| ID |
Date |
Author |
Subject |
|
315
|
Thu May 13 23:58:05 2021 |
OH | Friday 14th May 00:00 - 08:00 |
00:00 OH Takes over.
PULSER SETTINGS
---------------------------
Pulse is ON
Positive Tail Pulse
Trigger Source is Internal Clock
Trigger Threshold is 3.5
Amplitude : 2.0 Volts
Rep Rate : 2.0 hZ
Delay : 250.0 ns
Fall Time : 1 ms
Attenuation : 1
Display is : Volts
Equivalent keV is : 200.0
Ramp Start at 0.01 Volts
Ramp Stop at 9.99 Volts
Ramp Start at 1.0 keV
Ramp Stop at 999.0 keV
Ramp Time is 60 seconds
# Ramp Cycles is 1
OK
0x210
p+n Thresholds 0xa (100keV)
n+n Threshold 0x20 (320keV)
01:00 System wide checks
Clock status ok
ADC calibration fail as expected (Waveforms off)
WR Errors
Base Current Difference
aida01 fault 0xf932 : 0xf933 : 1
aida02 fault 0x62ec : 0x62ed : 1
aida03 fault 0x8679 : 0x867a : 1
aida04 fault 0xf0e4 : 0xf0e5 : 1
aida05 fault 0x9db8 : 0x9dbf : 7
aida06 fault 0x7f18 : 0x7f19 : 1
aida07 fault 0xdd2c : 0xdd2d : 1
aida08 fault 0x1557 : 0x1558 : 1
White Rabbit error counter test result: Passed 8, Failed 8
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
FPGA Errors
Base Current Difference
aida05 fault 0x0 : 0x2 : 2
FPGA Timestamp error counter test result: Passed 15, Failed 1
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last
Statistics ok - attachment 1
Temp ok - attachment 2
Bias and leakage current ok - attachment 3
01:42 Comparing the CS of AIDA3 and 4
Stats have been running for a while (Believe since 5am)
Looking at the counter ratio - attachment 4
We still have a deadtime of around 14% in FEE4 (Assuming FEE3 has no dead time)
01:56 Noticed /media/ThirdDrive was at 97% full
Let DESPEC locals know I would like to use the next run stop to change the directory.
They said they could do it now so they stopped their run.
Changed the symbolic link to /media/1e2....
Now writing to R4_
03:26 MBS DAQ Stopped as beam stopped
03:33 Beam back now and DAQ running again
04:44 System wide checks as before
Statistics ok - attachment 5
Temperatures ok - attachment - 7
Bias and leakage currents ok - attachment 6
05:53 MBS stops run as beam drops
06:00 MBS started a new run as beam is back
07:37 System wide checks clock ok and FPGA as before
WR additional difference on FEE5
Base Current Difference
aida01 fault 0xf932 : 0xf933 : 1
aida02 fault 0x62ec : 0x62ed : 1
aida03 fault 0x8679 : 0x867a : 1
aida04 fault 0xf0e4 : 0xf0e5 : 1
aida05 fault 0x9db8 : 0x9dc0 : 8
aida06 fault 0x7f18 : 0x7f19 : 1
aida07 fault 0xdd2c : 0xdd2d : 1
aida08 fault 0x1557 : 0x1558 : 1
White Rabbit error counter test result: Passed 8, Failed 8
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
Statistics ok - attachment 8
Temp ok - attachment 9
Bias and leakage ok - attachment 10
|
| Attachment 1: 210514_0100_Stats.png
|
|
| Attachment 2: 210514_0101_Temp.png
|
|
| Attachment 3: 210514_0102_Bias.png
|
|
| Attachment 4: 210514_0141_CS_Stats.png
|
|
| Attachment 5: 210514_0442_Stats.png
|
|
| Attachment 6: 210514_0443_Bias.png
|
|
| Attachment 7: 210514_0443_Temp.png
|
|
| Attachment 8: 210514_0737_Stats.png
|
|
| Attachment 9: 210514_0738_Temp.png
|
|
| Attachment 10: 210514_0739_Bias.png
|
|
| Attachment 11: Screenshot_2021-05-14_Spectrum_Browser_aidas-gsi.png
|
|
| Attachment 12: Screenshot_2021-05-14_Spectrum_Browser_aidas-gsi(1).png
|
.png.png "Screenshot_2021-05-14_Spectrum_Browser_aidas-gsi(1).png")
|
| Attachment 13: Screenshot_2021-05-14_Statistics_aidas-gsi.png
|
|
| Attachment 14: Screenshot_2021-05-14_Statistics_aidas-gsi(1).png
|
.png.png "Screenshot_2021-05-14_Statistics_aidas-gsi(1).png")
|
| Attachment 15: Screenshot_2021-05-14_Statistics_aidas-gsi(2).png
|
.png.png "Screenshot_2021-05-14_Statistics_aidas-gsi(2).png")
|
| Attachment 16: Screenshot_2021-05-14_Statistics_aidas-gsi(3).png
|
.png.png "Screenshot_2021-05-14_Statistics_aidas-gsi(3).png")
|
| Attachment 17: Screenshot_2021-05-14_Statistics_aidas-gsi(4).png
|
.png.png "Screenshot_2021-05-14_Statistics_aidas-gsi(4).png")
|
| Attachment 18: Screenshot_2021-05-14_Temperature_and_status_scan_aidas-gsi.png
|
|
| Attachment 19: Screenshot_2021-05-14_AIDA_Alerting_-_Grafana.png
|
|
| Attachment 20: 600.png
|
|
| Attachment 21: 601.png
|
|
|
314
|
Thu May 13 21:21:25 2021 |
Philippos and Marc | system wide checks |
Wide checks at Time 22:22 CET
Clock status test result: Passed 16, Failed 0
Understand status as follows
Status bit 3 : firmware PLL that creates clocks from external clock not locked
Status bit 2 : always logic '1'
Status bit 1 : LMK3200(2) PLL and clock distribution chip not locked to external clock
Status bit 0 : LMK3200(1) PLL and clock distribution chip not locked to external clock
If all these bits are not set then the operation of the firmware is unreliable
FEE64 module aida01 failed
FEE64 module aida02 failed
FEE64 module aida03 failed
FEE64 module aida04 failed
FEE64 module aida05 failed
FEE64 module aida06 failed
FEE64 module aida07 failed
FEE64 module aida08 failed
FEE64 module aida09 failed
FEE64 module aida10 failed
FEE64 module aida11 failed
FEE64 module aida12 failed
FEE64 module aida13 failed
FEE64 module aida14 failed
FEE64 module aida15 failed
FEE64 module aida16 failed
Calibration test result: Passed 0, Failed 16
If any modules fail calibration , check the clock status and open the FADC Align and Control browser page to rerun calibration for that module
Base Current Difference
aida01 fault 0xf932 : 0xf933 : 1
aida02 fault 0x62ec : 0x62ed : 1
aida03 fault 0x8679 : 0x867a : 1
aida04 fault 0xf0e4 : 0xf0e5 : 1
aida05 fault 0x9db8 : 0x9dbc : 4
aida06 fault 0x7f18 : 0x7f19 : 1
aida07 fault 0xdd2c : 0xdd2d : 1
aida08 fault 0x1557 : 0x1558 : 1
White Rabbit error counter test result: Passed 8, Failed 8
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
Base Current Difference
aida05 fault 0x0 : 0x2 : 2
FPGA Timestamp error counter test result: Passed 15, Failed 1
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last
Returned 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k
aida01 : 35 11 3 5 5 4 1 3 2 4 6 : 37876
aida02 : 20 5 4 3 2 5 2 4 3 3 6 : 37400
aida03 : 20 3 4 3 4 4 1 3 2 4 6 : 37640
aida04 : 25 6 2 3 4 4 3 3 3 3 6 : 37140
aida05 : 30 10 5 7 2 6 2 4 2 4 6 : 38776
aida06 : 21 11 4 4 3 5 2 4 3 3 6 : 37548
aida07 : 23 8 4 4 2 6 1 3 2 4 6 : 37852
aida08 : 27 7 2 3 4 3 2 4 3 3 6 : 37284
aida09 : 31 6 5 6 3 3 2 4 3 3 6 : 37372
aida10 : 22 5 3 4 3 6 2 2 2 4 6 : 37616
aida11 : 23 5 4 2 5 2 1 3 2 4 6 : 37444
aida12 : 20 7 4 7 3 5 2 3 3 3 6 : 37096
aida13 : 28 5 3 3 1 5 2 3 3 3 6 : 36840
aida14 : 38 12 2 4 2 4 1 4 3 3 6 : 37144
aida15 : 27 9 5 4 2 5 3 2 3 3 6 : 36740
aida16 : 21 6 4 4 1 4 2 3 3 3 6 : 36740
|
| Attachment 1: 2021-05-13_ucesb_scalers_22h22mn.png
|
|
| Attachment 2: 2021-05-13_Currents_22h22mn.png
|
|
| Attachment 3: 2021-05-13_temperatures_22h22.png
|
|
| Attachment 4: 2021-05-13-22h22mn_Stat-good-events.png
|
|
| Attachment 5: 2021-05-13-22h22mn_ADC-data-items.png
|
|
| Attachment 6: 2021-05-13_22h22mn-Correlation-info.png
|
|
| Attachment 7: 2021-05-13_22h22mn-Pause-info.png
|
|
| Attachment 8: 2021-05-13_22h22mn-Resume-Info.png
|
|
| Attachment 9: 2021-05-13_merger_22h22.png
|
|
| Attachment 10: 2021-05-13_22h22mn-LAY-ID1.png
|
|
| Attachment 11: 2021-05-13_22h22mn-LAY-ID2.png
|
|
| Attachment 12: 2021-05-13_22h22mn-LAY-ID3.png
|
|
| Attachment 13: 2021-05-13_22h22mn-LAY-ID4.png
|
|
|
313
|
Thu May 13 19:52:36 2021 |
Philippos and Marc | Connection problem |
At 20:15, We lost connection with AnyDesk.
Liliana restarted Anydesk on the AIDA DAQ PC. All seemed fine on AIDA DAQ but there was a more generic issue on the main DAQ, possibly the timesorter.
Helena restarted all after ~30mn and it's all working again now.
|
| Attachment 1: 2021-05-13_ucesb_scalers.png
|
|
|
312
|
Thu May 13 17:05:42 2021 |
Muneerah, MArc | Thu 13 May 04:00-00:00 |
19:08 System Check
Rates from ucesb below 1 kHz
Atachment 1 Stats
Atachment 2 Temperatures
Atachment 3 Voltages
System wide checks are all ok except
ADC calibration all failed
FEE64 module aida01 failed
FEE64 module aida02 failed
FEE64 module aida03 failed
FEE64 module aida04 failed
FEE64 module aida05 failed
FEE64 module aida06 failed
FEE64 module aida07 failed
FEE64 module aida08 failed
FEE64 module aida09 failed
FEE64 module aida10 failed
FEE64 module aida11 failed
FEE64 module aida12 failed
FEE64 module aida13 failed
FEE64 module aida14 failed
FEE64 module aida15 failed
FEE64 module aida16 failed
Calibration test result: Passed 0, Failed 16
If any modules fail calibration , check the clock status and open the FADC Align and Control browser page to rerun calibration for that module
White rabbit
Base Current Difference
aida01 fault 0xf932 : 0xf933 : 1
aida02 fault 0x62ec : 0x62ed : 1
aida03 fault 0x8679 : 0x867a : 1
aida04 fault 0xf0e4 : 0xf0e5 : 1
aida05 fault 0x9db8 : 0x9dba : 2
aida06 fault 0x7f18 : 0x7f19 : 1
aida07 fault 0xdd2c : 0xdd2d : 1
aida08 fault 0x1557 : 0x1558 : 1
White Rabbit error counter test result: Passed 8, Failed 8
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
FPGA all passed
Memory information
Returned 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k
aida01 : 6 2 2 1 2 4 3 4 2 3 7 : 40424
aida02 : 3 4 2 2 1 2 1 3 3 3 7 : 40140
aida03 : 10 10 0 3 2 4 2 4 2 3 7 : 40280
aida04 : 3 2 0 2 2 3 2 3 1 4 7 : 40540
aida05 : 4 9 2 3 2 4 3 3 1 4 7 : 41048
aida06 : 8 6 1 1 2 3 2 2 3 3 7 : 40064
aida07 : 1 4 0 1 1 3 1 3 3 3 7 : 40196
aida08 : 1 4 2 2 2 4 3 4 2 3 7 : 40452
aida09 : 8 5 2 2 1 2 1 3 3 3 7 : 40168
aida10 : 22 5 4 2 1 3 1 4 2 3 7 : 39872
aida11 : 2 1 2 1 2 2 3 3 2 3 7 : 39632
aida12 : 8 5 2 2 1 3 1 4 2 3 7 : 39784
aida13 : 18 8 2 1 0 2 3 3 2 3 7 : 39624
aida14 : 23 12 2 2 1 2 2 4 2 3 7 : 40028
aida15 : 3 5 3 2 2 3 1 4 2 3 7 : 39844
aida16 : 0 2 1 2 1 4 2 4 2 3 7 : 40096
|
| Attachment 1: 130521_1802_Stats.png
|
|
| Attachment 2: 130521_1802_Temp.png
|
|
| Attachment 3: 130521_1804_Voltages.png
|
|
|
311
|
Thu May 13 07:10:17 2021 |
CA, TD | May 13th 08:00 - 16:00 shift |
08:10 all system wide checks ok *except*
all FEE64 modules fail ADC calibration
WR decoder status:
Base Current Difference
aida01 fault 0xf932 : 0xf933 : 1
aida02 fault 0x62ec : 0x62ed : 1
aida03 fault 0x8679 : 0x867a : 1
aida04 fault 0xf0e4 : 0xf0e5 : 1
aida05 fault 0x9db8 : 0x9db9 : 1
aida06 fault 0x7f18 : 0x7f19 : 1
aida07 fault 0xdd2c : 0xdd2d : 1
aida08 fault 0x1557 : 0x1558 : 1
White Rabbit error counter test result: Passed 8, Failed 8
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
08:16 attempt to recalibrate ADCs using FADC align and control - unsuccessful on all
08:18 FEE64 temps ok - attachment 1
bias/leakage currents ok - attachment 2
statistics - attachments 3-8
10:13 all system wide checks ok *except*
all FEE64 modules fail ADC calibration
WR decoder status:
Base Current Difference
aida01 fault 0xf932 : 0xf933 : 1
aida02 fault 0x62ec : 0x62ed : 1
aida03 fault 0x8679 : 0x867a : 1
aida04 fault 0xf0e4 : 0xf0e5 : 1
aida05 fault 0x9db8 : 0x9db9 : 1
aida06 fault 0x7f18 : 0x7f19 : 1
aida07 fault 0xdd2c : 0xdd2d : 1
aida08 fault 0x1557 : 0x1558 : 1
White Rabbit error counter test result: Passed 8, Failed 8
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
10:16 FEE64 temps ok - attachment 9
bias/leakage currents ok - attachment 10
statistics - attachments 11-16
12:16 all system wide checks ok *except*
all FEE64 modules fail ADC calibration
WR decoder status:
Base Current Difference
aida01 fault 0xf932 : 0xf933 : 1
aida02 fault 0x62ec : 0x62ed : 1
aida03 fault 0x8679 : 0x867a : 1
aida04 fault 0xf0e4 : 0xf0e5 : 1
aida05 fault 0x9db8 : 0x9dba : 2
aida06 fault 0x7f18 : 0x7f19 : 1
aida07 fault 0xdd2c : 0xdd2d : 1
aida08 fault 0x1557 : 0x1558 : 1
White Rabbit error counter test result: Passed 8, Failed 8
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
12:16 FEE64 temps ok - attachment 17
bias/leakage currents ok - attachment 18
statistics - attachments 19-25
14:08 all system wide checks ok *except*
all FEE64 modules fail ADC calibration
WR decoder status:
Base Current Difference
aida01 fault 0xf932 : 0xf933 : 1
aida02 fault 0x62ec : 0x62ed : 1
aida03 fault 0x8679 : 0x867a : 1
aida04 fault 0xf0e4 : 0xf0e5 : 1
aida05 fault 0x9db8 : 0x9dba : 2
aida06 fault 0x7f18 : 0x7f19 : 1
aida07 fault 0xdd2c : 0xdd2d : 1
aida08 fault 0x1557 : 0x1558 : 1
White Rabbit error counter test result: Passed 8, Failed 8
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
FEE64 temps ok - attachment 16
bias/leakage currents ok - attachment 27
statistics - attachments 28-35 |
| Attachment 1: Screenshot_from_2021-05-13_07-17-47.png
|
|
| Attachment 2: Screenshot_from_2021-05-13_07-18-57.png
|
|
| Attachment 3: Screenshot_from_2021-05-13_07-19-42.png
|
|
| Attachment 4: Screenshot_from_2021-05-13_07-20-45.png
|
|
| Attachment 5: Screenshot_from_2021-05-13_07-23-01.png
|
|
| Attachment 6: Screenshot_from_2021-05-13_07-23-35.png
|
|
| Attachment 7: Screenshot_from_2021-05-13_07-24-02.png
|
|
| Attachment 8: Screenshot_from_2021-05-13_07-25-15.png
|
|
| Attachment 9: Screenshot_from_2021-05-13_09-17-57.png
|
|
| Attachment 10: Screenshot_from_2021-05-13_09-18-21.png
|
|
| Attachment 11: Screenshot_from_2021-05-13_09-18-58.png
|
|
| Attachment 12: Screenshot_from_2021-05-13_09-19-32.png
|
|
| Attachment 13: Screenshot_from_2021-05-13_09-20-23.png
|
|
| Attachment 14: Screenshot_from_2021-05-13_09-21-05.png
|
|
| Attachment 15: Screenshot_from_2021-05-13_09-21-53.png
|
|
| Attachment 16: Screenshot_from_2021-05-13_09-22-18.png
|
|
| Attachment 17: Screenshot_from_2021-05-13_11-19-16.png
|
|
| Attachment 18: Screenshot_from_2021-05-13_11-19-30.png
|
|
| Attachment 19: Screenshot_from_2021-05-13_11-20-09.png
|
|
| Attachment 20: Screenshot_from_2021-05-13_11-20-33.png
|
|
| Attachment 21: Screenshot_from_2021-05-13_11-20-59.png
|
|
| Attachment 22: Screenshot_from_2021-05-13_11-21-29.png
|
|
| Attachment 23: Screenshot_from_2021-05-13_11-21-53.png
|
|
| Attachment 24: Screenshot_from_2021-05-13_11-22-30.png
|
|
| Attachment 25: Screenshot_from_2021-05-13_11-24-36.png
|
|
| Attachment 26: Screenshot_from_2021-05-13_13-09-43.png
|
|
| Attachment 27: Screenshot_from_2021-05-13_13-10-03.png
|
|
| Attachment 28: Screenshot_from_2021-05-13_13-10-28.png
|
|
| Attachment 29: Screenshot_from_2021-05-13_13-10-52.png
|
|
| Attachment 30: Screenshot_from_2021-05-13_13-11-22.png
|
|
| Attachment 31: Screenshot_from_2021-05-13_13-11-51.png
|
|
| Attachment 32: Screenshot_from_2021-05-13_13-12-24.png
|
|
| Attachment 33: Screenshot_from_2021-05-13_13-13-34.png
|
|
| Attachment 34: Screenshot_from_2021-05-13_13-14-16.png
|
|
|
310
|
Thu May 13 00:51:40 2021 |
Muneerah and OH | Thu 13 May 00:00-08:00 |
01:50 Beam on
The leakage current and the voltages been monitered every half an hour and logged in the excel sheet, looks decreasing.
Tempetratures OK
Rates OK
Attachment 1 Voltages
Atachment 2 Rates
Atachment 3 Temperatures
Attachment 4 ucesb rates less than 1 kHz
System wide check are ok except:
Base Current Difference
aida05 fault 0x36ca : 0x36ce : 4
White Rabbit error counter test result: Passed 15, Failed 1
Understand the status reports as follows:
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
Base Current Difference
aida13 fault 0xa : 0xe9 : 223
FPGA Timestamp error counter test result: Passed 15, Failed 1
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last
Returned 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k
aida01 : 0 5 3 0 1 4 3 3 3 3 6 : 36760
aida02 : 7 9 0 2 2 4 2 3 3 3 6 : 36644
aida03 : 1 3 2 1 2 1 2 3 3 3 6 : 36188
aida04 : 3 1 2 0 2 3 2 3 3 3 6 : 36404
aida05 : 20 9 3 2 2 3 2 2 3 3 6 : 36104
aida06 : 4 10 0 2 2 4 2 2 3 3 6 : 36128
aida07 : 3 1 2 1 3 3 2 3 3 3 6 : 36500
aida08 : 2 4 3 2 3 4 2 3 2 3 6 : 35672
aida09 : 1 6 3 3 1 4 2 3 2 3 6 : 35588
aida10 : 5 6 4 2 1 3 2 3 2 3 6 : 35460
aida11 : 23 8 2 2 2 3 3 4 2 3 6 : 36348
aida12 : 8 4 2 2 2 3 2 4 2 3 6 : 36000
aida13 : 2 5 3 1 2 4 3 3 2 3 6 : 35840
aida14 : 3 6 2 2 2 3 2 4 2 3 6 : 35996
aida15 : 2 4 3 3 0 4 1 3 3 3 6 : 36280
aida16 : 7 7 5 1 3 4 2 3 2 3 6 : 35716
<strong>05:00 OH Took over at 04:00</strong>
System wide checks ok except
Base Current Difference
aida05 fault 0x36ca : 0x36d0 : 6
White Rabbit error counter test result: Passed 15, Failed 1
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
Base Current Difference
aida05 fault 0x0 : 0x1 : 1
aida13 fault 0xa : 0xe9 : 223
FPGA Timestamp error counter test result: Passed 14, Failed 2
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last
05:41 AIDA 05 has dropped out. Will restart the system
05:58 DAQ recovered from powercycle
p+n strips at 0xa
n+n strips at 0x20
ADC control register at 0xFF
All waveforms turned off in LED
Statistics - attachment 5
Correlation scaler in FEE 3 and 4 are mostly tracking 1:1
06:34 Local users have been unable to recover MBS
And have been unable to contact local experts
07:22 Bias and leakage currents ok - attachment 6
Stats attachment -7 |
| Attachment 1: 130521_0155_Voltages.png
|
|
| Attachment 2: 130521_0157_Stats.png
|
|
| Attachment 3: 130521_0158_Temp.png
|
|
| Attachment 4: 130521_0204_ucesb.png
|
|
| Attachment 5: 210513_0600_Stats.png
|
|
| Attachment 6: 210513_0722_bias.png
|
|
| Attachment 7: 210513_0722_Stats.png
|
|
|
309
|
Wed May 12 18:53:38 2021 |
JS | Wed 12 20:00-00:00 |
19:51 Shift change
Stats ok
ucesb ok, Max implants ~1500 Hz
20:30
Stats ok
ucesb ok, Max implants ~1000 Hz
current ok (maybe leveling out)
20:51
The online people are starting a new sort and are going to change some things with degraders I think. We are on R1_340.
20:59
Check
Clock status test result: Passed 16, Failed 0
Calibration test result: Passed 16, Failed 0
WR:
Base Current Difference
aida05 fault 0x36ca : 0x36ce : 4
White Rabbit error counter test result: Passed 15, Failed 1
FPGA time:
Base Current Difference
aida13 fault 0xa : 0xb6 : 172
FPGA Timestamp error counter test result: Passed 15, Failed 1
--- both errors above same module as earlier shift
Returned 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k
aida01 : 1 3 2 0 1 3 3 2 3 3 6 : 36092
aida02 : 6 4 4 2 2 3 1 3 3 3 6 : 36280
aida03 : 6 3 2 0 0 3 3 2 3 3 6 : 36048
aida04 : 10 3 1 1 3 3 1 3 3 3 6 : 36272
aida05 : 19 8 2 0 2 3 1 3 3 3 6 : 36268
aida06 : 2 2 0 2 3 4 2 2 3 3 6 : 36120
aida07 : 6 7 3 0 3 4 3 2 3 3 6 : 36416
aida08 : 7 5 4 0 3 2 2 3 3 3 6 : 36420
aida09 : 21 6 3 2 2 4 2 3 2 3 6 : 35700
aida10 : 13 3 1 1 3 3 1 4 2 3 6 : 35772
aida11 : 25 6 4 2 1 4 2 4 2 3 6 : 36180
aida12 : 0 4 0 3 2 3 3 3 2 3 6 : 35712
aida13 : 18 5 2 3 2 3 2 4 2 3 6 : 36080
aida14 : 2 1 1 1 2 3 2 4 2 3 6 : 35904
aida15 : 0 1 1 3 0 4 2 2 3 3 6 : 35960
aida16 : 4 5 3 2 3 4 1 3 2 3 6 : 35432
ucesb ok elog:309/1
current ok elog:309/2
Stats ok elog:309/3
temps ok elog:309/4
21:36
ucesb ok
Stats ok
22:01
ucesb ok 1500 Hz peak implant
Stats ok
temps ok
bias ok - earlier rise seems to have stopped, 0.2uA fluctuations on values.
22:20 Nic noted that they were seeing fewer y-strips events (x agreed with FRS rate).
Dead time was suggested as a problem. Oscar investigating, good event rate in midas doesn't show significant dead time.
Looking at the difference in FEEs3 & 4, which should have the same scaler rate but don't, suggestion data lost in the pause and resume.
Oscar is going to raise the threshold on one of the y FEEs as a test
Increased aida4 slow comparator threshold changed
There is some confusion as it seems to be dead time but apart rates shown look low enough, dead time is possibly masking true rate?
Results of test, need thresholds 100keV on p+n and 320keV n+n to get a roughly 1:1 between FEE3 and FEE4 scaler
23:40 FRS magnet issue, possibly power, no beam
00:03 bias ok elog:309/5 has come down because no beam
handing over to muneerah |
| Attachment 1: ucesb.png
|
|
| Attachment 2: bias1.png
|
|
| Attachment 3: Screenshot_2021-05-12_Statistics_aidas-gsi.png
|
|
| Attachment 4: Screenshot_2021-05-12_Temperature_and_status_scan_aidas-gsi.png
|
|
| Attachment 5: bias2.png
|
|
|
308
|
Wed May 12 15:03:10 2021 |
CB, OH | Wed 12 16:00-20:00 |
16:00 Shift change
Statistics OK (attach 1)
Temps OK (attach 2)
Bias OK (attach 3)
System wide checks
Clock, ADC - OK
WR
Base Current Difference
aida05 fault 0x36ca : 0x36cb : 1
White Rabbit error counter test result: Passed 15, Failed 1
FPGA
Base Current Difference
aida13 fault 0xa : 0x4b : 65
FPGA Timestamp error counter test result: Passed 15, Failed 1
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last
Returned 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k
aida01 : 15 5 6 1 1 2 2 3 3 3 6 : 36388
aida02 : 21 10 2 2 2 3 2 2 3 3 6 : 36100
aida03 : 25 5 3 1 0 3 3 2 3 3 6 : 36188
aida04 : 5 2 0 3 2 3 2 3 3 3 6 : 36484
aida05 : 16 6 3 1 2 4 1 3 2 4 6 : 37440
aida06 : 2 2 2 2 2 3 1 3 3 3 6 : 36216
aida07 : 16 9 3 0 3 4 3 2 3 3 6 : 36472
aida08 : 0 7 1 1 2 2 3 3 2 3 6 : 35560
aida09 : 15 7 4 2 2 4 2 3 2 3 6 : 35700
aida10 : 3 7 3 4 1 3 1 4 1 4 6 : 36788
aida11 : 5 1 3 1 1 4 3 3 2 3 6 : 35756
aida12 : 5 5 0 3 2 3 2 4 2 3 6 : 35996
aida13 : 2 5 1 2 2 4 3 3 2 3 6 : 35840
aida14 : 19 5 3 1 1 2 1 3 3 3 6 : 36100
aida15 : 20 6 6 2 1 3 2 2 3 3 6 : 36064
aida16 : 7 9 4 1 3 4 2 3 2 3 6 : 35716
File size change
Collecting the file size of each FEE64 Options CONTENTS file to check they are all the same
FEE : aida01 => Options file size is 1026 Last changed Mon May 10 16:47:51 CEST 2021
FEE : aida02 => Options file size is 1014 Last changed Thu Apr 29 14:43:46 CEST 2021
FEE : aida03 => Options file size is 1014 Last changed Thu Apr 29 14:43:50 CEST 2021
FEE : aida04 => Options file size is 1014 Last changed Thu Apr 29 14:43:53 CEST 2021
FEE : aida05 => Options file size is 1014 Last changed Thu Apr 29 14:43:55 CEST 2021
FEE : aida06 => Options file size is 1014 Last changed Thu Apr 29 14:43:59 CEST 2021
FEE : aida07 => Options file size is 1014 Last changed Thu Apr 29 14:44:02 CEST 2021
FEE : aida08 => Options file size is 1025 Last changed Wed May 05 12:15:54 CEST 2021
FEE : aida09 => Options file size is 1014 Last changed Thu Apr 29 14:44:08 CEST 2021
FEE : aida10 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021
FEE : aida11 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021
FEE : aida12 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021
FEE : aida13 => Options file size is 1025 Last changed Fri May 07 19:40:34 CEST 2021
FEE : aida14 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021
FEE : aida15 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021
FEE : aida16 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021
16:20 Beam is back. Currently on File R1_200
16:43 Beam is being optimised.
17:00 UCESB OK
Stats OK (attach 4)
Temps OK
Bias OK (attach 5)
System-wide checks as before
17:30 Beam rate is quite high (up to 2000 Hz peak on ucesb). Stats still OK
17:52 Started compressing R1_1*
18:00 UCESB ok (attach 5)
Stats OK (attach 6)
Temps OK
Bias OK (attach 7)
System wide checks as before
19:00 UCESB ok (as before)
Stats OK (attach 8)
Temps OK
Bias OK (attach 9)
Merger OK (attach 10)
19:32 UCESB ok
Stats OK (attach 11)
Temps OK (attach 12)
Bias OK (attach 13)
System wide checks as before
19:51 Shift handed over to James S |
| Attachment 1: Stat1.png
|
|
| Attachment 2: Temp1.png
|
|
| Attachment 3: Bias1.png
|
|
| Attachment 4: Stats2.png
|
|
| Attachment 5: Bias2.png
|
|
| Attachment 6: Stats3.png
|
|
| Attachment 7: Bias3.png
|
|
| Attachment 8: ucesb1.png
|
|
| Attachment 9: Stats4.png
|
|
| Attachment 10: Bias4.png
|
|
| Attachment 11: Merger.png
|
|
| Attachment 12: ucesb2.png
|
|
| Attachment 13: Stats5.png
|
|
| Attachment 14: Temps2.png
|
|
| Attachment 15: Bias5.png
|
|
|
307
|
Wed May 12 06:59:55 2021 |
OH, RDP | Wed 12 May 08:00-16:00 |
08:00 While the rates appeared to have quietened around 7am they are back to their previous rate now.
They still seem to be working on the setting. Implant rate in AIDA about 8 per spill. Thick degrader is still in place
They have collected 25 minutes of implantation data. They are analysing this data to confirm the PID
08:38 The PID confirmation was apparently run number 4. During this run they were implanting Cd in AIDA DSSD2
09:09 They are now taking data implanting somewhere in the snout. I have turned off no storage.
Unfortunately we are writing to NOTAPE R3. I was unable to change it as they were already taking data
Data rate 16.3MB/s
ucesb shows similar rates in SC42 and AIDA01. We may be implanting Te in AIDA then.
09:35 They stopped the DAQ as their is no beam. Switched the tapeserver over to R1 in directory S496. Setting to no storage
09:47 Beam back turned off no storage. On file R1_10
11:04 Now that we have implants on the detector we get a better look at the strips
From the 1d pattern it is obvious that there is an adapter card misaligned in DSSD1- attachments 1 and 2
This adaptor board corresponds to FEE11
12:17 Leakage currents screenshot 512.png
13:30 Beam off. Expected back at 15:00...
14:09 Making use of the beam off time NH and HA entered S4 to investigate FEE1 and FEE11.
They noticed FEE11 was off and have realigned that. All channels are now observed in that FEE
They couldn't see anything wrong with the connector for FEE1. We are still missing a block of channels there.
Rates are as before. No better, no worse.
15:31 Leakage currents screenshot 513.png. They are continuing to rise following the intervention in S4. It could just be because the temperature is rising... |
| Attachment 1: 1dImplants.png
|
|
| Attachment 2: 1dImplants2.png
|
|
| Attachment 3: 512.png
|
|
| Attachment 4: 513.png
|
|
|
306
|
Wed May 12 02:07:59 2021 |
MA, BA | Wed 12 May 00:00-08:00 |
03:12 System Check
attachment 1 : Current
attachment 2 : Temperature
attachment 3 : Rates
Clock status test result: Passed 16, Failed 0
Understand status as follows
Status bit 3 : firmware PLL that creates clocks from external clock not locked
Status bit 2 : always logic '1'
Status bit 1 : LMK3200(2) PLL and clock distribution chip not locked to external clock
Status bit 0 : LMK3200(1) PLL and clock distribution chip not locked to external clock
If all these bits are not set then the operation of the firmware is unreliable
Calibration test result: Passed 16, Failed 0
If any modules fail calibration , check the clock status and open the FADC Align and Control browser page to rerun calibration for that module
Base Current Difference
aida05 fault 0x36ca : 0x36cb : 1
White Rabbit error counter test result: Passed 15, Failed 1
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
Base Current Difference
aida13 fault 0xa : 0xf : 5
FPGA Timestamp error counter test result: Passed 15, Failed 1
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last
Returned 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k
aida01 : 22 5 7 2 1 2 2 3 3 3 6 : 36464
aida02 : 9 8 3 3 1 4 1 2 4 3 6 : 36916
aida03 : 5 2 6 2 0 3 2 3 3 3 6 : 36420
aida04 : 6 5 2 3 4 4 2 3 3 3 6 : 36800
aida05 : 17 6 6 2 2 4 1 3 2 4 6 : 37524
aida06 : 7 12 3 4 3 3 1 3 3 3 6 : 36460
aida07 : 17 11 5 1 3 3 3 2 3 3 6 : 36428
aida08 : 3 5 0 1 4 2 2 4 2 3 6 : 35924
aida09 : 27 6 4 2 0 2 2 2 3 3 6 : 35868
aida10 : 16 11 8 0 2 2 1 3 2 4 6 : 37272
aida11 : 15 2 2 3 1 4 3 4 2 3 6 : 36364
aida12 : 1 6 4 3 1 3 2 4 2 3 6 : 35988
aida13 : 22 14 10 2 4 2 2 4 2 3 6 : 36264
aida14 : 26 10 4 3 2 1 1 3 3 3 6 : 36184
aida15 : 14 2 3 2 2 4 1 2 3 3 6 : 35896
aida16 : 7 5 4 0 2 4 2 3 2 3 6 : 35588
06:10 DSSD1 rate high!
Attached 4
Called OH and he woke up to fix it :)
It was a problem with one of the ASIC according to what he says:
One of the ASICs HEC was running crazy!. Forced the ASICs to check their settings which brings them to back into line see attachment 9. This done by around 06:35
07:03 System check
attachment 5 Spectrum rate
attachment 6 Voltages
attachment 7 Rates
attachment 8 Temperature
System wide clock are all ok except
White rabbit
Base Current Difference
aida05 fault 0x36ca : 0x36cb : 1
White Rabbit error counter test result: Passed 15, Failed 1
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
FPGA
Base Current Difference
aida13 fault 0xa : 0x14 : 10
FPGA Timestamp error counter test result: Passed 15, Failed 1
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last
|
| Attachment 1: 1205_0310.png
|
|
| Attachment 2: 1205_0311.png
|
|
| Attachment 3: 1205_0312.png
|
|
| Attachment 4: 120521_0630ucesb.png
|
|
| Attachment 5: 120521_0639_SpecRates.png
|
|
| Attachment 6: 120521_0655_Voltages.png
|
|
| Attachment 7: 120521_0657_Rates.png
|
|
| Attachment 8: 120521_0685_Temp.png
|
|
| Attachment 9: 120521_0635_ASICs.png
|
|
|
305
|
Tue May 11 07:21:24 2021 |
OH | Tuesday 11 May |
08:20 System wide checks all ok except
Base Current Difference
aida01 fault 0xc10c : 0xc10e : 2
aida02 fault 0xbe2a : 0xbe2c : 2
aida03 fault 0xf665 : 0xf667 : 2
aida04 fault 0xeabd : 0xeabf : 2
aida05 fault 0x36c8 : 0x36ca : 2
aida06 fault 0x2ea2 : 0x2ea4 : 2
aida07 fault 0x9186 : 0x9188 : 2
aida08 fault 0x5443 : 0x5445 : 2
White Rabbit error counter test result: Passed 8, Failed 8
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
and
Base Current Difference
aida01 fault 0xc10c : 0xc10e : 2
aida02 fault 0xbe2a : 0xbe2c : 2
aida03 fault 0xf665 : 0xf667 : 2
aida04 fault 0xeabd : 0xeabf : 2
aida05 fault 0x36c8 : 0x36ca : 2
aida06 fault 0x2ea2 : 0x2ea4 : 2
aida07 fault 0x9186 : 0x9188 : 2
aida08 fault 0x5443 : 0x5445 : 2
White Rabbit error counter test result: Passed 8, Failed 8
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
Statistics still high - attachment 1
Temperatures ok - attachment 2
Bias and leakage currents ok - attachment 3 |
| Attachment 1: 210511_0823_Stats.png
|
|
| Attachment 2: 210511_0824_Temp.png
|
|
| Attachment 3: 210511_0825_Bias.png
|
|
|
304
|
Mon May 10 11:45:15 2021 |
NH | Confusing behaviour of rates |
Testing the behaviour of powering down the fast ADCs in aida01 (the hot FEE)
Set local control 2 to 0xff in aida01
Wait... see temperature drpos by ~3 degrees (PJCS reports much larger drop in T9)
So far so normal
*but*
aida05 rates go very high when this waveform is disabled!!
Set local control to 0x00 again
They drop back...
Recalibrated FADCs and back to normal |
|
303
|
Mon May 10 08:49:37 2021 |
TD | Monday 10 May |
09.51 All system wide checks OK *except*
Base Current Difference
aida05 fault 0x8441 : 0x8442 : 1
aida06 fault 0xc5c5 : 0xc5c6 : 1
aida07 fault 0x6f07 : 0x6f08 : 1
aida08 fault 0x4814 : 0x4815 : 1
White Rabbit error counter test result: Passed 12, Failed 4
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
Returned 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k
aida01 : 1 4 6 3 5 5 2 3 2 3 6 : 36004
aida02 : 4 1 3 6 3 4 3 3 2 3 6 : 36040
aida03 : 12 8 5 2 3 3 3 4 2 3 6 : 36416
aida04 : 1 2 5 4 1 4 3 4 2 3 6 : 36388
aida05 : 22 8 4 2 4 5 1 4 1 4 6 : 37272
aida06 : 5 4 0 6 3 6 3 3 2 3 6 : 36276
aida07 : 38 16 7 7 1 6 1 3 3 3 6 : 37032
aida08 : 16 4 2 3 1 4 1 3 3 3 6 : 36384
aida09 : 2 3 7 6 5 5 2 3 2 3 6 : 36112
aida10 : 42 15 4 6 2 6 2 4 2 3 6 : 36768
aida11 : 1 5 13 7 3 3 3 3 2 3 6 : 36124
aida12 : 23 9 3 4 7 3 2 3 2 3 6 : 35988
aida13 : 2 6 7 3 4 4 3 2 2 3 6 : 35592
aida14 : 17 11 3 4 3 5 2 3 2 3 6 : 35980
aida15 : 4 7 5 2 1 6 2 3 2 3 6 : 35864
aida16 : 4 1 3 3 4 2 3 4 2 3 6 : 36264
Collecting the file size of each FEE64 Options CONTENTS file to check they are all the same
FEE : aida01 => Options file size is 1026 Last changed Sun May 09 15:10:52 CEST 2021
FEE : aida02 => Options file size is 1014 Last changed Thu Apr 29 14:43:46 CEST 2021
FEE : aida03 => Options file size is 1014 Last changed Thu Apr 29 14:43:50 CEST 2021
FEE : aida04 => Options file size is 1014 Last changed Thu Apr 29 14:43:53 CEST 2021
FEE : aida05 => Options file size is 1014 Last changed Thu Apr 29 14:43:55 CEST 2021
FEE : aida06 => Options file size is 1014 Last changed Thu Apr 29 14:43:59 CEST 2021
FEE : aida07 => Options file size is 1014 Last changed Thu Apr 29 14:44:02 CEST 2021
FEE : aida08 => Options file size is 1025 Last changed Wed May 05 12:15:54 CEST 2021
FEE : aida09 => Options file size is 1014 Last changed Thu Apr 29 14:44:08 CEST 2021
FEE : aida10 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021
FEE : aida11 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021
FEE : aida12 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021
FEE : aida13 => Options file size is 1025 Last changed Fri May 07 19:40:34 CEST 2021
FEE : aida14 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021
FEE : aida15 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021
FEE : aida16 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021
09.52 All histograms, stats and merger stats zero'd
FEE64 temps OK - attachment 1
ADC data, disc/WR 28-27/pause/correlation stats OK - attachments 2-6
Rate spectra - attachment 7
ASIC check load
Rate spectra - attachment 8
1.8.W spectra 20us FSR - attachments 9 & 10
Grafana - most recent 7 days DSSSD bias and leakage current - attachment 11
Merger stats/tape server/merger - attachment 12
DSSSD bias and leakage current OK - attachment 13
10.08 1.8.W spectra 20us, 200us, 2ms & 20ms FSR - attachments 14-21
we are not missing extrinsic noise features at longer time ranges cf. 20us FSR
12.18 Cannot connect to port 8015, MIDAS terminal says "Killed"
Restart MIDAS 8015
Collect FPGA baseline to avoid TCL error
FEEs unaffected and running as before
13.25 FEEs power cycled to see if any change in weird noise/rates situation
No change
ASICs synchronised and back to normal
14.34 Start a pulser walkthrough in May21/R10
Attenuation 5x, Rep Rate 25 Hz
Amplitudes 10..9...1
14.45 Back to 2 Hz @ 2V Pulser, walkthrough complete. No Storage again.
PULSER SETTINGS
---------------------------
Pulse is ON
Positive Tail Pulse
Trigger Source is Internal Clock
Trigger Threshold is 3.5
Amplitude : 2.0 Volts
Rep Rate : 2.0 hZ
Delay : 250.0 ns
Fall Time : 1 ms
Attenuation : 1
Display is : Volts
Equivalent keV is : 200.0 (NB. actually it is 12 MeV)
Ramp Start at 0.01 Volts
Ramp Stop at 9.99 Volts
Ramp Start at 1.0 keV
Ramp Stop at 999.0 keV
Ramp Time is 60 seconds
# Ramp Cycles is 1
OK |
| Attachment 1: Screenshot_2021-05-10_Temperature_and_status_scan_aidas-gsi.png
|
|
| Attachment 2: Screenshot_2021-05-10_Statistics_aidas-gsi.png
|
|
| Attachment 3: Screenshot_2021-05-10_Statistics_aidas-gsi(1).png
|
.png.png "Screenshot_2021-05-10_Statistics_aidas-gsi(1).png")
|
| Attachment 4: Screenshot_2021-05-10_Statistics_aidas-gsi(2).png
|
.png.png "Screenshot_2021-05-10_Statistics_aidas-gsi(2).png")
|
| Attachment 5: Screenshot_2021-05-10_Statistics_aidas-gsi(3).png
|
.png.png "Screenshot_2021-05-10_Statistics_aidas-gsi(3).png")
|
| Attachment 6: Screenshot_2021-05-10_Statistics_aidas-gsi(4).png
|
.png.png "Screenshot_2021-05-10_Statistics_aidas-gsi(4).png")
|
| Attachment 7: Screenshot_2021-05-10_Spectrum_Browser_aidas-gsi.png
|
|
| Attachment 8: Screenshot_2021-05-10_Spectrum_Browser_aidas-gsi(1).png
|
.png.png "Screenshot_2021-05-10_Spectrum_Browser_aidas-gsi(1).png")
|
| Attachment 9: Screenshot_2021-05-10_Spectrum_Browser_aidas-gsi(2).png
|
.png.png "Screenshot_2021-05-10_Spectrum_Browser_aidas-gsi(2).png")
|
| Attachment 10: Screenshot_2021-05-10_Spectrum_Browser_aidas-gsi(3).png
|
.png.png "Screenshot_2021-05-10_Spectrum_Browser_aidas-gsi(3).png")
|
| Attachment 11: Screenshot_2021-05-10_AIDA_Alerting_-_Grafana.png
|
|
| Attachment 12: 510.png
|
|
| Attachment 13: 511.png
|
|
| Attachment 14: Screenshot_2021-05-10_Spectrum_Browser_aidas-gsi(4).png
|
.png.png "Screenshot_2021-05-10_Spectrum_Browser_aidas-gsi(4).png")
|
| Attachment 15: Screenshot_2021-05-10_Spectrum_Browser_aidas-gsi(11).png
|
.png.png "Screenshot_2021-05-10_Spectrum_Browser_aidas-gsi(11).png")
|
| Attachment 16: Screenshot_2021-05-10_Spectrum_Browser_aidas-gsi(5).png
|
.png.png "Screenshot_2021-05-10_Spectrum_Browser_aidas-gsi(5).png")
|
| Attachment 17: Screenshot_2021-05-10_Spectrum_Browser_aidas-gsi(10).png
|
.png.png "Screenshot_2021-05-10_Spectrum_Browser_aidas-gsi(10).png")
|
| Attachment 18: Screenshot_2021-05-10_Spectrum_Browser_aidas-gsi(6).png
|
.png.png "Screenshot_2021-05-10_Spectrum_Browser_aidas-gsi(6).png")
|
| Attachment 19: Screenshot_2021-05-10_Spectrum_Browser_aidas-gsi(9).png
|
.png.png "Screenshot_2021-05-10_Spectrum_Browser_aidas-gsi(9).png")
|
| Attachment 20: Screenshot_2021-05-10_Spectrum_Browser_aidas-gsi(7).png
|
.png.png "Screenshot_2021-05-10_Spectrum_Browser_aidas-gsi(7).png")
|
| Attachment 21: Screenshot_2021-05-10_Spectrum_Browser_aidas-gsi(8).png
|
.png.png "Screenshot_2021-05-10_Spectrum_Browser_aidas-gsi(8).png")
|
|
302
|
Sun May 9 19:29:23 2021 |
TD | Sunday 9 May |
|
| Attachment 1: Screenshot_2021-05-09_Temperature_and_status_scan_aidas-gsi.png
|
|
| Attachment 2: Screenshot_2021-05-09_Statistics_aidas-gsi.png
|
|
| Attachment 3: Screenshot_2021-05-09_Statistics_aidas-gsi(1).png
|
.png.png "Screenshot_2021-05-09_Statistics_aidas-gsi(1).png")
|
| Attachment 4: Screenshot_2021-05-09_Statistics_aidas-gsi(2).png
|
.png.png "Screenshot_2021-05-09_Statistics_aidas-gsi(2).png")
|
| Attachment 5: Screenshot_2021-05-09_Statistics_aidas-gsi(3).png
|
.png.png "Screenshot_2021-05-09_Statistics_aidas-gsi(3).png")
|
| Attachment 6: Screenshot_2021-05-09_System_wide_Checks_aidas-gsi.png
|
|
| Attachment 7: Screenshot_2021-05-09_Spectrum_Browser_aidas-gsi.png
|
|
| Attachment 8: Screenshot_2021-05-09_Spectrum_Browser_aidas-gsi(1).png
|
.png.png "Screenshot_2021-05-09_Spectrum_Browser_aidas-gsi(1).png")
|
| Attachment 9: Screenshot_2021-05-09_Spectrum_Browser_aidas-gsi(2).png
|
.png.png "Screenshot_2021-05-09_Spectrum_Browser_aidas-gsi(2).png")
|
| Attachment 10: Screenshot_2021-05-09_Spectrum_Browser_aidas-gsi(3).png
|
.png.png "Screenshot_2021-05-09_Spectrum_Browser_aidas-gsi(3).png")
|
| Attachment 11: Screenshot_2021-05-09_Spectrum_Browser_aidas-gsi(4).png
|
.png.png "Screenshot_2021-05-09_Spectrum_Browser_aidas-gsi(4).png")
|
| Attachment 12: Screenshot_2021-05-09_AIDA_Alerting_-_Grafana.png
|
|
| Attachment 13: 503.png
|
|
| Attachment 14: 504.png
|
|
|
301
|
Sat May 8 09:05:04 2021 |
TD | Saturday 8 May |
09.54 FEE64 temperatures OK - attachment 1
ADC data item stats OK - attachment 2
p+n FEE64s 11x <100k, 1x <200k
Rate spectra - attachments 3 & 4
before and after ASIC check load
1.8.L spectra - attachments 5 & 6
1.8.W spectra 20us FSR - attachments 7 & 8
Disc, WR-28-47, pause, resume info data items - attachments 9-12
note large number pause/resume for aida13 - legacy numbers since last restart/zero?
attachment 16 for pause stats since stats zero at 10.02 - looks OK
Grafana DSSSD bias & leakage currents for most recent 48h OK - atatchment 13
DSSSD bias & leakage currents - attachment 14
Merger stats/merger/tape server messages - attachment 15
10.02 All histograms and stats zero'd
10.06 All system wide checks OK *except*
Collecting the file size of each FEE64 Options CONTENTS file to check they are all the same
FEE : aida01 => Options file size is 1026 Last changed Thu May 06 15:29:51 CEST 2021
FEE : aida02 => Options file size is 1014 Last changed Thu Apr 29 14:43:46 CEST 2021
FEE : aida03 => Options file size is 1014 Last changed Thu Apr 29 14:43:50 CEST 2021
FEE : aida04 => Options file size is 1014 Last changed Thu Apr 29 14:43:53 CEST 2021
FEE : aida05 => Options file size is 1014 Last changed Thu Apr 29 14:43:55 CEST 2021
FEE : aida06 => Options file size is 1014 Last changed Thu Apr 29 14:43:59 CEST 2021
FEE : aida07 => Options file size is 1014 Last changed Thu Apr 29 14:44:02 CEST 2021
FEE : aida08 => Options file size is 1025 Last changed Wed May 05 12:15:54 CEST 2021
FEE : aida09 => Options file size is 1014 Last changed Thu Apr 29 14:44:08 CEST 2021
FEE : aida10 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021
FEE : aida11 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021
FEE : aida12 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021
FEE : aida13 => Options file size is 1025 Last changed Fri May 07 19:40:34 CEST 2021
FEE : aida14 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021
FEE : aida15 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021
FEE : aida16 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021
10.25 Pulser peak width aida01 97 ch FWHM, aida02 350 ch FWHM
peak widths are increasing cf. earlier this week - see https://elog.ph.ed.ac.uk/DESPEC/291 , https://elog.ph.ed.ac.uk/DESPEC/298 |
| Attachment 1: Screenshot_2021-05-08_Temperature_and_status_scan_aidas-gsi.png
|
|
| Attachment 2: Screenshot_2021-05-08_Statistics_aidas-gsi.png
|
|
| Attachment 3: Screenshot_2021-05-08_Spectrum_Browser_aidas-gsi.png
|
|
| Attachment 4: Screenshot_2021-05-08_Spectrum_Browser_aidas-gsi(1).png
|
.png.png "Screenshot_2021-05-08_Spectrum_Browser_aidas-gsi(1).png")
|
| Attachment 5: Screenshot_2021-05-08_Spectrum_Browser_aidas-gsi(2).png
|
.png.png "Screenshot_2021-05-08_Spectrum_Browser_aidas-gsi(2).png")
|
| Attachment 6: Screenshot_2021-05-08_Spectrum_Browser_aidas-gsi(3).png
|
.png.png "Screenshot_2021-05-08_Spectrum_Browser_aidas-gsi(3).png")
|
| Attachment 7: Screenshot_2021-05-08_Spectrum_Browser_aidas-gsi(4).png
|
.png.png "Screenshot_2021-05-08_Spectrum_Browser_aidas-gsi(4).png")
|
| Attachment 8: Screenshot_2021-05-08_Spectrum_Browser_aidas-gsi(5).png
|
.png.png "Screenshot_2021-05-08_Spectrum_Browser_aidas-gsi(5).png")
|
| Attachment 9: Screenshot_2021-05-08_Statistics_aidas-gsi(1).png
|
.png.png "Screenshot_2021-05-08_Statistics_aidas-gsi(1).png")
|
| Attachment 10: Screenshot_2021-05-08_Statistics_aidas-gsi(2).png
|
.png.png "Screenshot_2021-05-08_Statistics_aidas-gsi(2).png")
|
| Attachment 11: Screenshot_2021-05-08_Statistics_aidas-gsi(3).png
|
.png.png "Screenshot_2021-05-08_Statistics_aidas-gsi(3).png")
|
| Attachment 12: Screenshot_2021-05-08_Statistics_aidas-gsi(4).png
|
.png.png "Screenshot_2021-05-08_Statistics_aidas-gsi(4).png")
|
| Attachment 13: Screenshot_2021-05-08_AIDA_Alerting_-_Grafana.png
|
|
| Attachment 14: 500.png
|
|
| Attachment 15: 501.png
|
|
| Attachment 16: Screenshot_2021-05-08_Statistics_aidas-gsi(5).png
|
.png.png "Screenshot_2021-05-08_Statistics_aidas-gsi(5).png")
|
| Attachment 17: Screenshot_2021-05-08_Statistics_aidas-gsi(5).png
|
.png.png "Screenshot_2021-05-08_Statistics_aidas-gsi(5).png")
|
| Attachment 18: Screenshot_2021-05-08_Statistics_aidas-gsi(6).png
|
.png.png "Screenshot_2021-05-08_Statistics_aidas-gsi(6).png")
|
| Attachment 19: Screenshot_2021-05-08_Temperature_and_status_scan_aidas-gsi(1).png
|
.png.png "Screenshot_2021-05-08_Temperature_and_status_scan_aidas-gsi(1).png")
|
| Attachment 20: Screenshot_2021-05-08_Spectrum_Browser_aidas-gsi(6).png
|
.png.png "Screenshot_2021-05-08_Spectrum_Browser_aidas-gsi(6).png")
|
| Attachment 21: Screenshot_2021-05-08_Spectrum_Browser_aidas-gsi(7).png
|
.png.png "Screenshot_2021-05-08_Spectrum_Browser_aidas-gsi(7).png")
|
| Attachment 22: Screenshot_2021-05-08_Spectrum_Browser_aidas-gsi(8).png
|
.png.png "Screenshot_2021-05-08_Spectrum_Browser_aidas-gsi(8).png")
|
| Attachment 23: Screenshot_2021-05-08_Statistics_aidas-gsi(7).png
|
.png.png "Screenshot_2021-05-08_Statistics_aidas-gsi(7).png")
|
| Attachment 24: Screenshot_2021-05-08_Statistics_aidas-gsi(8).png
|
.png.png "Screenshot_2021-05-08_Statistics_aidas-gsi(8).png")
|
| Attachment 25: Screenshot_2021-05-08_Statistics_aidas-gsi(9).png
|
.png.png "Screenshot_2021-05-08_Statistics_aidas-gsi(9).png")
|
| Attachment 26: Screenshot_2021-05-08_Spectrum_Browser_aidas-gsi(9).png
|
.png.png "Screenshot_2021-05-08_Spectrum_Browser_aidas-gsi(9).png")
|
| Attachment 27: Screenshot_2021-05-08_Statistics_aidas-gsi(10).png
|
.png.png "Screenshot_2021-05-08_Statistics_aidas-gsi(10).png")
|
|
300
|
Fri May 7 19:47:54 2021 |
PJCS | HowTo mitigate excessive temperature in an FEE64 |
After tests in the Daresbury T9 system.
Disabling the waveform ADCs in an FEE64 which is running with the FPGA over temperature will drop the FPGA temperature by 10 degrees.
To disable the ADCs open the Local Control browser window and set the ADC Control register , @2, to 0xFF
The easiest way to restart the waveform ADCs correctly is to rerun SETUP from the control window selecting just the FEE that is affected.
Alternatively STOP acquisition, set the ADC Control register back to 0 and rerun the calibrate ADCs in the FADC Align and Control browser window.
|
|
299
|
Fri May 7 13:11:22 2021 |
NH | Friday 7th May |
14:11 - Alpha has been running most of morning
Just saw rates in tape spike to 6 MB/s...
Stop output to tape and look:
ASIC check & load... all rates except aida04 back to 0
Start output to tape
Back to ~300 KB/s
R6_49 will be affected by this.
Others seem OK
System wide check failures:
Base Current Difference
aida01 fault 0xb405 : 0xb406 : 1
aida02 fault 0xefc7 : 0xefc8 : 1
aida03 fault 0xdaab : 0xdaac : 1
aida04 fault 0x8f7c : 0x8f7d : 1
aida05 fault 0xb5bd : 0xb5be : 1
aida06 fault 0xeff1 : 0xeff2 : 1
aida07 fault 0x8f57 : 0x8f58 : 1
aida08 fault 0xbef7 : 0xbef8 : 1
White Rabbit error counter test result: Passed 8, Failed 8
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
Base Current Difference
aida12 fault 0x0 : 0x200 : 512
aida13 fault 0x0 : 0x61 : 97
FPGA Timestamp error counter test result: Passed 14, Failed 2
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last
The FPGA errors seem to come on FEEs with no WR errors or clock errors (including Lock/PLL page)
Temps & Rates OK
Will now stop Alpha run and check noise situation
Run stopped at R6_49
Switching to nostorage (NOTAPE/R2)
Set ASICs to threshold 0xa, Rates OK
Rate to Tape/MBS ca 9 MB/s
No change to situation since yesterday... good sign
During MBS test aida13 rebooted... crash log from ttyUSB5 attached
It was later noticed connector half off in aida05, reseated and after some time got noise levels OK again...
cables on top very sensitive, indicative of issues inside maybe(?). We avoid touching AIDA for now :)
A power cycle of all FEEs was performed after aida13's reboot to make sure things are good.
All systems check OK |
| Attachment 1: elog_locks.png
|
|
| Attachment 2: elog_temps.png
|
|
| Attachment 3: elog_rates.png
|
|
| Attachment 4: elog_rates1.png
|
|
| Attachment 5: aida13.txt
|
06/19:25:39|Data Acquisition Statistics counters now cleared^M
06/19:25:55|Clear Statistics (1)^M
06/19:25:55|------------[ cut here ]------------^M
07/15:23:58|kernel BUG at mm/slab.c:2974!^M
07/15:23:58|Oops: Exception in kernel mode, sig: 5 [#1]^M
07/15:23:58|PREEMPT Xilinx Virtex440^M
07/15:23:59|Modules linked in: aidamem xdriver xh_spidev_register^M
07/15:23:59|NIP: c009211c LR: c00920b0 CTR: 00000007^M
07/15:23:59|REGS: c0391bf0 TRAP: 0700 Not tainted (2.6.31)^M
07/15:23:59|MSR: 00021000 <ME,CE> CR: 24022048 XER: 00000000^M
07/15:23:59|TASK = c036e318[0] 'swapper' THREAD: c0390000^M
07/15:23:59|GPR00: 00000001 c0391ca0 c036e318 c680daf0 c694003c 0000000a c6940020 00000009 ^M
07/15:23:59|GPR08: 0000001b c680dae0 00000cf0 c680dae0 24008042 00005aa8 c03a0000 00000020 ^M
07/15:23:59|GPR16: c0390000 c03a069c c03a0000 c038c384 c038cc18 00000020 00000000 00200200 ^M
07/15:23:59|GPR24: 00100100 c0390000 00000000 c680dae8 c680dae0 c680ae00 00000006 c680e400 ^M
07/15:23:59|NIP [c009211c] cache_alloc_refill+0x130/0x608^M
07/15:23:59|LR [c00920b0] cache_alloc_refill+0xc4/0x608^M
07/15:23:59|Call Trace:^M
07/15:23:59|[c0391ca0] [c00920b0] cache_alloc_refill+0xc4/0x608 (unreliable)^M
07/15:23:59|[c0391d00] [c00927d8] kmem_cache_alloc+0xc4/0xcc^M
07/15:23:59|[c0391d20] [c0042420] __sigqueue_alloc+0x50/0xb8^M
07/15:23:59|[c0391d40] [c0042938] __send_signal+0x78/0x260^M
07/15:23:59|[c0391d70] [c0042f78] group_send_sig_info+0x70/0x9c^M
07/15:24:00|[c0391da0] [c00438a8] kill_pid_info+0x48/0x8c^M
07/15:24:00|[c0391dc0] [c0038e8c] it_real_fn+0x1c/0x30^M
07/15:24:00|[c0391dd0] [c0050c40] hrtimer_run_queues+0x184/0x240^M
07/15:24:00|[c0391e30] [c0040ba8] run_local_timers+0x10/0x2c^M
07/15:24:00|[c0391e40] [c0040bf4] update_process_times+0x30/0x70^M
07/15:24:00|[c0391e60] [c005a000] tick_periodic+0x34/0xe8^M
07/15:24:00|[c0391e70] [c005a0d4] tick_handle_periodic+0x20/0x120^M
07/15:24:00|[c0391eb0] [c000af70] timer_interrupt+0xa4/0x10c^M
07/15:24:00|[c0391ed0] [c000e9c4] ret_from_except+0x0/0x18^M
07/15:24:00|[c0391f90] [c0006fac] cpu_idle+0xcc/0xdc^M
07/15:24:00|[c0391fb0] [c000172c] rest_init+0x70/0x84^M
07/15:24:00|[c0391fc0] [c0341854] start_kernel+0x230/0x2ac^M
07/15:24:00|[c0391ff0] [c0000204] skpinv+0x194/0x1d0^M
07/15:24:00|Instruction dump:^M
07/15:24:00|2f1e0000 409900f4 387c0010 3b7c0008 80dc0000 7f9c3000 419e014c 81060010 ^M
07/15:24:00|801d001c 7c004010 38000000 7c000114 <0f000000> 81260010 801d001c 7f804840 ^M
07/15:24:00|Kernel panic - not syncing: Fatal exception in interrupt^M
07/15:24:00|Call Trace:^M
07/15:24:00|[c0391a40] [c0005de8] show_stack+0x44/0x16c (unreliable)^M
07/15:24:00|[c0391a80] [c00345bc] panic+0x94/0x168^M
07/15:24:01|[c0391ad0] [c000bd44] die+0x178/0x18c^M
07/15:24:01|[c0391af0] [c000c000] _exception+0x164/0x1b4^M
07/15:24:01|[c0391be0] [c000e978] ret_from_except_full+0x0/0x4c^M
07/15:24:01|[c0391ca0] [c00920b0] cache_alloc_refill+0xc4/0x608^M
07/15:24:01|[c0391d00] [c00927d8] kmem_cache_alloc+0xc4/0xcc^M
07/15:24:01|[c0391d20] [c0042420] __sigqueue_alloc+0x50/0xb8^M
07/15:24:01|[c0391d40] [c0042938] __send_signal+0x78/0x260^M
07/15:24:01|[c0391d70] [c0042f78] group_send_sig_info+0x70/0x9c^M
07/15:24:01|[c0391da0] [c00438a8] kill_pid_info+0x48/0x8c^M
07/15:24:01|[c0391dc0] [c0038e8c] it_real_fn+0x1c/0x30^M
07/15:24:01|[c0391dd0] [c0050c40] hrtimer_run_queues+0x184/0x240^M
07/15:24:01|[c0391e30] [c0040ba8] run_local_timers+0x10/0x2c^M
07/15:24:01|[c0391e40] [c0040bf4] update_process_times+0x30/0x70^M
07/15:24:01|[c0391e60] [c005a000] tick_periodic+0x34/0xe8^M
07/15:24:01|[c0391e70] [c005a0d4] tick_handle_periodic+0x20/0x120^M
07/15:24:01|[c0391eb0] [c000af70] timer_interrupt+0xa4/0x10c^M
07/15:24:01|[c0391ed0] [c000e9c4] ret_from_except+0x0/0x18^M
07/15:24:01|[c0391f90] [c0006fac] cpu_idle+0xcc/0xdc^M
07/15:24:01|[c0391fb0] [c000172c] rest_init+0x70/0x84^M
07/15:24:01|[c0391fc0] [c0341854] start_kernel+0x230/0x2ac^M
07/15:24:02|[c0391ff0] [c0000204] skpinv+0x194/0x1d0^M
07/15:24:02|Rebooting in 180 seconds..
07/15:27:02|^MISOL Version 1.00 Date 9th January 2017
|
|
298
|
Thu May 6 16:59:20 2021 |
TD, OH | Wednesday 6 May |
18.09 NH has installed jumpers LK2-4 for *all* adaptor PCBs
per FEE64 rate spectra - attachments 1-4
attachment 4 with BNC PB-5 pulser 10Hz
ADC data items stats - attachment 5
1.8.W spectra - attachments 6 & 7
Observe significant reduction in DSSSD/ribbon cable boundary channel rates
- status quo ante Tuesday 4 May https://elog.ph.ed.ac.uk/DESPEC/291 ?
1.8.L spectra - attachments 8 & 9
pulser peak width aida01 85 ch FWHM, aida2 295 ch FWHM
19:21 Alpha run started May21/R6
Statistics dominated by aida04 with a rate of 6k
System wide checks all ok except:
Base Current Difference
aida13 fault 0x0 : 0x17 : 23
FPGA Timestamp error counter test result: Passed 15, Failed 1
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last
Writing to file at ~300kB/s
Rate spectra for aida04 shows dominated by first asic - attachment 10
1*L spectra for aida04 asic 1 - attachment 11
20.25 per FEE64 rate spectra - attachment 12
handful of hot channels aida06, 09 & 10
ADC data item stats - attachment 13 |
| Attachment 1: Screenshot_2021-05-06_Spectrum_Browser_aidas-gsi(4).png
|
.png.png "Screenshot_2021-05-06_Spectrum_Browser_aidas-gsi(4).png")
|
| Attachment 2: Screenshot_2021-05-06_Spectrum_Browser_aidas-gsi(5).png
|
.png.png "Screenshot_2021-05-06_Spectrum_Browser_aidas-gsi(5).png")
|
| Attachment 3: Screenshot_2021-05-06_Spectrum_Browser_aidas-gsi(6).png
|
.png.png "Screenshot_2021-05-06_Spectrum_Browser_aidas-gsi(6).png")
|
| Attachment 4: Screenshot_2021-05-06_Spectrum_Browser_aidas-gsi(7).png
|
.png.png "Screenshot_2021-05-06_Spectrum_Browser_aidas-gsi(7).png")
|
| Attachment 5: Screenshot_2021-05-06_Statistics_aidas-gsi(1).png
|
.png.png "Screenshot_2021-05-06_Statistics_aidas-gsi(1).png")
|
| Attachment 6: Screenshot_2021-05-06_Spectrum_Browser_aidas-gsi(8).png
|
.png.png "Screenshot_2021-05-06_Spectrum_Browser_aidas-gsi(8).png")
|
| Attachment 7: Screenshot_2021-05-06_Spectrum_Browser_aidas-gsi(9).png
|
.png.png "Screenshot_2021-05-06_Spectrum_Browser_aidas-gsi(9).png")
|
| Attachment 8: Screenshot_2021-05-06_Spectrum_Browser_aidas-gsi.png
|
|
| Attachment 9: Screenshot_2021-05-06_Spectrum_Browser_aidas-gsi(1).png
|
.png.png "Screenshot_2021-05-06_Spectrum_Browser_aidas-gsi(1).png")
|
| Attachment 10: 210506_1924_aida04Rate.png
|
|
| Attachment 11: 210506_1927_1*L.png
|
|
| Attachment 12: Screenshot_2021-05-06_Spectrum_Browser_aidas-gsi(2).png
|
.png.png "Screenshot_2021-05-06_Spectrum_Browser_aidas-gsi(2).png")
|
| Attachment 13: Screenshot_2021-05-06_Statistics_aidas-gsi.png
|
|
|
297
|
Wed May 5 20:10:16 2021 |
OH | Wednesday 5 May Alpha run |
21:10 After all of the works in S4 today the noise in the system was considerably worse
It was decided that before starting a new alpha run a powercycle would be performed.
The powercycle has had no effect on the rates. They are still terrible.
The difference between yesterday and today is:
- Adaptor cards for FEE9 and 13 were re-aligned as they were previously misaligned
- bPlast has been plugged in and biased
All system wide checks ok
Statistics threshold at 0xa - attachment 1
Rate spectra (FEE5 does have events in all channels just noise is dominated by a few) - attachment 2
Waveforms - attachments 3 and 4
Pulser turned off and threshold raised to 0x64
Statistics - attachment 5
21:19 Alpha run started to May21/R4*
08:51 DAQ continues OK - file May21/R4_23
FEE64 temps OK - attachment 8
ADC data items OK - attachment 9
1.8.W spectra - attachments 6 & 7
no change cf. yesterday pm
Grafana - most recent 12h DSSSD bias & leakage current - attachment 10
DSSSD biases & leakage currents - attachment 11
Tape Server/Merger - attachment 12
09:44 R4 stopped |
| Attachment 1: 210504_2105_Stats.png
|
|
| Attachment 2: 210504_2107_Layout1.png
|
|
| Attachment 3: 210504_2108_layout7.png
|
|
| Attachment 4: 210504_2109_Layout8.png
|
|
| Attachment 5: 210504_2115_stats.png
|
|
| Attachment 6: Screenshot_2021-05-06_Spectrum_Browser_aidas-gsi.png
|
|
| Attachment 7: Screenshot_2021-05-06_Spectrum_Browser_aidas-gsi(1).png
|
.png.png "Screenshot_2021-05-06_Spectrum_Browser_aidas-gsi(1).png")
|
| Attachment 8: Screenshot_2021-05-06_Temperature_and_status_scan_aidas-gsi.png
|
|
| Attachment 9: Screenshot_2021-05-06_Statistics_aidas-gsi.png
|
|
| Attachment 10: Screenshot_2021-05-06_AIDA_Alerting_-_Grafana.png
|
|
| Attachment 11: 401.png
|
|
| Attachment 12: 402.png
|
|
|
296
|
Wed May 5 16:57:48 2021 |
TD | Tuesday 5 May |
17.55 Grafana DSSSD bias & leakage current - attachment 1
Note abrupt decrease of DSSSD# 2 leakage current c. 1.5uA at 17.37
DSSSD bias & leakage currents - attachment 2 |
| Attachment 1: Screenshot_2021-05-05_AIDA_Alerting_-_Grafana(1).png
|
.png.png "Screenshot_2021-05-05_AIDA_Alerting_-_Grafana(1).png")
|
| Attachment 2: 401.png
|
|