ELOG DESPEC

AIDA GELINA BRIKEN nToF CRIB ISOLDE CIRCE nTOFCapture DESPEC DTAS EDI_PSA 179Ta CARME StellarModelling DCF K40

DESPEC, Page 20 of 35

Full | Summary | Threaded | Hide attachments

692 Entries

Goto page Previous 1, 2, 3 ... 19, 20, 21 ... 33, 34, 35 Next

ID	Date	Author	Subject
321	Mon May 17 19:05:23 2021	LS	Monday 17th May 20.00-24.00
20.30 Checked stats, seem okay (Fig 1) Ran R14_99 through analyser, dead times all good (Fig 2) Merger rate 1.8M items/s Tape server 6.4MB/s 21.00 Checked stats seem okay (Fig 3) Ran R14_106 through analyser, dead times all good (Fig 4) 21.30 Checked stats seem okay (Fig 5) Ran R14_112 through analyser, dead times all good (Fig 6) 22.00 Stats okay (Fig 7) FEE temps okay (Fig 8) Rate spectra (Fig 9) Leakage currents (Fig 10) System wide checks: Clock status all passed White rabbit 1 fail: Base Current Difference aida05 fault 0x4da : 0x4e7 : 13 White Rabbit error counter test result: Passed 15, Failed 1 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR FPGA timestamp all passed Merger rate 2.4M items/s Tape server 6.3MB/s Ran R14_119 through analyser, dead times all good (Fig 11) 22.30 Checked stats seem okay (Fig 12) Ran R14_123 through analyser, dead times all good (Fig 13) 23.00 Checked stats seem okay (Fig 14) Ran R14_129 through analyser, dead times all good (Fig 15) 23.30 Checked stats seem okay (Fig 16) Ran R14_135 through analyser, dead times all good (Fig 17) 24.00 Stats okay (Fig 18) FEE temps okay (Fig 19) Leakage currents (Fig 20) System wide checks: Clock status all passed White rabbit 1 fail: Base Current Difference aida05 fault 0x4da : 0x4eb : 17 White Rabbit error counter test result: Passed 15, Failed 1 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR FPGA timestamp all passed Merger rate 2.5M items/s Tape server 6.5MB/s Ran R14_142 through analyser, dead times all good (Fig 21)
Attachment 1: 210517_Stats_2026.png

Attachment 2: 210517_Deadtime_R14_99.png

Attachment 3: 210517_Stats_2101.png

Attachment 4: 210517_Deadtimes_R14_106.png

Attachment 5: 210517_Stats_2128.png

Attachment 6: 210517_Deadtimes_R14_112.png

Attachment 7: 210517_Stats_2159.png

Attachment 8: 210517_FEEtemps_2159.png

Attachment 9: 210517_Spectra_2159.png

Attachment 10: 210517_Bias_2159.png

Attachment 11: 210517_Deadtimes_R14_119.png

Attachment 12: 210517_Stats_2230.png

Attachment 13: 210517_Deadtimes_R14_123.png

Attachment 14: 210517_Stats_2300.png

Attachment 15: 210517_Deadtimes_R14_129.png

Attachment 16: 210517_Stats_2328.png

Attachment 17: 210517_Deadtimes_R14_135.png

Attachment 18: 210517_Stats_2359.png

Attachment 19: 210517_FEEtemps_2359.png

Attachment 20: 210517_bias_2359.png

Attachment 21: 210517_deadtime_R14_142_1.png

320	Mon May 17 15:14:35 2021	LJW	Monday 17th May 2021 16:00-20:00
16:25 Informed at shift handover that there has been no beam. Statistics - See attachment 1 Temperatures - See attachment 2 Bias & Leakage currents - See attachment 3 System Wide checks - All passed, EXCEPT: ADC Calibration FEE64 module aida01 failed FEE64 module aida02 failed FEE64 module aida03 failed FEE64 module aida04 failed FEE64 module aida05 failed FEE64 module aida06 failed FEE64 module aida07 failed FEE64 module aida08 failed FEE64 module aida09 failed FEE64 module aida10 failed FEE64 module aida11 failed FEE64 module aida12 failed FEE64 module aida13 failed FEE64 module aida14 failed FEE64 module aida15 failed FEE64 module aida16 failed Calibration test result: Passed 0, Failed 16 If any modules fail calibration , check the clock status and open the FADC Align and Control browser page to rerun calibration for that module White Rabbit decoder status: Base Current Difference aida05 fault 0x4da : 0x4dd : 3 White Rabbit error counter test result: Passed 15, Failed 1 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR 18:00 Usecb scalars now showing DSSD implant rates. Statistics - See attachment 4 Temperatures - See attachment 5 Bias & Leakage currents - See attachment 6 System Wide checks - All passed, EXCEPT: ADC Calibration FEE64 module aida01 failed FEE64 module aida02 failed FEE64 module aida03 failed FEE64 module aida04 failed FEE64 module aida05 failed FEE64 module aida06 failed FEE64 module aida07 failed FEE64 module aida08 failed FEE64 module aida09 failed FEE64 module aida10 failed FEE64 module aida11 failed FEE64 module aida12 failed FEE64 module aida13 failed FEE64 module aida14 failed FEE64 module aida15 failed FEE64 module aida16 failed Calibration test result: Passed 0, Failed 16 If any modules fail calibration , check the clock status and open the FADC Align and Control browser page to rerun calibration for that module White rabbit decoder status Base Current Difference aida05 fault 0x4da : 0x4e1 : 7 White Rabbit error counter test result: Passed 15, Failed 1 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WRx 19:45 Usecb scalars have continued to show DSSD implant rates since the last recorded elog check. Statistics - See attachment 7 Temperatures - See attachment 8 Bias & Leakage currents - See attachment 9 System Wide checks - All passed, EXCEPT: ADC Calibration: FEE64 module aida01 failed FEE64 module aida02 failed FEE64 module aida03 failed FEE64 module aida04 failed FEE64 module aida05 failed FEE64 module aida06 failed FEE64 module aida07 failed FEE64 module aida08 failed FEE64 module aida09 failed FEE64 module aida10 failed FEE64 module aida11 failed FEE64 module aida12 failed FEE64 module aida13 failed FEE64 module aida14 failed FEE64 module aida15 failed FEE64 module aida16 failed Calibration test result: Passed 0, Failed 16 If any modules fail calibration , check the clock status and open the FADC Align and Control browser page to rerun calibration for that module White Rabbit decoder status: Base Current Difference aida05 fault 0x4da : 0x4e1 : 7 White Rabbit error counter test result: Passed 15, Failed 1 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR 19:50 - Just as completing checks, notced usesb rates not showing DSSD implants again for several minutes 19:55 - Beam now back again - DSSD implants showing
Attachment 1: 170521_1.png

Attachment 2: 170521_2.png

Attachment 3: 170521_3.png

Attachment 4: 170521_4.png

Attachment 5: 170521_5.png

Attachment 6: 170521_6.png

Attachment 7: 170521_7.png

Attachment 8: 170521_8.png

Attachment 9: 170521_9.png

319	Fri May 14 19:01:09 2021	JS	Friday 14th May 20:00-00:00
20:00 Taking over from CB 20:33 Doing full checks. Temps ok elog:319/8 Bias ok elog:319/1 Clock check - ok ADC Calc check - ok White Rabbit - Base Current Difference aida01 fault 0xf932 : 0xf934 : 2 aida02 fault 0x62ec : 0x62ee : 2 aida03 fault 0x8679 : 0x867b : 2 aida04 fault 0xf0e4 : 0xf0e6 : 2 aida05 fault 0x9db8 : 0x9dc5 : 13 aida06 fault 0x7f18 : 0x7f1a : 2 aida07 fault 0xdd2c : 0xdd2e : 2 aida08 fault 0x1557 : 0x1559 : 2 White Rabbit error counter test result: Passed 8, Failed 8 FPGA Timestamp errors - Base Current Difference aida05 fault 0x0 : 0x3 : 3 FPGA Timestamp error counter test result: Passed 15, Failed 1 Memory Info- Returned 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k aida01 : 35 34 30 8 1 4 1 2 2 3 6 : 35772 aida02 : 37 30 28 5 3 1 2 4 2 3 6 : 36644 aida03 : 41 29 30 16 4 3 1 5 1 3 6 : 36588 aida04 : 13 6 23 12 4 4 4 4 2 2 6 : 35412 aida05 : 20 32 23 10 2 2 2 2 1 4 6 : 36736 aida06 : 14 5 10 5 1 3 2 3 2 3 6 : 35680 aida07 : 44 23 22 9 4 3 1 3 2 3 6 : 36200 aida08 : 39 30 28 9 0 3 2 3 3 2 6 : 35308 aida09 : 41 31 28 10 2 5 1 3 1 3 6 : 35484 aida10 : 43 23 27 7 3 1 1 3 3 3 6 : 36916 aida11 : 39 35 17 10 3 3 2 2 2 3 6 : 35908 aida12 : 37 36 15 10 2 2 2 4 3 2 6 : 35684 aida13 : 47 32 17 7 4 2 3 4 3 2 6 : 36012 aida14 : 23 33 14 10 3 4 3 4 3 2 6 : 36164 aida15 : 44 28 24 12 3 2 4 3 3 2 6 : 35920 aida16 : 22 17 24 17 3 4 2 3 1 3 6 : 35648 Stats Aida Correlation Info #8 - elog:319/2 same as elog:317/27 Resume info #3 - elog:319/3 same as elog:317/26 Pause info #2 - elog:319/4 same as elog:317/32 AIDA disk info #6 - elog:319/5 same as elog:317/31 AIDA ADC data items - elog:319/6 same as elog:317/30 Good Events - elog:319/7 same as elog:317/29 [I had some artifacts in AnyDesk when looking at the stats pages with many zeros, but could see clearly once uploaded the screenshots] Analysis R5_108 elog:319/9 Pause 149 Resume 150 Highest deadtime FEE10 3% 21:01 ucesb ok - Max 1700 Hz Implant - 1MHz Decay 21:35 Temps ok Bias ok Clock check - ok ADC Calc check - ok White Rabbit - Base Current Difference aida01 fault 0xf932 : 0xf934 : 2 aida02 fault 0x62ec : 0x62ee : 2 aida03 fault 0x8679 : 0x867b : 2 aida04 fault 0xf0e4 : 0xf0e6 : 2 aida05 fault 0x9db8 : 0x9dc5 : 13 aida06 fault 0x7f18 : 0x7f1a : 2 aida07 fault 0xdd2c : 0xdd2e : 2 aida08 fault 0x1557 : 0x1559 : 2 White Rabbit error counter test result: Passed 8, Failed 8 Base Current Difference aida05 fault 0x0 : 0x3 : 3 FPGA Timestamp error counter test result: Passed 15, Failed 1 Returned 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k aida01 : 39 34 29 8 1 4 1 2 2 3 6 : 35772 aida02 : 46 29 28 5 3 2 2 3 2 3 6 : 36288 aida03 : 39 25 29 16 4 2 2 5 1 3 6 : 36660 aida04 : 14 6 19 12 4 4 3 4 2 2 6 : 35096 aida05 : 20 30 24 10 2 2 2 2 1 4 6 : 36736 aida06 : 26 4 11 5 2 4 3 2 2 3 6 : 35672 aida07 : 46 22 22 9 4 3 1 3 2 3 6 : 36200 aida08 : 28 32 28 9 0 2 2 4 3 2 6 : 35664 aida09 : 32 30 29 10 3 5 2 3 1 3 6 : 35776 aida10 : 39 23 25 7 3 1 1 3 3 3 6 : 36868 aida11 : 40 31 21 10 3 3 1 4 1 3 6 : 35688 aida12 : 17 31 12 10 2 2 3 4 3 2 6 : 35772 aida13 : 35 28 22 7 4 2 3 4 3 2 6 : 36012 aida14 : 30 33 14 10 3 4 3 4 3 2 6 : 36192 aida15 : 34 26 24 12 3 2 4 3 3 2 6 : 35864 aida16 : 38 24 27 17 3 4 2 3 1 3 6 : 35816 Stats Good Events - elog:319/10 AIDA ADC data items - elog:319/11 AIDA disk info #6 - elog:319/12 Pause info #2 - elog:319/13 Resume info #3 - elog:319/14 Aida Correlation Info #8 - elog:319/15 - rates showed zero, checked again and normal elog:319/17 Analysis R5_128 elog:319/16 Pause 167 Resume 166 Highest deadtime FEE10 5% 22:00 Temps ok Stats ok ucesb ok 22:35 Temps ok Stats ok ucesb- DSSD 2 is reading consistently 30% lower, not sure if this is dead time issue cropping up again elog:319/17 22:54 They are closing the file, we are on R5_155 23:00
Attachment 1: bias1.png

Attachment 2: Screenshot_2021-05-14_Statistics_aidas-gsi(10).png

Attachment 3: Screenshot_2021-05-14_Statistics_aidas-gsi(9).png

Attachment 4: Screenshot_2021-05-14_Statistics_aidas-gsi(8).png

Attachment 5: Screenshot_2021-05-14_Statistics_aidas-gsi(7).png

Attachment 6: Screenshot_2021-05-14_Statistics_aidas-gsi(6).png

Attachment 7: Screenshot_2021-05-14_Statistics_aidas-gsi(5).png

Attachment 8: Screenshot_2021-05-14_Temperature_and_status_scan_aidas-gsi(1).png

Attachment 9: R5_108_analysis.txt
* TDR format 3.3.0 analyser - TD - January 2019 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 256861958 ( 1503007.9 Hz) Other data format: 5058042 ( 29596.7 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 149 ( 0.9 Hz) RESUME: 150 ( 0.9 Hz) SYNC100: 32636 ( 191.0 Hz) WR48-63: 32636 ( 191.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 4992471 ( 29213.1 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 207149 ( 1212.1 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 170.899 s FEE elapsed dead time(s) elapsed idle time(s) 1 4.459 72.353 2 1.217 86.117 3 3.357 28.177 4 0.000 160.970 5 0.495 76.386 6 0.216 93.617 7 1.418 40.259 8 3.253 44.571 9 0.000 168.837 10 5.250 9.058 11 1.956 49.014 12 0.182 82.483 13 0.000 160.585 14 0.143 88.740 15 3.053 35.456 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 8464368 3303 0 0 2 2 1138 1138 0 1023 0 11424 1 16399642 4233 0 0 17 18 2099 2099 0 0 0 22505 2 13045073 1576129 0 0 6 6 1793 1793 0 1572531 0 18179 3 26563169 1558422 0 0 14 14 3487 3487 0 1551420 0 26353 4 2213090 510296 0 0 0 0 328 328 0 509640 0 5100 5 15498485 314714 0 0 4 4 1986 1986 0 310734 0 15610 6 12553775 609520 0 0 7 7 1573 1573 0 606360 0 10360 7 23384876 446841 0 0 10 10 3029 3029 0 440763 0 18175 8 21832531 5542 0 0 15 15 2756 2756 0 0 0 22662 9 1045474 278 0 0 0 0 139 139 0 0 0 1866 10 42357744 10552 0 0 43 43 5233 5233 0 0 0 12639 11 20606319 4998 0 0 11 11 2488 2488 0 0 0 4351 12 14311836 3576 0 0 6 6 1782 1782 0 0 0 20348 13 3016503 780 0 0 0 0 390 390 0 0 0 1508 14 13047482 3248 0 0 4 4 1620 1620 0 0 0 12826 15 22521591 5610 0 0 10 10 2795 2795 0 0 0 3243 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time:74697.445s ( 0.428 blocks/s, 0.027 Mb/s)
Attachment 10: Screenshot_2021-05-14_Statistics_aidas-gsi(16).png

Attachment 11: Screenshot_2021-05-14_Statistics_aidas-gsi(15).png

Attachment 12: Screenshot_2021-05-14_Statistics_aidas-gsi(14).png

Attachment 13: Screenshot_2021-05-14_Statistics_aidas-gsi(13).png

Attachment 14: Screenshot_2021-05-14_Statistics_aidas-gsi(12).png

Attachment 15: Screenshot_2021-05-14_Statistics_aidas-gsi(11).png

Attachment 16: R5_128_analysis.txt
* TDR format 3.3.0 analyser - TD - January 2019 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 256841478 ( 1482693.9 Hz) Other data format: 5078522 ( 29317.3 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 167 ( 1.0 Hz) RESUME: 166 ( 1.0 Hz) SYNC100: 32644 ( 188.4 Hz) WR48-63: 32644 ( 188.4 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 5012901 ( 28938.5 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 205165 ( 1184.4 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 173.226 s FEE elapsed dead time(s) elapsed idle time(s) 1 2.621 76.080 2 1.556 81.876 3 3.719 27.628 4 0.000 162.954 5 0.710 80.266 6 0.170 93.769 7 2.714 44.740 8 3.483 45.565 9 0.000 167.005 10 8.522 10.948 11 2.181 50.562 12 0.202 85.035 13 0.000 161.510 14 0.146 88.959 15 1.812 38.597 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 8468806 3273 0 0 7 7 1112 1112 0 1035 0 11260 1 16364560 4360 0 0 13 13 2167 2167 0 0 0 23505 2 13265609 1594590 0 0 6 6 1881 1881 0 1590816 0 18254 3 26054686 1576337 0 0 14 14 3422 3422 0 1569465 0 26152 4 2223261 507850 0 0 0 0 362 362 0 507126 0 4952 5 15152054 312213 0 0 8 7 1938 1938 0 308322 0 15336 6 12659379 606961 0 0 4 4 1612 1612 0 603729 0 10099 7 22669666 438118 0 0 14 14 2841 2841 0 432408 0 17594 8 22337729 5564 0 0 15 15 2767 2767 0 0 0 22524 9 1020352 240 0 0 0 0 120 120 0 0 0 1807 10 42596491 10676 0 0 59 59 5279 5279 0 0 0 12076 11 20672887 5060 0 0 13 13 2517 2517 0 0 0 4379 12 14335521 3608 0 0 5 5 1799 1799 0 0 0 20105 13 2812573 690 0 0 0 0 345 345 0 0 0 1405 14 13325633 3260 0 0 4 4 1626 1626 0 0 0 12554 15 22882271 5722 0 0 5 5 2856 2856 0 0 0 3163 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time:78055.344s ( 0.410 blocks/s, 0.026 Mb/s)
Attachment 17: Screenshot_2021-05-14_Statistics_aidas-gsi(17).png

Attachment 18: ucesb.png

Attachment 19: _~.png

Attachment 20: Screenshot_2021-05-14_Temperature_and_status_scan_aidas-gsi(2).png

Attachment 21: Screenshot_2021-05-14_Statistics_aidas-gsi(23).png

Attachment 22: Screenshot_2021-05-14_Statistics_aidas-gsi(22).png

Attachment 23: Screenshot_2021-05-14_Statistics_aidas-gsi(21).png

Attachment 24: Screenshot_2021-05-14_Statistics_aidas-gsi(20).png

Attachment 25: Screenshot_2021-05-14_Statistics_aidas-gsi(19).png

Attachment 26: Screenshot_2021-05-14_Statistics_aidas-gsi(18).png

Attachment 27: R5_157_analysis.txt
* TDR format 3.3.0 analyser - TD - January 2019 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 256650793 ( 1485751.4 Hz) Other data format: 5269207 ( 30503.4 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 130 ( 0.8 Hz) RESUME: 129 ( 0.7 Hz) SYNC100: 32643 ( 189.0 Hz) WR48-63: 32643 ( 189.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 5203662 ( 30124.0 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 223116 ( 1291.6 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 172.741 s FEE elapsed dead time(s) elapsed idle time(s) 1 2.094 74.418 2 0.927 76.576 3 3.655 26.911 4 0.000 161.752 5 0.023 80.653 6 0.215 91.583 7 1.871 44.002 8 1.038 39.676 9 0.000 166.718 10 8.591 10.747 11 3.917 45.280 12 0.214 88.240 13 0.000 163.408 14 0.280 88.718 15 1.416 44.122 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 8604841 3308 0 0 0 0 1138 1138 0 1032 0 12424 1 16359820 4228 0 0 13 13 2101 2101 0 0 0 24974 2 13547296 1610585 0 0 6 6 1930 1930 0 1606713 0 19730 3 25981004 1589167 0 0 14 13 3491 3491 0 1582158 0 28914 4 2316430 549243 0 0 0 0 351 351 0 548541 0 5271 5 15208801 341870 0 0 1 1 1974 1974 0 337920 0 16457 6 12807457 657341 0 0 5 5 1667 1667 0 653997 0 10925 7 22697274 479019 0 0 10 10 2849 2849 0 473301 0 19398 8 22587880 5594 0 0 5 5 2792 2792 0 0 0 24704 9 1078064 266 0 0 0 0 133 133 0 0 0 1963 10 42543713 10740 0 0 43 43 5327 5327 0 0 0 13313 11 20362862 5182 0 0 14 14 2577 2577 0 0 0 4606 12 13994455 3436 0 0 7 7 1711 1711 0 0 0 21818 13 2731986 666 0 0 0 0 333 333 0 0 0 1621 14 13145005 3222 0 0 8 8 1603 1603 0 0 0 13539 15 22683905 5340 0 0 4 4 2666 2666 0 0 0 3459 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time:83137.008s ( 0.385 blocks/s, 0.024 Mb/s)
318	Fri May 14 17:30:56 2021	TD	Analysis of S496 files R5_18, R5_32 & R5_45
S496/R5_18 - attachment 1 LEC fast discriminators - all channels disabled Slow comparator thresholds - p+n FEE64s 0xa except aida09 0xf n+n FEE64s 0x20 Sampling ADCs OFF S496/R5_32 - attachment 2 LEC fast discriminators - all channels disabled Slow comparator thresholds - p+n FEE64s 0xa except aida09 & aida15 0xf n+n FEE64s 0x20 Sampling ADCs ON, trigger threshold 15000 S496/R5_45 - attachment 3 LEC fast discriminators - all channels disabled Slow comparator thresholds - p+n FEE64s 0xc n+n FEE64s 0x20 Sampling ADCs ON, trigger threshold 15000 * N.B. Ignore 'elapsed idle time(s)' metric which does not work with WR timestamps
Attachment 1: R5_18
* TDR format 3.3.0 analyser - TD - January 2019 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 260127700 ( 2662102.7 Hz) Other data format: 1792300 ( 18342.1 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 1843 ( 18.9 Hz) RESUME: 1843 ( 18.9 Hz) SYNC100: 32365 ( 331.2 Hz) WR48-63: 32365 ( 331.2 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 1723884 ( 17641.9 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 65165 ( 666.9 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 97.715 s FEE elapsed dead time(s) elapsed idle time(s) 1 36.653 41.693 2 44.272 48.364 3 46.942 50.228 4 0.000 81.057 5 27.042 29.539 6 41.734 45.821 7 43.168 46.980 8 54.980 58.850 9 4.477 17.487 10 57.700 61.776 11 43.911 47.867 12 48.996 52.920 13 21.829 26.853 14 51.720 56.077 15 53.092 56.077 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 16755449 4921 0 0 122 122 2151 2151 0 375 0 4078 1 15729031 4184 0 0 103 103 1989 1989 0 0 0 7687 2 17390463 502955 0 0 136 135 2294 2294 0 498096 0 5652 3 14745088 476937 0 0 118 118 1907 1907 0 472887 0 8350 4 2857057 295831 0 0 0 0 413 413 0 295005 0 2971 5 19341027 128907 0 0 112 112 2426 2426 0 123831 0 5913 6 17649809 199902 0 0 136 136 2168 2168 0 195294 0 3189 7 17833639 143068 0 0 135 135 2201 2201 0 138396 0 5626 8 17514114 4531 0 0 139 138 2127 2127 0 0 0 6021 9 14922420 3686 0 0 23 23 1820 1820 0 0 0 1039 10 16909910 4387 0 0 140 141 2053 2053 0 0 0 3196 11 18661933 4896 0 0 151 151 2297 2297 0 0 0 1392 12 17768788 4718 0 0 148 148 2211 2211 0 0 0 5274 13 16872590 4258 0 0 96 96 2033 2033 0 0 0 605 14 16747047 4335 0 0 134 135 2033 2033 0 0 0 3273 15 18429335 4784 0 0 150 150 2242 2242 0 0 0 899 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time:66231.297s ( 0.483 blocks/s, 0.030 Mb/s)
Attachment 2: R5_32
* TDR format 3.3.0 analyser - TD - January 2019 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 259165945 ( 2447522.6 Hz) Other data format: 2754055 ( 26008.9 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 1068 ( 10.1 Hz) RESUME: 1070 ( 10.1 Hz) SYNC100: 32395 ( 305.9 Hz) WR48-63: 32395 ( 305.9 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 2687127 ( 25376.8 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 109002 ( 1029.4 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 105.889 s FEE elapsed dead time(s) elapsed idle time(s) 1 2.772 22.665 2 28.336 32.781 3 9.177 18.264 4 0.000 94.253 5 5.882 26.886 6 8.897 16.463 7 18.512 26.355 8 29.893 33.327 9 0.057 79.535 10 45.010 46.522 11 27.988 27.766 12 32.050 37.161 13 1.981 23.343 14 0.002 96.477 15 36.327 39.608 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 17728100 5332 0 0 32 32 2340 2340 0 588 0 6827 1 15060064 3752 0 0 18 18 1858 1858 0 0 0 14360 2 18674317 723732 0 0 99 99 2382 2382 0 718770 0 8046 3 19118104 904863 0 0 39 39 2463 2463 0 899859 0 15890 4 2260998 321658 0 0 0 0 326 326 0 321006 0 3138 5 14506811 189277 0 0 25 25 1756 1756 0 185715 0 9208 6 21798062 340177 0 0 43 43 2689 2689 0 334713 0 5553 7 18561150 231264 0 0 70 70 2324 2324 0 226476 0 9337 8 22060606 5804 0 0 136 136 2766 2766 0 0 0 10232 9 5139884 1246 0 0 5 5 618 618 0 0 0 1276 10 24215101 6255 0 0 190 191 2937 2937 0 0 0 4375 11 22485598 5956 0 0 148 148 2830 2830 0 0 0 2034 12 19527530 4883 0 0 108 109 2333 2333 0 0 0 8243 13 14237341 3538 0 0 9 9 1760 1760 0 0 0 984 14 2260329 600 0 0 1 1 299 299 0 0 0 8235 15 21531950 5718 0 0 145 145 2714 2714 0 0 0 1264 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time:65849.211s ( 0.486 blocks/s, 0.030 Mb/s)
Attachment 3: R5_45
* TDR format 3.3.0 analyser - TD - January 2019 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 257173968 ( 1605341.2 Hz) Other data format: 4746032 ( 29625.9 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 149 ( 0.9 Hz) RESUME: 149 ( 0.9 Hz) SYNC100: 32597 ( 203.5 Hz) WR48-63: 32597 ( 203.5 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 4680540 ( 29217.0 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 198582 ( 1239.6 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 160.199 s FEE elapsed dead time(s) elapsed idle time(s) 1 1.826 60.560 2 1.857 72.569 3 3.101 18.747 4 0.000 149.092 5 0.725 60.979 6 0.276 85.413 7 1.668 27.289 8 2.719 31.235 9 0.000 157.899 10 6.867 10.073 11 2.634 42.733 12 0.375 69.093 13 0.000 148.656 14 0.255 79.878 15 3.499 32.266 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 8318308 3120 0 0 3 3 1077 1077 0 960 0 11152 1 17482671 4536 0 0 10 10 2258 2258 0 0 0 22118 2 12591028 1472109 0 0 7 7 1790 1790 0 1468515 0 17237 3 26467090 1465014 0 0 17 17 3574 3574 0 1457832 0 25917 4 2005748 477188 0 0 0 0 331 331 0 476526 0 4838 5 16244903 298514 0 0 5 5 2012 2012 0 294480 0 14514 6 11816116 567974 0 0 7 7 1554 1554 0 564852 0 9683 7 24437155 423701 0 0 8 8 3155 3155 0 417375 0 17498 8 22741388 5724 0 0 10 10 2852 2852 0 0 0 21729 9 1027419 274 0 0 0 0 137 137 0 0 0 1781 10 39497864 9636 0 0 47 47 4771 4771 0 0 0 12114 11 19835466 4892 0 0 8 8 2438 2438 0 0 0 4107 12 15299334 3708 0 0 8 8 1846 1846 0 0 0 19448 13 3576125 840 0 0 0 0 420 420 0 0 0 1437 14 13120071 3182 0 0 7 7 1584 1584 0 0 0 12115 15 22713282 5620 0 0 12 12 2798 2798 0 0 0 2894 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time:63108.355s ( 0.507 blocks/s, 0.032 Mb/s)
317	Fri May 14 14:57:32 2021	CB + OH, TD, NH	Friday 14th May 16:00-20:00
16:00 Shift taken over from CA 16:00 Temperatures OK. Attach 1. Upon reloading aida11 first returns "No respose" for all values. Upon refreshing, aida11 responds but aida 9 returns "No response". Upon refreshing again, attach 1. Bias OK. Attach 2. Statistics OK. Attach 3-7 System-wide checks Clock OK ADC - all fail Base Current Difference aida01 fault 0xf932 : 0xf933 : 1 aida02 fault 0x62ec : 0x62ed : 1 aida03 fault 0x8679 : 0x867a : 1 aida04 fault 0xf0e4 : 0xf0e5 : 1 aida05 fault 0x9db8 : 0x9dc3 : 11 aida06 fault 0x7f18 : 0x7f19 : 1 aida07 fault 0xdd2c : 0xdd2d : 1 aida08 fault 0x1557 : 0x1558 : 1 White Rabbit error counter test result: Passed 8, Failed 8 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR Base Current Difference aida05 fault 0x0 : 0x3 : 3 FPGA Timestamp error counter test result: Passed 15, Failed 1 If any of these counts are reported as in error The ASIC readout system has detected a timeslip. That is the timestamp read from the time FIFO is not younger than the last Returned 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k aida01 : 32 28 25 7 1 4 1 3 2 3 6 : 36112 aida02 : 43 28 29 5 4 2 3 4 1 3 6 : 36092 aida03 : 39 26 28 5 4 3 2 5 1 3 6 : 36428 aida04 : 9 5 21 8 5 4 4 4 2 2 6 : 35292 aida05 : 46 32 26 7 2 2 2 2 2 3 6 : 35768 aida06 : 4 5 16 1 3 4 2 4 1 3 6 : 35352 aida07 : 47 21 25 5 4 3 1 4 1 3 6 : 35604 aida08 : 62 33 32 6 0 2 3 3 3 2 6 : 35520 aida09 : 33 25 28 7 3 5 2 4 1 3 6 : 36140 aida10 : 47 29 22 6 3 2 2 2 2 3 6 : 35716 aida11 : 39 30 29 6 2 3 1 3 2 3 6 : 36124 aida12 : 38 36 20 6 3 2 3 3 3 2 6 : 35448 aida13 : 42 29 24 3 4 2 3 3 3 2 6 : 35440 aida14 : 31 28 18 7 3 3 4 4 2 2 6 : 35228 aida15 : 48 25 30 5 3 2 4 4 2 2 6 : 35272 aida16 : 37 16 28 6 3 3 2 2 2 3 6 : 35796 Collecting the file size of each FEE64 Options CONTENTS file to check they are all the same FEE : aida01 => Options file size is 1026 Last changed Thu May 13 05:49:42 CEST 2021 FEE : aida02 => Options file size is 1014 Last changed Thu Apr 29 14:43:46 CEST 2021 FEE : aida03 => Options file size is 1014 Last changed Thu Apr 29 14:43:50 CEST 2021 FEE : aida04 => Options file size is 1014 Last changed Thu Apr 29 14:43:53 CEST 2021 FEE : aida05 => Options file size is 1014 Last changed Thu Apr 29 14:43:55 CEST 2021 FEE : aida06 => Options file size is 1014 Last changed Thu Apr 29 14:43:59 CEST 2021 FEE : aida07 => Options file size is 1014 Last changed Thu Apr 29 14:44:02 CEST 2021 FEE : aida08 => Options file size is 1025 Last changed Wed May 05 12:15:54 CEST 2021 FEE : aida09 => Options file size is 1014 Last changed Thu Apr 29 14:44:08 CEST 2021 FEE : aida10 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida11 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida12 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida13 => Options file size is 1025 Last changed Fri May 07 19:40:34 CEST 2021 FEE : aida14 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida15 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida16 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 16:15 Control handed over to OH temporarily. 16:25 AIDA stopped. OH attempts to update Merger. Discriminators off. 16:29 AIDA restart begins. 16:33 AIDA restarted. 16:40 Dead time still very high ~50% in most FEEs. 16:50 Checking effect of threshold on dead time. 16:53 Checking waveform effect on deadtime. DAQ stopped. Turning waveforms on, threshold increased to max. This reduces deadtime to <10%. Sampling ADCs were disabled (switched off) late Wednesday evening. 17:01 DAQ can be restarted. 17:27 Finished checking effect of threshold on dead time. 120 keV front. 320 keV back. 17:33 Analysis of R5_45 - x strips 0xc - y strips 0x20 17:40 OH hands back control. Temperature OK - attach 10 Bias OK - attach 11 Stats - attach 12-17 System-wide checks Clock - all pass ADC - all pass WR Base Current Difference aida01 fault 0xf932 : 0xf933 : 1 aida02 fault 0x62ec : 0x62ed : 1 aida03 fault 0x8679 : 0x867a : 1 aida04 fault 0xf0e4 : 0xf0e5 : 1 aida05 fault 0x9db8 : 0x9dc3 : 11 aida06 fault 0x7f18 : 0x7f19 : 1 aida07 fault 0xdd2c : 0xdd2d : 1 aida08 fault 0x1557 : 0x1558 : 1 White Rabbit error counter test result: Passed 8, Failed 8 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR Base Current Difference aida05 fault 0x0 : 0x3 : 3 FPGA Timestamp error counter test result: Passed 15, Failed 1 If any of these counts are reported as in error The ASIC readout system has detected a timeslip. That is the timestamp read from the time FIFO is not younger than the last Returned 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k aida01 : 56 35 27 8 1 4 1 2 2 3 6 : 35816 aida02 : 43 31 27 5 3 1 3 3 2 3 6 : 36404 aida03 : 45 28 28 16 4 2 2 4 1 3 6 : 36180 aida04 : 2 2 18 12 4 3 3 4 2 2 6 : 34872 aida05 : 28 28 24 10 2 2 2 2 1 4 6 : 36752 aida06 : 28 11 9 5 2 3 3 3 1 3 6 : 35064 aida07 : 52 24 23 9 4 3 1 2 2 3 6 : 35744 aida08 : 21 26 27 8 0 2 3 3 3 2 6 : 35284 aida09 : 40 32 26 10 3 5 1 3 1 3 6 : 35520 aida10 : 46 23 27 7 3 1 1 3 3 3 6 : 36928 aida11 : 49 31 20 10 2 2 1 2 2 3 6 : 35516 aida12 : 39 35 17 9 2 2 3 4 3 2 6 : 35940 aida13 : 40 32 20 7 4 2 3 4 3 2 6 : 36032 aida14 : 33 33 16 10 3 4 3 4 3 2 6 : 36236 aida15 : 53 27 25 12 3 2 4 4 2 2 6 : 35452 aida16 : 35 22 32 15 3 4 3 3 1 3 6 : 36060 Collecting the file size of each FEE64 Options CONTENTS file to check they are all the same FEE : aida01 => Options file size is 1026 Last changed Thu May 13 05:49:42 CEST 2021 FEE : aida02 => Options file size is 1014 Last changed Thu Apr 29 14:43:46 CEST 2021 FEE : aida03 => Options file size is 1014 Last changed Thu Apr 29 14:43:50 CEST 2021 FEE : aida04 => Options file size is 1025 Last changed Fri May 14 16:54:56 CEST 2021 FEE : aida05 => Options file size is 1014 Last changed Thu Apr 29 14:43:55 CEST 2021 FEE : aida06 => Options file size is 1014 Last changed Thu Apr 29 14:43:59 CEST 2021 FEE : aida07 => Options file size is 1014 Last changed Thu Apr 29 14:44:02 CEST 2021 FEE : aida08 => Options file size is 1025 Last changed Wed May 05 12:15:54 CEST 2021 FEE : aida09 => Options file size is 1014 Last changed Thu Apr 29 14:44:08 CEST 2021 FEE : aida10 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida11 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida12 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida13 => Options file size is 1025 Last changed Fri May 07 19:40:34 CEST 2021 FEE : aida14 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida15 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida16 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 18:30 Temperatures - OK (attach 18) Bias OK (attach 19) Stats - attach 20-24 System-wide checks Clock - all pass ADC - all pass Base Current Difference aida01 fault 0xf932 : 0xf933 : 1 aida02 fault 0x62ec : 0x62ed : 1 aida03 fault 0x8679 : 0x867a : 1 aida04 fault 0xf0e4 : 0xf0e5 : 1 aida05 fault 0x9db8 : 0x9dc3 : 11 aida06 fault 0x7f18 : 0x7f19 : 1 aida07 fault 0xdd2c : 0xdd2d : 1 aida08 fault 0x1557 : 0x1558 : 1 White Rabbit error counter test result: Passed 8, Failed 8 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR Base Current Difference aida05 fault 0x0 : 0x3 : 3 FPGA Timestamp error counter test result: Passed 15, Failed 1 If any of these counts are reported as in error The ASIC readout system has detected a timeslip. That is the timestamp read from the time FIFO is not younger than the last Returned 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k aida01 : 41 31 31 8 1 4 1 2 2 3 6 : 35788 aida02 : 42 31 29 5 3 2 4 4 1 3 6 : 36304 aida03 : 29 30 29 16 4 3 2 4 1 3 6 : 36276 aida04 : 28 4 20 12 4 3 4 4 2 2 6 : 35280 aida05 : 25 28 23 10 2 2 2 2 1 4 6 : 36724 aida06 : 5 3 10 5 2 4 2 2 2 3 6 : 35308 aida07 : 38 26 22 9 4 3 1 2 2 3 6 : 35688 aida08 : 52 30 28 8 0 2 2 3 3 2 6 : 35200 aida09 : 22 26 21 10 3 4 1 4 1 3 6 : 35704 aida10 : 37 28 25 7 3 1 1 3 3 3 6 : 36900 aida11 : 53 30 20 10 2 3 2 2 2 3 6 : 35908 aida12 : 37 34 17 10 2 2 3 4 3 2 6 : 35956 aida13 : 47 34 16 7 4 2 3 4 3 2 6 : 36012 aida14 : 37 29 17 10 3 4 3 4 3 2 6 : 36236 aida15 : 44 28 25 12 3 2 4 4 2 2 6 : 35424 aida16 : 40 21 33 15 3 4 1 3 1 3 6 : 35576 18:40 Analysed R5_67. Attached. Dead time improved. Max ~1.5% 19:40 Temperatures OK Bias OK - attach 26 Stats - attach 27-32 System-wide checks Clock, ADC - all pass WR Base Current Difference aida01 fault 0xf932 : 0xf934 : 2 aida02 fault 0x62ec : 0x62ee : 2 aida03 fault 0x8679 : 0x867b : 2 aida04 fault 0xf0e4 : 0xf0e6 : 2 aida05 fault 0x9db8 : 0x9dc4 : 12 aida06 fault 0x7f18 : 0x7f1a : 2 aida07 fault 0xdd2c : 0xdd2e : 2 aida08 fault 0x1557 : 0x1559 : 2 White Rabbit error counter test result: Passed 8, Failed 8 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR Base Current Difference aida05 fault 0x0 : 0x3 : 3 FPGA Timestamp error counter test result: Passed 15, Failed 1 If any of these counts are reported as in error The ASIC readout system has detected a timeslip. That is the timestamp read from the time FIFO is not younger than the last Returned 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k aida01 : 41 33 30 8 1 4 1 2 2 3 6 : 35788 aida02 : 51 30 30 5 3 2 3 4 1 3 6 : 36092 aida03 : 52 31 28 16 4 2 2 5 1 3 6 : 36744 aida04 : 6 8 20 12 4 4 3 4 2 2 6 : 35096 aida05 : 30 31 22 10 2 2 2 2 1 4 6 : 36752 aida06 : 12 6 10 5 2 3 3 2 2 3 6 : 35488 aida07 : 53 24 21 9 4 3 1 3 2 3 6 : 36228 aida08 : 36 28 28 9 0 2 3 3 3 2 6 : 35408 aida09 : 27 28 25 10 3 4 2 3 1 3 6 : 35548 aida10 : 50 23 26 7 3 1 1 3 3 3 6 : 36928 aida11 : 42 28 22 10 3 3 2 2 2 3 6 : 35944 aida12 : 39 35 15 10 2 2 2 4 3 2 6 : 35684 aida13 : 43 34 17 7 4 2 3 4 3 2 6 : 36012 aida14 : 42 32 16 10 3 4 3 4 3 2 6 : 36264 aida15 : 36 30 25 12 3 2 4 3 3 2 6 : 35920 aida16 : 40 21 25 15 3 4 2 3 1 3 6 : 35704 Collecting the file size of each FEE64 Options CONTENTS file to check they are all the same FEE : aida01 => Options file size is 1026 Last changed Thu May 13 05:49:42 CEST 2021 FEE : aida02 => Options file size is 1014 Last changed Thu Apr 29 14:43:46 CEST 2021 FEE : aida03 => Options file size is 1014 Last changed Thu Apr 29 14:43:50 CEST 2021 FEE : aida04 => Options file size is 1025 Last changed Fri May 14 16:54:56 CEST 2021 FEE : aida05 => Options file size is 1014 Last changed Thu Apr 29 14:43:55 CEST 2021 FEE : aida06 => Options file size is 1014 Last changed Thu Apr 29 14:43:59 CEST 2021 FEE : aida07 => Options file size is 1014 Last changed Thu Apr 29 14:44:02 CEST 2021 FEE : aida08 => Options file size is 1025 Last changed Wed May 05 12:15:54 CEST 2021 FEE : aida09 => Options file size is 1014 Last changed Thu Apr 29 14:44:08 CEST 2021 FEE : aida10 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida11 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida12 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida13 => Options file size is 1025 Last changed Fri May 07 19:40:34 CEST 2021 FEE : aida14 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida15 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida16 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 19:40 Analysed R5_86. Attached. Dead time as before. 19:57 Shift handed over to James S
Attachment 1: Temp1.png

Attachment 2: Bias1.png

Attachment 3: Stats1-1.png

Attachment 4: Stats1-2.png

Attachment 5: Stats1-3.png

Attachment 6: Stats1-4.png

Attachment 7: Stats1-5.png

Attachment 8: Stats1-6.png

Attachment 9: R5_45_analysis.txt
* TDR format 3.3.0 analyser - TD - January 2019 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 257173968 ( 1605341.2 Hz) Other data format: 4746032 ( 29625.9 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 149 ( 0.9 Hz) RESUME: 149 ( 0.9 Hz) SYNC100: 32597 ( 203.5 Hz) WR48-63: 32597 ( 203.5 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 4680540 ( 29217.0 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 198582 ( 1239.6 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 160.199 s FEE elapsed dead time(s) elapsed idle time(s) 1 1.826 60.560 2 1.857 72.569 3 3.101 18.747 4 0.000 149.092 5 0.725 60.979 6 0.276 85.413 7 1.668 27.289 8 2.719 31.235 9 0.000 157.899 10 6.867 10.073 11 2.634 42.733 12 0.375 69.093 13 0.000 148.656 14 0.255 79.878 15 3.499 32.266 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 8318308 3120 0 0 3 3 1077 1077 0 960 0 11152 1 17482671 4536 0 0 10 10 2258 2258 0 0 0 22118 2 12591028 1472109 0 0 7 7 1790 1790 0 1468515 0 17237 3 26467090 1465014 0 0 17 17 3574 3574 0 1457832 0 25917 4 2005748 477188 0 0 0 0 331 331 0 476526 0 4838 5 16244903 298514 0 0 5 5 2012 2012 0 294480 0 14514 6 11816116 567974 0 0 7 7 1554 1554 0 564852 0 9683 7 24437155 423701 0 0 8 8 3155 3155 0 417375 0 17498 8 22741388 5724 0 0 10 10 2852 2852 0 0 0 21729 9 1027419 274 0 0 0 0 137 137 0 0 0 1781 10 39497864 9636 0 0 47 47 4771 4771 0 0 0 12114 11 19835466 4892 0 0 8 8 2438 2438 0 0 0 4107 12 15299334 3708 0 0 8 8 1846 1846 0 0 0 19448 13 3576125 840 0 0 0 0 420 420 0 0 0 1437 14 13120071 3182 0 0 7 7 1584 1584 0 0 0 12115 15 22713282 5620 0 0 12 12 2798 2798 0 0 0 2894 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time:63108.355s ( 0.507 blocks/s, 0.032 Mb/s)
Attachment 10: Temps2.png

Attachment 11: Bias2.png

Attachment 12: Stats2-1.png

Attachment 13: Stats2-2.png

Attachment 14: Stats2-3.png

Attachment 15: Stats2-4.png

Attachment 16: Stats2-5.png

Attachment 17: Stats2-6.png

Attachment 18: Temp3.png

Attachment 19: Bias3.png

Attachment 20: Stats3-1.png

Attachment 21: Stats3-2.png

Attachment 22: Stats3-3.png

Attachment 23: Stats3-4.png

Attachment 24: Stats3-5.png

Attachment 25: R5_67_analysis.txt
* TDR format 3.3.0 analyser - TD - January 2019 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 255938817 ( 1305497.2 Hz) Other data format: 5981183 ( 30508.9 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 114 ( 0.6 Hz) RESUME: 113 ( 0.6 Hz) SYNC100: 32730 ( 166.9 Hz) WR48-63: 32730 ( 166.9 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 5915496 ( 30173.9 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 257806 ( 1315.0 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 196.047 s FEE elapsed dead time(s) elapsed idle time(s) 1 2.111 102.399 2 0.513 105.076 3 3.587 39.451 4 0.000 182.105 5 0.792 103.780 6 0.167 115.991 7 1.244 72.680 8 0.805 56.828 9 0.000 190.127 10 2.629 6.967 11 0.295 76.751 12 0.222 114.996 13 0.000 188.225 14 0.031 124.690 15 2.491 63.947 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 8223770 3364 0 0 2 2 1092 1092 0 1176 0 13825 1 16628095 4338 0 0 12 12 2157 2157 0 0 0 28636 2 13173045 1831289 0 0 3 3 1864 1864 0 1827555 0 22667 3 27251797 1807380 0 0 13 13 3668 3668 0 1800018 0 33190 4 2564061 622927 0 0 0 0 404 404 0 622119 0 6108 5 14810679 385418 0 0 6 6 1903 1903 0 381600 0 19053 6 12067625 742516 0 0 6 6 1616 1616 0 739272 0 12600 7 21266971 549224 0 0 11 11 2723 2723 0 543756 0 22659 8 23290358 5786 0 0 5 5 2888 2888 0 0 0 28199 9 1157906 324 0 0 0 0 162 162 0 0 0 2443 10 45608185 11489 0 0 27 26 5718 5718 0 0 0 16139 11 20146427 4876 0 0 6 6 2432 2432 0 0 0 5579 12 13411417 3300 0 0 7 7 1643 1643 0 0 0 24922 13 2681820 654 0 0 0 0 327 327 0 0 0 1925 14 11884997 2904 0 0 1 1 1451 1451 0 0 0 15892 15 21771664 5394 0 0 15 15 2682 2682 0 0 0 3969 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time:67311.180s ( 0.475 blocks/s, 0.030 Mb/s)
Attachment 26: Stats_RESUME.png

Attachment 27: Stats-CORRELATION.png

Attachment 28: Bias4.png

Attachment 29: Stats-good.png

Attachment 30: Stats-AIDAADC.png

Attachment 31: Stats_DISC.png

Attachment 32: Stats_PAUSE.png

Attachment 33: R5_86_analysis.txt
* TDR format 3.3.0 analyser - TD - January 2019 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 256871525 ( 1549964.4 Hz) Other data format: 5048475 ( 30462.5 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 133 ( 0.8 Hz) RESUME: 132 ( 0.8 Hz) SYNC100: 32617 ( 196.8 Hz) WR48-63: 32617 ( 196.8 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 4982976 ( 30067.3 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 217412 ( 1311.9 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 165.727 s FEE elapsed dead time(s) elapsed idle time(s) 1 1.819 66.425 2 0.365 78.785 3 3.792 29.131 4 0.000 149.995 5 0.868 74.751 6 0.080 85.583 7 2.138 33.988 8 2.899 39.410 9 0.000 164.566 10 6.499 11.006 11 1.139 43.564 12 0.944 80.601 13 0.000 152.925 14 0.102 87.597 15 2.546 36.680 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 8622288 3316 0 0 4 3 1158 1158 0 993 0 11812 1 17129008 4510 0 0 12 12 2243 2243 0 0 0 24429 2 13474006 1553973 0 0 6 6 1869 1869 0 1550223 0 19028 3 26129234 1524704 0 0 20 20 3374 3374 0 1517916 0 27835 4 2168475 521045 0 0 0 0 352 352 0 520341 0 5247 5 15823578 326080 0 0 4 4 1963 1963 0 322146 0 16074 6 12515224 622754 0 0 2 2 1625 1625 0 619500 0 10516 7 23990039 458079 0 0 12 12 3099 3099 0 451857 0 18924 8 22108276 5660 0 0 13 13 2817 2817 0 0 0 24206 9 1062355 236 0 0 0 0 118 118 0 0 0 1949 10 41223894 10244 0 0 40 40 5082 5082 0 0 0 13136 11 20572413 4974 0 0 7 7 2480 2480 0 0 0 4577 12 14036482 3446 0 0 3 3 1720 1720 0 0 0 21370 13 3191210 818 0 0 0 0 409 409 0 0 0 1573 14 12949121 3198 0 0 3 3 1596 1596 0 0 0 13450 15 21875922 5438 0 0 7 7 2712 2712 0 0 0 3286 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time:70812.570s ( 0.452 blocks/s, 0.028 Mb/s)
316	Fri May 14 07:05:08 2021	CA	Friday 14th May 08:00 - 16:00 shift
08:00 CA takes over 08:28 Problem at UNILAC - no beam 09:30 all system wide checks ok except all FEE64 fail ADC calibration (no waveforms) WR decoder status: Base Current Difference aida01 fault 0xf932 : 0xf933 : 1 aida02 fault 0x62ec : 0x62ed : 1 aida03 fault 0x8679 : 0x867a : 1 aida04 fault 0xf0e4 : 0xf0e5 : 1 aida05 fault 0x9db8 : 0x9dc2 : 10 aida06 fault 0x7f18 : 0x7f19 : 1 aida07 fault 0xdd2c : 0xdd2d : 1 aida08 fault 0x1557 : 0x1558 : 1 White Rabbit error counter test result: Passed 8, Failed 8 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR FPGA timestamp errors: Base Current Difference aida05 fault 0x0 : 0x2 : 2 FPGA Timestamp error counter test result: Passed 15, Failed 1 If any of these counts are reported as in error The ASIC readout system has detected a timeslip. That is the timestamp read from the time FIFO is not younger than the last 09:36 FEE64 Temperatures ok - attachment 1 Detector bias / leakage currents ok - attachment 2 Statistics - attachments 3-8 09:50 beam is back - writing to file R4_265 09:56 FRS adjusting degrader settings (S4) - temporarily remove to check counts in scintillator vs AIDA 10:10 FRS increase degrader thickness 10.28 all histograms, stats and merger stats zero'd 10.50 all system wide checks ok except Base Current Difference aida01 fault 0xf932 : 0xf933 : 1 aida02 fault 0x62ec : 0x62ed : 1 aida03 fault 0x8679 : 0x867a : 1 aida04 fault 0xf0e4 : 0xf0e5 : 1 aida05 fault 0x9db8 : 0x9dc2 : 10 aida06 fault 0x7f18 : 0x7f19 : 1 aida07 fault 0xdd2c : 0xdd2d : 1 aida08 fault 0x1557 : 0x1558 : 1 White Rabbit error counter test result: Passed 8, Failed 8 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR Base Current Difference aida05 fault 0x0 : 0x3 : 3 FPGA Timestamp error counter test result: Passed 15, Failed 1 If any of these counts are reported as in error The ASIC readout system has detected a timeslip. That is the timestamp read from the time FIFO is not younger than the last Returned 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k aida01 : 3 2 2 2 2 2 2 4 3 3 6 : 36860 aida02 : 7 3 5 1 2 5 2 4 3 3 6 : 37284 aida03 : 7 5 3 1 4 4 2 3 3 3 6 : 36756 aida04 : 3 1 20 4 2 3 3 5 1 3 6 : 36052 aida05 : 19 25 26 6 2 2 3 2 2 3 6 : 35828 aida06 : 1 3 16 1 3 4 1 5 1 3 6 : 35580 aida07 : 6 4 1 2 3 3 2 3 3 3 6 : 36552 aida08 : 8 5 2 3 2 3 2 2 2 4 6 : 37064 aida09 : 9 7 1 2 2 4 2 3 3 3 6 : 36652 aida10 : 2 5 3 1 1 4 2 3 3 3 6 : 36544 aida11 : 16 4 4 2 1 2 2 3 3 3 6 : 36384 aida12 : 2 1 1 3 1 2 2 3 3 3 6 : 36288 aida13 : 0 1 1 2 0 4 3 2 3 3 6 : 36184 aida14 : 6 3 2 0 2 3 2 3 3 3 6 : 36432 aida15 : 25 8 2 1 2 3 1 2 2 4 6 : 36836 aida16 : 3 5 1 2 2 2 3 2 3 3 6 : 36100 Collecting the file size of each FEE64 Options CONTENTS file to check they are all the same FEE : aida01 => Options file size is 1026 Last changed Thu May 13 05:49:42 CEST 2021 FEE : aida02 => Options file size is 1014 Last changed Thu Apr 29 14:43:46 CEST 2021 FEE : aida03 => Options file size is 1014 Last changed Thu Apr 29 14:43:50 CEST 2021 FEE : aida04 => Options file size is 1014 Last changed Thu Apr 29 14:43:53 CEST 2021 FEE : aida05 => Options file size is 1014 Last changed Thu Apr 29 14:43:55 CEST 2021 FEE : aida06 => Options file size is 1014 Last changed Thu Apr 29 14:43:59 CEST 2021 FEE : aida07 => Options file size is 1014 Last changed Thu Apr 29 14:44:02 CEST 2021 FEE : aida08 => Options file size is 1025 Last changed Wed May 05 12:15:54 CEST 2021 FEE : aida09 => Options file size is 1014 Last changed Thu Apr 29 14:44:08 CEST 2021 FEE : aida10 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida11 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida12 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida13 => Options file size is 1025 Last changed Fri May 07 19:40:34 CEST 2021 FEE : aida14 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida15 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida16 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 10.50 DAQ continues S496/R4_304 11:18 FEE64 Temperatures ok - attachment 9 Detector bias & leakage currents ok - attachment 10 statistics - attachments 11-16 15:00 FEE64 avg. CPU usage (%) 1 52 2 55 3 55 4 60 5 93 6 50 7 53 8 55 9 55 10 51 11 50 12 67 13 56 14 55 15 55 16 58 15:08 all system wide checks ok except all FEE64 fail ADC calibration (no waveform) WR decoder status: Base Current Difference aida01 fault 0xf932 : 0xf933 : 1 aida02 fault 0x62ec : 0x62ed : 1 aida03 fault 0x8679 : 0x867a : 1 aida04 fault 0xf0e4 : 0xf0e5 : 1 aida05 fault 0x9db8 : 0x9dc3 : 11 aida06 fault 0x7f18 : 0x7f19 : 1 aida07 fault 0xdd2c : 0xdd2d : 1 aida08 fault 0x1557 : 0x1558 : 1 White Rabbit error counter test result: Passed 8, Failed 8 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR FPGA errors: Base Current Difference aida05 fault 0x0 : 0x3 : 3 FPGA Timestamp error counter test result: Passed 15, Failed 1 If any of these counts are reported as in error The ASIC readout system has detected a timeslip. That is the timestamp read from the time FIFO is not younger than the last 15:10 Temperatures ok - attachment 17 Detector bias / leakage current ok - attachment 18 Statistics - attachments 18 -24
Attachment 1: Screenshot_from_2021-05-14_08-32-16.png

Attachment 2: Screenshot_from_2021-05-14_08-32-45.png

Attachment 3: Screenshot_from_2021-05-14_08-33-11.png

Attachment 4: Screenshot_from_2021-05-14_08-33-33.png

Attachment 5: Screenshot_from_2021-05-14_08-34-12.png

Attachment 6: Screenshot_from_2021-05-14_08-34-44.png

Attachment 7: Screenshot_from_2021-05-14_08-35-17.png

Attachment 8: Screenshot_from_2021-05-14_08-35-55.png

Attachment 9: Screenshot_from_2021-05-14_10-17-25.png

Attachment 10: Screenshot_from_2021-05-14_10-17-43.png

Attachment 11: Screenshot_from_2021-05-14_10-22-39.png

Attachment 12: Screenshot_from_2021-05-14_10-23-13.png

Attachment 13: Screenshot_from_2021-05-14_10-23-41.png

Attachment 14: Screenshot_from_2021-05-14_10-24-12.png

Attachment 15: Screenshot_from_2021-05-14_10-24-37.png

Attachment 16: Screenshot_from_2021-05-14_10-25-20.png

Attachment 17: Screenshot_from_2021-05-14_14-07-48.png

Attachment 18: Screenshot_from_2021-05-14_14-11-23.png

Attachment 19: Screenshot_from_2021-05-14_14-13-21.png

Attachment 20: Screenshot_from_2021-05-14_14-13-38.png

Attachment 21: Screenshot_from_2021-05-14_14-14-12.png

Attachment 22: Screenshot_from_2021-05-14_14-14-39.png

Attachment 23: Screenshot_from_2021-05-14_14-15-06.png

Attachment 24: Screenshot_from_2021-05-14_14-15-26.png

315	Thu May 13 23:58:05 2021	OH	Friday 14th May 00:00 - 08:00
00:00 OH Takes over. PULSER SETTINGS --------------------------- Pulse is ON Positive Tail Pulse Trigger Source is Internal Clock Trigger Threshold is 3.5 Amplitude : 2.0 Volts Rep Rate : 2.0 hZ Delay : 250.0 ns Fall Time : 1 ms Attenuation : 1 Display is : Volts Equivalent keV is : 200.0 Ramp Start at 0.01 Volts Ramp Stop at 9.99 Volts Ramp Start at 1.0 keV Ramp Stop at 999.0 keV Ramp Time is 60 seconds # Ramp Cycles is 1 OK 0x210 p+n Thresholds 0xa (100keV) n+n Threshold 0x20 (320keV) 01:00 System wide checks Clock status ok ADC calibration fail as expected (Waveforms off) WR Errors Base Current Difference aida01 fault 0xf932 : 0xf933 : 1 aida02 fault 0x62ec : 0x62ed : 1 aida03 fault 0x8679 : 0x867a : 1 aida04 fault 0xf0e4 : 0xf0e5 : 1 aida05 fault 0x9db8 : 0x9dbf : 7 aida06 fault 0x7f18 : 0x7f19 : 1 aida07 fault 0xdd2c : 0xdd2d : 1 aida08 fault 0x1557 : 0x1558 : 1 White Rabbit error counter test result: Passed 8, Failed 8 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR FPGA Errors Base Current Difference aida05 fault 0x0 : 0x2 : 2 FPGA Timestamp error counter test result: Passed 15, Failed 1 If any of these counts are reported as in error The ASIC readout system has detected a timeslip. That is the timestamp read from the time FIFO is not younger than the last Statistics ok - attachment 1 Temp ok - attachment 2 Bias and leakage current ok - attachment 3 01:42 Comparing the CS of AIDA3 and 4 Stats have been running for a while (Believe since 5am) Looking at the counter ratio - attachment 4 We still have a deadtime of around 14% in FEE4 (Assuming FEE3 has no dead time) 01:56 Noticed /media/ThirdDrive was at 97% full Let DESPEC locals know I would like to use the next run stop to change the directory. They said they could do it now so they stopped their run. Changed the symbolic link to /media/1e2.... Now writing to R4_ 03:26 MBS DAQ Stopped as beam stopped 03:33 Beam back now and DAQ running again 04:44 System wide checks as before Statistics ok - attachment 5 Temperatures ok - attachment - 7 Bias and leakage currents ok - attachment 6 05:53 MBS stops run as beam drops 06:00 MBS started a new run as beam is back 07:37 System wide checks clock ok and FPGA as before WR additional difference on FEE5 Base Current Difference aida01 fault 0xf932 : 0xf933 : 1 aida02 fault 0x62ec : 0x62ed : 1 aida03 fault 0x8679 : 0x867a : 1 aida04 fault 0xf0e4 : 0xf0e5 : 1 aida05 fault 0x9db8 : 0x9dc0 : 8 aida06 fault 0x7f18 : 0x7f19 : 1 aida07 fault 0xdd2c : 0xdd2d : 1 aida08 fault 0x1557 : 0x1558 : 1 White Rabbit error counter test result: Passed 8, Failed 8 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR Statistics ok - attachment 8 Temp ok - attachment 9 Bias and leakage ok - attachment 10
Attachment 1: 210514_0100_Stats.png

Attachment 2: 210514_0101_Temp.png

Attachment 3: 210514_0102_Bias.png

Attachment 4: 210514_0141_CS_Stats.png

Attachment 5: 210514_0442_Stats.png

Attachment 6: 210514_0443_Bias.png

Attachment 7: 210514_0443_Temp.png

Attachment 8: 210514_0737_Stats.png

Attachment 9: 210514_0738_Temp.png

Attachment 10: 210514_0739_Bias.png

Attachment 11: Screenshot_2021-05-14_Spectrum_Browser_aidas-gsi.png

Attachment 12: Screenshot_2021-05-14_Spectrum_Browser_aidas-gsi(1).png

Attachment 13: Screenshot_2021-05-14_Statistics_aidas-gsi.png

Attachment 14: Screenshot_2021-05-14_Statistics_aidas-gsi(1).png

Attachment 15: Screenshot_2021-05-14_Statistics_aidas-gsi(2).png

Attachment 16: Screenshot_2021-05-14_Statistics_aidas-gsi(3).png

Attachment 17: Screenshot_2021-05-14_Statistics_aidas-gsi(4).png

Attachment 18: Screenshot_2021-05-14_Temperature_and_status_scan_aidas-gsi.png

Attachment 19: Screenshot_2021-05-14_AIDA_Alerting_-_Grafana.png

Attachment 20: 600.png

Attachment 21: 601.png

314	Thu May 13 21:21:25 2021	Philippos and Marc	system wide checks
Wide checks at Time 22:22 CET Clock status test result: Passed 16, Failed 0 Understand status as follows Status bit 3 : firmware PLL that creates clocks from external clock not locked Status bit 2 : always logic '1' Status bit 1 : LMK3200(2) PLL and clock distribution chip not locked to external clock Status bit 0 : LMK3200(1) PLL and clock distribution chip not locked to external clock If all these bits are not set then the operation of the firmware is unreliable FEE64 module aida01 failed FEE64 module aida02 failed FEE64 module aida03 failed FEE64 module aida04 failed FEE64 module aida05 failed FEE64 module aida06 failed FEE64 module aida07 failed FEE64 module aida08 failed FEE64 module aida09 failed FEE64 module aida10 failed FEE64 module aida11 failed FEE64 module aida12 failed FEE64 module aida13 failed FEE64 module aida14 failed FEE64 module aida15 failed FEE64 module aida16 failed Calibration test result: Passed 0, Failed 16 If any modules fail calibration , check the clock status and open the FADC Align and Control browser page to rerun calibration for that module Base Current Difference aida01 fault 0xf932 : 0xf933 : 1 aida02 fault 0x62ec : 0x62ed : 1 aida03 fault 0x8679 : 0x867a : 1 aida04 fault 0xf0e4 : 0xf0e5 : 1 aida05 fault 0x9db8 : 0x9dbc : 4 aida06 fault 0x7f18 : 0x7f19 : 1 aida07 fault 0xdd2c : 0xdd2d : 1 aida08 fault 0x1557 : 0x1558 : 1 White Rabbit error counter test result: Passed 8, Failed 8 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR Base Current Difference aida05 fault 0x0 : 0x2 : 2 FPGA Timestamp error counter test result: Passed 15, Failed 1 If any of these counts are reported as in error The ASIC readout system has detected a timeslip. That is the timestamp read from the time FIFO is not younger than the last Returned 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k aida01 : 35 11 3 5 5 4 1 3 2 4 6 : 37876 aida02 : 20 5 4 3 2 5 2 4 3 3 6 : 37400 aida03 : 20 3 4 3 4 4 1 3 2 4 6 : 37640 aida04 : 25 6 2 3 4 4 3 3 3 3 6 : 37140 aida05 : 30 10 5 7 2 6 2 4 2 4 6 : 38776 aida06 : 21 11 4 4 3 5 2 4 3 3 6 : 37548 aida07 : 23 8 4 4 2 6 1 3 2 4 6 : 37852 aida08 : 27 7 2 3 4 3 2 4 3 3 6 : 37284 aida09 : 31 6 5 6 3 3 2 4 3 3 6 : 37372 aida10 : 22 5 3 4 3 6 2 2 2 4 6 : 37616 aida11 : 23 5 4 2 5 2 1 3 2 4 6 : 37444 aida12 : 20 7 4 7 3 5 2 3 3 3 6 : 37096 aida13 : 28 5 3 3 1 5 2 3 3 3 6 : 36840 aida14 : 38 12 2 4 2 4 1 4 3 3 6 : 37144 aida15 : 27 9 5 4 2 5 3 2 3 3 6 : 36740 aida16 : 21 6 4 4 1 4 2 3 3 3 6 : 36740
Attachment 1: 2021-05-13_ucesb_scalers_22h22mn.png

Attachment 2: 2021-05-13_Currents_22h22mn.png

Attachment 3: 2021-05-13_temperatures_22h22.png

Attachment 4: 2021-05-13-22h22mn_Stat-good-events.png

Attachment 5: 2021-05-13-22h22mn_ADC-data-items.png

Attachment 6: 2021-05-13_22h22mn-Correlation-info.png

Attachment 7: 2021-05-13_22h22mn-Pause-info.png

Attachment 8: 2021-05-13_22h22mn-Resume-Info.png

Attachment 9: 2021-05-13_merger_22h22.png

Attachment 10: 2021-05-13_22h22mn-LAY-ID1.png

Attachment 11: 2021-05-13_22h22mn-LAY-ID2.png

Attachment 12: 2021-05-13_22h22mn-LAY-ID3.png

Attachment 13: 2021-05-13_22h22mn-LAY-ID4.png

313	Thu May 13 19:52:36 2021	Philippos and Marc	Connection problem
At 20:15, We lost connection with AnyDesk. Liliana restarted Anydesk on the AIDA DAQ PC. All seemed fine on AIDA DAQ but there was a more generic issue on the main DAQ, possibly the timesorter. Helena restarted all after ~30mn and it's all working again now.
Attachment 1: 2021-05-13_ucesb_scalers.png

312	Thu May 13 17:05:42 2021	Muneerah, MArc	Thu 13 May 04:00-00:00
19:08 System Check Rates from ucesb below 1 kHz Atachment 1 Stats Atachment 2 Temperatures Atachment 3 Voltages System wide checks are all ok except ADC calibration all failed FEE64 module aida01 failed FEE64 module aida02 failed FEE64 module aida03 failed FEE64 module aida04 failed FEE64 module aida05 failed FEE64 module aida06 failed FEE64 module aida07 failed FEE64 module aida08 failed FEE64 module aida09 failed FEE64 module aida10 failed FEE64 module aida11 failed FEE64 module aida12 failed FEE64 module aida13 failed FEE64 module aida14 failed FEE64 module aida15 failed FEE64 module aida16 failed Calibration test result: Passed 0, Failed 16 If any modules fail calibration , check the clock status and open the FADC Align and Control browser page to rerun calibration for that module White rabbit Base Current Difference aida01 fault 0xf932 : 0xf933 : 1 aida02 fault 0x62ec : 0x62ed : 1 aida03 fault 0x8679 : 0x867a : 1 aida04 fault 0xf0e4 : 0xf0e5 : 1 aida05 fault 0x9db8 : 0x9dba : 2 aida06 fault 0x7f18 : 0x7f19 : 1 aida07 fault 0xdd2c : 0xdd2d : 1 aida08 fault 0x1557 : 0x1558 : 1 White Rabbit error counter test result: Passed 8, Failed 8 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR FPGA all passed Memory information Returned 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k aida01 : 6 2 2 1 2 4 3 4 2 3 7 : 40424 aida02 : 3 4 2 2 1 2 1 3 3 3 7 : 40140 aida03 : 10 10 0 3 2 4 2 4 2 3 7 : 40280 aida04 : 3 2 0 2 2 3 2 3 1 4 7 : 40540 aida05 : 4 9 2 3 2 4 3 3 1 4 7 : 41048 aida06 : 8 6 1 1 2 3 2 2 3 3 7 : 40064 aida07 : 1 4 0 1 1 3 1 3 3 3 7 : 40196 aida08 : 1 4 2 2 2 4 3 4 2 3 7 : 40452 aida09 : 8 5 2 2 1 2 1 3 3 3 7 : 40168 aida10 : 22 5 4 2 1 3 1 4 2 3 7 : 39872 aida11 : 2 1 2 1 2 2 3 3 2 3 7 : 39632 aida12 : 8 5 2 2 1 3 1 4 2 3 7 : 39784 aida13 : 18 8 2 1 0 2 3 3 2 3 7 : 39624 aida14 : 23 12 2 2 1 2 2 4 2 3 7 : 40028 aida15 : 3 5 3 2 2 3 1 4 2 3 7 : 39844 aida16 : 0 2 1 2 1 4 2 4 2 3 7 : 40096
Attachment 1: 130521_1802_Stats.png

Attachment 2: 130521_1802_Temp.png

Attachment 3: 130521_1804_Voltages.png

311	Thu May 13 07:10:17 2021	CA, TD	May 13th 08:00 - 16:00 shift
08:10 all system wide checks ok except all FEE64 modules fail ADC calibration WR decoder status: Base Current Difference aida01 fault 0xf932 : 0xf933 : 1 aida02 fault 0x62ec : 0x62ed : 1 aida03 fault 0x8679 : 0x867a : 1 aida04 fault 0xf0e4 : 0xf0e5 : 1 aida05 fault 0x9db8 : 0x9db9 : 1 aida06 fault 0x7f18 : 0x7f19 : 1 aida07 fault 0xdd2c : 0xdd2d : 1 aida08 fault 0x1557 : 0x1558 : 1 White Rabbit error counter test result: Passed 8, Failed 8 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR 08:16 attempt to recalibrate ADCs using FADC align and control - unsuccessful on all 08:18 FEE64 temps ok - attachment 1 bias/leakage currents ok - attachment 2 statistics - attachments 3-8 10:13 all system wide checks ok except all FEE64 modules fail ADC calibration WR decoder status: Base Current Difference aida01 fault 0xf932 : 0xf933 : 1 aida02 fault 0x62ec : 0x62ed : 1 aida03 fault 0x8679 : 0x867a : 1 aida04 fault 0xf0e4 : 0xf0e5 : 1 aida05 fault 0x9db8 : 0x9db9 : 1 aida06 fault 0x7f18 : 0x7f19 : 1 aida07 fault 0xdd2c : 0xdd2d : 1 aida08 fault 0x1557 : 0x1558 : 1 White Rabbit error counter test result: Passed 8, Failed 8 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR 10:16 FEE64 temps ok - attachment 9 bias/leakage currents ok - attachment 10 statistics - attachments 11-16 12:16 all system wide checks ok except all FEE64 modules fail ADC calibration WR decoder status: Base Current Difference aida01 fault 0xf932 : 0xf933 : 1 aida02 fault 0x62ec : 0x62ed : 1 aida03 fault 0x8679 : 0x867a : 1 aida04 fault 0xf0e4 : 0xf0e5 : 1 aida05 fault 0x9db8 : 0x9dba : 2 aida06 fault 0x7f18 : 0x7f19 : 1 aida07 fault 0xdd2c : 0xdd2d : 1 aida08 fault 0x1557 : 0x1558 : 1 White Rabbit error counter test result: Passed 8, Failed 8 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR 12:16 FEE64 temps ok - attachment 17 bias/leakage currents ok - attachment 18 statistics - attachments 19-25 14:08 all system wide checks ok except all FEE64 modules fail ADC calibration WR decoder status: Base Current Difference aida01 fault 0xf932 : 0xf933 : 1 aida02 fault 0x62ec : 0x62ed : 1 aida03 fault 0x8679 : 0x867a : 1 aida04 fault 0xf0e4 : 0xf0e5 : 1 aida05 fault 0x9db8 : 0x9dba : 2 aida06 fault 0x7f18 : 0x7f19 : 1 aida07 fault 0xdd2c : 0xdd2d : 1 aida08 fault 0x1557 : 0x1558 : 1 White Rabbit error counter test result: Passed 8, Failed 8 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR FEE64 temps ok - attachment 16 bias/leakage currents ok - attachment 27 statistics - attachments 28-35
Attachment 1: Screenshot_from_2021-05-13_07-17-47.png

Attachment 2: Screenshot_from_2021-05-13_07-18-57.png

Attachment 3: Screenshot_from_2021-05-13_07-19-42.png

Attachment 4: Screenshot_from_2021-05-13_07-20-45.png

Attachment 5: Screenshot_from_2021-05-13_07-23-01.png

Attachment 6: Screenshot_from_2021-05-13_07-23-35.png

Attachment 7: Screenshot_from_2021-05-13_07-24-02.png

Attachment 8: Screenshot_from_2021-05-13_07-25-15.png

Attachment 9: Screenshot_from_2021-05-13_09-17-57.png

Attachment 10: Screenshot_from_2021-05-13_09-18-21.png

Attachment 11: Screenshot_from_2021-05-13_09-18-58.png

Attachment 12: Screenshot_from_2021-05-13_09-19-32.png

Attachment 13: Screenshot_from_2021-05-13_09-20-23.png

Attachment 14: Screenshot_from_2021-05-13_09-21-05.png

Attachment 15: Screenshot_from_2021-05-13_09-21-53.png

Attachment 16: Screenshot_from_2021-05-13_09-22-18.png

Attachment 17: Screenshot_from_2021-05-13_11-19-16.png

Attachment 18: Screenshot_from_2021-05-13_11-19-30.png

Attachment 19: Screenshot_from_2021-05-13_11-20-09.png

Attachment 20: Screenshot_from_2021-05-13_11-20-33.png

Attachment 21: Screenshot_from_2021-05-13_11-20-59.png

Attachment 22: Screenshot_from_2021-05-13_11-21-29.png

Attachment 23: Screenshot_from_2021-05-13_11-21-53.png

Attachment 24: Screenshot_from_2021-05-13_11-22-30.png

Attachment 25: Screenshot_from_2021-05-13_11-24-36.png

Attachment 26: Screenshot_from_2021-05-13_13-09-43.png

Attachment 27: Screenshot_from_2021-05-13_13-10-03.png

Attachment 28: Screenshot_from_2021-05-13_13-10-28.png

Attachment 29: Screenshot_from_2021-05-13_13-10-52.png

Attachment 30: Screenshot_from_2021-05-13_13-11-22.png

Attachment 31: Screenshot_from_2021-05-13_13-11-51.png

Attachment 32: Screenshot_from_2021-05-13_13-12-24.png

Attachment 33: Screenshot_from_2021-05-13_13-13-34.png

Attachment 34: Screenshot_from_2021-05-13_13-14-16.png

310	Thu May 13 00:51:40 2021	Muneerah and OH	Thu 13 May 00:00-08:00
01:50 Beam on The leakage current and the voltages been monitered every half an hour and logged in the excel sheet, looks decreasing. Tempetratures OK Rates OK Attachment 1 Voltages Atachment 2 Rates Atachment 3 Temperatures Attachment 4 ucesb rates less than 1 kHz System wide check are ok except: Base Current Difference aida05 fault 0x36ca : 0x36ce : 4 White Rabbit error counter test result: Passed 15, Failed 1 Understand the status reports as follows: Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR Base Current Difference aida13 fault 0xa : 0xe9 : 223 FPGA Timestamp error counter test result: Passed 15, Failed 1 If any of these counts are reported as in error The ASIC readout system has detected a timeslip. That is the timestamp read from the time FIFO is not younger than the last Returned 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k aida01 : 0 5 3 0 1 4 3 3 3 3 6 : 36760 aida02 : 7 9 0 2 2 4 2 3 3 3 6 : 36644 aida03 : 1 3 2 1 2 1 2 3 3 3 6 : 36188 aida04 : 3 1 2 0 2 3 2 3 3 3 6 : 36404 aida05 : 20 9 3 2 2 3 2 2 3 3 6 : 36104 aida06 : 4 10 0 2 2 4 2 2 3 3 6 : 36128 aida07 : 3 1 2 1 3 3 2 3 3 3 6 : 36500 aida08 : 2 4 3 2 3 4 2 3 2 3 6 : 35672 aida09 : 1 6 3 3 1 4 2 3 2 3 6 : 35588 aida10 : 5 6 4 2 1 3 2 3 2 3 6 : 35460 aida11 : 23 8 2 2 2 3 3 4 2 3 6 : 36348 aida12 : 8 4 2 2 2 3 2 4 2 3 6 : 36000 aida13 : 2 5 3 1 2 4 3 3 2 3 6 : 35840 aida14 : 3 6 2 2 2 3 2 4 2 3 6 : 35996 aida15 : 2 4 3 3 0 4 1 3 3 3 6 : 36280 aida16 : 7 7 5 1 3 4 2 3 2 3 6 : 35716 <strong>05:00 OH Took over at 04:00</strong> System wide checks ok except Base Current Difference aida05 fault 0x36ca : 0x36d0 : 6 White Rabbit error counter test result: Passed 15, Failed 1 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR Base Current Difference aida05 fault 0x0 : 0x1 : 1 aida13 fault 0xa : 0xe9 : 223 FPGA Timestamp error counter test result: Passed 14, Failed 2 If any of these counts are reported as in error The ASIC readout system has detected a timeslip. That is the timestamp read from the time FIFO is not younger than the last 05:41 AIDA 05 has dropped out. Will restart the system 05:58 DAQ recovered from powercycle p+n strips at 0xa n+n strips at 0x20 ADC control register at 0xFF All waveforms turned off in LED Statistics - attachment 5 Correlation scaler in FEE 3 and 4 are mostly tracking 1:1 06:34 Local users have been unable to recover MBS And have been unable to contact local experts 07:22 Bias and leakage currents ok - attachment 6 Stats attachment -7
Attachment 1: 130521_0155_Voltages.png

Attachment 2: 130521_0157_Stats.png

Attachment 3: 130521_0158_Temp.png

Attachment 4: 130521_0204_ucesb.png

Attachment 5: 210513_0600_Stats.png

Attachment 6: 210513_0722_bias.png

Attachment 7: 210513_0722_Stats.png

309	Wed May 12 18:53:38 2021	JS	Wed 12 20:00-00:00
19:51 Shift change Stats ok ucesb ok, Max implants ~1500 Hz 20:30 Stats ok ucesb ok, Max implants ~1000 Hz current ok (maybe leveling out) 20:51 The online people are starting a new sort and are going to change some things with degraders I think. We are on R1_340. 20:59 Check Clock status test result: Passed 16, Failed 0 Calibration test result: Passed 16, Failed 0 WR: Base Current Difference aida05 fault 0x36ca : 0x36ce : 4 White Rabbit error counter test result: Passed 15, Failed 1 FPGA time: Base Current Difference aida13 fault 0xa : 0xb6 : 172 FPGA Timestamp error counter test result: Passed 15, Failed 1 --- both errors above same module as earlier shift Returned 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k aida01 : 1 3 2 0 1 3 3 2 3 3 6 : 36092 aida02 : 6 4 4 2 2 3 1 3 3 3 6 : 36280 aida03 : 6 3 2 0 0 3 3 2 3 3 6 : 36048 aida04 : 10 3 1 1 3 3 1 3 3 3 6 : 36272 aida05 : 19 8 2 0 2 3 1 3 3 3 6 : 36268 aida06 : 2 2 0 2 3 4 2 2 3 3 6 : 36120 aida07 : 6 7 3 0 3 4 3 2 3 3 6 : 36416 aida08 : 7 5 4 0 3 2 2 3 3 3 6 : 36420 aida09 : 21 6 3 2 2 4 2 3 2 3 6 : 35700 aida10 : 13 3 1 1 3 3 1 4 2 3 6 : 35772 aida11 : 25 6 4 2 1 4 2 4 2 3 6 : 36180 aida12 : 0 4 0 3 2 3 3 3 2 3 6 : 35712 aida13 : 18 5 2 3 2 3 2 4 2 3 6 : 36080 aida14 : 2 1 1 1 2 3 2 4 2 3 6 : 35904 aida15 : 0 1 1 3 0 4 2 2 3 3 6 : 35960 aida16 : 4 5 3 2 3 4 1 3 2 3 6 : 35432 ucesb ok elog:309/1 current ok elog:309/2 Stats ok elog:309/3 temps ok elog:309/4 21:36 ucesb ok Stats ok 22:01 ucesb ok 1500 Hz peak implant Stats ok temps ok bias ok - earlier rise seems to have stopped, 0.2uA fluctuations on values. 22:20 Nic noted that they were seeing fewer y-strips events (x agreed with FRS rate). Dead time was suggested as a problem. Oscar investigating, good event rate in midas doesn't show significant dead time. Looking at the difference in FEEs3 & 4, which should have the same scaler rate but don't, suggestion data lost in the pause and resume. Oscar is going to raise the threshold on one of the y FEEs as a test Increased aida4 slow comparator threshold changed There is some confusion as it seems to be dead time but apart rates shown look low enough, dead time is possibly masking true rate? Results of test, need thresholds 100keV on p+n and 320keV n+n to get a roughly 1:1 between FEE3 and FEE4 scaler 23:40 FRS magnet issue, possibly power, no beam 00:03 bias ok elog:309/5 has come down because no beam handing over to muneerah
Attachment 1: ucesb.png

Attachment 2: bias1.png

Attachment 3: Screenshot_2021-05-12_Statistics_aidas-gsi.png

Attachment 4: Screenshot_2021-05-12_Temperature_and_status_scan_aidas-gsi.png

Attachment 5: bias2.png

308	Wed May 12 15:03:10 2021	CB, OH	Wed 12 16:00-20:00
16:00 Shift change Statistics OK (attach 1) Temps OK (attach 2) Bias OK (attach 3) System wide checks Clock, ADC - OK WR Base Current Difference aida05 fault 0x36ca : 0x36cb : 1 White Rabbit error counter test result: Passed 15, Failed 1 FPGA Base Current Difference aida13 fault 0xa : 0x4b : 65 FPGA Timestamp error counter test result: Passed 15, Failed 1 If any of these counts are reported as in error The ASIC readout system has detected a timeslip. That is the timestamp read from the time FIFO is not younger than the last Returned 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k aida01 : 15 5 6 1 1 2 2 3 3 3 6 : 36388 aida02 : 21 10 2 2 2 3 2 2 3 3 6 : 36100 aida03 : 25 5 3 1 0 3 3 2 3 3 6 : 36188 aida04 : 5 2 0 3 2 3 2 3 3 3 6 : 36484 aida05 : 16 6 3 1 2 4 1 3 2 4 6 : 37440 aida06 : 2 2 2 2 2 3 1 3 3 3 6 : 36216 aida07 : 16 9 3 0 3 4 3 2 3 3 6 : 36472 aida08 : 0 7 1 1 2 2 3 3 2 3 6 : 35560 aida09 : 15 7 4 2 2 4 2 3 2 3 6 : 35700 aida10 : 3 7 3 4 1 3 1 4 1 4 6 : 36788 aida11 : 5 1 3 1 1 4 3 3 2 3 6 : 35756 aida12 : 5 5 0 3 2 3 2 4 2 3 6 : 35996 aida13 : 2 5 1 2 2 4 3 3 2 3 6 : 35840 aida14 : 19 5 3 1 1 2 1 3 3 3 6 : 36100 aida15 : 20 6 6 2 1 3 2 2 3 3 6 : 36064 aida16 : 7 9 4 1 3 4 2 3 2 3 6 : 35716 File size change Collecting the file size of each FEE64 Options CONTENTS file to check they are all the same FEE : aida01 => Options file size is 1026 Last changed Mon May 10 16:47:51 CEST 2021 FEE : aida02 => Options file size is 1014 Last changed Thu Apr 29 14:43:46 CEST 2021 FEE : aida03 => Options file size is 1014 Last changed Thu Apr 29 14:43:50 CEST 2021 FEE : aida04 => Options file size is 1014 Last changed Thu Apr 29 14:43:53 CEST 2021 FEE : aida05 => Options file size is 1014 Last changed Thu Apr 29 14:43:55 CEST 2021 FEE : aida06 => Options file size is 1014 Last changed Thu Apr 29 14:43:59 CEST 2021 FEE : aida07 => Options file size is 1014 Last changed Thu Apr 29 14:44:02 CEST 2021 FEE : aida08 => Options file size is 1025 Last changed Wed May 05 12:15:54 CEST 2021 FEE : aida09 => Options file size is 1014 Last changed Thu Apr 29 14:44:08 CEST 2021 FEE : aida10 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida11 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida12 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida13 => Options file size is 1025 Last changed Fri May 07 19:40:34 CEST 2021 FEE : aida14 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida15 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida16 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 16:20 Beam is back. Currently on File R1_200 16:43 Beam is being optimised. 17:00 UCESB OK Stats OK (attach 4) Temps OK Bias OK (attach 5) System-wide checks as before 17:30 Beam rate is quite high (up to 2000 Hz peak on ucesb). Stats still OK 17:52 Started compressing R1_1* 18:00 UCESB ok (attach 5) Stats OK (attach 6) Temps OK Bias OK (attach 7) System wide checks as before 19:00 UCESB ok (as before) Stats OK (attach 8) Temps OK Bias OK (attach 9) Merger OK (attach 10) 19:32 UCESB ok Stats OK (attach 11) Temps OK (attach 12) Bias OK (attach 13) System wide checks as before 19:51 Shift handed over to James S
Attachment 1: Stat1.png

Attachment 2: Temp1.png

Attachment 3: Bias1.png

Attachment 4: Stats2.png

Attachment 5: Bias2.png

Attachment 6: Stats3.png

Attachment 7: Bias3.png

Attachment 8: ucesb1.png

Attachment 9: Stats4.png

Attachment 10: Bias4.png

Attachment 11: Merger.png

Attachment 12: ucesb2.png

Attachment 13: Stats5.png

Attachment 14: Temps2.png

Attachment 15: Bias5.png

307	Wed May 12 06:59:55 2021	OH, RDP	Wed 12 May 08:00-16:00
08:00 While the rates appeared to have quietened around 7am they are back to their previous rate now. They still seem to be working on the setting. Implant rate in AIDA about 8 per spill. Thick degrader is still in place They have collected 25 minutes of implantation data. They are analysing this data to confirm the PID 08:38 The PID confirmation was apparently run number 4. During this run they were implanting Cd in AIDA DSSD2 09:09 They are now taking data implanting somewhere in the snout. I have turned off no storage. Unfortunately we are writing to NOTAPE R3. I was unable to change it as they were already taking data Data rate 16.3MB/s ucesb shows similar rates in SC42 and AIDA01. We may be implanting Te in AIDA then. 09:35 They stopped the DAQ as their is no beam. Switched the tapeserver over to R1 in directory S496. Setting to no storage 09:47 Beam back turned off no storage. On file R1_10 11:04 Now that we have implants on the detector we get a better look at the strips From the 1d pattern it is obvious that there is an adapter card misaligned in DSSD1- attachments 1 and 2 This adaptor board corresponds to FEE11 12:17 Leakage currents screenshot 512.png 13:30 Beam off. Expected back at 15:00... 14:09 Making use of the beam off time NH and HA entered S4 to investigate FEE1 and FEE11. They noticed FEE11 was off and have realigned that. All channels are now observed in that FEE They couldn't see anything wrong with the connector for FEE1. We are still missing a block of channels there. Rates are as before. No better, no worse. 15:31 Leakage currents screenshot 513.png. They are continuing to rise following the intervention in S4. It could just be because the temperature is rising...
Attachment 1: 1dImplants.png

Attachment 2: 1dImplants2.png

Attachment 3: 512.png

Attachment 4: 513.png

306	Wed May 12 02:07:59 2021	MA, BA	Wed 12 May 00:00-08:00
03:12 System Check attachment 1 : Current attachment 2 : Temperature attachment 3 : Rates Clock status test result: Passed 16, Failed 0 Understand status as follows Status bit 3 : firmware PLL that creates clocks from external clock not locked Status bit 2 : always logic '1' Status bit 1 : LMK3200(2) PLL and clock distribution chip not locked to external clock Status bit 0 : LMK3200(1) PLL and clock distribution chip not locked to external clock If all these bits are not set then the operation of the firmware is unreliable Calibration test result: Passed 16, Failed 0 If any modules fail calibration , check the clock status and open the FADC Align and Control browser page to rerun calibration for that module Base Current Difference aida05 fault 0x36ca : 0x36cb : 1 White Rabbit error counter test result: Passed 15, Failed 1 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR Base Current Difference aida13 fault 0xa : 0xf : 5 FPGA Timestamp error counter test result: Passed 15, Failed 1 If any of these counts are reported as in error The ASIC readout system has detected a timeslip. That is the timestamp read from the time FIFO is not younger than the last Returned 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k aida01 : 22 5 7 2 1 2 2 3 3 3 6 : 36464 aida02 : 9 8 3 3 1 4 1 2 4 3 6 : 36916 aida03 : 5 2 6 2 0 3 2 3 3 3 6 : 36420 aida04 : 6 5 2 3 4 4 2 3 3 3 6 : 36800 aida05 : 17 6 6 2 2 4 1 3 2 4 6 : 37524 aida06 : 7 12 3 4 3 3 1 3 3 3 6 : 36460 aida07 : 17 11 5 1 3 3 3 2 3 3 6 : 36428 aida08 : 3 5 0 1 4 2 2 4 2 3 6 : 35924 aida09 : 27 6 4 2 0 2 2 2 3 3 6 : 35868 aida10 : 16 11 8 0 2 2 1 3 2 4 6 : 37272 aida11 : 15 2 2 3 1 4 3 4 2 3 6 : 36364 aida12 : 1 6 4 3 1 3 2 4 2 3 6 : 35988 aida13 : 22 14 10 2 4 2 2 4 2 3 6 : 36264 aida14 : 26 10 4 3 2 1 1 3 3 3 6 : 36184 aida15 : 14 2 3 2 2 4 1 2 3 3 6 : 35896 aida16 : 7 5 4 0 2 4 2 3 2 3 6 : 35588 06:10 DSSD1 rate high! Attached 4 Called OH and he woke up to fix it :) It was a problem with one of the ASIC according to what he says: One of the ASICs HEC was running crazy!. Forced the ASICs to check their settings which brings them to back into line see attachment 9. This done by around 06:35 07:03 System check attachment 5 Spectrum rate attachment 6 Voltages attachment 7 Rates attachment 8 Temperature System wide clock are all ok except White rabbit Base Current Difference aida05 fault 0x36ca : 0x36cb : 1 White Rabbit error counter test result: Passed 15, Failed 1 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR FPGA Base Current Difference aida13 fault 0xa : 0x14 : 10 FPGA Timestamp error counter test result: Passed 15, Failed 1 If any of these counts are reported as in error The ASIC readout system has detected a timeslip. That is the timestamp read from the time FIFO is not younger than the last
Attachment 1: 1205_0310.png

Attachment 2: 1205_0311.png

Attachment 3: 1205_0312.png

Attachment 4: 120521_0630ucesb.png

Attachment 5: 120521_0639_SpecRates.png

Attachment 6: 120521_0655_Voltages.png

Attachment 7: 120521_0657_Rates.png

Attachment 8: 120521_0685_Temp.png

Attachment 9: 120521_0635_ASICs.png

305	Tue May 11 07:21:24 2021	OH	Tuesday 11 May
08:20 System wide checks all ok except Base Current Difference aida01 fault 0xc10c : 0xc10e : 2 aida02 fault 0xbe2a : 0xbe2c : 2 aida03 fault 0xf665 : 0xf667 : 2 aida04 fault 0xeabd : 0xeabf : 2 aida05 fault 0x36c8 : 0x36ca : 2 aida06 fault 0x2ea2 : 0x2ea4 : 2 aida07 fault 0x9186 : 0x9188 : 2 aida08 fault 0x5443 : 0x5445 : 2 White Rabbit error counter test result: Passed 8, Failed 8 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR and Base Current Difference aida01 fault 0xc10c : 0xc10e : 2 aida02 fault 0xbe2a : 0xbe2c : 2 aida03 fault 0xf665 : 0xf667 : 2 aida04 fault 0xeabd : 0xeabf : 2 aida05 fault 0x36c8 : 0x36ca : 2 aida06 fault 0x2ea2 : 0x2ea4 : 2 aida07 fault 0x9186 : 0x9188 : 2 aida08 fault 0x5443 : 0x5445 : 2 White Rabbit error counter test result: Passed 8, Failed 8 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR Statistics still high - attachment 1 Temperatures ok - attachment 2 Bias and leakage currents ok - attachment 3
Attachment 1: 210511_0823_Stats.png

Attachment 2: 210511_0824_Temp.png

Attachment 3: 210511_0825_Bias.png

304	Mon May 10 11:45:15 2021	NH	Confusing behaviour of rates
Testing the behaviour of powering down the fast ADCs in aida01 (the hot FEE) Set local control 2 to 0xff in aida01 Wait... see temperature drpos by ~3 degrees (PJCS reports much larger drop in T9) So far so normal but aida05 rates go very high when this waveform is disabled!! Set local control to 0x00 again They drop back... Recalibrated FADCs and back to normal
303	Mon May 10 08:49:37 2021	TD	Monday 10 May
09.51 All system wide checks OK except Base Current Difference aida05 fault 0x8441 : 0x8442 : 1 aida06 fault 0xc5c5 : 0xc5c6 : 1 aida07 fault 0x6f07 : 0x6f08 : 1 aida08 fault 0x4814 : 0x4815 : 1 White Rabbit error counter test result: Passed 12, Failed 4 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR Returned 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k aida01 : 1 4 6 3 5 5 2 3 2 3 6 : 36004 aida02 : 4 1 3 6 3 4 3 3 2 3 6 : 36040 aida03 : 12 8 5 2 3 3 3 4 2 3 6 : 36416 aida04 : 1 2 5 4 1 4 3 4 2 3 6 : 36388 aida05 : 22 8 4 2 4 5 1 4 1 4 6 : 37272 aida06 : 5 4 0 6 3 6 3 3 2 3 6 : 36276 aida07 : 38 16 7 7 1 6 1 3 3 3 6 : 37032 aida08 : 16 4 2 3 1 4 1 3 3 3 6 : 36384 aida09 : 2 3 7 6 5 5 2 3 2 3 6 : 36112 aida10 : 42 15 4 6 2 6 2 4 2 3 6 : 36768 aida11 : 1 5 13 7 3 3 3 3 2 3 6 : 36124 aida12 : 23 9 3 4 7 3 2 3 2 3 6 : 35988 aida13 : 2 6 7 3 4 4 3 2 2 3 6 : 35592 aida14 : 17 11 3 4 3 5 2 3 2 3 6 : 35980 aida15 : 4 7 5 2 1 6 2 3 2 3 6 : 35864 aida16 : 4 1 3 3 4 2 3 4 2 3 6 : 36264 Collecting the file size of each FEE64 Options CONTENTS file to check they are all the same FEE : aida01 => Options file size is 1026 Last changed Sun May 09 15:10:52 CEST 2021 FEE : aida02 => Options file size is 1014 Last changed Thu Apr 29 14:43:46 CEST 2021 FEE : aida03 => Options file size is 1014 Last changed Thu Apr 29 14:43:50 CEST 2021 FEE : aida04 => Options file size is 1014 Last changed Thu Apr 29 14:43:53 CEST 2021 FEE : aida05 => Options file size is 1014 Last changed Thu Apr 29 14:43:55 CEST 2021 FEE : aida06 => Options file size is 1014 Last changed Thu Apr 29 14:43:59 CEST 2021 FEE : aida07 => Options file size is 1014 Last changed Thu Apr 29 14:44:02 CEST 2021 FEE : aida08 => Options file size is 1025 Last changed Wed May 05 12:15:54 CEST 2021 FEE : aida09 => Options file size is 1014 Last changed Thu Apr 29 14:44:08 CEST 2021 FEE : aida10 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida11 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida12 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida13 => Options file size is 1025 Last changed Fri May 07 19:40:34 CEST 2021 FEE : aida14 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida15 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida16 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 09.52 All histograms, stats and merger stats zero'd FEE64 temps OK - attachment 1 ADC data, disc/WR 28-27/pause/correlation stats OK - attachments 2-6 Rate spectra - attachment 7 ASIC check load Rate spectra - attachment 8 1.8.W spectra 20us FSR - attachments 9 & 10 Grafana - most recent 7 days DSSSD bias and leakage current - attachment 11 Merger stats/tape server/merger - attachment 12 DSSSD bias and leakage current OK - attachment 13 10.08 1.8.W spectra 20us, 200us, 2ms & 20ms FSR - attachments 14-21 we are not missing extrinsic noise features at longer time ranges cf. 20us FSR 12.18 Cannot connect to port 8015, MIDAS terminal says "Killed" Restart MIDAS 8015 Collect FPGA baseline to avoid TCL error FEEs unaffected and running as before 13.25 FEEs power cycled to see if any change in weird noise/rates situation No change ASICs synchronised and back to normal 14.34 Start a pulser walkthrough in May21/R10 Attenuation 5x, Rep Rate 25 Hz Amplitudes 10..9...1 14.45 Back to 2 Hz @ 2V Pulser, walkthrough complete. No Storage again. PULSER SETTINGS --------------------------- Pulse is ON Positive Tail Pulse Trigger Source is Internal Clock Trigger Threshold is 3.5 Amplitude : 2.0 Volts Rep Rate : 2.0 hZ Delay : 250.0 ns Fall Time : 1 ms Attenuation : 1 Display is : Volts Equivalent keV is : 200.0 (NB. actually it is 12 MeV) Ramp Start at 0.01 Volts Ramp Stop at 9.99 Volts Ramp Start at 1.0 keV Ramp Stop at 999.0 keV Ramp Time is 60 seconds # Ramp Cycles is 1 OK
Attachment 1: Screenshot_2021-05-10_Temperature_and_status_scan_aidas-gsi.png

Attachment 2: Screenshot_2021-05-10_Statistics_aidas-gsi.png

Attachment 3: Screenshot_2021-05-10_Statistics_aidas-gsi(1).png

Attachment 4: Screenshot_2021-05-10_Statistics_aidas-gsi(2).png

Attachment 5: Screenshot_2021-05-10_Statistics_aidas-gsi(3).png

Attachment 6: Screenshot_2021-05-10_Statistics_aidas-gsi(4).png

Attachment 7: Screenshot_2021-05-10_Spectrum_Browser_aidas-gsi.png

Attachment 8: Screenshot_2021-05-10_Spectrum_Browser_aidas-gsi(1).png

Attachment 9: Screenshot_2021-05-10_Spectrum_Browser_aidas-gsi(2).png

Attachment 10: Screenshot_2021-05-10_Spectrum_Browser_aidas-gsi(3).png

Attachment 11: Screenshot_2021-05-10_AIDA_Alerting_-_Grafana.png

Attachment 12: 510.png

Attachment 13: 511.png

Attachment 14: Screenshot_2021-05-10_Spectrum_Browser_aidas-gsi(4).png

Attachment 15: Screenshot_2021-05-10_Spectrum_Browser_aidas-gsi(11).png

Attachment 16: Screenshot_2021-05-10_Spectrum_Browser_aidas-gsi(5).png

Attachment 17: Screenshot_2021-05-10_Spectrum_Browser_aidas-gsi(10).png

Attachment 18: Screenshot_2021-05-10_Spectrum_Browser_aidas-gsi(6).png

Attachment 19: Screenshot_2021-05-10_Spectrum_Browser_aidas-gsi(9).png

Attachment 20: Screenshot_2021-05-10_Spectrum_Browser_aidas-gsi(7).png

Attachment 21: Screenshot_2021-05-10_Spectrum_Browser_aidas-gsi(8).png

302	Sun May 9 19:29:23 2021	TD	Sunday 9 May

Attachment 1: Screenshot_2021-05-09_Temperature_and_status_scan_aidas-gsi.png

Attachment 2: Screenshot_2021-05-09_Statistics_aidas-gsi.png

Attachment 3: Screenshot_2021-05-09_Statistics_aidas-gsi(1).png

Attachment 4: Screenshot_2021-05-09_Statistics_aidas-gsi(2).png

Attachment 5: Screenshot_2021-05-09_Statistics_aidas-gsi(3).png

Attachment 6: Screenshot_2021-05-09_System_wide_Checks_aidas-gsi.png

Attachment 7: Screenshot_2021-05-09_Spectrum_Browser_aidas-gsi.png

Attachment 8: Screenshot_2021-05-09_Spectrum_Browser_aidas-gsi(1).png

Attachment 9: Screenshot_2021-05-09_Spectrum_Browser_aidas-gsi(2).png

Attachment 10: Screenshot_2021-05-09_Spectrum_Browser_aidas-gsi(3).png

Attachment 11: Screenshot_2021-05-09_Spectrum_Browser_aidas-gsi(4).png

Attachment 12: Screenshot_2021-05-09_AIDA_Alerting_-_Grafana.png

Attachment 13: 503.png

Attachment 14: 504.png

Goto page Previous 1, 2, 3 ... 19, 20, 21 ... 33, 34, 35 Next

ELOG V3.1.4-unknown