ELOG DESPEC

AIDA GELINA BRIKEN nToF CRIB ISOLDE CIRCE nTOFCapture DESPEC DTAS EDI_PSA 179Ta CARME StellarModelling DCF K40

DESPEC, Page 6 of 37

Full | Summary | Threaded | Hide attachments

728 Entries

Goto page Previous 1, 2, 3 ... 5, 6, 7 ... 35, 36, 37 Next

ID	Date	Author	Subject
630	Tue May 7 13:25:00 2024	JB, CC, NH, HMA	Tuesday 6 May - dismount snout
Status before dismount 14:26 DSSSD#1 119.99 V @ 17.968 uA DSSSD#2 119.95 V @ 11.212 uA Leakage currents slightly elevated from Monday. S4 temperature at 26 °C. 14:30 Detectors being debiased. All relay channels turned off. Voltages and currents of both DSSSDs to 0. Plan: - Dismount snout. - Open up and remove BB7 and Upstream bPlast - leave AIDA 1 and 2 in place if possible.
Attachment 1: Screenshot_from_2024-05-07_14-25-52.png

Attachment 2: Screenshot_from_2024-05-07_14-29-13.png

296	Wed May 5 16:57:48 2021	TD	Tuesday 5 May
17.55 Grafana DSSSD bias & leakage current - attachment 1 Note abrupt decrease of DSSSD# 2 leakage current c. 1.5uA at 17.37 DSSSD bias & leakage currents - attachment 2
Attachment 1: Screenshot_2021-05-05_AIDA_Alerting_-_Grafana(1).png

Attachment 2: 401.png

528	Tue Mar 5 09:10:01 2024	MA, JB, TD	Tuesday 5 March
Old ribbon cable assemblies - attachments 1 2 Length of cable from base of AIDA snout assembly to Samtec FFSD ribbon cable connectors p+n junction side 10-11cm & 25.5cm n+n Ohmic side 11cm & 25cm Distance from Delron base of AIDA snout assembly to Samtec CLP connectors ( Kapton PCBs ) 51.5cm & 52.5cm Manufacture of new ribbon cable assemblies - attachment 3 8x 2x 29" Samtec FFSD 34-way cables 8x 2x 23" Samtec FFSD 34-way cables 17.52 from Helena "These are the detector positions within the snout: Total snout length of 573 mm (380 mm bottom stage + 193 top stage), relative to the 'black flange' of the AIDA frame Upstream AIDA @ 513 mm Downstream AIDA @ 523 mm This leaves 5cm space for the Downstream bPlast AND the BB7 layer together. I believe this should be enough space - can you all confirm for AIDA/bPlast/BB7 if this is agreed upon? It would be great to get a fast response so that we are ready for mounting tomorrow. If we need more space we could think of shifting everything upstream by 10mm. The upstream bPlast will need to go first such that the upstream AIDA is at 513mm. I don't have the measurements to hand to give the position."
Attachment 1: 20240305_101140.jpg

Attachment 2: 20240305_101146.jpg

Attachment 3: 20240305_165949.jpg

410	Tue Apr 5 08:52:16 2022	TD	Tuesday 5 April
DSSSD bias OFF. DAQ STOPped Attachment 1 FEE64 temps OK Attachment 2 system wide checks OK except WR decoder (attachment 2) and FPGA ts errors no longer works Attachment 6 System wide check - 'Synchronise ASIC clocks' Attachment 5 System wide check - check ADC calibration - all 16x FEE64s fail Attachment 4 System wide check - WR decoder status - aida09 WR status 0x10 clears Repeat Synchronsie ASIC clocks Attachment 3 System wide check - WR decoder status - aida05 WR status 0x10 clears
Attachment 1: Screenshot_from_2022-04-05_09-52-42.png

Attachment 2: Screenshot_from_2022-04-05_10-05-59.png

Attachment 3: Screenshot_from_2022-04-05_16-10-31.png

Attachment 4: Screenshot_from_2022-04-05_16-09-38.png

Attachment 5: Screenshot_from_2022-04-05_16-09-30.png

Attachment 6: Screenshot_from_2022-04-05_16-08-44.png

1	Thu Sep 6 15:11:17 2018	OH, TD	Tuesday 4 September - Thursday 6 September
Attachment 1 - FEE64 temperatures illustrating (we assume) a faulty PSU temperature sensor for aida07 Attachment 2 - FEE64 temperatures following replacement of aida07 Attachment 3-5 - 1..W waveforms for aida01 - aida03 - LED settings for aida02 incorrect, aida01 adaptor PCB incorrectly aligned Attachment 6-7 - 1..W waveforms for aida02 and aida04 Attachment 8-9 - aida01 - aida04 1.8.L spectra full range and expanded scale pulser peak width c. 15-20 channels FWHM Attachment 10-12 - good events stats for all FEE64s and all statistics for aida01 and aida05 Note aida01 - aida04 show rates expected, all other FEE64s show very rates due to noise aida01 - aida04 adaptor PCB are well grounded to FEE64 copper mezzanine/cooling plate, the other FEE64s are not Attachment 13-14 - aida01 - aida04 rate spectra before and after correcting alignment of aida01 adaptor PCB Attachment 15 - aida01 - aida04 1.8.L spectra, expanded scale Attachment 16 - illustrates high frequency noise (period 5 samples = 100ns) for aida01 which is not observed for aida02 - aida03 subsequently determined that this is not due to a possible adaptor PCB fault by changing the adaptor PCB Note that with bias turned on this noise did appear when Bias was on but all the other groudning connectors for aida05-aida12 were not in effect. Attachment 17-19 - PuTTY connection to CAEN 1419ET 4ch high voltage supply illustrating PuTTY, N1419ET configuration and leakage current with 100V applied to adaptor PCBs (no input cabling or DSSSD connected) Note the CAEN N1419ET appears as a 'USB ACM' device and we connect using /dev/ttyACM<n>.
Attachment 1: 180904_1615_FeeTemp.png

Attachment 2: 180905_1444_FEETemp.png

Attachment 3: 180905_1636_aida01W.png

Attachment 4: 180905_1643_aida02W.png

Attachment 5: 180905_1644_aida03W.png

Attachment 6: 180905_1646_aida02W.png

Attachment 7: 180905_1647_aida04W.png

Attachment 8: 8_L.png

Attachment 9: 8_L_Zoom.png

Attachment 10: 180905_1653_Stats.png

Attachment 11: 180905_1654_aida01Stats.png

Attachment 12: 180905_1654_aida05Stats.png

Attachment 13: 180905_1657_HitRateAida1-4.png

Attachment 14: 180905_1703_HitRateZoomPostAlign.png

Attachment 15: 180905_1707_aida01_1_8_L.png

Attachment 16: 180905_1709_aida01W.png

Attachment 17: 180906_1424_biasWindow.png

Attachment 18: 180906_1425_Putty.png

Attachment 19: 180906_1441_BiasOnNoDSSD.png

291	Tue May 4 13:53:22 2021	OH, TD	Tuesday 4 May
NH has re-checked alignment of AIDA adaptor PCBs cf. Elog:290 14.40 Rate spectra - attachment 1 adc data items - attachment 2 slow comparator 0xa stats for p+n much improved, n+n remain poor 1.8.W spectra - attachments 3 & 4 1.8.L spectra - attachments 5 & 6 pulser peak widths aida01 69 ch FWHM, aida02 247 ch FWHM 17:31 Bias lowered to 100V on DSSD2 after noticing the leakage current has increased 2uA over the previous 3 hours. - attachment 7
Attachment 1: Screenshot_2021-05-04_Spectrum_Browser_aidas-gsi.png

Attachment 2: Screenshot_2021-05-04_Statistics_aidas-gsi.png

Attachment 3: Screenshot_2021-05-04_Spectrum_Browser_aidas-gsi(1).png

Attachment 4: Screenshot_2021-05-04_Spectrum_Browser_aidas-gsi(2).png

Attachment 5: Screenshot_2021-05-04_Spectrum_Browser_aidas-gsi(3).png

Attachment 6: Screenshot_2021-05-04_Spectrum_Browser_aidas-gsi(4).png

Attachment 7: 210504_Leakage.png

474	Tue May 31 09:05:00 2022	NH, TD	Tuesday 31 May
DSSD stack will be as follows 1 3208-7 1019 125 upstream 2 3208-13 1020 120 downstream First start checking bias pins on both detectors These are pins on the bottom right of each 68 pin connector (C-2299) Expect finite resistance 3208-7: Top and bottom: 22 Ohm Left and right: 22 Ohm 3208-13: Top and bottom: 22 Ohm Left and right: 22 Ohm Conclusion: All bias bond wires are intact on both DSSDs Visual inspection is both DSSDs look good with no damage or bond wire issues Installed in snout: full stack 3 mm bPlas 1 17 mm Air 1 mm AIDA 1 (645 mm from base of snout) 9 mm Air 1 mm AIDA 2 (655 mm from base of snout) 12 mm Air 3 mm bPlas 2
475	Tue May 31 17:09:35 2022	TD	Tuesday 31 May
2x MSL type BB18(DS)-1000 installed Adaptor PCB LK config all FEE64s LK2, LK4 fitted n+n FEE64s LK1 fitted bottom p+n FEE64s LK3 fitted AIDA PSU config top 1-3 2-4 bottom 5-7 6-8 DSSSD bias -> p+n FEE64 core, n+n FEE64 braid Heavy duty grounds not connected to FEE64 adaptor PCBs ASIC settings 2021Apr29-13-16-00 slow comparator 0xa BNC PB-5 settings amplitude 1.000V attenuation x1 tau_d 1ms frequency 25Hz polarity + Attachment 1 - DSSSD bias & Leakage current - OK Attachment 2 - FEE64 temps OK Attachment 3 - adc data item stats Attachments 4-9 - system wide checks OK except aida07 fails ADC calibration Attachments 10 & 11 - 1.8.W spectra 20us FSR Attachments 12 & 13 - 1.8.L spectra - aida03 pulser peak width 155 ch FWHM Attachment 14 - per FEE64 rate spectra 19.15 Attachments 15-18 - 2*W spectra for aida01, 02, 03 &04 Attachment 19 - per FEE64 rate spectra Attachment 20 - adc data item stats
Attachment 1: Screenshot_from_2022-05-31_18-09-27.png

Attachment 2: Screenshot_from_2022-05-31_18-09-49.png

Attachment 3: Screenshot_from_2022-05-31_18-10-18.png

Attachment 4: Screenshot_from_2022-05-31_18-17-27.png

Attachment 5: Screenshot_from_2022-05-31_18-17-02.png

Attachment 6: Screenshot_from_2022-05-31_18-16-43.png

Attachment 7: Screenshot_from_2022-05-31_18-16-28.png

Attachment 8: Screenshot_from_2022-05-31_18-16-12.png

Attachment 9: Screenshot_from_2022-05-31_18-15-13.png

Attachment 10: Screenshot_from_2022-05-31_18-32-34.png

Attachment 11: Screenshot_from_2022-05-31_18-31-56.png

Attachment 12: Screenshot_from_2022-05-31_18-30-55.png

Attachment 13: Screenshot_from_2022-05-31_18-29-53.png

Attachment 14: Screenshot_from_2022-05-31_18-28-56.png

Attachment 15: Screenshot_from_2022-05-31_19-13-51.png

Attachment 16: Screenshot_from_2022-05-31_19-13-03.png

Attachment 17: Screenshot_from_2022-05-31_19-12-19.png

Attachment 18: Screenshot_from_2022-05-31_19-11-24.png

Attachment 19: Screenshot_from_2022-05-31_19-09-10.png

Attachment 20: Screenshot_from_2022-05-31_19-06-59.png

623	Tue Apr 30 09:06:45 2024	TD, NH	Tuesday 30 April
10.00 DSSSD bias & leakasge current - Grafana - attachments 1-2 FEE64 temperatures OK - attachment 3 ADC data item stats - attachment 4 9/16 FEE64s < 20k per FEE64 Rate spectra - attachment 5 Merger etc - attachments 6-7 aida02, aida04 inactive 11.20 DAQ restarted aida02 and aida04 now producing data 11.30 analysis data file R22_313 all deadtimes <1% no timewarps HEC data item rate 560Hz (all from one channel of aida08 asic #3) aida03 & aida04 MBS rates c. 24kHz 14.32 FEE64 temperatures OK ADC data item stats OK all FEE64s producing data 14.43 all histograms & stats zero'd [NH checks here] 21.26 aida04 stopped forwarding to merger the "quick fix" (stop merger, rerun) worked MBS is having huge issues on DESPEC side, AIDA not included Decide to stop taking data to disk for now (no storage mode on) Keeping running (incl. to AIDA FDR MBS) just to get an idea of stability System Wide Checks clocks PASSED ADC IGNORED WR: Base Current Difference aida02 fault 0xe4d8 : 0x65c0 : -32536 aida03 fault 0x2371 : 0x2380 : 15 aida04 fault 0xa210 : 0xaf58 : 3400 aida06 fault 0x3624 : 0x3626 : 2 White Rabbit error counter test result: Passed 12, Failed 4 FPGA: Base Current Difference aida02 fault 0xaa3b : 0xc455 : 6682 aida04 fault 0x5a4 : 0x6ba : 278 aida06 fault 0x0 : 0x1 : 1 FPGA Timestamp error counter test result: Passed 13, Failed 3 If any of these counts are reported as in error The ASIC readout system has detected a timeslip. That is the timestamp read from the time FIFO is not younger than the last Module aida04 LMK PLL channel 1 lock transition counter has incremented Module aida04 LMK PLL channel 2 lock transition counter has incremented PLL lock counter test result: Passed 15, Failed 1 Baselines reset 22.50 FEE64 temps ok merger ok all links active ADC data item stats ok
Attachment 1: Screenshot_from_2024-04-30_10-05-08.png

Attachment 2: Screenshot_from_2024-04-30_10-05-37.png

Attachment 3: Screenshot_from_2024-04-30_10-01-32.png

Attachment 4: Screenshot_from_2024-04-30_10-02-03.png

Attachment 5: Screenshot_from_2024-04-30_10-03-26.png

Attachment 6: Screenshot_from_2024-04-30_10-03-58.png

Attachment 7: R22_313
* TDR format 3.3.0 analyser - TD - May 2021 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 246802750 ( 787077.4 Hz) Other data format: 15117251 ( 48210.3 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 802 ( 2.6 Hz) RESUME: 802 ( 2.6 Hz) SYNC100: 33168 ( 105.8 Hz) WR48-63: 33168 ( 105.8 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 15049311 ( 47993.7 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 182597 ( 582.3 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 313.569 s FEE elapsed dead time(s) elapsed idle time(s) 0 0.000 0.000 1 0.000 0.000 2 0.000 0.000 3 0.410 0.000 4 0.000 0.000 5 0.208 0.000 6 0.000 0.000 7 1.577 0.000 8 0.000 0.000 9 0.000 0.000 10 1.890 0.000 11 0.000 0.000 12 0.000 0.000 13 0.000 0.000 14 0.000 0.000 15 1.784 0.000 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 4403022 10517 0 0 0 0 556 556 0 9405 0 0 1 4797622 11663 0 0 0 0 607 607 0 10449 0 0 2 9960742 7551016 0 0 0 0 2246 2246 0 7546524 0 0 3 26989916 7491649 0 0 64 64 4294 4294 0 7482933 0 0 4 2737535 758 0 0 0 0 379 379 0 0 0 0 5 21805196 5662 0 0 70 70 2761 2761 0 0 0 0 6 6978804 1886 0 0 0 0 943 943 0 0 0 0 7 53329550 13820 0 0 126 126 6784 6784 0 0 0 182597 8 479454 122 0 0 0 0 61 61 0 0 0 0 9 5592721 1538 0 0 0 0 769 769 0 0 0 0 10 39929583 11138 0 0 441 441 5128 5128 0 0 0 0 11 2351324 636 0 0 0 0 318 318 0 0 0 0 12 5309169 1226 0 0 0 0 613 613 0 0 0 0 13 3913898 1006 0 0 0 0 503 503 0 0 0 0 14 2364855 578 0 0 0 0 289 289 0 0 0 0 15 55859359 14036 0 0 101 101 6917 6917 0 0 0 0 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time: 32.668s ( 979.553 blocks/s, 61.222 Mb/s)
41	Tue Apr 2 07:39:44 2019	CB, TD, CA	Tuesday 2nd April 2019
08:15 beam tuning in progress 08.30 System wide checks - aida06 global clock failure (check clock status) - aida02 , aida04, aida06 fail calibration (ADC calibration) - SYNC error counter ok - SYNC pulse check ok - 'collect memory information from FEE64 Linux' still returns scripting error -> will not check again until update - WR decoder test passes - good event statistics OK, except aida 09, 10, 11, 12 as yesterday morning (see attach 1) - FEE temperature OK (see attach 2) - Detector OK (see attach 3) - NewMerger. MergerHTTPd, newMerger Terminal, data relay MBS screenshots attached (4,5,6,7) 10:37 Issues with magnets due to the new control system. Beam tuning continues AIDA continues running OK - aida06 global clock failure (check clock status) - aida02 , aida04, aida06 fail calibration (ADC calibration) - SYNC error counter ok - SYNC pulse check ok - WR decoder test passes - good event statistics OK, except aida 09, 10 (see attach 8). Aida 9 & 12 rates now lower - FEE temperature OK - Detector OK - Merger OK 12:21 Beam start AIDA continues running OK - aida06 global clock failure (check clock status) - aida02 , aida04, aida06 fail calibration (ADC calibration) - SYNC error counter ok - SYNC pulse check ok - WR decoder test passes -ASIC check load performed -Writing to file R11 in directory 290319 -histograms zeroed -good event statistics OK, except aida 09, 10 (attachment 9) -FEE temperatures ok (attachment 10) -detector bias ok (attachment 11) -thick degrader was placed in front of snout during beam operation 12:40 beam stop TapeServer stopped, file R11_0 in 290319 TapeServer restarted, not writing to file low energy spectra for aida09 (attachment 12) high energy spectra for aida09 (attachment 13) high energy spectra for aida11 (attachment 14) 1D hit patterns (stat) in aida09,10,11,12 (attachment 15) ASIC control settings used during beam, including thresholds (attachment 16) 14.20 *NOTE degrader setting different from yesterday, silver beam still not observed, just unidentified light ions. AIDA continues running OK aida06 global clock failure (check clock status) aida02 , aida04, aida06 fail calibration (ADC calibration) SYNC error counter ok SYNC pulse check ok WR decoder test passes 14.37 good event statistics OK, except aida 10 (attachment 17) detector bias ok (attachment 18) FEE temperatures ok (attachment 19) 14.54 Degrader removed 16:13 AIDA continues running OK aida06 global clock failure (check clock status) aida02 , aida04, aida06 fail calibration (ADC calibration) SYNC error counter ok SYNC pulse check ok WR decoder test passes FEE64 temperatures OK good event statistics OK, except aida 3, 9, 10 running hot (see attach 18) 17:00 Beam start - no degrader AIDA running OK Writing on file R13 Beam is better focused (see attach 19). Appears to be off-centre in the bottom right part of the detector Rates OK (see attach 20) DSSD bias/current OK (see attach 21) 17:21 Beam re-centred. Histograms cleared - see attach 22 AIDA continues OK Run continues High energy spectra in aida09 (attachment 25) Beam rate approx 5000 ions/s Beam being diffused TapeServer start stop - AIDA writing to file R14 in 290319 17:48 1D hit patterns - beam in process of being diffused (attachment 26) 17:57 leakage current back at 1.465 uA (attachment 27) 18:08 beam stopped TapeServer stopped and restarted - not writing to file updated hit patterns from beam diffusing (attachment 28) aida10, ADC3 high energy spectra (attachment 29) 18.11 calibrating tpc with masks TapeServer stop/start R16, 290319 18.49 leakage current briefly fluctuating between ~1.2 uA and ~2 uA, but has returned to stability at ~ 1.4 uA (attachment 30) 18.55 beam stopped for tuning - TapeServer stop/start. Not writing to file. 18.58 leakage current still stable after beam off (attachment 31) 19.10 beam start. TapeServer stop/start writing to file R18 in 290319 19.15 leakage current still ok after beam activation 19.34 fee12 high energy spectra (attachment 32) 20.35 beam stop, tapeserver stopped histogramming link dropped on aida 12 20.38 beam start. TapeServer start R20
Attachment 1: 71.png

Attachment 2: 72.png

Attachment 3: 73.png

Attachment 4: 74.png

Attachment 5: 75.png

Attachment 6: 76.png

Attachment 7: 76.png

Attachment 8: 78.png

Attachment 9: 020419_1227_stats.png

Attachment 10: 020419_1228_temp.png

Attachment 11: 020419_1230_bias.png

Attachment 12: 020419_1235_lowenergyspectraaida09.png

Attachment 13: 020419_HEspectra_09(2).png

Attachment 14: 040219_1257_HEspectra11.png

Attachment 15: highenergyhitpatters020419_1300.png

Attachment 16: 020419_noon_asiccontrol.png

Attachment 17: 020419_1434_stats.png

Attachment 18: 020419_1436_bias.png

Attachment 19: 040219_1454_temp.png

Attachment 20: 79.png

Attachment 21: 80.png

Attachment 22: 81.png

Attachment 23: 82.png

Attachment 24: 84.png

Attachment 25: 020419_1737_HEspectra09.png

Attachment 26: 020419_1748_hitpattern.png

Attachment 27: 020419_1756_bias.png

Attachment 28: 020419_1803_hitpattern.png

Attachment 29: 020419_1807_315H.png

Attachment 30: 020418_1851_bias.png

Attachment 31: 020419_1859_bias.png

Attachment 32: 040219_1932_22h_12.png

Attachment 33: 020419_1954_hitpatter.png

Attachment 34: 020419_2003_hitpattern.png

Attachment 35: 020419_2006_waveforms.png

Attachment 36: 020419_2035_bias.png

506	Mon Jun 27 23:11:47 2022	TD	Tuesday 28 June 00:00-08:00
00:07 Zero stats & all histograms ASIC settings 2021Apr29-13-16-00 slow comparator 0x64 -> 0xa all waveform AD9252 ADCs disabled all fast discs disabled BNC PB-5 settings (to p+n FEE64s only) amplitude 1.0V attenuator x1 decay time 1ms polarity + frequency 22Hz analysis of file S505/R5_896 - attachment 1 zero timewarps deadtime all FEE64s << 1% All system wide checks OK except WR & FPGA errors - attachments 2 & 3 adc data item stats - attachment 4 FEE64 temps OK - attachment 5 DSSSD bias & leakage currents OK - attachment 6 & 7 00:15 Check ASIC control all FEE64s, all ASICs 02:03 analysis of file S505/R5_914 - attachment 8 zero timewarps deadtime all FEE64s << 1% per FEE64 1.8.H spectra - attachments 9 & 10 per p+n FEE64 1.8.L spectra - attachment 11 aida01 pulser peak width 94 ch FWHM per FEE64 stat & rate spectra - attachments 12 & 13 All system wide checks OK except WR & FPGA errors - attachments 14 & 15 adc data item stats - attachment 16 FEE64 temps OK - attachment 17 DSSSD bias & leakage currents OK - attachment 18 03:31 S505 PI Anabel declares experiment end - following periods of beam loss and FRS DAQ issues today 03:41 analysis of file S505/R5_926 - attachment 19 zero timewarps deadtime all FEE64s << 1% All system wide checks OK except WR & FPGA errors - attachments 20 & 21 adc data item stats - attachment 22 FEE64 temps OK - attachment 23 DSSSD bias & leakage currents OK - attachment 24 07:00 analysis of file S505/R5_954 - attachment 25 zero timewarps deadtime all FEE64s << 1% All system wide checks OK except WR & FPGA errors - attachments 26 & 27 adc data item stats - attachment 28 FEE64 temps OK - attachment 29 DSSSD bias & leakage currents OK - attachment 30
Attachment 1: R5_896
* TDR format 3.3.0 analyser - TD - May 2021 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 261821326 ( 595374.9 Hz) Other data format: 98676 ( 224.4 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 406 ( 0.9 Hz) RESUME: 406 ( 0.9 Hz) SYNC100: 33638 ( 76.5 Hz) WR48-63: 33638 ( 76.5 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 30588 ( 69.6 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 0 ( 0.0 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 439.759 s FEE elapsed dead time(s) elapsed idle time(s) 0 0.000 0.000 1 1.599 0.000 2 0.000 0.000 3 0.043 0.000 4 0.000 153.964 5 0.000 0.000 6 0.053 0.000 7 0.015 0.000 8 0.000 0.000 9 0.000 0.000 10 0.000 0.000 11 0.000 0.000 12 0.000 0.000 13 0.000 0.000 14 0.000 0.000 15 0.000 0.000 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 19090298 35782 0 0 0 0 2597 2597 0 30588 0 0 1 70343282 19202 0 0 400 400 9201 9201 0 0 0 0 2 10361360 2782 0 0 0 0 1391 1391 0 0 0 0 3 39578798 10102 0 0 3 3 5048 5048 0 0 0 0 4 3065688 742 0 0 0 0 371 371 0 0 0 0 5 15482560 3946 0 0 0 0 1973 1973 0 0 0 0 6 51969876 12870 0 0 2 2 6433 6433 0 0 0 0 7 51929464 13250 0 0 1 1 6624 6624 0 0 0 0 8 0 0 0 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time: 35.371s ( 904.697 blocks/s, 56.544 Mb/s)
Attachment 2: Screenshot_from_2022-06-28_00-06-58.png

Attachment 3: Screenshot_from_2022-06-28_00-06-35.png

Attachment 4: Screenshot_from_2022-06-28_00-06-00.png

Attachment 5: Screenshot_from_2022-06-28_00-05-30.png

Attachment 6: Screenshot_from_2022-06-28_00-04-42.png

Attachment 7: Screenshot_from_2022-06-28_00-03-56.png

Attachment 8: R5_914
* TDR format 3.3.0 analyser - TD - May 2021 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 261460369 ( 646962.6 Hz) Other data format: 459631 ( 1137.3 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 616 ( 1.5 Hz) RESUME: 616 ( 1.5 Hz) SYNC100: 33505 ( 82.9 Hz) WR48-63: 33505 ( 82.9 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 391389 ( 968.5 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 131720 ( 325.9 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 404.135 s FEE elapsed dead time(s) elapsed idle time(s) 0 0.615 0.000 1 2.119 0.000 2 0.420 0.000 3 0.323 0.000 4 0.124 111.840 5 0.000 0.000 6 0.696 0.000 7 0.001 0.000 8 0.000 0.000 9 0.000 0.000 10 0.000 0.000 11 0.000 0.000 12 0.000 0.000 13 0.000 0.000 14 0.000 0.000 15 0.000 0.000 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 19284409 33077 0 0 6 6 2512 2512 0 28041 0 31815 1 69379431 18886 0 0 391 391 9052 9052 0 0 0 26209 2 20984122 96945 0 0 6 6 2775 2775 0 91383 0 19775 3 56761004 105837 0 0 202 202 7127 7127 0 91179 0 9889 4 3261224 838 0 0 2 2 417 417 0 0 0 9818 5 13707273 3434 0 0 0 0 1717 1717 0 0 0 11918 6 42321326 100064 0 0 8 8 5351 5351 0 89346 0 17237 7 35761580 100550 0 0 1 1 4554 4554 0 91440 0 5059 8 0 0 0 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time: 35.648s ( 897.667 blocks/s, 56.104 Mb/s)
Attachment 9: Screenshot_from_2022-06-28_02-14-50.png

Attachment 10: Screenshot_from_2022-06-28_02-13-46.png

Attachment 11: Screenshot_from_2022-06-28_02-12-22.png

Attachment 12: Screenshot_from_2022-06-28_02-11-10.png

Attachment 13: Screenshot_from_2022-06-28_02-10-07.png

Attachment 14: Screenshot_from_2022-06-28_02-08-49.png

Attachment 15: Screenshot_from_2022-06-28_02-05-26.png

Attachment 16: Screenshot_from_2022-06-28_02-04-36.png

Attachment 17: Screenshot_from_2022-06-28_02-04-11.png

Attachment 18: Screenshot_from_2022-06-28_02-03-39.png

Attachment 19: R5_926
* TDR format 3.3.0 analyser - TD - May 2021 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 261820610 ( 589706.0 Hz) Other data format: 99390 ( 223.9 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 624 ( 1.4 Hz) RESUME: 624 ( 1.4 Hz) SYNC100: 33654 ( 75.8 Hz) WR48-63: 33654 ( 75.8 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 30834 ( 69.4 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 0 ( 0.0 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 443.985 s FEE elapsed dead time(s) elapsed idle time(s) 0 0.000 0.000 1 1.081 0.000 2 0.000 0.000 3 0.281 0.000 4 0.000 152.429 5 0.000 0.000 6 0.000 0.000 7 0.000 0.000 8 0.000 0.000 9 0.000 0.000 10 0.000 0.000 11 0.000 0.000 12 0.000 0.000 13 0.000 0.000 14 0.000 0.000 15 0.000 0.000 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 15622398 34978 0 0 0 0 2072 2072 0 30834 0 0 1 68236330 18574 0 0 381 381 8906 8906 0 0 0 0 2 18744892 4984 0 0 0 0 2492 2492 0 0 0 0 3 59875268 15514 0 0 243 243 7514 7514 0 0 0 0 4 2759883 664 0 0 0 0 332 332 0 0 0 0 5 13541412 3478 0 0 0 0 1739 1739 0 0 0 0 6 45470554 11726 0 0 0 0 5863 5863 0 0 0 0 7 37569873 9472 0 0 0 0 4736 4736 0 0 0 0 8 0 0 0 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time: 35.045s ( 913.114 blocks/s, 57.070 Mb/s)
Attachment 20: Screenshot_from_2022-06-28_03-44-20.png

Attachment 21: Screenshot_from_2022-06-28_03-44-00.png

Attachment 22: Screenshot_from_2022-06-28_03-43-05.png

Attachment 23: Screenshot_from_2022-06-28_03-41-50.png

Attachment 24: Screenshot_from_2022-06-28_03-41-21.png

Attachment 25: R5_954
* TDR format 3.3.0 analyser - TD - May 2021 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 261819650 ( 564425.6 Hz) Other data format: 100350 ( 216.3 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 346 ( 0.7 Hz) RESUME: 346 ( 0.7 Hz) SYNC100: 33728 ( 72.7 Hz) WR48-63: 33728 ( 72.7 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 32202 ( 69.4 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 0 ( 0.0 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 463.869 s FEE elapsed dead time(s) elapsed idle time(s) 0 0.000 0.000 1 0.860 0.000 2 0.000 16.297 3 0.000 0.000 4 0.000 130.996 5 0.000 0.000 6 0.000 0.000 7 0.000 0.000 8 0.000 0.000 9 0.000 0.000 10 0.000 0.000 11 0.000 0.000 12 0.000 0.000 13 0.000 0.000 14 0.000 0.000 15 0.000 0.000 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 19510795 37524 0 0 0 0 2661 2661 0 32202 0 0 1 71776267 19370 0 0 343 343 9342 9342 0 0 0 0 2 7596519 1752 0 0 0 0 876 876 0 0 0 0 3 39174917 10150 0 0 0 0 5075 5075 0 0 0 0 4 3312486 838 0 0 0 0 419 419 0 0 0 0 5 15419570 4004 0 0 0 0 2002 2002 0 0 0 0 6 56857618 14472 0 0 3 3 7233 7233 0 0 0 0 7 48171478 12240 0 0 0 0 6120 6120 0 0 0 0 8 0 0 0 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time: 35.318s ( 906.044 blocks/s, 56.628 Mb/s)
Attachment 26: Screenshot_from_2022-06-28_07-03-01.png

Attachment 27: Screenshot_from_2022-06-28_07-02-34.png

Attachment 28: Screenshot_from_2022-06-28_07-01-31.png

Attachment 29: Screenshot_from_2022-06-28_07-01-03.png

Attachment 30: Screenshot_from_2022-06-28_07-00-31.png

284	Tue Apr 27 08:26:01 2021	TD	Tuesday 27 April - aida09 system console reports 'received undefined information code: 1' and 'code: 9'
09.25 All system wide checks OK except Base Current Difference aida01 fault 0xc960 : 0xc963 : 3 aida02 fault 0x8bbf : 0x8bc2 : 3 aida03 fault 0xae9e : 0xaea1 : 3 aida04 fault 0x6e3 : 0x6e6 : 3 aida05 fault 0x31a4 : 0x31ac : 8 aida05 : WR status 0x10 aida06 fault 0x22ea : 0x22f2 : 8 aida07 fault 0x438f : 0x4397 : 8 aida08 fault 0x61ed : 0x61f5 : 8 aida09 fault 0x1c32 : 0x1c33 : 1 White Rabbit error counter test result: Passed 3, Failed 9 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR Returned 0 0 0 0 0 0 0 0 0 0 0 0 Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k aida01 : 16 18 24 16 3 1 3 2 2 3 4 : 27792 aida02 : 25 6 3 5 1 4 2 2 3 3 6 : 36260 aida03 : 19 10 3 6 3 3 1 3 3 3 6 : 36556 aida04 : 21 7 3 4 2 4 2 2 3 3 6 : 36284 aida05 : 40 37 16 13 4 3 2 2 3 3 4 : 28904 aida06 : 32 4 4 3 0 4 1 3 3 3 6 : 36416 aida07 : 26 22 18 13 3 3 2 4 3 4 3 : 27672 aida08 : 15 9 4 1 2 3 1 3 3 3 6 : 36324 aida09 : 29 41 11 19 3 4 3 4 3 3 4 : 30348 aida10 : 17 5 8 4 3 3 3 3 2 3 6 : 36012 aida11 : 25 9 3 5 1 1 2 4 2 3 6 : 35900 aida12 : 80 43 12 7 4 2 3 2 2 3 4 : 27960 Collecting the file size of each FEE64 Options CONTENTS file to check they are all the same FEE : aida01 => Options file size is 1026 Last changed Sat Apr 24 03:57:22 CEST 2021 FEE : aida02 => Options file size is 1014 Last changed Fri Apr 16 00:56:20 CEST 2021 FEE : aida03 => Options file size is 1014 Last changed Wed Apr 14 21:52:04 CEST 2021 FEE : aida04 => Options file size is 1025 Last changed Sat Apr 17 06:07:36 CEST 2021 FEE : aida05 => Options file size is 1025 Last changed Fri Apr 16 00:53:25 CEST 2021 FEE : aida06 => Options file size is 1014 Last changed Wed Apr 14 21:52:04 CEST 2021 FEE : aida07 => Options file size is 1014 Last changed Wed Apr 14 21:52:04 CEST 2021 FEE : aida08 => Options file size is 1014 Last changed Wed Apr 14 21:52:04 CEST 2021 FEE : aida09 => Options file size is 1014 Last changed Wed Apr 14 21:52:05 CEST 2021 FEE : aida10 => Options file size is 1014 Last changed Wed Apr 14 21:52:06 CEST 2021 FEE : aida11 => Options file size is 1014 Last changed Wed Apr 14 21:52:05 CEST 2021 FEE : aida12 => Options file size is 1025 Last changed Mon Apr 19 09:05:25 CEST 2021 09.25 DSSSD bias \|& leakage currents Ok - attachment 1 FEE64 temps OK - attachment 2 good event stats - attachment 3 aida09 zero rate merger time seq errors - attachment 4 Grafana DSSSD bias \|& leakage currents for previous 7 days - attachment 5 DAQ continues OK except aida09 - no data storage 10.00 from aida09 system console 24/03:04:39\|In RDOGo_Operate: Enabled Correlation, ASIC and discriminator readout 24/03:04:39\|Also in RDOGo_Operate: Enabled waveform readout 24/03:04:39\| 24/03:04:39\|get_WAVEBlk (C) : which = 0 , Status = 00001031 , Count = 0 24/03:04:39\|get_WAVEBlk (A) which = 0 ---- status = 0540, State machines = 050A 24/03:04:39\|WV:0:Buffer info. Length = 131072 : Offset = 0 24/03:04:40\|WV:1:Buffer info. Length = 131070 : Offset = 2 24/03:04:40\|WV:2:Buffer info. Length = 131068 : Offset = 4 24/03:04:40\|WV:3:Buffer info. Length = 131066 : Offset = 6 24/03:04:40\|WV:4:Buffer info. Length = 131064 : Offset = 8 24/03:04:40\|WV:5:Buffer info. Length = 131062 : Offset = 10 24/03:04:40\|WV:6:Buffer info. Length = 131060 : Offset = 12 24/03:04:40\|WV:7:Buffer info. Length = 131058 : Offset = 14 24/03:04:40\|WV:8:Buffer info. Length = 131056 : Offset = 16 24/03:04:40\|WV:9:Buffer info. Length = 131054 : Offset = 18 24/03:04:40\|get_WAVEBlk (A) which = 1 ---- status = 0088, State machines = 0908 24/03:04:40\|get_ASICBlk : Blk=1 : bytes = 1048576 : Blk_Status = 00000088 : Offset = 00100000 : Databuffer : 273090556 : 0 => 804441A5 : 1 => 09CD0000 24/03:04:40\|Last Data : Databuffer 274139128 : 0 => C01B7F88 : 1 => 0C05B135 24/03:04:40\| 1FA61FB2 : 1F951F66 \| 1F361F5D : 1F751F0F \| 1F191EF0 : 1EF31EE9 \| 1E701E8E : 1EEB1F51 24/03:04:40\| 1F521F99 : 1FF52005 \| 1FE52027 : 20171FCC \| 1FAD1F3D : 1ED41E7B \| 1EB11E77 : 3FAB373A 24/03:04:40\| 8050023F : 0AE0C000 \| 804441A5 : 0AE0C000 \| 400003FC : 0AE0C4D0 \| 1E581F6F : 1E451D26 24/03:04:41\| 1FB01E60 : 1D2E1F80 \| 1E251D88 : 1FA81F4A \| 1DD51F1F : 1E1D1DF7 \| 1EBC1DF0 : 1DF41E7E 24/03:04:41\| 1DEA1DF5 : 1E9E1E83 \| 1E231E9C : 1E661E60 \| 1EA41E6F : 1E101D9C \| 1D751D92 : 1DFC1DF2 24/03:04:41\| 1E201E47 : 1E7C1E6C \| 1E351E00 : 1DD91DFE \| 1DD81DB5 : 1DE91E1C \| 1E261DD6 : 1E1A1E0B 24/03:04:41\| 1DFB1DCC : 1DEA1E11 \| 1E201E39 : 1E351E7A \| 1E7B1DBE : 1E7A1E81 \| 1E261DFC : 1DEA1DAC 24/03:04:41\| 1D831DAC : 1DF51E1F \| 1E4E1E48 : 1E421E50 \| 1E861DDB : 1E361E18 \| 1D551DB9 : 1DC51D8E 24/03:04:41\|get_ASICBlk : Blk=0 : bytes = 1048576 : Blk_Status = 00000048 : Offset = 00000000 : Databuffer : 273090556 : 0 => C03A7F13 : 1 => 0C05B455 24/03:04:41\|Last Data : Databuffer 274139128 : 0 => C0127D9D : 1 => 0DB9DEED 24/03:04:41\| 1FA61FB2 : 1F951F66 \| 1F361F5D : 1F751F0F \| 1F191EF0 : 1EF31EE9 \| 1E701E8E : 1EEB1F51 24/03:04:41\| 1F521F99 : 1FF52005 \| 1FE52027 : 20171FCC \| 1FAD1F3D : 1ED41E7B \| 1EB11E77 : 3FAB373A 24/03:04:41\| 8050023F : 0AE0C000 \| 804441A5 : 0AE0C000 \| 400003FC : 0AE0C4D0 \| 1E581F6F : 1E451D26 24/03:04:42\| 1FB01E60 : 1D2E1F80 \| 1E251D88 : 1FA81F4A \| 1DD51F1F : 1E1D1DF7 \| 1EBC1DF0 : 1DF41E7E 24/03:04:42\| 1DEA1DF5 : 1E9E1E83 \| 1E231E9C : 1E661E60 \| 1EA41E6F : 1E101D9C \| 1D751D92 : 1DFC1DF2 24/03:04:42\| 1E201E47 : 1E7C1E6C \| 1E351E00 : 1DD91DFE \| 1DD81DB5 : 1DE91E1C \| 1E261DD6 : 1E1A1E0B 24/03:04:42\| 1DFB1DCC : 1DEA1E11 \| 1E201E39 : 1E351E7A \| 1E7B1DBE : 1E7A1E81 \| 1E261DFC : 1DEA1DAC 24/03:04:42\| 1D831DAC : 1DF51E1F \| 1E4E1E48 : 1E421E50 \| 1E861DDB : 1E361E18 \| 1D551DB9 : 1DC51D8E 24/03:04:42\|get_WAVEBlk (A) which = 0 ---- status = 0048, State machines = 0908 24/03:04:42\|get_ASICBlk : Blk=1 : bytes = 1048576 : Blk_Status = 00000088 : Offset = 00100000 : Databuffer : 273090556 : 0 => C02D7E26 : 1 => 0DB9DEED 24/03:04:42\|Last Data : Databuffer 274139128 : 0 => C0217F73 : 1 => 0F816B3D 24/03:04:42\| 1EFB1F2D : 1F311F1E \| 1F3B1F1C : 1EDD1EC4 \| 1ED71EE6 : 1F301F09 \| 1F4D1FAA : 1F1E1F81 24/03:04:42\| 1F491F0C : 1F481F31 \| 1F6C1F7E : 1F601F8E \| 1FC71FA9 : 1F451F9F \| 1F8C1F1D : 1F551FA9 24/03:04:42\| 1F671E98 : 1F421F47 \| 1ED91F67 : 1F911F70 \| 1DFD1F98 : 224A1D5B \| 1CF821BC : 1F771E94 24/03:04:43\| 213F1EE7 : 1DBC20F2 \| 1F961D9F : 1FC81FE3 \| 1EA0206E : 1F9D1DD9 \| 20042040 : 1E6A1ECA 24/03:04:43\| 1F7E1FD0 : 1F981EC7 \| 1E7A1F1B : 1F5F1F27 \| 1F121F10 : 1F531F92 \| 1F5B1EF8 : 1FA12003 24/03:04:43\| 1F7A1F97 : 1F561F26 \| 200C1F80 : 1FC3201A \| 1FA81FA4 : 1FEB1F99 \| 1F5C1F9D : 1F8F1F98 24/03:04:43\| 1FCC1FC5 : 1FB01F92 \| 1FA21F6D : 1F261F0A \| 1F141F1C : 1F461F24 \| 1EEE1FDB : 20221F2F 24/03:04:43\| 1F741FF1 : 1F891F8A \| 1FC71F5E : 1F961FF2 \| 1F6B1F6C : 1FB11F74 \| 1F821FA8 : 1F841F54 24/03:04:43\|get_ASICBlk : Blk=0 : bytes = 1048576 : Blk_Status = 00000048 : Offset = 00000000 : Databuffer : 273090556 : 0 => C02D7EB4 : 1 => 0F816D95 24/03:04:43\|Last Data : Databuffer 274139128 : 0 => C0167F53 : 1 => 0148F2DD 24/03:04:43\| 1EFB1F2D : 1F311F1E \| 1F3B1F1C : 1EDD1EC4 \| 1ED71EE6 : 1F301F09 \| 1F4D1FAA : 1F1E1F81 24/03:04:43\| 1F491F0C : 1F481F31 \| 1F6C1F7E : 1F601F8E \| 1FC71FA9 : 1F451F9F \| 1F8C1F1D : 1F551FA9 24/03:04:43\| 1F671E98 : 1F421F47 \| 1ED91F67 : 1F911F70 \| 1DFD1F98 : 224A1D5B \| 1CF821BC : 1F771E94 24/03:04:44\| 213F1EE7 : 1DBC20F2 \| 1F961D9F : 1FC81FE3 \| 1EA0206E : 1F9D1DD9 \| 20042040 : 1E6A1ECA 24/03:04:44\| 1F7E1FD0 : 1F981EC7 \| 1E7A1F1B : 1F5F1F27 \| 1F121F10 : 1F531F92 \| 1F5B1EF8 : 1FA12003 24/03:04:44\| 1F7A1F97 : 1F561F26 \| 200C1F80 : 1FC3201A \| 1FA81FA4 : 1FEB1F99 \| 1F5C1F9D : 1F8F1F98 24/03:04:44\| 1FCC1FC5 : 1FB01F92 \| 1FA21F6D : 1F261F0A \| 1F141F1C : 1F461F24 \| 1EEE1FDB : 20221F2F 24/03:04:44\| 1F741FF1 : 1F891F8A \| 1FC71F5E : 1F961FF2 \| 1F6B1F6C : 1FB11F74 \| 1F821FA8 : 1F841F54 24/03:04:44\|get_ASICBlk : Blk=1 : bytes = 1048576 : Blk_Status = 00000088 : Offset = 00100000 : Databuffer : 273090556 : 0 => C0207E17 : 1 => 0148F2DD 24/03:04:44\|Last Data : Databuffer 274139128 : 0 => C0177F46 : 1 => 047FF0CD 24/03:04:44\| 1EFB1F2D : 1F311F1E \| 1F3B1F1C : 1EDD1EC4 \| 1ED71EE6 : 1F301F09 \| 1F4D1FAA : 1F1E1F81 24/03:04:44\| 1F491F0C : 1F481F31 \| 1F6C1F7E : 1F601F8E \| 1FC71FA9 : 1F451F9F \| 1F8C1F1D : 1F551FA9 24/03:04:44\| 1F671E98 : 1F421F47 \| 1ED91F67 : 1F911F70 \| 1DFD1F98 : 224A1D5B \| 1CF821BC : 1F771E94 24/03:04:44\| 213F1EE7 : 1DBC20F2 \| 1F961D9F : 1FC81FE3 \| 1EA0206E : 1F9D1DD9 \| 20042040 : 1E6A1ECA 24/03:04:45\| 1F7E1FD0 : 1F981EC7 \| 1E7A1F1B : 1F5F1F27 \| 1F121F10 : 1F531F92 \| 1F5B1EF8 : 1FA12003 24/03:04:45\| 1F7A1F97 : 1F561F26 \| 200C1F80 : 1FC3201A \| 1FA81FA4 : 1FEB1F99 \| 1F5C1F9D : 1F8F1F98 24/03:04:45\| 1FCC1FC5 : 1FB01F92 \| 1FA21F6D : 1F261F0A \| 1F141F1C : 1F461F24 \| 1EEE1FDB : 20221F2F 24/03:04:45\| 1F741FF1 : 1F891F8A \| 1FC71F5E : 1F961FF2 \| 1F6B1F6C : 1FB11F74 \| 1F821FA8 : 1F841F54 24/03:04:45\|get_WAVEBlk (A) which = 1 ---- status = 0088, State machines = 0908 24/03:04:45\|get_WAVEBlk (A) which = 0 ---- status = 0048, State machines = 0908 24/03:04:45\|get_WAVEBlk (A) which = 1 ---- status = 0088, State machines = 0908 24/03:04:47\|get_WAVEBlk (A) which = 0 ---- status = 0048, State machines = 0908 24/03:04:56\|get_WAVEBlk (A) which = 1 ---- status = 0088, State machines = 0908 24/03:05:05\|get_WAVEBlk (A) which = 0 ---- status = 0048, State machines = 0908 24/03:05:15\|get_WAVEBlk (A) which = 1 ---- status = 0088, State machines = 0908 24/03:05:24\|197 spectra zeroed 25/10:21:10\|do_GetState returned z=0 and 1 25/10:21:11\|Data Acquisition Statistics counters now cleared 25/10:24:01\|Clear Statistics (1) 25/10:24:01\|bad event data (0x45000034 0x84e64000) 26/16:52:50\|bad event data (0x40061e21 0xc0a80b63) 26/16:52:50\|received undefined information code: 1 26/16:52:50\|bad event data (0x0101080a 0xe9b68def) 26/16:52:50\|bad event data (0x03527827 0x0101050a) 26/16:52:50\|received undefined information code: 9 From system console Apr 24 02:52:42 aida09 kernel: IP-Config: Got DHCP answer from 192.168.11.99, my address is 192.168.11.9 Apr 24 02:52:42 aida09 kernel: IP-Config: Complete: Apr 24 02:52:42 aida09 kernel: device=eth0, addr=192.168.11.9, mask=255.255.255.0, gw=255.255.255.255, Apr 24 02:52:42 aida09 kernel: host=aida09, domain=dl.ac.uk, nis-domain=nuclear.physics, Apr 24 02:52:42 aida09 kernel: bootserver=192.168.11.99, rootserver=192.168.11.99, rootpath=/home/Embedded/XilinxLinux/ppc_4xx/rfs/aida09 Apr 24 02:52:42 aida09 kernel: Looking up port of RPC 100003/2 on 192.168.11.99 Apr 24 02:52:42 aida09 kernel: Looking up port of RPC 100005/1 on 192.168.11.99 Apr 24 02:52:43 aida09 kernel: VFS: Mounted root (nfs filesystem) on device 0:12. Apr 24 02:52:43 aida09 kernel: Freeing unused kernel memory: 168k init Apr 24 02:52:43 aida09 kernel: xaida: device parameters: base=0x81000000 size=0x200000 Apr 24 02:52:44 aida09 kernel: Trying to free nonexistent resource <0000000081000000-00000000811fffff> Apr 24 02:52:44 aida09 kernel: xaida: mem region start 0x81000000 for 0x200000 mapped at 0xd2100000 Apr 24 02:52:44 aida09 kernel: xaida: driver assigned major number 254 Apr 24 02:52:44 aida09 xinetd[273]: IPv6 socket creation failed for service telnet, trying IPv4 Apr 24 02:52:44 aida09 xinetd[273]: IPv6 socket creation failed for service ftp, trying IPv4 Apr 24 02:52:44 aida09 xinetd[273]: xinetd Version 2.3.14 started with libwrap loadavg options compiled in. Apr 24 02:52:44 aida09 xinetd[273]: Started working: 2 available services Apr 24 02:52:48 aida09 kernel: Trying to free nonexistent resource <0000000007000000-0000000007ffffff> Apr 24 02:52:48 aida09 kernel: AIDAMEM: aidamem: mem region start 0x7000000 for 0x1000000 mapped at 0xd2380000 Apr 24 02:52:48 aida09 kernel: AIDAMEM: aidamem: driver assigned major number 253 Apr 24 02:53:04 aida09 kernel: xaida: open: Apr 24 02:53:04 aida09 kernel: AIDAMEM: aidamem_open: Apr 24 02:57:33 aida09 kernel: xaida: open: Apr 24 13:39:36 aida09 xinetd[273]: START: telnet pid=396 from=192.168.11.99 Apr 24 13:42:05 aida09 xinetd[273]: EXIT: telnet status=0 pid=396 duration=149(sec) Apr 27 09:01:50 aida09 xinetd[273]: START: telnet pid=422 from=192.168.11.99
Attachment 1: 303.png

Attachment 2: Screenshot_2021-04-27_Temperature_and_status_scan_aidas-gsi.png

Attachment 3: Screenshot_2021-04-27_Statistics_aidas-gsi.png

Attachment 4: Screenshot_2021-04-27_GSI_White_Rabbit_Timestamp_Control_aidas-gsi.png

Attachment 5: Screenshot_2021-04-27_NewMerger_Statistics_aidas-gsi.png

Attachment 6: Screenshot_2021-04-27_AIDA_Alerting_-_Grafana.png

347	Tue May 25 11:16:54 2021	TD	Tuesday 25 May
12.16 DAQ continues file S496/R18_324 alpha background Tape server c. 2.5Mb/s ASIC check Tape server c. 300kb/s - presumably hot HEC channels 12.20 All system wide checks OK except Base Current Difference aida01 fault 0x82b0 : 0x82b1 : 1 aida02 fault 0xfe72 : 0xfe73 : 1 aida03 fault 0x97f4 : 0x97f5 : 1 aida04 fault 0x950 : 0x951 : 1 aida05 fault 0x8e93 : 0x8e94 : 1 aida06 fault 0x545a : 0x545b : 1 aida07 fault 0xc04d : 0xc04e : 1 aida08 fault 0xa0f7 : 0xa0f8 : 1 White Rabbit error counter test result: Passed 8, Failed 8 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR Returned 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k aida01 : 2 6 6 2 1 3 2 2 2 4 6 : 37016 aida02 : 3 6 5 3 3 4 3 2 1 3 7 : 38572 aida03 : 21 10 8 6 3 3 2 3 2 4 6 : 37924 aida04 : 29 15 4 5 3 4 2 3 3 3 6 : 37004 aida05 : 17 5 2 2 2 2 2 2 2 4 6 : 36940 aida06 : 1 6 0 1 2 2 2 3 3 4 6 : 38356 aida07 : 11 6 7 4 3 3 3 3 2 4 6 : 38028 aida08 : 13 8 3 2 2 3 3 2 1 3 7 : 38372 aida09 : 7 9 2 1 3 3 3 3 2 4 6 : 37860 aida10 : 9 8 4 2 0 3 3 3 1 4 6 : 36708 aida11 : 16 6 3 2 2 3 3 3 1 4 6 : 36832 aida12 : 21 10 7 4 2 4 2 2 1 3 7 : 38420 aida13 : 8 3 3 1 3 3 3 3 2 4 6 : 37832 aida14 : 14 3 6 1 0 4 2 2 2 4 6 : 37072 aida15 : 2 4 2 2 1 3 3 4 2 4 6 : 38216 aida16 : 16 5 5 3 0 3 2 2 2 4 6 : 37016 Collecting the file size of each FEE64 Options CONTENTS file to check they are all the same FEE : aida01 => Options file size is 1026 Last changed Sun May 23 12:04:25 CEST 2021 FEE : aida02 => Options file size is 1025 Last changed Sun May 23 00:19:21 CEST 2021 FEE : aida03 => Options file size is 1014 Last changed Thu Apr 29 14:43:50 CEST 2021 FEE : aida04 => Options file size is 1025 Last changed Fri May 14 16:54:56 CEST 2021 FEE : aida05 => Options file size is 1025 Last changed Mon May 17 06:25:41 CEST 2021 FEE : aida06 => Options file size is 1014 Last changed Thu Apr 29 14:43:59 CEST 2021 FEE : aida07 => Options file size is 1014 Last changed Thu Apr 29 14:44:02 CEST 2021 FEE : aida08 => Options file size is 1025 Last changed Sun May 23 00:16:54 CEST 2021 FEE : aida09 => Options file size is 1014 Last changed Thu Apr 29 14:44:08 CEST 2021 FEE : aida10 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida11 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida12 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida13 => Options file size is 1025 Last changed Fri May 07 19:40:34 CEST 2021 FEE : aida14 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida15 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida16 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 Grafana - DSSSD bias & leakage cuuent - most recent 7 days - attachment 1 Rate spectra - attachment 2 ADC data item stats - attachment 3 FEE64 temps OK - attachment 4 DSSSD bias & leakage current OK - attachment 5 Merger/Tape Server/Merger stats - attachment 6 no merger errors reported since previous restart 17.30 analysis of file S496/R18_340 max deadtime 0.36% aida04
Attachment 1: Screenshot_2021-05-25_AIDA_Alerting_-_Grafana.png

Attachment 2: Screenshot_2021-05-25_Spectrum_Browser_aidas-gsi.png

Attachment 3: Screenshot_2021-05-25_Statistics_aidas-gsi.png

Attachment 4: Screenshot_2021-05-25_Temperature_and_status_scan_aidas-gsi.png

Attachment 5: 910.png

Attachment 6: 911.png

Attachment 7: R18_340
* TDR format 3.3.0 analyser - TD - May 2021 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 63855540 ( 23748.1 Hz) Other data format: 198064462 ( 73660.8 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 109 ( 0.0 Hz) RESUME: 109 ( 0.0 Hz) SYNC100: 42015 ( 15.6 Hz) WR48-63: 42015 ( 15.6 Hz) FEE64 disc: 1291036 ( 480.1 Hz) MBS info: 196689178 ( 73149.3 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 35 ( 0.0 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 2688.871 s FEE elapsed dead time(s) elapsed idle time(s) 0 0.000 0.000 1 0.000 2304.866 2 0.344 0.000 3 9.625 0.000 4 0.000 0.000 5 0.000 1450.665 6 0.000 0.000 7 0.000 1243.447 8 0.000 0.000 9 0.000 0.000 10 0.000 0.000 11 0.000 0.000 12 0.000 0.000 13 0.000 0.000 14 0.000 0.000 15 0.000 0.000 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 303 7 0 0 0 0 1 1 5 0 0 5 1 3031185 1240 0 0 0 0 620 620 0 0 0 0 2 536 98548687 0 0 20 20 16872 16872 2 98514901 0 3 3 44821969 99507955 0 0 89 89 21248 21248 1291004 98174277 0 0 4 514 3 0 0 0 0 1 1 1 0 0 1 5 7529304 3056 0 0 0 0 1528 1528 0 0 0 0 6 1314 2 0 0 0 0 0 0 2 0 0 2 7 8467764 3488 0 0 0 0 1744 1744 0 0 0 0 8 226 4 0 0 0 0 0 0 4 0 0 4 9 144 4 0 0 0 0 0 0 4 0 0 4 10 524 1 0 0 0 0 0 0 1 0 0 0 11 432 2 0 0 0 0 0 0 2 0 0 2 12 719 0 0 0 0 0 0 0 0 0 0 0 13 154 7 0 0 0 0 1 1 5 0 0 7 14 0 0 0 0 0 0 0 0 0 0 0 0 15 452 6 0 0 0 0 0 0 6 0 0 7 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time: 39.492s ( 810.287 blocks/s, 50.643 Mb/s)
598	Tue Apr 23 15:11:50 2024	TD	Tuesday 23 April 16:00-00:00
16.12 Analysis of data file R17_101 - attachment 1 max deadtime c. 2% (aida02) no timewarps observed 16.15 DSSSD bias & leakage current OK - attachment 2 FEE64 temperatures OK - attachment 7 ADC data item stats - attachment 3 per FEE64 rate spectra (on and off spill) - attachments 4-5 Merger etc - attachment 6 16.53 aida04 stops producing data DAQ STOP fails for aida04 Restart Merger to enable aida04 to complete DAQ STOP aida04 rebooted and DAQ restarted OK data file S100_alpha/R18
Attachment 1: R17_101
* TDR format 3.3.0 analyser - TD - May 2021 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 244392363 ( 344543.7 Hz) Other data format: 17527637 ( 24710.4 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 632 ( 0.9 Hz) RESUME: 632 ( 0.9 Hz) SYNC100: 34642 ( 48.8 Hz) WR48-63: 34642 ( 48.8 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 17457089 ( 24611.0 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 976870 ( 1377.2 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 709.322 s FEE elapsed dead time(s) elapsed idle time(s) 0 0.000 0.000 1 16.367 0.000 2 0.000 0.000 3 3.744 0.000 4 0.000 0.000 5 0.028 0.000 6 0.000 0.000 7 0.009 0.000 8 0.000 0.000 9 0.000 0.000 10 0.000 0.000 11 0.000 0.000 12 0.000 0.000 13 0.000 0.000 14 0.004 0.000 15 0.000 0.000 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 3247904 22147 0 0 0 0 434 434 0 21279 0 100052 1 78164199 878648 0 0 419 419 10303 10303 0 857204 0 222655 2 3679894 7126519 0 0 0 0 1427 1427 0 7123665 0 69753 3 82858158 7034348 0 0 202 202 11907 11907 0 7010130 0 82407 4 2430024 1045502 0 0 0 0 415 415 0 1044672 0 72940 5 14446252 1404299 0 0 6 6 2074 2074 0 1400139 0 68087 6 2997919 898 0 0 0 0 449 449 0 0 0 20036 7 28730414 7980 0 0 4 4 3986 3986 0 0 0 64499 8 2617862 676 0 0 0 0 338 338 0 0 0 38168 9 3117608 872 0 0 0 0 436 436 0 0 0 15569 10 3647866 954 0 0 0 0 477 477 0 0 0 7030 11 3150764 810 0 0 0 0 405 405 0 0 0 129790 12 4169396 1050 0 0 0 0 525 525 0 0 0 20235 13 2725572 706 0 0 0 0 353 353 0 0 0 23658 14 2606679 622 0 0 1 1 310 310 0 0 0 15170 15 5801852 1606 0 0 0 0 803 803 0 0 0 26821 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time: 30.402s ( 1052.550 blocks/s, 65.784 Mb/s)
Attachment 2: Screenshot_from_2024-04-23_16-15-38.png

Attachment 3: Screenshot_from_2024-04-23_16-16-52.png

Attachment 4: Screenshot_from_2024-04-23_16-17-40.png

Attachment 5: Screenshot_from_2024-04-23_16-17-25.png

Attachment 6: Screenshot_from_2024-04-23_16-18-04.png

Attachment 7: Screenshot_from_2024-04-23_16-22-04.png

Attachment 8: Screenshot_from_2024-04-23_17-18-08.png

Attachment 9: Screenshot_from_2024-04-23_17-18-34.png

Attachment 10: Screenshot_from_2024-04-23_17-19-01.png

Attachment 11: Screenshot_from_2024-04-23_17-19-18.png

Attachment 12: Screenshot_from_2024-04-23_17-20-08.png

Attachment 13: Screenshot_from_2024-04-23_17-20-47.png

Attachment 14: Screenshot_from_2024-04-23_17-22-09.png

Attachment 15: Screenshot_from_2024-04-23_17-22-09.png

Attachment 16: Screenshot_from_2024-04-23_17-25-10.png

Attachment 17: Screenshot_from_2024-04-23_17-29-21.png

Attachment 18: Screenshot_from_2024-04-23_17-29-21.png

Attachment 19: Screenshot_from_2024-04-23_17-29-40.png

Attachment 20: Screenshot_from_2024-04-23_17-30-04.png

487	Tue Jun 21 10:19:05 2022	OH ML	Tuesday 21st June 08:00-00:00
11:19 Stats ok 0xa on all FEE - attachment 1 Current pulser settings - attachment 2 FEE Temperatures ok - attachment 3 Noticed both AIDA03 and AIDA07 had ASICs with missing channels. Did a check ASIC control on them to recover Layout 1 after recovering channels - attachment 4 New stats (Note increased rate on 3 and 7) attachment 5 Bias and leakage currents ok - attachment 6 S4 now in closed access. Trying to find out if the beam dump has been put in front of AIDA. Will make sure this is checked before beam to S4. 14:05 Have had it confirmed that the flange beam dump is in position in S4 15:43 Stats ok -attachment 7 Temp ok - attachment 8 Bias and Leakage current ok - attachment 9 17:45 Currently the time machine trigger(for correlation) is connected to the DTAS or. As the beam is tuning they are triggering at 150k. This is 450k worth of scalers in AIDA During the experiment this will be changed to SC1 trigger to solve this. 19:49: Stats ok - attachment 10 temperatures ok - attachment 11 Bias - Leakage current ok - attachment 12
Attachment 1: 220621_1119_Stats.png

Attachment 2: 220621_1120_Pulser.png

Attachment 3: 220621_1120_Temp.png

Attachment 4: 220621_1123_Layout1.png

Attachment 5: 220621_1123_Stats.png

Attachment 6: 220621_1123_Bias.png

Attachment 7: 220621_1542_Stats.png

Attachment 8: 220621_1542_Temp.png

Attachment 9: 220621_1543_Bias.png

Attachment 10: Stats-Screenshot_from_2022-06-21_19-50-19.png

Attachment 11: Temp-Screenshot_from_2022-06-21_19-48-56.png

Attachment 12: HV_LC-Screenshot_from_2022-06-21_19-47-49.png

254	Tue Apr 20 19:00:00 2021	JS	Tuesday 20th 20:00-00:00
20:00 Taking over from Liam, all systems good. 20:30 DB No faults. Stats good ucesb ok 20:58 DB No faults. Stats good Temps good ucesb ok 21:31 DB No faults. Stats good Temps good ucesb ok 22:02 DB No faults. Stats good elog:254/3 Temps good elog:254/4 ucesb ok elog:254/1 Current ok elog:254/2 ADC Calibration check: FEE64 module aida06 failed Calibration test result: Passed 11, Failed 1 22:06 ucesb - DAQ Error - Onsite team checking daq crash Tape server icon stopped spinning Stats Rates 0, Counter aida01 zeroed but others normal. elog:254/5 Called Tom. Tried resetting in midas, no luck. Full reboot of DAQ and midas required. According to log at 22:07 aida01 reset Data taking stopped at 22:04 file R45_193 22:50 After a full power cycle all appear to be up and running well. Starting full checks. 23:00 Clock status test result: Passed 12, Failed 0 Calibration test result: Passed 12, Failed 0 White Rabbit error counter test result: Passed 12, Failed 0 Check FPGA is having a page error Returned 0 0 0 0 0 0 0 0 0 0 0 0 Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k aida01 : 4 8 2 2 1 3 1 4 2 3 7 : 39792 aida02 : 13 9 2 4 2 3 2 3 2 3 7 : 39708 aida03 : 19 5 4 3 1 3 1 4 2 3 7 : 39892 aida04 : 14 5 2 2 0 5 2 3 2 3 7 : 39744 aida05 : 16 11 3 2 2 4 3 2 1 4 7 : 40584 aida06 : 15 9 5 2 2 2 1 4 2 3 7 : 39828 aida07 : 15 9 3 3 2 2 1 4 2 3 7 : 39828 aida08 : 21 4 3 4 2 2 1 4 2 3 7 : 39844 aida09 : 11 6 1 2 3 4 2 3 2 3 7 : 39788 aida10 : 0 6 4 2 0 3 2 3 2 3 7 : 39472 aida11 : 16 7 2 0 1 3 2 3 2 3 7 : 39512 aida12 : 3 7 4 1 3 2 2 3 2 3 7 : 39524 DB No faults. Stats good elog:254/6 Temps good elog:254/7 aida01 had been high during reboot issue, >70, but now is back down Current ok elog:254/8 ucesb ok 23:25 DB No faults. Stats good Temps good ucesb ok 23:42 No Beam 23:48 Beam Back 23:57 DB No faults. Stats good elog:254/11 Temps good elog:254/12 ucesb ok elog:254/9 Current ok elog:254/10 Clock status test result: Passed 12, Failed 0 Calibration test result: Passed 12, Failed 0 White Rabbit error counter test result: Passed 12, Failed 0 FPGA check page error Returned 0 0 0 0 0 0 0 0 0 0 0 0 Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k aida01 : 27 9 5 2 1 2 1 4 2 3 7 : 39812 aida02 : 13 9 5 2 2 2 1 4 2 3 7 : 39820 aida03 : 21 8 3 2 2 2 1 4 2 3 7 : 39812 aida04 : 13 4 3 1 1 5 2 3 2 3 7 : 39780 aida05 : 24 5 3 2 2 4 2 3 2 3 7 : 39800 aida06 : 16 5 5 2 2 2 1 4 2 3 7 : 39800 aida07 : 22 6 2 2 1 3 1 4 2 3 7 : 39848 aida08 : 21 8 2 3 2 2 1 4 2 3 7 : 39828 aida09 : 18 7 1 1 3 4 2 3 2 3 7 : 39792 aida10 : 19 3 3 1 0 3 2 3 2 3 7 : 39476 aida11 : 17 4 4 0 1 3 2 3 2 3 7 : 39524 aida12 : 13 4 3 2 3 1 2 3 2 3 7 : 39428 00:04 Handing over to Corrigan
Attachment 1: 40.png

Attachment 2: 41.png

Attachment 3: Screenshot_2021-04-20_Statistics_aidas-gsi(3).png

Attachment 4: Screenshot_2021-04-20_Temperature_and_status_scan_aidas-gsi(3).png

Attachment 5: Screenshot_2021-04-20_Statistics_aidas-gsi(4).png

Attachment 6: Screenshot_2021-04-20_Statistics_aidas-gsi(5).png

Attachment 7: Screenshot_2021-04-20_Temperature_and_status_scan_aidas-gsi(4).png

Attachment 8: 42.png

Attachment 9: 44.png

Attachment 10: 45.png

Attachment 11: Screenshot_2021-04-20_Statistics_aidas-gsi(6).png

Attachment 12: Screenshot_2021-04-20_Temperature_and_status_scan_aidas-gsi(5).png

253	Tue Apr 20 14:56:38 2021	LPG	Tuesday 20th 16:00-20:00
16:00 New shift, ready to go! Beam stopped just as I started... Waiting for update. Beam back at 16:08, ucesb scalers shown in elog:253/1 Database ok! Stats ok! ucesb ok! Temperatures ok! elog:253/2 Statistics ok! elog:253/3 Leakage currents ok! Steadily rising, day/night effect? - elog:253/4 and elog:253/5 16:21 Online histograms zeroed in MIDAS. Same done in MBS DAQ. 16:45 Database ok! Stats ok! ucesb ok! System wide checks: Clock ok! ADC 1 failed: FEE64 module aida06 failed WR ok! FPGA ok! Memory ok! 17:15 Database ok! Stats ok! ucesb ok! 17:45 Database ok! Stats ok! ucesb ok! 18:15 Database ok! Stats ok! ucesb ok! System wide checks: Clock ok! ADC 1 fail: FEE64 module aida06 failed Calibration test result: Passed 11, Failed 1 WR ok! FPGA ok! Memory ok! MIDAS Rates ok! elog:253/6 Temperatures ok! elog:253/7 Leakage currents ok, but still slowly rising! Topped out at ~20:30 yesterday elog:253/8 18:42 Message in the Merger terminal window (elog:253/9) MERGE Actor (15671): Working with 0 from 12 data sources 19:05 Database ok! Stats ok! ucesb ok! 19:30 Some MIDAS spectra in elog:253/10 and elog:253/11 Database ok! Stats ok! ucesb ok! 19:50 Database ok! Stats ok! ucesb ok! elog:253/12 System wide checks: Clock ok! ADC 1 fail: FEE64 module aida06 failed Calibration test result: Passed 11, Failed 1 WR ok! FPGA ok! Memory ok! MIDAS Rates ok! elog:253/13 Temperatures ok! elog:253/14 Leakage currents ok, now plateaued! elog:253/15 19:55 - Handing over to James
Attachment 1: Screenshot_2021-04-20_at_15.09.52.png

Attachment 2: Screenshot_2021-04-20_Temperature_and_status_scan_aidas-gsi.png

Attachment 3: Screenshot_2021-04-20_Statistics_aidas-gsi.png

Attachment 4: lpg1.png

Attachment 5: Screenshot_2021-04-20_at_15.13.14.png

Attachment 6: Screenshot_2021-04-20_Statistics_aidas-gsi.png

Attachment 7: Screenshot_2021-04-20_Temperature_and_status_scan_aidas-gsi(1).png

Attachment 8: lpg2.png

Attachment 9: lpg3_merger.png

Attachment 10: Screenshot_2021-04-20_Spectrum_Browser_aidas-gsi.png

Attachment 11: Screenshot_2021-04-20_Spectrum_Browser_aidas-gsi(1).png

Attachment 12: Screenshot_2021-04-20_at_18.50.56.png

Attachment 13: Screenshot_2021-04-20_Statistics_aidas-gsi(2).png

Attachment 14: Screenshot_2021-04-20_Temperature_and_status_scan_aidas-gsi(2).png

Attachment 15: lpg3.png

325	Tue May 18 18:47:25 2021	LS	Tuesday 18th May 20:00 - 24:00
19.50 Stats okay (Fig 1) FEE temps okay (Fig 2) Bias okay (Fig 3) System wide checks okay except: Base Current Difference aida05 fault 0x500 : 0x520 : 32 White Rabbit error counter test result: Passed 15, Failed 1 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR Merger rate ~1.8M items/s Tape server ~7MB/s Analysed R14_399, deadtimes are okay (Fig 4) 20.30 Stats okay (Fig 5) Analysed R14_407, deadtimes are okay (Fig 6) 21.00 Stats okay (Fig 7) Analysed R14_415, deadtimes are okay (Fig 8) 21.30 Stats okay (Fig 9) Analysed R14_422, deadtimes are okay (Fig 10) 22.00 Stats okay (Fig 11) FEE temps okay (Fig 12) Bias okay (Fig 13) System wide checks okay except: Base Current Difference aida05 fault 0x500 : 0x524 : 36 White Rabbit error counter test result: Passed 15, Failed 1 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR Merger rate ~2.3M items/s Tape server ~8MB/s Analysed R14_430, deadtimes are okay (Fig 14) 22.30 Stats okay (Fig 15) Analysed R14_438, deadtimes are okay (Fig 16) FEE8 deadtime seems to be abit higher (7s previous now 11s, total elapsed time both 232s) but still within 5% 23.00 Stats okay (Fig 17) Analysed R14_445, deadtimes are okay (Fig 18) 23.30 Stats okay (Fig 19) Analysed R14_454, deadtimes are okay (Fig 20) 24.00 Stats okay (Fig 21) FEE temps okay (Fig 22) Bias okay (Fig 23) System wide checks okay except: Base Current Difference aida05 fault 0x500 : 0x529 : 41 White Rabbit error counter test result: Passed 15, Failed 1 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR The difference has increased over time (not sure if an issue) Merger rate ~3M items/s Tape server ~8MB/s Analysed R14_462, deadtimes are okay (Fig 24)
Attachment 1: 210518_Stats_1950.png

Attachment 2: 210518_FEEtemps_1950.png

Attachment 3: 210518_Bias_1950.png

Attachment 4: 210518_Deadtimes_R14_399.png

Attachment 5: 210518_Stats_2028.png

Attachment 6: 210518_Deadtimes_R14_407.png

Attachment 7: 210518_Stats_2059.png

Attachment 8: 210518_Deadtimes_R14_415.png

Attachment 9: 210518_Stats_2130.png

Attachment 10: 210518_Deadtimes_R14_422.png

Attachment 11: 210518_Stats_2158.png

Attachment 12: 210518_FEEtemps_2158.png

Attachment 13: 210518_bias_2158.png

Attachment 14: 210518_Deadtimes_R14_430.png

Attachment 15: 210518_Stats_2230.png

Attachment 16: 210518_deadtimes_R14_438.png

Attachment 17: 210518_Stats_2300.png

Attachment 18: 210518_Deadtimes_R14_445.png

Attachment 19: 210518_Stats_2330.png

Attachment 20: 210518_Deadtimes_R14_454.png

Attachment 21: 210518_Stats_2400.png

Attachment 22: 210518_FEEtemps_2400.png

Attachment 23: 210518_bias_2400.png

Attachment 24: 210518_Deadtimes_R14_462.png

324	Tue May 18 14:57:43 2021	CB	Tuesday 18th May 16:00 - 20:00
15:58 Took shift over from OH and PP Stats OK - attach 1 Temps OK - attach 2 Bias OK - attach 3 System-wide checks Clock - all pass ADC - all fail (as before) Base Current Difference aida05 fault 0x500 : 0x510 : 16 White Rabbit error counter test result: Passed 15, Failed 1 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR FPGA - all pass Returned 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k aida01 : 22 8 7 4 1 4 2 2 2 2 7 : 37320 aida02 : 12 9 4 2 4 2 3 3 3 3 6 : 36856 aida03 : 19 6 7 2 2 2 2 4 3 3 6 : 37036 aida04 : 18 9 10 6 1 4 1 4 3 3 6 : 37168 aida05 : 17 12 2 1 2 3 3 3 3 3 6 : 36836 aida06 : 19 8 7 7 2 4 2 4 3 3 6 : 37468 aida07 : 28 5 4 1 2 4 2 3 2 2 7 : 37752 aida08 : 17 5 4 2 1 2 2 3 3 3 6 : 36396 aida09 : 21 10 4 5 4 4 3 3 3 3 6 : 37252 aida10 : 15 13 4 2 2 2 3 2 2 4 6 : 37284 aida11 : 22 13 3 3 4 3 1 4 3 3 6 : 37072 aida12 : 2 8 1 3 1 3 2 3 3 3 6 : 36472 aida13 : 23 5 4 4 1 4 3 2 3 3 6 : 36484 aida14 : 19 7 4 3 1 3 2 4 2 4 6 : 38116 aida15 : 20 10 2 2 3 2 3 2 3 3 6 : 36288 aida16 : 29 6 1 2 0 3 1 4 3 3 6 : 36724 Collecting the file size of each FEE64 Options CONTENTS file to check they are all the same FEE : aida01 => Options file size is 1026 Last changed Mon May 17 11:43:04 CEST 2021 FEE : aida02 => Options file size is 1014 Last changed Thu Apr 29 14:43:46 CEST 2021 FEE : aida03 => Options file size is 1014 Last changed Thu Apr 29 14:43:50 CEST 2021 FEE : aida04 => Options file size is 1025 Last changed Fri May 14 16:54:56 CEST 2021 FEE : aida05 => Options file size is 1025 Last changed Mon May 17 06:25:41 CEST 2021 FEE : aida06 => Options file size is 1014 Last changed Thu Apr 29 14:43:59 CEST 2021 FEE : aida07 => Options file size is 1014 Last changed Thu Apr 29 14:44:02 CEST 2021 FEE : aida08 => Options file size is 1025 Last changed Wed May 05 12:15:54 CEST 2021 FEE : aida09 => Options file size is 1014 Last changed Thu Apr 29 14:44:08 CEST 2021 FEE : aida10 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida11 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida12 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida13 => Options file size is 1025 Last changed Fri May 07 19:40:34 CEST 2021 FEE : aida14 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida15 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 FEE : aida16 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021 Analysed R14_342. Attach 4. Dead time <5% 17:00 Stats OK - attach 5 Temps OK - as before Bias increasing quite quickly - attach 6 System-wide checks System-wide checks Clock - all pass ADC - all fail (as before) Base Current Difference aida05 fault 0x500 : 0x512 : 18 White Rabbit error counter test result: Passed 15, Failed 1 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR FPGA - all pass Returned 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k aida01 : 28 7 8 4 1 4 2 2 2 2 7 : 37352 aida02 : 24 11 6 4 3 2 3 2 3 3 6 : 36440 aida03 : 17 11 5 2 1 2 2 3 3 3 6 : 36460 aida04 : 25 13 10 6 2 4 2 3 3 3 6 : 37036 aida05 : 23 7 3 2 2 3 3 3 3 3 6 : 36868 aida06 : 1 12 3 8 2 4 3 3 3 3 6 : 37140 aida07 : 22 12 1 1 2 4 2 2 2 2 7 : 37224 aida08 : 21 8 7 2 1 3 3 2 3 3 6 : 36356 aida09 : 23 7 4 6 4 3 2 4 3 3 6 : 37396 aida10 : 27 7 2 2 2 2 3 3 2 4 6 : 37764 aida11 : 12 5 3 5 4 3 1 4 3 3 6 : 37032 aida12 : 23 9 4 1 2 3 2 3 3 3 6 : 36612 aida13 : 10 12 6 3 1 4 3 2 3 3 6 : 36488 aida14 : 23 7 3 3 1 3 2 3 2 4 6 : 37604 aida15 : 22 6 6 4 2 2 3 2 3 3 6 : 36328 aida16 : 27 7 3 1 0 3 1 4 3 3 6 : 36724 18:00 Stats OK - attach 7 Temps OK - as before Bias - attach 8 System-wide checks - as before except Base Current Difference aida05 fault 0x500 : 0x517 : 23 White Rabbit error counter test result: Passed 15, Failed 1 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR Analysed R14_371. Attach 9. Dead time below 5%. 18:35 MBS DAQ crashed 18:40 Stats OK - attach 9 Temps OK - as before Bias - attach 10 System-wide checks - as before except Base Current Difference aida05 fault 0x500 : 0x51a : 26 White Rabbit error counter test result: Passed 15, Failed 1 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR 18:42 MBS DAQ restarted - new file being opened. 19:36 Stats OK - attach 11 Temps OK - attach 12 Bias - attach 13 System-wide checks Clock OK ADC all fail Base Current Difference aida05 fault 0x500 : 0x51e : 30 White Rabbit error counter test result: Passed 15, Failed 1 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR FPGA OK Returned 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k aida01 : 24 11 5 4 1 4 2 3 2 2 7 : 37832 aida02 : 0 5 6 3 4 2 3 2 3 3 6 : 36328 aida03 : 15 8 5 3 2 2 1 3 4 3 6 : 37292 aida04 : 14 8 7 5 3 4 2 3 3 3 6 : 36936 aida05 : 31 6 1 1 2 3 3 3 2 4 6 : 37852 aida06 : 9 8 3 8 2 4 3 3 3 3 6 : 37140 aida07 : 21 7 2 1 2 4 1 3 2 2 7 : 37452 aida08 : 8 4 5 3 1 3 2 3 3 3 6 : 36528 aida09 : 24 7 3 5 4 3 2 4 3 3 6 : 37352 aida10 : 19 9 7 1 2 2 3 2 2 4 6 : 37284 aida11 : 27 5 0 5 4 3 1 4 3 3 6 : 37044 aida12 : 31 9 2 1 2 3 2 3 3 3 6 : 36612 aida13 : 21 10 4 3 1 4 3 2 3 3 6 : 36484 aida14 : 22 6 4 2 1 3 2 4 2 4 6 : 38088 aida15 : 21 9 3 4 2 2 3 2 3 3 6 : 36300 aida16 : 23 11 4 2 1 4 2 3 3 3 6 : 36724 19:43 Shift handed over to LS
Attachment 1: Stats1.png

Attachment 2: Temps1.png

Attachment 3: Bias1.png

Attachment 4: Analysis_R14_342
* TDR format 3.3.0 analyser - TD - May 2021 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 252065796 ( 1015168.3 Hz) Other data format: 9854206 ( 39686.8 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 242 ( 1.0 Hz) RESUME: 241 ( 1.0 Hz) SYNC100: 32924 ( 132.6 Hz) WR48-63: 32924 ( 132.6 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 9787875 ( 39419.6 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 499592 ( 2012.1 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 248.300 s FEE elapsed dead time(s) elapsed idle time(s) 0 0.028 16.674 1 4.476 0.000 2 0.095 0.000 3 4.784 0.000 4 0.046 31.798 5 8.905 0.000 6 0.093 3.062 7 8.121 0.000 8 0.937 0.000 9 0.000 59.989 10 0.965 0.000 11 0.025 0.000 12 0.042 0.000 13 0.000 63.078 14 0.061 0.000 15 0.217 0.000 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 5702434 2900 0 0 3 3 703 703 0 1488 0 26833 1 25200522 6341 0 0 31 30 3140 3140 0 0 0 55809 2 10737118 2562866 0 0 3 3 1687 1687 0 2559486 0 44132 3 32448674 2519917 0 0 37 37 4558 4558 0 2510727 0 63444 4 3679860 1335111 0 0 5 5 577 577 0 1333947 0 11808 5 37244520 759044 0 0 62 62 4940 4940 0 749040 0 34314 6 9560033 1568630 0 0 3 3 1348 1348 0 1565928 0 23903 7 40864979 1077667 0 0 66 66 5138 5138 0 1067259 0 40193 8 17664728 4388 0 0 6 6 2188 2188 0 0 0 56741 9 2360528 644 0 0 0 0 322 322 0 0 0 4285 10 20213561 5020 0 0 12 12 2498 2498 0 0 0 34696 11 11474187 2786 0 0 1 1 1392 1392 0 0 0 10298 12 8797735 2188 0 0 1 1 1093 1093 0 0 0 49042 13 2441760 604 0 0 0 0 302 302 0 0 0 3463 14 7875814 1932 0 0 4 4 962 962 0 0 0 33004 15 15799343 4168 0 0 8 8 2076 2076 0 0 0 7627 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time: 34.352s ( 931.544 blocks/s, 58.222 Mb/s)
Attachment 5: Stats2.png

Attachment 6: Bias2.png

Attachment 7: Stats3.png

Attachment 8: Bias3.png

Attachment 9: Analysis_R14_371
* TDR format 3.3.0 analyser - TD - May 2021 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 252182561 ( 1038396.9 Hz) Other data format: 9737439 ( 40095.3 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 234 ( 1.0 Hz) RESUME: 234 ( 1.0 Hz) SYNC100: 32904 ( 135.5 Hz) WR48-63: 32904 ( 135.5 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 9671163 ( 39822.4 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 493534 ( 2032.2 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 242.858 s FEE elapsed dead time(s) elapsed idle time(s) 0 0.060 15.876 1 5.312 0.000 2 0.091 0.000 3 3.590 0.000 4 0.163 29.634 5 9.407 0.000 6 0.049 0.000 7 6.820 0.000 8 2.387 0.000 9 0.000 29.724 10 0.676 0.000 11 0.043 0.000 12 0.046 0.000 13 0.000 57.696 14 0.016 3.102 15 0.214 0.000 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 5708701 2832 0 0 4 4 686 686 0 1452 0 26548 1 24896226 6554 0 0 36 36 3241 3241 0 0 0 54251 2 10734245 2512200 0 0 3 3 1683 1683 0 2508828 0 43373 3 32202526 2481239 0 0 32 32 4391 4391 0 2472393 0 63125 4 3649395 1322612 0 0 11 11 611 611 0 1321368 0 11610 5 36874871 743171 0 0 64 64 4722 4722 0 733599 0 33565 6 9551266 1557362 0 0 1 1 1434 1434 0 1554492 0 23558 7 41439213 1089893 0 0 57 57 5374 5374 0 1079031 0 40478 8 17460031 4238 0 0 7 7 2112 2112 0 0 0 55845 9 2360192 582 0 0 0 0 291 291 0 0 0 4290 10 20593873 5182 0 0 6 6 2585 2585 0 0 0 34440 11 11697470 2942 0 0 2 2 1469 1469 0 0 0 10244 12 8815559 2192 0 0 1 1 1095 1095 0 0 0 48502 13 2454200 586 0 0 0 0 293 293 0 0 0 3481 14 7942567 1924 0 0 2 2 960 960 0 0 0 32639 15 15802226 3930 0 0 8 8 1957 1957 0 0 0 7585 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time: 33.879s ( 944.541 blocks/s, 59.034 Mb/s)
Attachment 10: Stats4.png

Attachment 11: Bias4.png

323	Tue May 18 06:50:53 2021	OH, PP	Tuesday 18th May 08:00 - 16:00
08:00 OH Takes over Statistics still look good from yesterday. Rate is still down. Dead time in FEEs 2 and 4 is 2.04% System wide checks clock ok Base Current Difference aida05 fault 0x4da : 0x500 : 38 White Rabbit error counter test result: Passed 15, Failed 1 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR Baseline reset FPGA check ok Stats - attachment 1 Temp - attachment 2 Bias - attachment 3 08:11 With the decreased noise I am investigating whether we can lower the thresholds on DSSD2 y strips. I have set them to 0x19 on ASICS 1-3 and 0x64 on ASIC4 The results of the test appear to indicate that it is the network link that we are saturating causing dead time *** Before After FEE DT (s) Dead time % DT (s) Dead time % 0 0.013 0.004184451 0.026 0.010025681 1 6.352 2.04458693 4.097 1.57981599 2 0.295 0.09495484 0.292 0.112596112 3 6.349 2.043621288 8.255 3.183153771 4 0.021 0.006759497 0.03 0.011568094 5 0.285 0.091736032 3.388 1.306423377 6 0.02 0.006437616 0.149 0.057454865 7 1.219 0.392372712 2.133 0.822491459 8 1.137 0.365978485 0.457 0.176220627 9 0 0 0 0 10 1.633 0.525631369 1.545 0.595756823 11 0.061 0.01963473 0.166 0.064010118 12 0.059 0.018990968 0.085 0.032776265 13 0 0 0 0 14 0.016 0.005150093 0.023 0.008868872 15 0.282 0.09077039 0.168 0.064781324 Note that the dead time for FEE6 and 8 remains fairly low but the dead time for FEE4 has increased 09:00 They are stopping the run to decrease the bias on the bPlast detector 09:25 No noticable change in AIDA They will now begin to change the spill structure. 09:46 While they are optimising the 1s spill structure raised the thresholds of FEE6 and 8 back to 0x20. Will start from here when optimising the thresholds post spill change 10:21 Beam is back on AIDA 10:39 System wide checks. - ADC calibration check failed (this is anticipated because waveforms are off). - 1 Failed test in White Rabbit: Base Current Difference aida05 fault 0x500 : 0x506 : 6 White Rabbit error counter test result: Passed 15, Failed 1 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR - All other systems passed 11:00 Stats - attachment 4 Temp - attachment 5 Bias - attachment 6 12:46 System wide checks - ADC calibration check failed (this is anticipated because waveforms are off). - 1 Failed test in White Rabbit: Base Current Difference aida05 fault 0x500 : 0x50b : 11 White Rabbit error counter test result: Passed 15, Failed 1 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR - All other systems passed 14:36 System wide checks - ADC calibration check failed (this is anticipated because waveforms are off). - 1 Failed test in White Rabbit: Base Current Difference aida05 fault 0x500 : 0x50f : 15 White Rabbit error counter test result: Passed 15, Failed 1 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR - All other systems passed
Attachment 1: 210518_0757_Stats.png

Attachment 2: 210518_0758_Temp.png

Attachment 3: 210518_0759_Bias.png

Attachment 4: 210518_1059_Stats.png

Attachment 5: 210518_1100_Temp.png

Attachment 6: 210518_1101_Bias.png

Goto page Previous 1, 2, 3 ... 5, 6, 7 ... 35, 36, 37 Next

ELOG V3.1.3-7933898