ELOG DESPEC

AIDA GELINA BRIKEN nToF CRIB ISOLDE CIRCE nTOFCapture DESPEC DTAS EDI_PSA 179Ta CARME StellarModelling DCF K40

DESPEC, Page 11 of 36

Full | Summary | Threaded | Hide attachments

703 Entries

Goto page Previous 1, 2, 3 ... 10, 11, 12 ... 34, 35, 36 Next

Selected entries:

	ID	Date	Author	Subject
	514	Wed Sep 14 19:07:07 2022	PJCS	INFO : Three Merger Statistics explained
There are three Merger statistics that can be used to better understand how the data flow through the Merger system is proceeding. Two are from the Link task and one is from the Merger.They are all "No data buffers avaliable" with #1, #2, #3 at the end. #1: This is incremented when the Link task has a data item to put in the queue for the Merge process but there is no room. #2: This is incremented when the Link task has found no room in the queue for the Merge process ( #1 ) , waited , tried again and failed. #3: This the other end of the queue. When the Merge task requests a data item from a Link task queue and there is nothing available.
	513	Thu Sep 8 12:37:18 2022	NH	Proxy Port Changed
The proxy in Firefox, Yum and AnyDesk has been changed as the old wasn't working proxy.gsi.de port 3128 is now in use
	512	Thu Sep 8 12:31:25 2022	NH	Retrying AIDA DataAcq v10
Startup AIDA with ribbon cable connected to aida03 and aida07 for noise Setup and run with waveforms enabled. Discriminators ADC power etc as default Try to push above 200k as this is where we saw issues before... lowering threshold to 0x3 pushes rates to aida03 - 320k aida07 - 254k Startup merger and observe rates aida03 - 224k aida07 - 213k Rate drop observed as before. Now update aidacommon to point to AidaExecV10 and powercycle FEEs Rates again with 0x3 aida03 - 315k aida07 - 252k Restart with data transfer ON aida03 - 317k aida07 - 262k No errors in merger terminal or "Merge time errors" statistic Will keep running
Attachment 1: AnyDeskMSI_2022-09-08_13-35-50.png

Attachment 2: AnyDeskMSI_2022-09-08_13-35-58.png

Attachment 3: AnyDeskMSI_2022-09-08_13-36-02.png

	511	Tue Aug 30 13:48:32 2022	NH	AIDA Single Switch Configuration
The second switch was moved back to CARME so AIDA has been configured back to using a single switch aida02/aida04/aida06/aida08 updated back to first switch as per https://elog.ph.ed.ac.uk/DESPEC/433 Additionally a ribbon cable is attached to aida01 and aida05 to introduce some noise into the system
	510	Tue Jul 5 08:53:20 2022	TD	To Do
In no particular order 1) CAEN 83xx series NIM bin (Ortec 533A output noise issue) observe +/- 6V, 12V, 24V lines with/without load try new CAEN NIM bin and/or NIM bin of different type 2) Measure actual voltages at FEE64 power connector input OH suggests fab of power adaptor for safe observation - contact EW 3) rev B adaptor PCB invert 125 way ERNI - check for mech conflicts paired HV input (avoid Lemo-00 T pieces) consider isolating test/HV Lemo-00 shells from PCB ground (loop elimination) straight jumpers shrouded Samtec headers - consider mech issues/consequences of using eject clips too re-visit HV filtering & separate trace ground 4) isolation transformer as practical matter may be necessary to operate all platform from isolation transformer consider hire of appropriate unit need method to measure isolation - will require permit to work or equiv 5) investigate S4 area ac mains NH discussing with GSI electricians 6) Systematic measurement of AIDA PSU noise Spec linear AIDA FEE64 PSU 7) Redesign of snout Return to 1mm welded box Al for lower stage of snout for added rigidity 8) Revisit calculation of cable lengths. Particularly for the triple 9)
	509	Wed Jun 29 10:48:26 2022	NH, OH	AIDA Dismounted
All detectors removed from single and triple AIDA snouts Empty snouts and DSSDs (in boxes) stored in NH office
	508	Tue Jun 28 10:11:35 2022	OH, NH	MIDAS Data Aq V10
11:11 Rebooted FEEs and changed aidacommon in /MIDAS/linux-ppc_4xx/startup to point to the new V10 DataAq that Patrick produced When using V9 the Merger statistics reported WR items at twice the rate of ADC data items. i.e for ever data item we were sending and info code 4 and info code 5 item sending 192 bits of data vs 64 for just the data word This was causing significant deadtime when FEEs were running in the range of around 200kHz. These WR items were not reported by the MIDAS Acquisition server but were in the Merger statistics Patrick has produced V10 which removes these. When running V10 we can confirm in the Merger statistics that this rate is no longer determined by the ADC data rate and instead controlled via Sync Rollover Target in GSI WhiteRabbit Control. WR items for 0xE - attachment 1 WR items for 0x7 - attachment 2 However we see in the NewMerger terminal the message shown in attachment 3 frequently. Also we note that the merger time error counter is also going up. Our thoughts for this are we have a rollover issue (Is the merger expecting the rollover of the LSB to be one value when the MSB is updated but MIDAS is happening on another?) Are we having dead time issues which is causing time warps? Does each buffer from the MIDAS Data Acq start with a full WR timestamp? aidacommon has been changed back to point to V9 to not cause issues when we run the DAQ and forget we changed it to be this way?
Attachment 1: 220628_1117_Rollover0xE.png

Attachment 2: 220628_1119_Merger_Stats_0x7.png

Attachment 3: NewMerger_Dump.txt
MERGE Data Link (17671): block sequence error: ID 2, expected 462; received 0 MERGE Data Link (17669): block sequence error: ID 0, expected 461; received 0 MERGE Data Link (17672): block sequence error: ID 3, expected 462; received 0 MERGE Data Link (17670): block sequence error: ID 1, expected 462; received 0 MERGE Data Link (17674): block sequence error: ID 5, expected 463; received 0 MERGE Data Link (17676): block sequence error: ID 7, expected 462; received 0 MERGE Data Link (17675): block sequence error: ID 6, expected 461; received 0 MERGE Data Link (17673): block sequence error: ID 4, expected 462; received 0 MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources MERGE Actor (17699): Working with 0 from 8 data sources
	507	Tue Jun 28 09:37:19 2022	NH	Tues 28 June 08:00-
Experiment over 10:37 - Stop DAQ & Tape S4 enters controlled access and they uncable bPlas Will dismount AIDA snout after
	506	Mon Jun 27 23:11:47 2022	TD	Tuesday 28 June 00:00-08:00
00:07 Zero stats & all histograms ASIC settings 2021Apr29-13-16-00 slow comparator 0x64 -> 0xa all waveform AD9252 ADCs disabled all fast discs disabled BNC PB-5 settings (to p+n FEE64s only) amplitude 1.0V attenuator x1 decay time 1ms polarity + frequency 22Hz analysis of file S505/R5_896 - attachment 1 zero timewarps deadtime all FEE64s << 1% All system wide checks OK except WR & FPGA errors - attachments 2 & 3 adc data item stats - attachment 4 FEE64 temps OK - attachment 5 DSSSD bias & leakage currents OK - attachment 6 & 7 00:15 Check ASIC control all FEE64s, all ASICs 02:03 analysis of file S505/R5_914 - attachment 8 zero timewarps deadtime all FEE64s << 1% per FEE64 1.8.H spectra - attachments 9 & 10 per p+n FEE64 1.8.L spectra - attachment 11 aida01 pulser peak width 94 ch FWHM per FEE64 stat & rate spectra - attachments 12 & 13 All system wide checks OK except WR & FPGA errors - attachments 14 & 15 adc data item stats - attachment 16 FEE64 temps OK - attachment 17 DSSSD bias & leakage currents OK - attachment 18 03:31 S505 PI Anabel declares experiment end - following periods of beam loss and FRS DAQ issues today 03:41 analysis of file S505/R5_926 - attachment 19 zero timewarps deadtime all FEE64s << 1% All system wide checks OK except WR & FPGA errors - attachments 20 & 21 adc data item stats - attachment 22 FEE64 temps OK - attachment 23 DSSSD bias & leakage currents OK - attachment 24 07:00 analysis of file S505/R5_954 - attachment 25 zero timewarps deadtime all FEE64s << 1% All system wide checks OK except WR & FPGA errors - attachments 26 & 27 adc data item stats - attachment 28 FEE64 temps OK - attachment 29 DSSSD bias & leakage currents OK - attachment 30
Attachment 1: R5_896
* TDR format 3.3.0 analyser - TD - May 2021 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 261821326 ( 595374.9 Hz) Other data format: 98676 ( 224.4 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 406 ( 0.9 Hz) RESUME: 406 ( 0.9 Hz) SYNC100: 33638 ( 76.5 Hz) WR48-63: 33638 ( 76.5 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 30588 ( 69.6 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 0 ( 0.0 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 439.759 s FEE elapsed dead time(s) elapsed idle time(s) 0 0.000 0.000 1 1.599 0.000 2 0.000 0.000 3 0.043 0.000 4 0.000 153.964 5 0.000 0.000 6 0.053 0.000 7 0.015 0.000 8 0.000 0.000 9 0.000 0.000 10 0.000 0.000 11 0.000 0.000 12 0.000 0.000 13 0.000 0.000 14 0.000 0.000 15 0.000 0.000 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 19090298 35782 0 0 0 0 2597 2597 0 30588 0 0 1 70343282 19202 0 0 400 400 9201 9201 0 0 0 0 2 10361360 2782 0 0 0 0 1391 1391 0 0 0 0 3 39578798 10102 0 0 3 3 5048 5048 0 0 0 0 4 3065688 742 0 0 0 0 371 371 0 0 0 0 5 15482560 3946 0 0 0 0 1973 1973 0 0 0 0 6 51969876 12870 0 0 2 2 6433 6433 0 0 0 0 7 51929464 13250 0 0 1 1 6624 6624 0 0 0 0 8 0 0 0 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time: 35.371s ( 904.697 blocks/s, 56.544 Mb/s)
Attachment 2: Screenshot_from_2022-06-28_00-06-58.png

Attachment 3: Screenshot_from_2022-06-28_00-06-35.png

Attachment 4: Screenshot_from_2022-06-28_00-06-00.png

Attachment 5: Screenshot_from_2022-06-28_00-05-30.png

Attachment 6: Screenshot_from_2022-06-28_00-04-42.png

Attachment 7: Screenshot_from_2022-06-28_00-03-56.png

Attachment 8: R5_914
* TDR format 3.3.0 analyser - TD - May 2021 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 261460369 ( 646962.6 Hz) Other data format: 459631 ( 1137.3 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 616 ( 1.5 Hz) RESUME: 616 ( 1.5 Hz) SYNC100: 33505 ( 82.9 Hz) WR48-63: 33505 ( 82.9 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 391389 ( 968.5 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 131720 ( 325.9 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 404.135 s FEE elapsed dead time(s) elapsed idle time(s) 0 0.615 0.000 1 2.119 0.000 2 0.420 0.000 3 0.323 0.000 4 0.124 111.840 5 0.000 0.000 6 0.696 0.000 7 0.001 0.000 8 0.000 0.000 9 0.000 0.000 10 0.000 0.000 11 0.000 0.000 12 0.000 0.000 13 0.000 0.000 14 0.000 0.000 15 0.000 0.000 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 19284409 33077 0 0 6 6 2512 2512 0 28041 0 31815 1 69379431 18886 0 0 391 391 9052 9052 0 0 0 26209 2 20984122 96945 0 0 6 6 2775 2775 0 91383 0 19775 3 56761004 105837 0 0 202 202 7127 7127 0 91179 0 9889 4 3261224 838 0 0 2 2 417 417 0 0 0 9818 5 13707273 3434 0 0 0 0 1717 1717 0 0 0 11918 6 42321326 100064 0 0 8 8 5351 5351 0 89346 0 17237 7 35761580 100550 0 0 1 1 4554 4554 0 91440 0 5059 8 0 0 0 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time: 35.648s ( 897.667 blocks/s, 56.104 Mb/s)
Attachment 9: Screenshot_from_2022-06-28_02-14-50.png

Attachment 10: Screenshot_from_2022-06-28_02-13-46.png

Attachment 11: Screenshot_from_2022-06-28_02-12-22.png

Attachment 12: Screenshot_from_2022-06-28_02-11-10.png

Attachment 13: Screenshot_from_2022-06-28_02-10-07.png

Attachment 14: Screenshot_from_2022-06-28_02-08-49.png

Attachment 15: Screenshot_from_2022-06-28_02-05-26.png

Attachment 16: Screenshot_from_2022-06-28_02-04-36.png

Attachment 17: Screenshot_from_2022-06-28_02-04-11.png

Attachment 18: Screenshot_from_2022-06-28_02-03-39.png

Attachment 19: R5_926
* TDR format 3.3.0 analyser - TD - May 2021 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 261820610 ( 589706.0 Hz) Other data format: 99390 ( 223.9 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 624 ( 1.4 Hz) RESUME: 624 ( 1.4 Hz) SYNC100: 33654 ( 75.8 Hz) WR48-63: 33654 ( 75.8 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 30834 ( 69.4 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 0 ( 0.0 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 443.985 s FEE elapsed dead time(s) elapsed idle time(s) 0 0.000 0.000 1 1.081 0.000 2 0.000 0.000 3 0.281 0.000 4 0.000 152.429 5 0.000 0.000 6 0.000 0.000 7 0.000 0.000 8 0.000 0.000 9 0.000 0.000 10 0.000 0.000 11 0.000 0.000 12 0.000 0.000 13 0.000 0.000 14 0.000 0.000 15 0.000 0.000 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 15622398 34978 0 0 0 0 2072 2072 0 30834 0 0 1 68236330 18574 0 0 381 381 8906 8906 0 0 0 0 2 18744892 4984 0 0 0 0 2492 2492 0 0 0 0 3 59875268 15514 0 0 243 243 7514 7514 0 0 0 0 4 2759883 664 0 0 0 0 332 332 0 0 0 0 5 13541412 3478 0 0 0 0 1739 1739 0 0 0 0 6 45470554 11726 0 0 0 0 5863 5863 0 0 0 0 7 37569873 9472 0 0 0 0 4736 4736 0 0 0 0 8 0 0 0 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time: 35.045s ( 913.114 blocks/s, 57.070 Mb/s)
Attachment 20: Screenshot_from_2022-06-28_03-44-20.png

Attachment 21: Screenshot_from_2022-06-28_03-44-00.png

Attachment 22: Screenshot_from_2022-06-28_03-43-05.png

Attachment 23: Screenshot_from_2022-06-28_03-41-50.png

Attachment 24: Screenshot_from_2022-06-28_03-41-21.png

Attachment 25: R5_954
* TDR format 3.3.0 analyser - TD - May 2021 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 261819650 ( 564425.6 Hz) Other data format: 100350 ( 216.3 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 346 ( 0.7 Hz) RESUME: 346 ( 0.7 Hz) SYNC100: 33728 ( 72.7 Hz) WR48-63: 33728 ( 72.7 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 32202 ( 69.4 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 0 ( 0.0 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 463.869 s FEE elapsed dead time(s) elapsed idle time(s) 0 0.000 0.000 1 0.860 0.000 2 0.000 16.297 3 0.000 0.000 4 0.000 130.996 5 0.000 0.000 6 0.000 0.000 7 0.000 0.000 8 0.000 0.000 9 0.000 0.000 10 0.000 0.000 11 0.000 0.000 12 0.000 0.000 13 0.000 0.000 14 0.000 0.000 15 0.000 0.000 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 19510795 37524 0 0 0 0 2661 2661 0 32202 0 0 1 71776267 19370 0 0 343 343 9342 9342 0 0 0 0 2 7596519 1752 0 0 0 0 876 876 0 0 0 0 3 39174917 10150 0 0 0 0 5075 5075 0 0 0 0 4 3312486 838 0 0 0 0 419 419 0 0 0 0 5 15419570 4004 0 0 0 0 2002 2002 0 0 0 0 6 56857618 14472 0 0 3 3 7233 7233 0 0 0 0 7 48171478 12240 0 0 0 0 6120 6120 0 0 0 0 8 0 0 0 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time: 35.318s ( 906.044 blocks/s, 56.628 Mb/s)
Attachment 26: Screenshot_from_2022-06-28_07-03-01.png

Attachment 27: Screenshot_from_2022-06-28_07-02-34.png

Attachment 28: Screenshot_from_2022-06-28_07-01-31.png

Attachment 29: Screenshot_from_2022-06-28_07-01-03.png

Attachment 30: Screenshot_from_2022-06-28_07-00-31.png

	505	Mon Jun 27 17:03:09 2022	MA	Monday 27th June 16:00-00:00
16:00 Took over the shift from OH no beam yet. 18:00 Still no beam yet. Statistics, Temperature, Current are checked and attached 1-3 system wide checks same as last updated in the previoues shift. 22:00 The beam is back but not taking data yet! FRS team doing some checkings Statistics, Temperature, Current are checked and attached 4-6 system wide checks same as last updated in the previoues shift. 23:30 beam is back and taking data
Attachment 1: Statistics2022-06-27_18-02-25.png

Attachment 2: Temperature2022-06-27_18-01-14.png

Attachment 3: Current2022-06-27_17-59-55.png

Attachment 4: Statics2022-06-27_22-12-07.png

Attachment 5: Temperature2022-06-27_22-11-21.png

Attachment 6: Current2022-06-27_22-10-12.png

	504	Mon Jun 27 06:45:22 2022	OH	Monday 27th June 08:00-16:00
07:45 Spoke to David and the beam has been gone since about 05:30 Reason for the loss of beam is a vacuum issue before the FRS They are waiting for the experts 08:31 Statistics ok - attachment 1 Temperature ok - attachment 2 Bias and leakage currrents ok - attachment 3 ASIC clock check ok Base Current Difference aida07 fault 0xc53d : 0xc5cf : 146 aida08 fault 0xf1be : 0xf2ba : 252 White Rabbit error counter test result: Passed 6, Failed 2 Base Current Difference aida07 fault 0x2a : 0x41 : 23 Currently on file R5_771 Analysis of file R5_770 (No beam) - attachment 4 Around 0.25% deadtime on AIDA02 rest even less 09:02 Current free HDD space 965 GB Current tape server rate 4979 kB/s Free space taking data rate at 5700 kB/s (Closer to beam value) 47 hours 11:41 Statistics ok - attachment 5 Temperatures ok - attachment 6 Bias and leakage currents ok - attachment 7 ASIC clock check ok Base Current Difference aida07 fault 0xc53d : 0xc5cf : 146 aida08 fault 0xf1be : 0xf2ba : 252 White Rabbit error counter test result: Passed 6, Failed 2 Base Current Difference aida07 fault 0x2a : 0x41 : 23 FPGA Timestamp error counter test result: Passed 7, Failed 1 Note that there has been no change in the White Rabbit errors or FPGA faults since very early morning. Could the rate of accrual in errors be proportional to the data rate. Faster data rate, errors occur more frequently?
Attachment 1: 220626_0830_Stats.png

Attachment 2: 220626_0830_Temp.png

Attachment 3: 220626_0831_Bias.png

Attachment 4: R5_770_analysis.txt
* TDR format 3.3.0 analyser - TD - May 2021 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 261823568 ( 639881.5 Hz) Other data format: 96432 ( 235.7 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 451 ( 1.1 Hz) RESUME: 451 ( 1.1 Hz) SYNC100: 33524 ( 81.9 Hz) WR48-63: 33524 ( 81.9 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 28482 ( 69.6 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 0 ( 0.0 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 409.175 s FEE elapsed dead time(s) elapsed idle time(s) 0 0.033 0.000 1 1.307 0.000 2 0.000 0.000 3 0.206 0.000 4 0.000 157.882 5 0.000 0.000 6 0.000 0.000 7 0.139 0.000 8 0.000 0.000 9 0.000 0.000 10 0.000 0.000 11 0.000 0.000 12 0.000 0.000 13 0.000 0.000 14 0.000 0.000 15 0.000 0.000 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 20319054 33950 0 0 1 1 2733 2733 0 28482 0 0 1 68104715 18442 0 0 318 318 8903 8903 0 0 0 0 2 24150534 6320 0 0 0 0 3160 3160 0 0 0 0 3 55928626 14410 0 0 131 131 7074 7074 0 0 0 0 4 2503858 618 0 0 0 0 309 309 0 0 0 0 5 12980974 3340 0 0 0 0 1670 1670 0 0 0 0 6 41271038 10344 0 0 0 0 5172 5172 0 0 0 0 7 36564769 9008 0 0 1 1 4503 4503 0 0 0 0 8 0 0 0 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time: 41.158s ( 777.488 blocks/s, 48.593 Mb/s)
	503	Sun Jun 26 23:04:30 2022	Marc	new shift - Monday 27 June 0:00 to 8:00
0:00 Experiment continues to run smoothly. AIDA DAQ has been rather stable. Leakage current has gone up for the past two days in both DSSDs (combination of high-Z and high-intensity beam and external high temperature). Stats & Temperatures (VIRTEX,PSU, ASICs) all ok. At 0:30 Stats ok - Attachment 1 Temp ok - Attachement 2 HV-LC -Attachment 3 At 2:20 Stats ok - Attachment 4 Temp ok - Attachement 5 HV-LC -Attachment 6 Wide Checks: Clock status test result: Passed 8, Failed 0 Understand status as follows Status bit 3 : firmware PLL that creates clocks from external clock not locked Status bit 2 : always logic '1' Status bit 1 : LMK3200(2) PLL and clock distribution chip not locked to external clock Status bit 0 : LMK3200(1) PLL and clock distribution chip not locked to external clock If all these bits are not set then the operation of the firmware is unreliable ADC Calibration (same as before): FEE64 module aida01 failed FEE64 module aida02 failed FEE64 module aida03 failed FEE64 module aida04 failed FEE64 module aida05 failed FEE64 module aida06 failed FEE64 module aida07 failed FEE64 module aida08 failed Calibration test result: Passed 0, Failed 8 If any modules fail calibration , check the clock status and open the FADC Align and Control browser page to rerun calibration for that module WR decoder status: Base Current Difference aida07 fault 0xc53d : 0xc5c9 : 140 aida08 fault 0xf1be : 0xf2b2 : 244 White Rabbit error counter test result: Passed 6, Failed 2 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR FPGA timestamp check: Base Current Difference aida07 fault 0x2a : 0x41 : 23 FPGA Timestamp error counter test result: Passed 7, Failed 1 If any of these counts are reported as in error The ASIC readout system has detected a timeslip. That is the timestamp read from the time FIFO is not younger than the last At 4:15: Stats ok - Attachment 7 Temp ok - Attachement 8 HV-LC -Attachment 9 Wide Checks: No change At 7:15: (no beam since ~6am -> background run) Stats ok - Attachment 10 Temp ok - Attachement 11 HV-LC -Attachment 12 Wide Checks: No change
Attachment 1: Stats-Screenshot_from_2022-06-27_00-30-58.png

Attachment 2: Temp-Screenshot_from_2022-06-27_00-31-44.png

Attachment 3: HV-LC-Screenshot_from_2022-06-27_00-30-18.png

Attachment 4: Stats-Screenshot_from_2022-06-27_02-22-34.png

Attachment 5: Temp-Screenshot_from_2022-06-27_02-19-42.png

Attachment 6: HV-LC-Screenshot_from_2022-06-27_02-19-05.png

Attachment 7: Stats-Screenshot_from_2022-06-27_04-17-22.png

Attachment 8: Temp-Screenshot_from_2022-06-27_04-16-40.png

Attachment 9: HV-LC-Screenshot_from_2022-06-27_04-14-57.png

Attachment 10: Stats-Screenshot_from_2022-06-27_07-15-17.png

Attachment 11: Temp-Screenshot_from_2022-06-27_07-14-02.png

Attachment 12: HV-LC-Screenshot_from_2022-06-27_07-13-09.png

	502	Sun Jun 26 08:51:20 2022	OH, NH	Sunday 26 June 08:00-24:00
09:51 Taken over from Tom following the night shift Experiment is still running smoothly Compression of the files is complete up to the start of R5. Have started compression of files in R5 which should run up to R5_499 Currently on R5_528 Statistics ok - attachment 1 Temperatures ok - attachment 2 Bias and leakage currents ok - attachment 3 System wide checks: Base Current Difference aida07 fault 0xc53d : 0xc594 : 87 aida08 fault 0xf1be : 0xf271 : 179 White Rabbit error counter test result: Passed 6, Failed 2 Base Current Difference aida07 fault 0x2a : 0x3b : 17 FPGA Timestamp error counter test result: Passed 7, Failed 1 Current merger rate is 2E6-4E6 events per second Current tapeserver rate is 5800 kB/s Free HDD space is 1.1 TB At current rates will last 54 hours which should see out the experiment Experiment currently scheduled to finish at 6am on Tuesday morning (May get until 8am) Analysis of R5_528 - attachment 4 Deadtime of AIDA02 currently around 15% 11:56 Statistics ok - attachment 5 Temps ok - attachment 6 Bias and leakage currents ok - attachment 7 System wide checks: Clocks all ok Base Current Difference aida07 fault 0xc53d : 0xc59c : 95 aida08 fault 0xf1be : 0xf27a : 188 White Rabbit error counter test result: Passed 6, Failed 2 Base Current Difference aida07 fault 0x2a : 0x3b : 17 FPGA Timestamp error counter test result: Passed 7, Failed 1 Analysis of file R5_458 - attachment 8 Deadtime in AIDA02 only 11.5% in this file TapeServer rate still 5.5 MB/s 14:36 Has been no beam for the last while or so. With no beam AIDA02 has 0.25% deadtime so the deadtime is almost entirely due to the spill on time Stats- attachment 9 Temp - attachment 10 Bias and leakage currents ok - attachment 11 System wide checks: Clock ok Base Current Difference aida07 fault 0xc53d : 0xc59d : 96 aida08 fault 0xf1be : 0xf27c : 190 White Rabbit error counter test result: Passed 6, Failed 2 Base Current Difference aida07 fault 0x2a : 0x3c : 18 FPGA Timestamp error counter test result: Passed 7, Failed 1 13:30 Beam taken to change an ion source 14:57 Beam back 16:21 Statistics ok - attachment 12 Temperatures ok - attachment 13 Bias and leakage currents ok - attachment 14 System wide checks - ASIC clocks ok Base Current Difference aida07 fault 0xc53d : 0xc5a3 : 102 aida08 fault 0xf1be : 0xf285 : 199 White Rabbit error counter test result: Passed 6, Failed 2 Base Current Difference aida07 fault 0x2a : 0x3e : 20 FPGA Timestamp error counter test result: Passed 7, Failed 1 Currently on file R5_592 Analysis of R5_591 - Attachment 15 Deadtime of AIDA02 sitting at 17% [NH taking over for OH so he can get home] 18:53 - FRS DAQ problems mean we weren't taking DESPEC data for the past hour or so... now all back Statitics ok - attachement 16 Temps ok - attachement 17 Bias & leakage ok - attachement 18 System wide checks - Clocks OK ADC Calibration N/A WR Decoder - Base Current Difference aida07 fault 0xc53d : 0xc5ac : 111 aida08 fault 0xf1be : 0xf28c : 206 White Rabbit error counter test result: Passed 6, Failed 2 FPGA - Base Current Difference aida07 fault 0x2a : 0x3f : 21 PLL OK Currently on file R5_621 Analysis of R5_620 - Attachement 19 aida02 deadtime only 5%, all others negligible 20:20 Stats ok - attachment 20 Temps ok - attachment 21 Bias and leakage currents ok - attachment 22 System wide checks: Clock ok Base Current Difference aida07 fault 0xc53d : 0xc5ad : 112 aida08 fault 0xf1be : 0xf293 : 213 White Rabbit error counter test result: Passed 6, Failed 2 Base Current Difference aida07 fault 0x2a : 0x3f : 21 FPGA Timestamp error counter test result: Passed 7, Failed 1 Analysis of R6_637 - attachment 23 22:13 Statistics ok - attachment 24 Temperatures ok - attachment 25 Bias and leakage currents ok - attachment 26 ASIC clock check ok Base Current Difference aida07 fault 0xc53d : 0xc5ba : 125 aida08 fault 0xf1be : 0xf2a2 : 228 White Rabbit error counter test result: Passed 6, Failed 2 Base Current Difference aida07 fault 0x2a : 0x40 : 22 FPGA Timestamp error counter test result: Passed 7, Failed 1 Analysis of R5_658 - attachment 27
Attachment 1: 220626_0949_stats.png

Attachment 2: 220626_0950_Temps.png

Attachment 3: 220626_0951_Bias.png

Attachment 4: R5_528_analysis.txt
* TDR format 3.3.0 analyser - TD - May 2021 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 260639000 ( 776334.1 Hz) Other data format: 1281002 ( 3815.6 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 1133 ( 3.4 Hz) RESUME: 1133 ( 3.4 Hz) SYNC100: 33251 ( 99.0 Hz) WR48-63: 33251 ( 99.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 1212234 ( 3610.7 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 393457 ( 1171.9 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 335.730 s FEE elapsed dead time(s) elapsed idle time(s) 0 8.363 0.000 1 44.893 0.000 2 0.179 0.000 3 3.779 0.000 4 0.000 44.522 5 0.034 0.000 6 0.166 0.000 7 0.017 0.000 8 0.000 0.000 9 0.000 0.000 10 0.000 0.000 11 0.000 0.000 12 0.000 0.000 13 0.000 0.000 14 0.000 0.000 15 0.000 0.000 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 31317521 31305 0 0 207 207 4035 4035 0 22821 0 98396 1 68454688 19188 0 0 693 693 8901 8901 0 0 0 59818 2 19369571 305849 0 0 35 35 2468 2468 0 300843 0 63063 3 45019317 306201 0 0 130 130 5636 5636 0 294669 0 32623 4 4769649 1252 0 0 0 0 626 626 0 0 0 31000 5 17853070 4600 0 0 15 15 2285 2285 0 0 0 37328 6 42448852 303192 0 0 44 44 5356 5356 0 292392 0 54344 7 31406332 309415 0 0 9 9 3944 3944 0 301509 0 16885 8 0 0 0 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time: 41.891s ( 763.894 blocks/s, 47.743 Mb/s)
Attachment 5: 220626_1155_stats.png

Attachment 6: 220626_1155_Temp.png

Attachment 7: 220626_1156_Bias.png

Attachment 8: R5_548_analysis.txt
* TDR format 3.3.0 analyser - TD - May 2021 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 260758427 ( 740797.4 Hz) Other data format: 1161573 ( 3300.0 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 1084 ( 3.1 Hz) RESUME: 1084 ( 3.1 Hz) SYNC100: 33311 ( 94.6 Hz) WR48-63: 33311 ( 94.6 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 1092783 ( 3104.5 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 356241 ( 1012.1 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 351.997 s FEE elapsed dead time(s) elapsed idle time(s) 0 5.340 0.000 1 40.660 0.000 2 0.175 0.000 3 2.385 0.000 4 0.000 67.319 5 0.032 0.000 6 0.142 0.000 7 0.019 0.000 8 0.000 0.000 9 0.000 0.000 10 0.000 0.000 11 0.000 0.000 12 0.000 0.000 13 0.000 0.000 14 0.000 0.000 15 0.000 0.000 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 29258900 32253 0 0 166 166 3875 3875 0 24171 0 88948 1 70599060 19658 0 0 716 716 9113 9113 0 0 0 56350 2 19313501 275533 0 0 28 28 2458 2458 0 270561 0 56248 3 44887469 278330 0 0 112 112 5682 5682 0 266742 0 29387 4 4430708 1118 0 0 0 0 559 559 0 0 0 27825 5 17540711 4456 0 0 11 11 2217 2217 0 0 0 33663 6 43048879 271297 0 0 40 40 5377 5377 0 260463 0 48745 7 31679199 278928 0 0 11 11 4030 4030 0 270846 0 15075 8 0 0 0 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time: 40.309s ( 793.875 blocks/s, 49.617 Mb/s)
Attachment 9: 220626_1435_stats.png

Attachment 10: 220626_1435_Temp.png

Attachment 11: 220626_1436_Bias.png

Attachment 12: 220626_1620_Stats.png

Attachment 13: 220627_1620_Temp.png

Attachment 14: 220626_1621_Bias.png

Attachment 15: R5_591_analysis.txt
* TDR format 3.3.0 analyser - TD - May 2021 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 260421862 ( 840783.5 Hz) Other data format: 1498138 ( 4836.8 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 1449 ( 4.7 Hz) RESUME: 1448 ( 4.7 Hz) SYNC100: 33154 ( 107.0 Hz) WR48-63: 33154 ( 107.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 1428933 ( 4613.4 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 452287 ( 1460.2 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 309.737 s FEE elapsed dead time(s) elapsed idle time(s) 0 13.828 0.000 1 52.434 0.000 2 0.366 0.000 3 9.346 0.000 4 0.001 63.918 5 0.097 0.000 6 0.290 0.000 7 0.023 0.000 8 0.000 0.000 9 0.000 0.000 10 0.000 0.000 11 0.000 0.000 12 0.000 0.000 13 0.000 0.000 14 0.000 0.000 15 0.000 0.000 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 31248979 29393 0 0 283 282 4085 4085 0 20658 0 112900 1 66285610 18734 0 0 794 794 8573 8573 0 0 0 62107 2 22411069 363765 0 0 53 53 2890 2890 0 357879 0 73563 3 44202913 357046 0 0 221 221 5556 5556 0 345492 0 37941 4 5178577 1284 0 0 1 1 641 641 0 0 0 37680 5 19493707 4858 0 0 26 26 2403 2403 0 0 0 44391 6 39593301 355717 0 0 57 57 5081 5081 0 345441 0 63694 7 32007706 367341 0 0 14 14 3925 3925 0 359463 0 20011 8 0 0 0 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time: 41.789s ( 765.751 blocks/s, 47.859 Mb/s)
Attachment 16: tmp_aida_stats.png

Attachment 17: tmp_aida_temps.png

Attachment 18: tmp_aida_hv.png

Attachment 19: R5_620
* TDR format 3.3.0 analyser - TD - May 2021 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 261173934 ( 672570.7 Hz) Other data format: 746069 ( 1921.3 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 773 ( 2.0 Hz) RESUME: 773 ( 2.0 Hz) SYNC100: 33446 ( 86.1 Hz) WR48-63: 33446 ( 86.1 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 677631 ( 1745.0 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 225736 ( 581.3 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 388.322 s FEE elapsed dead time(s) elapsed idle time(s) 0 1.039 0.000 1 21.090 0.000 2 0.051 0.000 3 0.148 0.000 4 0.000 87.597 5 0.001 0.000 6 0.083 0.000 7 0.003 0.000 8 0.000 0.000 9 0.000 0.000 10 0.000 0.000 11 0.000 0.000 12 0.000 0.000 13 0.000 0.000 14 0.000 0.000 15 0.000 0.000 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 25216948 33824 0 0 63 63 3334 3334 0 27030 0 55557 1 75946108 20872 0 0 626 626 9810 9810 0 0 0 40146 2 18060200 168976 0 0 23 23 2304 2304 0 164322 0 34386 3 41452092 174351 0 0 26 26 5287 5287 0 163725 0 18377 4 3680704 948 0 0 0 0 474 474 0 0 0 17387 5 16518678 4150 0 0 1 1 2074 2074 0 0 0 20823 6 44456577 169523 0 0 30 30 5686 5686 0 158091 0 29842 7 35842627 173425 0 0 4 4 4477 4477 0 164463 0 9218 8 0 0 0 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time: 41.547s ( 770.214 blocks/s, 48.138 Mb/s)
Attachment 20: 220624_2021_Stats.png

Attachment 21: 220626_2021_Temp.png

Attachment 22: 220626_2022_Bias.png

Attachment 23: R5_637_analysis.txt
* TDR format 3.3.0 analyser - TD - May 2021 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 260438015 ( 849636.0 Hz) Other data format: 1481985 ( 4834.7 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 1460 ( 4.8 Hz) RESUME: 1460 ( 4.8 Hz) SYNC100: 33142 ( 108.1 Hz) WR48-63: 33142 ( 108.1 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 1412781 ( 4609.0 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 447675 ( 1460.5 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 306.529 s FEE elapsed dead time(s) elapsed idle time(s) 0 15.951 0.000 1 53.516 0.000 2 0.642 0.000 3 7.248 0.000 4 0.000 53.241 5 0.100 0.000 6 0.344 0.000 7 0.040 0.000 8 0.000 0.000 9 0.000 0.000 10 0.000 0.000 11 0.000 0.000 12 0.000 0.000 13 0.000 0.000 14 0.000 0.000 15 0.000 0.000 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 31824689 29138 0 0 291 291 4129 4129 0 20298 0 110511 1 66116092 18806 0 0 788 788 8615 8615 0 0 0 62706 2 22609638 359670 0 0 68 68 2899 2899 0 353736 0 72536 3 44231727 352857 0 0 199 199 5696 5696 0 341067 0 37873 4 5159378 1270 0 0 0 0 635 635 0 0 0 37425 5 19491876 4836 0 0 27 27 2391 2391 0 0 0 43832 6 39561529 352144 0 0 68 68 4899 4899 0 342210 0 62927 7 31443086 363264 0 0 19 19 3878 3878 0 355470 0 19865 8 0 0 0 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time: 42.891s ( 746.084 blocks/s, 46.630 Mb/s)
Attachment 24: 220626_2211_Stats.png

Attachment 25: 220626_2211_Temps.png

Attachment 26: 220626_2212_Bias.png

Attachment 27: R5_658_analysis.txt
* TDR format 3.3.0 analyser - TD - May 2021 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 260445182 ( 832450.2 Hz) Other data format: 1474818 ( 4713.9 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 1484 ( 4.7 Hz) RESUME: 1484 ( 4.7 Hz) SYNC100: 33166 ( 106.0 Hz) WR48-63: 33166 ( 106.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 1405518 ( 4492.4 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 448659 ( 1434.0 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 312.866 s FEE elapsed dead time(s) elapsed idle time(s) 0 15.080 0.000 1 57.798 0.000 2 0.343 0.000 3 7.278 0.000 4 0.000 44.445 5 0.093 0.000 6 0.265 0.000 7 0.017 0.000 8 0.000 0.000 9 0.000 0.000 10 0.000 0.000 11 0.000 0.000 12 0.000 0.000 13 0.000 0.000 14 0.000 0.000 15 0.000 0.000 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 32528426 29869 0 0 310 310 4234 4234 0 20781 0 110841 1 66604779 18608 0 0 825 825 8479 8479 0 0 0 61991 2 23919816 357449 0 0 63 63 3136 3136 0 351051 0 72944 3 47288432 353667 0 0 196 196 5939 5939 0 341397 0 38095 4 5032393 1218 0 0 0 0 609 609 0 0 0 37603 5 19089927 4824 0 0 28 28 2384 2384 0 0 0 44213 6 39392581 350027 0 0 52 52 5076 5076 0 339771 0 63206 7 26588828 359156 0 0 10 10 3309 3309 0 352518 0 19766 8 0 0 0 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time: 42.102s ( 760.067 blocks/s, 47.504 Mb/s)
	501	Sat Jun 25 22:48:57 2022	TD	Sunday 26 June 00:00-08:00
23.43 Check ASIC control Zero stats & all histograms ASIC settings 2021Apr29-13-16-00 slow comparator 0x64 -> 0xa all waveform AD9252 ADCs disabled all fast discs disabled BNC PB-5 settings (to p+n FEE64s only) amplitude 1.0V attenuator x1 decay time 1ms polarity + frequency 22Hz All system wide checks OK except WR & FPGA errors - attachments 1 & 2 DSSSD bias & leakage currents OK - attachment 3 adc data item stats - attachment 4 FEE64 temps OK - attachment 5 DSSSD bias & leakage currents OK - attachment 6 analysis of file S505/R5_415 - attachment 7 zero timewarps max deadtime aida02 c. 17%, all other FEE64s < 1% 02:36 analysis of file S505/R5_449 - attachment 8 zero timewarps max deadtime aida02 c. 15%, all other FEE64s < 1% per FEE64 rate & stat spectra - attachments 9 & 10 per p+n FEE64 1.8.L spectra - attachment 11 aida01 pulser peak width 99 ch FWHM per FEE64 1.8.H spectra - attachments 12 & 13 All system wide checks OK except WR & FPGA errors - attachments 14 & 15 adc data item stats - attachment 16 FEE64 temps OK - attachment 17 DSSSD bias & leakage currents OK - attachment 18 05:38 analysis of file S505/R5_483 - attachment 19 zero timewarps max deadtime aida02 c. 16%, all other FEE64s < 2% All system wide checks OK except WR & FPGA errors - attachments 20 & 21 adc data item stats - attachment 22 FEE64 temps OK - attachment 23 DSSSD bias & leakage currents OK - attachment 24 07:27 analysis of file S505/R5_502 - attachment 25 zero timewarps max deadtime aida02 c. 16%, all other FEE64s < 2% All system wide checks OK except WR & FPGA errors - attachments 26 & 27 adc data item stats - attachment 28 FEE64 temps OK - attachment 29 DSSSD bias & leakage currents OK - attachment 30
Attachment 1: Screenshot_from_2022-06-25_23-48-13.png

Attachment 2: Screenshot_from_2022-06-25_23-47-49.png

Attachment 3: Screenshot_from_2022-06-25_23-46-30.png

Attachment 4: Screenshot_from_2022-06-25_23-45-38.png

Attachment 5: Screenshot_from_2022-06-25_23-43-15.png

Attachment 6: Screenshot_from_2022-06-25_23-42-41.png

Attachment 7: R5_415
* TDR format 3.3.0 analyser - TD - May 2021 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 260603334 ( 839394.5 Hz) Other data format: 1316666 ( 4240.9 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 1333 ( 4.3 Hz) RESUME: 1333 ( 4.3 Hz) SYNC100: 33156 ( 106.8 Hz) WR48-63: 33156 ( 106.8 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 1247688 ( 4018.8 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 404733 ( 1303.6 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 310.466 s FEE elapsed dead time(s) elapsed idle time(s) 0 5.804 0.000 1 49.047 0.000 2 0.579 0.000 3 4.786 0.000 4 0.000 41.193 5 0.052 0.000 6 0.398 0.000 7 0.178 0.000 8 0.000 0.000 9 0.000 0.000 10 0.000 0.000 11 0.000 0.000 12 0.000 0.000 13 0.000 0.000 14 0.000 0.000 15 0.000 0.000 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 29744429 29368 0 0 191 191 3879 3879 0 21228 0 101774 1 62881123 17488 0 0 744 744 8000 8000 0 0 0 60446 2 27391657 317618 0 0 76 76 3507 3507 0 310452 0 64539 3 52390232 315971 0 0 228 228 6571 6571 0 302373 0 33153 4 4668386 1144 0 0 0 0 572 572 0 0 0 32450 5 16955242 4388 0 0 19 19 2175 2175 0 0 0 39119 6 36767424 310864 0 0 60 60 4661 4661 0 301422 0 55985 7 29804841 319825 0 0 15 15 3791 3791 0 312213 0 17267 8 0 0 0 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time: 42.203s ( 758.238 blocks/s, 47.390 Mb/s)
Attachment 8: R5_449
* TDR format 3.3.0 analyser - TD - May 2021 * ERROR: READ I/O error: 5002 blocks: 9631 ADC data format: 78467361 ( 817544.9 Hz) Other data format: 362374 ( 3775.5 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 372 ( 3.9 Hz) RESUME: 372 ( 3.9 Hz) SYNC100: 9989 ( 104.1 Hz) WR48-63: 9989 ( 104.1 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 341652 ( 3559.6 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 112408 ( 1171.2 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 95.979 s FEE elapsed dead time(s) elapsed idle time(s) 0 1.159 0.000 1 13.633 0.000 2 0.066 0.000 3 0.790 0.000 4 0.000 20.217 5 0.003 0.000 6 0.066 0.000 7 0.003 0.000 8 0.000 0.000 9 0.000 0.000 10 0.000 0.000 11 0.000 0.000 12 0.000 0.000 13 0.000 0.000 14 0.000 0.000 15 0.000 0.000 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 8759445 9043 0 0 45 45 1175 1175 0 6603 0 28377 1 19225571 5374 0 0 215 215 2472 2472 0 0 0 17713 2 7917505 86814 0 0 15 15 1017 1017 0 84750 0 17600 3 15877732 87394 0 0 75 75 1976 1976 0 83292 0 9310 4 1340586 302 0 0 0 0 151 151 0 0 0 8860 5 4870076 1158 0 0 2 2 577 577 0 0 0 10559 6 11177308 84854 0 0 17 17 1400 1400 0 82020 0 15171 7 9299138 87435 0 0 3 3 1221 1221 0 84987 0 4818 8 0 0 0 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time: 10.232s ( 941.224 blocks/s, 58.826 Mb/s)
Attachment 9: Screenshot_from_2022-06-26_02-36-29.png

Attachment 10: Screenshot_from_2022-06-26_02-34-58.png

Attachment 11: Screenshot_from_2022-06-26_02-33-46.png

Attachment 12: Screenshot_from_2022-06-26_02-32-48.png

Attachment 13: Screenshot_from_2022-06-26_02-31-49.png

Attachment 14: Screenshot_from_2022-06-26_02-30-49.png

Attachment 15: Screenshot_from_2022-06-26_02-30-25.png

Attachment 16: Screenshot_from_2022-06-26_02-29-31.png

Attachment 17: Screenshot_from_2022-06-26_02-28-59.png

Attachment 18: Screenshot_from_2022-06-26_02-28-31.png

Attachment 19: R5_483
* TDR format 3.3.0 analyser - TD - May 2021 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 260645305 ( 834521.2 Hz) Other data format: 1274695 ( 4081.3 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 1211 ( 3.9 Hz) RESUME: 1211 ( 3.9 Hz) SYNC100: 33162 ( 106.2 Hz) WR48-63: 33162 ( 106.2 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 1205949 ( 3861.1 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 393822 ( 1260.9 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 312.329 s FEE elapsed dead time(s) elapsed idle time(s) 0 5.184 0.000 1 48.274 0.000 2 0.431 0.000 3 3.375 0.000 4 0.000 25.625 5 0.027 0.000 6 0.216 0.000 7 0.008 0.000 8 0.000 0.000 9 0.000 0.000 10 0.000 0.000 11 0.000 0.000 12 0.000 0.000 13 0.000 0.000 14 0.000 0.000 15 0.000 0.000 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 30200144 29499 0 0 166 166 3899 3899 0 21369 0 99521 1 63245692 17566 0 0 710 710 8073 8073 0 0 0 60306 2 25915590 306468 0 0 52 52 3383 3383 0 299598 0 62507 3 52691198 306273 0 0 212 212 6559 6559 0 292731 0 32107 4 4611863 1212 0 0 0 0 606 606 0 0 0 31071 5 16567070 4140 0 0 9 9 2061 2061 0 0 0 37441 6 37080833 301098 0 0 53 53 4819 4819 0 291354 0 54190 7 30332915 308439 0 0 9 9 3762 3762 0 300897 0 16679 8 0 0 0 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time: 35.023s ( 913.674 blocks/s, 57.105 Mb/s)
Attachment 20: Screenshot_from_2022-06-26_05-40-48.png

Attachment 21: Screenshot_from_2022-06-26_05-40-20.png

Attachment 22: Screenshot_from_2022-06-26_05-39-34.png

Attachment 23: Screenshot_from_2022-06-26_05-38-30.png

Attachment 24: Screenshot_from_2022-06-26_05-37-55.png

Attachment 25: R5_502
* TDR format 3.3.0 analyser - TD - May 2021 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 260592349 ( 788577.6 Hz) Other data format: 1327651 ( 4017.6 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 1258 ( 3.8 Hz) RESUME: 1257 ( 3.8 Hz) SYNC100: 33231 ( 100.6 Hz) WR48-63: 33231 ( 100.6 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 1258674 ( 3808.9 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 409569 ( 1239.4 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 330.459 s FEE elapsed dead time(s) elapsed idle time(s) 0 10.444 0.000 1 49.479 0.000 2 0.188 0.000 3 4.232 0.000 4 0.000 57.929 5 0.053 0.000 6 0.278 0.000 7 0.015 0.000 8 0.000 0.000 9 0.000 0.000 10 0.000 0.000 11 0.000 0.000 12 0.000 0.000 13 0.000 0.000 14 0.000 0.000 15 0.000 0.000 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 31755884 31086 0 0 242 242 4168 4168 0 22266 0 103011 1 67198908 18739 0 0 724 723 8646 8646 0 0 0 63328 2 19438169 317456 0 0 45 45 2440 2440 0 312486 0 65069 3 45255369 318470 0 0 158 158 5750 5750 0 306654 0 33811 4 4887217 1230 0 0 0 0 615 615 0 0 0 32106 5 18040993 4688 0 0 19 19 2325 2325 0 0 0 38770 6 42367504 314874 0 0 58 58 5348 5348 0 304062 0 56174 7 31648305 321108 0 0 12 12 3939 3939 0 313206 0 17300 8 0 0 0 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time: 33.316s ( 960.488 blocks/s, 60.030 Mb/s)
Attachment 26: Screenshot_from_2022-06-26_07-29-14.png

Attachment 27: Screenshot_from_2022-06-26_07-28-54.png

Attachment 28: Screenshot_from_2022-06-26_07-28-22.png

Attachment 29: Screenshot_from_2022-06-26_07-27-50.png

Attachment 30: Screenshot_from_2022-06-26_07-27-21.png

	500	Sat Jun 25 17:06:42 2022	BA, AA	Saturday 25 June 2022 16:00-00:00
Took over the night shift from Magda 18:00 : attachments 1-3 20:00 : attachments 4-6 22:00 : attachments 7-9 00:00 : attachments 10-12
Attachment 1: Stat_17.png

Attachment 2: leak_17.png

Attachment 3: Temp17.png

Attachment 4: Temp_20.png

Attachment 5: Stat_20.png

Attachment 6: lek_20.png

Attachment 7: stat_22.png

Attachment 8: temp_22.png

Attachment 9: lak_22.png

	499	Sat Jun 25 06:55:07 2022	MS	Saturday 25 June 2022 8:00-16:00
Took over the night shift from Tom. 7:00 The beam is back. 8:00 : attachments 1-3 10:00 : attachments 4-6 12:00 : attachments 7-9 14:00 : attachments 10-12 16:00 : attachments 13-15
Attachment 1: Screenshot_2022-06-25_at_08-01-16_Statistics_aidas-gsi.png

Attachment 2: Screenshot_2022-06-25_at_08-01-37_Temperature_and_status_scan_aidas-gsi.png

Attachment 3: Screenshot_from_2022-06-25_08-02-58.png

Attachment 4: Screenshot_2022-06-25_at_10-00-41_Statistics_aidas-gsi.png

Attachment 5: Screenshot_2022-06-25_at_10-01-03_Temperature_and_status_scan_aidas-gsi.png

Attachment 6: Screenshot_from_2022-06-25_10-01-59.png

Attachment 7: Screenshot_2022-06-25_at_12-00-54_Statistics_aidas-gsi.png

Attachment 8: Screenshot_2022-06-25_at_12-01-17_Temperature_and_status_scan_aidas-gsi.png

Attachment 9: Screenshot_from_2022-06-25_12-02-08.png

Attachment 10: Screenshot_2022-06-25_at_14-07-36_Statistics_aidas-gsi.png

Attachment 11: Screenshot_2022-06-25_at_14-07-59_Temperature_and_status_scan_aidas-gsi.png

Attachment 12: Screenshot_from_2022-06-25_14-08-50.png

Attachment 13: Screenshot_2022-06-25_at_15-56-41_Statistics_aidas-gsi.png

Attachment 14: Screenshot_2022-06-25_at_15-56-57_Temperature_and_status_scan_aidas-gsi.png

Attachment 15: Screenshot_from_2022-06-25_15-58-15.png

	498	Fri Jun 24 22:36:45 2022	TD	Saturday 25 June 00:00-08:00
23:36 Check ASIC contorol Zero stats & all histograms ASIC settings 2021Apr29-13-16-00 slow comparator 0x64 -> 0xa all waveform AD9252 ADCs disabled all fast discs disabled BNC PB-5 settings (to p+n FEE64s only) amplitude 1.0V attenuator x1 decay time 1ms polarity + frequency 22Hz analysis of file S505/R5_154 - attachment 1 zero timewarps max deadtime aida02 c. 17%, all other FEE64s < 5% stats - attachments 2-6 per FEE64 1.8.H spectra - attachments 7 & 8 per p+n FEE64 1.8.L spectra - attachment 9 aida01 pulser peak width 101 ch FWHM per FEE64 stat & rate spectra - attachments 10 & 11 adc data item stats - attachment 12 FEE64 temps OK - attachment 13 DSSSD bias & leakage currents OK - attachments 14 & 15 00:20 all system wide checks OK except WR and FPGA errors - attachments 16 & 17 03:03 analysis of file S505/R5_189 - attachment 18 zero timewarps max deadtime aida02 c. 17%, all other FEE64s < 5% all system wide checks OK except WR and FPGA errors - attachments 19 & 20 adc data item stats - attachment 21 FEE64 temps OK - attachment 22 DSSSD bias & leakage currents OK - attachment 23 03:30 per FEE64 1.8.H spectra - attcahments 24 & 25 06:09 no beam analysis of file S505/R5_221 - attachment 26 zero timewarps all dead times << 1% all system wide checks OK except WR and FPGA errors - attachments 27 & 28 adc data item stats - attachment 29 FEE64 temps OK - attachment 30 DSSSD bias & leakage currents OK - attachment 31
Attachment 1: R5_154
* TDR format 3.3.0 analyser - TD - May 2021 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 260632197 ( 880101.4 Hz) Other data format: 1287803 ( 4348.6 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 1443 ( 4.9 Hz) RESUME: 1443 ( 4.9 Hz) SYNC100: 33103 ( 111.8 Hz) WR48-63: 33103 ( 111.8 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 1218711 ( 4115.3 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 391650 ( 1322.5 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 296.139 s FEE elapsed dead time(s) elapsed idle time(s) 0 14.978 0.000 1 49.946 0.000 2 0.925 0.000 3 8.130 0.000 4 0.131 17.535 5 0.197 0.000 6 0.760 0.000 7 0.599 0.000 8 0.000 0.000 9 0.000 0.000 10 0.000 0.000 11 0.000 0.000 12 0.000 0.000 13 0.000 0.000 14 0.000 0.000 15 0.000 0.000 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 32916598 28529 0 0 287 287 4193 4193 0 19569 0 96572 1 59287487 16678 0 0 710 710 7629 7629 0 0 0 57145 2 20165095 309168 0 0 52 52 2618 2618 0 303828 0 63600 3 42178844 305489 0 0 214 214 5322 5322 0 294417 0 32426 4 5271956 1388 0 0 2 2 692 692 0 0 0 31943 5 18164680 4584 0 0 28 28 2264 2264 0 0 0 38343 6 41060613 306981 0 0 61 61 5168 5168 0 296523 0 54824 7 41586924 314986 0 0 89 89 5217 5217 0 304374 0 16797 8 0 0 0 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time: 44.250s ( 723.164 blocks/s, 45.198 Mb/s)
Attachment 2: Screenshot_from_2022-06-24_23-58-03.png

Attachment 3: Screenshot_from_2022-06-24_23-56-54.png

Attachment 4: Screenshot_from_2022-06-24_23-56-18.png

Attachment 5: Screenshot_from_2022-06-24_23-55-53.png

Attachment 6: Screenshot_from_2022-06-24_23-55-15.png

Attachment 7: Screenshot_from_2022-06-24_23-54-37.png

Attachment 8: Screenshot_from_2022-06-24_23-53-22.png

Attachment 9: Screenshot_from_2022-06-24_23-51-35.png

Attachment 10: Screenshot_from_2022-06-24_23-50-18.png

Attachment 11: Screenshot_from_2022-06-24_23-49-08.png

Attachment 12: Screenshot_from_2022-06-24_23-48-14.png

Attachment 13: Screenshot_from_2022-06-24_23-47-40.png

Attachment 14: Screenshot_from_2022-06-24_23-46-10.png

Attachment 15: Screenshot_from_2022-06-24_23-44-08.png

Attachment 16: Screenshot_from_2022-06-25_00-17-58.png

Attachment 17: Screenshot_from_2022-06-25_00-17-36.png

Attachment 18: R5_189
* TDR format 3.3.0 analyser - TD - May 2021 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 260527466 ( 871545.5 Hz) Other data format: 1392534 ( 4658.5 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 1393 ( 4.7 Hz) RESUME: 1393 ( 4.7 Hz) SYNC100: 33113 ( 110.8 Hz) WR48-63: 33113 ( 110.8 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 1323522 ( 4427.6 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 429409 ( 1436.5 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 298.926 s FEE elapsed dead time(s) elapsed idle time(s) 0 14.659 0.000 1 49.890 0.000 2 0.405 2.804 3 7.856 0.000 4 0.000 45.637 5 0.052 0.000 6 0.331 0.000 7 0.206 0.000 8 0.000 0.000 9 0.000 0.000 10 0.000 0.000 11 0.000 0.000 12 0.000 0.000 13 0.000 0.000 14 0.000 0.000 15 0.000 0.000 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 33437852 29241 0 0 298 298 4430 4430 0 19785 0 105011 1 60873066 16872 0 0 713 713 7723 7723 0 0 0 63589 2 19991278 336066 0 0 51 51 2502 2502 0 330960 0 70003 3 42622163 327782 0 0 194 194 5471 5471 0 316452 0 35634 4 5450705 1394 0 0 0 0 697 697 0 0 0 34276 5 18430449 4608 0 0 17 17 2287 2287 0 0 0 41850 6 41735438 335959 0 0 67 67 5311 5311 0 325203 0 60533 7 37986515 340612 0 0 53 53 4692 4692 0 331122 0 18513 8 0 0 0 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time: 35.010s ( 914.031 blocks/s, 57.127 Mb/s)
Attachment 19: Screenshot_from_2022-06-25_03-05-56.png

Attachment 20: Screenshot_from_2022-06-25_03-05-35.png

Attachment 21: Screenshot_from_2022-06-25_03-04-59.png

Attachment 22: Screenshot_from_2022-06-25_03-04-24.png

Attachment 23: Screenshot_from_2022-06-25_03-03-54.png

Attachment 24: Screenshot_from_2022-06-25_03-31-28.png

Attachment 25: Screenshot_from_2022-06-25_03-30-31.png

Attachment 26: R5_221
* TDR format 3.3.0 analyser - TD - May 2021 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 261819129 ( 557711.5 Hz) Other data format: 100871 ( 214.9 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 371 ( 0.8 Hz) RESUME: 371 ( 0.8 Hz) SYNC100: 33749 ( 71.9 Hz) WR48-63: 33749 ( 71.9 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 32631 ( 69.5 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 2 ( 0.0 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 469.453 s FEE elapsed dead time(s) elapsed idle time(s) 0 0.000 0.000 1 0.835 0.000 2 0.000 15.780 3 0.000 0.000 4 0.000 132.034 5 0.000 0.000 6 0.000 0.000 7 0.000 0.000 8 0.000 0.000 9 0.000 0.000 10 0.000 0.000 11 0.000 0.000 12 0.000 0.000 13 0.000 0.000 14 0.000 0.000 15 0.000 0.000 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 18255571 37491 0 0 0 0 2430 2430 0 32631 0 1 1 67878845 18770 0 0 371 371 9014 9014 0 0 0 0 2 8103831 2048 0 0 0 0 1024 1024 0 0 0 1 3 41453255 10648 0 0 0 0 5324 5324 0 0 0 0 4 3384177 880 0 0 0 0 440 440 0 0 0 0 5 15593071 3880 0 0 0 0 1940 1940 0 0 0 0 6 55917021 14018 0 0 0 0 7009 7009 0 0 0 0 7 51233358 13136 0 0 0 0 6568 6568 0 0 0 0 8 0 0 0 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time: 34.299s ( 932.977 blocks/s, 58.311 Mb/s)
Attachment 27: Screenshot_from_2022-06-25_06-11-13.png

Attachment 28: Screenshot_from_2022-06-25_06-10-50.png

Attachment 29: Screenshot_from_2022-06-25_06-10-11.png

Attachment 30: Screenshot_from_2022-06-25_06-09-40.png

Attachment 31: Screenshot_from_2022-06-25_06-09-06.png

	497	Fri Jun 24 15:04:06 2022	Marc	Friday 24th June - evening shift
16:05 - Last checked was at 15:30. (see previous entry. All running smoothly. Next wide check will be in about an hour. 17:00 Stats -ok - attachment 1 Temperatures ok - attachement 2 Leakage current ok but - attachment 3 ucesb screen-shot - attachment 4 Wide check completed. Nothing different. WR status decoder status: Base Current Difference aida07 fault 0xc53d : 0xc547 : 10 aida08 fault 0xf1be : 0xf1e9 : 43 White Rabbit error counter test result: Passed 6, Failed 2 Understand the status reports as follows:- Status bit 3 : White Rabbit decoder detected an error in the received data Status bit 2 : Firmware registered WR error, no reload of Timestamp Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR FPGA timestamp:: Base Current Difference aida07 fault 0x2a : 0x2c : 2 FPGA Timestamp error counter test result: Passed 7, Failed 1 If any of these counts are reported as in error The ASIC readout system has detected a timeslip. That is the timestamp read from the time FIFO is not younger than the last Note that the leakage current is ok but has increased since yesterday , See graphana - attachement 5 - Prossibly due to higher beam intensity. 19:20 - Stats ok - attachment 6 Temp ok - attachment 7 Leakage current ok - attachement 8 Wide check completed and same output as above. 22:00 Stats ok - attachment 9 Temp ok - attachment 10 Leakage current ok - attachement 11 Wide check completed and same output as above.
Attachment 1: Stats-Screenshot_from_2022-06-24_16-53-47.png

Attachment 2: Temp-Screenshot_from_2022-06-24_16-52-58.png

Attachment 3: HV_LC-Screenshot_from_2022-06-24_16-51-39.png

Attachment 4: ucesb-Screenshot_from_2022-06-24_16-57-32.png

Attachment 5: GraphanaAIDA-Screenshot_from_2022-06-24_17-48-41.png

Attachment 6: Stats-Screenshot_from_2022-06-24_19-21-32.png

Attachment 7: Temp-Screenshot_from_2022-06-24_19-20-48.png

Attachment 8: HV-LC-Screenshot_from_2022-06-24_19-19-43.png

Attachment 9: Stats-Screenshot_from_2022-06-24_22-01-09.png

Attachment 10: Temp-Screenshot_from_2022-06-24_22-01-50.png

Attachment 11: HV_LC-Screenshot_from_2022-06-24_21-58-33.png

	496	Fri Jun 24 06:56:06 2022	OH	Friday 24 June 008:00-16:00
07:56 Took over from AM. No issues reported overnight Stats ok - attachment 1 Temperature ok - attachment 2 Bias and leakage current ok - attachment 3 System wide checks: Clocks ok WR Base Current Difference aida07 fault 0xc4fe : 0xc53b : 61 aida08 fault 0xf0e9 : 0xf1b7 : 206 White Rabbit error counter test result: Passed 6, Failed 2 FPGA Errors Base Current Difference aida07 fault 0x11 : 0x29 : 24 aida08 fault 0x1a : 0x2c : 18 FPGA Timestamp error counter test result: Passed 6, Failed 2 Analysis of R3_359 - attachment 4 Dead time still around 15.9% Merger item rate around 2E6-4E6 Tape server rate at 7750 kB/s Current HDD free space 1.7 TB Time left in HDD 2.59 days Will run out of space at some point on Sunday Have started compression of uncompressed raw data on the HDD. Using nice +10 08:45 AIDA07 dropped out from the merger at some point in the preceeding 5-10 minutes. - attachment 5 Am regularly checking the statistics Was able to stop the DAQ by relaunching the merger. Reset the FEEs and recovered without a powercylce Started R4 following this stop 08:58 They have taken the beam to change the ion source for maybe 2 hours Will stop writing data but continue forwarding to MBS No storage ticked. Following break will be on R5 11:10 Beam is starting to come back R5 started Stats ok - attachment 6 Temps ok - attachment 7 Bias and leakage currents ok - attachment 8 13:05 Statistics ok - attachment 9 Temps ok - attachment 10 Bias and leakage curents ok - attachment 11 System wide checks: WR Base Current Difference aida07 fault 0xc53d : 0xc540 : 3 aida08 fault 0xf1be : 0xf1d0 : 18 White Rabbit error counter test result: Passed 6, Failed 2 FPGA Base Current Difference aida07 fault 0x2a : 0x2b : 1 FPGA Timestamp error counter test result: Passed 7, Failed 1 Analysis of R5_33 - attachment 12 15:28 Statistics ok - attachment 13 Temperature ok - attachment 14 Bias and leakage current ok - attachment 15 System wide checks: Base Current Difference aida07 fault 0xc53d : 0xc546 : 9 aida08 fault 0xf1be : 0xf1e0 : 34 White Rabbit error counter test result: Passed 6, Failed 2 Base Current Difference aida07 fault 0x2a : 0x2b : 1 FPGA Timestamp error counter test result: Passed 7, Failed 1 Analysis of R5_63 - attachment 16
Attachment 1: 220624_0753_stats.png

Attachment 2: 220624_0754_Temp.png

Attachment 3: 220624_0755_Bias.png

Attachment 4: R3_359_analysis.txt
* TDR format 3.3.0 analyser - TD - May 2021 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 260715255 ( 897318.9 Hz) Other data format: 1204745 ( 4146.4 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 1323 ( 4.6 Hz) RESUME: 1323 ( 4.6 Hz) SYNC100: 33082 ( 113.9 Hz) WR48-63: 33082 ( 113.9 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 1135935 ( 3909.6 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 353220 ( 1215.7 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 290.549 s FEE elapsed dead time(s) elapsed idle time(s) 0 10.171 0.000 1 46.409 0.000 2 1.006 0.000 3 4.601 0.000 4 0.000 37.574 5 0.031 0.000 6 0.191 0.000 7 0.254 0.000 8 0.000 0.000 9 0.000 0.000 10 0.000 0.000 11 0.000 0.000 12 0.000 0.000 13 0.000 0.000 14 0.000 0.000 15 0.000 0.000 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 30903987 28078 0 0 236 236 4023 4023 0 19560 0 86851 1 61208192 17252 0 0 718 718 7908 7908 0 0 0 52897 2 26785987 291397 0 0 72 72 3425 3425 0 284403 0 56573 3 43119726 289440 0 0 153 153 5319 5319 0 278496 0 29859 4 4604412 1194 0 0 0 0 597 597 0 0 0 28791 5 18336996 4656 0 0 16 16 2312 2312 0 0 0 34152 6 36059875 277258 0 0 42 42 4514 4514 0 268146 0 48935 7 39696080 295470 0 0 86 86 4984 4984 0 285330 0 15162 8 0 0 0 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time: 34.877s ( 917.511 blocks/s, 57.344 Mb/s)
Attachment 5: 220624_0842_Stats_Stop.png

Attachment 6: 220624_1111_Stats.png

Attachment 7: 220624_1111_Temp.png

Attachment 8: 220624_1112_Bias.png

Attachment 9: 220624_1303_stats.png

Attachment 10: 220624_1303_Temp.png

Attachment 11: 220624_1304_Bias.png

Attachment 12: R5_33_analysis.txt
* TDR format 3.3.0 analyser - TD - May 2021 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 260717099 ( 869523.1 Hz) Other data format: 1202901 ( 4011.8 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 1344 ( 4.5 Hz) RESUME: 1344 ( 4.5 Hz) SYNC100: 33117 ( 110.4 Hz) WR48-63: 33117 ( 110.4 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 1133979 ( 3782.0 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 354749 ( 1183.1 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 299.839 s FEE elapsed dead time(s) elapsed idle time(s) 0 11.504 0.000 1 42.102 0.000 2 0.275 0.000 3 6.677 0.000 4 0.000 31.976 5 0.051 0.000 6 0.250 0.000 7 0.412 0.000 8 0.000 0.000 9 0.000 0.000 10 0.000 0.000 11 0.000 0.000 12 0.000 0.000 13 0.000 0.000 14 0.000 0.000 15 0.000 0.000 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 31758241 28867 0 0 238 238 4156 4156 0 20079 0 87480 1 58453105 16104 0 0 635 635 7417 7417 0 0 0 53128 2 20104679 289945 0 0 41 41 2565 2565 0 284733 0 56849 3 41709424 287290 0 0 188 188 5262 5262 0 276390 0 29572 4 5133297 1264 0 0 0 0 632 632 0 0 0 29278 5 17857346 4470 0 0 22 22 2213 2213 0 0 0 34539 6 40732502 278221 0 0 59 59 5175 5175 0 267753 0 48740 7 44968505 296740 0 0 161 161 5697 5697 0 285024 0 15163 8 0 0 0 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time: 34.742s ( 921.070 blocks/s, 57.567 Mb/s)
Attachment 13: 220624_1538_Stats.png

Attachment 14: 220624_1538_Temp.png

Attachment 15: 220624_1538_Bias.png

Attachment 16: R5_63_analysis.txt
* TDR format 3.3.0 analyser - TD - May 2021 * ERROR: READ I/O error: 5002 blocks: 32000 ADC data format: 260796374 ( 834020.0 Hz) Other data format: 1123626 ( 3593.3 Hz) Sample trace data format: 0 ( 0.0 Hz) Undefined format: 0 ( 0.0 Hz) Other data format type: PAUSE: 1191 ( 3.8 Hz) RESUME: 1191 ( 3.8 Hz) SYNC100: 33165 ( 106.1 Hz) WR48-63: 33165 ( 106.1 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 1054914 ( 3373.6 Hz) Other info: 0 ( 0.0 Hz) ADC data range bit set: 350507 ( 1120.9 Hz) Timewarps: ADC: 0 ( 0.0 Hz) PAUSE: 0 ( 0.0 Hz) RESUME: 0 ( 0.0 Hz) SYNC100: 0 ( 0.0 Hz) WR48-63: 0 ( 0.0 Hz) FEE64 disc: 0 ( 0.0 Hz) MBS info: 0 ( 0.0 Hz) Undefined: 0 ( 0.0 Hz) Sample trace: 0 ( 0.0 Hz) * Timestamp elapsed time: 312.698 s FEE elapsed dead time(s) elapsed idle time(s) 0 7.889 0.000 1 39.498 0.000 2 0.306 0.000 3 5.270 0.000 4 0.000 26.707 5 0.036 0.000 6 0.217 0.000 7 0.175 0.000 8 0.000 0.000 9 0.000 0.000 10 0.000 0.000 11 0.000 0.000 12 0.000 0.000 13 0.000 0.000 14 0.000 0.000 15 0.000 0.000 16 0.000 0.000 17 0.000 0.000 18 0.000 0.000 19 0.000 0.000 20 0.000 0.000 21 0.000 0.000 22 0.000 0.000 23 0.000 0.000 24 0.000 0.000 25 0.000 0.000 26 0.000 0.000 27 0.000 0.000 28 0.000 0.000 29 0.000 0.000 30 0.000 0.000 31 0.000 0.000 32 0.000 0.000 * Statistics FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data 0 30903831 29785 0 0 188 188 4074 4074 0 21261 0 87155 1 61666403 16932 0 0 646 646 7820 7820 0 0 0 55280 2 20140383 267008 0 0 42 42 2575 2575 0 261774 0 55290 3 41652352 266495 0 0 164 164 5306 5306 0 255555 0 28879 4 4871487 1204 0 0 0 0 602 602 0 0 0 28340 5 17605547 4430 0 0 11 11 2204 2204 0 0 0 33538 6 41056242 264471 0 0 55 55 5126 5126 0 254109 0 47278 7 42900129 273301 0 0 85 85 5458 5458 0 262215 0 14747 8 0 0 0 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 0 0 0 * Timewarps FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 0 0 0 0 0 0 0 0 0 3 0 0 0 0 0 0 0 0 0 4 0 0 0 0 0 0 0 0 0 5 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0 0 0 7 0 0 0 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 0 9 0 0 0 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 11 0 0 0 0 0 0 0 0 0 12 0 0 0 0 0 0 0 0 0 13 0 0 0 0 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 15 0 0 0 0 0 0 0 0 0 16 0 0 0 0 0 0 0 0 0 17 0 0 0 0 0 0 0 0 0 18 0 0 0 0 0 0 0 0 0 19 0 0 0 0 0 0 0 0 0 20 0 0 0 0 0 0 0 0 0 21 0 0 0 0 0 0 0 0 0 22 0 0 0 0 0 0 0 0 0 23 0 0 0 0 0 0 0 0 0 24 0 0 0 0 0 0 0 0 0 25 0 0 0 0 0 0 0 0 0 26 0 0 0 0 0 0 0 0 0 27 0 0 0 0 0 0 0 0 0 28 0 0 0 0 0 0 0 0 0 29 0 0 0 0 0 0 0 0 0 30 0 0 0 0 0 0 0 0 0 31 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0 0 0 * Program elapsed time: 41.305s ( 774.730 blocks/s, 48.421 Mb/s)
	495	Fri Jun 24 00:34:55 2022	AM	Friday 24 June 00:00-08:00
01:30 Attachments 1-5, white rabbit and fpga timestamp failures, otherwise all good 03:30 Attachments 11-15, white rabbit and fpga timestamp failures, otherwise all good 05:30 Attachments 6-10, white rabbit and fpga timestamp failures, otherwise all good 07:30 Attachments 16-20, white rabbit and fpga timestamp failures, otherwise all good
Attachment 1: 220624_0130_fpgatime.png

Attachment 2: 220624_0130_whiterabbit.png

Attachment 3: 220624_0130_temps.png

Attachment 4: 220624_0130_stats.png

Attachment 5: 220624_0130_bias.png

Attachment 6: 220624_0530_fpgatime.png

Attachment 7: 220624_0530_whiterabbit.png

Attachment 8: 220624_0530_temps.png

Attachment 9: 220624_0530_stats.png

Attachment 10: 220624_0530_bias.png

Attachment 11: 220624_0330_fpgatime.png

Attachment 12: 220624_0330_whiterabbit.png

Attachment 13: 220624_0330_temps.png

Attachment 14: 220624_0330_stats.png

Attachment 15: 220624_0330_bias.png

Attachment 16: 220624_0730_fpga.png

Attachment 17: 220624_0730_whiterabbit.png

Attachment 18: 220624_0730_temps.png

Attachment 19: 220624_0730_stats.png

Attachment 20: 220624_0730_bias.png

Goto page Previous 1, 2, 3 ... 10, 11, 12 ... 34, 35, 36 Next

ELOG V3.1.4-unknown