AIDA GELINA BRIKEN nToF CRIB ISOLDE CIRCE nTOFCapture DESPEC DTAS EDI_PSA 179Ta CARME StellarModelling DCF K40
  DESPEC, Page 10 of 36  ELOG logo
ID Date Author Subjectdown
  643   Sat Jun 8 23:00:52 2024 TDSunday 9 June
23.58 8.6.24

      DSSSD bias & leakage current OK - attachments 1

      FEE64 temperatures OK - attachment 2

      ADC data item stats - attachment 3

      per FEE64 Rate spectra - attachment 4

03.43 slow comparator 0x64

      DSSSD bias & leakage current OK - attachments 5

      FEE64 temperatures OK - attachment 6

      ADC data item stats - attachment 7

      per FEE64 1.8.H spectra - attachments 8-9

      per FEE64 Rate spectra - attachment 10


09.11 DSSSD bias & leakage current OK - attachments 11

      FEE64 temperatures OK - attachment 12

      ADC data item stats - attachment 13

      per FEE64 Rate spectra - attachment 14


15.05 online spectra
      per DSSSD HEC E_p versus E_n and x versus y
      observe flat field of c. 500MeV at per spull rate c. 5Hz - fission fragments?
Attachment 1: Screenshot_from_2024-06-08_23-58-55.png
Screenshot_from_2024-06-08_23-58-55.png
Attachment 2: Screenshot_from_2024-06-08_23-59-16.png
Screenshot_from_2024-06-08_23-59-16.png
Attachment 3: Screenshot_from_2024-06-09_00-00-02.png
Screenshot_from_2024-06-09_00-00-02.png
Attachment 4: Screenshot_from_2024-06-09_00-00-32.png
Screenshot_from_2024-06-09_00-00-32.png
Attachment 5: Screenshot_from_2024-06-09_03-43-32.png
Screenshot_from_2024-06-09_03-43-32.png
Attachment 6: Screenshot_from_2024-06-09_03-44-19.png
Screenshot_from_2024-06-09_03-44-19.png
Attachment 7: Screenshot_from_2024-06-09_03-46-03.png
Screenshot_from_2024-06-09_03-46-03.png
Attachment 8: Screenshot_from_2024-06-09_03-46-37.png
Screenshot_from_2024-06-09_03-46-37.png
Attachment 9: Screenshot_from_2024-06-09_03-47-40.png
Screenshot_from_2024-06-09_03-47-40.png
Attachment 10: Screenshot_from_2024-06-09_03-49-06.png
Screenshot_from_2024-06-09_03-49-06.png
Attachment 11: Screenshot_from_2024-06-09_11-15-26.png
Screenshot_from_2024-06-09_11-15-26.png
Attachment 12: Screenshot_from_2024-06-09_11-27-22.png
Screenshot_from_2024-06-09_11-27-22.png
Attachment 13: Screenshot_from_2024-06-09_11-27-52.png
Screenshot_from_2024-06-09_11-27-52.png
Attachment 14: Screenshot_from_2024-06-09_11-28-19.png
Screenshot_from_2024-06-09_11-28-19.png
Attachment 15: Capture_2.PNG
Capture_2.PNG
Attachment 16: Capture.PNG
Capture.PNG
  424   Sun May 8 15:10:45 2022 TDSunday 8 May
DSSSD bias and FEE64 power OFF during Ge install



Photographs of AIDA (triple) + DEGAS setup as of Sunday pm.

Attachments 1-4 side/front/oblique views - note AIDA snout droops and twists

Attachments 5 & 6 - position of the AIDA stand vertical adjustment threads (brass) 

The asymmetry upstream-downstream pre-dates this setup. To lift the end of the snout clear of the of lower DEGAS detectors all 3x 1/4 turns clockwise (viewed from above) were applied to each of the four threads.
Attachment 1: 20220508_160103.jpg
20220508_160103.jpg
Attachment 2: 20220508_160115.jpg
20220508_160115.jpg
Attachment 3: 20220508_160128.jpg
20220508_160128.jpg
Attachment 4: 20220508_160140.jpg
20220508_160140.jpg
Attachment 5: 20220508_160720.jpg
20220508_160720.jpg
Attachment 6: 20220508_160804.jpg
20220508_160804.jpg
  176   Sat Mar 6 23:37:22 2021 TDSunday 7 March 00.00-08:00
00.30 UNILAC problem - no beam

00:39 DAQ continues R1_518
      FRS 190W setting 

      ASIC settinfs 2019Dec19-16.19.51
      DSSSD#1 slow comparator 0xa
      DSSSD#2 slow comparator 0xa
      DSSSD#3 slow comparator 0xa

      BNC PB-5 Pulser 
      Amplitude1.0V
      Attenuation x1
      Frequency 2Hz
      tau_d 1ms
      - polarity
      Delay 250ns, tail pulse

01:07 all system wide checks OK

      detector biases & leakage currents OK - see attachment 1
      FEE64 temperatures OK - see attachment 2
      good event statistics - OK - see attachment 3
      Merger OK - see attachment 4
      TapeServer OK - see attachment 5

01:20 zero'd all histograms
      ASIC check load

      rate spectra - see attachment 6

01:48 beam return

      run74 (R1_608)

03.05 all system wide checks OK

      detector biases & leakage currents OK - see attachment 7
      FEE64 temperatures OK - see attachment 8
      good event statistics - OK - see attachment 9
      Merger OK - see attachment 10
      TapeServer OK - see attachment 11

     rate spectra - see attachment 12

04.46 run74 ends (R1_841)

05.00 run75 (R1_859)

05:40 detector biases & leakage currents OK - see attachment 13
      FEE64 temperatures OK - see attachment 14
      good event statistics - OK - see attachment 15
      Merger OK - see attachment 16
      TapeServer OK - see attachment 17

     rate spectra - see attachment 18

07:29 run76 (R1_1055)
Attachment 1: 1.png
1.png
Attachment 2: Screenshot_2021-03-07_Temperature_and_status_scan_aidas-gsi(1).png
Screenshot_2021-03-07_Temperature_and_status_scan_aidas-gsi(1).png
Attachment 3: Screenshot_2021-03-07_Statistics_aidas-gsi.png
Screenshot_2021-03-07_Statistics_aidas-gsi.png
Attachment 4: Screenshot_2021-03-07_NewMerger_Control_aidas-gsi.png
Screenshot_2021-03-07_NewMerger_Control_aidas-gsi.png
Attachment 5: Screenshot_2021-03-07_Tape_Service_(Expert)_aidas-gsi(1).png
Screenshot_2021-03-07_Tape_Service_(Expert)_aidas-gsi(1).png
Attachment 6: Screenshot_2021-03-07_Spectrum_Browser_aidas-gsi(2).png
Screenshot_2021-03-07_Spectrum_Browser_aidas-gsi(2).png
Attachment 7: 2.png
2.png
Attachment 8: Screenshot_2021-03-07_Temperature_and_status_scan_aidas-gsi(2).png
Screenshot_2021-03-07_Temperature_and_status_scan_aidas-gsi(2).png
Attachment 9: Screenshot_2021-03-07_Statistics_aidas-gsi(1).png
Screenshot_2021-03-07_Statistics_aidas-gsi(1).png
Attachment 10: Screenshot_2021-03-07_NewMerger_Control_aidas-gsi(1).png
Screenshot_2021-03-07_NewMerger_Control_aidas-gsi(1).png
Attachment 11: Screenshot_2021-03-07_Tape_Service_(Expert)_aidas-gsi(2).png
Screenshot_2021-03-07_Tape_Service_(Expert)_aidas-gsi(2).png
Attachment 12: Screenshot_2021-03-07_Spectrum_Browser_aidas-gsi(3).png
Screenshot_2021-03-07_Spectrum_Browser_aidas-gsi(3).png
Attachment 13: 3.png
3.png
Attachment 14: Screenshot_2021-03-07_Temperature_and_status_scan_aidas-gsi(3).png
Screenshot_2021-03-07_Temperature_and_status_scan_aidas-gsi(3).png
Attachment 15: Screenshot_2021-03-07_Statistics_aidas-gsi(2).png
Screenshot_2021-03-07_Statistics_aidas-gsi(2).png
Attachment 16: Screenshot_2021-03-07_NewMerger_Control_aidas-gsi(2).png
Screenshot_2021-03-07_NewMerger_Control_aidas-gsi(2).png
Attachment 17: Screenshot_2021-03-07_Tape_Service_(Expert)_aidas-gsi(3).png
Screenshot_2021-03-07_Tape_Service_(Expert)_aidas-gsi(3).png
Attachment 18: Screenshot_2021-03-07_Spectrum_Browser_aidas-gsi(4).png
Screenshot_2021-03-07_Spectrum_Browser_aidas-gsi(4).png
  563   Sun Apr 7 18:13:56 2024 TDSunday 7 April contd.
19.10 CAEN N1419ET LK fitted
      power cycle

attachments 1-6
Attachment 1: Screenshot_from_2024-04-07_19-13-19.png
Screenshot_from_2024-04-07_19-13-19.png
Attachment 2: Screenshot_from_2024-04-07_19-12-40.png
Screenshot_from_2024-04-07_19-12-40.png
Attachment 3: Screenshot_from_2024-04-07_19-11-24.png
Screenshot_from_2024-04-07_19-11-24.png
Attachment 4: Screenshot_from_2024-04-07_19-11-09.png
Screenshot_from_2024-04-07_19-11-09.png
Attachment 5: Screenshot_from_2024-04-07_19-10-45.png
Screenshot_from_2024-04-07_19-10-45.png
Attachment 6: Screenshot_from_2024-04-07_19-10-30.png
Screenshot_from_2024-04-07_19-10-30.png
  560   Sun Apr 7 12:02:23 2024 TDSunday 7 April
13.00 Cooling water temperature and flow OK - attachment 1

      Test of AIDA 2x MSL type BB18(DS)-1000 24cm x 8cm DSSSDs 'as is' ( to be defined later in this Elog )

      DSSSD bias & leakage current OK - attachment 2
      Ambient temp 24.7 deg C, d.p. 7.1 deg C, RH 32.4%
      Leakage current c. 6.6uA => 4nA/cm2/100um ( very good )

      FEE64 temps OK - attachment 3
      *except* aida02 ASIC temp which is known to be u/s

      All system wide checks OK *except* aida02 and aida04 WR decoder status - attachment 4

      WR timestamps OK - attachment 5

      WR (info code 4 & 5), correlation scaler, PAUSE, RESUME, DISC, ADC data item stats - attachments 6-12

      per FEE64 Rate spectra - attachments 13-15

      per 1.8.W spectra - 20us FSR - attachments 16-1710129


14.45 FEE64 config check - per https://elog.ph.ed.ac.uk/DESPEC/562


FEE64 # PSU cable #           MAC
1       1                     ?
2       2                     ?
3       3                     ?
4       4                     41 ee 71
5       5                     ?
6       6                     ?
7       7                     f6 5a
8       8                     41 d7 cd
9       ?                     ?
10      10                    41 d0 0e
11      11                    41 ee 0f
12      ?                     ?
13      13                    ?
14      ?                     0d 15
15      15                    ?
16      16                    f6 ed

? = no line of sight

- AIDA FEE64 PSU cabling - see attachment 18

Currently

PSU #1 1-3, 2-4, 9-5, 15-12
PSU #2 14-7, 6-8, 10-13, 11-16

Should be changed to

PSU #1 1-3, 2-4, 9-15, 5-12
PSU #2 14-7, 6-8, 10-11, 13-16


- AIDA snout mount to support frame - attachments 19 & 21
LHS ( looking downstream ) incorrect, RHS OK

- LKs
LK1 fitted aida02, aida04, aida06, aida08
LK3 fitted aida03, aida07, aida01, aida14


Significant gaps in snout ( i.e. possible light leaks ) where bPlas cabling exits snout - attachments 20 & 22

bPlas driver PCBs removed 
bPlas ribbon cables, drain wires and Lemo 00.250 cabling disconnected - some cabling/drain wires touching snout etc


15.15 Adjust bPlas ribbon cables/drain wires/Lemo cables to ensure that none are touching snout or AIDA support frame - significant improvement

      DSSSD bias & leakage current OK - attachment 23

      FEE64 temps OK - attachment 24

      ADC data item stats - attachments 25

      per FEE64 Rate spectra - attachments 26
       6x FEE64s < 20k. all FEE64s < 120k ( cf. 4x FEE64s < 20k, 5x FEE64s > 100k, 1x FEE64 320k earlier - attachment 12 )

      per 1.8.W spectra - 20us FSR - attachments 27-28

17.15

LHS top hat washers
LK1, LK3
PSU power cables
tighten gnd screws
attachments 29-34

Note that some of the newly installed FEE64s have the incorrect rails fitted - FEE64s may ground to AIDA support stand

17.55 CAEN N1419ET LK removed -> floating outputs

18.15 +LK1 restored
attachments 35-40

18.40 +pwwer cycle
attachments 41-46
Attachment 1: 20240407_125941.jpg
20240407_125941.jpg
Attachment 2: Screenshot_from_2024-04-07_13-20-57.png
Screenshot_from_2024-04-07_13-20-57.png
Attachment 3: Screenshot_from_2024-04-07_13-29-54.png
Screenshot_from_2024-04-07_13-29-54.png
Attachment 4: Screenshot_from_2024-04-07_13-32-14.png
Screenshot_from_2024-04-07_13-32-14.png
Attachment 5: Screenshot_from_2024-04-07_13-36-47.png
Screenshot_from_2024-04-07_13-36-47.png
Attachment 6: Screenshot_from_2024-04-07_13-42-52.png
Screenshot_from_2024-04-07_13-42-52.png
Attachment 7: Screenshot_from_2024-04-07_13-42-26.png
Screenshot_from_2024-04-07_13-42-26.png
Attachment 8: Screenshot_from_2024-04-07_13-42-04.png
Screenshot_from_2024-04-07_13-42-04.png
Attachment 9: Screenshot_from_2024-04-07_13-41-37.png
Screenshot_from_2024-04-07_13-41-37.png
Attachment 10: Screenshot_from_2024-04-07_13-41-25.png
Screenshot_from_2024-04-07_13-41-25.png
Attachment 11: Screenshot_from_2024-04-07_13-41-03.png
Screenshot_from_2024-04-07_13-41-03.png
Attachment 12: Screenshot_from_2024-04-07_13-40-35.png
Screenshot_from_2024-04-07_13-40-35.png
Attachment 13: Screenshot_from_2024-04-07_13-47-03.png
Screenshot_from_2024-04-07_13-47-03.png
Attachment 14: Screenshot_from_2024-04-07_13-46-47.png
Screenshot_from_2024-04-07_13-46-47.png
Attachment 15: Screenshot_from_2024-04-07_13-46-39.png
Screenshot_from_2024-04-07_13-46-39.png
Attachment 16: Screenshot_from_2024-04-07_13-53-21.png
Screenshot_from_2024-04-07_13-53-21.png
Attachment 17: Screenshot_from_2024-04-07_13-52-25.png
Screenshot_from_2024-04-07_13-52-25.png
Attachment 18: 20240407_143456.jpg
20240407_143456.jpg
Attachment 19: 20240407_143510.jpg
20240407_143510.jpg
Attachment 20: 20240407_143553.jpg
20240407_143553.jpg
Attachment 21: 20240407_143532.jpg
20240407_143532.jpg
Attachment 22: 20240407_143539.jpg
20240407_143539.jpg
Attachment 23: Screenshot_from_2024-04-07_15-10-39.png
Screenshot_from_2024-04-07_15-10-39.png
Attachment 24: Screenshot_from_2024-04-07_15-10-53.png
Screenshot_from_2024-04-07_15-10-53.png
Attachment 25: Screenshot_from_2024-04-07_15-13-00.png
Screenshot_from_2024-04-07_15-13-00.png
Attachment 26: Screenshot_from_2024-04-07_15-12-49.png
Screenshot_from_2024-04-07_15-12-49.png
Attachment 27: Screenshot_from_2024-04-07_15-11-54.png
Screenshot_from_2024-04-07_15-11-54.png
Attachment 28: Screenshot_from_2024-04-07_15-11-06.png
Screenshot_from_2024-04-07_15-11-06.png
Attachment 29: Screenshot_from_2024-04-07_17-14-23.png
Screenshot_from_2024-04-07_17-14-23.png
Attachment 30: Screenshot_from_2024-04-07_17-13-49.png
Screenshot_from_2024-04-07_17-13-49.png
Attachment 31: Screenshot_from_2024-04-07_17-11-59.png
Screenshot_from_2024-04-07_17-11-59.png
Attachment 32: Screenshot_from_2024-04-07_17-11-47.png
Screenshot_from_2024-04-07_17-11-47.png
Attachment 33: Screenshot_from_2024-04-07_17-11-38.png
Screenshot_from_2024-04-07_17-11-38.png
Attachment 34: Screenshot_from_2024-04-07_17-11-19.png
Screenshot_from_2024-04-07_17-11-19.png
Attachment 35: Screenshot_from_2024-04-07_18-12-38.png
Screenshot_from_2024-04-07_18-12-38.png
Attachment 36: Screenshot_from_2024-04-07_18-12-53.png
Screenshot_from_2024-04-07_18-12-53.png
Attachment 37: Screenshot_from_2024-04-07_18-13-03.png
Screenshot_from_2024-04-07_18-13-03.png
Attachment 38: Screenshot_from_2024-04-07_18-14-51.png
Screenshot_from_2024-04-07_18-14-51.png
Attachment 39: Screenshot_from_2024-04-07_18-14-12.png
Screenshot_from_2024-04-07_18-14-12.png
Attachment 40: Screenshot_from_2024-04-07_18-13-10.png
Screenshot_from_2024-04-07_18-13-10.png
Attachment 41: Screenshot_from_2024-04-07_18-44-32.png
Screenshot_from_2024-04-07_18-44-32.png
Attachment 42: Screenshot_from_2024-04-07_18-44-08.png
Screenshot_from_2024-04-07_18-44-08.png
Attachment 43: Screenshot_from_2024-04-07_18-43-30.png
Screenshot_from_2024-04-07_18-43-30.png
Attachment 44: Screenshot_from_2024-04-07_18-43-21.png
Screenshot_from_2024-04-07_18-43-21.png
Attachment 45: Screenshot_from_2024-04-07_18-43-12.png
Screenshot_from_2024-04-07_18-43-12.png
Attachment 46: Screenshot_from_2024-04-07_18-42-56.png
Screenshot_from_2024-04-07_18-42-56.png
  358   Sun Jun 6 14:15:05 2021 TDSunday 6 June
14.15 DAQ continues file S496/R32_117
      Hot HEC channels multiple FEE64s from c. 06.00 this morning
      ASIC check fixes

      System wide checks OK *except*

	 Base 		Current 	Difference
aida01 fault 	 0x8944 : 	 0x8946 : 	 2  
aida02 fault 	 0x9b36 : 	 0x9b38 : 	 2  
aida03 fault 	 0xf26b : 	 0xf26d : 	 2  
aida04 fault 	 0x57a0 : 	 0x57a2 : 	 2  
aida05 fault 	 0x4d3c : 	 0x4d3d : 	 1  
aida05 : WR status 0x10
 aida06 fault 	 0x640c : 	 0x640d : 	 1  
aida07 fault 	 0x255e : 	 0x255f : 	 1  
aida08 fault 	 0xffbd : 	 0xffbe : 	 1  
White Rabbit error counter test result: Passed 8, Failed 8

Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR

	
Returned 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0  
Mem(KB) :	4	8	16	32	64	128	256	512	1k	2k	4k
aida01 :     15     12     12      3      3      4      2      2      1      4      7   : 40572
aida02 :      7      8     10      5      2      3      3      2      1      4      7   : 40604
aida03 :     27     10      4      8      1      4      1      3      2      3      7   : 39740
aida04 :     18      7      4      5      1      3      2      3      2      3      7   : 39712
aida05 :     15     13      8      4      1      3      1      3      1      4      7   : 40548
aida06 :     14      8      8      6      3      2      1      3      1      4      7   : 40568
aida07 :     11      4      5      6      2      3      3      2      1      4      7   : 40540
aida08 :     15      6      5      3      4      3      3      2      1      4      7   : 40604
aida09 :     18      4      4      3      3      2      2      3      1      4      7   : 40648
aida10 :     12      6      8      6      1      1      1      3      1      4      7   : 40288
aida11 :     16      8      6      6      4      4      3      3      2      3      7   : 40352
aida12 :     10      7      4      8      3      4      3      3      2      3      7   : 40288
aida13 :     15      7      5      4      5      4      3      3      2      3      7   : 40324
aida14 :      9      4      6      7      3      4      3      3      2      3      7   : 40260
aida15 :     12      4      8      3      2      2      2      4      1      4      7   : 41136
aida16 :     11      8      6      6      3      4      3      3      2      3      7   : 40268

	
 Collecting the file size of each FEE64 Options CONTENTS file to check they are all the same

 FEE : aida01 =>   Options file size is 1026 	 Last changed Fri Jun 04 09:30:42 CEST 2021
 FEE : aida02 =>   Options file size is 1025 	 Last changed Sun May 23 00:19:21 CEST 2021
 FEE : aida03 =>   Options file size is 1014 	 Last changed Thu Apr 29 14:43:50 CEST 2021
 FEE : aida04 =>   Options file size is 1025 	 Last changed Fri May 14 16:54:56 CEST 2021
 FEE : aida05 =>   Options file size is 1025 	 Last changed Mon May 17 06:25:41 CEST 2021
 FEE : aida06 =>   Options file size is 1014 	 Last changed Thu Apr 29 14:43:59 CEST 2021
 FEE : aida07 =>   Options file size is 1014 	 Last changed Thu Apr 29 14:44:02 CEST 2021
 FEE : aida08 =>   Options file size is 1025 	 Last changed Sun May 23 00:16:54 CEST 2021
 FEE : aida09 =>   Options file size is 1014 	 Last changed Thu Apr 29 14:44:08 CEST 2021
 FEE : aida10 =>   Options file size is 1014 	 Last changed Thu Apr 29 14:44:57 CEST 2021
 FEE : aida11 =>   Options file size is 1014 	 Last changed Thu Apr 29 14:44:57 CEST 2021
 FEE : aida12 =>   Options file size is 1014 	 Last changed Thu Apr 29 14:44:57 CEST 2021
 FEE : aida13 =>   Options file size is 1025 	 Last changed Fri May 07 19:40:34 CEST 2021
 FEE : aida14 =>   Options file size is 1014 	 Last changed Thu Apr 29 14:44:57 CEST 2021
 FEE : aida15 =>   Options file size is 1014 	 Last changed Thu Apr 29 14:44:57 CEST 2021
 FEE : aida16 =>   Options file size is 1014 	 Last changed Thu Apr 29 14:44:57 CEST 2021

      Grafana - DSSSD bias & leakage current - most recent 7 days - attachment 1
      Lost activity monitor - attachment 2
      1.8.W spectra - 20us FSR - attachments 3 & 4
      ADC data items - attachment 5
      FEE64 temperatures OK - attachment 6
      DSSSD bias & leakage currents OK - attachment 7
      Merger/Tape Server/Merger statistics - attachment 8
       no merger errors reported since previous restart

16.28 analysis of file S496/R32_118 - attachment 9
       max deadtime 0.28% aida04
Attachment 1: Screenshot_2021-06-06_AIDA_Alerting_-_Grafana.png
Screenshot_2021-06-06_AIDA_Alerting_-_Grafana.png
Attachment 2: Screenshot_2021-06-06_Lost_activity_monitor_aidas-gsi.png
Screenshot_2021-06-06_Lost_activity_monitor_aidas-gsi.png
Attachment 3: Screenshot_2021-06-06_Spectrum_Browser_aidas-gsi(1).png
Screenshot_2021-06-06_Spectrum_Browser_aidas-gsi(1).png
Attachment 4: Screenshot_2021-06-06_Spectrum_Browser_aidas-gsi.png
Screenshot_2021-06-06_Spectrum_Browser_aidas-gsi.png
Attachment 5: Screenshot_2021-06-06_Statistics_aidas-gsi.png
Screenshot_2021-06-06_Statistics_aidas-gsi.png
Attachment 6: Screenshot_2021-06-06_Temperature_and_status_scan_aidas-gsi.png
Screenshot_2021-06-06_Temperature_and_status_scan_aidas-gsi.png
Attachment 7: 984.png
984.png
Attachment 8: 985.png
985.png
Attachment 9: R32_118
 *** TDR format 3.3.0 analyser - TD - May 2021
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:   48860593 (   17844.1 Hz)
        Other data format:  213059412 (   77810.4 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:        101 (       0.0 Hz)
                               RESUME:        101 (       0.0 Hz)
                              SYNC100:      42200 (      15.4 Hz)
                              WR48-63:      42200 (      15.4 Hz)
                           FEE64 disc:    1112345 (     406.2 Hz)
                             MBS info:  211862465 (   77373.2 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:          0 (       0.0 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                              WR48-63:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:     2738.188 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  0                0.000                0.000
  1                0.000             2613.952
  2                0.575                0.000
  3                7.745                0.000
  4                0.000                0.000
  5                0.000             2154.815
  6                0.000                0.000
  7                0.000             1921.162
  8                0.000              777.447
  9                0.000                0.000
 10                0.000                0.000
 11                0.000                0.000
 12                0.000                0.000
 13                0.000                0.000
 14                0.000                0.000
 15                0.000                0.000
 16                0.000                0.000
 17                0.000                0.000
 18                0.000                0.000
 19                0.000                0.000
 20                0.000                0.000
 21                0.000                0.000
 22                0.000                0.000
 23                0.000                0.000
 24                0.000                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100    WR48-63       Disc        MBS      Other   HEC Data
  0        155          0          0          0          0          0          0          0          0          0          0          0
  1      66625         28          0          0          0          0         14         14          0          0          0          0
  2        415  106108157          0          0         26         26      18899      18899          0  106070307          0          0
  3   39298810  106947309          0          0         75         75      21328      21328    1112345  105792158          0          0
  4        171          0          0          0          0          0          0          0          0          0          0          0
  5    4255149       1684          0          0          0          0        842        842          0          0          0          0
  6        596          0          0          0          0          0          0          0          0          0          0          0
  7    5234928       2226          0          0          0          0       1113       1113          0          0          0          0
  8        493          4          0          0          0          0          2          2          0          0          0          0
  9         92          0          0          0          0          0          0          0          0          0          0          0
 10       1212          2          0          0          0          0          1          1          0          0          0          0
 11        160          0          0          0          0          0          0          0          0          0          0          0
 12        781          0          0          0          0          0          0          0          0          0          0          0
 13         89          0          0          0          0          0          0          0          0          0          0          0
 14        724          2          0          0          0          0          1          1          0          0          0          0
 15        193          0          0          0          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100    WR48-63       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0

 *** Program elapsed time:   28.738s ( 1113.497 blocks/s,  69.594 Mb/s)
  628   Sun May 5 10:22:24 2024 TDSunday 5 May
11.22 DSSSD#1 bias -120V leakage current -17.1uA
      DSSSD#2 bias -120V leakage current -10.6uA
      S4 temperature 25 deg C

      cf. 07.00 29.4.24 S4 temperature 25 deg C

      DSSSD#1 -21.8uA
      DSSSD#2 -12.8uA

      Leakage currents currently c. 80% of 29.4.24 values at same temperature 
Attachment 1: Capture.PNG
Capture.PNG
  352   Sun May 30 08:57:53 2021 TDSunday 30 May
09.55 DAQ continues - file S496/R18_588
      alpha background

      increased data rate due to hot HEC channels since c. 06.00 this am - ASIC check fixes problem

      All system wide checks OK *except*

		 Base 		Current 	Difference
aida01 fault 	 0x82b0 : 	 0x82b7 : 	 7  
aida02 fault 	 0xfe72 : 	 0xfe79 : 	 7  
aida03 fault 	 0x97f4 : 	 0x97fb : 	 7  
aida04 fault 	 0x950 : 	 0x957 : 	 7  
aida05 fault 	 0x8e93 : 	 0x8e98 : 	 5  
aida06 fault 	 0x545a : 	 0x545f : 	 5  
aida07 fault 	 0xc04d : 	 0xc052 : 	 5  
aida08 fault 	 0xa0f7 : 	 0xa0fc : 	 5  
White Rabbit error counter test result: Passed 8, Failed 8

Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR

Returned 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0  
Mem(KB) :	4	8	16	32	64	128	256	512	1k	2k	4k
aida01 :      6      9      5      1      3      2      2      2      2      4      6   : 37008
aida02 :      3      5      5      2      2      4      3      3      2      4      6   : 37956
aida03 :     22     12      7      5      3      3      2      3      3      3      6   : 36872
aida04 :     40     13      5      5      3      4      2      3      3      3      6   : 37048
aida05 :     15      5      5      4      2      2      2      2      2      4      6   : 37044
aida06 :     11      6      2      1      2      3      3      4      2      4      6   : 38300
aida07 :     17      5      4      3      1      3      3      2      2      4      6   : 37324
aida08 :      1      8      1      2      2      4      4      3      2      4      6   : 38164
aida09 :     10      8      6      1      2      4      3      3      1      4      6   : 36968
aida10 :     14      7      5      2      1      3      3      3      1      4      6   : 36800
aida11 :      7      9      3      1      2      3      3      3      1      4      6   : 36788
aida12 :      3      5      2      3      1      4      2      3      2      4      6   : 37620
aida13 :     12      4      4      2      1      3      2      2      2      4      6   : 37008
aida14 :     11     10      5      1      1      3      2      2      2      4      6   : 37036
aida15 :     11      5      1      2      1      3      3      4      2      4      6   : 38244
aida16 :     10      4      8      1      2      3      2      2      2      4      6   : 37096

 Collecting the file size of each FEE64 Options CONTENTS file to check they are all the same

 FEE : aida01 =>   Options file size is 1026 	 Last changed Sun May 23 12:04:25 CEST 2021
 FEE : aida02 =>   Options file size is 1025 	 Last changed Sun May 23 00:19:21 CEST 2021
 FEE : aida03 =>   Options file size is 1014 	 Last changed Thu Apr 29 14:43:50 CEST 2021
 FEE : aida04 =>   Options file size is 1025 	 Last changed Fri May 14 16:54:56 CEST 2021
 FEE : aida05 =>   Options file size is 1025 	 Last changed Mon May 17 06:25:41 CEST 2021
 FEE : aida06 =>   Options file size is 1014 	 Last changed Thu Apr 29 14:43:59 CEST 2021
 FEE : aida07 =>   Options file size is 1014 	 Last changed Thu Apr 29 14:44:02 CEST 2021
 FEE : aida08 =>   Options file size is 1025 	 Last changed Sun May 23 00:16:54 CEST 2021
 FEE : aida09 =>   Options file size is 1014 	 Last changed Thu Apr 29 14:44:08 CEST 2021
 FEE : aida10 =>   Options file size is 1014 	 Last changed Thu Apr 29 14:44:57 CEST 2021
 FEE : aida11 =>   Options file size is 1014 	 Last changed Thu Apr 29 14:44:57 CEST 2021
 FEE : aida12 =>   Options file size is 1014 	 Last changed Thu Apr 29 14:44:57 CEST 2021
 FEE : aida13 =>   Options file size is 1025 	 Last changed Fri May 07 19:40:34 CEST 2021
 FEE : aida14 =>   Options file size is 1014 	 Last changed Thu Apr 29 14:44:57 CEST 2021
 FEE : aida15 =>   Options file size is 1014 	 Last changed Thu Apr 29 14:44:57 CEST 2021
 FEE : aida16 =>   Options file size is 1014 	 Last changed Thu Apr 29 14:44:57 CEST 2021

      Grafana - DSSSD bias & leakage current - most recent 7 days - attachment 1
      Lost activity monitor - attachment 2
      1.8.W spectra - attachments 3 & 4
      ADC data item stats - attachment 5
      FEE64 temps OK - attachment 6
      DSSSD bias & leakage current OK - attachment 7
      Merger/Tape Server/Merger stats - attachment 8
       no merger errors reported since previous restart

14.24 All histograms, statistics and merger statistics zero'd

16.16 analysis of file S496/R18_541 - attachment 9
       max deadtime 0.02% aida03

18.40 DAQ continues - file S496/R18_589
      alpha background

      increased data rate due to hot HEC channels since c. 18.00 this am - ASIC check fixes problem
Attachment 1: Screenshot_2021-05-30_AIDA_Alerting_-_Grafana.png
Screenshot_2021-05-30_AIDA_Alerting_-_Grafana.png
Attachment 2: Screenshot_2021-05-30_Lost_activity_monitor_aidas-gsi.png
Screenshot_2021-05-30_Lost_activity_monitor_aidas-gsi.png
Attachment 3: Screenshot_2021-05-30_Spectrum_Browser_aidas-gsi(1).png
Screenshot_2021-05-30_Spectrum_Browser_aidas-gsi(1).png
Attachment 4: Screenshot_2021-05-30_Spectrum_Browser_aidas-gsi.png
Screenshot_2021-05-30_Spectrum_Browser_aidas-gsi.png
Attachment 5: Screenshot_2021-05-30_Statistics_aidas-gsi.png
Screenshot_2021-05-30_Statistics_aidas-gsi.png
Attachment 6: Screenshot_2021-05-30_Temperature_and_status_scan_aidas-gsi.png
Screenshot_2021-05-30_Temperature_and_status_scan_aidas-gsi.png
Attachment 7: 960.png
960.png
Attachment 8: 961.png
961.png
Attachment 9: R18_589
 *** TDR format 3.3.0 analyser - TD - May 2021
 *** ERROR: READ I/O error:       5002
                   blocks:      31985
          ADC data format:   58630511 (   25364.6 Hz)
        Other data format:  203166719 (   87893.5 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:         35 (       0.0 Hz)
                               RESUME:         35 (       0.0 Hz)
                              SYNC100:      40596 (      17.6 Hz)
                              WR48-63:      40596 (      17.6 Hz)
                           FEE64 disc:    1341777 (     580.5 Hz)
                             MBS info:  201743680 (   87277.8 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:          0 (       0.0 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                              WR48-63:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:     2311.511 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  0                0.000                0.000
  1                0.000             1879.226
  2                0.365                0.000
  3                0.313                0.000
  4                0.000             1697.189
  5                0.000              557.330
  6                0.000             1686.560
  7                0.000              647.171
  8                0.000                0.000
  9                0.000                0.000
 10                0.382                0.000
 11                0.000                0.000
 12                0.000                0.000
 13                0.000                0.000
 14                0.000                0.000
 15                0.000                0.000
 16                0.000                0.000
 17                0.000                0.000
 18                0.000                0.000
 19                0.000                0.000
 20                0.000                0.000
 21                0.000                0.000
 22                0.000                0.000
 23                0.000                0.000
 24                0.000                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100    WR48-63       Disc        MBS      Other   HEC Data
  0        157          0          0          0          0          0          0          0          0          0          0          0
  1    3314609       1296          0          0          0          0        648        648          0          0          0          0
  2        413   87031526          0          0         19         19      14856      14856          0   87001776          0          0
  3   42258127   88383449          0          0         15         15      18954      18954    1341775   87003736          0          0
  4        153    6936262          0          0          0          0        860        860          0    6934542          0          0
  5    6312304    6939162          0          0          0          0       2310       2310          0    6934542          0          0
  6        544    6936170          0          0          0          0        814        814          0    6934542          0          0
  7    6741331    6938850          0          0          0          0       2154       2154          0    6934542          0          0
  8        448          0          0          0          0          0          0          0          0          0          0          0
  9         79          0          0          0          0          0          0          0          0          0          0          0
 10       1189          2          0          0          1          1          0          0          0          0          0          0
 11        111          2          0          0          0          0          0          0          2          0          0          0
 12        767          0          0          0          0          0          0          0          0          0          0          0
 13         99          0          0          0          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0          0          0          0          0
 15        180          0          0          0          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100    WR48-63       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0

 *** Program elapsed time:   31.504s ( 1015.271 blocks/s,  63.454 Mb/s)
  526   Sun Mar 3 16:06:11 2024 TDSunday 3 March
17.00 FEE64 41:a0:71 ASIC #2 u/s
      Replaced ASIC mezzanine with new ASIC mezzanine
      Installed as aida04

      Unable to boot nnrpi2 - manual/local control of BNC PB-5 and FEE64 PSU - no interlock

      Water temperature & pressure as measured outside S4 area - OK 

      Manually power FEE64s

      BNC PB-5 local control/ON
      Amplitude 1.0V
      Attenuation x10
      Polarity -
      tau_d 1ms
      Frequency 22Hz

      FEE64 temps OK - attachment 1

      All system wide checks OK

      WR timestamp OK - attachment 2

      aida04 ASIC settings - attachment 3

      ADC data item stats OK - attachment 4
   
      aida04 Rate spectrum - attachment 5

      aida04 *.*.L spectra - attachments 6-9
       1.8.L pulser peak width 15 ch FWHM

      aida04 1.8.W spectra - 20us FSR - attachment 10-11

      MIDAS configuration - attachment 12

      DHCP config - attachment 13



18.30 FEE64 41:f6:b7 ASIC #1 u/s
      Replaced ASIC mezzanine with new ASIC mezzanine
      Installed as aida02

      All system wide checks OK

      FEE64 temps - attachment 14
       aida02 ASIC temperature c. 512 deg C !
       PSU/Virtex temps OK
       Mezzanine ambient to touch - assume faulty sensor/poor connection?

      aida02 ASIC settings - attachment 15

      WR timestamp OK - attachment 16

      ADC data item stats OK - attachment 4

      aida04 Rate spectrum - attachment 18

      aida02 1.8.W spectra - 20us FSR - attachment 19-20

      aida02 *.*.L spectra - attachments 21-24
       1.8.L pulser peak width 16 ch FWHM


19.30 Power OFF



     
Attachment 1: Screenshot_from_2024-03-03_16-54-42.png
Screenshot_from_2024-03-03_16-54-42.png
Attachment 2: Screenshot_from_2024-03-03_16-55-14.png
Screenshot_from_2024-03-03_16-55-14.png
Attachment 3: Screenshot_from_2024-03-03_16-55-21.png
Screenshot_from_2024-03-03_16-55-21.png
Attachment 4: Screenshot_from_2024-03-03_17-07-26.png
Screenshot_from_2024-03-03_17-07-26.png
Attachment 5: Screenshot_from_2024-03-03_16-53-52.png
Screenshot_from_2024-03-03_16-53-52.png
Attachment 6: Screenshot_from_2024-03-03_17-02-09.png
Screenshot_from_2024-03-03_17-02-09.png
Attachment 7: Screenshot_from_2024-03-03_17-01-52.png
Screenshot_from_2024-03-03_17-01-52.png
Attachment 8: Screenshot_from_2024-03-03_17-00-18.png
Screenshot_from_2024-03-03_17-00-18.png
Attachment 9: Screenshot_from_2024-03-03_16-59-23.png
Screenshot_from_2024-03-03_16-59-23.png
Attachment 10: Screenshot_from_2024-03-03_16-58-43.png
Screenshot_from_2024-03-03_16-58-43.png
Attachment 11: Screenshot_from_2024-03-03_16-57-09.png
Screenshot_from_2024-03-03_16-57-09.png
Attachment 12: startup.tcl

   Setting BGColor "BlanchedAlmond"
   Setting TextColor "red"

      Setting ProjectName  AIDA
      Setting ProjectImage AIDA.gif
      Setting ProjectURL   "http://npg.dl.ac.uk/NPG/Projects/Fair.html"


  Setting Option1Name STFC
  Setting Option1URL  "stfc.ac.uk"
  Setting Option1Image stfc.jpg


# global MessageLoggerServerHost
#  set  MessageLoggerServerHost nndhcp077.dl.ac.uk

#    package require  MessageLoggerClient 

#  Setting Option3Name "Elog Server"
#  Setting Option3URL  "http://nndhcp077.dl.ac.uk:8080/DataAcq/"

#    Install required services

    if {![namespace exists ::AIDA]} {namespace eval ::AIDA {puts "created namespace ::AIDA"}}
#    set ::AIDA::TestMode 1

    global SpectrumServerHost
    set SpectrumServerHost aidas

   package require XAIDAAccessClient  ;# for Client end - ie AIDA server workstation  sets MIDAS_XAIDAAccessClient_Exists (SOAP)

   package require XAD9252AccessClient ;# for Client end - ie AIDA server workstation  sets MIDAS_XAD9252AccessClient_Exists (SOAP)

namespace eval DataAcquisition {
     variable PROJECT AIDA
     variable ACQSERVERS
     set ACQSERVERS [list aida01 aida03 aida04 aida05 aida08]
     variable ACQSERVER [first $ACQSERVERS]
     variable DataTransferStreams; set DataTransferStreams 2
#     set ::DataAcquisition::EnableMerger 1
#     set ::DataAcquisition::EnableTape 1
    variable RDOGo 0 
}

namespace eval AIDA {
      variable ModuleMenu; set ModuleMenu $::DataAcquisition::ACQSERVERS
      variable TSMaster; set TSMaster aida01
      variable FEE64 [first $ModuleMenu]
      variable ConfigBase; set ConfigBase [file join $env(MIDASBASE) config TclHttpd]
}

    Setting DataBaseRoot "/MIDAS/DB"
    package require DataBaseAccessServer

    package require NetVarsServer 1.1
    package require SigTaskServer

#    package require MemSasServer

#    Install services for Run Control

namespace eval $::DataAcquisition::PROJECT {
    variable DBRootName [file join EXPERIMENTS AIDA]
    variable DBNodeBase 2012
}

  package require AIDARunControl
#  package require TapeServer
#  package require MergerControl
#  package require MERGERunControl


  Setting Option7Name "Project Home Page"
  Setting Option7URL  "http://npg.dl.ac.uk/NPG/Projects/Fair.html"

  Setting Option8Name "Server Software Home Page"
  Setting Option8URL  "http://npg.dl.ac.uk/MIDAS/download/WebServices.html"


Attachment 13: dhcpd.conf
#
# DHCP Server Configuration file.
#   see /usr/share/doc/dhcp*/dhcpd.conf.sample  
#
# Date of last update  Jan 12 2015 
#
authoritative;

ddns-update-style none; ddns-updates off;

# 2 days
#default-lease-time 172800;
# 4 days
default-lease-time 345600;
# 8 days
max-lease-time 691200;

option domain-search code 119 = string;

option domain-name "dl.ac.uk";
option domain-name-servers 193.62.115.16, 148.79.80.78;
option netbios-name-servers 148.79.160.89;
option netbios-node-type 8;
option nis-domain "nuclear.physics";
option nis-servers 193.62.115.77;


subnet 192.168.11.0 netmask 255.255.255.0 {
   option subnet-mask 255.255.255.0;
   option broadcast-address 192.168.11.255;
   pool {
 range 192.168.11.118 192.168.11.199;
   }
}

group {
   use-host-decl-names true;
   default-lease-time 3600;
   max-lease-time 14400;

   server-name "192.168.11.99";
   next-server 192.168.11.99;

   host nnrpi1 {
     hardware ethernet b8:27:eb:bb:46:7b;
     fixed-address 192.168.11.251;
   }

   host nnrpi2 {
     hardware ethernet b8:27:eb:40:53:e8;
     fixed-address 192.168.11.117;
   }

   host edinburgh {
      hardware ethernet 00:14:4f:9b:6e:7a;
      fixed-address 192.168.11.118;
   }

   host aida01 {
     hardware ethernet d8:80:39:41:ba:8a;
     fixed-address 192.168.11.1;
    option root-path "/home/Embedded/XilinxLinux/ppc_4xx/rfs/aida01";
   }

   host aida02 {
     hardware ethernet d8:80:39:41:ba:22;
     fixed-address 192.168.11.2;
    option root-path "/home/Embedded/XilinxLinux/ppc_4xx/rfs/aida02";
   }

   host aida03 {
     hardware ethernet d8:80:39:41:d8:21;
     fixed-address 192.168.11.3;
    option root-path "/home/Embedded/XilinxLinux/ppc_4xx/rfs/aida03";
   }

   host aida04 {
     hardware ethernet d8:80:39:41:a0:71;
     fixed-address 192.168.11.4;
    option root-path "/home/Embedded/XilinxLinux/ppc_4xx/rfs/aida04";
   }


   host aida05 {
     hardware ethernet d8:80:39:41:ee:10;
     fixed-address 192.168.11.5;
    option root-path "/home/Embedded/XilinxLinux/ppc_4xx/rfs/aida05";
   }

   host aida06 {
     hardware ethernet d8:80:39:41:cf:ac;
     fixed-address 192.168.11.6;
    option root-path "/home/Embedded/XilinxLinux/ppc_4xx/rfs/aida06";
   }

   host aida07 {
     hardware ethernet d8:80:39:41:f6:5a;
     fixed-address 192.168.11.7;
    option root-path "/home/Embedded/XilinxLinux/ppc_4xx/rfs/aida07";
   }

   host aida08 {
     hardware ethernet d8:80:39:41:ba:89;
     fixed-address 192.168.11.8;
    option root-path "/home/Embedded/XilinxLinux/ppc_4xx/rfs/aida08";
   }

   host aida09 {
     hardware ethernet d8:80:39:42:0d:15;
     fixed-address 192.168.11.9;
    option root-path "/home/Embedded/XilinxLinux/ppc_4xx/rfs/aida09";
   }

   #host aida06 {
   #  hardware ethernet d8:80:39:41:ee:72;
   #  fixed-address 192.168.11.6;
   # option root-path "/home/Embedded/XilinxLinux/ppc_4xx/rfs/aida06";
   #}

   #host aida07 {
   #  hardware ethernet d8:80:39:41:b4:0c;
   #  fixed-address 192.168.11.7;
   # option root-path "/home/Embedded/XilinxLinux/ppc_4xx/rfs/aida07";
   #}

   #host aida08 {
   #  hardware ethernet d8:80:39:41:ba:2b;
   #  fixed-address 192.168.11.8;
   # option root-path "/home/Embedded/XilinxLinux/ppc_4xx/rfs/aida08";
   #}

   #host aida13 {
   #  hardware ethernet d8:80:39:42:d:15;
   #  fixed-address 192.168.11.13;
   # option root-path "/home/Embedded/XilinxLinux/ppc_4xx/rfs/aida13";
   #}

#   host aida14 {
#     hardware ethernet d8:80:39:42:d:b;
#     fixed-address 192.168.11.14;
#    option root-path "/home/Embedded/XilinxLinux/ppc_4xx/rfs/aida14";
#   }

   #host aida05 {
   #  hardware ethernet d8:80:39:41:ee:10;
   #  fixed-address 192.168.11.5;
   # option root-path "/home/Embedded/XilinxLinux/ppc_4xx/rfs/aida05";
   #}

   #host aida14 {
   #  hardware ethernet d8:80:39:41:f6:ed;
   #  fixed-address 192.168.11.14;
   # option root-path "/home/Embedded/XilinxLinux/ppc_4xx/rfs/aida14";
   #}
}


subnet 192.168.12.0 netmask 255.255.255.0 {
   option subnet-mask 255.255.255.0;
   option broadcast-address 192.168.12.255;
   pool {
 range 192.168.12.100 192.168.12.199;
   }
}

group {
   use-host-decl-names true;
   default-lease-time 3600;
   max-lease-time 14400;

   server-name "192.168.12.99";
   next-server 192.168.12.99;







}


Attachment 14: Screenshot_from_2024-03-03_18-53-03.png
Screenshot_from_2024-03-03_18-53-03.png
Attachment 15: Screenshot_from_2024-03-03_18-53-16.png
Screenshot_from_2024-03-03_18-53-16.png
Attachment 16: Screenshot_from_2024-03-03_18-53-41.png
Screenshot_from_2024-03-03_18-53-41.png
Attachment 17: Screenshot_from_2024-03-03_19-02-33.png
Screenshot_from_2024-03-03_19-02-33.png
Attachment 18: Screenshot_from_2024-03-03_18-53-47.png
Screenshot_from_2024-03-03_18-53-47.png
Attachment 19: Screenshot_from_2024-03-03_19-01-41.png
Screenshot_from_2024-03-03_19-01-41.png
Attachment 20: Screenshot_from_2024-03-03_19-01-31.png
Screenshot_from_2024-03-03_19-01-31.png
Attachment 21: Screenshot_from_2024-03-03_19-00-11.png
Screenshot_from_2024-03-03_19-00-11.png
Attachment 22: Screenshot_from_2024-03-03_18-59-24.png
Screenshot_from_2024-03-03_18-59-24.png
Attachment 23: Screenshot_from_2024-03-03_18-58-39.png
Screenshot_from_2024-03-03_18-58-39.png
Attachment 24: Screenshot_from_2024-03-03_18-57-57.png
Screenshot_from_2024-03-03_18-57-57.png
  408   Sun Apr 3 10:56:11 2022 TDSunday 3 April
all system wide checks OK *except* aida10 failed ADC calibration

Attachment 1 ADC data item stats
Attachment 2 FEE64 temps OK
Attachment 3 DSSSD bias & leakage currents OK





DSSSD bias to left (looking upstream) wafer *only*
      FEE64s 10 & 12, 14 & 16

Attachments 4 & 5 1.8.W spectra 20us FSR

Attachment 6 ADC data item stats

Attachment 7 DSSSD bias & leakage current




ASIC check all FEE64s

DSSSD bias to middle (looking upstream) wafer *only*
      FEE64s 1 & 3, 5 & 7

Attachments 8 & 9 1.8.W spectra 20us FSR

Attachment 10 ADC data item stats

Attachment 11 DSSSD bias & leakage current





ASIC check all FEE64s

DSSSD bias to right (looking upstream) wafer *only*
      FEE64s 9 & 11, 13 & 15

Attachments 12 & 13 1.8.W spectra 20us FSR

Attachment 14 ADC data item stats

Attachment 15 DSSSD bias & leakage current



Conclusions

ADC data item stats -> 300-400k

n+n 1.8.W spectra show large signal excursions

p+n 1.8.W spectra for biased Si wafers OK - unbiased Si wafers show large signal excursions


DSSSD#1 leakage currents 1.850+2.220+1.990=6.06uA    cf. 5.095uA with all 3 wafers biased 
DSSSD#2 leakage currents 1.510+1.580+2.350=5.44uA    cf. 5.235uA 


Right wafer (looking upstream)
             
Bias(V)         -20    -40    -60    -80    -100
DSSSD#1 I_L(uA) -1.135 -1.475 -1.645 -1.750 -1.805
DSSSD#2 I_l(uA) -1.625 -2.020 -2.205 -2.320 -2.360

Middle wafer (looking upstream)
          
Bias(V)         -20    -40    -60    -80    -100
DSSSD#1 I_L(uA) -1.540 -1.870 -2.035 -2.150 -2.210
DSSSD#2 I_l(uA) -0.985 -1.285 -1.465 -1.575 -1.615

Left wafer (looking upstream)
          
Bias(V)         -20    -40    -60    -80    -100
DSSSD#1 I_L(uA) -0.735 -0.915 -1.005 -1.080 -1.110
DSSSD#2 I_l(uA) -0.865 -1.205 -1.400 -1.510 -1.560

Bias versus leakage cuurent characteristic of each wafer of each DSSSD indicates diode behaviour.

Note LK1 not fitted - presumably LK3 of mid/top p+n FEE64 adaptor PCBs (aida01 and aida05) connecting n+n bias to gnd is sufficient to establish circuit.




15.50 Re-connect bias to all 3x Si wafers p+n junction side bias rings

ASIC check all FEE64s

Attachments 16 & 17 1.8.W spectra 20us FSR

Attachment 18 ADC data item stats

Attachment 19 DSSSD bias & leakage current

Conclusion - status quo ante restored



16.40 Remove aida01 & aida05 LK3, add aida04 & aida08 LK1

ASIC check all FEE64s

Attachments 20 & 21 1.8.W spectra 20us FSR

Attachment 22 ADC data item stats

Attachment 23 DSSSD bias & leakage current

Conclusion - no change



17.00 Add Thorn-Lab HV filters DSSSD#1 & #2


ASIC check all FEE64s

Attachments 24 & 25 1.8.W spectra 20us FSR

Attachment 26 ADC data item stats

Attachment 27 DSSSD bias & leakage current

Conclusion - aida09-aida12 no change, aida13-aida16 -> 300-400k
             I do not know why there's a difference between DSSSD#1 & #2 but more important point (probably) no improvement aida09-aida12
             Thorn Lab HV filters removed - status quo ante restored


18.02 Remove LK2 & LK4 all top p+n adaptor PCBs (aida13, 5, 14, 9, 1, & 10)

ASIC check all FEE64s

Attachments 28 & 29 1.8.W spectra 20us FSR

Attachment 30 ADC data item stats

Attachment 31 DSSSD bias & leakage current

Conclusion - no change cf. 16.40 test



19.10 Re-order power cabling at AIDA FEE64 PSUs from ...

Top    1-3 2-4 9-10 11-12
Bottom 5-7 6-8 13-14 15-16

to ...

Top    1-2 3-4 9-10 11-12
Bottom 5-6 7-8 13-14 15-16


ASIC check all FEE64s

Attachments 32 & 33 1.8.W spectra 20us FSR

Attachment 34 ADC data item stats

Attachment 35 DSSSD bias & leakage current

Conclusion - all p+n FEE64 rates c. 100k, or less, n+n FEE64 rates c. 400k

FEE64 adaptor PCB config

LK2-LK3-LK4 fitted for all bottom p+n FEE64s (aida11, 3, 12, 15, 7, 16)

LK1 fitted n+n FEE64s aida06 & aida02 *only*
Attachment 1: Screenshot_from_2022-04-03_11-54-21.png
Screenshot_from_2022-04-03_11-54-21.png
Attachment 2: Screenshot_from_2022-04-03_11-54-04.png
Screenshot_from_2022-04-03_11-54-04.png
Attachment 3: Screenshot_from_2022-04-03_11-53-15.png
Screenshot_from_2022-04-03_11-53-15.png
Attachment 4: Screenshot_from_2022-04-03_13-07-21.png
Screenshot_from_2022-04-03_13-07-21.png
Attachment 5: Screenshot_from_2022-04-03_13-06-48.png
Screenshot_from_2022-04-03_13-06-48.png
Attachment 6: Screenshot_from_2022-04-03_13-06-34.png
Screenshot_from_2022-04-03_13-06-34.png
Attachment 7: Screenshot_from_2022-04-03_13-05-24.png
Screenshot_from_2022-04-03_13-05-24.png
Attachment 8: Screenshot_from_2022-04-03_13-21-31.png
Screenshot_from_2022-04-03_13-21-31.png
Attachment 9: Screenshot_from_2022-04-03_13-21-07.png
Screenshot_from_2022-04-03_13-21-07.png
Attachment 10: Screenshot_from_2022-04-03_13-20-43.png
Screenshot_from_2022-04-03_13-20-43.png
Attachment 11: Screenshot_from_2022-04-03_13-20-25.png
Screenshot_from_2022-04-03_13-20-25.png
Attachment 12: Screenshot_from_2022-04-03_13-32-24.png
Screenshot_from_2022-04-03_13-32-24.png
Attachment 13: Screenshot_from_2022-04-03_13-31-50.png
Screenshot_from_2022-04-03_13-31-50.png
Attachment 14: Screenshot_from_2022-04-03_13-31-32.png
Screenshot_from_2022-04-03_13-31-32.png
Attachment 15: Screenshot_from_2022-04-03_13-31-06.png
Screenshot_from_2022-04-03_13-31-06.png
Attachment 16: Screenshot_from_2022-04-03_15-52-42.png
Screenshot_from_2022-04-03_15-52-42.png
Attachment 17: Screenshot_from_2022-04-03_15-51-49.png
Screenshot_from_2022-04-03_15-51-49.png
Attachment 18: Screenshot_from_2022-04-03_15-51-34.png
Screenshot_from_2022-04-03_15-51-34.png
Attachment 19: Screenshot_from_2022-04-03_15-50-53.png
Screenshot_from_2022-04-03_15-50-53.png
Attachment 20: Screenshot_from_2022-04-03_16-40-15.png
Screenshot_from_2022-04-03_16-40-15.png
Attachment 21: Screenshot_from_2022-04-03_16-39-43.png
Screenshot_from_2022-04-03_16-39-43.png
Attachment 22: Screenshot_from_2022-04-03_16-39-34.png
Screenshot_from_2022-04-03_16-39-34.png
Attachment 23: Screenshot_from_2022-04-03_16-39-22.png
Screenshot_from_2022-04-03_16-39-22.png
Attachment 24: Screenshot_from_2022-04-03_16-59-59.png
Screenshot_from_2022-04-03_16-59-59.png
Attachment 25: Screenshot_from_2022-04-03_16-59-33.png
Screenshot_from_2022-04-03_16-59-33.png
Attachment 26: Screenshot_from_2022-04-03_16-59-10.png
Screenshot_from_2022-04-03_16-59-10.png
Attachment 27: Screenshot_from_2022-04-03_16-59-07.png
Screenshot_from_2022-04-03_16-59-07.png
Attachment 28: Screenshot_from_2022-04-03_18-01-39.png
Screenshot_from_2022-04-03_18-01-39.png
Attachment 29: Screenshot_from_2022-04-03_18-00-56.png
Screenshot_from_2022-04-03_18-00-56.png
Attachment 30: Screenshot_from_2022-04-03_18-00-43.png
Screenshot_from_2022-04-03_18-00-43.png
Attachment 31: Screenshot_from_2022-04-03_18-00-40.png
Screenshot_from_2022-04-03_18-00-40.png
Attachment 32: Screenshot_from_2022-04-03_19-10-37.png
Screenshot_from_2022-04-03_19-10-37.png
Attachment 33: Screenshot_from_2022-04-03_19-10-11.png
Screenshot_from_2022-04-03_19-10-11.png
Attachment 34: Screenshot_from_2022-04-03_19-10-00.png
Screenshot_from_2022-04-03_19-10-00.png
Attachment 35: Screenshot_from_2022-04-03_19-09-36.png
Screenshot_from_2022-04-03_19-09-36.png
  502   Sun Jun 26 08:51:20 2022 OH, NHSunday 26 June 08:00-24:00
09:51 Taken over from Tom following the night shift
      Experiment is still running smoothly
      Compression of the files is complete up to the start of R5.
      Have started compression of files in R5 which should run up to R5_499
      Currently on R5_528

      Statistics ok - attachment 1
      Temperatures ok - attachment 2
      Bias and leakage currents ok - attachment 3
      System wide checks:
          		 Base 		Current 	Difference
      aida07 fault 	 0xc53d : 	 0xc594 : 	 87  
      aida08 fault 	 0xf1be : 	 0xf271 : 	 179  
      White Rabbit error counter test result: Passed 6, Failed 2

      			 Base 		Current 	Difference
      aida07 fault 	 0x2a : 	 0x3b : 	 17  
      FPGA Timestamp error counter test result: Passed 7, Failed 1

      Current merger rate is 2E6-4E6 events per second
      Current tapeserver rate is 5800 kB/s
      Free HDD space is 1.1 TB
      At current rates will last 54 hours which should see out the experiment
      Experiment currently scheduled to finish at 6am on Tuesday morning (May get until 8am)
      
      Analysis of R5_528 - attachment 4
      Deadtime of AIDA02 currently around 15%

11:56 Statistics ok - attachment 5
      Temps ok - attachment 6
      Bias and leakage currents ok - attachment 7
      System wide checks:
      Clocks all ok 
      
         		 Base 		Current 	Difference
      aida07 fault 	 0xc53d : 	 0xc59c : 	 95  
      aida08 fault 	 0xf1be : 	 0xf27a : 	 188  
      White Rabbit error counter test result: Passed 6, Failed 2

	
			 Base 		Current 		Difference
      aida07 fault 	 0x2a : 	 0x3b : 	 17  
      FPGA Timestamp error counter test result: Passed 7, Failed 1

      Analysis of file R5_458 - attachment 8
      Deadtime in AIDA02 only 11.5% in this file
      TapeServer rate still 5.5 MB/s

14:36 Has been no beam for the last while or so.
      With no beam AIDA02 has 0.25% deadtime so the deadtime is almost entirely due to the spill on time
      Stats- attachment 9
      Temp - attachment 10
      Bias and leakage currents ok - attachment 11
      System wide checks:
      Clock ok
      	
        		 Base 		Current 	Difference
      aida07 fault 	 0xc53d : 	 0xc59d : 	 96  
      aida08 fault 	 0xf1be : 	 0xf27c : 	 190  
      White Rabbit error counter test result: Passed 6, Failed 2
      	
			 Base 		Current 		Difference
      aida07 fault 	 0x2a : 	 0x3c : 	 18  
      FPGA Timestamp error counter test result: Passed 7, Failed 1

13:30 Beam taken to change an ion source

14:57 Beam back

16:21 Statistics ok - attachment 12
      Temperatures ok - attachment 13
      Bias and leakage currents ok - attachment 14

      System wide checks - ASIC clocks ok 
	
	        	 Base 		Current 	Difference
      aida07 fault 	 0xc53d : 	 0xc5a3 : 	 102  
      aida08 fault 	 0xf1be : 	 0xf285 : 	 199  
      White Rabbit error counter test result: Passed 6, Failed 2

	
			 Base 		Current 		Difference
      aida07 fault 	 0x2a : 	 0x3e : 	 20  
      FPGA Timestamp error counter test result: Passed 7, Failed 1

      Currently on file R5_592
      Analysis of R5_591 - Attachment 15
      Deadtime of AIDA02 sitting at 17%

[NH taking over for OH so he can get home]

18:53 - FRS DAQ problems mean we weren't taking DESPEC data for the past hour or so... now all back
        Statitics ok - attachement 16
        Temps ok - attachement 17
        Bias & leakage ok - attachement 18

        System wide checks - 
        Clocks OK
        ADC Calibration N/A 
	WR Decoder -
        		 Base 		Current 	Difference
        aida07 fault 	 0xc53d : 	 0xc5ac : 	 111  
        aida08 fault 	 0xf1be : 	 0xf28c : 	 206  
        White Rabbit error counter test result: Passed 6, Failed 2
        FPGA -
         Base 		Current 		Difference
        aida07 fault 	 0x2a : 	 0x3f : 	 21  
        PLL OK

        Currently on file R5_621
        Analysis of R5_620 - Attachement 19
        aida02 deadtime only 5%, all others negligible 

20:20 Stats ok - attachment 20
      Temps ok - attachment 21
      Bias and leakage currents ok - attachment 22
      System wide checks:
      Clock ok
    	
	        	 Base 		Current 	Difference
      aida07 fault 	 0xc53d : 	 0xc5ad : 	 112  
      aida08 fault 	 0xf1be : 	 0xf293 : 	 213  
      White Rabbit error counter test result: Passed 6, Failed 2

     	
			 Base 		Current 		Difference
      aida07 fault 	 0x2a : 	 0x3f : 	 21  
      FPGA Timestamp error counter test result: Passed 7, Failed 1

      Analysis of R6_637 - attachment 23

22:13 Statistics ok - attachment 24
      Temperatures ok - attachment 25
      Bias and leakage currents ok - attachment 26
      ASIC clock check ok

	
		         Base 		Current 	Difference
      aida07 fault 	 0xc53d : 	 0xc5ba : 	 125  
      aida08 fault 	 0xf1be : 	 0xf2a2 : 	 228  
      White Rabbit error counter test result: Passed 6, Failed 2

			 Base 		Current 		Difference
      aida07 fault 	 0x2a : 	 0x40 : 	 22  
      FPGA Timestamp error counter test result: Passed 7, Failed 1

      Analysis of R5_658 - attachment 27
Attachment 1: 220626_0949_stats.png
220626_0949_stats.png
Attachment 2: 220626_0950_Temps.png
220626_0950_Temps.png
Attachment 3: 220626_0951_Bias.png
220626_0951_Bias.png
Attachment 4: R5_528_analysis.txt
 *** TDR format 3.3.0 analyser - TD - May 2021
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  260639000 (  776334.1 Hz)
        Other data format:    1281002 (    3815.6 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:       1133 (       3.4 Hz)
                               RESUME:       1133 (       3.4 Hz)
                              SYNC100:      33251 (      99.0 Hz)
                              WR48-63:      33251 (      99.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:    1212234 (    3610.7 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:     393457 (    1171.9 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                              WR48-63:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:      335.730 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  0                8.363                0.000
  1               44.893                0.000
  2                0.179                0.000
  3                3.779                0.000
  4                0.000               44.522
  5                0.034                0.000
  6                0.166                0.000
  7                0.017                0.000
  8                0.000                0.000
  9                0.000                0.000
 10                0.000                0.000
 11                0.000                0.000
 12                0.000                0.000
 13                0.000                0.000
 14                0.000                0.000
 15                0.000                0.000
 16                0.000                0.000
 17                0.000                0.000
 18                0.000                0.000
 19                0.000                0.000
 20                0.000                0.000
 21                0.000                0.000
 22                0.000                0.000
 23                0.000                0.000
 24                0.000                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100    WR48-63       Disc        MBS      Other   HEC Data
  0   31317521      31305          0          0        207        207       4035       4035          0      22821          0      98396
  1   68454688      19188          0          0        693        693       8901       8901          0          0          0      59818
  2   19369571     305849          0          0         35         35       2468       2468          0     300843          0      63063
  3   45019317     306201          0          0        130        130       5636       5636          0     294669          0      32623
  4    4769649       1252          0          0          0          0        626        626          0          0          0      31000
  5   17853070       4600          0          0         15         15       2285       2285          0          0          0      37328
  6   42448852     303192          0          0         44         44       5356       5356          0     292392          0      54344
  7   31406332     309415          0          0          9          9       3944       3944          0     301509          0      16885
  8          0          0          0          0          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100    WR48-63       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0

 *** Program elapsed time:   41.891s (  763.894 blocks/s,  47.743 Mb/s)
Attachment 5: 220626_1155_stats.png
220626_1155_stats.png
Attachment 6: 220626_1155_Temp.png
220626_1155_Temp.png
Attachment 7: 220626_1156_Bias.png
220626_1156_Bias.png
Attachment 8: R5_548_analysis.txt
 *** TDR format 3.3.0 analyser - TD - May 2021
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  260758427 (  740797.4 Hz)
        Other data format:    1161573 (    3300.0 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:       1084 (       3.1 Hz)
                               RESUME:       1084 (       3.1 Hz)
                              SYNC100:      33311 (      94.6 Hz)
                              WR48-63:      33311 (      94.6 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:    1092783 (    3104.5 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:     356241 (    1012.1 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                              WR48-63:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:      351.997 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  0                5.340                0.000
  1               40.660                0.000
  2                0.175                0.000
  3                2.385                0.000
  4                0.000               67.319
  5                0.032                0.000
  6                0.142                0.000
  7                0.019                0.000
  8                0.000                0.000
  9                0.000                0.000
 10                0.000                0.000
 11                0.000                0.000
 12                0.000                0.000
 13                0.000                0.000
 14                0.000                0.000
 15                0.000                0.000
 16                0.000                0.000
 17                0.000                0.000
 18                0.000                0.000
 19                0.000                0.000
 20                0.000                0.000
 21                0.000                0.000
 22                0.000                0.000
 23                0.000                0.000
 24                0.000                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100    WR48-63       Disc        MBS      Other   HEC Data
  0   29258900      32253          0          0        166        166       3875       3875          0      24171          0      88948
  1   70599060      19658          0          0        716        716       9113       9113          0          0          0      56350
  2   19313501     275533          0          0         28         28       2458       2458          0     270561          0      56248
  3   44887469     278330          0          0        112        112       5682       5682          0     266742          0      29387
  4    4430708       1118          0          0          0          0        559        559          0          0          0      27825
  5   17540711       4456          0          0         11         11       2217       2217          0          0          0      33663
  6   43048879     271297          0          0         40         40       5377       5377          0     260463          0      48745
  7   31679199     278928          0          0         11         11       4030       4030          0     270846          0      15075
  8          0          0          0          0          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100    WR48-63       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0

 *** Program elapsed time:   40.309s (  793.875 blocks/s,  49.617 Mb/s)
Attachment 9: 220626_1435_stats.png
220626_1435_stats.png
Attachment 10: 220626_1435_Temp.png
220626_1435_Temp.png
Attachment 11: 220626_1436_Bias.png
220626_1436_Bias.png
Attachment 12: 220626_1620_Stats.png
220626_1620_Stats.png
Attachment 13: 220627_1620_Temp.png
220627_1620_Temp.png
Attachment 14: 220626_1621_Bias.png
220626_1621_Bias.png
Attachment 15: R5_591_analysis.txt
 *** TDR format 3.3.0 analyser - TD - May 2021
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  260421862 (  840783.5 Hz)
        Other data format:    1498138 (    4836.8 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:       1449 (       4.7 Hz)
                               RESUME:       1448 (       4.7 Hz)
                              SYNC100:      33154 (     107.0 Hz)
                              WR48-63:      33154 (     107.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:    1428933 (    4613.4 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:     452287 (    1460.2 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                              WR48-63:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:      309.737 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  0               13.828                0.000
  1               52.434                0.000
  2                0.366                0.000
  3                9.346                0.000
  4                0.001               63.918
  5                0.097                0.000
  6                0.290                0.000
  7                0.023                0.000
  8                0.000                0.000
  9                0.000                0.000
 10                0.000                0.000
 11                0.000                0.000
 12                0.000                0.000
 13                0.000                0.000
 14                0.000                0.000
 15                0.000                0.000
 16                0.000                0.000
 17                0.000                0.000
 18                0.000                0.000
 19                0.000                0.000
 20                0.000                0.000
 21                0.000                0.000
 22                0.000                0.000
 23                0.000                0.000
 24                0.000                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100    WR48-63       Disc        MBS      Other   HEC Data
  0   31248979      29393          0          0        283        282       4085       4085          0      20658          0     112900
  1   66285610      18734          0          0        794        794       8573       8573          0          0          0      62107
  2   22411069     363765          0          0         53         53       2890       2890          0     357879          0      73563
  3   44202913     357046          0          0        221        221       5556       5556          0     345492          0      37941
  4    5178577       1284          0          0          1          1        641        641          0          0          0      37680
  5   19493707       4858          0          0         26         26       2403       2403          0          0          0      44391
  6   39593301     355717          0          0         57         57       5081       5081          0     345441          0      63694
  7   32007706     367341          0          0         14         14       3925       3925          0     359463          0      20011
  8          0          0          0          0          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100    WR48-63       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0

 *** Program elapsed time:   41.789s (  765.751 blocks/s,  47.859 Mb/s)
Attachment 16: tmp_aida_stats.png
tmp_aida_stats.png
Attachment 17: tmp_aida_temps.png
tmp_aida_temps.png
Attachment 18: tmp_aida_hv.png
tmp_aida_hv.png
Attachment 19: R5_620
 *** TDR format 3.3.0 analyser - TD - May 2021
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  261173934 (  672570.7 Hz)
        Other data format:     746069 (    1921.3 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:        773 (       2.0 Hz)
                               RESUME:        773 (       2.0 Hz)
                              SYNC100:      33446 (      86.1 Hz)
                              WR48-63:      33446 (      86.1 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:     677631 (    1745.0 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:     225736 (     581.3 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                              WR48-63:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:      388.322 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  0                1.039                0.000
  1               21.090                0.000
  2                0.051                0.000
  3                0.148                0.000
  4                0.000               87.597
  5                0.001                0.000
  6                0.083                0.000
  7                0.003                0.000
  8                0.000                0.000
  9                0.000                0.000
 10                0.000                0.000
 11                0.000                0.000
 12                0.000                0.000
 13                0.000                0.000
 14                0.000                0.000
 15                0.000                0.000
 16                0.000                0.000
 17                0.000                0.000
 18                0.000                0.000
 19                0.000                0.000
 20                0.000                0.000
 21                0.000                0.000
 22                0.000                0.000
 23                0.000                0.000
 24                0.000                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100    WR48-63       Disc        MBS      Other   HEC Data
  0   25216948      33824          0          0         63         63       3334       3334          0      27030          0      55557
  1   75946108      20872          0          0        626        626       9810       9810          0          0          0      40146
  2   18060200     168976          0          0         23         23       2304       2304          0     164322          0      34386
  3   41452092     174351          0          0         26         26       5287       5287          0     163725          0      18377
  4    3680704        948          0          0          0          0        474        474          0          0          0      17387
  5   16518678       4150          0          0          1          1       2074       2074          0          0          0      20823
  6   44456577     169523          0          0         30         30       5686       5686          0     158091          0      29842
  7   35842627     173425          0          0          4          4       4477       4477          0     164463          0       9218
  8          0          0          0          0          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100    WR48-63       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0

 *** Program elapsed time:   41.547s (  770.214 blocks/s,  48.138 Mb/s)
Attachment 20: 220624_2021_Stats.png
220624_2021_Stats.png
Attachment 21: 220626_2021_Temp.png
220626_2021_Temp.png
Attachment 22: 220626_2022_Bias.png
220626_2022_Bias.png
Attachment 23: R5_637_analysis.txt
 *** TDR format 3.3.0 analyser - TD - May 2021
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  260438015 (  849636.0 Hz)
        Other data format:    1481985 (    4834.7 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:       1460 (       4.8 Hz)
                               RESUME:       1460 (       4.8 Hz)
                              SYNC100:      33142 (     108.1 Hz)
                              WR48-63:      33142 (     108.1 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:    1412781 (    4609.0 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:     447675 (    1460.5 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                              WR48-63:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:      306.529 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  0               15.951                0.000
  1               53.516                0.000
  2                0.642                0.000
  3                7.248                0.000
  4                0.000               53.241
  5                0.100                0.000
  6                0.344                0.000
  7                0.040                0.000
  8                0.000                0.000
  9                0.000                0.000
 10                0.000                0.000
 11                0.000                0.000
 12                0.000                0.000
 13                0.000                0.000
 14                0.000                0.000
 15                0.000                0.000
 16                0.000                0.000
 17                0.000                0.000
 18                0.000                0.000
 19                0.000                0.000
 20                0.000                0.000
 21                0.000                0.000
 22                0.000                0.000
 23                0.000                0.000
 24                0.000                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100    WR48-63       Disc        MBS      Other   HEC Data
  0   31824689      29138          0          0        291        291       4129       4129          0      20298          0     110511
  1   66116092      18806          0          0        788        788       8615       8615          0          0          0      62706
  2   22609638     359670          0          0         68         68       2899       2899          0     353736          0      72536
  3   44231727     352857          0          0        199        199       5696       5696          0     341067          0      37873
  4    5159378       1270          0          0          0          0        635        635          0          0          0      37425
  5   19491876       4836          0          0         27         27       2391       2391          0          0          0      43832
  6   39561529     352144          0          0         68         68       4899       4899          0     342210          0      62927
  7   31443086     363264          0          0         19         19       3878       3878          0     355470          0      19865
  8          0          0          0          0          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100    WR48-63       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0

 *** Program elapsed time:   42.891s (  746.084 blocks/s,  46.630 Mb/s)
Attachment 24: 220626_2211_Stats.png
220626_2211_Stats.png
Attachment 25: 220626_2211_Temps.png
220626_2211_Temps.png
Attachment 26: 220626_2212_Bias.png
220626_2212_Bias.png
Attachment 27: R5_658_analysis.txt
 *** TDR format 3.3.0 analyser - TD - May 2021
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  260445182 (  832450.2 Hz)
        Other data format:    1474818 (    4713.9 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:       1484 (       4.7 Hz)
                               RESUME:       1484 (       4.7 Hz)
                              SYNC100:      33166 (     106.0 Hz)
                              WR48-63:      33166 (     106.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:    1405518 (    4492.4 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:     448659 (    1434.0 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                              WR48-63:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:      312.866 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  0               15.080                0.000
  1               57.798                0.000
  2                0.343                0.000
  3                7.278                0.000
  4                0.000               44.445
  5                0.093                0.000
  6                0.265                0.000
  7                0.017                0.000
  8                0.000                0.000
  9                0.000                0.000
 10                0.000                0.000
 11                0.000                0.000
 12                0.000                0.000
 13                0.000                0.000
 14                0.000                0.000
 15                0.000                0.000
 16                0.000                0.000
 17                0.000                0.000
 18                0.000                0.000
 19                0.000                0.000
 20                0.000                0.000
 21                0.000                0.000
 22                0.000                0.000
 23                0.000                0.000
 24                0.000                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100    WR48-63       Disc        MBS      Other   HEC Data
  0   32528426      29869          0          0        310        310       4234       4234          0      20781          0     110841
  1   66604779      18608          0          0        825        825       8479       8479          0          0          0      61991
  2   23919816     357449          0          0         63         63       3136       3136          0     351051          0      72944
  3   47288432     353667          0          0        196        196       5939       5939          0     341397          0      38095
  4    5032393       1218          0          0          0          0        609        609          0          0          0      37603
  5   19089927       4824          0          0         28         28       2384       2384          0          0          0      44213
  6   39392581     350027          0          0         52         52       5076       5076          0     339771          0      63206
  7   26588828     359156          0          0         10         10       3309       3309          0     352518          0      19766
  8          0          0          0          0          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100    WR48-63       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0

 *** Program elapsed time:   42.102s (  760.067 blocks/s,  47.504 Mb/s)
  501   Sat Jun 25 22:48:57 2022 TDSunday 26 June 00:00-08:00
23.43 Check ASIC control
      Zero stats & all histograms

ASIC settings 2021Apr29-13-16-00
 slow comparator 0x64 -> 0xa

all waveform AD9252 ADCs disabled
all fast discs disabled

BNC PB-5 settings (to p+n FEE64s only)
 amplitude 1.0V
 attenuator x1
 decay time 1ms
 polarity +
 frequency 22Hz

All system wide checks OK *except* WR & FPGA errors - attachments 1 & 2

DSSSD bias & leakage currents OK - attachment 3

adc data item stats - attachment 4

FEE64 temps OK - attachment 5

DSSSD bias & leakage currents OK - attachment 6

analysis of file S505/R5_415 - attachment 7
 zero timewarps
 max deadtime aida02 c. 17%, all other FEE64s < 1%



02:36

analysis of file S505/R5_449 - attachment 8
 zero timewarps
 max deadtime aida02 c. 15%, all other FEE64s < 1%

per FEE64 rate & stat spectra - attachments 9 & 10

per p+n FEE64 1.8.L spectra - attachment 11
 aida01 pulser peak width 99 ch FWHM

per FEE64 1.8.H spectra - attachments 12 & 13

All system wide checks OK *except* WR & FPGA errors - attachments 14 & 15

adc data item stats - attachment 16

FEE64 temps OK - attachment 17

DSSSD bias & leakage currents OK - attachment 18


05:38

analysis of file S505/R5_483 - attachment 19
 zero timewarps
 max deadtime aida02 c. 16%, all other FEE64s < 2%

All system wide checks OK *except* WR & FPGA errors - attachments 20 & 21

adc data item stats - attachment 22

FEE64 temps OK - attachment 23

DSSSD bias & leakage currents OK - attachment 24



07:27

analysis of file S505/R5_502 - attachment 25
 zero timewarps
 max deadtime aida02 c. 16%, all other FEE64s < 2%

All system wide checks OK *except* WR & FPGA errors - attachments 26 & 27

adc data item stats - attachment 28

FEE64 temps OK - attachment 29

DSSSD bias & leakage currents OK - attachment 30
Attachment 1: Screenshot_from_2022-06-25_23-48-13.png
Screenshot_from_2022-06-25_23-48-13.png
Attachment 2: Screenshot_from_2022-06-25_23-47-49.png
Screenshot_from_2022-06-25_23-47-49.png
Attachment 3: Screenshot_from_2022-06-25_23-46-30.png
Screenshot_from_2022-06-25_23-46-30.png
Attachment 4: Screenshot_from_2022-06-25_23-45-38.png
Screenshot_from_2022-06-25_23-45-38.png
Attachment 5: Screenshot_from_2022-06-25_23-43-15.png
Screenshot_from_2022-06-25_23-43-15.png
Attachment 6: Screenshot_from_2022-06-25_23-42-41.png
Screenshot_from_2022-06-25_23-42-41.png
Attachment 7: R5_415
 *** TDR format 3.3.0 analyser - TD - May 2021
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  260603334 (  839394.5 Hz)
        Other data format:    1316666 (    4240.9 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:       1333 (       4.3 Hz)
                               RESUME:       1333 (       4.3 Hz)
                              SYNC100:      33156 (     106.8 Hz)
                              WR48-63:      33156 (     106.8 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:    1247688 (    4018.8 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:     404733 (    1303.6 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                              WR48-63:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:      310.466 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  0                5.804                0.000
  1               49.047                0.000
  2                0.579                0.000
  3                4.786                0.000
  4                0.000               41.193
  5                0.052                0.000
  6                0.398                0.000
  7                0.178                0.000
  8                0.000                0.000
  9                0.000                0.000
 10                0.000                0.000
 11                0.000                0.000
 12                0.000                0.000
 13                0.000                0.000
 14                0.000                0.000
 15                0.000                0.000
 16                0.000                0.000
 17                0.000                0.000
 18                0.000                0.000
 19                0.000                0.000
 20                0.000                0.000
 21                0.000                0.000
 22                0.000                0.000
 23                0.000                0.000
 24                0.000                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100    WR48-63       Disc        MBS      Other   HEC Data
  0   29744429      29368          0          0        191        191       3879       3879          0      21228          0     101774
  1   62881123      17488          0          0        744        744       8000       8000          0          0          0      60446
  2   27391657     317618          0          0         76         76       3507       3507          0     310452          0      64539
  3   52390232     315971          0          0        228        228       6571       6571          0     302373          0      33153
  4    4668386       1144          0          0          0          0        572        572          0          0          0      32450
  5   16955242       4388          0          0         19         19       2175       2175          0          0          0      39119
  6   36767424     310864          0          0         60         60       4661       4661          0     301422          0      55985
  7   29804841     319825          0          0         15         15       3791       3791          0     312213          0      17267
  8          0          0          0          0          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100    WR48-63       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0

 *** Program elapsed time:   42.203s (  758.238 blocks/s,  47.390 Mb/s)
Attachment 8: R5_449
 *** TDR format 3.3.0 analyser - TD - May 2021
 *** ERROR: READ I/O error:       5002
                   blocks:       9631
          ADC data format:   78467361 (  817544.9 Hz)
        Other data format:     362374 (    3775.5 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:        372 (       3.9 Hz)
                               RESUME:        372 (       3.9 Hz)
                              SYNC100:       9989 (     104.1 Hz)
                              WR48-63:       9989 (     104.1 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:     341652 (    3559.6 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:     112408 (    1171.2 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                              WR48-63:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:       95.979 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  0                1.159                0.000
  1               13.633                0.000
  2                0.066                0.000
  3                0.790                0.000
  4                0.000               20.217
  5                0.003                0.000
  6                0.066                0.000
  7                0.003                0.000
  8                0.000                0.000
  9                0.000                0.000
 10                0.000                0.000
 11                0.000                0.000
 12                0.000                0.000
 13                0.000                0.000
 14                0.000                0.000
 15                0.000                0.000
 16                0.000                0.000
 17                0.000                0.000
 18                0.000                0.000
 19                0.000                0.000
 20                0.000                0.000
 21                0.000                0.000
 22                0.000                0.000
 23                0.000                0.000
 24                0.000                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100    WR48-63       Disc        MBS      Other   HEC Data
  0    8759445       9043          0          0         45         45       1175       1175          0       6603          0      28377
  1   19225571       5374          0          0        215        215       2472       2472          0          0          0      17713
  2    7917505      86814          0          0         15         15       1017       1017          0      84750          0      17600
  3   15877732      87394          0          0         75         75       1976       1976          0      83292          0       9310
  4    1340586        302          0          0          0          0        151        151          0          0          0       8860
  5    4870076       1158          0          0          2          2        577        577          0          0          0      10559
  6   11177308      84854          0          0         17         17       1400       1400          0      82020          0      15171
  7    9299138      87435          0          0          3          3       1221       1221          0      84987          0       4818
  8          0          0          0          0          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100    WR48-63       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0

 *** Program elapsed time:   10.232s (  941.224 blocks/s,  58.826 Mb/s)
Attachment 9: Screenshot_from_2022-06-26_02-36-29.png
Screenshot_from_2022-06-26_02-36-29.png
Attachment 10: Screenshot_from_2022-06-26_02-34-58.png
Screenshot_from_2022-06-26_02-34-58.png
Attachment 11: Screenshot_from_2022-06-26_02-33-46.png
Screenshot_from_2022-06-26_02-33-46.png
Attachment 12: Screenshot_from_2022-06-26_02-32-48.png
Screenshot_from_2022-06-26_02-32-48.png
Attachment 13: Screenshot_from_2022-06-26_02-31-49.png
Screenshot_from_2022-06-26_02-31-49.png
Attachment 14: Screenshot_from_2022-06-26_02-30-49.png
Screenshot_from_2022-06-26_02-30-49.png
Attachment 15: Screenshot_from_2022-06-26_02-30-25.png
Screenshot_from_2022-06-26_02-30-25.png
Attachment 16: Screenshot_from_2022-06-26_02-29-31.png
Screenshot_from_2022-06-26_02-29-31.png
Attachment 17: Screenshot_from_2022-06-26_02-28-59.png
Screenshot_from_2022-06-26_02-28-59.png
Attachment 18: Screenshot_from_2022-06-26_02-28-31.png
Screenshot_from_2022-06-26_02-28-31.png
Attachment 19: R5_483
 *** TDR format 3.3.0 analyser - TD - May 2021
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  260645305 (  834521.2 Hz)
        Other data format:    1274695 (    4081.3 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:       1211 (       3.9 Hz)
                               RESUME:       1211 (       3.9 Hz)
                              SYNC100:      33162 (     106.2 Hz)
                              WR48-63:      33162 (     106.2 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:    1205949 (    3861.1 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:     393822 (    1260.9 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                              WR48-63:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:      312.329 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  0                5.184                0.000
  1               48.274                0.000
  2                0.431                0.000
  3                3.375                0.000
  4                0.000               25.625
  5                0.027                0.000
  6                0.216                0.000
  7                0.008                0.000
  8                0.000                0.000
  9                0.000                0.000
 10                0.000                0.000
 11                0.000                0.000
 12                0.000                0.000
 13                0.000                0.000
 14                0.000                0.000
 15                0.000                0.000
 16                0.000                0.000
 17                0.000                0.000
 18                0.000                0.000
 19                0.000                0.000
 20                0.000                0.000
 21                0.000                0.000
 22                0.000                0.000
 23                0.000                0.000
 24                0.000                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100    WR48-63       Disc        MBS      Other   HEC Data
  0   30200144      29499          0          0        166        166       3899       3899          0      21369          0      99521
  1   63245692      17566          0          0        710        710       8073       8073          0          0          0      60306
  2   25915590     306468          0          0         52         52       3383       3383          0     299598          0      62507
  3   52691198     306273          0          0        212        212       6559       6559          0     292731          0      32107
  4    4611863       1212          0          0          0          0        606        606          0          0          0      31071
  5   16567070       4140          0          0          9          9       2061       2061          0          0          0      37441
  6   37080833     301098          0          0         53         53       4819       4819          0     291354          0      54190
  7   30332915     308439          0          0          9          9       3762       3762          0     300897          0      16679
  8          0          0          0          0          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100    WR48-63       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0

 *** Program elapsed time:   35.023s (  913.674 blocks/s,  57.105 Mb/s)
Attachment 20: Screenshot_from_2022-06-26_05-40-48.png
Screenshot_from_2022-06-26_05-40-48.png
Attachment 21: Screenshot_from_2022-06-26_05-40-20.png
Screenshot_from_2022-06-26_05-40-20.png
Attachment 22: Screenshot_from_2022-06-26_05-39-34.png
Screenshot_from_2022-06-26_05-39-34.png
Attachment 23: Screenshot_from_2022-06-26_05-38-30.png
Screenshot_from_2022-06-26_05-38-30.png
Attachment 24: Screenshot_from_2022-06-26_05-37-55.png
Screenshot_from_2022-06-26_05-37-55.png
Attachment 25: R5_502
 *** TDR format 3.3.0 analyser - TD - May 2021
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  260592349 (  788577.6 Hz)
        Other data format:    1327651 (    4017.6 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:       1258 (       3.8 Hz)
                               RESUME:       1257 (       3.8 Hz)
                              SYNC100:      33231 (     100.6 Hz)
                              WR48-63:      33231 (     100.6 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:    1258674 (    3808.9 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:     409569 (    1239.4 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                              WR48-63:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:      330.459 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  0               10.444                0.000
  1               49.479                0.000
  2                0.188                0.000
  3                4.232                0.000
  4                0.000               57.929
  5                0.053                0.000
  6                0.278                0.000
  7                0.015                0.000
  8                0.000                0.000
  9                0.000                0.000
 10                0.000                0.000
 11                0.000                0.000
 12                0.000                0.000
 13                0.000                0.000
 14                0.000                0.000
 15                0.000                0.000
 16                0.000                0.000
 17                0.000                0.000
 18                0.000                0.000
 19                0.000                0.000
 20                0.000                0.000
 21                0.000                0.000
 22                0.000                0.000
 23                0.000                0.000
 24                0.000                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100    WR48-63       Disc        MBS      Other   HEC Data
  0   31755884      31086          0          0        242        242       4168       4168          0      22266          0     103011
  1   67198908      18739          0          0        724        723       8646       8646          0          0          0      63328
  2   19438169     317456          0          0         45         45       2440       2440          0     312486          0      65069
  3   45255369     318470          0          0        158        158       5750       5750          0     306654          0      33811
  4    4887217       1230          0          0          0          0        615        615          0          0          0      32106
  5   18040993       4688          0          0         19         19       2325       2325          0          0          0      38770
  6   42367504     314874          0          0         58         58       5348       5348          0     304062          0      56174
  7   31648305     321108          0          0         12         12       3939       3939          0     313206          0      17300
  8          0          0          0          0          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100    WR48-63       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0

 *** Program elapsed time:   33.316s (  960.488 blocks/s,  60.030 Mb/s)
Attachment 26: Screenshot_from_2022-06-26_07-29-14.png
Screenshot_from_2022-06-26_07-29-14.png
Attachment 27: Screenshot_from_2022-06-26_07-28-54.png
Screenshot_from_2022-06-26_07-28-54.png
Attachment 28: Screenshot_from_2022-06-26_07-28-22.png
Screenshot_from_2022-06-26_07-28-22.png
Attachment 29: Screenshot_from_2022-06-26_07-27-50.png
Screenshot_from_2022-06-26_07-27-50.png
Attachment 30: Screenshot_from_2022-06-26_07-27-21.png
Screenshot_from_2022-06-26_07-27-21.png
  282   Sun Apr 25 10:22:16 2021 TDSunday 25 April
11.25 All system wide checks OK *except*

	 Base 		Current 	Difference
aida01 fault 	 0xc95f : 	 0xc960 : 	 1  
aida02 fault 	 0x8bbe : 	 0x8bbf : 	 1  
aida03 fault 	 0xae9d : 	 0xae9e : 	 1  
aida04 fault 	 0x6e2 : 	 0x6e3 : 	 1  
aida05 fault 	 0x31a2 : 	 0x31a4 : 	 2  
aida05 : WR status 0x10
 aida06 fault 	 0x22e7 : 	 0x22ea : 	 3  
aida07 fault 	 0x438d : 	 0x438f : 	 2  
aida08 fault 	 0x61eb : 	 0x61ed : 	 2  
White Rabbit error counter test result: Passed 4, Failed 8
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
	
Returned 0 0 0 0 0 0 0 0 0 0 0 0  
Mem(KB) :	4	8	16	32	64	128	256	512	1k	2k	4k
aida01 :     55     21     31      6      3      2      2      3      2      3      4   : 28148
aida02 :     28      3      5      4      0      3      1      3      3      3      6   : 36312
aida03 :     25     10      2      2      2      4      1      3      3      3      6   : 36500
aida04 :     14      7     10      1      2      2      2      3      3      3      6   : 36528
aida05 :     58     35     28      6      4      2      2      3      3      3      4   : 29312
aida06 :     16     11      6      1      0      4      1      3      3      3      6   : 36376
aida07 :     75     31     25      9      4      3      2      2      2      3      4   : 27988
aida08 :     28      7      1      1      1      4      1      3      3      3      6   : 36376
aida09 :     50     48     28     10      3      3      3      4      2      3      4   : 29320
aida10 :     26      5      4      3      1      3      2      4      2      3      6   : 36080
aida11 :     21      7      5      3      5      2      2      4      2      3      6   : 36220
aida12 :     64     29     26      7      3      1      2      3      2      3      4   : 28072

 Collecting the file size of each FEE64 Options CONTENTS file to check they are all the same

 FEE : aida01 =>   Options file size is 1026 	 Last changed Sat Apr 24 03:57:22 CEST 2021
 FEE : aida02 =>   Options file size is 1014 	 Last changed Fri Apr 16 00:56:20 CEST 2021
 FEE : aida03 =>   Options file size is 1014 	 Last changed Wed Apr 14 21:52:04 CEST 2021
 FEE : aida04 =>   Options file size is 1025 	 Last changed Sat Apr 17 06:07:36 CEST 2021
 FEE : aida05 =>   Options file size is 1025 	 Last changed Fri Apr 16 00:53:25 CEST 2021
 FEE : aida06 =>   Options file size is 1014 	 Last changed Wed Apr 14 21:52:04 CEST 2021
 FEE : aida07 =>   Options file size is 1014 	 Last changed Wed Apr 14 21:52:04 CEST 2021
 FEE : aida08 =>   Options file size is 1014 	 Last changed Wed Apr 14 21:52:04 CEST 2021
 FEE : aida09 =>   Options file size is 1014 	 Last changed Wed Apr 14 21:52:05 CEST 2021
 FEE : aida10 =>   Options file size is 1014 	 Last changed Wed Apr 14 21:52:06 CEST 2021
 FEE : aida11 =>   Options file size is 1014 	 Last changed Wed Apr 14 21:52:05 CEST 2021
 FEE : aida12 =>   Options file size is 1025 	 Last changed Mon Apr 19 09:05:25 CEST 2021

Most recent merger errors reported - server terminal now reset & clear'd

MERGE Data Link (4408): bad timestamp  10 3 0xc2b67d8f 0x0b50c3e2 0x0000f437cb50c3e2 0x1678f437cb50c3e2 0x1678f43a16f1e6b2
MERGE Data Link (4408): bad timestamp  10 3 0xc2877f27 0x0b50cbb2 0x0000f437cb50cbb2 0x1678f437cb50cbb2 0x1678f43a16f1e6b2
MERGE Data Link (4408): bad timestamp  10 3 0xc2a07fcd 0x0b50cbb2 0x0000f437cb50cbb2 0x1678f437cb50cbb2 0x1678f43a16f1e6b2
MERGE Data Link (4408): bad timestamp  10 3 0xc2b77c9c 0x0b50cbb2 0x0000f437cb50cbb2 0x1678f437cb50cbb2 0x1678f43a16f1e6b2
MERGE Data Link (4408): bad timestamp  10 3 0xc28b7d9c 0x0b50d382 0x0000f437cb50d382 0x1678f437cb50d382 0x1678f43a16f1e6b2
MERGE Data Link (4408): bad timestamp  10 3 0xc2937e6c 0x0b50e322 0x0000f437cb50e322 0x1678f437cb50e322 0x1678f43a16f1e6b2
MERGE Data Link (4408): bad timestamp  10 3 0xc2a17d78 0x0b50e322 0x0000f437cb50e322 0x1678f437cb50e322 0x1678f43a16f1e6b2
MERGE Data Link (4408): bad timestamp  10 3 0xc2817fff 0x0b50eaf2 0x0000f437cb50eaf2 0x1678f437cb50eaf2 0x1678f43a16f1e6b2
MERGE Data Link (4408): bad timestamp  10 3 0xc2b77ecf 0x06fb3d52 0x0000f437cb50eaf2 0x1678f437c6fb3d52 0x1678f43a16f1e6b2

11.25 Grafana DSSSD bias |& leakage currents for previous 7 days - attachment 1
      DSSSD bias |& leakage currents Ok - attachment 2
      FEE64 temps OK - attachment 3
      good event stats - attachment 4
      merger time seq errors - attachment 5

      All histograms, stats and merge stats zero'd
      WR decoder errors *new*  baseline

11.45 1.8.L spectra - attachments 6 & 7
      peak width FWHM aida05 65 ch, aida06 95 ch
      1.8.W spectra = attachments 8 & 9
Attachment 1: Screenshot_2021-04-25_AIDA_Alerting_-_Grafana.png
Screenshot_2021-04-25_AIDA_Alerting_-_Grafana.png
Attachment 2: 300.png
300.png
Attachment 3: Screenshot_2021-04-25_Temperature_and_status_scan_aidas-gsi.png
Screenshot_2021-04-25_Temperature_and_status_scan_aidas-gsi.png
Attachment 4: Screenshot_2021-04-25_Statistics_aidas-gsi.png
Screenshot_2021-04-25_Statistics_aidas-gsi.png
Attachment 5: Screenshot_2021-04-25_NewMerger_Statistics_aidas-gsi.png
Screenshot_2021-04-25_NewMerger_Statistics_aidas-gsi.png
Attachment 6: Screenshot_2021-04-25_Spectrum_Browser_aidas-gsi.png
Screenshot_2021-04-25_Spectrum_Browser_aidas-gsi.png
Attachment 7: Screenshot_2021-04-25_Spectrum_Browser_aidas-gsi(1).png
Screenshot_2021-04-25_Spectrum_Browser_aidas-gsi(1).png
Attachment 8: Screenshot_2021-04-25_Spectrum_Browser_aidas-gsi(2).png
Screenshot_2021-04-25_Spectrum_Browser_aidas-gsi(2).png
Attachment 9: Screenshot_2021-04-25_Spectrum_Browser_aidas-gsi(3).png
Screenshot_2021-04-25_Spectrum_Browser_aidas-gsi(3).png
  345   Sat May 22 23:40:32 2021 TDSunday 23 May
00.40 Unable to connect to FEE64s 1-7
      DAQ power cycled OK

      ASIC settings 2021Apr29-13-16-00
      slow comparator 0x64 *all* FEE64s

      BNC PB-5 OFF

      file S496/R16

      alpha background

07.17 Some hot HEC channels
      ASIC check fixes issue
      System wide checks OK *except*

		 Base 		Current 	Difference
aida06 fault 	 0x5457 : 	 0x5457 : 	 0  
aida06 : WR status 0x10
 White Rabbit error counter test result: Passed 15, Failed 1

Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR


			 Base 		Current 		Difference
aida12 fault 	 0x0 : 	 0x1cd : 	 461  
FPGA Timestamp error counter test result: Passed 15, Failed 1
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last


Returned 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0  
Mem(KB) :	4	8	16	32	64	128	256	512	1k	2k	4k
aida01 :     16      9      4      3      1      4      3      2      1      4      7   : 40552
aida02 :      3      2      2      1      2      3      3      2      2      4      7   : 41308
aida03 :     14      5      0      1      1      3      2      4      2      3      7   : 40000
aida04 :     14      4      5      1      3      3      1      4      2      3      7   : 39944
aida05 :     12      4      1      3      2      3      3      2      2      4      7   : 41408
aida06 :      8      3      2      1      2      4      2      3      3      4      7   : 42744
aida07 :     10      4      3      2      1      2      2      3      2      4      7   : 41464
aida08 :      7      5      2      0      3      3      3      2      2      4      7   : 41380
aida09 :     10      5      1      1      1      2      2      3      2      4      7   : 41408
aida10 :     11      6      3      2      1      3      2      2      2      4      7   : 41100
aida11 :     12      8      3      2      2      2      3      2      1      4      7   : 40288
aida12 :      9      9      3      1      2      3      3      2      1      4      7   : 40380
aida13 :     10      4      0      1      1      2      1      3      2      4      7   : 41128
aida14 :      9      4      2      1      1      2      1      3      2      4      7   : 41156
aida15 :      5      4      0      3      3      3      3      3      2      4      7   : 41940
aida16 :      9      6      3      2      0      2      1      3      2      4      7   : 41156

Collecting the file size of each FEE64 Options CONTENTS file to check they are all the same

 FEE : aida01 =>   Options file size is 1026 	 Last changed Sun May 23 00:29:48 CEST 2021
 FEE : aida02 =>   Options file size is 1025 	 Last changed Sun May 23 00:19:21 CEST 2021
 FEE : aida03 =>   Options file size is 1014 	 Last changed Thu Apr 29 14:43:50 CEST 2021
 FEE : aida04 =>   Options file size is 1025 	 Last changed Fri May 14 16:54:56 CEST 2021
 FEE : aida05 =>   Options file size is 1025 	 Last changed Mon May 17 06:25:41 CEST 2021
 FEE : aida06 =>   Options file size is 1014 	 Last changed Thu Apr 29 14:43:59 CEST 2021
 FEE : aida07 =>   Options file size is 1014 	 Last changed Thu Apr 29 14:44:02 CEST 2021
 FEE : aida08 =>   Options file size is 1025 	 Last changed Sun May 23 00:16:54 CEST 2021
 FEE : aida09 =>   Options file size is 1014 	 Last changed Thu Apr 29 14:44:08 CEST 2021
 FEE : aida10 =>   Options file size is 1014 	 Last changed Thu Apr 29 14:44:57 CEST 2021
 FEE : aida11 =>   Options file size is 1014 	 Last changed Thu Apr 29 14:44:57 CEST 2021
 FEE : aida12 =>   Options file size is 1014 	 Last changed Thu Apr 29 14:44:57 CEST 2021
 FEE : aida13 =>   Options file size is 1025 	 Last changed Fri May 07 19:40:34 CEST 2021
 FEE : aida14 =>   Options file size is 1014 	 Last changed Thu Apr 29 14:44:57 CEST 2021
 FEE : aida15 =>   Options file size is 1014 	 Last changed Thu Apr 29 14:44:57 CEST 2021
 FEE : aida16 =>   Options file size is 1014 	 Last changed Thu Apr 29 14:44:57 CEST 2021

      FEE64 temperatures OK - attachment 1
      ADC data item stats - attachment 2
      Grafana DSSSD bias & leakage currents most recent 7 days - attachment 3
      DSSSD bias & leakage currents OK - attachment 4

11.18 Analysis of file S496/R16_33 - attachment 5

[npg@aidas-gsi S496]$ df -h
Filesystem            Size  Used Avail Use% Mounted on
/dev/mapper/vg_aidasgsi-lv_root
                       50G   18G   30G  37% /
tmpfs                 7.9G  685M  7.2G   9% /dev/shm
/dev/sda2             477M   42M  410M  10% /boot
/dev/sda1             200M  264K  200M   1% /boot/efi
/dev/mapper/vg_aidasgsi-lv_home
                      401G   90G  292G  24% /home
/dev/mapper/vg_aidas2-lv_home
                      7.2T  6.0T  867G  88% /media/1e121361-83d3-4825-b6ae-8700b07e0ca7
/dev/sdd1             7.2T  5.6T  1.3T  82% /media/SecondDrive
/dev/sdc1             7.2T  6.6T  259G  97% /media/ThirdDrive

867/2 x 3279s = 16.5 days to filesystem full - OK

12.11 aida15 zero data/poll stats - re-loaded DAQ program OK
      aida04 unable to connect - multiple merger starts ineffective - aida04 rebooted and DAQ re-started OK

      DAQ continues file S496/R18
Attachment 1: Screenshot_2021-05-23_AIDA_Alerting_-_Grafana.png
Screenshot_2021-05-23_AIDA_Alerting_-_Grafana.png
Attachment 2: Screenshot_2021-05-23_Statistics_aidas-gsi.png
Screenshot_2021-05-23_Statistics_aidas-gsi.png
Attachment 3: Screenshot_2021-05-23_Temperature_and_status_scan_aidas-gsi.png
Screenshot_2021-05-23_Temperature_and_status_scan_aidas-gsi.png
Attachment 4: 810.png
810.png
Attachment 5: R16_33
 *** TDR format 3.3.0 analyser - TD - May 2021
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:   47385414 (   14450.2 Hz)
        Other data format:  214534594 (   65422.3 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:         61 (       0.0 Hz)
                               RESUME:         61 (       0.0 Hz)
                              SYNC100:      44215 (      13.5 Hz)
                              WR48-63:      44215 (      13.5 Hz)
                           FEE64 disc:    1311957 (     400.1 Hz)
                             MBS info:  213134085 (   64995.2 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:          0 (       0.0 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                              WR48-63:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:     3279.230 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  0                0.000                0.000
  1                0.000                0.000
  2                0.386                0.000
  3                1.000                0.000
  4                0.000                0.000
  5                0.000             2849.824
  6                0.000                0.000
  7                0.000             2608.689
  8                0.000                0.000
  9                0.000                0.000
 10                0.000                0.000
 11                0.000                0.000
 12                0.000                0.000
 13                0.000                0.000
 14                0.000                0.000
 15                0.000                0.000
 16                0.000                0.000
 17                0.000                0.000
 18                0.000                0.000
 19                0.000                0.000
 20                0.000                0.000
 21                0.000                0.000
 22                0.000                0.000
 23                0.000                0.000
 24                0.000                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100    WR48-63       Disc        MBS      Other   HEC Data
  0         71          0          0          0          0          0          0          0          0          0          0          0
  1       1455          0          0          0          0          0          0          0          0          0          0          0
  2         87  106617422          0          0         35         35      20186      20186          0  106576980          0          0
  3   39184250  107913590          0          0         26         26      22238      22238    1311957  106557105          0          0
  4         63          0          0          0          0          0          0          0          0          0          0          0
  5    3345685       1512          0          0          0          0        756        756          0          0          0          0
  6         60          0          0          0          0          0          0          0          0          0          0          0
  7    4853274       2070          0          0          0          0       1035       1035          0          0          0          0
  8         69          0          0          0          0          0          0          0          0          0          0          0
  9         45          0          0          0          0          0          0          0          0          0          0          0
 10         70          0          0          0          0          0          0          0          0          0          0          0
 11         68          0          0          0          0          0          0          0          0          0          0          0
 12         89          0          0          0          0          0          0          0          0          0          0          0
 13         57          0          0          0          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0          0          0          0          0
 15         71          0          0          0          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100    WR48-63       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0

 *** Program elapsed time:   44.293s (  722.462 blocks/s,  45.154 Mb/s)
  470   Sun May 22 14:12:55 2022 TDSunday 22 May
15.11 DAQ stopped

Attachment 1 - DSSSD bias & leakage current

Attachment 2 - grafana DSSSD bias, leakage current - OK, temp data has ceased

Attachment 3 - FEE64 temps - OK
Attachment 1: Screenshot_from_2022-05-22_15-10-25.png
Screenshot_from_2022-05-22_15-10-25.png
Attachment 2: Screenshot_from_2022-05-22_15-10-48.png
Screenshot_from_2022-05-22_15-10-48.png
Attachment 3: Screenshot_from_2022-05-22_15-11-35.png
Screenshot_from_2022-05-22_15-11-35.png
  584   Sun Apr 21 00:34:33 2024 TDSunday 21 April
01.35 DSSSD bias & leakage current OK - Grafana - attachment 1

      FEE64 temperatures OK - attachment 2
 
      ADC data item stats OK - attachment 3

      Merger OK - attachment 4

04.05 DSSSD bias & leakage current OK - Grafana - attachment 5

      FEE64 temperatures OK - attachment 6
 
      ADC data item stats OK - attachment 7

      Merger OK - attachment 8

08.20 DSSSD bias & leakage current OK - Grafana - attachment 9

      FEE64 temperatures OK - attachment 10
 
      ADC data item stats - attachment 11
       increased rates observed esp. DSSSD#2 n+n

      Merger etc - attachment 12
      rate increased x2 cf. overnight

      WR timestamp - attachment 13
       aida03 out sequence

09.25 MBS data relay restarted

      Merger data links - attachment 14
       aida03 rate zero

      per FEE64 1.8.W spectra - 20us FSR - attachments 15-16

      per FEE64 Rate spectra - attachment 17
      increased rate for DSSSD#2 n+n FEE64s in particular

      MIDASsort online analysis - attachments 18-19
      per DSSSD e_front versus e_back for LEC (20keV/channel) and HEC (20MeV/channel)
      observe light ions (LEC) c. 2MeV
      observe low rate of high energy ions (HEC) c. 600MeV
      similar energies in both DSSSDs for LEC and HEC implying both types of event have range >> 2mm Si


10.09 DAQ STOP
      aida03 does not respond - reboot aida03

      DAQ RESET/SETUP etc     

      Synchronise ASIC clocks
      All system wide checks OK *except* FPGA errors

      Data transfer disabled
      Histograms & stats zero'd
      DAQ GO

      Merger restarted 

      Data transfer enabled
      DAQ GO

      WR timestamp OK - attachments 20-21

      ADC data item stats OK - attachment 22
       rates status quo ante
  
      Merger etc OK - attachment 23


14.58 DSSSD bias & leakage current OK - Grafana - attachment 24

      FEE64 temperatures OK - attachment 25

      ADC data item stats OK - attachment 26

      Merger etc OK - attachment 27

18.13 DSSSD bias & leakage current OK - Grafana - attachment 28

      FEE64 temperatures OK - attachment 29

      ADC data item stats OK - attachment 30

      Merger etc OK - attachment 31


20.30 Primary c, few kHz 170Er beam to S4 - upstream s/steel flange removed
      Start of stopping range calibration in the implantation stack - currently ion appear to be stopping in DSSSD#1 (upstream)


      Decay and implant events as function of time showing spill structure - attachment 32

      per DSSSD e_front versus e_back (HEC, 20MeV/channel) - attachment 33

      per DSSSD x versus y hit pattern (HEC) - attachment 34
       mapping to be configured but clear ions are mostly implanted in centre of DSSSD#1 

      2D colour/contour levels - attachment 35

      per DSSSD m_front versus m_back (HEC) - attachment 36

      per DSSSD per pixel HEC-HEC time (4.096us/channel) - attachment 37

23.44 aida02 has stopped running
      DAQ STOP
      aida02 rebooted

      Data transfer disabled

      DAQ RESET/SETUP 

      Synchronise ASIC clocks
      All system wide checks OK *except* FPGA errors

      Histograms & stats zero'd
      DAQ GO

      Merger restarted 

      Data transfer enabled
      DAQ GO







        


        
Attachment 1: Screenshot_from_2024-04-21_01-31-59.png
Screenshot_from_2024-04-21_01-31-59.png
Attachment 2: Screenshot_from_2024-04-21_01-32-50.png
Screenshot_from_2024-04-21_01-32-50.png
Attachment 3: Screenshot_from_2024-04-21_01-33-28.png
Screenshot_from_2024-04-21_01-33-28.png
Attachment 4: Screenshot_from_2024-04-21_01-34-10.png
Screenshot_from_2024-04-21_01-34-10.png
Attachment 5: Screenshot_from_2024-04-21_04-05-57.png
Screenshot_from_2024-04-21_04-05-57.png
Attachment 6: Screenshot_from_2024-04-21_04-06-58.png
Screenshot_from_2024-04-21_04-06-58.png
Attachment 7: Screenshot_from_2024-04-21_04-07-36.png
Screenshot_from_2024-04-21_04-07-36.png
Attachment 8: Screenshot_from_2024-04-21_04-08-08.png
Screenshot_from_2024-04-21_04-08-08.png
Attachment 9: Screenshot_from_2024-04-21_08-18-51.png
Screenshot_from_2024-04-21_08-18-51.png
Attachment 10: Screenshot_from_2024-04-21_08-19-50.png
Screenshot_from_2024-04-21_08-19-50.png
Attachment 11: Screenshot_from_2024-04-21_08-21-20.png
Screenshot_from_2024-04-21_08-21-20.png
Attachment 12: Screenshot_from_2024-04-21_08-22-42.png
Screenshot_from_2024-04-21_08-22-42.png
Attachment 13: Screenshot_from_2024-04-21_08-28-22.png
Screenshot_from_2024-04-21_08-28-22.png
Attachment 14: Screenshot_from_2024-04-21_09-27-50.png
Screenshot_from_2024-04-21_09-27-50.png
Attachment 15: Screenshot_from_2024-04-21_09-29-07.png
Screenshot_from_2024-04-21_09-29-07.png
Attachment 16: Screenshot_from_2024-04-21_09-30-08.png
Screenshot_from_2024-04-21_09-30-08.png
Attachment 17: Screenshot_from_2024-04-21_09-31-12.png
Screenshot_from_2024-04-21_09-31-12.png
Attachment 18: Screenshot_from_2024-04-21_09-37-11.png
Screenshot_from_2024-04-21_09-37-11.png
Attachment 19: Screenshot_from_2024-04-21_09-38-08.png
Screenshot_from_2024-04-21_09-38-08.png
Attachment 20: Screenshot_from_2024-04-21_10-18-25.png
Screenshot_from_2024-04-21_10-18-25.png
Attachment 21: Screenshot_from_2024-04-21_10-32-41.png
Screenshot_from_2024-04-21_10-32-41.png
Attachment 22: Screenshot_from_2024-04-21_10-33-08.png
Screenshot_from_2024-04-21_10-33-08.png
Attachment 23: Screenshot_from_2024-04-21_10-33-33.png
Screenshot_from_2024-04-21_10-33-33.png
Attachment 24: Screenshot_from_2024-04-21_14-58-07.png
Screenshot_from_2024-04-21_14-58-07.png
Attachment 25: Screenshot_from_2024-04-21_14-58-31.png
Screenshot_from_2024-04-21_14-58-31.png
Attachment 26: Screenshot_from_2024-04-21_14-58-48.png
Screenshot_from_2024-04-21_14-58-48.png
Attachment 27: Screenshot_from_2024-04-21_14-59-00.png
Screenshot_from_2024-04-21_14-59-00.png
Attachment 28: Screenshot_from_2024-04-21_18-13-44.png
Screenshot_from_2024-04-21_18-13-44.png
Attachment 29: Screenshot_from_2024-04-21_18-14-06.png
Screenshot_from_2024-04-21_18-14-06.png
Attachment 30: Screenshot_from_2024-04-21_18-14-24.png
Screenshot_from_2024-04-21_18-14-24.png
Attachment 31: Screenshot_from_2024-04-21_18-14-40.png
Screenshot_from_2024-04-21_18-14-40.png
Attachment 32: Screenshot_from_2024-04-21_20-54-50.png
Screenshot_from_2024-04-21_20-54-50.png
Attachment 33: Screenshot_from_2024-04-21_20-54-18.png
Screenshot_from_2024-04-21_20-54-18.png
Attachment 34: Screenshot_from_2024-04-21_20-54-03.png
Screenshot_from_2024-04-21_20-54-03.png
Attachment 35: Screenshot_from_2024-04-21_20-53-41.png
Screenshot_from_2024-04-21_20-53-41.png
Attachment 36: Screenshot_from_2024-04-21_20-53-31.png
Screenshot_from_2024-04-21_20-53-31.png
Attachment 37: Screenshot_from_2024-04-21_21-02-02.png
Screenshot_from_2024-04-21_21-02-02.png
  635   Sun Jun 2 01:45:05 2024 TDSunday 2 June
02.41 DSSSD bias & leakage current - attachment 1

      FEE64 temps OK - attachment 2

      ADC data item stats - attachment 3

      per FEE64 Stat spectra - attachment 4


06.52 DSSSD bias & leakage current - attachment 5

      FEE64 temps OK - attachment 6

      ADC data item stats - attachment 7

      per FEE64 Stat spectra - attachment 8

12.13 DSSSD bias & leakage current - attachment 9

      FEE64 temps OK - attachment 10

      ADC data item stats - attachment 11

      per FEE64 Stat spectra - attachment 12


14.51 DSSSD bias & leakage current - attachments 13-14

      FEE64 temps OK - attachment 15

      ADC data item stats - attachment 16

      per FEE64 Stat spectra - attachment 17

21.49 DSSSD bias & leakage current - attachment 18

      FEE64 temps OK - attachment 19

      ADC data item stats - attachment 20

      per FEE64 Stat spectra - attachment 21


03.55 DSSSD bias & leakage current - attachment 22

      FEE64 temps OK - attachment 23

      ADC data item stats - attachment 24

      per FEE64 Stat spectra - attachment 25
Attachment 1: Screenshot_from_2024-06-02_02-40-53.png
Screenshot_from_2024-06-02_02-40-53.png
Attachment 2: Screenshot_from_2024-06-02_02-41-25.png
Screenshot_from_2024-06-02_02-41-25.png
Attachment 3: Screenshot_from_2024-06-02_02-41-49.png
Screenshot_from_2024-06-02_02-41-49.png
Attachment 4: Screenshot_from_2024-06-02_02-42-57.png
Screenshot_from_2024-06-02_02-42-57.png
Attachment 5: Screenshot_from_2024-06-02_06-52-56.png
Screenshot_from_2024-06-02_06-52-56.png
Attachment 6: Screenshot_from_2024-06-02_06-53-29.png
Screenshot_from_2024-06-02_06-53-29.png
Attachment 7: Screenshot_from_2024-06-02_06-53-57.png
Screenshot_from_2024-06-02_06-53-57.png
Attachment 8: Screenshot_from_2024-06-02_06-54-52.png
Screenshot_from_2024-06-02_06-54-52.png
Attachment 9: Screenshot_from_2024-06-02_12-13-13.png
Screenshot_from_2024-06-02_12-13-13.png
Attachment 10: Screenshot_from_2024-06-02_12-13-46.png
Screenshot_from_2024-06-02_12-13-46.png
Attachment 11: Screenshot_from_2024-06-02_12-14-07.png
Screenshot_from_2024-06-02_12-14-07.png
Attachment 12: Screenshot_from_2024-06-02_12-15-07.png
Screenshot_from_2024-06-02_12-15-07.png
Attachment 13: Screenshot_from_2024-06-02_14-47-23.png
Screenshot_from_2024-06-02_14-47-23.png
Attachment 14: Screenshot_from_2024-06-02_14-51-12.png
Screenshot_from_2024-06-02_14-51-12.png
Attachment 15: Screenshot_from_2024-06-02_14-51-45.png
Screenshot_from_2024-06-02_14-51-45.png
Attachment 16: Screenshot_from_2024-06-02_14-52-12.png
Screenshot_from_2024-06-02_14-52-12.png
Attachment 17: Screenshot_from_2024-06-02_14-52-46.png
Screenshot_from_2024-06-02_14-52-46.png
Attachment 18: Screenshot_from_2024-06-02_21-47-35.png
Screenshot_from_2024-06-02_21-47-35.png
Attachment 19: Screenshot_from_2024-06-02_21-48-05.png
Screenshot_from_2024-06-02_21-48-05.png
Attachment 20: Screenshot_from_2024-06-02_21-48-30.png
Screenshot_from_2024-06-02_21-48-30.png
Attachment 21: Screenshot_from_2024-06-02_21-49-08.png
Screenshot_from_2024-06-02_21-49-08.png
Attachment 22: Screenshot_from_2024-06-03_03-55-12.png
Screenshot_from_2024-06-03_03-55-12.png
Attachment 23: Screenshot_from_2024-06-03_03-55-56.png
Screenshot_from_2024-06-03_03-55-56.png
Attachment 24: Screenshot_from_2024-06-03_03-56-23.png
Screenshot_from_2024-06-03_03-56-23.png
Attachment 25: Screenshot_from_2024-06-03_03-58-23.png
Screenshot_from_2024-06-03_03-58-23.png
  484   Sun Jun 19 12:36:10 2022 OHSunday 19th June
Yesterday the sum/inverter was found to be a considerable source of noise in the system.

Plugging it into an oscilloscope this morning it was clear there was a Vpp 17mv 60kHz sin wave in its signal - attachment 1 yellow trace

Moved the inverter to a crate in the messheute and did not see same behaviour. This time see Vpp 5mV and a ~265Hz wave that looks much less clean. - attachment 2 yellow

Put inverter back in CAEN crate in S4 and confirm similar behavior.

Move CAEN crate to new mains port, same behaviour

Move CAEN crate to AC voltage stabiliser, same behaviour

Remove module one by one from CAEN crate.
Removing BIAS supply - No change
Remove Pulser - No change
Remove right most MACB - No change
Remove second right most MACB - Signal disappears  - attachment 3 blue trace
Remove second right most MACB from the rack entirely
Put right most MACB back - Signal comes back - attachment 4 blue trace
Test MACB with and without HDMI connectors connected signal remains
Remove rightmost MACB from the rack - Signal disappears

Put pulser and bias back - Signal does not return
Signal also doesn't return when ramping up bias or running the pulser
Power DAQ up - No change in performance from yesterday with inverter removed.

MACB and Inverter don't share any voltages on NIM:
MACB +-6V and Gnd
Inverter +-24V and Gnd

CAEN Crate does not have any easily accessible monitoring points. Anyone have any ideas?

MACBs and inverter checked on another crate - no signal

Inverter put back in CAEN crate and no noise observed on scope.
With waveforms disabled am able to get <100kHz on all FEEs with the pulser connected

Tested adding bias filters - No change

15:30 Nic realised that one of the mains boxes is labelled measurement network so we connect the AIDA PSU to this via the ac stabiliser
      We get ok stats even with waveforms on at 0xa- attachment 5

      Waveforms still have the 100kHz oscillation in them though attachments 6 and 7

      Without waveforms we get similar performance to before the switch to the new mains - attachment 8

15:56 Move CAEN NIM crate across to this mains network
      300+kHz on all FEEs with waveforms on. Can recover waveform off performance though

16:01 Place CAEN NIM crate back onto platform mains but don't recover the ealier rates with waveform. Everything still around 300kHz.

17:43 Current best settings are waveforms off and we can run at 0xa on all FEEs - attachment 9
Attachment 1: 1.jpg
1.jpg
Attachment 2: 2.jpg
2.jpg
Attachment 3: 3.jpg
3.jpg
Attachment 4: 4.jpg
4.jpg
Attachment 5: 220618_1753_stats_no_waveform.png
220618_1753_stats_no_waveform.png
  483   Sun Jun 19 00:22:24 2022 TDSunday 19 June
01.20 

ASIC settings 2021Apr29-13-16-00
 *except* slow comparator 0x64 -> 0xa

All waveform ADCs disabled

BNC PB-5 pulser
 to p+n FEE64s only

all system wide checks OK *except* ADC calibration, WR decoder & FPGA timestamp errors - see attachments 1 & 2

DSSSD bias & leakage current OK - see attachments 3 & 4

FEE64 temps OK - see attachment 5

statistics OK - ADC data, pause, resume & correlation scaler data items
                data push, data flush, aida01, aida02 - see attachments 6-13

per FEE64 1.8.L spectra - see attachment 14
 aida01 pulser peak width 73 ch FWHM
Attachment 1: Screenshot_from_2022-06-19_01-24-50.png
Screenshot_from_2022-06-19_01-24-50.png
Attachment 2: Screenshot_from_2022-06-19_01-24-24.png
Screenshot_from_2022-06-19_01-24-24.png
Attachment 3: Screenshot_from_2022-06-19_01-20-50.png
Screenshot_from_2022-06-19_01-20-50.png
Attachment 4: Screenshot_from_2022-06-19_01-20-09.png
Screenshot_from_2022-06-19_01-20-09.png
Attachment 5: Screenshot_from_2022-06-19_01-19-37.png
Screenshot_from_2022-06-19_01-19-37.png
Attachment 6: Screenshot_from_2022-06-19_01-18-35.png
Screenshot_from_2022-06-19_01-18-35.png
Attachment 7: Screenshot_from_2022-06-19_01-18-05.png
Screenshot_from_2022-06-19_01-18-05.png
Attachment 8: Screenshot_from_2022-06-19_01-17-28.png
Screenshot_from_2022-06-19_01-17-28.png
Attachment 9: Screenshot_from_2022-06-19_01-15-44.png
Screenshot_from_2022-06-19_01-15-44.png
Attachment 10: Screenshot_from_2022-06-19_01-14-59.png
Screenshot_from_2022-06-19_01-14-59.png
Attachment 11: Screenshot_from_2022-06-19_01-14-24.png
Screenshot_from_2022-06-19_01-14-24.png
Attachment 12: Screenshot_from_2022-06-19_01-13-43.png
Screenshot_from_2022-06-19_01-13-43.png
Attachment 13: Screenshot_from_2022-06-19_01-13-03.png
Screenshot_from_2022-06-19_01-13-03.png
Attachment 14: Screenshot_from_2022-06-19_01-12-16.png
Screenshot_from_2022-06-19_01-12-16.png
  238   Sun Apr 18 07:30:20 2021 DJ, TDSunday 18th April 08:00-12:00

---- 09-26
FEE64 module aida06 failed
FEE64 module aida07 failed
FEE64 module aida10 failed
Calibration test result: Passed 9, Failed 3

If any modules fail calibration , check the clock status and open the FADC Align and Control browser page to rerun calibration for that module

---


         Base         Current     Difference
aida01 fault      0x7685 :      0x7686 :      1  
aida02 fault      0x941c :      0x941d :      1  
aida03 fault      0x7cd6 :      0x7cd7 :      1  
aida04 fault      0xb86c :      0xb86d :      1  
aida05 fault      0x1a52 :      0x1a59 :      7  
aida06 fault      0x4f3e :      0x4f45 :      7  
aida07 fault      0x3bcd :      0x3bfc :      47  
aida08 fault      0xc7c7 :      0xc7ce :      7  
aida09 fault      0xb33a :      0xb33b :      1  
White Rabbit error counter test result: Passed 3, Failed 9

Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR

--


         Base         Current     Difference
aida01 fault      0x7685 :      0x7686 :      1  
aida02 fault      0x941c :      0x941d :      1  
aida03 fault      0x7cd6 :      0x7cd7 :      1  
aida04 fault      0xb86c :      0xb86d :      1  
aida05 fault      0x1a52 :      0x1a59 :      7  
aida06 fault      0x4f3e :      0x4f45 :      7  
aida07 fault      0x3bcd :      0x3bfc :      47  
aida08 fault      0xc7c7 :      0xc7ce :      7  
aida09 fault      0xb33a :      0xb33b :      1  
White Rabbit error counter test result: Passed 3, Failed 9

Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR

-


         Base         Current     Difference
aida01 fault      0x7685 :      0x7686 :      1  
aida02 fault      0x941c :      0x941d :      1  
aida03 fault      0x7cd6 :      0x7cd7 :      1  
aida04 fault      0xb86c :      0xb86d :      1  
aida05 fault      0x1a52 :      0x1a59 :      7  
aida06 fault      0x4f3e :      0x4f45 :      7  
aida07 fault      0x3bcd :      0x3bfc :      47  
aida08 fault      0xc7c7 :      0xc7ce :      7  
aida09 fault      0xb33a :      0xb33b :      1  
White Rabbit error counter test result: Passed 3, Failed 9

Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR

 

 

08.45 TD resets baseline for WR and FPGA errors

 

Attachment 1: Screenshot_2021-04-18_Statistics_aidas-gsi.png
Screenshot_2021-04-18_Statistics_aidas-gsi.png
Attachment 2: Screenshot_2021-04-18_Temperature_and_status_scan_aidas-gsi.png
Screenshot_2021-04-18_Temperature_and_status_scan_aidas-gsi.png
Attachment 3: 52.png
52.png
Attachment 4: 53.png
53.png
Attachment 5: Screenshot_2021-04-18_Temperature_and_status_scan_aidas-gsi(1).png
Screenshot_2021-04-18_Temperature_and_status_scan_aidas-gsi(1).png
Attachment 6: 54.png
54.png
Attachment 7: Screenshot_2021-04-18_Statistics_aidas-gsi(1).png
Screenshot_2021-04-18_Statistics_aidas-gsi(1).png
ELOG V3.1.4-unknown