12.18 DAQ continues file NULL/R30_490

      ASIC settings 2019Dec19-16.19.51
      slow comparator 0x64 -> 0xa

      BNC PB-5
      amplitude 2V
      attenuation 1x
      decay time 1ms
      frequency 2Hz

12.22 all histograms zero'd

c. 12.30 219Rn setting

12.35 analysis of R30_490 - see attachment 1

13.15 system wide checks

Clock status test result: Passed 12, Failed 0
Understand status as follows
Status bit 3 : firmware PLL that creates clocks from external clock not locked
Status bit 2 : always logic '1' 
Status bit 1 : LMK3200(2) PLL and clock distribution chip not locked to external clock
Status bit 0 : LMK3200(1) PLL and clock distribution chip not locked to external clock
If all these bits are not set then the operation of the firmware is unreliable

FEE64 module aida06 failed
FEE64 module aida07 failed
FEE64 module aida10 failed
Calibration test result: Passed 9, Failed 3
If any modules fail calibration , check the clock status and open the FADC Align and Control browser page to rerun calibration for that module

	 Base 		Current 	Difference
aida01 fault 	 0x7686 : 	 0x768a : 	 4  
aida02 fault 	 0x941d : 	 0x9421 : 	 4  
aida03 fault 	 0x7cd7 : 	 0x7cdb : 	 4  
aida04 fault 	 0xb86d : 	 0xb871 : 	 4  
aida05 fault 	 0x1a59 : 	 0x1a5f : 	 6  
aida06 fault 	 0x4f45 : 	 0x4f4b : 	 6  
aida07 fault 	 0x3bfc : 	 0x3c04 : 	 8  
aida08 fault 	 0xc7ce : 	 0xc7d4 : 	 6  
aida09 fault 	 0xb33b : 	 0xb33c : 	 1  
White Rabbit error counter test result: Passed 3, Failed 9
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR

			 Base 		Current 		Difference
aida12 fault 	 0xa : 	 0xb : 	 1  
FPGA Timestamp error counter test result: Passed 11, Failed 1
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last


Returned 0 0 0 0 0 0 0 0 0 0 0 0  
Mem(KB) :	4	8	16	32	64	128	256	512	1k	2k	4k
aida01 :     23     10      3      1      1      2      1      3      3      3      6   : 36156
aida02 :      2     11      7      4      2      2      2      4      2      3      6   : 36048
aida03 :     21      8      6      4      5      4      3      3      2      3      6   : 36276
aida04 :     19     11     14      3      2      3      2      4      2      3      6   : 36324
aida05 :     25      4      5      4      4      2      1      3      2      4      6   : 37460
aida06 :     13      9     15      1      3      5      1      3      3      3      6   : 36812
aida07 :     19     10      6      1      3      3      2      2      4      3      6   : 37212
aida08 :     23      6      4      2      1      1      3      4      2      3      6   : 36044
aida09 :     11      5      5      1      2      4      3      3      2      3      6   : 35908
aida10 :     14      5      6      5      3      1      3      3      2      3      6   : 35744
aida11 :     16      5      3      0      3      3      1      4      2      3      6   : 35800
aida12 :     12     10      0      2      4      4      1      3      3      3      6   : 36544

 Collecting the file size of each FEE64 Options CONTENTS file to check they are all the same

 FEE : aida01 =>   Options file size is 1025 	 Last changed Sat Apr 17 06:14:30 CEST 2021
 FEE : aida02 =>   Options file size is 1014 	 Last changed Fri Apr 16 00:56:20 CEST 2021
 FEE : aida03 =>   Options file size is 1014 	 Last changed Wed Apr 14 21:52:04 CEST 2021
 FEE : aida04 =>   Options file size is 1025 	 Last changed Sat Apr 17 06:07:36 CEST 2021
 FEE : aida05 =>   Options file size is 1025 	 Last changed Fri Apr 16 00:53:25 CEST 2021
 FEE : aida06 =>   Options file size is 1014 	 Last changed Wed Apr 14 21:52:04 CEST 2021
 FEE : aida07 =>   Options file size is 1014 	 Last changed Wed Apr 14 21:52:04 CEST 2021
 FEE : aida08 =>   Options file size is 1014 	 Last changed Wed Apr 14 21:52:04 CEST 2021
 FEE : aida09 =>   Options file size is 1014 	 Last changed Wed Apr 14 21:52:05 CEST 2021
 FEE : aida10 =>   Options file size is 1014 	 Last changed Wed Apr 14 21:52:06 CEST 2021
 FEE : aida11 =>   Options file size is 1014 	 Last changed Wed Apr 14 21:52:05 CEST 2021
 FEE : aida12 =>   Options file size is 1025 	 Last changed Wed Apr 14 21:58:54 CEST 2021

*no faults detected by ~/oh/OptionsCheck.py

13.10 Detector biases & leakage currents OK - see attachment 2
      Statistics - good events, adc data, disc data, info code 4 & 5, pause, resume, correlation info - attachments 3-12
      per FEE64 rate spectra - attachments 13-14
      1.8.L spectra - attachments 15-18

       pulser peak widths
       1 80
       2 113
       3 308
       4 105
       5 50
       6 91
       7 61
       8 90
       9 200
       10 133
       11 187
       12 107
  
      1.8.H spectra - attachments 19-20
      1.8.W spectra - attachments 21-22
      ucesb - attachment 23
       implant rates DSSSD#1-3 to c. 1kHz
      grafana - AIDA DSSSD leakage currents for previous 2 days - attachment 24
      merger & merger/tape server/mbs data tranfser - attachment 25
       no recent merger warning/error messages

13.30 225At setting