| ID |
Date |
Author |
Subject |
|
197
|
Sat Mar 13 23:08:08 2021 |
CA | 14th March 00:00-08:00 |
00:08 DAQ continues ok - writing to file R46_221
ASIC settings 2019Dec19-16.19.51
DSSSD#1 slow comparator 0xa
DSSSD#2 slow comparator 0xa
DSSSD#3 slow comparator 0xd
BNC PB-5 Pulser
Amplitude1.0V
Attenuation x1
Frequency 2Hz
tau_d 1ms
- polarity
Delay 250ns, tail pulse
00:09 system wide checks:
FEE64 module aida09 global clocks failed, 6
Clock status test result: Passed 11, Failed 1
Understand status as follows
Status bit 3 : firmware PLL that creates clocks from external clock not locked
Status bit 2 : always logic '1'
Status bit 1 : LMK3200(2) PLL and clock distribution chip not locked to external clock
Status bit 0 : LMK3200(1) PLL and clock distribution chip not locked to external clock
If all these bits are not set then the operation of the firmware is unreliable
FEE64 module aida09 failed
Calibration test result: Passed 11, Failed 1
If any modules fail calibration , check the clock status and open the FADC Align and Control browser page to rerun calibration for that module
Base Current Difference
aida07 fault 0x82a0 : 0x82a4 : 4
White Rabbit error counter test result: Passed 11, Failed 1
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
Base Current Difference
aida07 fault 0x2 : 0x3 : 1
FPGA Timestamp error counter test result: Passed 11, Failed 1
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last
Returned 0 0 0 0 0 0 0 0 0 0 0 0
Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k
aida01 : 11 6 2 5 1 3 2 2 3 4 10 : 54492
aida02 : 12 7 3 4 3 3 3 2 3 3 6 : 36440
aida03 : 4 4 2 4 2 3 2 2 3 3 6 : 36048
aida04 : 18 9 4 2 1 3 2 4 1 4 15 : 73936
aida05 : 31 11 8 7 6 4 2 18 7 4 7 : 55220
aida06 : 36 8 18 4 4 2 1 4 3 2 5 : 31088
aida07 : 26 7 4 3 1 2 1 3 3 3 6 : 36224
aida08 : 25 12 5 4 4 3 2 3 3 3 6 : 36884
aida09 : 2 9 4 2 2 2 2 3 3 3 6 : 36432
aida10 : 11 3 4 6 4 3 1 3 3 3 6 : 36548
aida11 : 21 8 5 0 1 3 3 3 2 3 6 : 35748
aida12 : 10 6 6 2 4 4 1 3 3 3 6 : 36600
00:14 FEE64 Temperatures ok - attachment 1
Good event statistics ok - attachment 2
Detector bias/leakage currents ok - attachment 3
00:17 Merger ok - 4.4M items/s
TapeServer ok - 14 MB/s
01:30 beam off
01:31 beam back
02:19 system wide checks
same as entry at 00:09, *except*
Base Current Difference
aida07 fault 0x82a0 : 0x82a5 : 5
White Rabbit error counter test result: Passed 11, Failed 1
02:22 FEE64 Temperatures ok - attachment 4
Good event statistics ok - attachment 5
Detector bias/leakage currents ok - attachment 6
02:30 Merger ok - 4.4M items/s
TapeServer ok - 14 MB/s
no further bad timestamp errors in NewMerger terminal
02:40 ... burst of bad timestamp errors in NewMerger terminal - attachment 7
02:50 ... and sure enough lose connection to aida07 after checking stats
DAQ stop, Merger/TapeServer closed
telnet aida07 -> sent reboot command
mounted ok, reset DAQ, TapeService and Merge
restarted DATA forwarding to MBS
all looks to be ok now -> writing to R56
03:09 system wide checks:
FEE64 module aida09 global clocks failed, 6
Clock status test result: Passed 11, Failed 1
Understand status as follows
Status bit 3 : firmware PLL that creates clocks from external clock not locked
Status bit 2 : always logic '1'
Status bit 1 : LMK3200(2) PLL and clock distribution chip not locked to external clock
Status bit 0 : LMK3200(1) PLL and clock distribution chip not locked to external clock
If all these bits are not set then the operation of the firmware is unreliable
FEE64 module aida07 failed
FEE64 module aida09 failed
Calibration test result: Passed 10, Failed 2
If any modules fail calibration , check the clock status and open the FADC Align and Control browser page to rerun calibration for that module
Base Current Difference
aida07 fault 0x2 : 0x5 : 3
FPGA Timestamp error counter test result: Passed 11, Failed 1
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last
Returned 0 0 0 0 0 0 0 0 0 0 0 0
Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k
aida01 : 13 5 3 7 2 2 2 2 3 4 10 : 54508
aida02 : 2 7 3 2 2 3 1 4 3 3 6 : 36784
aida03 : 8 8 1 3 2 3 1 3 3 3 6 : 36304
aida04 : 20 9 2 3 0 3 2 4 1 4 15 : 73880
aida05 : 51 74 70 54 53 49 22 18 7 4 7 : 72188
aida06 : 15 15 3 9 1 2 2 4 3 2 5 : 31044
aida07 : 24 6 2 3 3 4 2 3 2 3 7 : 39888
aida08 : 19 15 1 2 1 3 1 4 3 3 6 : 36820
aida09 : 18 4 2 7 3 4 1 3 3 3 6 : 36648
aida10 : 20 7 1 1 1 3 3 2 3 3 6 : 36216
aida11 : 25 7 5 3 4 2 1 4 2 3 6 : 35916
aida12 : 3 3 2 2 3 2 3 2 3 3 6 : 36164
03:18 FEE64 Temperatures ok - attachment 8
Good event statistics ok - attachment 9
Detector bias/leakage currents ok - attachment 10
Merger ok - 4.4M items/s
TapeServer ok - 14 MB/s
03:29 more bad timestamp error messages - attachment 11
03:52 analyser output on R56_35 - attachment 12
no timewarps
03:53 DAQ continues ok, writing to file R56_41
05:18 system wide checks:
same as entry at 03:08, *but* with additional WR decoder status error
Base Current Difference
aida07 fault 0x8c74 : 0x8c77 : 3
White Rabbit error counter test result: Passed 11, Failed 1
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
05:19 FEE64 Temperatures ok - attachment 14
Good event statistics ok - attachment 13
Detector bias/leakage currents ok - attachment 15
Merger ok - 4.4M items/s
TapeServer ok - 15 MB/s
05:25 rate spectra - attachment 16
05:33 AIDA implant XY hit patterns - attachments 17/18/19
05:56 BuTIS interface control set to 0x3 at 04.52 UTC
07:06 system wide checks - same error messages as entry at 05:18
07:08 FEE64 Temperatures ok - attachment 20
good event statistics ok - attachment 21
detector bias/leakage currents ok - attachment 22
Merger ok - 4.3M items/s
TapeServer ok - 15 MB/s
07:22 no bad timestamp errors since 02:30 UTC |
| Attachment 1: Screenshot_from_2021-03-13_23-14-33.png
|
|
| Attachment 2: Screenshot_from_2021-03-13_23-14-57.png
|
|
| Attachment 3: Screenshot_from_2021-03-13_23-15-12.png
|
|
| Attachment 4: Screenshot_from_2021-03-14_01-22-56.png
|
|
| Attachment 5: Screenshot_from_2021-03-14_01-29-35.png
|
|
| Attachment 6: Screenshot_from_2021-03-14_01-29-52.png
|
|
| Attachment 7: Screenshot_from_2021-03-14_01-40-57.png
|
|
| Attachment 8: Screenshot_from_2021-03-14_02-16-28.png
|
|
| Attachment 9: Screenshot_from_2021-03-14_02-17-01.png
|
|
| Attachment 10: Screenshot_from_2021-03-14_02-17-32.png
|
|
| Attachment 11: Screenshot_from_2021-03-14_02-29-29.png
|
|
| Attachment 12: R56_35
|
*** TDR format 3.3.0 analyser - TD - January 2019
*** ERROR: READ I/O error: 5002
blocks: 32000
ADC data format: 261409816 ( 1907248.6 Hz)
Other data format: 510184 ( 3722.3 Hz)
Sample trace data format: 0 ( 0.0 Hz)
Undefined format: 0 ( 0.0 Hz)
Other data format type: PAUSE: 2488 ( 18.2 Hz)
RESUME: 2487 ( 18.1 Hz)
SYNC100: 511 ( 3.7 Hz)
WR48-63: 511 ( 3.7 Hz)
FEE64 disc: 503410 ( 3672.9 Hz)
MBS info: 777 ( 5.7 Hz)
Other info: 0 ( 0.0 Hz)
ADC data range bit set: 60911 ( 444.4 Hz)
Timewarps: ADC: 0 ( 0.0 Hz)
PAUSE: 0 ( 0.0 Hz)
RESUME: 0 ( 0.0 Hz)
SYNC100: 0 ( 0.0 Hz)
WR48-63: 0 ( 0.0 Hz)
FEE64 disc: 0 ( 0.0 Hz)
MBS info: 0 ( 0.0 Hz)
Undefined: 0 ( 0.0 Hz)
Sample trace: 0 ( 0.0 Hz)
*** Timestamp elapsed time: 137.061 s
FEE elapsed dead time(s) elapsed idle time(s)
1 2.725 132.339
2 3.132 135.291
3 6.180 132.876
4 12.844 128.581
5 8.386 132.070
6 1.216 132.607
7 1.093 115.159
8 50.447 129.654
9 19.940 134.755
10 0.568 132.339
11 51.844 133.681
12 0.000 0.000
13 0.000 0.000
14 0.000 0.000
15 0.000 0.000
16 0.000 0.000
17 0.000 0.000
18 0.000 0.000
19 0.000 0.000
20 0.000 0.000
21 0.000 0.000
22 0.000 0.000
23 0.000 0.000
24 0.000 0.000
25 0.000 0.000
26 0.000 0.000
27 0.000 0.000
28 0.000 0.000
29 0.000 0.000
30 0.000 0.000
31 0.000 0.000
32 0.000 0.000
*** Statistics
FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data
0 22917695 26526 0 0 878 878 65 65 23863 777 0 8590
1 26593258 35084 0 0 13 13 51 51 34956 0 0 10875
2 25634005 337148 0 0 16 16 76 76 336964 0 0 6926
3 28548879 3343 0 0 34 34 27 27 3221 0 0 1214
4 7607641 18967 0 0 663 663 14 14 17613 0 0 6303
5 19366719 25239 0 0 305 304 24 24 24582 0 0 8037
6 18601227 17453 0 0 3 3 18 18 17411 0 0 6563
7 10076045 2592 0 0 4 4 24 24 2536 0 0 908
8 30026924 8042 0 0 217 216 34 34 7541 0 0 2274
9 30858440 18084 0 0 113 113 88 88 17682 0 0 4590
10 9946552 15820 0 0 3 3 46 46 15722 0 0 4264
11 31232431 1886 0 0 239 240 44 44 1319 0 0 367
12 0 0 0 0 0 0 0 0 0 0 0 0
13 0 0 0 0 0 0 0 0 0 0 0 0
14 0 0 0 0 0 0 0 0 0 0 0 0
15 0 0 0 0 0 0 0 0 0 0 0 0
16 0 0 0 0 0 0 0 0 0 0 0 0
17 0 0 0 0 0 0 0 0 0 0 0 0
18 0 0 0 0 0 0 0 0 0 0 0 0
19 0 0 0 0 0 0 0 0 0 0 0 0
20 0 0 0 0 0 0 0 0 0 0 0 0
21 0 0 0 0 0 0 0 0 0 0 0 0
22 0 0 0 0 0 0 0 0 0 0 0 0
23 0 0 0 0 0 0 0 0 0 0 0 0
24 0 0 0 0 0 0 0 0 0 0 0 0
25 0 0 0 0 0 0 0 0 0 0 0 0
26 0 0 0 0 0 0 0 0 0 0 0 0
27 0 0 0 0 0 0 0 0 0 0 0 0
28 0 0 0 0 0 0 0 0 0 0 0 0
29 0 0 0 0 0 0 0 0 0 0 0 0
30 0 0 0 0 0 0 0 0 0 0 0 0
31 0 0 0 0 0 0 0 0 0 0 0 0
32 0 0 0 0 0 0 0 0 0 0 0 0
*** Timewarps
FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples
0 0 0 0 0 0 0 0 0 0
1 0 0 0 0 0 0 0 0 0
2 0 0 0 0 0 0 0 0 0
3 0 0 0 0 0 0 0 0 0
4 0 0 0 0 0 0 0 0 0
5 0 0 0 0 0 0 0 0 0
6 0 0 0 0 0 0 0 0 0
7 0 0 0 0 0 0 0 0 0
8 0 0 0 0 0 0 0 0 0
9 0 0 0 0 0 0 0 0 0
10 0 0 0 0 0 0 0 0 0
11 0 0 0 0 0 0 0 0 0
12 0 0 0 0 0 0 0 0 0
13 0 0 0 0 0 0 0 0 0
14 0 0 0 0 0 0 0 0 0
15 0 0 0 0 0 0 0 0 0
16 0 0 0 0 0 0 0 0 0
17 0 0 0 0 0 0 0 0 0
18 0 0 0 0 0 0 0 0 0
19 0 0 0 0 0 0 0 0 0
20 0 0 0 0 0 0 0 0 0
21 0 0 0 0 0 0 0 0 0
22 0 0 0 0 0 0 0 0 0
23 0 0 0 0 0 0 0 0 0
24 0 0 0 0 0 0 0 0 0
25 0 0 0 0 0 0 0 0 0
26 0 0 0 0 0 0 0 0 0
27 0 0 0 0 0 0 0 0 0
28 0 0 0 0 0 0 0 0 0
29 0 0 0 0 0 0 0 0 0
30 0 0 0 0 0 0 0 0 0
31 0 0 0 0 0 0 0 0 0
32 0 0 0 0 0 0 0 0 0
*** Program elapsed time:13611.407s ( 2.351 blocks/s, 0.147 Mb/s)
|
| Attachment 13: Screenshot_from_2021-03-14_04-20-07.png
|
|
| Attachment 14: Screenshot_from_2021-03-14_04-20-34.png
|
|
| Attachment 15: Screenshot_from_2021-03-14_04-20-50.png
|
|
| Attachment 16: Screenshot_from_2021-03-14_04-25-41.png
|
|
| Attachment 17: Screenshot_from_2021-03-14_04-32-03.png
|
|
| Attachment 18: Screenshot_from_2021-03-14_04-32-32.png
|
|
| Attachment 19: Screenshot_from_2021-03-14_04-33-14.png
|
|
| Attachment 20: Screenshot_from_2021-03-14_06-10-39.png
|
|
| Attachment 21: Screenshot_from_2021-03-14_06-11-19.png
|
|
| Attachment 22: Screenshot_from_2021-03-14_06-11-38_-_1.png
|
|
|
251
|
Tue Apr 20 07:06:20 2021 |
CA | April 20th 08:00 - 12:00 |
08:09 DAQ crashes at start of shift (!)
again happens at same time as beam being lost
All FEE64 lost connection
Beam downtime for next 3-4 hours
Performed powercycle and reset
08:40 AIDA back up and running, writing to R36
08:42 *all* system wide checks ok
temperatures ok - attachment 1
statistics ok - attachment 2
detector bias/leakage currents ok - attachment 3
08:57 options file size check;
Collecting the file size of each FEE64 Options CONTENTS file to check they are all the same
FEE : aida01 => Options file size is 1025 Last changed Tue Apr 20 08:22:14 CEST 2021
FEE : aida02 => Options file size is 1014 Last changed Fri Apr 16 00:56:20 CEST 2021
FEE : aida03 => Options file size is 1014 Last changed Wed Apr 14 21:52:04 CEST 2021
FEE : aida04 => Options file size is 1025 Last changed Sat Apr 17 06:07:36 CEST 2021
FEE : aida05 => Options file size is 1025 Last changed Fri Apr 16 00:53:25 CEST 2021
FEE : aida06 => Options file size is 1014 Last changed Wed Apr 14 21:52:04 CEST 2021
FEE : aida07 => Options file size is 1014 Last changed Wed Apr 14 21:52:04 CEST 2021
FEE : aida08 => Options file size is 1014 Last changed Wed Apr 14 21:52:04 CEST 2021
FEE : aida09 => Options file size is 1014 Last changed Wed Apr 14 21:52:05 CEST 2021
FEE : aida10 => Options file size is 1014 Last changed Wed Apr 14 21:52:06 CEST 2021
FEE : aida11 => Options file size is 1014 Last changed Wed Apr 14 21:52:05 CEST 2021
FEE : aida12 => Options file size is 1025 Last changed Mon Apr 19 09:05:25 CEST 2021
08:59 no error messages in database check terminal
stats ok
09:16 waveforms - attachments 4 & 5
09:30 no error messages in database check terminal
stats ok
10:07 no error messages in database check terminal
stats ok
10:30 aida01, aida02, aida03, aida04, aida07 lost connection, DAQ crashes
powercycle attempted, but FEE modules remain unconnected
TD performs further power cycle
11.12 reboot aida05
DAQ reset/setup
system wide checks
sync asic clocks OK
clock status & fpga timestamp errors OK
WR decoder status
Base Current Difference
aida09 fault 0xb307 : 0xb307 : 0
aida09 : WR status 0x40
aida10 fault 0x3d6c : 0x3d6c : 0
aida10 : WR status 0x40
aida11 fault 0xa610 : 0xa610 : 0
aida11 : WR status 0x40
aida12 fault 0x7c7 : 0x7c7 : 0
aida12 : WR status 0x40
White Rabbit error counter test result: Passed 8, Failed 4
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
NH had access to area, unplugged and replugged HDMI cables from aida09, aida10, aida11, aida12 root to MACB (at both ends)
earlier on, Akash secured HDMI cable to aida07
11:55 AIDA powercycle and reset, DAQ ok now
writing to file NULL/R45
12:00 CB takes over |
| Attachment 1: Screenshot_from_2021-04-20_07-45-09.png
|
|
| Attachment 2: Screenshot_from_2021-04-20_07-45-43.png
|
|
| Attachment 3: Screenshot_from_2021-04-20_07-46-05.png
|
|
| Attachment 4: Screenshot_from_2021-04-20_08-14-58.png
|
|
| Attachment 5: Screenshot_from_2021-04-20_08-15-38.png
|
|
|
255
|
Tue Apr 20 23:08:22 2021 |
CA | Wed Apr 21 00:00-08:00 |
00:00 - CA takes over
00:15 - stats/database/ucesb ok - attachment 1
- another burst of bad timestamp error messages in NewMerger terminal - but all FEE64 still ok - attachment 2
- Merger/TapeService ok
00:21 - beam still off while UNILAC having problems
00:26 - beam is back - rate spectra - attachment 3
00:32 - ucesb following beam return - attachment 4
- implant rates reaching highs of ~1kHz
00:35 - Grafana leakage current monitor last 6 hours - attachment 5
01:00 *all* system wide checks ok
stats ok - attachment 6
temperatures ok - attachment 7
detector bias / leakage currents ok - attachment 8
db check ok / ucesb ok
still observe periodic bursts of bad timestamp errors in NewMerger terminal - FEE64s still linked with merger ok
01:30 AIDA crashes just as I make check, most FEE64 lost connection -> powercycle and restart MIDAS
01:53 AIDA reset completed - writing to file NULL/R48
01:56 all system wide checks ok *except*
FPGA error counter
Base Current Difference
aida12 fault 0x0 : 0x1 : 1
FPGA Timestamp error counter test result: Passed 11, Failed 1
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last
ADC calibration
FEE64 module aida04 failed
FEE64 module aida05 failed
Calibration test result: Passed 10, Failed 2
If any modules fail calibration , check the clock status and open the FADC Align and Control browser page to rerun calibration for that module
02:01 good event statistics ok - attachment 9
temperatures ok - attachment 10
detector bias / leakage currents ok - attachment 11
db check / ucesb ok
02:20 beam stop
02:21 beam back
02:30 stats/ucesb/db checks all ok
03:00 stats/ucesb/db checks all ok - attachment 12
03:30 stats/ucesb/db checks all ok
04:00 system wide checks ok, except;
ADC calibration
FEE64 module aida04 failed
FEE64 module aida05 failed
Calibration test result: Passed 10, Failed 2
If any modules fail calibration , check the clock status and open the FADC Align and Control browser page to rerun calibration for that module
FPGA errors
Base Current Difference
aida12 fault 0x0 : 0x9 : 9
FPGA Timestamp error counter test result: Passed 11, Failed 1
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last
04:03 beam off briefly
04:05 good event statistics ok - attachment 13
04:07 beam back
temperatures ok - attachment 14
bias / leakage currents ok - attachment 15
db check / ucesb ok - attachment 16
implant rates in AIDA peaking at ~1.5kHz
04:30 stats/ucesb/db checks all ok
04:48 no beam
04:58 beam back
05:00 stats/ucesb/db checks all ok - attachment 17
05:30 stats/ucesb/db checks all ok
06:00 system wide checks ok, except;
ADC calibration
FEE64 module aida04 failed
FEE64 module aida05 failed
Calibration test result: Passed 10, Failed 2
If any modules fail calibration , check the clock status and open the FADC Align and Control browser page to rerun calibration for that module
FPGA errors
Base Current Difference
aida12 fault 0x0 : 0x9 : 9
FPGA Timestamp error counter test result: Passed 11, Failed 1
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last
FEE64 Linux Memory Info
Returned 0 0 0 0 0 0 0 0 0 0 0 0
Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k
aida01 : 5 5 3 3 2 3 2 3 2 3 7 : 39628
aida02 : 22 11 3 0 2 3 2 3 2 3 7 : 39648
aida03 : 20 10 1 1 2 2 1 4 2 3 7 : 39760
aida04 : 17 10 2 2 3 3 2 3 2 3 7 : 39732
aida05 : 1 8 3 2 3 2 2 3 3 3 7 : 40564
aida06 : 5 6 2 3 2 2 3 3 2 3 7 : 39748
aida07 : 18 4 7 0 1 3 1 4 2 3 7 : 39832
aida08 : 22 10 3 3 2 2 3 3 2 3 7 : 39864
aida09 : 3 6 2 2 0 3 1 4 2 3 7 : 39708
aida10 : 2 4 3 2 1 2 2 3 2 3 7 : 39384
aida11 : 20 8 3 1 1 3 3 2 2 3 7 : 39328
aida12 : 16 6 3 1 0 3 2 3 2 3 7 : 39488
06:02 good event statistics ok - attachment 18
FEE64 temperatures ok - attachment 19
detector bias / leakage currents ok - attachment 20
06:06 db check and ucesb ok - attachment 21
NewMerger terminal hasn't flagged up any more errors since ~ 03:00
06:30 stats/ucesb/db checks all ok
DESPEC restarts timesorter
07:00 stats/ucesb/db checks all ok
07:30 stats/ucesb/db checks all ok - attachment 22
grafana leakage currents last 1 hour - attachment 23
|
| Attachment 1: Screenshot_from_2021-04-20_23-15-20.png
|
|
| Attachment 2: Screenshot_from_2021-04-20_23-18-14.png
|
|
| Attachment 3: Screenshot_from_2021-04-20_23-29-06.png
|
|
| Attachment 4: Screenshot_from_2021-04-20_23-32-08.png
|
|
| Attachment 5: Screenshot_from_2021-04-20_23-34-42.png
|
|
| Attachment 6: Screenshot_from_2021-04-21_00-00-06.png
|
|
| Attachment 7: Screenshot_from_2021-04-21_00-00-29.png
|
|
| Attachment 8: Screenshot_from_2021-04-21_00-01-15.png
|
|
| Attachment 9: Screenshot_from_2021-04-21_01-00-03.png
|
|
| Attachment 10: Screenshot_from_2021-04-21_01-00-48.png
|
|
| Attachment 11: Screenshot_from_2021-04-21_01-01-05.png
|
|
| Attachment 12: Screenshot_from_2021-04-21_01-59-30.png
|
|
| Attachment 13: Screenshot_from_2021-04-21_03-05-24.png
|
|
| Attachment 14: Screenshot_from_2021-04-21_03-05-47.png
|
|
| Attachment 15: Screenshot_from_2021-04-21_03-06-07.png
|
|
| Attachment 16: Screenshot_from_2021-04-21_03-11-44.png
|
|
| Attachment 17: Screenshot_from_2021-04-21_04-00-22.png
|
|
| Attachment 18: Screenshot_from_2021-04-21_05-00-18.png
|
|
| Attachment 19: Screenshot_from_2021-04-21_05-00-43.png
|
|
| Attachment 20: Screenshot_from_2021-04-21_05-03-47.png
|
|
| Attachment 21: Screenshot_from_2021-04-21_05-05-43.png
|
|
| Attachment 22: Screenshot_from_2021-04-21_06-30-20.png
|
|
| Attachment 23: Screenshot_from_2021-04-21_06-32-51.png
|
|
|
259
|
Wed Apr 21 23:05:39 2021 |
CA | 22nd April 00:00 - 08:00 |
00:07 stats/ucesb/DB checks all ok
00:30 all system wide checks ok *except* fpga errors
Base Current Difference
aida12 fault 0x0 : 0x1f : 31
FPGA Timestamp error counter test result: Passed 11, Failed 1
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last
statistics ok - attachment 1
temperatures ok - attachment 2
detector bias / leakage currents ok - attachment 3
no error messages in DB terminal & ucesb ok - attachment 4
01:00 stats/ucesb/DB checks all ok
01:30 stats/ucesb/DB checks all ok
01:53 issues with beam dropping in and out - ESR working to stabilise this
02:00 stats/ucesb/DB checks all ok
02:09 beam back in a stable state
02:30 all system wide checks ok *except* fpga errors
Base Current Difference
aida12 fault 0x0 : 0x29 : 41
FPGA Timestamp error counter test result: Passed 11, Failed 1
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last
02:33 statistics ok - attachment 5
temperatures ok - attachment 6
detector bias / leakage currents ok - attachment 7
no error messages in DB terminal & ucesb ok - attachment 8
02:45 beam off - potentially serious issue, awaiting update from FRS
03:00 significant issues with UNILAC, beam not expected back for a while
03:05 stats/ucesb/DB checks all ok
03:32 stats/ucesb/DB checks all ok
03:55 beam is back
04:00 stats/ucesb/DB checks all ok
04:30 all system wide checks ok *except* fpga errors
Base Current Difference
aida12 fault 0x0 : 0x2b : 43
FPGA Timestamp error counter test result: Passed 11, Failed 1
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last
04:32 statistics ok - attachment 9
temperatures ok - attachment 10
detector bias / leakage currents ok - attachment 11
no error messages in DB terminal & ucesb ok - attachment 12
05:00 stats/ucesb/DB checks all ok
05:30 stats/ucesb/DB checks all ok
06:00 stats/ucesb/DB checks all ok
06:30 all system wide checks ok *except* fpga errors
Base Current Difference
aida12 fault 0x0 : 0x34 : 52
FPGA Timestamp error counter test result: Passed 11, Failed 1
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last
06:32 temperatures ok - attachment 13
statistics ok - attachment 14
detector bias / leakage currents ok - attachment 15
no error messages in DB terminal & ucesb ok - attachment 16
07:00 stats/ucesb/DB checks all ok
07:30 stats/ucesb/DB checks all ok
07:59 stats/ucesb/DB checks all ok
|
| Attachment 1: Screenshot_from_2021-04-21_23-31-22.png
|
|
| Attachment 2: Screenshot_from_2021-04-21_23-31-44.png
|
|
| Attachment 3: Screenshot_from_2021-04-21_23-32-03.png
|
|
| Attachment 4: Screenshot_from_2021-04-21_23-34-46.png
|
|
| Attachment 5: Screenshot_from_2021-04-22_01-31-14.png
|
|
| Attachment 6: Screenshot_from_2021-04-22_01-31-37.png
|
|
| Attachment 7: Screenshot_from_2021-04-22_01-34-03.png
|
|
| Attachment 8: Screenshot_from_2021-04-22_01-34-31.png
|
|
| Attachment 9: Screenshot_from_2021-04-22_03-32-36.png
|
|
| Attachment 10: Screenshot_from_2021-04-22_03-32-57.png
|
|
| Attachment 11: Screenshot_from_2021-04-22_03-33-11.png
|
|
| Attachment 12: Screenshot_from_2021-04-22_03-33-57.png
|
|
| Attachment 13: Screenshot_from_2021-04-22_05-33-01.png
|
|
| Attachment 14: Screenshot_from_2021-04-22_05-33-19.png
|
|
| Attachment 15: Screenshot_from_2021-04-22_05-33-30.png
|
|
| Attachment 16: Screenshot_from_2021-04-22_05-33-43.png
|
|
|
316
|
Fri May 14 07:05:08 2021 |
CA | Friday 14th May 08:00 - 16:00 shift |
08:00 CA takes over
08:28 Problem at UNILAC - no beam
09:30 all system wide checks ok *except*
all FEE64 fail ADC calibration (no waveforms)
WR decoder status:
Base Current Difference
aida01 fault 0xf932 : 0xf933 : 1
aida02 fault 0x62ec : 0x62ed : 1
aida03 fault 0x8679 : 0x867a : 1
aida04 fault 0xf0e4 : 0xf0e5 : 1
aida05 fault 0x9db8 : 0x9dc2 : 10
aida06 fault 0x7f18 : 0x7f19 : 1
aida07 fault 0xdd2c : 0xdd2d : 1
aida08 fault 0x1557 : 0x1558 : 1
White Rabbit error counter test result: Passed 8, Failed 8
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
FPGA timestamp errors:
Base Current Difference
aida05 fault 0x0 : 0x2 : 2
FPGA Timestamp error counter test result: Passed 15, Failed 1
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last
09:36 FEE64 Temperatures ok - attachment 1
Detector bias / leakage currents ok - attachment 2
Statistics - attachments 3-8
09:50 beam is back - writing to file R4_265
09:56 FRS adjusting degrader settings (S4) - temporarily remove to check counts in scintillator vs AIDA
10:10 FRS increase degrader thickness
10.28 all histograms, stats and merger stats zero'd
10.50 all system wide checks ok *except*
Base Current Difference
aida01 fault 0xf932 : 0xf933 : 1
aida02 fault 0x62ec : 0x62ed : 1
aida03 fault 0x8679 : 0x867a : 1
aida04 fault 0xf0e4 : 0xf0e5 : 1
aida05 fault 0x9db8 : 0x9dc2 : 10
aida06 fault 0x7f18 : 0x7f19 : 1
aida07 fault 0xdd2c : 0xdd2d : 1
aida08 fault 0x1557 : 0x1558 : 1
White Rabbit error counter test result: Passed 8, Failed 8
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
Base Current Difference
aida05 fault 0x0 : 0x3 : 3
FPGA Timestamp error counter test result: Passed 15, Failed 1
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last
Returned 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k
aida01 : 3 2 2 2 2 2 2 4 3 3 6 : 36860
aida02 : 7 3 5 1 2 5 2 4 3 3 6 : 37284
aida03 : 7 5 3 1 4 4 2 3 3 3 6 : 36756
aida04 : 3 1 20 4 2 3 3 5 1 3 6 : 36052
aida05 : 19 25 26 6 2 2 3 2 2 3 6 : 35828
aida06 : 1 3 16 1 3 4 1 5 1 3 6 : 35580
aida07 : 6 4 1 2 3 3 2 3 3 3 6 : 36552
aida08 : 8 5 2 3 2 3 2 2 2 4 6 : 37064
aida09 : 9 7 1 2 2 4 2 3 3 3 6 : 36652
aida10 : 2 5 3 1 1 4 2 3 3 3 6 : 36544
aida11 : 16 4 4 2 1 2 2 3 3 3 6 : 36384
aida12 : 2 1 1 3 1 2 2 3 3 3 6 : 36288
aida13 : 0 1 1 2 0 4 3 2 3 3 6 : 36184
aida14 : 6 3 2 0 2 3 2 3 3 3 6 : 36432
aida15 : 25 8 2 1 2 3 1 2 2 4 6 : 36836
aida16 : 3 5 1 2 2 2 3 2 3 3 6 : 36100
Collecting the file size of each FEE64 Options CONTENTS file to check they are all the same
FEE : aida01 => Options file size is 1026 Last changed Thu May 13 05:49:42 CEST 2021
FEE : aida02 => Options file size is 1014 Last changed Thu Apr 29 14:43:46 CEST 2021
FEE : aida03 => Options file size is 1014 Last changed Thu Apr 29 14:43:50 CEST 2021
FEE : aida04 => Options file size is 1014 Last changed Thu Apr 29 14:43:53 CEST 2021
FEE : aida05 => Options file size is 1014 Last changed Thu Apr 29 14:43:55 CEST 2021
FEE : aida06 => Options file size is 1014 Last changed Thu Apr 29 14:43:59 CEST 2021
FEE : aida07 => Options file size is 1014 Last changed Thu Apr 29 14:44:02 CEST 2021
FEE : aida08 => Options file size is 1025 Last changed Wed May 05 12:15:54 CEST 2021
FEE : aida09 => Options file size is 1014 Last changed Thu Apr 29 14:44:08 CEST 2021
FEE : aida10 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021
FEE : aida11 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021
FEE : aida12 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021
FEE : aida13 => Options file size is 1025 Last changed Fri May 07 19:40:34 CEST 2021
FEE : aida14 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021
FEE : aida15 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021
FEE : aida16 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021
10.50 DAQ continues S496/R4_304
11:18 FEE64 Temperatures ok - attachment 9
Detector bias & leakage currents ok - attachment 10
statistics - attachments 11-16
15:00 FEE64 avg. CPU usage (%)
1 52
2 55
3 55
4 60
5 93
6 50
7 53
8 55
9 55
10 51
11 50
12 67
13 56
14 55
15 55
16 58
15:08 all system wide checks ok *except*
all FEE64 fail ADC calibration (no waveform)
WR decoder status:
Base Current Difference
aida01 fault 0xf932 : 0xf933 : 1
aida02 fault 0x62ec : 0x62ed : 1
aida03 fault 0x8679 : 0x867a : 1
aida04 fault 0xf0e4 : 0xf0e5 : 1
aida05 fault 0x9db8 : 0x9dc3 : 11
aida06 fault 0x7f18 : 0x7f19 : 1
aida07 fault 0xdd2c : 0xdd2d : 1
aida08 fault 0x1557 : 0x1558 : 1
White Rabbit error counter test result: Passed 8, Failed 8
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
FPGA errors:
Base Current Difference
aida05 fault 0x0 : 0x3 : 3
FPGA Timestamp error counter test result: Passed 15, Failed 1
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last
15:10 Temperatures ok - attachment 17
Detector bias / leakage current ok - attachment 18
Statistics - attachments 18 -24 |
| Attachment 1: Screenshot_from_2021-05-14_08-32-16.png
|
|
| Attachment 2: Screenshot_from_2021-05-14_08-32-45.png
|
|
| Attachment 3: Screenshot_from_2021-05-14_08-33-11.png
|
|
| Attachment 4: Screenshot_from_2021-05-14_08-33-33.png
|
|
| Attachment 5: Screenshot_from_2021-05-14_08-34-12.png
|
|
| Attachment 6: Screenshot_from_2021-05-14_08-34-44.png
|
|
| Attachment 7: Screenshot_from_2021-05-14_08-35-17.png
|
|
| Attachment 8: Screenshot_from_2021-05-14_08-35-55.png
|
|
| Attachment 9: Screenshot_from_2021-05-14_10-17-25.png
|
|
| Attachment 10: Screenshot_from_2021-05-14_10-17-43.png
|
|
| Attachment 11: Screenshot_from_2021-05-14_10-22-39.png
|
|
| Attachment 12: Screenshot_from_2021-05-14_10-23-13.png
|
|
| Attachment 13: Screenshot_from_2021-05-14_10-23-41.png
|
|
| Attachment 14: Screenshot_from_2021-05-14_10-24-12.png
|
|
| Attachment 15: Screenshot_from_2021-05-14_10-24-37.png
|
|
| Attachment 16: Screenshot_from_2021-05-14_10-25-20.png
|
|
| Attachment 17: Screenshot_from_2021-05-14_14-07-48.png
|
|
| Attachment 18: Screenshot_from_2021-05-14_14-11-23.png
|
|
| Attachment 19: Screenshot_from_2021-05-14_14-13-21.png
|
|
| Attachment 20: Screenshot_from_2021-05-14_14-13-38.png
|
|
| Attachment 21: Screenshot_from_2021-05-14_14-14-12.png
|
|
| Attachment 22: Screenshot_from_2021-05-14_14-14-39.png
|
|
| Attachment 23: Screenshot_from_2021-05-14_14-15-06.png
|
|
| Attachment 24: Screenshot_from_2021-05-14_14-15-26.png
|
|
|
326
|
Tue May 18 23:11:40 2021 |
CA | Wednesday May 19th 00:00 - 08:00 |
00:00 CA takes over
LS has performed usual checks, see previous Elog entry - all ok
00:30 stats ok
R14_470 deadtime at 4.4%
02:10 system wide checks ok except:
all ADC fail calibration (expected, no waveforms)
WR decoder status
Base Current Difference
aida05 fault 0x500 : 0x52f : 47
White Rabbit error counter test result: Passed 15, Failed 1
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
02:12 FEE64 Temps ok - attachment 1
Stats ok - attachment 2
detector bias / leakage currents ok - attachment 3
dead-times ok - R14_497 max 4% - attachment 4
03:27 DAQ continues ok - writing to file R14_517
04:07 system wide checks ok except:
all ADC fail calibration (expected, no waveforms)
WR decoder status
Base Current Difference
aida05 fault 0x500 : 0x537 : 55
White Rabbit error counter test result: Passed 15, Failed 1
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
FEE64 Temps ok - attachment 6
Stats ok - attachment 5
detector bias / leakage currents ok - attachment 7
dead-times ok - R14_526 max 4% - attachment 8
05:27 bad timestamp error in merger terminal - attachment 9
06:05 all system wide checks ok except;
all ADC fail calibration (expected, no waveforms)
WR decoder status
Base Current Difference
aida05 fault 0x500 : 0x53d : 61
White Rabbit error counter test result: Passed 15, Failed 1
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
06:07 FEE64 Temps ok - attachment 10
Stats ok - attachment 11
detector bias / leakage currents ok - attachment 12
dead-times ok - R14_558 max 3.6% - attachment 13
07:01 another bad timestamp error in merger terminal - attachment 14 |
| Attachment 1: Screenshot_from_2021-05-19_01-13-48.png
|
|
| Attachment 2: Screenshot_from_2021-05-19_01-14-09.png
|
|
| Attachment 3: Screenshot_from_2021-05-19_01-14-24.png
|
|
| Attachment 4: Screenshot_from_2021-05-19_01-19-37.png
|
|
| Attachment 5: Screenshot_from_2021-05-19_03-04-39.png
|
|
| Attachment 6: Screenshot_from_2021-05-19_03-05-33.png
|
|
| Attachment 7: Screenshot_from_2021-05-19_03-05-53.png
|
|
| Attachment 8: Screenshot_from_2021-05-19_03-09-03.png
|
|
| Attachment 9: Screenshot_from_2021-05-19_04-26-09.png
|
|
| Attachment 10: Screenshot_from_2021-05-19_05-08-01.png
|
|
| Attachment 11: Screenshot_from_2021-05-19_05-08-23.png
|
|
| Attachment 12: Screenshot_from_2021-05-19_05-08-46.png
|
|
| Attachment 13: Screenshot_from_2021-05-19_05-11-33.png
|
|
| Attachment 14: Screenshot_from_2021-05-19_06-12-29.png
|
|
|
328
|
Wed May 19 09:06:58 2021 |
CA | May 16th 00:00 - 08:00 |
16th May 2021 - 00:00 - 08:00 Shift
Author: CA
00:15 System wide checks;
FEE64 module aida06 global clocks failed, 6
FEE64 module aida09 global clocks failed, 6
Clock status test result: Passed 14, Failed 2
Understand status as follows
Status bit 3 : firmware PLL that creates clocks from external clock not locked
Status bit 2 : always logic '1'
Status bit 1 : LMK3200(2) PLL and clock distribution chip not locked to external clock
Status bit 0 : LMK3200(1) PLL and clock distribution chip not locked to external clock
If all these bits are not set then the operation of the firmware is unreliable
FEE64 module aida09 failed
Calibration test result: Passed 15, Failed 1
If any modules fail calibration , check the clock status and open the FADC Align and Control browser page to rerun calibration for that module
Base Current Difference
aida05 fault 0x714c : 0x7154 : 8
White Rabbit error counter test result: Passed 15, Failed 1
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
Base Current Difference
aida05 fault 0x0 : 0x3 : 3
aida12 fault 0x0 : 0x3 : 3
aida13 fault 0x0 : 0x4d : 77
FPGA Timestamp error counter test result: Passed 13, Failed 3
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last
Returned 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k
aida01 : 19 10 3 1 2 3 2 3 2 3 7 : 39660
aida02 : 29 5 3 1 1 3 2 3 2 3 7 : 39596
aida03 : 15 7 1 1 2 3 2 3 2 3 7 : 39588
aida04 : 44 26 19 5 2 4 3 3 2 2 7 : 38608
aida05 : 20 10 3 0 1 4 2 2 3 3 7 : 40208
aida06 : 27 6 2 1 2 4 2 4 2 3 7 : 40284
aida07 : 25 5 3 1 2 3 2 3 2 3 7 : 39644
aida08 : 23 8 2 3 1 4 2 3 2 3 7 : 39772
aida09 : 23 10 3 2 3 4 1 3 2 3 7 : 39644
aida10 : 18 10 3 2 3 2 2 2 2 4 7 : 41160
aida11 : 16 7 3 2 1 2 2 3 2 3 7 : 39464
aida12 : 21 4 7 1 3 3 3 3 2 3 7 : 40004
aida13 : 25 6 3 2 1 3 1 4 2 3 7 : 39876
aida14 : 20 8 10 1 1 2 2 2 2 4 7 : 41104
aida15 : 26 6 3 3 0 4 3 2 2 3 7 : 39464
aida16 : 9 8 2 4 1 3 1 4 2 3 7 : 39876
00:30 Stats ok - 210516_0030_stats.png
Temps ok - 210516_0030_temps.png
Bias ok - 210516_0030_bias.png
00:38 analyzer output R7_178 - Deadtime at 7.3% - 210516_R7_178_analysis.txt
02:21 system wide checks as above, except;
Base Current Difference
aida05 fault 0x714c : 0x7159 : 13
White Rabbit error counter test result: Passed 15, Failed 1
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
Base Current Difference
aida05 fault 0x0 : 0x7 : 7
aida12 fault 0x0 : 0x3 : 3
aida13 fault 0x0 : 0x4d : 77
FPGA Timestamp error counter test result: Passed 13, Failed 3
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last
02:28 Stats ok - 210516_0230_stats.png
Temps ok - 210516_0230_temps.png
Bias ok - 210516_0230_bias.png
02:33 analyzer output R7_216 - Deadtime at 6.5% - 210516_R7_216_analysis.txt
04:36 system wide checks same as above, except;
Base Current Difference
aida05 fault 0x714c : 0x715c : 16
White Rabbit error counter test result: Passed 15, Failed 1
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
Base Current Difference
aida05 fault 0x0 : 0x9 : 9
aida12 fault 0x0 : 0x3 : 3
aida13 fault 0x0 : 0x4d : 77
FPGA Timestamp error counter test result: Passed 13, Failed 3
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last
04:37 Stats ok - 210516_0430_stats.png
Temps ok - 210516_0430_temps.png
Bias ok - 210516_0430_bias.png
04:44 analyzer output R7_260 - Deadtime at 6.9% - 210516_R7_260_analysis.txt
06:38 system wide checks same as before, except;
Base Current Difference
aida01 fault 0xf294 : 0xf296 : 2
aida02 fault 0xd8ec : 0xd8ee : 2
aida03 fault 0xf001 : 0xf003 : 2
aida04 fault 0xd992 : 0xd994 : 2
aida05 fault 0x714c : 0x7161 : 21
aida06 fault 0x5a49 : 0x5a4a : 1
aida07 fault 0x5aca : 0x5acb : 1
aida08 fault 0xb92e : 0xb92f : 1
White Rabbit error counter test result: Passed 8, Failed 8
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
06:40 Stats ok - 210516_0640_stats.png
Temps ok - 210516_0640_temps.png
Bias ok - 210516_0640_bias.png
06:45 analyzer output R7_298 - Deadtime at 5.8% - 210516_R7_298_analysis.txt |
| Attachment 1: 210516_0030_bias.png
|
|
| Attachment 2: 210516_0030_stats.png
|
|
| Attachment 3: 210516_0030_temps.png
|
|
| Attachment 4: 210516_0230_bias.png
|
|
| Attachment 5: 210516_0230_stats.png
|
|
| Attachment 6: 210516_0230_temps.png
|
|
| Attachment 7: 210516_0430_bias.png
|
|
| Attachment 8: 210516_0430_stats.png
|
|
| Attachment 9: 210516_0430_temps.png
|
|
| Attachment 10: 210516_0640_bias.png
|
|
| Attachment 11: 210516_0640_stats.png
|
|
| Attachment 12: 210516_0640_temps.png.png
|
|
| Attachment 13: analysis.txt
|
*** TDR format 3.3.0 analyser - TD - May 2021
*** ERROR: READ I/O error: 5002
blocks: 32000
ADC data format: 255660963 ( 1413413.6 Hz)
Other data format: 6259037 ( 34602.9 Hz)
Sample trace data format: 0 ( 0.0 Hz)
Undefined format: 0 ( 0.0 Hz)
Other data format type: PAUSE: 192 ( 1.1 Hz)
RESUME: 192 ( 1.1 Hz)
SYNC100: 32674 ( 180.6 Hz)
WR48-63: 32674 ( 180.6 Hz)
FEE64 disc: 0 ( 0.0 Hz)
MBS info: 6193305 ( 34239.5 Hz)
Other info: 0 ( 0.0 Hz)
ADC data range bit set: 287054 ( 1587.0 Hz)
Timewarps: ADC: 0 ( 0.0 Hz)
PAUSE: 0 ( 0.0 Hz)
RESUME: 0 ( 0.0 Hz)
SYNC100: 0 ( 0.0 Hz)
WR48-63: 0 ( 0.0 Hz)
FEE64 disc: 0 ( 0.0 Hz)
MBS info: 0 ( 0.0 Hz)
Undefined: 0 ( 0.0 Hz)
Sample trace: 0 ( 0.0 Hz)
*** Timestamp elapsed time: 180.882 s
FEE elapsed dead time(s) elapsed idle time(s)
0 0.117 0.000
1 8.836 0.000
2 1.027 0.000
3 5.545 0.000
4 0.000 5.604
5 0.873 0.000
6 0.370 0.000
7 0.861 0.000
8 0.767 0.000
9 0.000 63.434
10 13.201 0.000
11 3.930 0.000
12 0.813 0.000
13 0.000 30.131
14 0.448 0.000
15 1.895 0.000
16 0.000 0.000
17 0.000 0.000
18 0.000 0.000
19 0.000 0.000
20 0.000 0.000
21 0.000 0.000
22 0.000 0.000
23 0.000 0.000
24 0.000 0.000
25 0.000 0.000
26 0.000 0.000
27 0.000 0.000
28 0.000 0.000
29 0.000 0.000
30 0.000 0.000
31 0.000 0.000
32 0.000 0.000
*** Statistics
FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data
0 9469697 3614 0 0 3 3 1264 1264 0 1080 0 15256
1 23268933 6078 0 0 41 41 2998 2998 0 0 0 31257
2 14135373 1756135 0 0 5 5 1968 1968 0 1752189 0 25654
3 26646926 1718468 0 0 28 28 3507 3507 0 1711398 0 36818
4 2828773 749772 0 0 0 0 426 426 0 748920 0 7104
5 14183721 453202 0 0 5 5 1830 1830 0 449532 0 20813
6 11921192 886700 0 0 5 5 1583 1583 0 883524 0 13410
7 19791515 651950 0 0 5 5 2639 2639 0 646662 0 25026
8 22244739 5464 0 0 4 4 2728 2728 0 0 0 32840
9 1601175 378 0 0 0 0 189 189 0 0 0 2522
10 41869813 10332 0 0 63 63 5103 5103 0 0 0 18083
11 18332381 4602 0 0 16 16 2285 2285 0 0 0 5732
12 14937821 3786 0 0 7 7 1886 1886 0 0 0 28026
13 2220427 536 0 0 0 0 268 268 0 0 0 2121
14 11574320 2908 0 0 3 3 1451 1451 0 0 0 17899
15 20634157 5112 0 0 7 7 2549 2549 0 0 0 4493
16 0 0 0 0 0 0 0 0 0 0 0 0
17 0 0 0 0 0 0 0 0 0 0 0 0
18 0 0 0 0 0 0 0 0 0 0 0 0
19 0 0 0 0 0 0 0 0 0 0 0 0
20 0 0 0 0 0 0 0 0 0 0 0 0
21 0 0 0 0 0 0 0 0 0 0 0 0
22 0 0 0 0 0 0 0 0 0 0 0 0
23 0 0 0 0 0 0 0 0 0 0 0 0
24 0 0 0 0 0 0 0 0 0 0 0 0
25 0 0 0 0 0 0 0 0 0 0 0 0
26 0 0 0 0 0 0 0 0 0 0 0 0
27 0 0 0 0 0 0 0 0 0 0 0 0
28 0 0 0 0 0 0 0 0 0 0 0 0
29 0 0 0 0 0 0 0 0 0 0 0 0
30 0 0 0 0 0 0 0 0 0 0 0 0
31 0 0 0 0 0 0 0 0 0 0 0 0
32 0 0 0 0 0 0 0 0 0 0 0 0
*** Timewarps
FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples
0 0 0 0 0 0 0 0 0 0
1 0 0 0 0 0 0 0 0 0
2 0 0 0 0 0 0 0 0 0
3 0 0 0 0 0 0 0 0 0
4 0 0 0 0 0 0 0 0 0
5 0 0 0 0 0 0 0 0 0
6 0 0 0 0 0 0 0 0 0
7 0 0 0 0 0 0 0 0 0
8 0 0 0 0 0 0 0 0 0
9 0 0 0 0 0 0 0 0 0
10 0 0 0 0 0 0 0 0 0
11 0 0 0 0 0 0 0 0 0
12 0 0 0 0 0 0 0 0 0
13 0 0 0 0 0 0 0 0 0
14 0 0 0 0 0 0 0 0 0
15 0 0 0 0 0 0 0 0 0
16 0 0 0 0 0 0 0 0 0
17 0 0 0 0 0 0 0 0 0
18 0 0 0 0 0 0 0 0 0
19 0 0 0 0 0 0 0 0 0
20 0 0 0 0 0 0 0 0 0
21 0 0 0 0 0 0 0 0 0
22 0 0 0 0 0 0 0 0 0
23 0 0 0 0 0 0 0 0 0
24 0 0 0 0 0 0 0 0 0
25 0 0 0 0 0 0 0 0 0
26 0 0 0 0 0 0 0 0 0
27 0 0 0 0 0 0 0 0 0
28 0 0 0 0 0 0 0 0 0
29 0 0 0 0 0 0 0 0 0
30 0 0 0 0 0 0 0 0 0
31 0 0 0 0 0 0 0 0 0
32 0 0 0 0 0 0 0 0 0
*** Program elapsed time: 47.672s ( 671.255 blocks/s, 41.953 Mb/s)
|
| Attachment 14: analysis.txt
|
*** TDR format 3.3.0 analyser - TD - May 2021
*** ERROR: READ I/O error: 5002
blocks: 32000
ADC data format: 255713262 ( 1398395.0 Hz)
Other data format: 6206738 ( 33942.2 Hz)
Sample trace data format: 0 ( 0.0 Hz)
Undefined format: 0 ( 0.0 Hz)
Other data format type: PAUSE: 185 ( 1.0 Hz)
RESUME: 185 ( 1.0 Hz)
SYNC100: 32681 ( 178.7 Hz)
WR48-63: 32681 ( 178.7 Hz)
FEE64 disc: 0 ( 0.0 Hz)
MBS info: 6141006 ( 33582.7 Hz)
Other info: 0 ( 0.0 Hz)
ADC data range bit set: 279005 ( 1525.8 Hz)
Timewarps: ADC: 0 ( 0.0 Hz)
PAUSE: 0 ( 0.0 Hz)
RESUME: 0 ( 0.0 Hz)
SYNC100: 0 ( 0.0 Hz)
WR48-63: 0 ( 0.0 Hz)
FEE64 disc: 0 ( 0.0 Hz)
MBS info: 0 ( 0.0 Hz)
Undefined: 0 ( 0.0 Hz)
Sample trace: 0 ( 0.0 Hz)
*** Timestamp elapsed time: 182.862 s
FEE elapsed dead time(s) elapsed idle time(s)
0 0.488 0.000
1 8.465 0.000
2 0.216 0.000
3 7.120 0.000
4 0.011 8.896
5 0.764 0.000
6 0.401 0.000
7 1.395 0.000
8 0.721 0.000
9 0.000 86.292
10 11.881 0.000
11 1.912 0.000
12 0.187 0.000
13 0.000 15.181
14 0.528 0.000
15 0.095 0.000
16 0.000 0.000
17 0.000 0.000
18 0.000 0.000
19 0.000 0.000
20 0.000 0.000
21 0.000 0.000
22 0.000 0.000
23 0.000 0.000
24 0.000 0.000
25 0.000 0.000
26 0.000 0.000
27 0.000 0.000
28 0.000 0.000
29 0.000 0.000
30 0.000 0.000
31 0.000 0.000
32 0.000 0.000
*** Statistics
FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data
0 9424415 3624 0 0 2 2 1264 1264 0 1092 0 14964
1 23109905 5922 0 0 39 39 2922 2922 0 0 0 29876
2 14322958 1782809 0 0 3 3 2029 2029 0 1778745 0 25108
3 26234410 1716299 0 0 35 35 3458 3458 0 1709313 0 35100
4 2817740 734656 0 0 1 1 433 433 0 733788 0 6814
5 13978921 443934 0 0 4 4 1871 1871 0 440184 0 20242
6 11924553 862150 0 0 4 4 1621 1621 0 858900 0 13000
7 19324336 623898 0 0 11 11 2446 2446 0 618984 0 24043
8 21963572 5366 0 0 5 5 2678 2678 0 0 0 32304
9 1580877 372 0 0 0 0 186 186 0 0 0 2567
10 42874488 10618 0 0 59 59 5250 5250 0 0 0 17549
11 18504188 4566 0 0 14 14 2269 2269 0 0 0 5838
12 14580871 3684 0 0 2 2 1840 1840 0 0 0 27687
13 2240991 612 0 0 0 0 306 306 0 0 0 2138
14 11530867 2858 0 0 4 4 1425 1425 0 0 0 17152
15 21300170 5370 0 0 2 2 2683 2683 0 0 0 4623
16 0 0 0 0 0 0 0 0 0 0 0 0
17 0 0 0 0 0 0 0 0 0 0 0 0
18 0 0 0 0 0 0 0 0 0 0 0 0
19 0 0 0 0 0 0 0 0 0 0 0 0
20 0 0 0 0 0 0 0 0 0 0 0 0
21 0 0 0 0 0 0 0 0 0 0 0 0
22 0 0 0 0 0 0 0 0 0 0 0 0
23 0 0 0 0 0 0 0 0 0 0 0 0
24 0 0 0 0 0 0 0 0 0 0 0 0
25 0 0 0 0 0 0 0 0 0 0 0 0
26 0 0 0 0 0 0 0 0 0 0 0 0
27 0 0 0 0 0 0 0 0 0 0 0 0
28 0 0 0 0 0 0 0 0 0 0 0 0
29 0 0 0 0 0 0 0 0 0 0 0 0
30 0 0 0 0 0 0 0 0 0 0 0 0
31 0 0 0 0 0 0 0 0 0 0 0 0
32 0 0 0 0 0 0 0 0 0 0 0 0
*** Timewarps
FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples
0 0 0 0 0 0 0 0 0 0
1 0 0 0 0 0 0 0 0 0
2 0 0 0 0 0 0 0 0 0
3 0 0 0 0 0 0 0 0 0
4 0 0 0 0 0 0 0 0 0
5 0 0 0 0 0 0 0 0 0
6 0 0 0 0 0 0 0 0 0
7 0 0 0 0 0 0 0 0 0
8 0 0 0 0 0 0 0 0 0
9 0 0 0 0 0 0 0 0 0
10 0 0 0 0 0 0 0 0 0
11 0 0 0 0 0 0 0 0 0
12 0 0 0 0 0 0 0 0 0
13 0 0 0 0 0 0 0 0 0
14 0 0 0 0 0 0 0 0 0
15 0 0 0 0 0 0 0 0 0
16 0 0 0 0 0 0 0 0 0
17 0 0 0 0 0 0 0 0 0
18 0 0 0 0 0 0 0 0 0
19 0 0 0 0 0 0 0 0 0
20 0 0 0 0 0 0 0 0 0
21 0 0 0 0 0 0 0 0 0
22 0 0 0 0 0 0 0 0 0
23 0 0 0 0 0 0 0 0 0
24 0 0 0 0 0 0 0 0 0
25 0 0 0 0 0 0 0 0 0
26 0 0 0 0 0 0 0 0 0
27 0 0 0 0 0 0 0 0 0
28 0 0 0 0 0 0 0 0 0
29 0 0 0 0 0 0 0 0 0
30 0 0 0 0 0 0 0 0 0
31 0 0 0 0 0 0 0 0 0
32 0 0 0 0 0 0 0 0 0
*** Program elapsed time: 45.405s ( 704.764 blocks/s, 44.048 Mb/s)
|
| Attachment 15: analysis.txt
|
*** TDR format 3.3.0 analyser - TD - May 2021
*** ERROR: READ I/O error: 5002
blocks: 32000
ADC data format: 255591110 ( 1400708.0 Hz)
Other data format: 6328890 ( 34684.0 Hz)
Sample trace data format: 0 ( 0.0 Hz)
Undefined format: 0 ( 0.0 Hz)
Other data format type: PAUSE: 179 ( 1.0 Hz)
RESUME: 179 ( 1.0 Hz)
SYNC100: 32680 ( 179.1 Hz)
WR48-63: 32680 ( 179.1 Hz)
FEE64 disc: 0 ( 0.0 Hz)
MBS info: 6263172 ( 34323.9 Hz)
Other info: 0 ( 0.0 Hz)
ADC data range bit set: 288458 ( 1580.8 Hz)
Timewarps: ADC: 0 ( 0.0 Hz)
PAUSE: 0 ( 0.0 Hz)
RESUME: 0 ( 0.0 Hz)
SYNC100: 0 ( 0.0 Hz)
WR48-63: 0 ( 0.0 Hz)
FEE64 disc: 0 ( 0.0 Hz)
MBS info: 0 ( 0.0 Hz)
Undefined: 0 ( 0.0 Hz)
Sample trace: 0 ( 0.0 Hz)
*** Timestamp elapsed time: 182.473 s
FEE elapsed dead time(s) elapsed idle time(s)
0 0.000 0.000
1 7.649 0.000
2 0.265 0.000
3 5.929 0.000
4 0.000 21.293
5 1.614 0.000
6 0.390 0.000
7 0.004 0.000
8 1.749 0.000
9 0.000 75.748
10 12.608 0.000
11 1.662 0.000
12 0.334 0.000
13 0.000 39.700
14 0.092 0.000
15 1.009 0.000
16 0.000 0.000
17 0.000 0.000
18 0.000 0.000
19 0.000 0.000
20 0.000 0.000
21 0.000 0.000
22 0.000 0.000
23 0.000 0.000
24 0.000 0.000
25 0.000 0.000
26 0.000 0.000
27 0.000 0.000
28 0.000 0.000
29 0.000 0.000
30 0.000 0.000
31 0.000 0.000
32 0.000 0.000
*** Statistics
FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data
0 9481493 3580 0 0 0 0 1244 1244 0 1092 0 15504
1 23234003 5924 0 0 42 42 2920 2920 0 0 0 30950
2 14360490 1787895 0 0 2 2 2026 2026 0 1783839 0 26238
3 26580599 1734745 0 0 32 32 3537 3537 0 1727607 0 36830
4 2867864 759325 0 0 0 0 449 449 0 758427 0 7075
5 13998560 454755 0 0 6 6 1806 1806 0 451131 0 20732
6 12019427 893028 0 0 3 3 1644 1644 0 889734 0 13550
7 19745451 656494 0 0 1 1 2575 2575 0 651342 0 25286
8 21649633 5478 0 0 7 7 2732 2732 0 0 0 32719
9 1602793 374 0 0 0 0 187 187 0 0 0 2586
10 42457575 10646 0 0 62 62 5261 5261 0 0 0 18276
11 18423606 4634 0 0 16 16 2301 2301 0 0 0 6050
12 14493303 3540 0 0 2 2 1768 1768 0 0 0 27878
13 2240564 512 0 0 0 0 256 256 0 0 0 2153
14 11446056 2794 0 0 2 2 1395 1395 0 0 0 17997
15 20989693 5166 0 0 4 4 2579 2579 0 0 0 4634
16 0 0 0 0 0 0 0 0 0 0 0 0
17 0 0 0 0 0 0 0 0 0 0 0 0
18 0 0 0 0 0 0 0 0 0 0 0 0
19 0 0 0 0 0 0 0 0 0 0 0 0
20 0 0 0 0 0 0 0 0 0 0 0 0
21 0 0 0 0 0 0 0 0 0 0 0 0
22 0 0 0 0 0 0 0 0 0 0 0 0
23 0 0 0 0 0 0 0 0 0 0 0 0
24 0 0 0 0 0 0 0 0 0 0 0 0
25 0 0 0 0 0 0 0 0 0 0 0 0
26 0 0 0 0 0 0 0 0 0 0 0 0
27 0 0 0 0 0 0 0 0 0 0 0 0
28 0 0 0 0 0 0 0 0 0 0 0 0
29 0 0 0 0 0 0 0 0 0 0 0 0
30 0 0 0 0 0 0 0 0 0 0 0 0
31 0 0 0 0 0 0 0 0 0 0 0 0
32 0 0 0 0 0 0 0 0 0 0 0 0
*** Timewarps
FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples
0 0 0 0 0 0 0 0 0 0
1 0 0 0 0 0 0 0 0 0
2 0 0 0 0 0 0 0 0 0
3 0 0 0 0 0 0 0 0 0
4 0 0 0 0 0 0 0 0 0
5 0 0 0 0 0 0 0 0 0
6 0 0 0 0 0 0 0 0 0
7 0 0 0 0 0 0 0 0 0
8 0 0 0 0 0 0 0 0 0
9 0 0 0 0 0 0 0 0 0
10 0 0 0 0 0 0 0 0 0
11 0 0 0 0 0 0 0 0 0
12 0 0 0 0 0 0 0 0 0
13 0 0 0 0 0 0 0 0 0
14 0 0 0 0 0 0 0 0 0
15 0 0 0 0 0 0 0 0 0
16 0 0 0 0 0 0 0 0 0
17 0 0 0 0 0 0 0 0 0
18 0 0 0 0 0 0 0 0 0
19 0 0 0 0 0 0 0 0 0
20 0 0 0 0 0 0 0 0 0
21 0 0 0 0 0 0 0 0 0
22 0 0 0 0 0 0 0 0 0
23 0 0 0 0 0 0 0 0 0
24 0 0 0 0 0 0 0 0 0
25 0 0 0 0 0 0 0 0 0
26 0 0 0 0 0 0 0 0 0
27 0 0 0 0 0 0 0 0 0
28 0 0 0 0 0 0 0 0 0
29 0 0 0 0 0 0 0 0 0
30 0 0 0 0 0 0 0 0 0
31 0 0 0 0 0 0 0 0 0
32 0 0 0 0 0 0 0 0 0
*** Program elapsed time: 52.041s ( 614.900 blocks/s, 38.431 Mb/s)
|
| Attachment 16: analysis.txt
|
*** TDR format 3.3.0 analyser - TD - May 2021
*** ERROR: READ I/O error: 5002
blocks: 32000
ADC data format: 254484788 ( 1267953.1 Hz)
Other data format: 7435212 ( 37045.4 Hz)
Sample trace data format: 0 ( 0.0 Hz)
Undefined format: 0 ( 0.0 Hz)
Other data format type: PAUSE: 166 ( 0.8 Hz)
RESUME: 166 ( 0.8 Hz)
SYNC100: 32747 ( 163.2 Hz)
WR48-63: 32747 ( 163.2 Hz)
FEE64 disc: 0 ( 0.0 Hz)
MBS info: 7369386 ( 36717.5 Hz)
Other info: 0 ( 0.0 Hz)
ADC data range bit set: 359272 ( 1790.0 Hz)
Timewarps: ADC: 0 ( 0.0 Hz)
PAUSE: 0 ( 0.0 Hz)
RESUME: 0 ( 0.0 Hz)
SYNC100: 0 ( 0.0 Hz)
WR48-63: 0 ( 0.0 Hz)
FEE64 disc: 0 ( 0.0 Hz)
MBS info: 0 ( 0.0 Hz)
Undefined: 0 ( 0.0 Hz)
Sample trace: 0 ( 0.0 Hz)
*** Timestamp elapsed time: 200.705 s
FEE elapsed dead time(s) elapsed idle time(s)
0 0.411 0.000
1 11.545 0.000
2 1.046 0.000
3 6.943 0.000
4 0.008 8.993
5 0.438 0.000
6 0.000 0.000
7 1.702 0.000
8 0.655 0.000
9 0.000 75.734
10 6.237 0.000
11 1.119 0.000
12 0.217 0.000
13 0.000 28.278
14 0.250 0.000
15 0.105 0.000
16 0.000 0.000
17 0.000 0.000
18 0.000 0.000
19 0.000 0.000
20 0.000 0.000
21 0.000 0.000
22 0.000 0.000
23 0.000 0.000
24 0.000 0.000
25 0.000 0.000
26 0.000 0.000
27 0.000 0.000
28 0.000 0.000
29 0.000 0.000
30 0.000 0.000
31 0.000 0.000
32 0.000 0.000
*** Statistics
FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data
0 8401665 3348 0 0 2 2 1072 1072 0 1200 0 19564
1 26165949 6958 0 0 57 57 3422 3422 0 0 0 37826
2 13624578 2004081 0 0 4 4 1973 1973 0 2000127 0 32349
3 29939387 1947767 0 0 35 35 4004 4004 0 1939689 0 45332
4 3232848 946545 0 0 1 1 548 548 0 945447 0 8745
5 15270389 573894 0 0 6 6 1986 1986 0 569910 0 26107
6 10372112 1114231 0 0 0 0 1457 1457 0 1111317 0 17063
7 19130864 806574 0 0 8 8 2431 2431 0 801696 0 31336
8 24018310 5808 0 0 5 5 2899 2899 0 0 0 41117
9 1787485 418 0 0 0 0 209 209 0 0 0 3357
10 42125761 10654 0 0 29 29 5298 5298 0 0 0 22828
11 16187533 3960 0 0 11 11 1969 1969 0 0 0 7397
12 14311704 3490 0 0 1 1 1744 1744 0 0 0 35224
13 2388212 620 0 0 0 0 310 310 0 0 0 2664
14 9736084 2414 0 0 1 1 1206 1206 0 0 0 22553
15 17791907 4450 0 0 6 6 2219 2219 0 0 0 5810
16 0 0 0 0 0 0 0 0 0 0 0 0
17 0 0 0 0 0 0 0 0 0 0 0 0
18 0 0 0 0 0 0 0 0 0 0 0 0
19 0 0 0 0 0 0 0 0 0 0 0 0
20 0 0 0 0 0 0 0 0 0 0 0 0
21 0 0 0 0 0 0 0 0 0 0 0 0
22 0 0 0 0 0 0 0 0 0 0 0 0
23 0 0 0 0 0 0 0 0 0 0 0 0
24 0 0 0 0 0 0 0 0 0 0 0 0
25 0 0 0 0 0 0 0 0 0 0 0 0
26 0 0 0 0 0 0 0 0 0 0 0 0
27 0 0 0 0 0 0 0 0 0 0 0 0
28 0 0 0 0 0 0 0 0 0 0 0 0
29 0 0 0 0 0 0 0 0 0 0 0 0
30 0 0 0 0 0 0 0 0 0 0 0 0
31 0 0 0 0 0 0 0 0 0 0 0 0
32 0 0 0 0 0 0 0 0 0 0 0 0
*** Timewarps
FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples
0 0 0 0 0 0 0 0 0 0
1 0 0 0 0 0 0 0 0 0
2 0 0 0 0 0 0 0 0 0
3 0 0 0 0 0 0 0 0 0
4 0 0 0 0 0 0 0 0 0
5 0 0 0 0 0 0 0 0 0
6 0 0 0 0 0 0 0 0 0
7 0 0 0 0 0 0 0 0 0
8 0 0 0 0 0 0 0 0 0
9 0 0 0 0 0 0 0 0 0
10 0 0 0 0 0 0 0 0 0
11 0 0 0 0 0 0 0 0 0
12 0 0 0 0 0 0 0 0 0
13 0 0 0 0 0 0 0 0 0
14 0 0 0 0 0 0 0 0 0
15 0 0 0 0 0 0 0 0 0
16 0 0 0 0 0 0 0 0 0
17 0 0 0 0 0 0 0 0 0
18 0 0 0 0 0 0 0 0 0
19 0 0 0 0 0 0 0 0 0
20 0 0 0 0 0 0 0 0 0
21 0 0 0 0 0 0 0 0 0
22 0 0 0 0 0 0 0 0 0
23 0 0 0 0 0 0 0 0 0
24 0 0 0 0 0 0 0 0 0
25 0 0 0 0 0 0 0 0 0
26 0 0 0 0 0 0 0 0 0
27 0 0 0 0 0 0 0 0 0
28 0 0 0 0 0 0 0 0 0
29 0 0 0 0 0 0 0 0 0
30 0 0 0 0 0 0 0 0 0
31 0 0 0 0 0 0 0 0 0
32 0 0 0 0 0 0 0 0 0
*** Program elapsed time: 43.287s ( 739.250 blocks/s, 46.203 Mb/s)
|
|
336
|
Thu May 20 07:03:02 2021 |
CA | Thursday May 20th 08:00 - 16:00 shift |
08:00 CA takes over
08:04 DAQ continues ok - writing to file R14_989
09:30 all system wide checks ok *except* WR decoder status;
Base Current Difference
aida05 fault 0x500 : 0x56a : 106
White Rabbit error counter test result: Passed 15, Failed 1
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
09:34 temperatures ok - attachment 1
stats ok - attachment 2
bias/leakage currents ok - attachment 3
R14_1016 analysis - max deadtime ~4.3% - attachment 4
11:30 all system wide checks ok *except* WR decoder status;
Base Current Difference
aida05 fault 0x500 : 0x56b : 107
White Rabbit error counter test result: Passed 15, Failed 1
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
11:34 temperatures ok - attachment 5
stats ok - attachment 6
bias/leakage currents ok - attachment 7
R14_1052 analysis - max deadtime ~3.6% - attachment 8
13:05 beam optimisation currently taking place
DAQ continues ok and writing to file R14_1085
13:17 no beam
13:28 all system wide checks ok, WR decoder status difference same as entry at 11:30.
13:31 temperatures ok - attachment 9
stats ok - attachment 10
bias/leakage currents ok - attachment 11
R14_1085 analysis (beam off) - max deadtime ~1.34% - attachment 12
13:37 beam is back - rate spectra - attachment 13
DAQ ok - writing to file R14_1088
13:43 analysis of R14_1088 - max deadtime back up to ~4.5% - attachment 14
14:21 beam off - issue with UNILAC
DESPEC also report issues with their DAQ
AIDA continues to forward data to MBS ok - lower rates while beam off
14.30 1.8.H spectra - attachments 16-18
1.8.L spectra - attachments 19-22
aida01 pulser peak width 99 ch FWHM
Rate spectra - attachment 23
Grafana - DSSSD bias & leakage currents past 7 days - attachment 24
DSSSD bias & leakage currents - attachment 25
Merger/Tape Server/Merger stats - attachment 26
14.41 All histograms & stats zero'd
14.55 Lost Activity Monitors - attachments 27, 28 & 35
Stats - ADC data items, disc, good wave, WR 28-47, pause, correlation scaler
15:00 beam is back
15:05 AIDA writing to file R14_1108
ADC data items - attachment 36
15:27 system wide checks ok *except* WR decoder status
Base Current Difference
aida05 fault 0x500 : 0x56c : 108
White Rabbit error counter test result: Passed 15, Failed 1
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
15:30 temperatures ok - attachment 37
stats ok - attachment 38
bias/leakage currents ok - attachment 39
R14_1113 analysis (beam off) - max deadtime ~4% - attachment 40 |
| Attachment 1: Screenshot_from_2021-05-20_08-33-49.png
|
|
| Attachment 2: Screenshot_from_2021-05-20_08-34-10.png
|
|
| Attachment 3: Screenshot_from_2021-05-20_08-34-44.png
|
|
| Attachment 4: Screenshot_from_2021-05-20_08-37-13.png
|
|
| Attachment 5: Screenshot_from_2021-05-20_10-32-22.png
|
|
| Attachment 6: Screenshot_from_2021-05-20_10-32-47.png
|
|
| Attachment 7: Screenshot_from_2021-05-20_10-33-04.png
|
|
| Attachment 8: Screenshot_from_2021-05-20_10-36-31.png
|
|
| Attachment 9: Screenshot_from_2021-05-20_12-29-26.png
|
|
| Attachment 10: Screenshot_from_2021-05-20_12-29-49.png
|
|
| Attachment 11: Screenshot_from_2021-05-20_12-30-20.png
|
|
| Attachment 12: Screenshot_from_2021-05-20_12-33-48.png
|
|
| Attachment 13: Screenshot_from_2021-05-20_12-38-42.png
|
|
| Attachment 14: Screenshot_from_2021-05-20_12-38-42.png
|
|
| Attachment 15: Screenshot_from_2021-05-20_12-43-18.png
|
|
| Attachment 16: Screenshot_2021-05-20_Spectrum_Browser_aidas-gsi(7).png
|
.png.png "Screenshot_2021-05-20_Spectrum_Browser_aidas-gsi(7).png")
|
| Attachment 17: Screenshot_2021-05-20_Spectrum_Browser_aidas-gsi(6).png
|
.png.png "Screenshot_2021-05-20_Spectrum_Browser_aidas-gsi(6).png")
|
| Attachment 18: Screenshot_2021-05-20_Spectrum_Browser_aidas-gsi(5).png
|
.png.png "Screenshot_2021-05-20_Spectrum_Browser_aidas-gsi(5).png")
|
| Attachment 19: Screenshot_2021-05-20_Spectrum_Browser_aidas-gsi(4).png
|
.png.png "Screenshot_2021-05-20_Spectrum_Browser_aidas-gsi(4).png")
|
| Attachment 20: Screenshot_2021-05-20_Spectrum_Browser_aidas-gsi(3).png
|
.png.png "Screenshot_2021-05-20_Spectrum_Browser_aidas-gsi(3).png")
|
| Attachment 21: Screenshot_2021-05-20_Spectrum_Browser_aidas-gsi(2).png
|
.png.png "Screenshot_2021-05-20_Spectrum_Browser_aidas-gsi(2).png")
|
| Attachment 22: Screenshot_2021-05-20_Spectrum_Browser_aidas-gsi(1).png
|
.png.png "Screenshot_2021-05-20_Spectrum_Browser_aidas-gsi(1).png")
|
| Attachment 23: Screenshot_2021-05-20_Spectrum_Browser_aidas-gsi.png
|
|
| Attachment 24: Screenshot_2021-05-20_AIDA_Alerting_-_Grafana.png
|
|
| Attachment 25: 710.png
|
|
| Attachment 26: 711.png
|
|
| Attachment 27: Screenshot_2021-05-20_Lost_activity_monitor_aidas-gsi(2).png
|
.png.png "Screenshot_2021-05-20_Lost_activity_monitor_aidas-gsi(2).png")
|
| Attachment 28: Screenshot_2021-05-20_Lost_activity_monitor_aidas-gsi(1).png
|
.png.png "Screenshot_2021-05-20_Lost_activity_monitor_aidas-gsi(1).png")
|
| Attachment 29: Screenshot_2021-05-20_Statistics_aidas-gsi(5).png
|
.png.png "Screenshot_2021-05-20_Statistics_aidas-gsi(5).png")
|
| Attachment 30: Screenshot_2021-05-20_Statistics_aidas-gsi(4).png
|
.png.png "Screenshot_2021-05-20_Statistics_aidas-gsi(4).png")
|
| Attachment 31: Screenshot_2021-05-20_Statistics_aidas-gsi(3).png
|
.png.png "Screenshot_2021-05-20_Statistics_aidas-gsi(3).png")
|
| Attachment 32: Screenshot_2021-05-20_Statistics_aidas-gsi(2).png
|
.png.png "Screenshot_2021-05-20_Statistics_aidas-gsi(2).png")
|
| Attachment 33: Screenshot_2021-05-20_Statistics_aidas-gsi(1).png
|
.png.png "Screenshot_2021-05-20_Statistics_aidas-gsi(1).png")
|
| Attachment 34: Screenshot_2021-05-20_Statistics_aidas-gsi.png
|
|
| Attachment 35: Screenshot_2021-05-20_Lost_activity_monitor_aidas-gsi.png
|
|
| Attachment 36: Screenshot_from_2021-05-20_14-07-22.png
|
|
| Attachment 37: Screenshot_from_2021-05-20_14-28-33.png
|
|
| Attachment 38: Screenshot_from_2021-05-20_14-29-04.png
|
|
| Attachment 39: Screenshot_from_2021-05-20_14-29-18.png
|
|
| Attachment 40: Screenshot_from_2021-05-20_14-31-50.png
|
|
|
342
|
Fri May 21 15:03:48 2021 |
CA | Friday 21st May 16:00 - 00:00 shift |
16:00 CA takes over
DSSD1 n+n sides 0x20 on ASICs 1-3 and 0x64 on ASIC 4
DSSD2 n+n sides 0x1b on ASICs 1-3 and 0x64 on ASIC 4
PULSER SETTINGS
---------------------------
Pulse is ON
Positive Tail Pulse
Trigger Source is Internal Clock
Trigger Threshold is 3.5
Amplitude : 2.0 Volts
Rep Rate : 2.0 hZ
Delay : 250.0 ns
Fall Time : 1 ms
Attenuation : 1
Display is : Volts
Equivalent keV is : 200.0
Ramp Start at 0.01 Volts
Ramp Stop at 9.99 Volts
Ramp Start at 1.0 keV
Ramp Stop at 999.0 keV
Ramp Time is 60 seconds
# Ramp Cycles is 1
16:14 system wide checks all ok *except*
Base Current Difference
aida05 fault 0x500 : 0x570 : 112
White Rabbit error counter test result: Passed 15, Failed 1
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
16:17 temperatures ok - attachment 1
statistics ok - attachment 2
detector bias / leakage currents ok - attachment 3
analysis of R14_1625 - FEE7 deadtime at 4.5%
18:06 system wide checks all ok *except*
Base Current Difference
aida05 fault 0x500 : 0x571 : 113
White Rabbit error counter test result: Passed 15, Failed 1
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
18:07 temperatures ok - attachment 4
statistics ok - attachment 5
detector bias / leakage currents ok - attachment 6
analysis of R14_1662 - FEE7 deadtime at 4.3%
19:07 DAQ continues ok - writing to file R14_1682
20:07 system wide checks all ok *except*
Base Current Difference
aida05 fault 0x500 : 0x572 : 114
White Rabbit error counter test result: Passed 15, Failed 1
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
20:10 temperatures ok - attachment 7
statistics ok - attachment 8
detector bias / leakage currents ok - attachment 9
analysis of R14_1703 - max deadtime at 4.0% - attachment 10
20:35 rate spectra - attachment 11
HEC spectra - attachment 12 & 13
20:36 all histograms zeroed
20:37 DAQ continues ok - writing to file R14_1712
20:45 /media/1e121361-83d3-4825-b6ae-9700b07e0ca7 at 94% use.
~ 12 hours until 100% at 10 MB/s data rate, not accounting for compression of older files
21:12 no beam - writing to file R14_1723
21:17 beam is back
22:07 system wide checks all ok - WR decoder fault same as entry at 20:07
22:08 temperatures ok - attachment 14
statistics ok - attachment 15
detector bias / leakage currents ok - attachment 16
analysis of R14_1740 - max deadtime at 4.2% - attachment 17
|
| Attachment 1: Screenshot_from_2021-05-21_15-14-59.png
|
|
| Attachment 2: Screenshot_from_2021-05-21_15-15-38.png
|
|
| Attachment 3: Screenshot_from_2021-05-21_15-15-54.png
|
|
| Attachment 4: Screenshot_from_2021-05-21_17-06-56.png
|
|
| Attachment 5: Screenshot_from_2021-05-21_17-07-18.png
|
|
| Attachment 6: Screenshot_from_2021-05-21_17-07-47.png
|
|
| Attachment 7: Screenshot_from_2021-05-21_19-09-19.png
|
|
| Attachment 8: Screenshot_from_2021-05-21_19-09-59.png
|
|
| Attachment 9: Screenshot_from_2021-05-21_19-10-15.png
|
|
| Attachment 10: Screenshot_from_2021-05-21_19-14-45.png
|
|
| Attachment 11: Screenshot_from_2021-05-21_19-25-51.png
|
|
| Attachment 12: Screenshot_from_2021-05-21_19-30-14.png
|
|
| Attachment 13: Screenshot_from_2021-05-21_19-32-13.png
|
|
| Attachment 14: Screenshot_from_2021-05-21_21-08-28.png
|
|
| Attachment 15: Screenshot_from_2021-05-21_21-08-51.png
|
|
| Attachment 16: Screenshot_from_2021-05-21_21-09-06.png
|
|
| Attachment 17: Screenshot_from_2021-05-21_21-12-03.png
|
|
|
616
|
Sun Apr 28 15:09:34 2024 |
Betool Alayed | 16:0-00:00 28 April 2024 |
16:00 aida04 not producing data
power cycle all FEE64s to recover DAQ
16.20 analysis data file R21_668
max deadtime 17% (aida04), 9% (aida02), 2% (aida06) all others < 1%
no timewarps
HEC data item rate 1.9kHz
|
| Attachment 1: R21_668.txt
|
*** TDR format 3.3.0 analyser - TD - May 2021
*** ERROR: READ I/O error: 5002
blocks: 32000
ADC data format: 256513573 ( 1160512.7 Hz)
Other data format: 5406427 ( 24459.6 Hz)
Sample trace data format: 0 ( 0.0 Hz)
Undefined format: 0 ( 0.0 Hz)
Other data format type: PAUSE: 1079 ( 4.9 Hz)
RESUME: 1078 ( 4.9 Hz)
SYNC100: 32824 ( 148.5 Hz)
WR48-63: 32824 ( 148.5 Hz)
FEE64 disc: 0 ( 0.0 Hz)
MBS info: 5338622 ( 24152.9 Hz)
Other info: 0 ( 0.0 Hz)
ADC data range bit set: 440937 ( 1994.9 Hz)
Timewarps: ADC: 0 ( 0.0 Hz)
PAUSE: 0 ( 0.0 Hz)
RESUME: 0 ( 0.0 Hz)
SYNC100: 0 ( 0.0 Hz)
WR48-63: 0 ( 0.0 Hz)
FEE64 disc: 0 ( 0.0 Hz)
MBS info: 0 ( 0.0 Hz)
Undefined: 0 ( 0.0 Hz)
Sample trace: 0 ( 0.0 Hz)
*** Timestamp elapsed time: 221.035 s
FEE elapsed dead time(s) elapsed idle time(s)
0 0.085 0.000
1 19.736 0.000
2 0.053 0.000
3 36.607 0.000
4 0.854 0.000
5 4.747 0.000
6 0.000 0.000
7 1.845 0.000
8 0.000 0.000
9 0.000 0.000
10 0.661 0.000
11 0.020 0.000
12 0.004 0.000
13 0.000 0.000
14 0.003 0.000
15 1.247 0.000
16 0.000 0.000
17 0.000 0.000
18 0.000 0.000
19 0.000 0.000
20 0.000 0.000
21 0.000 0.000
22 0.000 0.000
23 0.000 0.000
24 0.000 0.000
25 0.000 0.000
26 0.000 0.000
27 0.000 0.000
28 0.000 0.000
29 0.000 0.000
30 0.000 0.000
31 0.000 0.000
32 0.000 0.000
*** Statistics
FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data
0 8138410 8624 0 0 12 12 985 985 0 6630 0 38979
1 27142829 245404 0 0 242 242 3461 3461 0 237998 0 64179
2 11096772 2350080 0 0 8 8 1768 1768 0 2346528 0 26862
3 37888832 1835283 0 0 304 303 4762 4762 0 1825152 0 18340
4 9329455 413600 0 0 28 28 1212 1212 0 411120 0 29227
5 23846951 517930 0 0 167 167 3201 3201 0 511194 0 24385
6 5635241 1420 0 0 0 0 710 710 0 0 0 8053
7 40074524 10318 0 0 93 93 5066 5066 0 0 0 120554
8 3088839 754 0 0 0 0 377 377 0 0 0 14672
9 5102920 1254 0 0 0 0 627 627 0 0 0 6080
10 25963054 6756 0 0 140 140 3238 3238 0 0 0 2640
11 5980678 1458 0 0 5 5 724 724 0 0 0 52714
12 5769255 1548 0 0 2 2 772 772 0 0 0 8398
13 3930590 926 0 0 0 0 463 463 0 0 0 9544
14 5399163 1328 0 0 1 1 663 663 0 0 0 5692
15 38126060 9744 0 0 77 77 4795 4795 0 0 0 10618
16 0 0 0 0 0 0 0 0 0 0 0 0
17 0 0 0 0 0 0 0 0 0 0 0 0
18 0 0 0 0 0 0 0 0 0 0 0 0
19 0 0 0 0 0 0 0 0 0 0 0 0
20 0 0 0 0 0 0 0 0 0 0 0 0
21 0 0 0 0 0 0 0 0 0 0 0 0
22 0 0 0 0 0 0 0 0 0 0 0 0
23 0 0 0 0 0 0 0 0 0 0 0 0
24 0 0 0 0 0 0 0 0 0 0 0 0
25 0 0 0 0 0 0 0 0 0 0 0 0
26 0 0 0 0 0 0 0 0 0 0 0 0
27 0 0 0 0 0 0 0 0 0 0 0 0
28 0 0 0 0 0 0 0 0 0 0 0 0
29 0 0 0 0 0 0 0 0 0 0 0 0
30 0 0 0 0 0 0 0 0 0 0 0 0
31 0 0 0 0 0 0 0 0 0 0 0 0
32 0 0 0 0 0 0 0 0 0 0 0 0
*** Timewarps
FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples
0 0 0 0 0 0 0 0 0 0
1 0 0 0 0 0 0 0 0 0
2 0 0 0 0 0 0 0 0 0
3 0 0 0 0 0 0 0 0 0
4 0 0 0 0 0 0 0 0 0
5 0 0 0 0 0 0 0 0 0
6 0 0 0 0 0 0 0 0 0
7 0 0 0 0 0 0 0 0 0
8 0 0 0 0 0 0 0 0 0
9 0 0 0 0 0 0 0 0 0
10 0 0 0 0 0 0 0 0 0
11 0 0 0 0 0 0 0 0 0
12 0 0 0 0 0 0 0 0 0
13 0 0 0 0 0 0 0 0 0
14 0 0 0 0 0 0 0 0 0
15 0 0 0 0 0 0 0 0 0
16 0 0 0 0 0 0 0 0 0
17 0 0 0 0 0 0 0 0 0
18 0 0 0 0 0 0 0 0 0
19 0 0 0 0 0 0 0 0 0
20 0 0 0 0 0 0 0 0 0
21 0 0 0 0 0 0 0 0 0
22 0 0 0 0 0 0 0 0 0
23 0 0 0 0 0 0 0 0 0
24 0 0 0 0 0 0 0 0 0
25 0 0 0 0 0 0 0 0 0
26 0 0 0 0 0 0 0 0 0
27 0 0 0 0 0 0 0 0 0
28 0 0 0 0 0 0 0 0 0
29 0 0 0 0 0 0 0 0 0
30 0 0 0 0 0 0 0 0 0
31 0 0 0 0 0 0 0 0 0
32 0 0 0 0 0 0 0 0 0
*** Program elapsed time: 34.004s ( 941.068 blocks/s, 58.817 Mb/s)
|
|
619
|
Sun Apr 28 16:26:47 2024 |
Betool Alayed | 16:00-00:00 Sunday 28 April |
19:24 pm screenshots
and
17:18 pm screenshots |
| Attachment 1: Screenshot_from_2024-04-28_17-18-38.png
|
|
| Attachment 2: Screenshot_from_2024-04-28_17-13-13.png
|
|
| Attachment 3: Screenshot_from_2024-04-28_17-11-48.png
|
|
| Attachment 4: Screenshot_from_2024-04-28_17-10-32.png
|
|
| Attachment 5: Screenshot_from_2024-04-28_17-04-10.png
|
|
| Attachment 6: Screenshot_from_2024-04-28_19-18-42.png
|
|
| Attachment 7: Screenshot_from_2024-04-28_19-20-10.png
|
|
| Attachment 8: Screenshot_from_2024-04-28_19-22-19.png
|
|
| Attachment 9: Screenshot_from_2024-04-28_19-23-19.png
|
|
| Attachment 10: Screenshot_from_2024-04-28_19-24-40.png
|
|
|
620
|
Sun Apr 28 20:35:57 2024 |
Betool Alayed | 16:0-00:00 28 April 2024 |
21:30 screenshots
and
23:24 screenshots |
| Attachment 1: Screenshot_from_2024-04-28_21-30-19.png
|
|
| Attachment 2: Screenshot_from_2024-04-28_21-31-11.png
|
|
| Attachment 3: Screenshot_from_2024-04-28_21-32-07.png
|
|
| Attachment 4: Screenshot_from_2024-04-28_21-32-51.png
|
|
| Attachment 5: Screenshot_from_2024-04-28_21-35-10.png
|
|
| Attachment 6: Screenshot_from_2024-04-28_23-35-25.png
|
|
| Attachment 7: Screenshot_from_2024-04-28_23-34-31.png
|
|
| Attachment 8: Screenshot_from_2024-04-28_23-33-42.png
|
|
| Attachment 9: Screenshot_from_2024-04-28_23-32-28.png
|
|
| Attachment 10: Screenshot_from_2024-04-28_23-31-51.png
|
|
|
657
|
Wed Jun 12 15:41:07 2024 |
Betool Alayed | 16:00-00:00 Wed 12 Jun 24 |
5pm full checks:
DSSSD bias & leakage current ok - attachment # 1-2
FEE64 temperatures ok - attachment # 3
ADC data item stats - attachment # 4
Merger ok - Attachement # 5
Tape service - attachement # 6
7pm full checks:
DSSSD bias & leakage current ok - attachment # 7-8
FEE64 temperatures ok - attachment # 9
ADC data item stats - attachment # 10
Merger ok - Attachement # 11
Tape service - attachement # 12
ucesb - attachment # 13
9pm full checks:
DSSSD bias & leakage current ok - attachment# 14-15
FEE64 temperatures ok - attachment # 16
ADC data item stats - attachment # 17
Merger ok - Attachement # 18
Tape service - attachement # 19
ucesb - attachment # 20
11pm full checks:
DSSSD bias & leakage current ok - attachment# 21-22
FEE64 temperatures ok - attachment # 23
ADC data item stats - attachment # 24
Merger ok - Attachement # 25
Tape service - attachement # 26
ucesb - attachment # 27 |
| Attachment 1: Screenshot_from_2024-06-12_17-00-31.png
|
|
| Attachment 2: Screenshot_from_2024-06-12_17-01-10.png
|
|
| Attachment 3: Screenshot_from_2024-06-12_17-02-29.png
|
|
| Attachment 4: Screenshot_from_2024-06-12_17-03-14.png
|
|
| Attachment 5: Screenshot_from_2024-06-12_17-31-47.png
|
|
| Attachment 6: Screenshot_from_2024-06-12_17-31-13.png
|
|
| Attachment 7: Screenshot_from_2024-06-12_19-03-51.png
|
|
| Attachment 8: Screenshot_from_2024-06-12_19-04-39.png
|
|
| Attachment 9: Screenshot_from_2024-06-12_19-05-34.png
|
|
| Attachment 10: Screenshot_from_2024-06-12_19-06-05.png
|
|
| Attachment 11: Screenshot_from_2024-06-12_19-07-15.png
|
|
| Attachment 12: Screenshot_from_2024-06-12_19-08-02.png
|
|
| Attachment 13: Screenshot_from_2024-06-12_19-12-15.png
|
|
| Attachment 14: Screenshot_from_2024-06-12_21-01-54.png
|
|
| Attachment 15: Screenshot_from_2024-06-12_21-03-08.png
|
|
| Attachment 16: Screenshot_from_2024-06-12_21-03-52.png
|
|
| Attachment 17: Screenshot_from_2024-06-12_21-04-48.png
|
|
| Attachment 18: Screenshot_from_2024-06-12_21-06-37.png
|
|
| Attachment 19: Screenshot_from_2024-06-12_21-07-16.png
|
|
| Attachment 20: Screenshot_from_2024-06-12_21-08-36.png
|
|
| Attachment 21: Screenshot_from_2024-06-12_22-58-59.png
|
|
| Attachment 22: Screenshot_from_2024-06-12_22-59-43.png
|
|
| Attachment 23: Screenshot_from_2024-06-12_23-01-09.png
|
|
| Attachment 24: Screenshot_from_2024-06-12_23-02-14.png
|
|
| Attachment 25: Screenshot_from_2024-06-12_23-03-09.png
|
|
| Attachment 26: Screenshot_from_2024-06-12_23-03-48.png
|
|
| Attachment 27: Screenshot_from_2024-06-12_23-05-26.png
|
|
|
237
|
Sun Apr 18 00:57:36 2021 |
BA, MA | Sanday 18 April 00.00-08.00 |
02:01 Beam has stopped at 01:37 and returend at 01:43 for few min and then stopped again and not knowen how it will take until it is back
AIDA scalers attached 1
statistic attached 2
temretuer attached 3
bias attached 4
Clock check ok
ADC check :
FEE64 module aida06 failed
FEE64 module aida07 failed
FEE64 module aida10 failed
Calibration test result: Passed 9, Failed 3
If any modules fail calibration , check the clock status and open the FADC Align and Control browser page to rerun calibration for that module
Base Current Difference
aida05 fault 0x1a52 : 0x1a55 : 3
aida06 fault 0x4f3e : 0x4f41 : 3
aida07 fault 0x3bcd : 0x3bea : 29
aida08 fault 0xc7c7 : 0xc7ca : 3
White Rabbit error counter test result: Passed 8, Failed 4
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
Base Current Difference
aida09 fault 0x0 : 0x1 : 1
aida12 fault 0x0 : 0x9 : 9
FPGA Timestamp error counter test result: Passed 10, Failed 2
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last
Returned 0 0 0 0 0 0 0 0 0 0 0 0
Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k
aida01 : 32 8 3 1 0 3 1 3 3 3 6 : 36240
aida02 : 11 7 9 3 1 2 2 4 2 3 6 : 35988
aida03 : 32 4 13 5 5 4 3 3 2 3 6 : 36432
aida04 : 26 7 6 1 2 3 2 4 2 3 6 : 36128
aida05 : 18 8 8 7 4 2 2 2 2 4 6 : 37352
aida06 : 24 11 3 1 2 5 1 3 3 3 6 : 36616
aida07 : 14 5 3 3 3 2 3 2 4 3 6 : 37296
aida08 : 21 7 1 5 0 1 2 3 3 3 6 : 36284
aida09 : 0 7 1 1 1 3 2 2 3 3 6 : 35880
aida10 : 22 5 3 4 1 2 2 2 3 3 6 : 35952
aida11 : 4 3 1 1 2 2 3 3 2 3 6 : 35544
aida12 : 22 10 5 4 4 4 1 3 3 3 6 : 36728
02:19 beam is back
03:58 The beam has not been stable yet
The rate reach 1.5 kHz, they will contact FRS team to lower the intensity of the beam
AIDA scalers attached 8
statistic attached 7
temretuer attached 6
bias attached 5
FEE64 module aida06 failed
FEE64 module aida07 failed
FEE64 module aida10 failed
Calibration test result: Passed 9, Failed 3
If any modules fail calibration , check the clock status and open the FADC Align and Control browser page to rerun calibration for that module
Base Current Difference
aida05 fault 0x1a52 : 0x1a55 : 3
aida06 fault 0x4f3e : 0x4f41 : 3
aida07 fault 0x3bcd : 0x3beb : 30
aida08 fault 0xc7c7 : 0xc7ca : 3
White Rabbit error counter test result: Passed 8, Failed 4
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
Base Current Difference
aida09 fault 0x0 : 0x1 : 1
aida12 fault 0x0 : 0x9 : 9
FPGA Timestamp error counter test result: Passed 10, Failed 2
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last
Returned 0 0 0 0 0 0 0 0 0 0 0 0
Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k
aida01 : 21 8 6 2 1 2 1 3 3 3 6 : 36212
aida02 : 24 14 14 2 1 2 2 4 2 3 6 : 36144
aida03 : 31 5 10 5 5 4 2 3 2 3 6 : 36132
aida04 : 12 11 12 2 2 2 3 4 2 3 6 : 36360
aida05 : 23 8 5 7 4 2 2 2 2 4 6 : 37324
aida06 : 21 14 14 1 3 5 1 3 3 3 6 : 36868
aida07 : 15 9 5 0 3 2 3 2 4 3 6 : 37268
aida08 : 21 11 10 3 0 1 2 3 3 3 6 : 36396
aida09 : 5 7 5 1 1 3 1 3 3 3 6 : 36220
aida10 : 15 13 12 3 2 1 2 2 3 3 6 : 36036
aida11 : 13 10 1 0 2 2 2 4 2 3 6 : 35860
aida12 : 29 5 4 5 5 3 1 3 3 3 6 : 36668
05: 07 The rate was a bout 1500 and 2000, we contacted Oscar he said (if it's just bursts it should be ok), so they decided to do nothing.
06:26
AIDA scalers attached 9
statistic attached 10
temretuer attached 11
bias attached 12
Clock status test result: Passed 12, Failed 0
Understand status as follows
Status bit 3 : firmware PLL that creates clocks from external clock not locked
Status bit 2 : always logic '1'
Status bit 1 : LMK3200(2) PLL and clock distribution chip not locked to external clock
Status bit 0 : LMK3200(1) PLL and clock distribution chip not locked to external clock
If all these bits are not set then the operation of the firmware is unreliable
FEE64 module aida06 failed
FEE64 module aida07 failed
FEE64 module aida10 failed
Calibration test result: Passed 9, Failed 3
If any modules fail calibration , check the clock status and open the FADC Align and Control browser page to rerun calibration for that module
Base Current Difference
aida01 fault 0x7685 : 0x7686 : 1
aida02 fault 0x941c : 0x941d : 1
aida03 fault 0x7cd6 : 0x7cd7 : 1
aida04 fault 0xb86c : 0xb86d : 1
aida05 fault 0x1a52 : 0x1a59 : 7
aida06 fault 0x4f3e : 0x4f45 : 7
aida07 fault 0x3bcd : 0x3bf9 : 44
aida08 fault 0xc7c7 : 0xc7ce : 7
aida09 fault 0xb33a : 0xb33b : 1
White Rabbit error counter test result: Passed 3, Failed 9
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
Base Current Difference
aida09 fault 0x0 : 0x1 : 1
aida12 fault 0x0 : 0xa : 10
FPGA Timestamp error counter test result: Passed 10, Failed 2
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last
Returned 0 0 0 0 0 0 0 0 0 0 0 0
Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k
aida01 : 17 12 6 2 1 2 1 3 3 3 6 : 36228
aida02 : 19 11 12 3 2 2 2 4 2 3 6 : 36164
aida03 : 25 8 12 5 4 4 3 3 2 3 6 : 36356
aida04 : 22 19 11 3 1 2 3 4 2 3 6 : 36416
aida05 : 35 6 5 6 3 2 2 2 3 3 6 : 36236
aida06 : 12 11 11 2 3 4 1 3 3 3 6 : 36664
aida07 : 18 6 2 1 3 2 3 2 3 3 6 : 36216
aida08 : 27 10 8 3 0 1 2 3 3 3 6 : 36380
aida09 : 18 6 6 1 0 2 2 2 3 3 6 : 35832
aida10 : 3 14 10 3 1 1 2 3 3 3 6 : 36412
aida11 : 1 3 2 0 2 2 2 4 2 3 6 : 35772
aida12 : 0 5 6 3 3 4 1 3 3 3 6 : 36520
07:57 The beam stopped and they said there is a water leak !
|
| Attachment 1: 20210418_0154.png
|
|
| Attachment 2: 20210418_0152_rate.png
|
|
| Attachment 3: 20210418_0150_tem.png
|
|
| Attachment 4: 20210418_0150_bias.png
|
|
| Attachment 5: 20210418_0407.png
|
|
| Attachment 6: 20210418_0409.png
|
|
| Attachment 7: 20210418_0411.png
|
|
| Attachment 8: 20210418_0413.png
|
|
| Attachment 9: 18042021_0722_AIDA.png
|
|
| Attachment 10: 18042021_0615_rate.png
|
|
| Attachment 11: 18042021_0616_temp.png
|
|
| Attachment 12: 18042021_0620_bias.png
|
|
|
434
|
Thu May 12 21:43:49 2022 |
BA, MA | Rates |
Statistic check (screenshot attached).
Temperatures OK (screenshot attached).
Bias and leakage currents OK (same screenshot as temps).
|
| Attachment 1: Stati2022-05-12_22-47-26.png
|
|
| Attachment 2: Temp2022-05-12_22-48-41.png
|
|
| Attachment 3: LeakageCurrent2022-05-12_22-45-44.png
|
|
|
435
|
Thu May 12 22:49:39 2022 |
BA, MA | Low Rates |
The rate is very low in all aida, not sure . |
| Attachment 1: RatesLow2022-05-12_23-48-01.png
|
|
|
451
|
Sat May 14 15:35:24 2022 |
BA, AA | Saturday 14 May |
|
| Attachment 1: Stais_from_2022-05-14_16-30-53.png
|
|
| Attachment 2: Temp_2022-05-14_16-32-42.png
|
|
| Attachment 3: Leakage_2022-05-14_16-33-45.png
|
|
|
452
|
Sat May 14 17:34:40 2022 |
BA, AA | Saturday 14 May |
FEE64 module aida09 global clocks failed, 6
Clock status test result: Passed 13, Failed 1
Understand status as follows
Status bit 3 : firmware PLL that creates clocks from external clock not locked
Status bit 2 : always logic '1'
Status bit 1 : LMK3200(2) PLL and clock distribution chip not locked to external clock
Status bit 0 : LMK3200(1) PLL and clock distribution chip not locked to external clock
If all these bits are not set then the operation of the firmware is unreliable
FEE64 module aida02 failed
FEE64 module aida06 failed
FEE64 module aida09 failed
FEE64 module aida10 failed
FEE64 module aida13 failed
Calibration test result: Passed 9, Failed 5
If any modules fail calibration , check the clock status and open the FADC Align and Control browser page to rerun calibration for that module
White Rabbit error counter test result: Passed 14, Failed 0
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
FPGA Timestamp error counter test result: Passed 14, Failed 0
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last
|
| Attachment 1: Stat_2022-05-14_18-33-16.png
|
|
| Attachment 2: Temp_2022-05-14_18-32-07.png
|
|
| Attachment 3: Leakage_2022-05-14_18-30-52.png
|
|
|
453
|
Sat May 14 19:39:13 2022 |
BA, AA | Saturday 14 May |
FEE64 module aida09 global clocks failed, 6
Clock status test result: Passed 13, Failed 1
Understand status as follows
Status bit 3 : firmware PLL that creates clocks from external clock not locked
Status bit 2 : always logic '1'
Status bit 1 : LMK3200(2) PLL and clock distribution chip not locked to external clock
Status bit 0 : LMK3200(1) PLL and clock distribution chip not locked to external clock
If all these bits are not set then the operation of the firmware is unreliable
FEE64 module aida02 failed
FEE64 module aida06 failed
FEE64 module aida09 failed
FEE64 module aida10 failed
FEE64 module aida13 failed
Calibration test result: Passed 9, Failed 5
If any modules fail calibration , check the clock status and open the FADC Align and Control browser page to rerun calibration for that module
White Rabbit error counter test result: Passed 14, Failed 0
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
FPGA Timestamp error counter test result: Passed 14, Failed 0
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last |
| Attachment 1: Stat_2022-05-14_20-36-15.png
|
|
| Attachment 2: Temp_2022-05-14_20-35-19.png
|
|
| Attachment 3: Leakage_2022-05-14_20-33-32.png
|
|
|
454
|
Sat May 14 21:34:11 2022 |
BA, AA | Saturday 14 May |
FEE64 module aida09 global clocks failed, 6
Clock status test result: Passed 13, Failed 1
Understand status as follows
Status bit 3 : firmware PLL that creates clocks from external clock not locked
Status bit 2 : always logic '1'
Status bit 1 : LMK3200(2) PLL and clock distribution chip not locked to external clock
Status bit 0 : LMK3200(1) PLL and clock distribution chip not locked to external clock
If all these bits are not set then the operation of the firmware is unreliable
FEE64 module aida02 failed
FEE64 module aida06 failed
FEE64 module aida09 failed
FEE64 module aida10 failed
FEE64 module aida13 failed
Calibration test result: Passed 9, Failed 5
If any modules fail calibration , check the clock status and open the FADC Align and Control browser page to rerun calibration for that module
White Rabbit error counter test result: Passed 14, Failed 0
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
FPGA Timestamp error counter test result: Passed 14, Failed 0
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last |
| Attachment 1: Rates_2022-05-14_22-32-44.png
|
|
| Attachment 2: Temp_2022-05-14_22-31-37.png
|
|
| Attachment 3: Leakg_2022-05-14_22-30-28.png
|
|