| ID |
Date |
Author |
Subject |
|
454
|
Sat May 14 21:34:11 2022 |
BA, AA | Saturday 14 May |
FEE64 module aida09 global clocks failed, 6
Clock status test result: Passed 13, Failed 1
Understand status as follows
Status bit 3 : firmware PLL that creates clocks from external clock not locked
Status bit 2 : always logic '1'
Status bit 1 : LMK3200(2) PLL and clock distribution chip not locked to external clock
Status bit 0 : LMK3200(1) PLL and clock distribution chip not locked to external clock
If all these bits are not set then the operation of the firmware is unreliable
FEE64 module aida02 failed
FEE64 module aida06 failed
FEE64 module aida09 failed
FEE64 module aida10 failed
FEE64 module aida13 failed
Calibration test result: Passed 9, Failed 5
If any modules fail calibration , check the clock status and open the FADC Align and Control browser page to rerun calibration for that module
White Rabbit error counter test result: Passed 14, Failed 0
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
FPGA Timestamp error counter test result: Passed 14, Failed 0
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last |
| Attachment 1: Rates_2022-05-14_22-32-44.png
|
|
| Attachment 2: Temp_2022-05-14_22-31-37.png
|
|
| Attachment 3: Leakg_2022-05-14_22-30-28.png
|
|
|
453
|
Sat May 14 19:39:13 2022 |
BA, AA | Saturday 14 May |
FEE64 module aida09 global clocks failed, 6
Clock status test result: Passed 13, Failed 1
Understand status as follows
Status bit 3 : firmware PLL that creates clocks from external clock not locked
Status bit 2 : always logic '1'
Status bit 1 : LMK3200(2) PLL and clock distribution chip not locked to external clock
Status bit 0 : LMK3200(1) PLL and clock distribution chip not locked to external clock
If all these bits are not set then the operation of the firmware is unreliable
FEE64 module aida02 failed
FEE64 module aida06 failed
FEE64 module aida09 failed
FEE64 module aida10 failed
FEE64 module aida13 failed
Calibration test result: Passed 9, Failed 5
If any modules fail calibration , check the clock status and open the FADC Align and Control browser page to rerun calibration for that module
White Rabbit error counter test result: Passed 14, Failed 0
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
FPGA Timestamp error counter test result: Passed 14, Failed 0
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last |
| Attachment 1: Stat_2022-05-14_20-36-15.png
|
|
| Attachment 2: Temp_2022-05-14_20-35-19.png
|
|
| Attachment 3: Leakage_2022-05-14_20-33-32.png
|
|
|
452
|
Sat May 14 17:34:40 2022 |
BA, AA | Saturday 14 May |
FEE64 module aida09 global clocks failed, 6
Clock status test result: Passed 13, Failed 1
Understand status as follows
Status bit 3 : firmware PLL that creates clocks from external clock not locked
Status bit 2 : always logic '1'
Status bit 1 : LMK3200(2) PLL and clock distribution chip not locked to external clock
Status bit 0 : LMK3200(1) PLL and clock distribution chip not locked to external clock
If all these bits are not set then the operation of the firmware is unreliable
FEE64 module aida02 failed
FEE64 module aida06 failed
FEE64 module aida09 failed
FEE64 module aida10 failed
FEE64 module aida13 failed
Calibration test result: Passed 9, Failed 5
If any modules fail calibration , check the clock status and open the FADC Align and Control browser page to rerun calibration for that module
White Rabbit error counter test result: Passed 14, Failed 0
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
FPGA Timestamp error counter test result: Passed 14, Failed 0
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last
|
| Attachment 1: Stat_2022-05-14_18-33-16.png
|
|
| Attachment 2: Temp_2022-05-14_18-32-07.png
|
|
| Attachment 3: Leakage_2022-05-14_18-30-52.png
|
|
|
451
|
Sat May 14 15:35:24 2022 |
BA, AA | Saturday 14 May |
|
| Attachment 1: Stais_from_2022-05-14_16-30-53.png
|
|
| Attachment 2: Temp_2022-05-14_16-32-42.png
|
|
| Attachment 3: Leakage_2022-05-14_16-33-45.png
|
|
|
450
|
Sat May 14 13:01:58 2022 |
MS, OH | Saturday 14 May |
14:00 |
| Attachment 1: Screenshot_2022-05-14_at_14-02-31_Statistics_aidas-gsi.png
|
|
| Attachment 2: Screenshot_2022-05-14_at_14-02-52_Temperature_and_status_scan_aidas-gsi.png
|
|
| Attachment 3: Screenshot_from_2022-05-14_14-03-54.png
|
|
|
449
|
Sat May 14 10:59:52 2022 |
MS, OH | Saturday 14 May |
12:00 |
| Attachment 1: Screenshot_2022-05-14_at_12-00-16_Statistics_aidas-gsi.png
|
|
| Attachment 2: Screenshot_2022-05-14_at_12-00-44_Temperature_and_status_scan_aidas-gsi.png
|
|
| Attachment 3: Screenshot_from_2022-05-14_12-01-54.png
|
|
|
448
|
Sat May 14 09:00:21 2022 |
MS, OH | Saturday 14 May |
10:00 |
| Attachment 1: Screenshot_2022-05-14_at_10-01-07_Statistics_aidas-gsi.png
|
|
| Attachment 2: Screenshot_2022-05-14_at_10-01-50_Temperature_and_status_scan_aidas-gsi.png
|
|
| Attachment 3: Screenshot_from_2022-05-14_10-02-51.png
|
|
|
447
|
Sat May 14 06:57:21 2022 |
MS, OH | Saturday 14 May |
08:00 Took over the shift from Philippos
In system wide checks aida09 fails ASIC clock check but it is bit 6 which is ok |
|
446
|
Sat May 14 03:14:00 2022 |
PP | Shift Checks |
4:13
AIDA stats OK
Leakage current OK
Temperatures OK
grafana OK
ucesb rates OK
System wide check done and same results as earlier: aida09 fails clock (1), aida02 06 09 10 13 fail ADC calibration, all pass WR
Screenshot 1: statistics
Screenshot 2: temperatures
Screenshot 3: scalers
Screenshot 4: Bias and leakage current
6:36
AIDA stats OK
Leakage current OK
Temperatures OK
grafana OK
ucesb rates OK
System wide check done and same results as earlier: aida09 fails clock (1), aida02 06 09 10 13 fail ADC calibration, all pass WR
Screenshot 5: statistics
Screenshot 6: temperatures
Screenshot 7: scalers
Screenshot 8: Bias and leakage current
|
| Attachment 1: stats-220514-0428.png
|
|
| Attachment 2: temps-220514-0417.png
|
|
| Attachment 3: scalers-220514-0426.png
|
|
| Attachment 4: I-V-220514-0431.png
|
|
| Attachment 5: stats-220514-0639.png
|
|
| Attachment 6: temps-220514-0639.png
|
|
| Attachment 7: scalers-220514-0641.png
|
|
| Attachment 8: I-V-220514-0640.png
|
|
|
445
|
Sat May 14 01:52:03 2022 |
ML | 2h-Shift Checks |
AIDA stats ok
Leakage current ok
Temperatires ok
grafana ok
ucesb rates dropped a bit in all scalers so beam intensity must have dropped a bit.
System wide check done and same results as earlier:
aida09 fails clock (1), aida02 06 09 10 13 fail ADC calibration, all pass WR |
| Attachment 1: Stats_Screenshot_from_2022-05-14_02-48-14.png
|
|
| Attachment 2: Temp_Screenshot_from_2022-05-14_02-47-31.png
|
|
| Attachment 3: HV_LC_Screenshot_from_2022-05-14_02-46-42.png
|
|
| Attachment 4: ucesb_rates_Screenshot_from_2022-05-14_02-50-36.png
|
|
| Attachment 5: Grafana_Screenshot_from_2022-05-14_03-50-00.png
|
|
|
444
|
Fri May 13 23:37:59 2022 |
ML | 2h-Shift Checks |
Took over remotely from CB about an hour ago
At 0h40 (CET):
Stats still ok - attach 1
Leakage still OK - Attach 2
Temps - attach 3
Grafana OK
UCESB rates ok - attach 5
System-wide checks: aida09 fails clock (1), aida02 06 09 10 13 fail ADC calibration, all pass WR |
| Attachment 1: Stats_Screenshot_from_2022-05-14_00-40-56.png
|
|
| Attachment 2: HV_LC_Screenshot_from_2022-05-14_00-39-51.png
|
|
| Attachment 3: temp_Screenshot_from_2022-05-14_00-41-44.png
|
|
| Attachment 4: UCESB_Screenshot_from_2022-05-14_01-00-00.png
|
|
|
443
|
Fri May 13 15:00:23 2022 |
CB | 13 March - 16:00-24:00 shift |
16:00 Took over remotely from OH, TD who remain in GSI
Stats OK - attach 1
Stats & Leakage OK - attach 2
Temps OK
Grafana OK - attach 3
System-wide checks: aida09 fails clock (1), aida02 06 09 10 13 fail ADC calibration, all pass WR
17:29 All good, but no beam.
17:30 Beam is back
17:58 No beam again
18:10 Beam is back. Stats OK.
Ucesb OK - attach 4
Stats & Leakage currents ok - attach 5
Temps OK - attach 6
Grafana OK - attach 7
System-wide checks as before.
19:36 No beam again.
20:37 Beam is back
Stats OK - attach 8
Leakage OK
Temps OK
Grafana OK - attach 9
Ucesb OK - attach 10
System-wide checks as before
21:10 Lost anydesk connection to DAQ. Local shifters report AIDA still transferring data.
21:15 Local shifters report anydesk connection window still open. Unclear why DAQ reported offline in anydesk.
21:20 Connection restored itself. Hopefully it was a one-off.
22:51 Stats & Leakage current OK - attach 11
Temps OK
Grafana OK - attach 12
Ucesb OK - attach 13
System-wide checks as before |
| Attachment 1: 1305_1600_ucesb.png
|
|
| Attachment 2: 1305_1600_StatsTemps.png
|
|
| Attachment 3: 1305_1600_Grafana.png
|
|
| Attachment 4: 1305_1800_StatsLeakage.png
|
|
| Attachment 5: 1305_2030_Stats.png
|
|
| Attachment 6: 1305_2030_ucesb.png
|
|
| Attachment 7: 1305_2030_Grafana.png
|
|
| Attachment 8: 1305_2300_StatsLeakage.png
|
|
| Attachment 9: 1305_2300_ucesb.png
|
|
| Attachment 10: 1305_2300_Grafana.png
|
|
|
442
|
Fri May 13 07:36:18 2022 |
OH, TD | Friday 13 May |
08:36 DAQ Still running smoothly
Currently on run R1_328
At current data rates we have just over 4 days of space left on the current disk
Analysis of R1_327 - attachment 1
14.15 all histograms zero'd
baseline system wide checks counters
DAQ continues file S450/R4_33
netint pushenable 6 - was 60 - to investigate FEE64 throughput issues
netint flushenable 60 - not changed
ASIC settings
slow comparator aida02 aida04 0x16, aida06 aida08 0x23, aida12 0xd, all others 0xc
BNC PB-5 settings
amplitude 1.000V
attenuation x1
frequency 2Hz
tau_d 1ms (tail pulse)
+ polarity
Attachments 2 & 3 - ucesb
Pb beam intensity c. 4e+8/spill - lower than expected 1e+9/spill . Low implant rates (~Hz/spill) are expected for setting.
Attachment 4 & 5 - grafana DSSSD bias, leakage current & temp - OK
Attachments 6-8 - NewMerger stats blocks 0, 1, & 6
Attachment 9 - NewMerger link stats
Attachments 10-11 - TapeServer/NewMerger
Attachment 12 - iptraf aida-gsi network interfaces
Attachments 13-14 - per FEE64 1.8.L spectra
pulser peak width aida01 123 ch FWHM, aida04 430 ch FWHM
Attachments 15-18 - per FEE64 rates and stat spectra
Attachments 19-22 - system wide checks
aida09 clock status 6, WR decoder status errors
Attachments 23-26 - adc, pause, resume correlation sclaer data item stats
Attachment 27 - FEE64 temps OK
Attachment 28 - DSSSSD bias and leakage currents OK
14.30 check ASIC load
14.47 attachment 29 - analysis S450/R4_38
15.11 Attachments 30-35 - data push, flush stats for all FEE64s and aida01 (low ADC data item rate) and aida06 (high ADC data item rate) |
| Attachment 1: 220513_0839_R1_327_analysis.txt
|
*** TDR format 3.3.0 analyser - TD - May 2021
*** ERROR: READ I/O error: 5002
blocks: 32000
ADC data format: 259232212 ( 1719602.4 Hz)
Other data format: 2687788 ( 17829.3 Hz)
Sample trace data format: 0 ( 0.0 Hz)
Undefined format: 0 ( 0.0 Hz)
Other data format type: PAUSE: 986 ( 6.5 Hz)
RESUME: 986 ( 6.5 Hz)
SYNC100: 32562 ( 216.0 Hz)
WR48-63: 32562 ( 216.0 Hz)
FEE64 disc: 0 ( 0.0 Hz)
MBS info: 2620692 ( 17384.2 Hz)
Other info: 0 ( 0.0 Hz)
ADC data range bit set: 130683 ( 866.9 Hz)
Timewarps: ADC: 0 ( 0.0 Hz)
PAUSE: 0 ( 0.0 Hz)
RESUME: 0 ( 0.0 Hz)
SYNC100: 0 ( 0.0 Hz)
WR48-63: 0 ( 0.0 Hz)
FEE64 disc: 0 ( 0.0 Hz)
MBS info: 0 ( 0.0 Hz)
Undefined: 0 ( 0.0 Hz)
Sample trace: 0 ( 0.0 Hz)
*** Timestamp elapsed time: 150.751 s
FEE elapsed dead time(s) elapsed idle time(s)
0 0.085 0.000
1 9.978 0.000
2 0.059 0.000
3 21.640 0.000
4 0.158 0.000
5 66.897 0.000
6 1.778 0.000
7 36.972 0.000
8 0.172 0.000
9 0.018 0.000
10 0.000 7.315
11 28.135 0.000
12 0.007 0.000
13 0.000 3.034
14 0.000 0.000
15 0.000 0.000
16 0.000 0.000
17 0.000 0.000
18 0.000 0.000
19 0.000 0.000
20 0.000 0.000
21 0.000 0.000
22 0.000 0.000
23 0.000 0.000
24 0.000 0.000
25 0.000 0.000
26 0.000 0.000
27 0.000 0.000
28 0.000 0.000
29 0.000 0.000
30 0.000 0.000
31 0.000 0.000
32 0.000 0.000
*** Statistics
FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data
0 7933827 2887 0 0 5 5 987 987 0 903 0 1141
1 37526918 9508 0 0 50 50 4704 4704 0 0 0 122502
2 8368319 1400718 0 0 2 2 1222 1222 0 1398270 0 647
3 39185673 1207805 0 0 156 156 5116 5116 0 1197261 0 703
4 4609566 1178 0 0 5 5 584 584 0 0 0 1170
5 40049357 10540 0 0 309 309 4961 4961 0 0 0 297
6 13162553 17502 0 0 13 13 1685 1685 0 14106 0 302
7 41199857 20850 0 0 248 248 5101 5101 0 10152 0 241
8 12021437 2864 0 0 5 5 1427 1427 0 0 0 467
9 4748197 1188 0 0 2 2 592 592 0 0 0 1165
10 3089949 744 0 0 0 0 372 372 0 0 0 247
11 38258323 9856 0 0 190 190 4738 4738 0 0 0 1052
12 6307578 1518 0 0 1 1 758 758 0 0 0 311
13 2770658 630 0 0 0 0 315 315 0 0 0 438
14 0 0 0 0 0 0 0 0 0 0 0 0
15 0 0 0 0 0 0 0 0 0 0 0 0
16 0 0 0 0 0 0 0 0 0 0 0 0
17 0 0 0 0 0 0 0 0 0 0 0 0
18 0 0 0 0 0 0 0 0 0 0 0 0
19 0 0 0 0 0 0 0 0 0 0 0 0
20 0 0 0 0 0 0 0 0 0 0 0 0
21 0 0 0 0 0 0 0 0 0 0 0 0
22 0 0 0 0 0 0 0 0 0 0 0 0
23 0 0 0 0 0 0 0 0 0 0 0 0
24 0 0 0 0 0 0 0 0 0 0 0 0
25 0 0 0 0 0 0 0 0 0 0 0 0
26 0 0 0 0 0 0 0 0 0 0 0 0
27 0 0 0 0 0 0 0 0 0 0 0 0
28 0 0 0 0 0 0 0 0 0 0 0 0
29 0 0 0 0 0 0 0 0 0 0 0 0
30 0 0 0 0 0 0 0 0 0 0 0 0
31 0 0 0 0 0 0 0 0 0 0 0 0
32 0 0 0 0 0 0 0 0 0 0 0 0
*** Timewarps
FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples
0 0 0 0 0 0 0 0 0 0
1 0 0 0 0 0 0 0 0 0
2 0 0 0 0 0 0 0 0 0
3 0 0 0 0 0 0 0 0 0
4 0 0 0 0 0 0 0 0 0
5 0 0 0 0 0 0 0 0 0
6 0 0 0 0 0 0 0 0 0
7 0 0 0 0 0 0 0 0 0
8 0 0 0 0 0 0 0 0 0
9 0 0 0 0 0 0 0 0 0
10 0 0 0 0 0 0 0 0 0
11 0 0 0 0 0 0 0 0 0
12 0 0 0 0 0 0 0 0 0
13 0 0 0 0 0 0 0 0 0
14 0 0 0 0 0 0 0 0 0
15 0 0 0 0 0 0 0 0 0
16 0 0 0 0 0 0 0 0 0
17 0 0 0 0 0 0 0 0 0
18 0 0 0 0 0 0 0 0 0
19 0 0 0 0 0 0 0 0 0
20 0 0 0 0 0 0 0 0 0
21 0 0 0 0 0 0 0 0 0
22 0 0 0 0 0 0 0 0 0
23 0 0 0 0 0 0 0 0 0
24 0 0 0 0 0 0 0 0 0
25 0 0 0 0 0 0 0 0 0
26 0 0 0 0 0 0 0 0 0
27 0 0 0 0 0 0 0 0 0
28 0 0 0 0 0 0 0 0 0
29 0 0 0 0 0 0 0 0 0
30 0 0 0 0 0 0 0 0 0
31 0 0 0 0 0 0 0 0 0
32 0 0 0 0 0 0 0 0 0
*** Program elapsed time: 33.600s ( 952.392 blocks/s, 59.525 Mb/s)
|
| Attachment 2: Screenshot_from_2022-05-13_14-28-00.png
|
|
| Attachment 3: Screenshot_from_2022-05-13_14-27-51.png
|
|
| Attachment 4: Screenshot_from_2022-05-13_14-27-31.png
|
|
| Attachment 5: Screenshot_from_2022-05-13_14-27-17.png
|
|
| Attachment 6: Screenshot_from_2022-05-13_14-26-32.png
|
|
| Attachment 7: Screenshot_from_2022-05-13_14-26-26.png
|
|
| Attachment 8: Screenshot_from_2022-05-13_14-26-21.png
|
|
| Attachment 9: Screenshot_from_2022-05-13_14-26-08.png
|
|
| Attachment 10: Screenshot_from_2022-05-13_14-25-46.png
|
|
| Attachment 11: Screenshot_from_2022-05-13_14-25-38.png
|
|
| Attachment 12: Screenshot_from_2022-05-13_14-25-22.png
|
|
| Attachment 13: Screenshot_from_2022-05-13_14-24-07.png
|
|
| Attachment 14: Screenshot_from_2022-05-13_14-22-44.png
|
|
| Attachment 15: Screenshot_from_2022-05-13_14-21-16.png
|
|
| Attachment 16: Screenshot_from_2022-05-13_14-21-04.png
|
|
| Attachment 17: Screenshot_from_2022-05-13_14-20-34.png
|
|
| Attachment 18: Screenshot_from_2022-05-13_14-20-14.png
|
|
| Attachment 19: Screenshot_from_2022-05-13_14-19-10.png
|
|
| Attachment 20: Screenshot_from_2022-05-13_14-18-40.png
|
|
| Attachment 21: Screenshot_from_2022-05-13_14-18-31.png
|
|
| Attachment 22: Screenshot_from_2022-05-13_14-18-14.png
|
|
| Attachment 23: Screenshot_from_2022-05-13_14-17-38.png
|
|
| Attachment 24: Screenshot_from_2022-05-13_14-17-23.png
|
|
| Attachment 25: Screenshot_from_2022-05-13_14-17-09.png
|
|
| Attachment 26: Screenshot_from_2022-05-13_14-16-56.png
|
|
| Attachment 27: Screenshot_from_2022-05-13_14-16-30.png
|
|
| Attachment 28: Screenshot_from_2022-05-13_14-16-11.png
|
|
| Attachment 29: R4_38.txt
|
*** TDR format 3.3.0 analyser - TD - May 2021
*** ERROR: READ I/O error: 5002
blocks: 32000
ADC data format: 259102731 ( 1572653.5 Hz)
Other data format: 2817271 ( 17099.7 Hz)
Sample trace data format: 0 ( 0.0 Hz)
Undefined format: 0 ( 0.0 Hz)
Other data format type: PAUSE: 2412 ( 14.6 Hz)
RESUME: 2414 ( 14.7 Hz)
SYNC100: 32614 ( 198.0 Hz)
WR48-63: 32614 ( 198.0 Hz)
FEE64 disc: 0 ( 0.0 Hz)
MBS info: 2747217 ( 16674.5 Hz)
Other info: 0 ( 0.0 Hz)
ADC data range bit set: 30594 ( 185.7 Hz)
Timewarps: ADC: 0 ( 0.0 Hz)
PAUSE: 0 ( 0.0 Hz)
RESUME: 0 ( 0.0 Hz)
SYNC100: 0 ( 0.0 Hz)
WR48-63: 0 ( 0.0 Hz)
FEE64 disc: 0 ( 0.0 Hz)
MBS info: 0 ( 0.0 Hz)
Undefined: 0 ( 0.0 Hz)
Sample trace: 0 ( 0.0 Hz)
*** Timestamp elapsed time: 164.755 s
FEE elapsed dead time(s) elapsed idle time(s)
0 0.000 0.000
1 5.297 0.000
2 0.000 0.000
3 18.287 0.000
4 0.000 0.000
5 77.894 0.000
6 0.000 0.000
7 25.402 0.000
8 0.001 0.000
9 0.000 0.000
10 0.000 2.705
11 15.617 0.000
12 0.000 0.000
13 0.000 29.550
14 0.000 0.000
15 0.000 0.000
16 0.000 0.000
17 0.000 0.000
18 0.000 0.000
19 0.000 0.000
20 0.000 0.000
21 0.000 0.000
22 0.000 0.000
23 0.000 0.000
24 0.000 0.000
25 0.000 0.000
26 0.000 0.000
27 0.000 0.000
28 0.000 0.000
29 0.000 0.000
30 0.000 0.000
31 0.000 0.000
32 0.000 0.000
*** Statistics
FEE ADC Data Other Data Sample Undefined Pause Resume SYNC100 WR48-63 Disc MBS Other HEC Data
0 6844719 2775 0 0 0 0 894 894 0 987 0 375
1 39920437 10378 0 0 277 277 4912 4912 0 0 0 27546
2 7063505 1453891 0 0 0 0 1085 1085 0 1451721 0 328
3 42633132 1301928 0 0 410 410 5590 5590 0 1289928 0 251
4 3625899 900 0 0 0 0 450 450 0 0 0 125
5 38867835 10853 0 0 768 769 4658 4658 0 0 0 129
6 7590830 4334 0 0 0 0 934 934 0 2466 0 227
7 44498336 14120 0 0 564 565 5438 5438 0 2115 0 113
8 10949373 2716 0 0 1 1 1357 1357 0 0 0 345
9 3887105 996 0 0 0 0 498 498 0 0 0 273
10 1999345 532 0 0 0 0 266 266 0 0 0 160
11 43113077 11754 0 0 392 392 5485 5485 0 0 0 288
12 6030564 1596 0 0 0 0 798 798 0 0 0 252
13 2078574 498 0 0 0 0 249 249 0 0 0 182
14 0 0 0 0 0 0 0 0 0 0 0 0
15 0 0 0 0 0 0 0 0 0 0 0 0
16 0 0 0 0 0 0 0 0 0 0 0 0
17 0 0 0 0 0 0 0 0 0 0 0 0
18 0 0 0 0 0 0 0 0 0 0 0 0
19 0 0 0 0 0 0 0 0 0 0 0 0
20 0 0 0 0 0 0 0 0 0 0 0 0
21 0 0 0 0 0 0 0 0 0 0 0 0
22 0 0 0 0 0 0 0 0 0 0 0 0
23 0 0 0 0 0 0 0 0 0 0 0 0
24 0 0 0 0 0 0 0 0 0 0 0 0
25 0 0 0 0 0 0 0 0 0 0 0 0
26 0 0 0 0 0 0 0 0 0 0 0 0
27 0 0 0 0 0 0 0 0 0 0 0 0
28 0 0 0 0 0 0 0 0 0 0 0 0
29 0 0 0 0 0 0 0 0 0 0 0 0
30 0 0 0 0 0 0 0 0 0 0 0 0
31 0 0 0 0 0 0 0 0 0 0 0 0
32 0 0 0 0 0 0 0 0 0 0 0 0
*** Timewarps
FEE ADC Pause Resume SYNC100 WR48-63 Disc MBS Undefined Samples
0 0 0 0 0 0 0 0 0 0
1 0 0 0 0 0 0 0 0 0
2 0 0 0 0 0 0 0 0 0
3 0 0 0 0 0 0 0 0 0
4 0 0 0 0 0 0 0 0 0
5 0 0 0 0 0 0 0 0 0
6 0 0 0 0 0 0 0 0 0
7 0 0 0 0 0 0 0 0 0
8 0 0 0 0 0 0 0 0 0
9 0 0 0 0 0 0 0 0 0
10 0 0 0 0 0 0 0 0 0
11 0 0 0 0 0 0 0 0 0
12 0 0 0 0 0 0 0 0 0
13 0 0 0 0 0 0 0 0 0
14 0 0 0 0 0 0 0 0 0
15 0 0 0 0 0 0 0 0 0
16 0 0 0 0 0 0 0 0 0
17 0 0 0 0 0 0 0 0 0
18 0 0 0 0 0 0 0 0 0
19 0 0 0 0 0 0 0 0 0
20 0 0 0 0 0 0 0 0 0
21 0 0 0 0 0 0 0 0 0
22 0 0 0 0 0 0 0 0 0
23 0 0 0 0 0 0 0 0 0
24 0 0 0 0 0 0 0 0 0
25 0 0 0 0 0 0 0 0 0
26 0 0 0 0 0 0 0 0 0
27 0 0 0 0 0 0 0 0 0
28 0 0 0 0 0 0 0 0 0
29 0 0 0 0 0 0 0 0 0
30 0 0 0 0 0 0 0 0 0
31 0 0 0 0 0 0 0 0 0
32 0 0 0 0 0 0 0 0 0
*** Program elapsed time: 32.668s ( 979.553 blocks/s, 61.222 Mb/s)
|
| Attachment 30: Screenshot_from_2022-05-13_15-11-36.png
|
|
| Attachment 31: Screenshot_from_2022-05-13_15-11-29.png
|
|
| Attachment 32: Screenshot_from_2022-05-13_15-11-17.png
|
|
| Attachment 33: Screenshot_from_2022-05-13_15-10-55.png
|
|
| Attachment 34: Screenshot_from_2022-05-13_15-10-41.png
|
|
| Attachment 35: Screenshot_from_2022-05-13_15-10-30.png
|
|
|
441
|
Fri May 13 06:56:14 2022 |
OH, BA, MA | Low Rates |
| Quote: |
|
The rate is very low in all aida, not sure .
|
This was because the statistics page had been changed to transfer buffers. The rates were ok |
|
440
|
Fri May 13 06:47:33 2022 |
ML | 2h-Shift Checks |
It has been a quiet night. AIDA has been stable.
Stats appears stable appear
Temperature also stable
Leakage current slowly dropping still.
System wide checks done. Status quo here again. |
| Attachment 1: Stats_Screenshot_from_2022-05-13_07-43-54.png
|
|
| Attachment 2: Temp_Screenshot_from_2022-05-13_07-43-13.png
|
|
| Attachment 3: HV_LC_Screenshot_from_2022-05-13_07-42-38.png
|
|
|
439
|
Fri May 13 04:45:23 2022 |
ML | 2h-Shift Checks |
AIDA is running ok. Note that, in the last hour or so, the rate of implant in DSSD1 is back to higher rate ~10 Hzto 15 Hz as at the beginning of this shift.
Stats seems ok
Temperatures stable
Leakage current: ok
A systwm wide check gives same result as for the fist check on this shift at ~1am |
| Attachment 1: Stats_Screenshot_from_2022-05-13_05-43-14.png
|
|
| Attachment 2: Temp_Screenshot_from_2022-05-13_05-42-10.png
|
|
| Attachment 3: HV_LC_Screenshot_from_2022-05-13_05-41-23.png
|
|
|
438
|
Fri May 13 02:56:36 2022 |
ML | 2h-Shift Checks |
All seemnormal on AIDA side.
Stats as before
Temperatures stable
HV-LV ok
System wide check : all results as in the previous checks |
| Attachment 1: Stats_Screenshot_from_2022-05-13_03-43-34.png
|
|
| Attachment 2: Temp_Screenshot_from_2022-05-13_03-44-41.png
|
|
| Attachment 3: HV_LC_Screenshot_from_2022-05-13_03-41-28.png
|
|
|
437
|
Fri May 13 02:28:36 2022 |
ML | beam dropped |
We see less counts in AIDA implant DSSD1 (~1Hz) than at the beginning of the night shift (~10Hz).
This seems to be beam related as the count rates in DESPEC & FRS Scalers seems to have dropped too. |
|
436
|
Fri May 13 00:50:16 2022 |
ML | 2h-Shift Checks |
All seems ok (apart for my virgin network connection usually quite reliable but not so tonight !?!).
Statistics seems ok.
Temperatures appears stable
Leakage current ok.
System Wide Checks:
Clock check: Passed= 14: - Failed=: 0
ADC calibration check:
FEE64 module aida01 failed
FEE64 module aida04 failed
FEE64 module aida06 failed
FEE64 module aida13 failed
Calibration test result: Passed=10 ; Failed= 4
If any modules fail calibration , check the clock status and open the FADC Align and Control browser page to rerun calibration for that module -> DID THAT BUT NO CHANGES
White rabbit decode status: Passed=14 ; Failed=0
FPGA timestamp check: Passed=14 ; Failed=0
Memory information: Page loading failed with the error message below:
Got the error Server Internal Error
while trying to obtain /AIDA/Check/Check.tml.
could not read "/Embedded/XilinxLinux/ppc_4xx/rfs/aida01/tmp/mybuddy.txt": no such file or directory while executing "file size $mybuddy " (procedure "do_collect_info" line 16) invoked from within "do_collect_info " ("COLLECTINFO" arm line 1) invoked from within "switch -glob $w { RESET {set started 0} CLEAR {EmptyLog} ELOG {PrintLog} ..." (procedure "do_click" line 23) invoked from within "do_click" invoked from within "if {$started != 0} { variable JS "" variable LogFlag if {$LogFlag == 1} {InsertLog "Last Updated: [clock format [clock seconds] -form..." (file "Check.tcl" line 8) invoked from within "source Check.tcl" (in namespace eval "::Check" script line 6) invoked from within "namespace eval Check { global env source [file join $env(MIDASBASE) TclHttpd tcl Common common.tcl] source [file join $env(MIDASB..." invoked from within "subst { [Doc_Dynamic] <! [global Httpd; upvar #0 Httpd[set Httpd(currentSocket)] data; set ClientIPAddress $data(ipaddr); set MyInfo $data(self)] >..." ("uplevel" body line 1) invoked from within "uplevel #0 [list subst $script]" (procedure "SubstFile" line 12) invoked from within "SubstFile /home/npg/MIDAS_Releases/23Jan19/MIDAS_200119/TclHttpd/Html/AIDA/Check/Check.tml {}" ("uplevel" body line 1) invoked from within "uplevel 1 [list SubstFile $path $interp]" (procedure "Subst_File" line 7) invoked from within "Subst_File $template $interp" invoked from within "TemplateInstantiate $sock $path {} $suffix {} $Template(templateInterp)" (procedure "Doc_application/x-tcl-template" line 9) invoked from within "$cmd $path $suffix $sock" (procedure "Doc_Handle" line 20) invoked from within "Doc_Handle $prefix $path $suffix $sock" (procedure "DocDomain" line 44) invoked from within "DocDomain / /MIDAS/TclHttpd/Html sock8 AIDA/Check/Check.tml" ("eval" body line 1) invoked from within "eval $Url(command,$prefix) [list $sock $suffix]" |
| Attachment 1: Stats_Screenshot_from_2022-05-13_01-45-56.png
|
|
| Attachment 2: Temp_Screenshot_from_2022-05-13_01-47-31.png
|
|
| Attachment 3: HV_LC_Screenshot_from_2022-05-13_01-48-21.png
|
|
|
435
|
Thu May 12 22:49:39 2022 |
BA, MA | Low Rates |
The rate is very low in all aida, not sure . |
| Attachment 1: RatesLow2022-05-12_23-48-01.png
|
|