Mon Apr 19 19:19:18 2021, CB, Monday 19 April 20:00-24:00 shift 11x
|
20:19
Statistics OK (attach 1)
No faults found
Ucesb OK (attach 2)
Temps OK (attach 3)
Bias OK (attach 4)
System-wide checks - as per last check
aida09 fails clock (OK)
aida07 and 09 fail calibration (OK)
Base Current Difference
aida05 fault 0xdb9a : 0xdb9d : 3
aida06 fault 0xb74f : 0xb752 : 3
aida07 fault 0xd052 : 0xd05f : 13
aida08 fault 0xe4c1 : 0xe4c4 : 3
aida09 fault 0xaf4b : 0xaf4d : 2
White Rabbit error counter test result: Passed 7, Failed 5
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
Base Current Difference
aida12 fault 0x0 : 0x29 : 41
FPGA Timestamp error counter test result: Passed 11, Failed 1
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last
Returned 0 0 0 0 0 0 0 0 0 0 0 0
Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k
aida01 : 0 3 2 2 2 5 2 3 2 3 6 : 35704
aida02 : 19 4 1 1 1 2 2 3 3 3 6 : 36316
aida03 : 12 9 2 1 2 2 2 3 3 3 6 : 36408
aida04 : 16 3 5 4 2 4 2 3 3 3 6 : 36776
aida05 : 41 10 10 3 3 3 3 3 3 3 6 : 37172
aida06 : 25 21 9 3 2 3 1 4 3 3 6 : 37116
aida07 : 10 7 1 2 1 3 2 2 3 3 6 : 35952
aida08 : 33 7 5 1 1 2 2 3 3 3 6 : 36460
aida09 : 12 7 4 2 2 2 2 2 2 4 6 : 36968
aida10 : 16 6 2 1 1 4 3 3 2 3 6 : 35824
aida11 : 2 0 1 2 2 2 2 4 2 3 6 : 35800
aida12 : 15 6 2 0 2 4 2 2 3 3 6 : 36108
20:48 Started compressing *old* runs on Screen 2, Workspace 5
nice -n10 gzip -v R[...]_*
21:00 Stats OK, UCESB OK, No faults
21:07 Go4 spectra erased by remote shifters.
21:15 Local shifters report correlations lost. Beam may be intermittently removed for checks.
21:30 Still no beam. DAQ issues locally. AIDA MBS link had to be restarted due to operator mistake.
21:37 Beam back. Stats OK, UCESB OK, No faults found.
System wide checks:
Clock - aida09 fails
All modules now fail ADC calibration
FEE64 module aida01 failed
FEE64 module aida02 failed
FEE64 module aida03 failed
FEE64 module aida04 failed
FEE64 module aida05 failed
FEE64 module aida06 failed
FEE64 module aida07 failed
FEE64 module aida08 failed
FEE64 module aida09 failed
FEE64 module aida10 failed
FEE64 module aida11 failed
FEE64 module aida12 failed
Calibration test result: Passed 0, Failed 12
Base Current Difference
aida05 fault 0xdb9a : 0xdb9d : 3
aida06 fault 0xb74f : 0xb752 : 3
aida07 fault 0xd052 : 0xd061 : 15
aida08 fault 0xe4c1 : 0xe4c4 : 3
aida09 fault 0xaf4b : 0xaf4d : 2
White Rabbit error counter test result: Passed 7, Failed 5
Base Current Difference
aida12 fault 0x0 : 0x36 : 54
FPGA Timestamp error counter test result: Passed 11, Failed 1
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last
Returned 0 0 0 0 0 0 0 0 0 0 0 0
Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k
aida01 : 2 6 3 1 2 4 2 4 2 3 6 : 36104
aida02 : 2 3 0 2 2 4 2 2 3 3 6 : 36064
aida03 : 6 3 3 3 2 2 2 2 4 3 6 : 36928
aida04 : 15 5 8 4 3 3 2 3 3 3 6 : 36772
aida05 : 10 5 8 4 4 4 3 2 3 3 6 : 36688
aida06 : 14 17 10 3 3 3 1 4 3 3 6 : 37120
aida07 : 3 4 1 1 1 2 2 2 3 3 6 : 35740
aida08 : 12 5 7 2 2 4 1 2 3 3 6 : 35976
aida09 : 0 6 2 0 2 2 2 2 2 4 6 : 36816
aida10 : 4 2 5 2 1 4 2 4 2 3 6 : 36080
aida11 : 14 3 2 3 1 2 2 4 2 3 6 : 35856
aida12 : 1 2 0 2 1 4 1 3 3 3 6 : 36244
22:05 Stats OK (attach 5)
Temps OK (attach 6)
Bias OK (attach 7)
System wide checks as before - see above.
22:13 ADC calibration - Only 06,07 and 09 now fail
(TD re-calibrated remotely)
22:53 Beam off to allow access to S4 to reboot VME crate (akash).
22:58 Started compressing *old* runs on Screen 2, Workspace 5
nice -n10 gzip -v R[1-2][0-9]_* R[3][0-2]_*
aka everything *except* R33_*
23:11: Beam is back. Stats and UCESB as before.
23:24: Stats OK (attach 8)
Temps OK (attach 9)
Bias OK (attach 10)
UCESB OK (attach 11)
System-wide checks
Clock: 06 fails
Calibration: 06,07,09 fail
Base Current Difference
aida05 fault 0xdb9a : 0xdb9d : 3
aida06 fault 0xb74f : 0xb752 : 3
aida07 fault 0xd052 : 0xd066 : 20
aida08 fault 0xe4c1 : 0xe4c4 : 3
aida09 fault 0xaf4b : 0xaf4d : 2
White Rabbit error counter test result: Passed 7, Failed 5
Base Current Difference
aida05 fault 0xdb9a : 0xdb9d : 3
aida06 fault 0xb74f : 0xb752 : 3
aida07 fault 0xd052 : 0xd066 : 20
aida08 fault 0xe4c1 : 0xe4c4 : 3
aida09 fault 0xaf4b : 0xaf4d : 2
White Rabbit error counter test result: Passed 7, Failed 5
Returned 0 0 0 0 0 0 0 0 0 0 0 0
Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k
aida01 : 15 8 2 2 3 4 3 3 2 3 6 : 35996
aida02 : 8 12 4 1 2 4 3 2 3 3 6 : 36448
aida03 : 2 4 2 4 3 3 1 3 3 3 6 : 36360
aida04 : 7 8 4 4 2 4 3 3 3 3 6 : 37020
aida05 : 3 5 7 4 3 3 3 3 3 3 6 : 36964
aida06 : 2 6 8 2 3 4 2 3 3 3 6 : 36792
aida07 : 8 4 5 2 0 3 1 2 3 4 6 : 37712
aida08 : 26 11 3 1 1 3 1 3 3 3 6 : 36304
aida09 : 22 4 2 2 3 4 1 3 3 3 6 : 36504
aida10 : 21 6 6 2 0 4 2 3 3 3 6 : 36644
aida11 : 22 7 2 3 2 1 2 4 2 3 6 : 35856
aida12 : 16 9 2 2 3 3 2 2 3 3 6 : 36136 |
Wed May 19 11:24:55 2021, RDP, Monday 19 April 12 noon shift  
|
System checks gave 11 passed/1 failed, except for ADC timimgs: 10 passed/2 failed.
FEE64 module aida09 global clocks failed, 6
Clock status test result: Passed 11, Failed 1
Understand status as follows
Status bit 3 : firmware PLL that creates clocks from external clock not locked
Status bit 2 : always logic '1'
Status bit 1 : LMK3200(2) PLL and clock distribution chip not locked to external clock
Status bit 0 : LMK3200(1) PLL and clock distribution chip not locked to external clock
If all these bits are not set then the operation of the firmware is unreliable
FEE64 module aida07 failed
FEE64 module aida09 failed
Calibration test result: Passed 10, Failed 2
Base Current Difference
aida07 fault 0xd052 : 0xd056 : 4
White Rabbit error counter test result: Passed 11, Failed 1
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
Base Current Difference
aida12 fault 0x0 : 0x16 : 22
FPGA Timestamp error counter test result: Passed 11, Failed 1
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last
If any modules fail calibration , check the clock status and open the FADC Align and Control browser page to rerun calibration for that module
Returned 0 0 0 0 0 0 0 0 0 0 0 0
Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k
aida01 : 2 6 2 0 5 5 1 2 3 3 6 : 36120
aida02 : 25 10 0 4 3 5 2 3 3 3 6 : 36980
aida03 : 22 12 5 2 1 3 2 3 3 3 6 : 36616
aida04 : 16 3 3 3 4 4 4 2 3 3 6 : 36840
aida05 : 14 5 6 2 3 4 4 2 3 3 6 : 36800
aida06 : 30 10 6 3 3 4 2 3 3 3 6 : 36936
aida07 : 27 11 1 0 0 3 2 3 3 3 6 : 36436
aida08 : 38 7 7 3 3 2 2 3 3 3 6 : 36704
aida09 : 4 6 4 2 4 4 1 4 3 3 6 : 37056
aida10 : 21 10 3 3 1 5 1 3 3 3 6 : 36596
aida11 : 24 8 2 1 4 3 2 4 2 3 6 : 36192
aida12 : 31 12 4 3 5 5 2 2 3 3 6 : 36668
Collecting the file size of each FEE64 Options CONTENTS file to check they are all the same
FEE : aida01 => Options file size is 1025 Last changed Mon Apr 19 10:32:22 CEST 2021
FEE : aida02 => Options file size is 1014 Last changed Fri Apr 16 00:56:20 CEST 2021
FEE : aida03 => Options file size is 1014 Last changed Wed Apr 14 21:52:04 CEST 2021
FEE : aida04 => Options file size is 1025 Last changed Sat Apr 17 06:07:36 CEST 2021
FEE : aida05 => Options file size is 1025 Last changed Fri Apr 16 00:53:25 CEST 2021
FEE : aida06 => Options file size is 1014 Last changed Wed Apr 14 21:52:04 CEST 2021
FEE : aida07 => Options file size is 1014 Last changed Wed Apr 14 21:52:04 CEST 2021
FEE : aida08 => Options file size is 1014 Last changed Wed Apr 14 21:52:04 CEST 2021
FEE : aida09 => Options file size is 1014 Last changed Wed Apr 14 21:52:05 CEST 2021
FEE : aida10 => Options file size is 1014 Last changed Wed Apr 14 21:52:06 CEST 2021
FEE : aida11 => Options file size is 1014 Last changed Wed Apr 14 21:52:05 CEST 2021
FEE : aida12 => Options file size is 1025 Last changed Mon Apr 19 09:05:25 CEST 2021
There should be a separate elog note about changing one of the bias voltages.
All histograms zeroed at 16:13.
16.20 DAQ continues file NULL/R33_156
aida09 HEC fast comparator 0x2->0x1
DSSSD#3 bias -100->-120V |
Mon Apr 19 06:46:15 2021, MS, Monday 19 April 07:47-12:00 2021 9x
|
07:47
Clock status test result: Passed 12, Failed 0
Understand status as follows
Status bit 3 : firmware PLL that creates clocks from external clock not locked
Status bit 2 : always logic '1'
Status bit 1 : LMK3200(2) PLL and clock distribution chip not locked to external clock
Status bit 0 : LMK3200(1) PLL and clock distribution chip not locked to external clock
If all these bits are not set then the operation of the firmware is unreliable
FEE64 module aida06 failed
FEE64 module aida07 failed
FEE64 module aida10 failed
Calibration test result: Passed 9, Failed 3
If any modules fail calibration , check the clock status and open the FADC Align and Control browser page to rerun calibration for that module
Base Current Difference
aida01 fault 0x7686 : 0x768a : 4
aida02 fault 0x941d : 0x9421 : 4
aida03 fault 0x7cd7 : 0x7cdb : 4
aida04 fault 0xb86d : 0xb871 : 4
aida05 fault 0x1a59 : 0x1a61 : 8
aida06 fault 0x4f45 : 0x4f4d : 8
aida07 fault 0x3bfc : 0x3c46 : 74
aida08 fault 0xc7ce : 0xc7d5 : 7
aida09 fault 0xb33b : 0xb33c : 1
White Rabbit error counter test result: Passed 3, Failed 9
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
Base Current Difference
aida09 fault 0x1 : 0x2 : 1
aida12 fault 0xa : 0x35 : 43
FPGA Timestamp error counter test result: Passed 10, Failed 2
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last
Returned 0 0 0 0 0 0 0 0 0 0 0 0
Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k
aida01 : 19 18 10 7 1 3 2 4 2 3 6 : 36380
aida02 : 11 15 5 3 2 3 2 3 1 4 6 : 36692
aida03 : 15 11 13 3 4 3 3 3 2 3 6 : 36164
aida04 : 22 14 20 5 1 3 4 3 2 3 6 : 36456
aida05 : 7 7 5 2 1 2 3 4 2 3 6 : 36132
aida06 : 21 14 6 2 3 3 1 2 2 4 6 : 37028
aida07 : 11 8 7 4 2 3 2 2 4 3 6 : 37212
aida08 : 18 10 7 5 3 1 4 3 2 3 6 : 36072
aida09 : 24 23 18 3 2 3 2 4 2 3 6 : 36504
aida10 : 6 19 5 2 2 2 2 3 2 3 6 : 35520
aida11 : 22 15 7 2 1 3 2 3 2 3 6 : 35648
aida12 : 35 13 8 2 5 3 1 3 3 3 6 : 36724
At 8:30 DAQ and Temperature Scan stopped working properly.
11:00
It was noted that at the time that AIDA dropped out ~8:30 the beam also dropped out. It seems a bit of a coincidence
TD and MS powercycled the FEEs after the first crash and restarted MIDAS but not the merger. This recovered the FEEs but did not re-establish the links between the FEEs and the Merger.
Another powercycle was performed this time with a full reset of the merger and the links were restored. Upon restoring there was a large amount of noise in across all FEEs on average a 50% increase across all FEEs but in DSSD a factor of 4-6 increase was common.
In the waveforms large 100kHz transiets could be seen - attachment 4
A further power-cycle was performed by OH. The rates following this powercycle are better than just before the power cycle but have not recovered to pre-glitch levels.
The waveforms here are much improved though - attachment 5 and 6
11:45
FEE64 module aida09 global clocks failed, 6
Clock status test result: Passed 11, Failed 1
Understand status as follows
Status bit 3 : firmware PLL that creates clocks from external clock not locked
Status bit 2 : always logic '1'
Status bit 1 : LMK3200(2) PLL and clock distribution chip not locked to external clock
Status bit 0 : LMK3200(1) PLL and clock distribution chip not locked to external clock
If all these bits are not set then the operation of the firmware is unreliable
FEE64 module aida01 failed
FEE64 module aida02 failed
FEE64 module aida03 failed
FEE64 module aida04 failed
FEE64 module aida05 failed
FEE64 module aida06 failed
FEE64 module aida07 failed
FEE64 module aida08 failed
FEE64 module aida09 failed
FEE64 module aida10 failed
FEE64 module aida11 failed
FEE64 module aida12 failed
Calibration test result: Passed 0, Failed 12
If any modules fail calibration , check the clock status and open the FADC Align and Control browser page to rerun calibration for that module
White Rabbit error counter test result: Passed 12, Failed 0
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
FPGA Timestamp error counter test result: Passed 12, Failed 0
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last
Returned 0 0 0 0 0 0 0 0 0 0 0 0
Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k
aida01 : 1 2 2 1 2 4 2 4 2 3 7 : 40148
aida02 : 5 4 2 2 1 2 2 3 2 3 7 : 39380
aida03 : 3 2 1 1 1 3 1 4 2 3 7 : 39692
aida04 : 4 2 1 0 1 3 3 3 2 3 7 : 39664
aida05 : 2 7 2 0 2 2 3 4 2 3 7 : 40160
aida06 : 2 3 2 2 2 2 1 3 3 3 7 : 40192
aida07 : 23 7 2 0 0 3 2 4 2 3 7 : 39988
aida08 : 23 11 4 0 1 3 1 4 2 3 7 : 39860
aida09 : 1 3 1 1 2 4 1 3 1 4 7 : 40396
aida10 : 1 3 3 1 1 4 1 2 3 3 7 : 39852
aida11 : 3 0 2 3 1 2 3 2 2 3 7 : 39116
aida12 : 5 8 0 3 1 4 2 3 2 3 7 : 39668
|
Mon May 17 15:14:35 2021, LJW, Monday 17th May 2021 16:00-20:00 9x
|
16:25
Informed at shift handover that there has been no beam.
Statistics - See attachment 1
Temperatures - See attachment 2
Bias & Leakage currents - See attachment 3
System Wide checks - All passed, EXCEPT:
ADC Calibration
FEE64 module aida01 failed
FEE64 module aida02 failed
FEE64 module aida03 failed
FEE64 module aida04 failed
FEE64 module aida05 failed
FEE64 module aida06 failed
FEE64 module aida07 failed
FEE64 module aida08 failed
FEE64 module aida09 failed
FEE64 module aida10 failed
FEE64 module aida11 failed
FEE64 module aida12 failed
FEE64 module aida13 failed
FEE64 module aida14 failed
FEE64 module aida15 failed
FEE64 module aida16 failed
Calibration test result: Passed 0, Failed 16
If any modules fail calibration , check the clock status and open the FADC Align and Control browser page to rerun calibration for that module
White Rabbit decoder status:
Base Current Difference
aida05 fault 0x4da : 0x4dd : 3
White Rabbit error counter test result: Passed 15, Failed 1
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
18:00
Usecb scalars now showing DSSD implant rates.
Statistics - See attachment 4
Temperatures - See attachment 5
Bias & Leakage currents - See attachment 6
System Wide checks - All passed, EXCEPT:
ADC Calibration
FEE64 module aida01 failed
FEE64 module aida02 failed
FEE64 module aida03 failed
FEE64 module aida04 failed
FEE64 module aida05 failed
FEE64 module aida06 failed
FEE64 module aida07 failed
FEE64 module aida08 failed
FEE64 module aida09 failed
FEE64 module aida10 failed
FEE64 module aida11 failed
FEE64 module aida12 failed
FEE64 module aida13 failed
FEE64 module aida14 failed
FEE64 module aida15 failed
FEE64 module aida16 failed
Calibration test result: Passed 0, Failed 16
If any modules fail calibration , check the clock status and open the FADC Align and Control browser page to rerun calibration for that module
White rabbit decoder status
Base Current Difference
aida05 fault 0x4da : 0x4e1 : 7
White Rabbit error counter test result: Passed 15, Failed 1
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WRx
19:45
Usecb scalars have continued to show DSSD implant rates since the last recorded elog check.
Statistics - See attachment 7
Temperatures - See attachment 8
Bias & Leakage currents - See attachment 9
System Wide checks - All passed, EXCEPT:
ADC Calibration:
FEE64 module aida01 failed
FEE64 module aida02 failed
FEE64 module aida03 failed
FEE64 module aida04 failed
FEE64 module aida05 failed
FEE64 module aida06 failed
FEE64 module aida07 failed
FEE64 module aida08 failed
FEE64 module aida09 failed
FEE64 module aida10 failed
FEE64 module aida11 failed
FEE64 module aida12 failed
FEE64 module aida13 failed
FEE64 module aida14 failed
FEE64 module aida15 failed
FEE64 module aida16 failed
Calibration test result: Passed 0, Failed 16
If any modules fail calibration , check the clock status and open the FADC Align and Control browser page to rerun calibration for that module
White Rabbit decoder status:
Base Current Difference
aida05 fault 0x4da : 0x4e1 : 7
White Rabbit error counter test result: Passed 15, Failed 1
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
19:50 - Just as completing checks, notced usesb rates not showing DSSD implants again for several minutes
19:55 - Beam now back again - DSSD implants showing
|
Mon May 17 19:05:23 2021, LS, Monday 17th May 20.00-24.00 21x
|
20.30
Checked stats, seem okay (Fig 1)
Ran R14_99 through analyser, dead times all good (Fig 2)
Merger rate 1.8M items/s
Tape server 6.4MB/s
21.00
Checked stats seem okay (Fig 3)
Ran R14_106 through analyser, dead times all good (Fig 4)
21.30
Checked stats seem okay (Fig 5)
Ran R14_112 through analyser, dead times all good (Fig 6)
22.00
Stats okay (Fig 7)
FEE temps okay (Fig 8)
Rate spectra (Fig 9)
Leakage currents (Fig 10)
System wide checks:
Clock status all passed
White rabbit 1 fail:
Base Current Difference
aida05 fault 0x4da : 0x4e7 : 13
White Rabbit error counter test result: Passed 15, Failed 1
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
FPGA timestamp all passed
Merger rate 2.4M items/s
Tape server 6.3MB/s
Ran R14_119 through analyser, dead times all good (Fig 11)
22.30
Checked stats seem okay (Fig 12)
Ran R14_123 through analyser, dead times all good (Fig 13)
23.00
Checked stats seem okay (Fig 14)
Ran R14_129 through analyser, dead times all good (Fig 15)
23.30
Checked stats seem okay (Fig 16)
Ran R14_135 through analyser, dead times all good (Fig 17)
24.00
Stats okay (Fig 18)
FEE temps okay (Fig 19)
Leakage currents (Fig 20)
System wide checks:
Clock status all passed
White rabbit 1 fail:
Base Current Difference
aida05 fault 0x4da : 0x4eb : 17
White Rabbit error counter test result: Passed 15, Failed 1
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
FPGA timestamp all passed
Merger rate 2.5M items/s
Tape server 6.5MB/s
Ran R14_142 through analyser, dead times all good (Fig 21) |
Mon Jun 17 02:13:21 2024, TD, Monday 17 June 43x
|
03.11 DSSSD bias & leakage current OK - attachment 1
FEE64 temperatures OK - attachment 2
ADC data item stats OK - attachment 3
per FEE64 Rate spectra - attachment 4
05.33 DSSSD bias & leakage current OK - attachment 5
FEE64 temperatures OK - attachment 6
ADC data item stats OK - attachment 7
per FEE64 Rate spectra - attachment 8
per FEE64 1.8.L spectra - attachments 9-11
aida09 pulser walkthrough 60 ch FWHM
per FEE64 1.8.W spectra - 20us FSR - attachments 12-14
Merger, TapeServer etc - attachments 15-16
05.40 analysis data file R9_1042 - attachment 17
Check ASIC load x2
aida02 zero rate
restart Merger
05.55 Data file S181/R10
Pulser walkthrough
All histograms zero'd
BNC PB-5
Amplitudes 10.0-1.0 @ 1.0 step
Attenuation x10
Polarity +
tau_d 1ms
Frequency 25Hz
per p+n FEE64 1.8.L spectra - attachment 18
per FEE64 Rate spectra - attachment 19
06.43 TapeServer no storage mode
09.14 Data file S181/R11
Pulser walkthrough
All histograms zero'd
BNC PB-5
Amplitudes 10.0-1.0 @ 1.0 step
Attenuation x10
Polarity -
tau_d 1ms
Frequency 25Hz
09.52 TapeServer no storage mode
per n+n FEE64 1.8.L spectra - attachment 20
15.18 DEFGAS/FATIMA arrays moved downstream to permit installation of calibration source at centre of each array - increased distance to AIDA/bPlas => lower rate
15.16 DSSSD bias & leakage current OK - attachments 21-22
FEE64 temperatures OK - attachment 23
ADC data item stats OK - attachment 24
aida02 zero rate
per FEE64 Rate spectra - attachment 25
Merger restart
ADC data item stats OK - attachment 26
7x < 20k, max 207k aida16
15.54 bPlast debiased.
16.29 Data file S181/R12
bPlas OFF but remiains cabled/connected/grounded
16.30 DSSSD bias & leakage current OK - attachment 27
FEE64 temperatures OK - attachment 28
ADC data item stats OK - attachment 29
per FEE64 Rate spectra - attachment 30
per FEE64 1.8.W spectra - 20us, 200us, 2ms, 20ms FSR - see attachments 31-39
note - not all FEE64s updated spectra for all settings
ADC data item stats OK - attachment 40
rates change cf. attachment 29
sources installed/moved/removed, people moving around platform?
per FEE64 Rate spectra - attachment 41
16.57 DSSSD bias OFF
FEE64 power OFF
16.34 analysis data file S181/R12_7
max deadtime 2.2% (aida08)
ADC data rate 1.330M, HEC data rate 2.1k
16.52 analysis data file S181/R12_12
max deadtime 1.7% (aida08)
ADC data rate 945k, HEC data rate 1.8k |
Mon May 16 15:12:50 2022, RDP, MA, Monday 16th May 16:00-00:00 12x
|
16:00 Took over the shift from Magda.
17:30 Updates: Attached (1-3)
19:30 Updates: Attached (4-6)
21:30 Updates: Attached (7-9)
23:00 Updates: Attached (10-12)
|
Mon May 16 07:03:16 2022, MS, OH, Monday 16th May 08:00-16:00 17x
|
08:00 Took over the night shift from Tom (Attachments 1-3)
10:00: Attachement 4-6
around 10:30: Beam went off (Attachment 7)
11:00: Beam is back
12:00 Attachments 8-10
14:00 Attachements 11-13
15:50 Attachments 14-17 |
Sun May 15 23:00:08 2022, & TD, Monday 16 May 00:00-08:00 25x
|
00.01 DAQ continues
file S450/R4_1319
ADC control register 0xff
all disc outputs disabled
ASIC settings 2021Apr29-13-16-00
slow comparator aida02 & aida04 0x16, aida06 & aida08 0x23, aida12 0xd, all others 0xc
BNC PB-5 settings
amplitude 1.000V
attenuation x1
tau_d 1ms
frequency 2Hz
polarity +
Disk space OK - /media/SecondDrive
[npg@aidas-gsi S450]$ df -h
Filesystem Size Used Avail Use% Mounted on
devtmpfs 7.8G 0 7.8G 0% /dev
tmpfs 7.8G 389M 7.4G 5% /dev/shm
tmpfs 7.8G 19M 7.7G 1% /run
tmpfs 7.8G 0 7.8G 0% /sys/fs/cgroup
/dev/mapper/centos-root 50G 16G 35G 31% /
/dev/sda2 1014M 226M 789M 23% /boot
/dev/sda1 200M 12M 189M 6% /boot/efi
/dev/sde1 7.2T 4.1T 2.8T 61% /media/SecondDrive
/dev/mapper/centos-home 407G 91G 316G 23% /home
tmpfs 1.6G 52K 1.6G 1% /run/user/1000
/dev/sdd1 7.2T 6.5T 310G 96% /run/media/npg/ThirdDrive
00.03 all histograms zero'd
system wide checks counter baseline
00.08 check ASIC control - all FEE64s all ASICs
Attachments 1 & 2 - DSSSD bias & Leakage current - OK
grafana DSSSD bias, leakage current & temp - OK
Attachment 3 - FEE64 temps OK
Attachments 4-9 - adc, pause, resume & correlation scaler data items, push, flush stats
Attachments 10-16 - TapeServer, NewMerger, NewMerger stats
Attachment 17 - ucesb
04.08
Attachment 18 - DSSSD bias & Leakage current - OK
Attachment 19 - FEE64 temps OK
Attachment 20 - adc data item stats
Attachments 21 - ucesb
system wide checks - all OK *except* aida09 clock fail status 6
06.36
Attachment 22 - DSSSD bias & Leakage current - OK
Attachment 23 - FEE64 temps OK
Attachment 24 - adc data item stats
Attachments 25 - ucesb
system wide checks - all OK *except* aida09 clock fail status 6 |
Mon Mar 15 11:47:51 2021, TD, Monday 15 March 8x
|
12.48 DAQ continues OK - no storage
ASIC settings 2019Dec19-16.19.51
DSSSD#1 slow comparator 0xa
DSSSD#2 slow comparator 0xa
DSSSD#3 slow comparator 0xd
BNC PB-5 Pulser
Amplitude1.0V
Attenuation x1
Frequency 2Hz
tau_d 1ms
- polarity
Delay 250ns, tail pulse
12.50 System wide checks
FEE64 module aida09 global clocks failed, 6
Clock status test result: Passed 11, Failed 1
Understand status as follows
Status bit 3 : firmware PLL that creates clocks from external clock not locked
Status bit 2 : always logic '1'
Status bit 1 : LMK3200(2) PLL and clock distribution chip not locked to external clock
Status bit 0 : LMK3200(1) PLL and clock distribution chip not locked to external clock
If all these bits are not set then the operation of the firmware is unreliable
FEE64 module aida07 failed
FEE64 module aida09 failed
Calibration test result: Passed 10, Failed 2
If any modules fail calibration , check the clock status and open the FADC Align and Control browser page to rerun calibration for that module
Base Current Difference
aida05 fault 0x6acb : 0x6acc : 1
aida06 fault 0x8394 : 0x8395 : 1
aida07 fault 0x8c77 : 0x8c7a : 3
aida08 fault 0x1692 : 0x1693 : 1
White Rabbit error counter test result: Passed 8, Failed 4
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
FPGA Timestamp error counter test result: Passed 12, Failed 0
If any of these counts are reported as in error
The ASIC readout system has detected a timeslip.
That is the timestamp read from the time FIFO is not younger than the last
Returned 0 0 0 0 0 0 0 0 0 0 0 0
Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k
aida01 : 20 18 5 4 2 2 2 2 3 4 10 : 54576
aida02 : 26 18 16 10 6 4 2 4 2 3 6 : 37048
aida03 : 18 10 4 3 2 3 2 4 2 3 6 : 36152
aida04 : 13 9 4 2 2 2 2 4 1 4 15 : 73852
aida05 : 46 72 70 54 52 48 21 19 7 4 7 : 72216
aida06 : 32 10 4 10 0 2 2 4 3 2 5 : 31056
aida07 : 19 7 5 3 2 3 3 3 3 3 6 : 36916
aida08 : 20 14 2 3 1 3 1 4 3 3 6 : 36864
aida09 : 3 6 3 3 2 4 1 2 3 3 6 : 35916
aida10 : 23 11 3 3 1 3 3 2 3 3 6 : 36356
aida11 : 2 5 6 2 2 4 2 3 2 3 6 : 35664
aida12 : 25 10 5 2 2 2 2 3 3 3 6 : 36548
FEE64 Temperatures OK - attachment 1
Good event statistics OK - attachment 2
Detector bias & leakage currents OK - attachment 3
Merger OK - 4.6M data items/s
TapeServer OK - 14Mb/s
12.55 Rate spectra - attachments 4 & 5
Merger server error messages since most recent check
MERGE Data Link (20503): bad timestamp 3 3 0xc0d582ee 0x04f02352 0x000064aa97efd660 0x166c64aa94f02352 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0xc0e680cf 0x04f032f2 0x000064aa94f032f2 0x166c64aa94f032f2 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0xc0c68215 0x04f03ac2 0x000064aa94f03ac2 0x166c64aa94f03ac2 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0xc0fd81f1 0x04f061d2 0x000064aa94f061d2 0x166c64aa94f061d2 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0xc0eb812a 0x04f07942 0x000064aa94f07942 0x166c64aa94f07942 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0xc0f68041 0x04f07942 0x000064aa94f07942 0x166c64aa94f07942 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0x83806b78 0x04f07aa0 0x000064aa94f07aa0 0x166c64aa94f07aa0 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0x83811ea0 0x04f07aa0 0x000064aa94f07aa0 0x166c64aa94f07aa0 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0x83820000 0x04f07aa0 0x000064aa94f07aa0 0x166c64aa94f07aa0 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0xc0c183d5 0x04f0aff2 0x000064aa94f0aff2 0x166c64aa94f0aff2 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0xc0d58220 0x04f0b7c2 0x000064aa94f0b7c2 0x166c64aa94f0b7c2 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0xc0e68097 0x04f0bf92 0x000064aa94f0bf92 0x166c64aa94f0bf92 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0xc0c682e7 0x04f0c762 0x000064aa94f0c762 0x166c64aa94f0c762 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0xc0cf7ff7 0x04f0cf32 0x000064aa94f0cf32 0x166c64aa94f0cf32 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0xc0fd817e 0x04f0ee72 0x000064aa94f0ee72 0x166c64aa94f0ee72 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0xc0e180e5 0x04f105e2 0x000064aa94f105e2 0x166c64aa94f105e2 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0xc0d181fd 0x04f10db2 0x000064aa94f10db2 0x166c64aa94f10db2 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0xc0d78072 0x04f11582 0x000064aa94f11582 0x166c64aa94f11582 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0xc0c17fff 0x04f14462 0x000064aa94f14462 0x166c64aa94f14462 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0xc0c68234 0x04f15bd2 0x000064aa94f15bd2 0x166c64aa94f15bd2 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0xc0c780f9 0x04f17342 0x000064aa94f17342 0x166c64aa94f17342 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0xc0c98277 0x04f17b12 0x000064aa94f17b12 0x166c64aa94f17b12 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0xc0d28174 0x04f17b12 0x000064aa94f17b12 0x166c64aa94f17b12 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0xc0d5812d 0x04f182e2 0x000064aa94f182e2 0x166c64aa94f182e2 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0xc0fd8112 0x04f182e2 0x000064aa94f182e2 0x166c64aa94f182e2 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0x83806b78 0x04f186a2 0x000064aa94f186a2 0x166c64aa94f186a2 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0x83811ea0 0x04f186a2 0x000064aa94f186a2 0x166c64aa94f186a2 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0x83820000 0x04f186a2 0x000064aa94f186a2 0x166c64aa94f186a2 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0xc0d98224 0x04f18ab2 0x000064aa94f18ab2 0x166c64aa94f18ab2 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0xc0e68096 0x04f19a52 0x000064aa94f19a52 0x166c64aa94f19a52 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0xc0c080e1 0x04f1a222 0x000064aa94f1a222 0x166c64aa94f1a222 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0xc0d18282 0x04f1a222 0x000064aa94f1a222 0x166c64aa94f1a222 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0xc0c38198 0x04f1a9f2 0x000064aa94f1a9f2 0x166c64aa94f1a9f2 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0xc0cb8187 0x04f1b1c2 0x000064aa94f1b1c2 0x166c64aa94f1b1c2 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0xc0cc8178 0x04f1b992 0x000064aa94f1b992 0x166c64aa94f1b992 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0xc0c78063 0x04f1ffe2 0x000064aa94f1ffe2 0x166c64aa94f1ffe2 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0xc0e980e1 0x04f1ffe2 0x000064aa94f1ffe2 0x166c64aa94f1ffe2 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0xc0c98129 0x04f207b2 0x000064aa94f207b2 0x166c64aa94f207b2 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0xc0d28107 0x04f207b2 0x000064aa94f207b2 0x166c64aa94f207b2 0x166c64aa97efd660
MERGE Data Link (20503): bad timestamp 3 3 0xc0eb80e2 0x04f207b2 0x000064aa94f207b2 0x166c64aa94f207b2 0x166c64aa97efd660
18.47 FEE64 Temperatures OK - attachment 1
Good event statistics OK - attachment 2
Detector bias & leakage currents OK - attachment 3
Merger OK - 4.6M data items/s
TapeServer OK - 14Mb/s
No new merger error messages since 12.55 today
|
Tue Jun 15 12:33:46 2021, TD, Monday 14 June
|
|
Mon May 10 08:49:37 2021, TD, Monday 10 May 21x
|
09.51 All system wide checks OK *except*
Base Current Difference
aida05 fault 0x8441 : 0x8442 : 1
aida06 fault 0xc5c5 : 0xc5c6 : 1
aida07 fault 0x6f07 : 0x6f08 : 1
aida08 fault 0x4814 : 0x4815 : 1
White Rabbit error counter test result: Passed 12, Failed 4
Understand the status reports as follows:-
Status bit 3 : White Rabbit decoder detected an error in the received data
Status bit 2 : Firmware registered WR error, no reload of Timestamp
Status bit 0 : White Rabbit decoder reports uncertain of Timestamp information from WR
Returned 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Mem(KB) : 4 8 16 32 64 128 256 512 1k 2k 4k
aida01 : 1 4 6 3 5 5 2 3 2 3 6 : 36004
aida02 : 4 1 3 6 3 4 3 3 2 3 6 : 36040
aida03 : 12 8 5 2 3 3 3 4 2 3 6 : 36416
aida04 : 1 2 5 4 1 4 3 4 2 3 6 : 36388
aida05 : 22 8 4 2 4 5 1 4 1 4 6 : 37272
aida06 : 5 4 0 6 3 6 3 3 2 3 6 : 36276
aida07 : 38 16 7 7 1 6 1 3 3 3 6 : 37032
aida08 : 16 4 2 3 1 4 1 3 3 3 6 : 36384
aida09 : 2 3 7 6 5 5 2 3 2 3 6 : 36112
aida10 : 42 15 4 6 2 6 2 4 2 3 6 : 36768
aida11 : 1 5 13 7 3 3 3 3 2 3 6 : 36124
aida12 : 23 9 3 4 7 3 2 3 2 3 6 : 35988
aida13 : 2 6 7 3 4 4 3 2 2 3 6 : 35592
aida14 : 17 11 3 4 3 5 2 3 2 3 6 : 35980
aida15 : 4 7 5 2 1 6 2 3 2 3 6 : 35864
aida16 : 4 1 3 3 4 2 3 4 2 3 6 : 36264
Collecting the file size of each FEE64 Options CONTENTS file to check they are all the same
FEE : aida01 => Options file size is 1026 Last changed Sun May 09 15:10:52 CEST 2021
FEE : aida02 => Options file size is 1014 Last changed Thu Apr 29 14:43:46 CEST 2021
FEE : aida03 => Options file size is 1014 Last changed Thu Apr 29 14:43:50 CEST 2021
FEE : aida04 => Options file size is 1014 Last changed Thu Apr 29 14:43:53 CEST 2021
FEE : aida05 => Options file size is 1014 Last changed Thu Apr 29 14:43:55 CEST 2021
FEE : aida06 => Options file size is 1014 Last changed Thu Apr 29 14:43:59 CEST 2021
FEE : aida07 => Options file size is 1014 Last changed Thu Apr 29 14:44:02 CEST 2021
FEE : aida08 => Options file size is 1025 Last changed Wed May 05 12:15:54 CEST 2021
FEE : aida09 => Options file size is 1014 Last changed Thu Apr 29 14:44:08 CEST 2021
FEE : aida10 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021
FEE : aida11 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021
FEE : aida12 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021
FEE : aida13 => Options file size is 1025 Last changed Fri May 07 19:40:34 CEST 2021
FEE : aida14 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021
FEE : aida15 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021
FEE : aida16 => Options file size is 1014 Last changed Thu Apr 29 14:44:57 CEST 2021
09.52 All histograms, stats and merger stats zero'd
FEE64 temps OK - attachment 1
ADC data, disc/WR 28-27/pause/correlation stats OK - attachments 2-6
Rate spectra - attachment 7
ASIC check load
Rate spectra - attachment 8
1.8.W spectra 20us FSR - attachments 9 & 10
Grafana - most recent 7 days DSSSD bias and leakage current - attachment 11
Merger stats/tape server/merger - attachment 12
DSSSD bias and leakage current OK - attachment 13
10.08 1.8.W spectra 20us, 200us, 2ms & 20ms FSR - attachments 14-21
we are not missing extrinsic noise features at longer time ranges cf. 20us FSR
12.18 Cannot connect to port 8015, MIDAS terminal says "Killed"
Restart MIDAS 8015
Collect FPGA baseline to avoid TCL error
FEEs unaffected and running as before
13.25 FEEs power cycled to see if any change in weird noise/rates situation
No change
ASICs synchronised and back to normal
14.34 Start a pulser walkthrough in May21/R10
Attenuation 5x, Rep Rate 25 Hz
Amplitudes 10..9...1
14.45 Back to 2 Hz @ 2V Pulser, walkthrough complete. No Storage again.
PULSER SETTINGS
---------------------------
Pulse is ON
Positive Tail Pulse
Trigger Source is Internal Clock
Trigger Threshold is 3.5
Amplitude : 2.0 Volts
Rep Rate : 2.0 hZ
Delay : 250.0 ns
Fall Time : 1 ms
Attenuation : 1
Display is : Volts
Equivalent keV is : 200.0 (NB. actually it is 12 MeV)
Ramp Start at 0.01 Volts
Ramp Stop at 9.99 Volts
Ramp Start at 1.0 keV
Ramp Stop at 999.0 keV
Ramp Time is 60 seconds
# Ramp Cycles is 1
OK |
Tue Mar 11 11:53:18 2025, TD, Monday 10 March 11x
|
18.30 AIDA powered up for brief test
DSSSD bias & leakage current OK - attachment 1
FEE64 temperatures OK - attachment 2
ADC data item stats - attachment 3
ASIC settings at power up - slow comparator 0x64
per p+n FEE64 1.8.L spectra - attachment 4
pulser peak width aida9 55 ch FWHM (39keV FWHm), aida15 53 ch FWHM (37keV FWHM)
p+n FEE64 aida15 1.8.W spectra - 20us FSR - attachments 5-6
saved *.L, *.H, *.W spectra for aida15 - attachments 7-11
*.W spectra - 20us, 200us, 2ms & 20ms FSR
19.27 DAQ STOP
DSSSD bias OFF
FEE64 power OFF |
Mon Jun 13 16:38:37 2022, NH, Mon 13 Jun
|
Remove Caen HV Supply
Open up, C23 was grounded (HV grounded in NIM)
Remove C23 (HV floating at NIM) and reinstall
Rebias HV... No Change
Reboot AIDA... No change |
Tue Jun 11 18:45:37 2024, PP, Mid-shift checks, 19:45 8x
|
All looks good.
Sceenshots attached. |
Wed Jun 12 11:06:55 2024, PP, Mid-shift checks, 12:00 8x
|
All seems normal.
Screenshots attached. |
Wed Jun 2 14:53:05 2021, OH, TD, Merger/Tapeserver issues after reboot of aida-3 6x
|
On 01/06/21 aida-3 was rebooted as the graphical user interface had frozen.
We were also unable to connected to MIDAS via ssh port forwarding.
Since the restart we have been unable to write to file.
The tapeserver will allocate/mount/open a file but nothing will be written to it.
The merger will be receiving data but never shows as having any "Current links with data".
/MIDAS currently points to lrwxrwxrwx. 1 root root 45 Jan 23 2019 /MIDAS -> /home/npg/MIDAS_Releases/23Jan19/MIDAS_200119
The current disk structure is:
[npg@aidas-gsi npg]$ lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sr0 11:0 1 1024M 0 rom
sdb 8:16 0 7.3T 0 disk
├─sdb1 8:17 0 200M 0 part
├─sdb2 8:18 0 500M 0 part
└─sdb3 8:19 0 7.3T 0 part
├─vg_aidas2-lv_root (dm-2)
253:2 0 50G 0 lvm
├─vg_aidas2-lv_home (dm-3)
253:3 0 7.2T 0 lvm /media/1e121361-83d3-4825-b6ae-8700b07e0ca7
└─vg_aidas2-lv_swap (dm-4)
253:4 0 7.8G 0 lvm
sdc 8:32 0 7.3T 0 disk
└─sdc1 8:33 0 7.3T 0 part /media/ThirdDrive
sdd 8:48 0 7.3T 0 disk
└─sdd1 8:49 0 7.3T 0 part /media/SecondDrive
sda 8:0 0 465.8G 0 disk
├─sda1 8:1 0 200M 0 part /boot/efi
├─sda2 8:2 0 500M 0 part /boot
└─sda3 8:3 0 465.1G 0 part
├─vg_aidasgsi-lv_root (dm-0)
253:0 0 50G 0 lvm /
├─vg_aidasgsi-lv_swap (dm-1)
253:1 0 7.8G 0 lvm [SWAP]
└─vg_aidasgsi-lv_home (dm-5)
253:5 0 407.3G 0 lvm /home
Terminal outputs for the HTTPd, Merger and TapeServer terminals - attachments 1-3
TapeServer config file - attachment 4
Merger options - attachment 5
Note in the merger window the top bar is different to what we have seen previously - Attachment 6 and https://elog.ph.ed.ac.uk/DESPEC/210418_124830/51.png |
Mon Mar 25 14:44:33 2019, NH, Merger issues    
|
Plastic electronics have now been installed.
Water is not leaking still.
FEE64s powered on at 15:00 to test MBS connection (fig1: temperatures)
MBS relay connects to MBS server OK...
AIDA Merger does not accept any data... (links with data reads 0) and lots of timestamp errors in log? (Figs 2-4)
Startup procedure incorrect?
Otherwise things still OK. |
Wed Apr 3 13:02:19 2024, NH, Merger for 16 FEEs    
|
Changed /MIDAS/Linux/startup/NewMerger
Change parameters -i and -l in master64 to 16 for 16 FEEs
Update NewMerger Options LinksAvailable to 16, LinksInUse to 1%1%1%1%1%1%1%1%1%1%1%1%1%1%1%1%
Fix NetVar RunOptions 1 (was 0)
Restart Merger HTTPd, Tape, Merger, MBS Spy
Reset/Setup/Go
16 Links green and status going, all good?
Bias DSSSDs and turn data transfer on
Merger connected, shows rate and updates... no rate in Tape Server?
.. Oops forget to turn on Output to data storage in merger!
Rate in tape server and to MBS: 7 MB/s
Merger, Tape and MBS working with 16 FEEs |
Thu Oct 31 16:43:03 2019, NH CA TD, Merger & MBS Performance   
|
Testing merger with 3 DSSDs connected, with thresholds of 10 (slow comparator), 2 (HEC) and 255 (fast discriminator)
Merger handling rate of 1.6 million events per second comfortably. Forwarding to MBS fine.
Network usage: 130 Mbps (AIDA network) and 20 Mbps (MBS network) |
|