 Mon Jun 6 11:17:30 2016, TD, ML & YS, Re-configure merger to ignore nnaida19 
|
19.00 Power-cycled and rebooted AIDA FEE64s
Temperatures are lower - see attachment 1
Re-configured merge to ignore problem child nnaida19 which continues to ReSYNC but fails
to pass SYNC errors counting and ASIC clock timestamp system-wide checks - see attachment 2 |
|
Mon Jun 6 08:57:34 2016, GL,PW, YS, TD, ML, AIDA run 1112 - Sync problem
|
After starting run 1112, we noticed that the merge program was waiting for a first sync. It then turned out that all syncs had disappeared. This required an entire reboot of the AIDA DAQ. Consequently, AIDA run 1112 should not be used. |
|
Mon Jun 6 08:51:50 2016, TD, Change of set point for Julabo FL11006 recirculating chiller
|
The Julabo FL11006 recirculating chiller set point has been changed from +20.0 deg C to +15.0 deg C.
Ambient temperature in B2F/F11 +25.2 deg C, RH 39.8%, dew point +11.8 deg C
AIDA FEE temperatures decreasing slowly - see attachment 1
7.6.16 10.30 For comparison the latest AIDA FEE temperatures - see attachment 2 |
|
Sun Jun 5 17:09:49 2016, CG, DK, AE, Monday 6th June 20x
|
00.45 Run R1100 started on n-rich setting (EURICA run_1100, BigRIPS run 1165)
Degraders as noted in previous entry
Check clock status failed for nnaida5. ADC calib failed for nnaida8. nnaida19 failed Check ASIC clock and Check SYNC errors.
Temps ok. Leakage currents ok.
Settings file 2016Jun06-00.31.34
AIDA fluctuating but all > 0.
Tape rate ~8Mb/s.
Merge was outputting some interesting looking messages to terminal about queue being full and timestamps going backwards (attachment 3).
TapeServer window shows data being written as does repeated ls in /TapeData/NP1306. Writing one file every ~5-7min.
01.45 Merger went into 'Want next SYNC'
AIDA SYNC rate went to zero and TapeService stopped writing data.
Run stopped and FEEs power cycled as contact was lost with ~50%.
Beam operators want to do some tuning so control has been given to them while we start back up.
02.22 Started run R1101 on n-rich setting (EURICA run_1101-1102, BigRIPS run 1168-1169)
Increased fast disc threshold to 5 in all nnaida to prevent merger from running so fast and possibly choking.
Stopped @ 04.20
Realised after, nnaida24 had been on 1GeV range.
04.28 Started run R1102 on n-rich setting (EURICA run_1103, BigRIPS run 1170)
Stopped as 04.37 nnaida24 in 1GeV range.
04.39 Started run R1103 on n-rich setting (EURICA run_1104, BigRIPS run 1170)
Settings file 2016Jun06-04.39.22 -> same as previous settings but nnaida24 changed to 20MeV range.
Stopped at 04.59 at request of beam operators.
05.11 Started run R1104 on n-rich setting (EURICA run_1105, BigRIPS run 1171)
Merger died.
Stopped @ 05.15.
Ctrl-c out of all tape/merger related windows and restarted them. Setup/Configure etc.
05.34 Started run R1105 on n-rich setting ( EURICA run_1106, BigRIPS run 1172)
Settings file 2016Jun06-05.34.56 -> nnaida24 reverted back to 1GeV range. New settings file to make sure nnaida24 is set to 1GeV range. Changed in Save/Restore options.
Temps ok. Leakage currents ok.
Rates in visual scalar ~10% higher.
07.22 Lost contact with nnaida4 and merger stopped outputting data.
Stopped run R1105.
Power cycle FEEs and start new run.
On two power cycles, certain FEEs were not contactable.
Beam stopped by operators for brief period.
08.14 Run 1106 started on n-rich setting (EURICA run_1108, BigRIPS run 1175)
Settings file 2016Jun06-05.34.56
Temps ok. Leakage currents ok.
Stopped 09.06 for setting change.
09.41 Run 1107 started on reference mass setting (EURICA run_1200, BigRIPS run 1177)
Settings file 2016Jun06-05.34.56
11:24 Network link to the outside world is dropped across B3F
Beam is being controlled by the primary operators.
Run 1108 - background run with beam off from 10:29 to 11:31 (EURCA run 1201, no BigRIPS run)
(Was still editing the elog without submitting it. Sorry!)
Settings file was saved: 2016Jun06-10.45.31
Leak currents from paper logbook in consecutive order bias1 ch0-3, bias2 ch0-1 in uA: 3.225, 4.155, 3.515, 3.315, 3.65, 3.205
12.45 start R1110 (AIDA) run_1103 (EURICA)
Continuing reference mass measurement following earlier network outage B3F
ASIC settings 2016Jun06-05.34.56
see attachments 13-20
13.30 Stopped R1110 for B3F entry
'unable to connect' to nnaida1 etc
AIDA FEE64s reset OK but would not ReSync wuth about half of the FEE64s returning -1 status code
power cycle FEE64s, reboot aidas1 & FEE64s
14.03 ASIC seetings DB key 2016Jun06-14.03.48
14.20 System-wide checks
All FEE64s pass all tests *except*
nnaida21 ADC calibration
nnaida19 ASIC clock timestamp & SYNC errors not counting
|
|
Sun Jun 5 02:14:10 2016, TD, AE, CG & DK, Sunday 5 June 2016 8x
|
10.10 Detector biases & leakage currents - OK - see attachments 1-2
10.40 Detector biases & leakage currents - OK - see attachments 3-4
30 minutes ~2000Hz highenergy heavy ions during BigRIPS tuning
17.35 Detector biases & leakage currents - OK - see attachments 5-6
Rates DSSSD #1 - #6 ~500Hz per DSSSD
19.30 AIDA SYNCs lost
FEE64s power cycled and rebooted
22.30 Detector biases & leakage currents - OK - see attachments 7-8
Rates DSSSD #1 - #6 ~1kHz per DSSSD
23.00 2mm plate removed from fixed degrader, 1mm installed => net removal of 1mm
Variable degrader No. 2 in beam, all others out. |
|
Sun Jun 5 01:32:44 2016, TD, DK, GL, AE, PJW, First RIB implantation: Run 67
|
We restarted the merger (Stop, Setup & Configure, Go, Pause) and then we could restart the DAQ as normal. Rate is ~500 Hz. |
|
Sun Jun 5 01:20:39 2016, DK, AE, GL, PJW, Merger wants first SYNC
|
Trying to start the AIDA DAQ now that the RI beam is (nearly) ready. However, we cannot get merging to work. But the merger status has "Merge State = GOing : paused : xfer enabled : want first SYNC" but the last part ought to show "output paused" or after merge begins, "ready for SYNC". We restarted the DAQ according to the procedure several times but this aspect of the messaging does not change, and the merging does not go live. |
|
Sat Jun 4 08:46:20 2016, TD, AIDA noise - state of play 2 27x
|
Attachments 1-23 AIDA FEE64s nnaida1-nnaida23 ASIC #1 waveforms
Attachments 24-27 AIDA FEE64 nnaida24 ASIC #1 - #4 waveforms
Common y-scale 7000-9000, xscale ~1000 samples @ 20ns/sample
All *L and *W histograms saved to /MIDAS/SpecData at c. 17.00 Saturday 4 June 2016
Note
1) BNC PB-4 Pulser amplitude 90,000, x5 attenuator, frequency c. 5Hz + ~40kBq 60Co source
placed on AIDA snout
2) EURICA closed |
|
Sat Jun 4 04:53:25 2016, TD, AE, CG, DK, GL YL & PJW (Team AIDA), Saturday 4 June 2016 8x
|
12.27 DAQ run R61 started 01.30
Appears to have stopped abruptly at ~06.55
All FEE64 AIDA SYNCs zero
Attempted normal halt to run - DAQ STOP, toggle merge pause, stop tape server - OK
Attempted normal start to run - start tape server, DAQ GO, toggle merge pause - OK
Note during DAQ GO briefly obtained 'unable to connect' error from nnaida1 which resolved
itself a few seconds later
Atachment 1 - AIDA SYNCs
2 - MERGE and server terminal sessions
3 - TapeServer
4 - R61 disk files
5 - Detector biases and leakage currents - OK
Leakage current has decreased since yesterday. B2F/F11 ambient temperature
~25 deg C but EURICA now closed.
6 - AIDA discriminators
7 - AIDA good events
From the MERGE server terminal session ...
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Timestamp (4d087c824ee)[Q 5, Stream 5] is older than previous (4d097c800a0) [Q 5, Stream 5]
Merge: Attempting resynchronisation to timestamp 4d097c800a1 or greater
Merge: Last sync pulse time: 4d097c400a0
Merge: Last timestamp seen: 4d097c800a0
Merge: Restarting at timestamp 4d097cc00a0
Merge: Timestamp (4e122b40d1e)[Q 5, Stream 5] is older than previous (4e132b400a0) [Q 5, Stream 5]
Merge: Attempting resynchronisation to timestamp 4e132b400a1 or greater
Merge: Last sync pulse time: 4e132b000a0
Merge: Last timestamp seen: 4e132b400a0
Merge: Restarting at timestamp 4e132b800a0
Merge: Timestamp (4e1662818a6)[Q 5, Stream 5] is older than previous (4e1762800a0) [Q 5, Stream 5]
Merge: Attempting resynchronisation to timestamp 4e1762800a1 or greater
Merge: Last sync pulse time: 4e1762400a0
Merge: Last timestamp seen: 4e1762800a0
Merge: Restarting at timestamp 4e1762c00a0
Merge: Timestamp (4e1b89803c6)[Q 5, Stream 5] is older than previous (4e1c89800a0) [Q 5, Stream 5]
Merge: Attempting resynchronisation to timestamp 4e1c89800a1 or greater
Merge: Last sync pulse time: 4e1c89400a0
Merge: Last timestamp seen: 4e1c89800a0
Merge: Restarting at timestamp 4e1c89c00a0
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Timestamp (4f2580400c6)[Q 5, Stream 5] is older than previous (4f2680400a0) [Q 5, Stream 5]
Merge: Attempting resynchronisation to timestamp 4f2680400a1 or greater
Merge: Last sync pulse time: 4f2680000a0
Merge: Last timestamp seen: 4f2680400a0
Merge: Restarting at timestamp 4f2680800a0
Merge: Timestamp (5026a041c06)[Q 5, Stream 5] is older than previous (5027a0400a0) [Q 5, Stream 5]
Merge: Attempting resynchronisation to timestamp 5027a0400a1 or greater
Merge: Last sync pulse time: 5027a0000a0
Merge: Last timestamp seen: 5027a0400a0
Merge: Restarting at timestamp 5027a0800a0
Merge: Timestamp (5083c7008c6)[Q 5, Stream 5] is older than previous (5084c7000a0) [Q 5, Stream 5]
Merge: Attempting resynchronisation to timestamp 5084c7000a1 or greater
Merge: Last sync pulse time: 5084c6c00a0
Merge: Last timestamp seen: 5084c7000a0
Merge: Restarting at timestamp 5084c7400a0
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Timestamp (523c5c80b4e)[Q 5, Stream 5] is older than previous (523d5c800a0) [Q 5, Stream 5]
Merge: Attempting resynchronisation to timestamp 523d5c800a1 or greater
Merge: Last sync pulse time: 523d5c400a0
Merge: Last timestamp seen: 523d5c800a0
Merge: Restarting at timestamp 523d5cc00a0
Merge: Timestamp (527ddc03916)[Q 5, Stream 5] is older than previous (527edc000a0) [Q 5, Stream 5]
Merge: Attempting resynchronisation to timestamp 527edc000a1 or greater
Merge: Last sync pulse time: 527edbc00a0
Merge: Last timestamp seen: 527edc000a0
Merge: Restarting at timestamp 527edc400a0
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Timestamp (52e9c2c0456)[Q 5, Stream 5] is older than previous (52eac2c00a0) [Q 5, Stream 5]
Merge: Attempting resynchronisation to timestamp 52eac2c00a1 or greater
Merge: Last sync pulse time: 52eac2800a0
Merge: Last timestamp seen: 52eac2c00a0
Merge: Restarting at timestamp 52eac3000a0
Queue full messages do not appear to be correlated (currently at least) with the busiest FEE64s
12.50 AIDA trigger to EURICA OR(DSSSD#1 - #5) .AND.NOT. DSSSD#6 ~1.8kHz
.AND.EURICA ~50Hz (no significant change in rate when DSSSD#6 veto removed)
15.30 DAQ found stopped - AIDA SYNCs zero - data transfer disabled, histogramming enabled
System wide checks
nnaida19 fails 'ASIC clock timestamp' and 'SYNC errors not counting tests'
all other FEE64s pass all tests |
|
Fri Jun 3 03:10:55 2016, TD, AE, CG & DK, Friday 3 June 2016 12x
|
11.00 Detector biases and leakage currents - see attachments 1-2
FEE64 temperatures - see attachment 3
DAQ ran overnight without problem - statistics - attachments 4-8
Plan for today
1) Develop AIDA external trigger output for fast LEC/MEC discriminator threshold 0x4, or lower
2) Replace non-rev B MACB with rev B MACB in master timestamp chain (NIM module #2)
16.15 Non-rev B MACB in master timestamp chain replaced with rev B MACB module
FEE64s power cycled and rebooted.
System ReSYNC'd successfully
System-wide tests
clock states 24/24 pass
adc calibration 24/24 pass
ASIC clock timestamp check 23/24 pass, nnaida19 fails
SYNC errors not counting 23/24 pass, nnaida19 fails
N.B. We obtained the same nnaida19 errors before rpelacing non-rev B MACB *and* with FEE64
previously installed as nnaida19
Module timestamps - see attachment 9
Master timestamp module nnaida6 - all clocks locked
Fitted ground jumpers to front and rear field plate connections on all four adaptor PCBs
for each of DSSSD#2 - #5, i.e. DSSSD#1 - #6 now have field plate ground jumpers fitted.
See attachments 10 & 11 showing discriminator rates before and after fitting these additional
ground jumpers (LEC/MEC fast discriminator threshold 0x4 or 0x5)
18.25 NP1306 R58
207Bi + 60Co LEC/MEC disc threshold test
ASIC settings 2016Jun03-21.03.42
21.05 End R58
21.30 Moved extant data acquisition server options files to /MIDAS/DB/EXPERIMENT/AIDA/nnaida?/CONTENTS.BAK-030616
Saved options for all data acquisition servers with
TS_SYNC_PHASE = 0x3
MACB_TRIG_MODE = 0x4
ASIC Settings DB key 2016Jun03-21.03.42
(all LEC/MEC fast disc settings 0x5 *except* nnaida5 & nnaida6 = 0x20)
|
|
Thu Jun 2 09:04:57 2016, TD, [How to] Monitor AIDA
|
Every 4h
1) Record DSSSD #1 = #6 detector bias voltages and leakage currents in written logbook
Desktop 6 - 2x PUTTY terminal sessions
Each PUTTY terminal session is connected to a CAEN N1419 4 ch HV Power Supply
Addr 00
Ch 0 = DSSSD # 1
:
:
Ch 3 = DSSSD # 4
Addr 01
Ch 0 = DSSSD # 5
Ch 1 = DSSSD # 6
Compare with previous observations
2) Desktop 1 - Firefox web browser - Temperatures tab
Select Reload
Check temperatures
Virtex < 75 deg C
PSU < 45 deg C
ASIC < 65 deg C
If not call for expert help.
Note that the ASIC temperatures for some data acquisition servers sometimes read back as 0.0
*If* DAQ running also
3) Desktop 1 - Firefox web browser - Statistics tab
Check Reload
Check 'Show ALL Data Acquisition Servers'
From 'Select counter to Monitor' select 'AIDA Discriminator'
Select 'Update Once'
Check *all* data acquisition servers have a non-zero rate
N.B. If one, or more, data acquisition servers have zero rate call for expert help!
From keyboard select Alt-Print Screen and save screenshot to /tmp directory as a .png file
Upload the .png file to the EURICA 2016 Elog for the current run
Compare rates with previous observations at same settings
4) Desktop 1 - Firefox web browser - Statistics tab
Check Reload
Check 'Show ALL Data Acquisition Servers'
From 'Select counter to Monitor' select 'AIDA SYNC'
Select 'Update Once'
Check *all* data acquisition servers have a non-zero rate (typically ~300-500Hz)
N.B. If one, or more, data acquisition servers have zero rate call for expert help!
5) Desktop 2 - Firefox web browser - MERGE tab
Select 'Reload' several times and check all enabled data links (0-23) are active
bright green = active, olive green = inactive, red = disabled
N.B. If some data links are *always* inactive call for expert help!
Select Reload to observe merge rate (date items/s)
Observe active spinners in MERGE and TapeServer server terminal windows adjacent to web browser
6) Desktop 2 - Firefox web browser - TapeServer tab
Select Reload and observe number of blocks written to disk |
|
Thu Jun 2 01:33:13 2016, TD, AE, CG & DK, Thursday 2 June 2016
|
09.30 DAQ left running overnight
AIDA SYNCs on all FEE64s this morning
DSSSD#1 -#6 bias and leakage currents OK - see attachments 1-2
09.39 Estimation of AIDA timestamp clock frequency
See attachments 3-4
nnaida6 (master) timestamp 0x415 0x0af112ec - 0x413 0xa41a46b0 = 0x166d6cc3c = 6020320316 (dec)
elapsed time = 61s => 98.694MHz
10.50 Lower LEC/MEC fast discriminator thresholds from 0xa to 0x4/0x5
AIDA discriminator rates shown attachment 5
Rates <300kHz |
|
Wed Jun 1 01:33:58 2016, TD, Wednesday 1 June 2016 9x
|
09.30 Detector biases and leakage currents - ambient temp +24.9 deg C - attachments 1-2
10.08 Connection lost to nnaida27 and nnaida28
Most recent save of settings DB key 2016May31-23.32.46
12.00 Replaced nnaida17 & nnaida18 with FEE module previously used for nnaida31 & nnaida32
Pulser walkthrough
BNC PB-4 settings
90,000 - 10,000 @ 10,000 step
x5 attenuator (was x10 previously)
t_r = 50ns tau_d = 50us
polarity -
rate ~ 150Hz
INT, delay MIN
polarity + by EG&G Ortec 433A
N.B. - polarity terminated at end of AIDA adaptor chain, + polarity not terminated
Spectra saved 12.32 ( to directories tagged around June 1, 2016 05.29 )
BNC PB4 pulser rate set to ~5Hz
207Bi source at front of snout and 2x 60Co sources above DSSD3
14.00 Rebooted aidas1 to cleanup merge
Changed config to 24x FEE64s
Clock issues with nnaida23 - clock not locked status 0x6 - see attachments 3-9
18.00 Replace current nnaida19 (no histogramming, reSYNCs OK but timestamp not sync'd wrt timestamps of
other FEE64s).
Replace current nnaida23
Following powerup obtained clock not locked - status 0x6 for nnaida5 (master)
Replacement nnaida19 also does not histogram, reSYNCs OK but timestamp not sync'd wrt timestamps
of other FEE64s)
With help from PJCS investigate above issues and change timestamp master from nnaida5 to nnaida6
( /MIDAS/config/HttpdTcl/aidas1/startup.tcl and /MIDAS/config/HttpdTcl/nnaida5/startup.tcl ) to
change definition of timestamp master.
Able to operate DAQ and obtain AIDA SYNCs and WAVE SYNCs with TS_SYNC 0x0 _only_
PJCS will also investigate using system in T9 at STFC DL
Restored settings 2016June1-17.27.? |
 Wed Jun 1 09:00:13 2016, TD - Reply PJCS, Wednesday 1 June 2016
|
> 09.30 Detector biases and leakage currents - ambient temp +24.9 deg C - attachments 1-2
>
> 10.08 Connection lost to nnaida27 and nnaida28
> Most recent save of settings DB key 2016May31-23.32.46
>
> 12.00 Replaced nnaida17 & nnaida18 with FEE module previously used for nnaida31 & nnaida32
>
> Pulser walkthrough
>
> BNC PB-4 settings
>
> 90,000 - 10,000 @ 10,000 step
> x5 attenuator (was x10 previously)
> t_r = 50ns tau_d = 50us
> polarity -
> rate ~ 150Hz
> INT, delay MIN
>
> polarity + by EG&G Ortec 433A
>
> N.B. - polarity terminated at end of AIDA adaptor chain, + polarity not terminated
>
> Spectra saved 12.32 ( to directories tagged around June 1, 2016 05.29 )
>
> BNC PB4 pulser rate set to ~5Hz
>
> 207Bi source at front of snout and 2x 60Co sources above DSSD3
>
> 14.00 Rebooted aidas1 to cleanup merge
>
> Changed config to 24 FEE64s
>
> Clock issues with nnaida23 - clock not locked status 0x6 - see attachments 3-9
Check the Local Controls for the setting of the LMK3200 control rgister.
If you recall from the problem with nnaida5 the value should be 0xB.
If the clock still doesn't lock then maybe it's an HDMI cable problem like nnaida5.
Since the other FEE64 are ok then it is likely to be just the MACB to nnaida23. |
|
Wed Jun 1 13:58:48 2016, TD - Reply PJCS, Wednesday 1 June 2016
|
> Check the Local Controls for the setting of the LMK3200 control rgister.
> If you recall from the problem with nnaida5 the value should be 0xB.
> If the clock still doesn't lock then maybe it's an HDMI cable problem like nnaida5.
> Since the other FEE64 are ok then it is likely to be just the MACB to nnaida23.
I attach SYNC stats for WAVE and AIDA - you will notice that most (but not all) FEE64s
produce WAVE SYNCS
Plus (load balanced) statistics for disc, good events |
|
Wed Jun 1 12:14:08 2016, Patrick Coleman-Smith, [HowTo] React to "Check Clock Status => FEE64 Failure"
|
If there are more than one failures then check how they map to the MACB HDMI connections.
Are they all connected to the just one MACB ? => Check the HDMI cable at the MACB Layer Port.
Are they all connected to several MACBs which have a common "Parent" ? => Check the HDMI cable at the "Parent"
MACB Layer Port.
If there is just one failure then open the Local Controls browser window for the failing FEE64.
If the "Status Register" @1 is not 0x7 then the Waveform ADCs will not operate correctly and ASIC readout will
be compromised.
To remedy try
A) Enter 0x2B to "LMK03200 control register" @5
then Reload the Page
then Enter 0xB
then Reload the Page and check the status, if 0x7 all ok.
B) Enter 0xA to "LMK03200 control register" @5
then Reload the Page
then Enter 0xB
then Reload the Page
then enter 0x2B to "LMK03200 control register" @5
then Reload the Page
then Enter 0xB
then Reload the Page and check the status, if 0x7 all ok. |
|
Wed Jun 1 07:49:45 2016, TD, Detector noise - state of play 10x
|
Screenshots of ASIC#1 waveforms for each side of each of the DSSSD #1 - #6 are attached.
Standard ASIC settings - tau = 8us
Typical threshold values are ~8500 (positive signals) and ~7800 (negative signals)
Large (off-scale) signals are the pulser, lower amplitude signals are betas
Currently, the noise looks OK.
Note that EURICA is currently open (in preparation for IMPACT run) and (just possibly) SAMURAI
dipole in adjacent experimental area is now off (to be checked).
We (AIDA) have made no further changes since yesterday's addition of Field Plate grounding jumpers
to all four adaptor PCBs of DSSSD #1 and #6. |
|
Wed Jun 1 01:32:04 2016, TD, Co/Bi source run (R19)
|
09.18 R19 (AIDA) stopped
AIDA SYNC lost for most (but not all) FEE64s - see attachments 1-2
Statistics show similar numbers of SYNCs which may imply a recent event/failure
|
|
Tue May 31 16:03:24 2016, AE. VP, Co/Bi source run (R17) 8x
|
Set discriminator mask for DSSD2 through DSSD6 (see attachments). Fast comparator threshold set to 9 for all DSSDs.
New source run for beta-gamma correlation, now with all DSSDs included in EURICA trigger.
Trigger is OR of coincidence front:back of all DSSDs.
AIDA run: R17*
EURICA run: BiCocal_run0015.lmd
Saved new ASIC settings: 2016May31-23.32.46
Experiment elog: http://ribf-exp.riken.jp/elog/EURICA+U-campaign+2016/13 |
|
Tue May 31 08:06:43 2016, TD, AE & CG, Tuesday 31 May 2016 7x
|
Attachment 3 - AIDA discriminator with pulser ~5Hz
standard ASIC settings (tau=8us, slow comparator 0x10, LEC/MEC comparator 0x9)
17.30 Added jumpers to the front/rear field plate connections (Lk 2/4 + 6/8) on all FEEs corresponding to DSSDs
1 and 6
Saw significant reduction in size of noise peak in waveforms as well as in the fast discriminator rate
from all FEEs.
18.50 R13 (AIDA) + BiCocal_run0012.lmd (EURICA)
207Bi beta-gamma correlation test
Standard ASIC settings (tau=8us, slow comparator 0x10, LEC/MEC comparator 0x9)
BNC PB-4 pulser OFF
Settings DB key 2016May31-18.55.42
Attachment 4 - statistics AIDA discriminators
Attachments 6-7 - time correlation for 207Bi beta-gamma coincidences between EURICA Ge Or and
DSSSD#1 trigger ( .OR.X strips .AND. OR.Y strips ) |
|
Mon May 30 18:29:54 2016, AE, Co/Bi source run (R7)
|
Some comments regarding source run for beta-gamma calibration, to complement EURICA16 elog entry:
http://ribf-exp.riken.jp/elog/EURICA+U-campaign+2016/
This corresponds to run files R7_* (AIDA) and BiCocal_run003.lmd and BiCocal_run004.lmd (run files could
increase for EURICA)
EURICA trigger: AIDA trigger (#1) OR pulser (~25MHz).
Trigger rate: about 170 Hz
AIDA trigger: Detector 1 with low multiplicity condition; N=1, 2 or 3 within window of 5x40ns
AIDA trigger rate: Det1 X = 7500 (nnaida17+nnaida22)
Det1 Y = 800 (nnaida17+nnaida22)
coincidence X+Y= 330
The trigger output of MACB has an inverted logic (0 when trigger, -0.5 V otherwise)
Attached are screenshots documenting conditions during run.
8am: closed file: R7_110.gz in AIDA, BiCocal*005.lmd in EURICA |
|
Mon May 30 22:57:58 2016, AE, Co/Bi source run (R7)
|
> Some comments regarding source run for beta-gamma calibration, to complement EURICA16 elog entry:
> http://ribf-exp.riken.jp/elog/EURICA+U-campaign+2016/
>
> This corresponds to run files R7_* (AIDA) and BiCocal_run003.lmd and BiCocal_run004.lmd (run files could
> increase for EURICA)
>
> EURICA trigger: AIDA trigger (#1) OR pulser (~25MHz).
>
> Trigger rate: about 170 Hz
>
> AIDA trigger: Detector 1 with low multiplicity condition; N=1, 2 or 3 within window of 5x40ns
>
> AIDA trigger rate: Det1 X = 7500 (nnaida17+nnaida22)
> Det1 Y = 800 (nnaida17+nnaida22)
> coincidence X+Y= 330
>
> The trigger output of MACB has an inverted logic (0 when trigger, -0.5 V otherwise)
>
> Attached are screenshots documenting conditions during run.
No
The clock is in 10 ns intervals
So 5 => 50ns
The trigger is Fast NIM standard. Talk to Tom
With such a short time ,a lower limit of 1 and high rate discriminators the Trigger will appear true all the time. |
|
Mon May 30 09:03:07 2016, TD, AE & CG, timstamping - state of play 11x
|
Current error messages and status - see attachments |
|