AIDA GELINA BRIKEN nToF CRIB ISOLDE CIRCE nTOFCapture DESPEC DTAS EDI_PSA 179Ta CARME StellarModelling DCF K40
  AIDA, Page 33 of 46  ELOG logo
ID Date Author Subject
  278   Sun Jun 5 17:09:49 2016 CG, DK, AEMonday 6th June

00.45 Run R1100 started on n-rich setting (EURICA run_1100, BigRIPS run 1165)

            Degraders as noted in previous entry

           Check clock status failed for nnaida5. ADC calib failed for nnaida8. nnaida19 failed Check ASIC clock and Check SYNC errors.

           Temps ok. Leakage currents ok.

            Settings file 2016Jun06-00.31.34

            AIDA fluctuating but all > 0.

            Tape rate ~8Mb/s.

            Merge was outputting some interesting looking messages to terminal about queue being full and timestamps going backwards (attachment 3).

            TapeServer window shows data being written as does repeated ls in /TapeData/NP1306. Writing one file every ~5-7min.

 

01.45 Merger went into 'Want next SYNC'

            AIDA SYNC rate went to zero and TapeService stopped writing data.

            Run stopped and FEEs power cycled as contact was lost with ~50%.

            Beam operators want to do some tuning so control has been given to them while we start back up.

 

02.22 Started run R1101 on n-rich setting (EURICA run_1101-1102, BigRIPS run 1168-1169)

            Increased fast disc threshold to 5 in all nnaida to prevent merger from running so fast and possibly choking.

            Stopped @ 04.20

            Realised after, nnaida24 had been on 1GeV range.

 

04.28 Started run R1102 on n-rich setting (EURICA run_1103, BigRIPS run 1170)

           Stopped as 04.37 nnaida24 in 1GeV range.

 

04.39 Started run R1103 on n-rich setting (EURICA run_1104, BigRIPS run 1170)

           Settings file 2016Jun06-04.39.22 -> same as previous settings but nnaida24 changed to 20MeV range.

           Stopped at 04.59 at request of beam operators.

 

05.11 Started run R1104 on n-rich setting (EURICA run_1105, BigRIPS run 1171)

            Merger died.

            Stopped @ 05.15.

            Ctrl-c out of all tape/merger related windows and restarted them. Setup/Configure etc.

 

05.34 Started run R1105 on n-rich setting ( EURICA run_1106, BigRIPS run 1172)

           Settings file 2016Jun06-05.34.56 -> nnaida24 reverted back to 1GeV range. New settings file to make sure nnaida24 is set to 1GeV range. Changed in Save/Restore options.

           Temps ok. Leakage currents ok.

           Rates in visual scalar ~10% higher.

 

07.22 Lost contact with nnaida4 and merger stopped outputting data.

            Stopped run R1105.

            Power cycle FEEs and start new run.

            On two power cycles, certain FEEs were not contactable.

            Beam stopped by operators for brief period.

 

08.14 Run 1106 started on n-rich setting (EURICA run_1108, BigRIPS run 1175)

            Settings file 2016Jun06-05.34.56

            Temps ok. Leakage currents ok.

             Stopped 09.06 for setting change.

 

09.41 Run 1107 started on reference mass setting (EURICA run_1200, BigRIPS run 1177)

            Settings file 2016Jun06-05.34.56

 

11:24 Network link to the outside world is dropped across B3F

             Beam is being controlled by the primary operators.

             Run 1108 - background run with beam off from 10:29 to 11:31 (EURCA run 1201, no BigRIPS run)

             (Was still editing the elog without submitting it.  Sorry!)

             Settings file was saved: 2016Jun06-10.45.31

             Leak currents from paper logbook in consecutive order bias1 ch0-3, bias2 ch0-1 in uA: 3.225, 4.155, 3.515, 3.315, 3.65, 3.205

 

12.45 start R1110 (AIDA) run_1103 (EURICA)

           Continuing reference mass measurement following earlier network outage B3F

           ASIC settings 2016Jun06-05.34.56

 

          see attachments 13-20

 

13.30 Stopped R1110 for B3F entry

           'unable to connect' to nnaida1 etc

           AIDA FEE64s reset OK but would not ReSync wuth about half of the FEE64s returning -1 status code

          power cycle FEE64s, reboot aidas1 & FEE64s

14.03 ASIC seetings DB key 2016Jun06-14.03.48

14.20 System-wide checks

            All FEE64s pass all tests *except*

                 nnaida21 ADC calibration

                 nnaida19 ASIC clock timestamp & SYNC errors not counting

 

 

 

 

           

Attachment 1: bias1_run1100-0506-0046.png
bias1_run1100-0506-0046.png
Attachment 2: bias2_run1100-0506-0046.png
bias2_run1100-0506-0046.png
Attachment 3: merge_output_R1100.png
merge_output_R1100.png
Attachment 4: merger_output2.png
merger_output2.png
Attachment 5: bias1_R1101_0606-0228.png
bias1_R1101_0606-0228.png
Attachment 6: bias2_R1101_0606-0228.png
bias2_R1101_0606-0228.png
Attachment 7: bias1_R1102_0606-0430.png
bias1_R1102_0606-0430.png
Attachment 8: bias2_R1102_0606-0430.png
bias2_R1102_0606-0430.png
Attachment 9: bias1_R1105_0606-0540.png
bias1_R1105_0606-0540.png
Attachment 10: bias2_R1105_0606-0540.png
bias2_R1105_0606-0540.png
Attachment 11: bias1_R1107_0606-0953.png
bias1_R1107_0606-0953.png
Attachment 12: bias2_R1107_0606-0954.png
bias2_R1107_0606-0954.png
Attachment 13: 1.png
1.png
Attachment 14: 2.png
2.png
Attachment 15: 3.png
3.png
Attachment 16: 4.png
4.png
Attachment 17: 5.png
5.png
Attachment 18: 6.png
6.png
Attachment 19: 7.png
7.png
Attachment 20: 8.png
8.png
  277   Sun Jun 5 02:14:10 2016 TD, AE, CG & DKSunday 5 June 2016
10.10 Detector biases & leakage currents - OK - see attachments 1-2 

10.40 Detector biases & leakage currents - OK - see attachments 3-4
      30 minutes ~2000Hz highenergy heavy ions during BigRIPS tuning

17.35 Detector biases & leakage currents - OK - see attachments 5-6
      Rates DSSSD #1 - #6 ~500Hz per DSSSD

19.30 AIDA SYNCs lost
      FEE64s power cycled and rebooted

22.30 Detector biases & leakage currents - OK - see attachments 7-8
      Rates DSSSD #1 - #6 ~1kHz per DSSSD

23.00 2mm plate removed from fixed degrader, 1mm installed => net removal of 1mm
      Variable degrader No. 2 in beam, all others out.
Attachment 1: 200.png
200.png
Attachment 2: 201.png
201.png
Attachment 3: 202.png
202.png
Attachment 4: 203.png
203.png
Attachment 5: 300.png
300.png
Attachment 6: 301.png
301.png
Attachment 7: 310.png
310.png
Attachment 8: 311.png
311.png
  276   Sun Jun 5 01:32:44 2016 TD, DK, GL, AE, PJWFirst RIB implantation: Run 67

We restarted the merger (Stop, Setup & Configure, Go, Pause) and then we could restart the DAQ as normal.  Rate is ~500 Hz. 

  275   Sun Jun 5 01:20:39 2016 DK, AE, GL, PJWMerger wants first SYNC

Trying to start the AIDA DAQ now that the RI beam is (nearly) ready.  However, we cannot get merging to work.  But the merger status has "Merge State = GOing     :    paused     :    xfer enabled     :    want first SYNC"  but the last part ought to show "output paused" or after merge begins, "ready for SYNC".  We restarted the DAQ according to the procedure several times but this aspect of the messaging does not change, and the merging does not go live.

  274   Sat Jun 4 08:46:20 2016 TDAIDA noise - state of play 2
Attachments  1-23 AIDA FEE64s nnaida1-nnaida23 ASIC #1 waveforms

Attachments 24-27 AIDA FEE64 nnaida24 ASIC #1 - #4 waveforms

Common y-scale 7000-9000, xscale ~1000 samples @ 20ns/sample

All *L and *W histograms saved to /MIDAS/SpecData at c. 17.00 Saturday 4 June 2016

Note

1) BNC PB-4 Pulser amplitude 90,000, x5 attenuator, frequency c. 5Hz + ~40kBq 60Co source
placed on AIDA snout

2) EURICA closed
Attachment 1: 101.png
101.png
Attachment 2: 102.png
102.png
Attachment 3: 103.png
103.png
Attachment 4: 104.png
104.png
Attachment 5: 105.png
105.png
Attachment 6: 106.png
106.png
Attachment 7: 107.png
107.png
Attachment 8: 108.png
108.png
Attachment 9: 109.png
109.png
Attachment 10: 110.png
110.png
Attachment 11: 111.png
111.png
Attachment 12: 112.png
112.png
Attachment 13: 113.png
113.png
Attachment 14: 114.png
114.png
Attachment 15: 115.png
115.png
Attachment 16: 116.png
116.png
Attachment 17: 117.png
117.png
Attachment 18: 118.png
118.png
Attachment 19: 119.png
119.png
Attachment 20: 120.png
120.png
Attachment 21: 121.png
121.png
Attachment 22: 122.png
122.png
Attachment 23: 123.png
123.png
Attachment 24: 124.png
124.png
Attachment 25: 125.png
125.png
Attachment 26: 126.png
126.png
Attachment 27: 127.png
127.png
  273   Sat Jun 4 04:53:25 2016 TD, AE, CG, DK, GL YL & PJW (Team AIDA)Saturday 4 June 2016
12.27 DAQ run R61 started 01.30 
      Appears to have stopped abruptly at ~06.55
      All FEE64 AIDA SYNCs zero

      Attempted normal halt to run - DAQ STOP, toggle merge pause, stop tape server - OK

      Attempted normal start to run - start tape server, DAQ GO, toggle merge pause - OK
      Note during DAQ GO briefly obtained 'unable to connect' error from nnaida1 which resolved
      itself a few seconds later

      Atachment 1 - AIDA SYNCs
                2 - MERGE and server terminal sessions
                3 - TapeServer
                4 - R61 disk files
                5 - Detector biases and leakage currents - OK
                    Leakage current has decreased since yesterday. B2F/F11 ambient temperature
                    ~25 deg C but EURICA now closed.
                6 - AIDA discriminators
                7 - AIDA good events

From the MERGE server terminal session ...

Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Timestamp (4d087c824ee)[Q 5, Stream 5] is older than previous (4d097c800a0) [Q 5, Stream 5]
Merge: Attempting resynchronisation to timestamp 4d097c800a1 or greater
Merge: Last sync pulse time: 4d097c400a0
Merge: Last timestamp seen: 4d097c800a0
Merge: Restarting at timestamp 4d097cc00a0
Merge: Timestamp (4e122b40d1e)[Q 5, Stream 5] is older than previous (4e132b400a0) [Q 5, Stream 5]
Merge: Attempting resynchronisation to timestamp 4e132b400a1 or greater
Merge: Last sync pulse time: 4e132b000a0
Merge: Last timestamp seen: 4e132b400a0
Merge: Restarting at timestamp 4e132b800a0
Merge: Timestamp (4e1662818a6)[Q 5, Stream 5] is older than previous (4e1762800a0) [Q 5, Stream 5]
Merge: Attempting resynchronisation to timestamp 4e1762800a1 or greater
Merge: Last sync pulse time: 4e1762400a0
Merge: Last timestamp seen: 4e1762800a0
Merge: Restarting at timestamp 4e1762c00a0
Merge: Timestamp (4e1b89803c6)[Q 5, Stream 5] is older than previous (4e1c89800a0) [Q 5, Stream 5]
Merge: Attempting resynchronisation to timestamp 4e1c89800a1 or greater
Merge: Last sync pulse time: 4e1c89400a0
Merge: Last timestamp seen: 4e1c89800a0
Merge: Restarting at timestamp 4e1c89c00a0
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Trying to add items to Q index 7 (Link 7) but queue already full
Merge: Timestamp (4f2580400c6)[Q 5, Stream 5] is older than previous (4f2680400a0) [Q 5, Stream 5]
Merge: Attempting resynchronisation to timestamp 4f2680400a1 or greater
Merge: Last sync pulse time: 4f2680000a0
Merge: Last timestamp seen: 4f2680400a0
Merge: Restarting at timestamp 4f2680800a0
Merge: Timestamp (5026a041c06)[Q 5, Stream 5] is older than previous (5027a0400a0) [Q 5, Stream 5]
Merge: Attempting resynchronisation to timestamp 5027a0400a1 or greater
Merge: Last sync pulse time: 5027a0000a0
Merge: Last timestamp seen: 5027a0400a0
Merge: Restarting at timestamp 5027a0800a0
Merge: Timestamp (5083c7008c6)[Q 5, Stream 5] is older than previous (5084c7000a0) [Q 5, Stream 5]
Merge: Attempting resynchronisation to timestamp 5084c7000a1 or greater
Merge: Last sync pulse time: 5084c6c00a0
Merge: Last timestamp seen: 5084c7000a0
Merge: Restarting at timestamp 5084c7400a0
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Trying to add items to Q index 2 (Link 2) but queue already full
Merge: Timestamp (523c5c80b4e)[Q 5, Stream 5] is older than previous (523d5c800a0) [Q 5, Stream 5]
Merge: Attempting resynchronisation to timestamp 523d5c800a1 or greater
Merge: Last sync pulse time: 523d5c400a0
Merge: Last timestamp seen: 523d5c800a0
Merge: Restarting at timestamp 523d5cc00a0
Merge: Timestamp (527ddc03916)[Q 5, Stream 5] is older than previous (527edc000a0) [Q 5, Stream 5]
Merge: Attempting resynchronisation to timestamp 527edc000a1 or greater
Merge: Last sync pulse time: 527edbc00a0
Merge: Last timestamp seen: 527edc000a0
Merge: Restarting at timestamp 527edc400a0
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Trying to add items to Q index 4 (Link 4) but queue already full
Merge: Timestamp (52e9c2c0456)[Q 5, Stream 5] is older than previous (52eac2c00a0) [Q 5, Stream 5]
Merge: Attempting resynchronisation to timestamp 52eac2c00a1 or greater
Merge: Last sync pulse time: 52eac2800a0
Merge: Last timestamp seen: 52eac2c00a0
Merge: Restarting at timestamp 52eac3000a0


Queue full messages do not appear to be correlated (currently at least) with the busiest FEE64s


12.50 AIDA trigger to EURICA OR(DSSSD#1 - #5) .AND.NOT. DSSSD#6 ~1.8kHz
    
      .AND.EURICA ~50Hz (no significant change in rate when DSSSD#6 veto removed)

15.30 DAQ found stopped - AIDA SYNCs zero - data transfer disabled, histogramming enabled

      System wide checks
       nnaida19 fails 'ASIC clock timestamp' and 'SYNC errors not counting tests'
       all other FEE64s pass all tests
Attachment 1: 21.png
21.png
Attachment 2: 22.png
22.png
Attachment 3: 23.png
23.png
Attachment 4: 24.png
24.png
Attachment 5: 25.png
25.png
Attachment 6: 26.png
26.png
Attachment 7: 27.png
27.png
Attachment 8: 28.png
28.png
  272   Fri Jun 3 03:10:55 2016 TD, AE, CG & DKFriday 3 June 2016
11.00 Detector biases and leakage currents - see attachments 1-2
  
      FEE64 temperatures - see attachment 3

      DAQ ran overnight without problem - statistics - attachments 4-8

      Plan for today

      1) Develop AIDA external trigger output for fast LEC/MEC discriminator threshold 0x4, or lower

      2) Replace non-rev B MACB with rev B MACB in master timestamp chain (NIM module #2) 

16.15 Non-rev B MACB in master timestamp chain replaced with rev B MACB module

      FEE64s power cycled and rebooted.

      System ReSYNC'd successfully 

      System-wide tests 
            clock states 24/24 pass
            adc calibration 24/24 pass
            ASIC clock timestamp check 23/24 pass, nnaida19 fails
            SYNC errors not counting 23/24 pass, nnaida19 fails

      N.B. We obtained the same nnaida19 errors before rpelacing non-rev B MACB *and* with FEE64
           previously installed as nnaida19

      Module timestamps - see attachment 9

      Master timestamp module nnaida6 - all clocks locked


      Fitted ground jumpers to front and rear field plate connections on all four adaptor PCBs
      for each of DSSSD#2 - #5, i.e. DSSSD#1 - #6 now have field plate ground jumpers fitted.

      See attachments 10 & 11 showing discriminator rates before and after fitting these additional
      ground jumpers (LEC/MEC fast discriminator threshold 0x4 or 0x5)

18.25 NP1306 R58
      
      207Bi + 60Co LEC/MEC disc threshold test
      ASIC settings 2016Jun03-21.03.42

21.05 End R58

21.30 Moved extant data acquisition server options files to /MIDAS/DB/EXPERIMENT/AIDA/nnaida?/CONTENTS.BAK-030616
      Saved options for all data acquisition servers with
        TS_SYNC_PHASE = 0x3
        MACB_TRIG_MODE = 0x4
        ASIC Settings DB key 2016Jun03-21.03.42
        (all LEC/MEC fast disc settings 0x5 *except* nnaida5 & nnaida6 = 0x20)

       
Attachment 1: 1.png
1.png
Attachment 2: 2.png
2.png
Attachment 3: 3.png
3.png
Attachment 4: 4.png
4.png
Attachment 5: 5.png
5.png
Attachment 6: 6.png
6.png
Attachment 7: 7.png
7.png
Attachment 8: 8.png
8.png
Attachment 9: 10.png
10.png
Attachment 10: 11.png
11.png
Attachment 11: 12.png
12.png
Attachment 12: 13.png
13.png
  271   Thu Jun 2 09:04:57 2016 TD[How to] Monitor AIDA
Every 4h

1) Record DSSSD #1 = #6 detector bias voltages and leakage currents in written logbook

   Desktop 6 - 2x PUTTY terminal sessions

   Each PUTTY terminal session is connected to a CAEN N1419 4 ch HV Power Supply 

   Addr 00

   Ch 0 = DSSSD # 1
    :
    :
   Ch 3 = DSSSD # 4

   Addr 01

   Ch 0 = DSSSD # 5
   Ch 1 = DSSSD # 6

   Compare with previous observations 

2) Desktop 1 - Firefox web browser - Temperatures tab

   Select Reload

   Check temperatures

       Virtex < 75 deg C
       PSU    < 45 deg C
       ASIC   < 65 deg C

   If not call for expert help. 

   Note that the ASIC temperatures for some data acquisition servers sometimes read back as 0.0


*If* DAQ running also


3) Desktop 1 - Firefox web browser - Statistics tab

   Check Reload

   Check 'Show ALL Data Acquisition Servers' 

   From 'Select counter to Monitor' select 'AIDA Discriminator'

   Select 'Update Once'

   Check *all* data acquisition servers have a non-zero rate

   N.B. If one, or more, data acquisition servers have zero rate call for expert help!

   From keyboard select Alt-Print Screen and save screenshot to /tmp directory as a .png file
   Upload the .png file to the EURICA 2016 Elog for the current run

   Compare rates with previous observations at same settings 

4) Desktop 1 - Firefox web browser - Statistics tab

   Check Reload

   Check 'Show ALL Data Acquisition Servers' 

   From 'Select counter to Monitor' select 'AIDA SYNC'

   Select 'Update Once'

   Check *all* data acquisition servers have a non-zero rate (typically ~300-500Hz)

   N.B. If one, or more, data acquisition servers have zero rate call for expert help!

5) Desktop 2 - Firefox web browser - MERGE tab

   Select 'Reload' several times and check all enabled data links (0-23) are active
         bright green = active, olive green = inactive, red = disabled 

   N.B. If some data links are *always* inactive call for expert help!

   Select Reload to observe merge rate (date items/s)

   Observe active spinners in MERGE and TapeServer server terminal windows adjacent to web browser

6) Desktop 2 - Firefox web browser - TapeServer tab

   Select Reload and observe number of blocks written to disk
  270   Thu Jun 2 01:33:13 2016 TD, AE, CG & DKThursday 2 June 2016
09.30 DAQ left running overnight
      AIDA SYNCs on all FEE64s this morning 

      DSSSD#1 -#6 bias and leakage currents OK - see attachments 1-2

09.39 Estimation of AIDA timestamp clock frequency

      See attachments 3-4

      nnaida6 (master) timestamp  0x415 0x0af112ec - 0x413 0xa41a46b0 = 0x166d6cc3c = 6020320316 (dec)

      elapsed time = 61s => 98.694MHz


10.50 Lower LEC/MEC fast discriminator thresholds from 0xa to 0x4/0x5
      AIDA discriminator rates shown attachment 5
      Rates <300kHz
Attachment 1: 1.png
1.png
Attachment 2: 2.png
2.png
Attachment 3: 3.png
3.png
Attachment 4: 4.png
4.png
Attachment 5: 5.png
5.png
  269   Wed Jun 1 13:58:48 2016 TD - Reply PJCSWednesday 1 June 2016
> Check the Local Controls for the setting of the LMK3200 control rgister.
> If you recall from the problem with nnaida5 the value should be 0xB.
> If the clock still doesn't lock then maybe it's an HDMI cable problem like nnaida5.
> Since the other FEE64 are ok then it is likely to be just the MACB to nnaida23.

I attach SYNC stats for WAVE and AIDA - you will notice that most (but not all) FEE64s
produce WAVE SYNCS

Plus (load balanced) statistics for disc, good events
Attachment 1: 500.png
500.png
Attachment 2: 501.png
501.png
Attachment 3: 503.png
503.png
Attachment 4: 505.png
505.png
  268   Wed Jun 1 12:14:08 2016 Patrick Coleman-Smith[HowTo] React to "Check Clock Status => FEE64 Failure"
If there are more than one failures then check how they map to the MACB HDMI connections.
 Are they all connected to the just one MACB ? => Check the HDMI cable at the MACB Layer Port.
 Are they all connected to several MACBs which have a common "Parent" ? => Check the HDMI cable at the "Parent"
MACB Layer Port.

If there is just one failure then open the Local Controls browser window for the failing FEE64.
If the "Status Register" @1 is not 0x7 then the Waveform ADCs will not operate correctly and ASIC readout will
be compromised.
To remedy try 
A)    Enter 0x2B to "LMK03200 control register" @5 
          then Reload the Page 
          then Enter 0xB
          then Reload the Page and check the status, if 0x7 all ok. 

B)     Enter 0xA to "LMK03200 control register" @5 
          then Reload the Page
          then Enter 0xB
          then Reload the Page
          then enter 0x2B to "LMK03200 control register" @5 
          then Reload the Page 
          then Enter 0xB
          then Reload the Page and check the status, if 0x7 all ok.  
  267   Wed Jun 1 09:00:13 2016 TD - Reply PJCSWednesday 1 June 2016
> 09.30 Detector biases and leakage currents - ambient temp +24.9 deg C - attachments 1-2
> 
> 10.08 Connection lost to nnaida27 and nnaida28 
>       Most recent save of settings DB key 2016May31-23.32.46
> 
> 12.00 Replaced nnaida17 & nnaida18 with FEE module previously used for nnaida31 & nnaida32
> 
>       Pulser walkthrough
> 
>       BNC PB-4 settings 
> 
>       90,000 - 10,000 @ 10,000 step
>       x5 attenuator (was x10 previously)
>       t_r = 50ns tau_d = 50us
>       polarity -
>       rate ~ 150Hz
>       INT, delay MIN
> 
>       polarity + by EG&G Ortec 433A
> 
>       N.B. - polarity terminated at end of AIDA adaptor chain, + polarity not terminated
> 
>       Spectra saved 12.32 ( to directories tagged around June 1, 2016 05.29 )
> 
>       BNC PB4 pulser rate set to ~5Hz
> 
>       207Bi source at front of snout and 2x 60Co sources above DSSD3
> 
> 14.00 Rebooted aidas1 to cleanup merge 
>       
>       Changed config to 24 FEE64s 
> 
>       Clock issues with nnaida23 - clock not locked status 0x6 - see attachments 3-9

Check the Local Controls for the setting of the LMK3200 control rgister.
If you recall from the problem with nnaida5 the value should be 0xB.
If the clock still doesn't lock then maybe it's an HDMI cable problem like nnaida5.
Since the other FEE64 are ok then it is likely to be just the MACB to nnaida23.
  266   Wed Jun 1 07:49:45 2016 TDDetector noise - state of play
Screenshots of ASIC#1 waveforms for each side of each of the DSSSD #1 - #6 are attached.

Standard ASIC settings - tau = 8us

Typical threshold values are ~8500 (positive signals) and ~7800 (negative signals)

Large (off-scale) signals are the pulser, lower amplitude signals are betas

Currently, the noise looks OK.

Note that EURICA is currently open (in preparation for IMPACT run) and (just possibly) SAMURAI
dipole in adjacent experimental area  is now off (to be checked).

We (AIDA) have made no further changes since yesterday's addition of Field Plate grounding jumpers
to all four adaptor PCBs of DSSSD #1 and #6.
Attachment 1: 301.png
301.png
Attachment 2: 302.png
302.png
Attachment 3: 303.png
303.png
Attachment 4: 304.png
304.png
Attachment 5: 310.png
310.png
Attachment 6: 311.png
311.png
Attachment 7: 312.png
312.png
Attachment 8: 317.png
317.png
Attachment 9: 318.png
318.png
Attachment 10: 320.png
320.png
  265   Wed Jun 1 01:33:58 2016 TDWednesday 1 June 2016
09.30 Detector biases and leakage currents - ambient temp +24.9 deg C - attachments 1-2

10.08 Connection lost to nnaida27 and nnaida28 
      Most recent save of settings DB key 2016May31-23.32.46

12.00 Replaced nnaida17 & nnaida18 with FEE module previously used for nnaida31 & nnaida32

      Pulser walkthrough

      BNC PB-4 settings 

      90,000 - 10,000 @ 10,000 step
      x5 attenuator (was x10 previously)
      t_r = 50ns tau_d = 50us
      polarity -
      rate ~ 150Hz
      INT, delay MIN

      polarity + by EG&G Ortec 433A

      N.B. - polarity terminated at end of AIDA adaptor chain, + polarity not terminated

      Spectra saved 12.32 ( to directories tagged around June 1, 2016 05.29 )

      BNC PB4 pulser rate set to ~5Hz

      207Bi source at front of snout and 2x 60Co sources above DSSD3

14.00 Rebooted aidas1 to cleanup merge 
      
      Changed config to 24x FEE64s 

      Clock issues with nnaida23 - clock not locked status 0x6 - see attachments 3-9

18.00 Replace current nnaida19 (no histogramming, reSYNCs OK but timestamp not sync'd wrt timestamps of
      other FEE64s).
      Replace current nnaida23

      Following powerup obtained clock not locked - status 0x6 for nnaida5 (master)

      Replacement nnaida19 also does not histogram, reSYNCs OK but timestamp not sync'd wrt timestamps
      of other FEE64s)

      With help from PJCS investigate above issues and change timestamp master from nnaida5 to nnaida6
      ( /MIDAS/config/HttpdTcl/aidas1/startup.tcl and /MIDAS/config/HttpdTcl/nnaida5/startup.tcl ) to 
      change definition of timestamp master.

      Able to operate DAQ and obtain AIDA SYNCs and WAVE SYNCs with TS_SYNC 0x0 _only_ 
      PJCS will also investigate using system in T9 at STFC DL

      Restored settings 2016June1-17.27.?
Attachment 1: 1.png
1.png
Attachment 2: 2.png
2.png
Attachment 3: 200.png
200.png
Attachment 4: 201.png
201.png
Attachment 5: 202.png
202.png
Attachment 6: 204.png
204.png
Attachment 7: 205.png
205.png
Attachment 8: 206.png
206.png
Attachment 9: 207.png
207.png
  264   Wed Jun 1 01:32:04 2016 TDCo/Bi source run (R19)
09.18 R19 (AIDA) stopped 
      AIDA SYNC lost for most (but not all) FEE64s - see attachments 1-2
      Statistics show similar numbers of SYNCs which may imply a recent event/failure
      
Attachment 1: 110.png
110.png
Attachment 2: 111.png
111.png
  263   Tue May 31 16:03:24 2016 AE. VPCo/Bi source run (R17)
Set discriminator mask for DSSD2 through DSSD6 (see attachments). Fast comparator threshold set to 9 for all DSSDs.

New source run for beta-gamma correlation, now with all DSSDs included in EURICA trigger.

Trigger is OR of coincidence front:back of all DSSDs.

AIDA run: R17*
EURICA run: BiCocal_run0015.lmd

Saved new ASIC settings: 2016May31-23.32.46

Experiment elog: http://ribf-exp.riken.jp/elog/EURICA+U-campaign+2016/13
Attachment 1: Rall1.png
Rall1.png
Attachment 2: Rall3.png
Rall3.png
Attachment 3: Rall4.png
Rall4.png
Attachment 4: Rall_5.png
Rall_5.png
Attachment 5: Rall_7.png
Rall_7.png
Attachment 6: Rall_8.png
Rall_8.png
Attachment 7: Rall_9.png
Rall_9.png
Attachment 8: Rall_11.png
Rall_11.png
  262   Tue May 31 08:06:43 2016 TD, AE & CGTuesday 31 May 2016
Attachment 3 - AIDA discriminator with pulser ~5Hz
               standard ASIC settings (tau=8us, slow comparator 0x10, LEC/MEC comparator 0x9)

17.30 Added jumpers to the front/rear field plate connections (Lk 2/4 + 6/8) on all FEEs corresponding to DSSDs
1 and 6
      Saw significant reduction in size of noise peak in waveforms as well as in the fast discriminator rate
from all FEEs.

18.50 R13 (AIDA) + BiCocal_run0012.lmd (EURICA)

      207Bi beta-gamma correlation test

      Standard ASIC settings (tau=8us, slow comparator 0x10, LEC/MEC comparator 0x9)

      BNC PB-4 pulser OFF

      Settings DB key 2016May31-18.55.42

      Attachment 4 - statistics AIDA discriminators

Attachments 6-7 - time correlation for 207Bi beta-gamma coincidences between EURICA Ge Or and
                  DSSSD#1 trigger ( .OR.X strips .AND. OR.Y strips )
Attachment 1: 101.png
101.png
Attachment 2: 102.png
102.png
Attachment 3: 103.png
103.png
Attachment 4: 105.png
105.png
Attachment 5: biasVoltages_31May1904_R12.png
biasVoltages_31May1904_R12.png
Attachment 6: 2016-05-31_18.58.01.jpg
2016-05-31_18.58.01.jpg
Attachment 7: 2016-05-31_18.58.11.jpg
2016-05-31_18.58.11.jpg
  261   Mon May 30 22:57:58 2016 AECo/Bi source run (R7)
> Some comments regarding source run for beta-gamma calibration, to complement EURICA16 elog entry:
> http://ribf-exp.riken.jp/elog/EURICA+U-campaign+2016/
> 
> This corresponds to run files R7_* (AIDA) and BiCocal_run003.lmd and BiCocal_run004.lmd (run files could
> increase for EURICA)
> 
> EURICA trigger: AIDA trigger (#1) OR pulser (~25MHz). 
> 
> Trigger rate: about 170 Hz
> 
> AIDA trigger: Detector 1 with low multiplicity condition; N=1, 2 or 3 within window of 5x40ns
> 
> AIDA trigger rate: Det1 X = 7500 (nnaida17+nnaida22)
>                    Det1 Y = 800 (nnaida17+nnaida22)
>                    coincidence X+Y= 330
> 
> The trigger output of MACB has an inverted logic (0 when trigger, -0.5 V otherwise) 
> 
> Attached are screenshots documenting conditions during run.

No
The clock is in 10 ns intervals 
So 5 => 50ns
The trigger is Fast NIM standard. Talk to Tom
With such a short time ,a lower limit of 1 and high rate discriminators the Trigger will appear true all the time.
  260   Mon May 30 18:29:54 2016 AECo/Bi source run (R7)
Some comments regarding source run for beta-gamma calibration, to complement EURICA16 elog entry:
http://ribf-exp.riken.jp/elog/EURICA+U-campaign+2016/

This corresponds to run files R7_* (AIDA) and BiCocal_run003.lmd and BiCocal_run004.lmd (run files could
increase for EURICA)

EURICA trigger: AIDA trigger (#1) OR pulser (~25MHz). 

Trigger rate: about 170 Hz

AIDA trigger: Detector 1 with low multiplicity condition; N=1, 2 or 3 within window of 5x40ns

AIDA trigger rate: Det1 X = 7500 (nnaida17+nnaida22)
                   Det1 Y = 800 (nnaida17+nnaida22)
                   coincidence X+Y= 330

The trigger output of MACB has an inverted logic (0 when trigger, -0.5 V otherwise) 

Attached are screenshots documenting conditions during run.

8am: closed file: R7_110.gz in AIDA, BiCocal*005.lmd in EURICA
Attachment 1: R7_1.png
R7_1.png
Attachment 2: R7_2.png
R7_2.png
Attachment 3: R7_3.png
R7_3.png
Attachment 4: R7_5.png
R7_5.png
Attachment 5: R7_6.png
R7_6.png
  259   Mon May 30 09:03:07 2016 TD, AE & CGtimstamping - state of play
Current error messages and status - see attachments
Attachment 1: 1.png
1.png
Attachment 2: 2.png
2.png
Attachment 3: 3.png
3.png
Attachment 4: 4.png
4.png
Attachment 5: 5.png
5.png
Attachment 6: 6.png
6.png
Attachment 7: 7.png
7.png
Attachment 8: 8.png
8.png
Attachment 9: 9.png
9.png
Attachment 10: 11.png
11.png
Attachment 11: 12.png
12.png
ELOG V3.1.4-unknown