22.14 R1118 starts

      aidas1 has been rebooted


      Changed /MIDAS/linux-ppc_4xx/startup/aidacommon from

     netint DACQ_PushEnable 60
     netint DACQ_FlushEnable 60

     to

     netint DACQ_PushEnable 10
     netint DACQ_FlushEnable 10

      AIDA FEE64s then power-cycled and rebooted  

      nnaida19 data link to merger disabled

      see attachments 1-8

22.30 R1118 stops

      AIDA SYNCs & good events at end of R1118 - see attachments 9-10

R1120 stalled shortly after DAQ GO
      'unable to connect' etc

      power cycle & reboot FEE64s

R1121 currently running 
      AIDA SYNCs currently but rates <100Hz in many FEE64s - see attachment 2
      link64 processes consuming large fraction of available CPU - see attachment 1

10.25 Screenshots showing DAQ state of play during NP1512

10.50 SyncCheck ... EURICA server refusing connection

[aida@d05 euricatssender]$ ./euricatssender -t
euricatssender
Setting Transfer Block Size 65536
TCP transfer library version 4.0T
0: TCP socket send buffer was 16384 - now 425984
0: TCP socket receive buffer was 87380 - now 425984
0: TCP socket created OK - now connecting to 10.32.0.12 port 10305
0: Connected to 10.32.0.12 port 10305
E-f_evcli: Error connecting node:e01, port:6003. Msg:
-I- f_stc connection refused.
Can't connect Event Server = e01

11.08 Run AIDA9
      Stat/rate hit patterns - see attachments 1-3 

11.12 B3F ambient temp +25.0 deg C, d.p. +12.2 deg C, RH 44.2%

12.10 Attachments 4-9 - Right HEC 1*H spectra for DSSSD #1 - #6

12.17 Attachments 10-13 - nnaida24 (DSSSD #2) ASIC # 1-4 *H spectra

12.49 System wide checks OK 
      Some failures of FADC calibration - OK - readout is currently disabled
      nnaida19 fails SYNC errors not counting & ASIC clock timestamp

13.40 Run AIDA10

14.46 AIDA10_14 deadtime check

 *** GREAT format 3.2.0 analyser - TD - May 2014
 ***            ADC data: block: 30030 ptr: 12945 data: 0xC4A87DD1 module: 18 fail: 0 range: 0 id:  1192 
channel: 40 adc: 32209  ts: 0x0F0AC00000A0 OLD: ts: 0x0F0AD0000039 tag: 3 type: 0
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  204745037 (  910555.1 Hz)
        Other data format:   56374963 (  250714.3 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:        332 (       1.5 Hz)
                               RESUME:        332 (       1.5 Hz)
                              SYNC100:      85777 (     381.5 Hz)
                           FEE64 disc:   56286977 (  250323.0 Hz)
                             MBS info:       1545 (       6.9 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:     177071 (     787.5 Hz)

                Timewarps:        ADC:          1 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 Timestamp elapsed time:      224.857 s
 FEE module #:   1 elapsed dead time       0.010 s
 FEE module #:   2 elapsed dead time       0.209 s
 FEE module #:   3 elapsed dead time       0.001 s
 FEE module #:   4 elapsed dead time       0.000 s
 FEE module #:   5 elapsed dead time       0.120 s
 FEE module #:   6 elapsed dead time       0.362 s
 FEE module #:   7 elapsed dead time       0.000 s
 FEE module #:   8 elapsed dead time       0.000 s
 FEE module #:   9 elapsed dead time       0.019 s
 FEE module #:  10 elapsed dead time       0.011 s
 FEE module #:  11 elapsed dead time       0.000 s
 FEE module #:  12 elapsed dead time       0.005 s
 FEE module #:  13 elapsed dead time       0.000 s
 FEE module #:  14 elapsed dead time       0.000 s
 FEE module #:  15 elapsed dead time       0.059 s
 FEE module #:  16 elapsed dead time       0.304 s
 FEE module #:  17 elapsed dead time       0.000 s
 FEE module #:  18 elapsed dead time       0.010 s
 FEE module #:  19 elapsed dead time       0.000 s
 FEE module #:  20 elapsed dead time       0.029 s
 FEE module #:  21 elapsed dead time       0.035 s
 FEE module #:  22 elapsed dead time       0.006 s
 FEE module #:  23 elapsed dead time       0.052 s
 FEE module #:  24 elapsed dead time       0.044 s
 FEE module #:  25 elapsed dead time       0.000 s
 FEE module #:  26 elapsed dead time       0.000 s
 FEE module #:  27 elapsed dead time       0.000 s
 FEE module #:  28 elapsed dead time       0.000 s
 FEE module #:  29 elapsed dead time       0.000 s
 FEE module #:  30 elapsed dead time       0.000 s
 FEE module #:  31 elapsed dead time       0.000 s
 FEE module #:  32 elapsed dead time       0.000 s

 *** Program elapsed time:   68.563s (  466.727 blocks/s,  29.170 Mb/s)

21.08 Detector bias and leakage current screenshots - attachments 14-15

21.36 FEE64 temperatures - attachment 16
      Julabo FL11006 set point +17 deg C (B3F temperature +25.0 deg C, d.p. +11.5 deg C, RH 42.4%)
         

AIDA ASIC settuings 2023Nov16-18.55.20
     low comparator p+n FEE64s 0xa, n+n 0xf

     BNC PB-5 settings
     amplitide 10.0V
     attenuation x10
     decay time 1ms
     polarity + ( connected to FEE64 aida01 only )
     frequency 22Hz
     tail pulse
     remote control

16.46 per p+n FEE64 1.8.W spectra - 20us, 200us, 2ms & 20ms FSR - attachments 1-4
      per n+n FEE64 1.8.W spectra - 20us, 200us, 2ms & 20ms FSR - attachments 5-8

      DSSSD bias -150V leakage -5.690uA - attachment 9
      RH 32.7% ambient 2+3.2 deg C d.p. +5.9 deg C
      FEE64 temps OK - attachment 10


     bPlast configuration
     1x long and 1x short side connected to 3x bPlast booster PCBs
     Rohde & Schawrtz HMP4040 PSU ch 4 +4V ( ref'd to PSU chassis ground ) 
     Mesytec SiPM bias
     Screens of flat cables from bPlast to booster cards electrically connected together and to bPlast NIM bin c( below AIDA stand ) chassis
     bPlast NIM bin and TAMEX electrically isolated from AIDA stand/DESPEC platform

     Photos - attachments 11-16

17.00 Connect SC21 L disc o/p fan-out -> ESN LA8000 TTl output -> BNC PB-5 pulser ext trig
      Should enable triggering ( and delay ) of pulser from heavy-ions in scintillator SC21


17.17 LEC/MEC selection 0x -> 0x1
      ADC data item stats - attachment 20
      per FEE64 1.8.W spectra - 20us FSR - attachments 18-19
      per FEE64 Rate spectra - attachment 17
      BNC PB-5 pulser to aida01 - some channels missing asic # 2, 3 & 4
      aida04 asic# 1 rates still high but aida06 ( was aida10 ) high rates  in only two channels of asic #4
      Otherwise system very quiet as expected for MEC ( 1GeV FSR ).

17.56 LEC/MEC selection 0x1 -> 0x0

22.10 NH starts data transfer to Merger and TapeServer ( no storage mode ). Date Relay to MBS also started - see attachments  21-25

22.18 aida04 asic #1 slow comparator 0xf -> 0xff
      aida06 asic #4 slow comparator 0xa -> 0xff
      Merger data transfer c. 500k data items/s



     

Viewing AIDA status on Thursday morning 16/11/2023. 

Rates and histograms are observed with bPlast HV connected but not powered. The LIMO cables to the booster cards of bPlast are connected and the TAMEX crate is powered.

The following details the various tests of bPlast configurations and AIDA response:

1. The rates and status are the same as yesterday evening (15/11/2023) where we had the same configuration (bPlast connected to HV but not powered). (Attachment 1-3)

2. The rates and status are the same as in 1. when trying a different power supply but it is not turned on (Attachment 4-5). The R&S HMP4040 HV supply is a linearly regulated supply while the new supply is suspected to be switching regulated (?).

3. The rates and status are the same as in 1.,2. if the HV supply is connected. In fact they seem to increase when disconnecting the HV supply. (Attachment 6).

4. The rates and status are brought back to acceptable levels when disconnecting all the LIMOs of the bPlast booster board to TAMEX. (Attachment 7-8).

5. The rates and status are fairly worse when connecting a single LIMO (attachment 9) and when connecting the Mesytec module that powers the booster board (attachment 10).

6. The rates and status increase a little favourably when connecting a single LIMO to an odd numbered channel. (Attachment 11).

7. The rates and status are dramatically worse when connecting two LIMOs and a Mesytec module to the bPlast booster card. (Attachment 12).


The next tests will be dismounting the snout and trying to shield the bPlast ribbon cables with copper tape.

Tests resumed after lunch 14:00:00:

- The bPlast ribbon cables running to the booster boards were insulated with copper tape and kapton tape, and for the moment grounded freely with a tinned copper braid. A multimeter check of the ribbon cable showed that it is isolated from the snout as desired.

- Remounting the snout we found the following result on the AIDA rates and hit patterns (Attachment 15 & 16). The rates and hit patterns appear to be the same as it was before bPlast was mounted in the snout. The connector cable of AIDA01 was found to be broken for ASICs 1&2 (3&4 are still connected), and the noise on AIDA04 has increased slightly relative to previous tests.


8. The wave forms of the AIDA modules show regular structure. There are some high frequency 'beats' present in some of the AIDA modules (Attachment 13-14). The waveform of AIDA01 has the pulser signal (25 Hz), but has no noise as ASIC 1&2 is missing.

9. The next test carried out was that all the ribbon cables ground were connected to the separate grounds on the item frame and on the frame carrying the booster cards. The bPlast ribbon cables were also plugged into the booster board. (attachment 17-20).

10. The next test we connect all the ribbon cables to the same ground on the item frame and the ribbon cables were disconnected from the booster cards. (attachment 21 -24).

11. The test thereafter we connect all the grounds together but not grounded to anything, just floating in air. The ribbons were still disconnected from the booster cards. Rates were observed to decreased back to normal levels from the previous grounding configuration. (Attachment 25-28)

12. The final test carried out from the grounding tests was connecting the bPlast ribbon cables with floating air ground to the booster cards mounted around the snout. The rates and wave forms observed are back to normal and transience in some of the wave forms from (Attachment 20-28) have gone away after adjusting the LED and wave form capture threshold from 8900 -> 8000/8200. The rates and wave forms are back to the same point when we started the tests after lunch (Attachment 29-32).  

The next series of tests involved connecting and/or powering the bPlast HV and LIMOs individually to see their input to AIDA. Each of the tests were carried out individually, resetting back to the configuration from (Attachment 29-32, test 12.): 

13. The first test carried out was connecting a LIMO from the TAMEX card to the long side booster card of the bPlast. (Attachment 33-36). The rates, wave form and hit patterns seem to be dramatically affected by simply connecting 1 LIMO to the long side booster card.

14. The second test was connecting the HV supply of the booster card on the short side (right relative to the beam axis) and powering it with the R&S HMP4040 supply. Results are given by (Attachments 37-40). Rates, hit pattern and wave forms change and increase drastically.

15. The third test was simply connecting the booster card HV supply (R&S HMP4040) but not powering it at all. Results are given by (attachment 41-44). Simply connecting the HV supply is introducing a considerable amount of noise into AIDA. (Maybe grounding the supply, or changing its position relative to the DESPEC setup is a next possible test).

16. The fourth test was biasing the SiPMs on the short side booster card ie. right side of the bPlast with the Mesytec module 29.00 V @ 4 uA. The results are given by (attachment 45-48). The rates, hit patterns and wave forms return to more reasonable levels, however, it is clear that biasing the SiPMs is still introducing a great deal of noise into some of the ASICs based on the proximity. eg. aida03 ASIC1. 

17. The fifth and final test of the day was under-biasing the SiPMs of the long side of the bPlast with the Mesytec module 26.80 V @ 19 uA. The results are given by (attachment 1-4 in AIDA tests 16/11/2023 cont.). The rates, hit patterns and wave forms are the same as that which was carried out in test 16.


The tests wrap up with suspicion to the HV supply of the booster cards, whether it is grounded or not and its position in the setup. The grounding of the booster cards is also seen to affect AIDA substantially. Isolating and grounding the ribbon cables has proved to be helpful when biasing the SiPMs as the noise in AIDA is reduced in comparison to previous tests. The wave forms when connecting the HV supply seems to show a 100 kHz signal (HV supply cross-talk?).

Screenshot uploads as I hit the 50 image upload limit.

We restarted the merger (Stop, Setup & Configure, Go, Pause) and then we could restart the DAQ as normal.  Rate is ~500 Hz. 

16.11 The cyclotron and BigRIPS condition are now restored and we have good beam

     Count rate at F11 plastic is ~8 cps

     At F8, they are focued on 41Al (D5 Brho = 7.5235 Tm)

     At F11, they are focused on 40Mg (D8 Brho = 6.3208 Tm)

     Presently around Run R9_19

     3mm Pb is on the exit window of the first MUSIC at F11

     All variable degraders were out (that is not what we intended to have...see next note below)

16.35 The variable degraders were not in the positions we thought.  Now we make it as follows:

     Variable degraders 1.0 mm W (+1 mm Al) and 0.3 mm W (+1 mm Al)

     R9_24 just began

18:00 Beam stopped for stripper foil change

          Moved Pb degrader downstream, from window of MUSIC1 detector to hole of polyethylene shield in front of BRIKEN.

18:12 Stopped AIDA DAQ at run R9_43 (Ge filling will start soon)

R7_45 3mm Pb + 0.5mm W (+1mm Al) only (at start of run) changing to 1.5mm W (+2mm Al)

S O R T    C O M P L E T E ..... Sat Nov 26 16:46:31 2016


 *** ENTRY finish

 *** data items:  261088000 (  98973.71 Hz)
 *** ADC events:   41690396 (  15804.07 Hz)
 *** time warps:          0 (      0.00 Hz)
 *** DSSSD # 1 count:   5823816 old count:   5806214 dt:    343.81 s  LEC rate:  16939.06 Hz
 *** DSSSD # 2 count:   5673289 old count:   5657311 dt:    343.81 s  LEC rate:  16501.24 Hz
 *** DSSSD # 3 count:   2708029 old count:   2701714 dt:    343.81 s  LEC rate:   7876.53 Hz
 *** DSSSD # 4 count:   2583742 old count:   2576481 dt:    343.81 s  LEC rate:   7515.03 Hz
 *** DSSSD # 5 count:   1480052 old count:   1475781 dt:    343.81 s  LEC rate:   4304.85 Hz
 *** DSSSD # 6 count:   3956442 old count:   3945032 dt:    343.81 s  LEC rate:  11507.64 Hz
 *** DSSSD # 1 count:       128 old count:       128 dt:    343.81 s  HEC rate:      0.37 Hz
 *** DSSSD # 2 count:       115 old count:       115 dt:    343.81 s  HEC rate:      0.33 Hz
 *** DSSSD # 3 count:        91 old count:        90 dt:    343.81 s  HEC rate:      0.26 Hz
 *** DSSSD # 4 count:        41 old count:        40 dt:    343.81 s  HEC rate:      0.12 Hz
 *** DSSSD # 5 count:        13 old count:        13 dt:    343.81 s  HEC rate:      0.04 Hz
 *** DSSSD # 6 count:        12 old count:        12 dt:    343.81 s  HEC rate:      0.03 Hz

 *** ENTRY finish ends

S O R T    S T O P P E D ..... Sat Nov 26 16:47:58 2016

The MIDASsort routine implantdecay.f creates "D spectra of LEC (20MeV FSR) and HEC (20GeV FSR)
E_p versus E_n  events with dispersions of 10keV/channel and 10MeV/channel respectively.   

14.15 BigRIPS run number is now 1029

15.22 BigRIPS run number is now 1030

15.36 DSSSD bias & leakage currents OK - see attachments 1 & 2
      FEE64 temperatures OK - see attachment 3

      DAQ continues (RIBF03R1/R20)

      Degrader 3mm Pb fixed + (0.3mm W/1mm Al + 0.5mm W/1mm Al) variable
      
      ASIC settings 2016Nov17-10.50.10

      BNC PB-4 settings 
      Amplitude 90,000
      x5 attenuator IN
      freq 25Hz range
      t_r 50ns, tau_d 50us
      polarity -, int ref, delay MIN, tail pulse

15.43 System-wide checks OK *except* clock status errors from amongst nnaida5, 7, 8, 15 & 16 - bit 2 always set

15.46 Visual scalers - see attachment 4

16.04 Accelerator group wants to change the carbon stripper foil -- beam stop
      Run stop (R20_27 at the end)

16.10 Ambient temperature +25.2 deg C, d.p. +2.6 deg C, RH 23.8%

16.17 BigRIPS run 1031 is junk

16:17 Added 1 mm Al plate to the front of the 3 mm Pb degrader (on the upstream side of PE wall)
      Pb bricks stacked between MUSIC1 and MUSIC2.  
        Not enough time to measure it because of quick foil change
        Basically, about 10 cm thick, and it has a ~7 cm +/- 1 mm window in X, and no cut in Y (it is above and
below MUSIC window)

16:19 Start AIDA run R21.  BRIKEN run started.  BRIKEN Sync issued.

16.22 BigRIPS run 1032

16.26 SyncCheck - see attachment 5

17:01 AIDA merger stopped.  When attempting to stop the Run, the following error is issued:

STATE for nnaida1 returned with an error
error: SOAP http transport timed out after 20000 ms
NONE
error: SOAP http transport timed out after 20000 ms
    while executing
"$transport $procVarName $url $req"
    (procedure "::SOAP::invoke" line 18)
    invoked from within
"::SOAP::invoke ::SOAP::_DataAcquisitionControlClient__GetState"
    ("eval" body line 1)
    invoked from within
"eval ::SOAP::invoke ::SOAP::_DataAcquisitionControlClient__GetState $args"
    (procedure "DataAcquisitionControlClient__GetState" line 1)
    invoked from within
"DataAcquisitionControlClient__GetState"


Going through hardware checks, the check sync errors since baseline gets 23/24 failures  (nnaida6 is still my friend)
      Perform TimeStamp RESYNC -> all can pass the check

17:17 AIDA looks happy now.  R22 started.  

18.16 System-wide checks OK *except* clock status errors from amongst nnaida5, 7, 8, 15 & 16 - bit 2 always set
      and ADC calibration fails nnaida13

18.27 DAQ stops OK
      Soft reset following LN2 refill cycle

18.33 BigRIPS 1034

18.56 DAQ starts (RIBF03R1/R23)

      Degrader (3mm Pb + 1mm Al) fixed + (0.3mm W/1mm Al + 0.5mm W/1mm Al) variable
      
      ASIC settings 2016Nov17-10.50.10

      BNC PB-4 settings 
      Amplitude 90,000
      x5 attenuator IN
      freq 25Hz range
      t_r 50ns, tau_d 50us

19.02 BRIKEN issue correlation scaler reset request
      SyncCheck OK - see attachment 6

      Visual scaler, 1.8.L & 1.8.W spectra, good events stats - see attachments 7-12

1.8.L pulser peak widths

Peak width =    66.76+/-  0.7221
Peak width =   178.72+/-  2.5140
Peak width =    75.37+/-  0.9037
Peak width =    76.21+/-  0.6630
Peak width =    70.19+/-  0.6772
Peak width =    66.65+/-  0.8516
Peak width =    91.90+/-  0.8132
Peak width =    69.90+/-  1.169
Peak width =    73.73+/-  0.6390
Peak width =    73.01+/-  0.7860
Peak width =    81.35+/-  0.7306
Peak width =    84.03+/-  0.8589

Peak width =    77.27+/-  1.2263
Peak width =    78.92+/-  1.2343
Peak width =    76.99+/-  1.1963
Peak width =    68.85+/-  1.7060
Peak width =    82.37+/-  1.2500
Peak width =    84.83+/-  1.3169
Peak width =    90.84+/-  1.4190
Peak width =    89.81+/-  1.3821
Peak width =   100.33+/-  1.6409
Peak width =    89.42+/-  1.4682
Peak width =    97.52+/-  1.5855
Peak width =    64.02+/-  1.0206

19.19 DAQ stops 
      LN2 refill transient?

19.28 soft reset
      DAQ starts (RIBF03R1/R24)

      Degrader (3mm Pb + 1mm Al) fixed + (0.3mm W/1mm Al + 0.5mm W/1mm Al) variable
      
      ASIC settings 2016Nov17-10.50.10

      BNC PB-4 settings 
      Amplitude 90,000
      x5 attenuator IN
      freq 25Hz range
      t_r 50ns, tau_d 50us

19.34 BigRIPS file 1035

19.50 R24_3 AIDA ADC & disc data synchronised - see attachments 13 & 14

21:11 BRIKEN DAQ was not working properly from the last ~half hour (unrelated to AIDA), and had to be restarted and we
also had to send a couple of synchronization pulses.

      R25_0: Started new run once BRIKEN was running and all DAQs synchronized

21.41 BigRIPS file 1037

22.14 Stop DAQ to change degrader

22.16 DAQ starts (RIBF03R1/R26)

      Degrader (3mm Pb + 1mm Al) fixed + (0.3mm W/1mm Al + 1.0mm W/1mm Al) variable
      
      ASIC settings 2016Nov17-10.50.10

      BNC PB-4 settings 
      Amplitude 90,000
      x5 attenuator IN
      freq 25Hz range
      t_r 50ns, tau_d 50us

22.36 BRIKEN DAQ restarted
      re-sync issued
      AIDA data file R26_3
      BRIKEN data file 039

22.42 BigRIPS file 1038
      AIDA data file R26_4

09.13 DAQ run R3 ends OK (final file R3_9)
      
      ASIC settings 2017Mar27-16.12.39
      slow comparator 100 (dec)
      LEC/MEC fast comparator 255 (dec)
      BNC PB-4 pulser OFF

09.20 Biases & leakage currents OK - see attachments 1 & 2
      Ambient temperature +23.8 deg C, d.p. -3.5 deg C, RH 15.7%
      Julabo FL11006 set point +20 deg C actual +20.0 deg C

09.32 FEE64 temperatures OK - see attachment 3

09.39 System-wide checks OK except
      ADC calibration fails nnaida21 & 23
      SYNC errors not counted since baseline
      SYNC pulses received
      see attachments 4-8

13.36 PE16/R1

      Pulser walkthough 

      BNC PB-4 settings 
      Amplitude 90,000 - 10,000 @ 10,000 step
      x5 attenuator IN
      t_r 50ns, tau_d 50us
      polarity -
      rate ~250Hz 
      delay MIN, tail pulse

      ASIC settings 2017Mar27-16.12.39

      see attachment 9

13.52 PE16/R2

      Pulser walkthough 

      BNC PB-4 settings 
      Amplitude 10,000 - 2,000 @ 2,000 step

      see attachment 10

14.03 PE16/R3

      Pulser walkthough 

      BNC PB-4 settings 
      Amplitude 2,000 - 8,000 @ 2,000 step, 10,000 - 50,000 @ 10,000 step

      see attachment 11

20.30 System-wide checks
      All OK *except* clock status - nnaida1 global clocks failed 6 - see attachment 12

20.35 PE16/R4

      Background

      BNC PB-4 OFF

      ASIC settings 2017Mar27-16.12.39

      MACB master mode 5 (external 50MHz clock from Tektronix AFG3102C)

20.40 Biases & leakage currents OK - see attachments 13 & 14
      Ambient temperature +23.6 deg C, d.p. -3.2 deg C, RH 16.6%
      Julabo FL11006 set point +20 deg C actual +20.0 deg C
      FEE64 temperatures OK - see attachment 15

20.50 PE16/R4 ends OK

08.15 DAQ found stalled

      Soft reset OK

      DSSSD bias & leakage currents OK - see attachments 1 & 2
      FEE64 temperatures OK - see attachment 3

      Ambient temperature +25.0 deg C, d.p. -0.2 deg C, RH 19.2%

      System-wide checks OK *except* clock status errors for naida5, 7, 8, 15, 16

      ASIC settings 2016Nov07-23.03.06

      BNC PB-4 
      amplitude 90,000
      frequency 25Hz range

08.30 AIDA moved into (CH2)n moderator

08.46 Start DAQ (R141)
      BNC PB_4 pulser OFF
      Background run with AIDA inside (CH2)n moderator

      Statistics - good events - attachment 4

      per FEE64 1.8.W spectra - see attachments 5-8

09.00 DAQ stops OK
      System wide checks OK

      BNC PB-4 pulser ON
      amplitude 90,000
      x5 attenuator IN
      t_r 50ns tau_d 50us
      polarity -, delay MIN, tail pulse
      frequency 25Hz range

14.51 Bias and leakage voltages good (Attachments 9 and 10)

16.30 Ca beam delivered to F11 around 16:30.
      PB shield still in place up stream of AIDA.
      DAQ running in no storage mode. Leakage currents @ 16:40 in attachments 11+12.

18.28 DAQ stopped during LN2 fill cycle. Soft reset completed. 
      Will wait 15mins for cycle to complete and the start new run.

18.34 Ca beam stopped.

19.07 Run R146 started on no storage mode.

20.11 DAQ found stopped.
      Unable to perform soft reset. Power cycling FEEs.

00.40-02.30 Discussion with PJCS
 
      Confirm both NIM bin voltages OK

      Move master MACB to lower NIM bin (with BNC PB_4, Ortec 433, 2x CAEN N1419B, 1x CAEN N1419)
       successful ReSYNC
       system-wide checks clock test fails from zero to all of the following FEE64s - nnaida7, 8, 15 & 16
       SYNC count test OK *except* nnaida19 which has greater number of SYNC pulses
       online analysis indicates nnaida19 ADC data not synchronised with other FEE64s by ~200ms

      Replace master MACB rev B mode 0 with MACB module #13 mode 5 (external clock 50MHz TTL)
      Move MACB module 2 from upper NIM bin to lower NIM bin
      Swap nnaida19/port1 <-> nnaida20/port2 

      Power cycle FEE64s and restart
      System wide checks fail - see attachments 1-4

      Re-seat HDMI cabling master MACB -> MACB modules 3-6
      System wide checks fail - see attachments 7-10

      Swap ports of 2x HDMI cables from master MACB
      Power cycle FEE64s
      Re_SYNC & system wide checks fail - see attachments 11-15

10.20 ReSYNC fails for all TS_SYNC_PHASE settings 0-3

      DK checks MACB mode settings
      master -> 5
      module #2 2
      module #3 2
      modules #4-11 3

      Check HDMI cable seating nnaida6 to master MACB

      No change - ReSYNC fails, system wide checks fail as before

      Per PJCS e-mail check MACB settings per https://elog.ph.ed.ac.uk/AIDA/258
      and change MACB module # 7 from mode 3 to mode 2. MACB settings are now

      MACB #  1  2  3  4  5  6  7  8  9 10 11      spare 1   spare 2
      Mode    5  2  3  3  3  3  2  3  3  3  3
      Rev B      y  y                              50MHz?    y

      *BUT* remember the system has been in the previous state since Elog 258
      abd has been working OK

      No change - ReSYNC fails, system wide checks fail as before

      Check 50MHz TTL external clock signal and observe transients and width changes
      in clock signal - see attachment 16
      This may not be *the* explanation of current problems but I doubt the the hardware
      will be 'happy' with it either

      JAR cycles NIM signal through NIM-TTL signal converter several times to produce
      better (no transients or width changes) clock signal with c. 3.2V amplitude

      Power cycle and restart FEE64s
      No change - ReSYNC and system wide checks fail - see attachments 17-21

12.40 Re-checked HDMI cabling 
      found master MACB port 1 -> MACB #7 next, port 2 -> MACB #3 next
      change to master MACB port 1 -> MACB #3 next, port 2 -> MACB #7 next
      Power cycle FEE64s

      ReSYNC partial failure (left side OK, right side of tree fails), system wide checks fail - see attachments
22-26

13.05 Swap HDMI cables from master MACB to parents, i.e. HDMI cable master port 1 to MACB #3 next
      changes to master port 2 to MACB #7 next 

      ReSYNC and system wide checks fail - see attachments 30-34
      

13.35 Swapped HDMI cables from master MACB to MACB #3 & #7
      for HDMI cables from MACB #7 ports 1 & 2 to MACB modules #8 & #9

      ReSYNC and stsrem wide test failures - see attachments 1-5

15.00 Swap HDMI cable from MACB #2 port 1 to MACB #3 next

      ReSYNC and system wide test fails - see attachments 6-10

      *Conclusion* all of HDMI cables between HDMI cable from nnaida6 and master MACB
      have now been swapped for other HDMI cables between MACB # 7 and MACB # 8, 9, 10
      but we still observe ReSYNC and clock issues 

16.05 CG points out that I have misinterpreted Elog 258 - switch back MAC
      mode settings to the following

      MACB #  1  2  3  4  5  6  7  8  9 10 11      spare 1   spare 2
      Mode    5  2  2  3  3  3  3  3  3  3  3
      Rev B      y  y                              50MHz?    y

      FEE64 power cycle

      ReSYNC and system wide fails - see attachments 11-16


16,50 Re-considering options
      Install MACB #11 (rev B) mode 0
      Will attempt to use 25MHz correlation scaler clock NIM output from master MACB to BRIKEN+RIBFDAQ

      Power cycle FEE64s

      ReSYNC OK
      System wide checks OK but some issues remain - see attachments 17-25

17.10 DAQ starts
      Writing to disk file R115, merge rate 0.9M data items/, TapeServer ~7Mb/s

17.20 Analysis of R115_1 confirms ADC data synchronised - see attachment 26

17.25 MERGE stats look OK - see attachments 27-29

17.35 System wide tests SYNC errors & SYNC pulses OK

17.38 DAQ stalled - manual start of ORNL clover LN2 fill cycle by Nishimura-san
      Most recent file R115_5 last accessed 17.38

      DAQ stop OK

      Disable histogram and data transfer #1 
      DAQ RESET
      DAQ SETUP
      Restart merger and TapeServer
      Enable histogram and data transfer #1 

17.47 DAQ start (R116)

17.58 DAQ stopped again at end of fill cycle.
      1. Disable histogram and data transfer #1
      2. DAQ RESET
      3. DAQ SETUP
      4. Restart merger and TapeServer
      5. Enable histogram and data transfer #1 
      Had to repeat 1-5 multiple times to get all links working with the merger. R117 created during this (empty).

18.08 Run R118 started.

18.45 TD changing things for runs R119-R120.

18.50 Run R121 started.
      First few minutes are pulser run 30-10,000 @ 250Hz on coarse dial.

18.54 Beam ON.
      Continuing R121. Pb shield immediately after final MUSIC detector.

21.35 DAQ continues OK
      Most recent file R121_30

      All system-wide tests OK *but* note nnaida5 now fails clock status test in addition to combinations of
nnaida7/8/15/16
      Merge/Tapeserver desktop, Merge statistics 
      - see attachments 30-36

21.45 R121_32 ADC data synchronised

Overnight

Phong Vi completed the pulser walkthrough interrupted earlier this evening.
BNC PB-4 amplitude settings 30,000 - 20,000 @ 10,000 step, 8,000-2,000 @ 2,000 step  
The data is in files R121_62, _63 and _64 (which have been copied to d05 for further analysis).

DAQ start (R22) failed - merger remained in 'want first sync' state, no output to TapeServer -> soft reset OK

start 20.07
stop
AIDA filename R23
BRIKEN filename 161109_12012_767778Ni_23
BigRIPS filename 
ASIC settings 2016Nov07_23.03.06
DSSSD bias & leakage currents OK see attachments 1 & 2
Degrader 5.4mm Al from start of run
F11 rate 450Hz
BigRIPS setting 76-78Ni

N.B. there are a number of correlation resets at the start of R23

Offline analysis of R23_2

 *** DSSSD # 1 count:       297 old count:       146 dt:      1.03 s  HEC rate:    146.07 Hz
 *** DSSSD # 2 count:       259 old count:       126 dt:      1.03 s  HEC rate:    128.66 Hz
 *** DSSSD # 3 count:       281 old count:       141 dt:      1.03 s  HEC rate:    135.43 Hz
 *** DSSSD # 4 count:       178 old count:        86 dt:      1.03 s  HEC rate:     89.00 Hz
 *** DSSSD # 5 count:        30 old count:        13 dt:      1.03 s  HEC rate:     16.45 Hz
 *** DSSSD # 6 count:         3 old count:         2 dt:      1.03 s  HEC rate:      0.97 Hz

00.04 R23 continuing.
      F5 C wedge in. F7 empty. F11 now empty. All variable degraders in place.
      F11 plastic rate ~400-500Hz.
      Change made around start of R23_70.
      Offline implant rates shown below for R23_72:
      *** DSSSD # 1 count:       562 old count:       414 dt:      1.06 s  HEC rate:    139.98 Hz
      *** DSSSD # 2 count:       507 old count:       372 dt:      1.06 s  HEC rate:    127.68 Hz
      *** DSSSD # 3 count:       552 old count:       404 dt:      1.06 s  HEC rate:    139.98 Hz
      *** DSSSD # 4 count:       350 old count:       262 dt:      1.06 s  HEC rate:     83.23 Hz
      *** DSSSD # 5 count:        46 old count:        37 dt:      1.06 s  HEC rate:      8.51 Hz
      *** DSSSD # 6 count:         4 old count:         3 dt:      1.06 s  HEC rate:      0.95 Hz

00:34 (corresponds to the beginning of R23_77) Remove 1 mm of Al variable degrader at F11 (now total Al is
2.2+2.2 = 4.4 mm)
      *** DSSSD # 1 count:       715 old count:       579 dt:      5.00 s  HEC rate:    142.96 Hz
      *** DSSSD # 2 count:       619 old count:       511 dt:      5.00 s  HEC rate:    123.77 Hz
      *** DSSSD # 3 count:       717 old count:       579 dt:      5.00 s  HEC rate:    143.36 Hz
      *** DSSSD # 4 count:       714 old count:       574 dt:      5.00 s  HEC rate:    142.76 Hz
      *** DSSSD # 5 count:       493 old count:       398 dt:      5.00 s  HEC rate:     98.57 Hz
      *** DSSSD # 6 count:        93 old count:        81 dt:      5.00 s  HEC rate:     18.59 Hz

00:43 R23_80 biases are shown as attachments 3 and 4

01.08 F11 C target installed.
      Corresponds to start of R23_90.
01.09 Final 4.4mm of variable Al degrader removed by start of R23_91.
      Implant rates sensible.

02.12 F5 C target removed. F7 CH2 target put in. F11 C target remains in place.
      Rate reduction during R23_115 as beam components changed.     
      implant rate >0 by start of R23_116 and BRIKEN run 30.
      F11 plastic rate ~500Hz.


3:15 Takechi group changes the condition.  This is beginning R23_132 
      F5 carbon, F7 empty.
      F11 pllastic rate is 450 cps
      F11 carbon remains in.

06.20 R23 stopped in anticipation of LN2 fill cycle.
      Takechi group changed setting > F5 C out,  F7 CH2 out, FF C in.
      All variable degraders in.
      
06.30 Leakage currents attachments 5+6.

> 15.20 DAQ histogramming & data transfer #1 enabled
>       Merger configured, started, input paused
>       Following DAQ GO nnaida9 data transfer 'X' nnaida19 histogramming 'H' disappear - see attachments 1-7
> 
>       Workaround suggested by https://elog.ph.ed.ac.uk/AIDA/230 appear not to work
> 

########### The reason being that it is not the solution to this problem. When the X will not stay it seems to be because the FEE64 cannot open a 
connection to the Server. -------- Entry 230 was to help when the rates in the fastest  part of the system caused one of the FEE64 to be blocked for 
control access  while waiting for the slowest to produce data. Judging by the next entry in this diary I think this is now understood but .... 'belt and 
braces' seems a good idea ;-)

I've not seen the 'H' disappear but it could similarly mean that the enabling of Histogramming is failing. Perhaps check the Options settings for this 
FEE64 to see that the Histogram quantity and size parameters are the same as another FEE64.

> 
> 16.25 Resolved data transfer issue
>       nnaida9 producing SYNCs but merger data queue blocked
>       rebooted aidas1
> 
>       nnaida19 histogramming issue remains
> 
> 17:50 6 DSSD insalled
> 
>       From front to back of stack:
>         
>       DSSD 1 = 3131-9
>            2 = 3058-25 (rotated 90deg w.r.t. other detectors - p-strips horizontal and n-strips vertical)
>            3 = 2998-23
>            4 = 3058-5
>            5 = 3058-6
>            6 = 3058-7
> 
>       HV mapping (-ve bias):
> 
>         DSSD     Braid      Core
>           1     nnaida20   nnaida17
>           2     nnaida19   nnaida18
>           3     nnaida12   nnaida14
>           4     nnaida11   nnaida13
>           5     nnaida4    nnaida6
>           6     nnaida3    nnaida5
> 
> 18.55 Change ASIC settings 
> 
>       nnaida18, nnaida21 positive -> negative input
>                          diode link threshold 0xca -> 0xbf
>                          LED settings negative -> positive, threshold 7200 -> 9000
> 
>       nnaida19, nnaida24 negative -> positive input
>                          diode link threshold 0x11 -> 0x23
>                         LED settings positive -> negative, threshold 9000 -> 7200
> 
>       Saved new settings to DB key 2016May28-18.52.07
>       Saved new DB key to Options

MSL type BB18(DS)-1000 serial 2998-22
Bias +200V, I_L +8.110uA, ambient temperature +20.2 deg C

DSSSD - AIDA adaptor PCB cabling

4 off LH Coupler (Kapton PCB, 5cm), 2x 34-way Samtec ribbon cable (45cm), RH coupler(Kapton PCB, 10cm)
 + 3M 1245 1.4mil copper foil screen ribbon cables + RH coupler only (i.e. not LH coupler)
 + drain wires -> gold-plated Lemo-00 test input connectors 

nnaida 11 & 12 AIDA adaptor PCB rev B
nnaida 13 & 14 AIDA adaptor PCB rev C (LK1 fitted) 

Standard ASIC settings
 nnaida 11 & 12 - negative input
 nnaida 13 & 14 - positive input

Pulser BNC PB-5 
Fall time 1.0ms
Rate 100Hz
Delay 250ns
Ampl 5.00000V
Polarity +
Pulse top Tail
Atten 10x
Clamp ON
- polarity via Cooknell SA1 Summing Amplifier

Pulser peak width (ch FWHM) from spectra 2.*.L

nnaida11

Shaping time(us)

0.5  1   2   4   8   8**

80   83  76  82  87  82
82   84  77  82  87  83
82   80  77  82  79  75
75   77  73  77  91  87
79   81  76  78  90  88
79   81  76  80  90  85
72   77  73  83 100  98
82   81  79  88  99  94
81   81  79  86  94  96
84   84  77  86  93  94
76   87 100 325 557 828*
86   83  84 100 119 121*
83   83  82  92 108 106*
78   77  83  85 110 111*
98   81  96 105 119 123*
89   89  93 104 109 108*

81.6 81.8 81.3 82.4 91.0 88.2 mean
6.0  3.4  8.2  3.5  6.1  7.3  std dev

nnaida12

0.5  1   2   4   8   8**

72   79  70  68  65  62
77   81  74  73  70  70
81   85  77  76  70  70
66   74  64  63  62  63
73   79  71  69  63  65
75   83  73  70  64  65
65   74  65  64  63  63
70   74  68  66  65  65
73   79  69  68  64  65
78   80  76  72  67  65
61   72  61  60  61  62
69   77  68  61  63  63
74   80  71  68  66  66
64   69  63  61  61  62
74   83  72  67  58  57
75   82  72  70  62  64

71.7 78.2 69.6 67.3 64.0 64.2
5.5  4.5  4.6  4.6  3.2  3.1

nnaida13

0.5  1   2   4   8   8**

71   72  72  63  54  53
75   80  76  64  56  54
77   86  83  67  56  56
61   66  60  57  52  51
69   74  71  62  55  52
74   77  75  64  56  53
59   65  60  57  53  52
66   70  68  60  55  54
66   65  67  60  53  53
72   75  75  59  52  53
58   63  59  54  50  51
62   65  64  57  52  52
68   75  68  60  55  51
55   59  55  52  51  49
61   68  65  57  49  46
71   74  72  63  51  49

66.6 70.9 68.1 59.8 53.1 51.8
6.6  7.0  7.5  4.0  2.2  2.4

nnaida14

0.5  1   2   4   8   8**

68   76  68  64  56  54
69   76  73  48  56  51
68   77  72  66  56  53
67   75  70  66  54  52
68   77  70  57  54  49
69   77  71  66  56  53
65   76  69  65  56  55
66   75  67  65  54  54
67   76  68  65  57  53
70   79  74  67  46  48
66   76  68  64  53  53
65   75  68  64  56  54
69   77  70  66  52  56
70   81  73  69  57  54
81   96  82  74  54  50
74   84  78  71  54  52

68.9 78.3 71.3 64.8 54.4 52.6
3.9  5.3  4.0  5.8  2.7  2.2

* outlier ignored
** ground links LK3 & LK7 fitted to nnaida11-14 AIDA adaptor PCBs

electronic noise 

n+n strips ~64 ch FWHM ~ 0.7 * 64 ~ 45keV FWHM
=> slow comparator threshold (5x sigma) ~ 5 * 45 / 2.355 ~ 96keV

p+n strips ~ 54 ch FWHM ~ 0.7 * 54 ~ 38keV FWHM
=> slow comparator threshold (5x sigma) ~ 5 * 38 / 2.355 ~ 81keV

Attachments 1-30 per FEE64 ASIC #1 waveforms

Note - nnaida19 and nnaida26 disabled
       nnaida11, nnaida17 and nnaida29 ADC calibration failed => no waveforms

10.05 Recirculating chiller on
      FEE power on
      Detector bias on - ambient temp +23 deg  C - see attachments 1-2

20.30 Noisy fast discriminator channels masked in all nnaida to bring 'AIDA discriminator' rate to <~5kHz.
      Slow and fast comparator thresholds at 16 (decimal).
      Settings saved to 2016May14-13.57.38 DB key.