AIDA GELINA BRIKEN nToF CRIB ISOLDE CIRCE nTOFCapture DESPEC DTAS EDI_PSA 179Ta CARME StellarModelling DCF K40
  AIDA, Page 14 of 46  ELOG logo
ID Date Author Subjectdown
  675   Thu Oct 19 01:40:35 2017 TD, OHThursday 19 October
09.40 DAQ continues OK
      File /TapeData/Oct17/R1_280

      BNC PB-4 Pulser frequency switched from 250Hz to 25Hz range

09:54 ASIC Temperatures - Attachment 1
      Bias and leakage currents ok - Attachments 2 & 3
      Statistics - Attachment 4

10:19 Output of analysis of R1_291 - Attachment 5

11:02 Pulser widths measured before changing jumpers (In log book)
      DAQ stopped on Run R1_304

11:31 All field plane jumpers removed (Jumpers 1&3)
      System wide checks ok
      ASIC load check ok

11:37 DAQ started online only
      Statistics - Attachment 6
      FEE temperatures - Attachment 7

11:46 Layout 1 - Attachments 8 & 9
      Layout 2 - attachments 10

13:38 Layouts 3 - Attachment 11
      Layout 4 - Attachment 12
      Pulser widths measured using 1.8.L spectra.
      Most channels show an increase in noise with the FWHM increased by ~5-10 channels
      (Recorded in log book)

13:55 Layout 7 p-side waveforms - Attachments 13 & 14
      Layout 8 n-side waveforms - Attachments 15 & 16
      For comparison with jumpers on see yesterday's elog entry: https://elog.ph.ed.ac.uk/AIDA/674

14:02 DAQ stopped

14:23 PCB ground plane jumper removed from all adapter boards (Jumper 2)

      Bias and leakage currents ok T = 23.0 DP = +8.8 H = 38.7% - Attachment 17
      System wide checks all ok
      ASIC load check ok

      DAQ Started

14:44 FEE temperatures all ok - Attachment 18
      Statistics - Attachment 19

14:54 Layout 1 - Attachment 20 & 21
      Layout 2 - Attachment 22

15:17 Layout 3 p-side pulser - Attachment 23
      Layout 4 n-side pulser - Attachment 24

      Pulser widths measured using 1.8.L spectra

      In comparison with just having the FP jumpers removed for channels that were not noisy before they show no
      to only minor increases in noise.

      However channels that were previously noisy with all jumpers on show drastic increases in the amount of
      noise. Increases in the FWHM of up to 80ch

13:55 Layout 7 p-side waveforms - Attachments 25 & 26
      Layout 8 n-side waveforms - Attachments 27 & 28

      DAQ Stopped

16:15 Detector bias turned off as replacing the jumpers is challenging

16:55 All jumpers back on. I advise starting with all on the new boards tomorrow and removing if needed.
      Pain to put back on when mounted with cables.

16:59 System wide checks ok
      Bias back on and leakage currents ok - Attachment 29

17:09 Statistics - Attachment 30
      FEE temperatures - Attachment 31

      By putting the jumpers back the statistics appear to have recovered to a similar level to this morning

17:25 FEEs powered down to do a power cycle for Patrick

17:50 FEEs powered up

18:00 Same javascript errors as yesterday when setting up DAQ
      System wide checks all ok
      FEE Temperatures ok
      
18:06 DAQ started
      Statistics similar to before power cycle - Attachment 32
      Layout 1 looks good - Attachments 33 & 34

18:14 DAQ stopped

18:16 DAQ Started
      Writing to R2 in /TapeData/Oct17/
      Writing at 11Mb/s

18:56 Statistics - Attachment 35
  676   Thu Oct 19 11:32:29 2017 TD, OHThursday 19 October
> 
> 09.40 DAQ continues OK
>       File /TapeData/Oct17/R1_280
> 
>       BNC PB-4 Pulser frequency switched from 250Hz to 25Hz range
> 
> 09:54 ASIC Temperatures - Attachment 1
>       Bias and leakage currents ok - Attachments 2 & 3
>       Statistics - Attachment 4
> 
> 10:19 Output of analysis of R1_291 - Attachment 5
> 
> 11:02 Pulser widths measured before changing jumpers (In log book)
>       DAQ stopped on Run R1_304
> 
> 11:31 All field plane jumpers removed (Jumpers 1&3)
>       System wide checks ok
>       ASIC load check ok
> 
> 11:37 DAQ started online only
>       Statistics - Attachment 6
>       FEE temperatures - Attachment 7
> 
> 11:46 Layout 1 - Attachments 8 & 9
>       Layout 2 - attachments 10
> 
> 13:38 Layouts 3 - Attachment 11
>       Layout 4 - Attachment 12
>       Pulser widths measured using 1.8.L spectra.
>       Most channels show an increase in noise with the FWHM increased by ~5-10 channels
>       (Recorded in log book)
> 
> 13:55 Layout 7 p-side waveforms - Attachments 13 & 14
>       Layout 8 n-side waveforms - Attachments 15 & 16
>       For comparison with jumpers on see yesterday's elog entry: https://elog.ph.ed.ac.uk/AIDA/674
> 
> 14:02 DAQ stopped
> 
> 14:23 PCB ground plane jumper removed from all adapter boards (Jumper 2)
> 
>       Bias and leakage currents ok T = 23.0 DP = +8.8 H = 38.7% - Attachment 17
>       System wide checks all ok
>       ASIC load check ok
> 
>       DAQ Started
> 
> 14:44 FEE temperatures all ok - Attachment 18
>       Statistics - Attachment 19
> 
> 14:54 Layout 1 - Attachment 20 & 21
>       Layout 2 - Attachment 22
> 
> 15:17 Layout 3 p-side pulser - Attachment 23
>       Layout 4 n-side pulser - Attachment 24
> 
>       Pulser widths measured using 1.8.L spectra
> 
>       In comparison with just having the FP jumpers removed for channels that were not noisy before they show no
>       to only minor increases in noise.
> 
>       However channels that were previously noisy with all jumpers on show drastic increases in the amount of
>       noise. Increases in the FWHM of up to 80ch
> 
> 13:55 Layout 7 p-side waveforms - Attachments 25 & 26
>       Layout 8 n-side waveforms - Attachments 27 & 28
> 
>       DAQ Stopped
> 
> 16:15 Detector bias turned off as replacing the jumpers is challenging
> 
> 16:55 All jumpers back on. I advise starting with all on the new boards tomorrow and removing if needed.
>       Pain to put back on when mounted with cables.
> 
> 16:59 System wide checks ok
>       Bias back on and leakage currents ok - Attachment 29
> 
> 17:09 Statistics - Attachment 30
>       FEE temperatures - Attachment 31
> 
>       By putting the jumpers back the statistics appear to have recovered to a similar level to this morning
> 
> 17:25 FEEs powered down to do a power cycle for Patrick
> 
> 17:50 FEEs powered up
> 
> 18:00 Same javascript errors as yesterday when setting up DAQ
>       System wide checks all ok
>       FEE Temperatures ok
>       
> 18:06 DAQ started
>       Statistics similar to before power cycle - Attachment 32
>       Layout 1 looks good - Attachments 33 & 34
> 
> 18:14 DAQ stopped
> 
> 18:16 DAQ Started
>       Writing to R2 in /TapeData/Oct17/
>       Writing at 11Mb/s
> 
> 18:56 Statistics - Attachment 35
Please could you repeat the power cycle and this time turn all the FEE64s at once. The error I am looking to solve occurs ( so it is believed ) when all 24 request access to the server together.
  910   Thu Oct 19 10:39:20 2023 NHThursday 19 October
Water Temp: 20 C - Flow felt on pipe
AIDA interlock OVERRIDE 

One USB Hub for the FEE64 TTYs was unplugged on cable tray, replugged in
 (may fix Pi_Monitor)

Bias DSSD (Ch 3) 
Leakage current stays at 17 uA during ramp up. At 150 V it quickly drops back to 6 uA
 Fig 1

Current FEE mapping
p+n aida09 aida01 aida10
    aida11 aida03 aida12

n+n aida02 aida04

Unused aida06 aida08

Due to merger need 8 FEEs 1-8 to merge properly will temporarily renumber for 1 DSSSD test
 - Will revert to this numbering for experiment!

Power up with unchanged configuration to test

Fee Temps OK Figure 2

Start DAQ at 0x64 threshold (1 MeV)
 Most channels 0 rate (expected)
 ASIC01 of AIDA4 very hot 
 2 channels in aida10 very hot
 Figure 3

Pulser OFF and only connected to aida11 aida03 aida12
 LOCAL operation at present 10V/10X level, positive tail, 25 Hz

STOP and Power off to renumber 

New mapping for now:

p+n aida05 aida01 aida06
    aida07 aida03 aida08

n+n aida02 aida04

aida09 ---> aida05
aida10 ---> aida06
aida11 ---> aida07
aida12 ---> aida08

-

Backup dhcpd.conf -> dhcpd.conf231019
Update to only first 8 fees
only turn on Relay 1

Update MIDAS Tcl
/MIDAS/config/TclHttpd/aidas-gsi@8015/startup.Tcl
list aida01... aida08

new folder
/home/npg/LayOut/GSI_triple_test_renumber

copy to /tmp

-

Reboot MIDAS and Power on Relay 1
Power OFF
Reboot dhcp!

Anydesk Connection Lost??

Make new DB key 2023Oct19-13.46.30
Copy aida01/CONTENTS (p+n) to aida06 and aida08 
Cannot update Options http://localhost:8015/AIDA/Options/Options.tml ? Error 500
Figure 4
Load settings manually and check-load ASIC
TODO: Manually change files, or?

GO

ADC items + rates figures 5, 6

Restart Merger
xfer Links (bad)
Netvar -> Inquire Registers
NetVar.MERGE.RunOptions WRITE 1

Merger now shows xfer Links => Merger
Merger GO

Open file BG18OCT23  R1

STOP DAQ
Data Xfer #1 Enable
GO DAQ

See merger links all GSI_triple_test_renumber
Enable output to data storage
xfer Links => Merger => storage

See tape rate: 3 MB/s (!)

Also start MBS on x86l-119 (new AIDA FDR) and try MBS relay
rate seen in MBS

Figure 8 - Accumulated statistics for ca 3 hours
 Figs 9, 10 - ADC spectra

System turned off and DSSSD biased down for end of work day, due to water issue
  571   Thu May 18 02:16:05 2017 CB, TD, OHThursday 18 May
10.10 DAQ continues OK 
      Current file May2017/R10_346

      ASIC settings 2017Mar27-16.12.39 *except*
      slow comparator 0x0a
      LEC/MEC fast comparator 0xff

      Detector biases & leakage currents OK - see attachments 1 & 2
      FEE64 Temperatures OK - see attachment 3
      'good events' statistics OK - see attachment 4
      No warnings/errors reported by merger since DAQ GO - see attachment 5

      *all* system wide checks OK

10.20 E17/F11 ambient temperature +24.3 deg C, RH 39.0%, d.p. +9.3 deg C
      Julabo FL11006 set point +20 deg C, actual +20.0 deg C, water level OK (c. 65%)

10.25 DAQ stops OK
      Current file May2017/R13_294

      Files May2017/R13* *deleted* 

      ASIC settings 2017Mar27-16.12.39 *except*
      slow comparator 0x0a
      LEC/MEC fast comparator 0xff

      BNC PB-4 settings 
      Amplitude 90,000
      x5 attenuator IN
      t_r 50ns, tau_d 50us
      polarity -
      rate 250Hz range
      delay MIN, tail pulse

      Check ASIC Control x2
      Zero all spectra

10.30 DAQ starts
      File May2017/R14

17.34 DAQ stops OK
      Current file May2017/R14_113

      Files May2017/R14* *deleted* 

      ASIC settings 2017Mar27-16.12.39 *except*
      slow comparator 0x0a
      LEC/MEC fast comparator 0xff

      BNC PB-4 settings 
      Amplitude 90,000
      x5 attenuator IN
      t_r 50ns, tau_d 50us
      polarity -
      rate 250Hz range
      delay MIN, tail pulse

      Check ASIC Control
      Zero all spectra

      *all* system wide checks OK

17.37 DAQ starts
      File May2017/R15

      Detector biases & leakage currents OK - see attachments 6 & 7
      FEE64 Temperatures OK - see attachment 8
      good events statistics - higher rates for several FEE64s - due to addition of system consoles? - see
attachment 9
      No warnings/errors reported by merger since DAQ GO - ~ +30% data rate - see attachment 10
  154   Thu Feb 18 10:23:48 2016 TDThursday 18 February
MSL type BB18(DS)-1000 serial 2998-22
Bias +200V, I_L +=6.200uA, ambient temperature +20.1 deg C
 
DSSSD - AIDA adaptor PCB cabling
 
4 off LH Coupler (Kapton PCB, 5cm), 2x 34-way Samtec ribbon cable (45cm), RH coupler(Kapton PCB, 10cm)
 + 3M 1245 1.4mil copper foil screen ribbon cables + RH coupler only (i.e. not LH coupler)
 + drain wires -> gold-plated Lemo-00 test input connectors 
 
nnaida 11 & 12 AIDA adaptor PCB rev B
nnaida 13 & 14 AIDA adaptor PCB rev C (LK1 fitted) 
ground links LK3 & LK7 fitted to nnaida11-14 AIDA adaptor PCBs

Heavy duty copper cable connects copper front end frames of FEE modules
Nitto 5011N conductive gasket between FEE module and front end frames
 
Standard ASIC settings
 nnaida 11 & 12 - negative input
 nnaida 13 & 14 - positive input
 
Pulser BNC PB-5 
Fall time 1.0ms
Rate 100Hz
Delay 250ns
Ampl 5.00000V
Polarity +
Pulse top Tail
Atten 10x
Clamp ON
- polarity via Cooknell SA1 Summing Amplifier
 
207Bi source, approx centred on DSSSD, approx 3cm from DSSSD
  
File R30
shaping time 8uS
slow comparator 6 (dec)
start: 10.21 stop: 15.09
spectra saved to disk 16.10 BST (sic)
Pulser OFF

see attachments 1-4 (stat & rate hit patterns)

File R33
shaping time 8uS
slow comparator 5 (dec)
start: 16.03 stop: 17.44
spectra saved to disk 18.45 BST (sic)
Pulser OFF

Connect DSSSD-AIDA adaptor PCB screened cabling drain wires to adaptor PCB
mounting holes and secure with M3 socket bolts. With introduction of conductive
gasket should be equivalent to previous grounding via crocodile clips and gold-plated
Lemo-00 test input connectors.
 
18.19 Bias +200V, I_L +=6.760uA, ambient temperature +20.2 deg C

File R34
shaping time 8uS
slow comparator 8 (dec)
start: 18.34 stop: 10.19 19.2.16
spectra saved to disk 11.20 BST (sic)
Pulser OFF

see attachments 5-8

Attachments 9 & 10

DSSSD energy (~10keV/ch) versus DSSSD strip # 
Note some eveidence for non-linearity at low amplitude for p+n strips (128-255) cf. n+n strips
(0-127)

Projection of above showing energy spectrum for one strip. Can observe 478 and 975keV K-lines
and prominent Landau peak near threshold. Threshold estimated at ~80-100keV (slow comparator 0x8).

m(p+n strips) = m(n+n strips) = 1, E(p+n strip)-E(n+n strip) = +/- 100keV

Enegy spectra ADC offset correct, no relative gain adjustment

Attachments 11, 12

Energy (p+n strip) versus E(n+n strip) 
~10keV/channel, m(p+n strips) = m(n+n strips) = 1, with & without equal energy gate

Attachments 13, 14 & 15

Raw hit pattern, m(n+n strips) and m(p+n strips)  

Attachment 16 - gzip'd tar file of sorted R34 spectra (see attachments 17 & 18)

Attachment 17 - FORTRAN user subroutine

Attachment 18 - ADC offset variables used by FORTRAN user subroutine

Attachment 19 - ADC offsets
  458   Sat Nov 19 02:43:39 2016 TDThursday 17 November
10.15 DSSSD bias & leakage currents OK - see attachments 1 & 2
      FEE64 temperatures OK - see attachments 3 & 4
  801   Thu May 16 02:13:10 2019 CA, OH, TDThursday 16th May
10:13 all system wide checks OK *except* nnaida7 fails ADC calibration

      FEE64 temperatures OK - see attachment 1
      good event statistics OK - see attachments 2

      detector biases & leakage currents OK - see attachment 3

      Temperature + deg 24.7C dew point +8.6 deg C RH 35.0%

      Merger and TapeServer ok

10:30 DAQ, merger, TapeServer stop 

      Alpha run stopped at AIDA file TapeData/May19/R2_5

      slow comparator threshold lowered to 10 keV (0xa)

      DAQ start, not writing to file

      good event statistics after lowering threshold, ok (attachment 4)

10:49 1.8.W spectra 20ms FSR - attachments 5 & 6

11:25 started writing to file R3 (sync test)
      low threshold run at 5mb/s

11:33 DAQ stop (R3)

      slow comparator threshold raised to 100 kev (0x64)

      DAQ start, alpha run

      Writing to file TapeData/May19/R4

18.49 alpha background

      ASIC settings 2018Oct03-13.26.58
      *except* slow comparator 0xa -> 0x64

      BNC PB-4 Pulser OFF

      FEE64 temperatures OK - see attachment 7
      good event statistics - see attachments 8 - nnaida1 405k & nnaida17 368k, all other FEE64s c. 380Hz as
expected
      ASIC check for *all* ASICs & FEE64s restored all FEE64 rates to expected c. 380Hz - see attachment 13

      detector biases & leakage currents OK - see attachments 9 & 10

      Merger OK - no error messages - see attachment 11
      TapeServer OK - see attachment 12

      all system wide checks OK *except* nnaida7 fails ADC calibration *and* Check Sync errors not counted Since
Baseline - see attachment 14

      DAQ stopped May19/R4_3

aidas1> ls -l /TapeData/May19
total 19808048
-rw-rw-rw-. 1 npg npgstaff 1908736000 May 14 18:28 R1_0
-rw-rw-rw-. 1 npg npgstaff 2097152000 May 15 02:30 R2_0
-rw-rw-rw-. 1 npg npgstaff 2097152000 May 15 10:20 R2_1
-rw-rw-rw-. 1 npg npgstaff 2097152000 May 15 18:08 R2_2
-rw-rw-rw-. 1 npg npgstaff 2097152000 May 16 01:57 R2_3
-rw-rw-rw-. 1 npg npgstaff 2097152000 May 16 09:45 R2_4
-rw-rw-rw-. 1 npg npgstaff  190447616 May 16 10:28 R2_5
-rw-rw-rw-. 1 npg npgstaff 1109327872 May 16 11:28 R3_0
-rw-rw-rw-. 1 npg npgstaff 2097152000 May 16 18:39 R4_0
-rw-rw-rw-. 1 npg npgstaff 2097152000 May 16 18:45 R4_1
-rw-rw-rw-. 1 npg npgstaff 2097152000 May 16 18:50 R4_2
-rw-rw-rw-. 1 npg npgstaff  225312768 May 16 18:54 R4_3
-rw-rw-rw-. 1 npg npgstaff   52494336 May 16 19:10 R5_0

      Wahtever the issue was it probably occurred before 18.39

      DAQ RESET
      DAQ SETUP
      ASIC check for *all* ASICs & FEE64s
      all system wide checks OK *except* nnaida7 fails ADC calibration
      Sync all ASIC clocks using Re-SYNC

      DAQ started May19/R5

19.23 1.8.W spectra - see attachments 15 & 16
  316   Thu Jun 16 03:40:43 2016 TDThursday 16 June 2016
10.40 DAQ stalled AIDA75_30 c. 01.36

      SYNC errors since baseline (start of AIDA75) - attachment 1
      SYstem-wide checks ASIC clock timestamp and clock status OK for all FEE64s

      Power-cycle & reboot

11.14 AIDA76 

      ASIC settings 2016Jun12-10.10.08
      BNC PB-4 amplitude 50,000

11.19 AIDA77

      BNC PB-4 amplitude 30,000

11.23 AIDA78

      BNC PB-4 amplitude 10,000

11.28 AIDA79

      BNC PB-4 amplitude 5,000

      All *.L histograms saved c. 11.30 Thursday 16 June 2016
      Example spectra - attachment 5

11.34 Water on floor by AIDA NIM bins/forward AIDA stand/EURICA - it would appear
      that one or more cluster LN2 cryostat inlets have thawed are or thawing - failed fill
      and/or blocked manifold?

      Julabo FL11006 water level and flow looks OK
      FEE temperatures OK - see attachment 4

      Detector bias off
      FEE64 power off
      All AIDA power off

      Source of water was determined to be wheeled air dehumdifier/cooler used to cool crates
      in 19" rack to right of AIDA (looking upstream). This had a small tray tank to collect
      water which was full to overflowing.

      2x 60Co sources (#2530 and CD395) returned to cupboard B3F (between E12 & E17 stairwells)
 
  786   Thu Nov 15 06:52:09 2018 OHThursday 15th November 16:00 - 24:00
15:51 DAQ continues - AIDA file RIBF148/R5_664
      165Pm BigRIPS setting + 2.8mm Al degrader

      ASIC settings 2018Oct03-13.26.58
       from c. 09.00 13.11.18
       n+n FEE64s Ibias LF feedback 0xb -> 0xd
       HEC fast comparator threshold 0x20 -> 0xff

15:52 Beam out due to power fault somewhere.

15:53 Beam back
      BRIKEN and BigRIPS start
      BRIKEN file 181115_1553_165Pm_085.dlt  
      BigRIPS run 1070
      AIDA on run R5_664

16:00 System wide checks all ok *Except nnaida7 fails adc calibration*
      Leakage currents and bias ok - attachment 1
      FEE Temps ok - attachment 2
      Statistics ok - attachment 3

16:54 BRIKEN and BigRIPS stop
      AIDA on file R5_675

16:55 BRIKEN starts run 181115_1654_165Pm_086.dlt
      BigRIPS starts run 1071
      AIDA on file R5_675

17:30 BRIKEBN and BigRIPS stop for BigRIPS team to get access

13:46 BRIKEN sends sync pulse resetting timestamp
      AIDA on file R5_683

17:49 BRIKEN starts run 181115_1748_165Pm_087.dlt
      bigRIPS starts run 1072
      AIDA on file R5_683

18.00 System wide checks ok, except nnaida7 ADC calibration failure
      FEE64 Temperatures ok (attachment 4)
      Good event statistics ok (attachment 5)
      Detector bias/Leakage currents ok (attachment 6)

18.04 Merger and TapeServer run ok - no error messages in terminals (attachments 7 and 8)

18:48 BigRIPS and BRIKEN stop
      AIDA on file R5_693

18:49 BigRIPS starts run 1073
      BRIKEN starts run 181115_1849_165Pm_088.dlt
      AIDA on file R5_693

19:47 BgiRIPS and BRIKEN stop
      AIDA on file R5_703

19:48 BigRIPS starts run 1074
      BRIKEN starts run 181115_1947_165Pm_089.dlt  
      AIDA on file R5_703

20:54 bigRIPS and BRIKEN stop
      AIDA on file R5_714

20:55 bigRIPS starts run 1075
      BRIKEN starts run 181115_2053_165Pm_090.dlt
      AIDA on file R5_714

21:25 System wide checks all ok *Except nnaida 7 fails adc calibration*
      Bias and leakage currents ok - attachment 9
      FEE Temps all ok - attachment 10
      Statistics ok - attachment 11

21:55 BRIKEN and BigRIPS stop
      AIDA on file R5_724

21:56 BigRIPS starts on run 1076
      BRIKEN starts run
      AIDA on file R5_724

22:55 BigRIPS and BRIKEN stop
      AIDA on file R5_733

22:56 BRIKEN Starts run
      BigRIPS starts run 1077
      AIDA on file R5_733

23.53 Briken stops
      AIDA on file R5_743

23.55 BRIKEN starts
      bigRIPS run 1078
      BRIKEN starts run 93
      AIDA on file R5_743
  785   Wed Nov 14 22:54:11 2018 LSThursday 15th November 08:00 - 16:00
08.10 BRIKEN stop
      AIDA file RIBF148/R5_587

08.11 BRIKEN start
      AIDA file RIBF148/R5_588
      BRIKEN run 77
      BigRIPS run 1062

08.16 system wide checks ok, except nnaida7 ADC calibration failure
      FEE64 temperatures ok (attachment 1)
      good event statistics ok (attachment 2)
      detector bias/leakage currents ok (attachment 3)
      Merger and TapeServer still ok

09.11 BRIKEN stop
      AIDA file RIBF148/R5_598

09.13 BRIKEN start
      AIDA file RIBF148/R5_598
      BRIKEN run 78
      BigRIPS run 1063

10.10 BRIKEN stop
      AIDA file RIBF148/R5_608

10.12 BRIKEN start
      AIDA file RIBF148/R5_608
      BRIKEN run 79
      BigRIPS run 1064

11.10 BRIKEN stop
      AIDA file RIBF148/R5_618

11.12 BRIKEN start
      AIDA file RIBF148/R5_618
      BRIKEN run 80
      BigRIPS run 1065

11.17 system wide checks ok, except nnaida7 ADC calibration failure
      FEE64 temperatures ok (attachment 4)
      good event statistics ok (attachment 5)
      detector bias/leakage currents ok (attachment 6)
      Merger and TapeServer still ok

12:10 BigRIPS and BRIKEN stop
      AIDA on file R5_628

12:11 BRIKEN start
      AIDA on file R5_628
      BigRIPS run 1066
      BRIKEN run 81 181115_1211_165Pm_081.dlt

13.10 BRIKEN stop
      AIDA file RIBF148/R5_638

13.12 BRIKEN start
      AIDA file RIBF148/R5_638
      BRIKEN run 82
      BigRIPS run 1067

13.32 AIDA file RIBF148/R5_642
      BRIKEN stopped
      Turning beam off to access area

13.50 AIDA file RIBF148/R5_644
      beam back on
      BRIKEN run 83
      BigRIPS run 1068

14.26 MIDASsort analysis file RIBF148/R5_648 - all ADC data synchronised - attachment 7
      analysis of file RIBF148/R5_648 - attachment 8
       nnaida19 dead time ~0.5% - all other deadtimes lower or 0% - no timewarps

14.35 1.8.W spectra layout ID 8 (attachment 9)

14.50 BRIKEN stop
      AIDA file RIBF148/R5_654

14.51 BRIKEN start
      AIDA file RIBF148/R5_654
      BRIKEN run 83
      BigRIPS run 1068

15.10 1.8.H high energy channel spectra (attachment 10)

15.35 beam off
      AIDA file RIBF148/R5_662
      BRIKEN and BigRIPS stopped run           
  784   Wed Nov 14 14:46:47 2018 CAThursday 15th November 00:00 - 08:00
23.58 DAQ continues ok (RIBF148/R5_505)

00.09 system wide checks ok, except nnaida7 ADC calibration failure
      FEE64 temperatures ok (attachment 1)
      good event statistics ok (attachment 2)
      detector bias/leakage currents ok (attachment 3)

00.13 Merger and TapeServer run ok (attachment 4/5)

00.26 BRIKEN stop
      AIDA file RIBF148/R5_509

00.29 BRIKEN start
      AIDA file RIBF148/R5_510
      BRIKEN run 70
      BigRIPS run 1055

01.46 BRIKEN stop
      AIDA file RIBF148/R5_523

01.49 BRIKEN start
      AIDA file RIBF148/R5_523
      BRIKEN run 71
      BigRIPS run 1056

02.05 system wide checks ok, except nnaida7 ADC calibration failure
      FEE64 temperatures ok (attachment 6)
      good event statistics ok (attachment 7)
      detector bias/leakage currents ok (attachment 8)
      Merger and TapeServer still ok

02.34 XY hit patterns (attachment 9)
      Ex vs Ey plots (attachment 10)
      HEC spectra (attachment 11)
      LEC spectra (attachment 12)

02.49 BRIKEN stop
      AIDA file RIBF148/R5_534

02.50 BRIKEN start
      AIDA file RIBF148/R5_534
      BRIKEN run 72
      BigRIPS run 1057

03.26 zeroed all spectra on online analysis and MIDASsort

04.04 BRIKEN stop
      AIDA file RIBF148/R5_546

04.05 BRIKEN start
      AIDA file RIBF148/R5_546
      BRIKEN run 73
      BigRIPS run 1058

04.10 system wide checks ok, except nnaida7 ADC calibration failure
      FEE64 temperatures ok (attachment 13)
      good event statistics ok (attachment 14)
      detector bias/leakage currents ok (attachment 15)
      Merger and TapeServer still ok

05.06 BRIKEN stop
      AIDA file RIBF/R5_556

05.07 BRIKEN start
      AIDA file RIBF148/R5_557
      BRIKEN run 74
      BigRIPS run 1059

05.08 First 200ms of decay correlations in all detectors
      comparison between different Al degrader thickness values (3mm, 2.3mm, 2.8mm)
      see attachments 16, 17 and 18 - graphs labelled with detector number and Al degrader thickness

06.09 BRIKEN stop
      AIDA file RIBF148/R5_567

06.11 BRIKEN start
      AIDA file RIBF148/R5_567
      BRIKEN run 75
      BigRIPS run 1060

06.16 system wide checks ok, except nnaida7 ADC calibration failure
      FEE64 temperatures ok (attachment 19)
      good event statistics ok (attachment 20)
      detector bias/leakage currents ok (attachment 21)
      Merger and TapeServer still ok

06.17 ASIC check load - ok

06.34 XY hit patterns (attachment 22)
      Ex vs Ey plots (attachment 23)
      HEC spectra (attachment 24)
      LEC spectra (attachment 25)

07:12 BRIKEN stop
      AIDA file RIBF148/R5_578

07:15 BRIKEN start
      AIDA file RIBF148/R5_578
      BRIKEN run 76
      BigRIPS run 1061






      
















      
  662   Thu Jun 15 02:56:32 2017 TD, OHThursday 15 June
10.52 DAQ continues
      AIDA file RIBF148/R8_39

      BNC PB-4
      Amplitude 90,000
      x5 attenuator IN
      t_r 100ns tau_d 50us
      - polarity
      frequency 25Hz range 2.6Hz
      delay MIN, tail pulse, INT ref

      ASIC settings 2017Mar27-16.12.39
      *except* 
      slow comparator 0x64
      LEC/MEC fast comparator 0x14

10.54 Detector biases & leakage currents OK - see attachments 1 & 2
      FEE64 Temperatures OK - see attachment 3
      good events statistics stable & OK - see attachment 4 
      No warnings/errors reported by merger since start of RIBF148/R3  - see attachment 5
      *all* system wide checks OK (zero fails)

11.02 analysis file RIBF148/R8_39 - zero deadtime, 222x MBS and zero ts timewarps - see attachment 6
      correlation scaler trigger ~ 950/3 ~ 320Hz

15.12 online analysis 
      ADC & disc data synchronised - note the effect of the higher slow comparator threshold on the after-pulse
- see attachment 7
      per DSSSD m_p versus m_n (LEC) - see attachments 8
      per DSSSD x versus y (LEC) - see attachment 9
      per DSSSD E_p versus E_n (LEC) - 512x512 spectra - nominal 20keV per channel - see attachment 10
      Spectra show light particles detected from last night's 238U beam test - no HEC data due to 10cm Pb wall
      It should be straightforward to separate the alpha background from this data using the change in LEC rates
      and the light particle data will also provide a good check of the calibration.

11.17 Stop DAQ
      AIDA file RIBF148/R8_40

      online histograms & SortSas spectra zero'd

      saw tooth noise FEE64s p+n junction strips not observed
      clover detectors re-installed but not cabled or biased
      3He detectors are on
      Si dE and variable degrader was removed yesterday

11.19 Start DAQ
      AIDA file RIBF148/R9

      Check ASIC control x2

13.15 Detector biases & leakage currents OK - see attachments 11 & 12

16.45 Clover detectors cabled and bias applied

17.33 DAQ continues
      AIDA file RIBF148/R9_6

      nnaida13 & nnaida11 1.8.W spectra - nnaida13 shows evidence of high frequency noise modulated
      with a period of ~400us cf. https://elog.ph.ed.ac.uk/AIDA/661

18.01 DAQ stop
      AIDA file RIBF148/R9_6

18.09 *** NEW FEE64 FIRMWARE ***
      New RunControl/sys.tcl and Check/check.js .tcl .tml

18.48 DAQ start
      AIDA file RIBF148/R10

      BNC PB-4
      Amplitude 90,000
      x5 attenuator IN
      t_r 100ns tau_d 50us
      - polarity
      frequency 25Hz range 2.6Hz
      delay MIN, tail pulse, INT ref

      ASIC settings 2017Mar27-16.12.39
      *except* 
      slow comparator 0x64
      LEC/MEC fast comparator 0x14

19.03 online analysis
      ADC & disc data synchronised - 20.48us/channel - see attachment 15
      
      For all combinations of x-y strips (LEC events) calculate

         IF ( ihit( i ) .AND. ihit( j ) ) THEN
          tdiff1 = ihit_ts(i)-e_time
          tdiff2 = ihit_ts(j)-e_time
          CALL inc1d( 500, tdiff1 + 2000 )
          CALL inc1d( 506, tdiff2 + 2000 )
          CALL inc2d( 2600, tdiff1, tdiff2 )
         ENDIF

      where
      e_time = 100MHz timestamp of first ADC word of event
      ihit_ts(i) = 100MHz timestamp of ADC word i of event

      see attachments 16-17

19.21 Current MONLOCK status - see attachment 18
  384   Thu Oct 13 06:07:43 2016 TD & CGThursday 13 October
11.40 Power cycle AIDA FEE64s
      Set TS_SYNC_PHASE 0

      DSSSD bias/leakage current OK - see attachment 1-2
      FEE64 temperatures OK - see attachment 3
      *All* system-wide checks OK

      B2F/F11 temperature + deg C, d.p. + deg C,RH %

      ASIC settings 2016Sep02-18.17.01
      slow comparator 0x10 -> 0x0a
      LEC/MEC fast comparators # 1, 55 & 58 disabled for all FEE64s

      Master MACB serial #13 (see https://elog.ph.ed.ac.uk/AIDA/367)
      Master MACB mode 5

12.15 DAQ starts (file Sept2016/R24)

15.16 DAQ stops OK

15.18 DAQ starts (R25)
 
      Pulser walkthrough 

      BNC PB-4 amplitudes 10,000 - 90,000 @ 10,000 step

      See attachment 4

      Spectra saved 13.10.16 15.32 (08.32 FEE64s)

15.30 DAQ stops OK

15.38 DAQ starts (R26)
 
      Pulser walkthrough 

      BNC PB-4 amplitudes 8,000 - 2,000 @ 2,000 step

      See attachment 5

      Spectra saved 13.10.16 15.47 (08.47 FEE64s)

15.45 DAQ stops

15.50 DAQ starts (R27)
      LEC/MEC FSR 20MeV -> 1GeV 

      BNC PB-4 amplitude 90,000

      Spectra saved 13.10.16 16.07 (09.05 FEE64s)

16.05 DAQ stops

16.12 DAQ starts (R28)
      LEC/MEC FSR 1GeV -> 20MeV

      BNC PB-4 off (noise + background activity only)

      Spectra saved 13.10.16 16:49 (saved 09.49 FEE64s)

16.48 DAQ stops

16.57 DAQ starts (R29)

      BNC PB-4 90,000 amplitude ~23Hz freq.

17.26 Lost SYNC pulses. Merger+TapeServer stopped writing to file (noticed 18.20)

18.25 R29 closed.

19:20 NIM bin supplying TTL clock to master MACB failed at or around the same time as the DAQ stop occurred.
      
      Need to replace NIM bin before clock can be supplied.


21.20 DAQ starts (R32)

23.51 DAQ found stopped, most recent file R32_26 (last access 22.34 13.10.16)

23.56 Restarted merger & immediately requested DAQ STOP - OK
      DAQ reset & setup
      System-wide tests all OK

00.01 DAQ starts (R33)
  839   Thu Jun 13 00:30:17 2019 CA, CB, TD, CG, OH, DKThursday 13 June
08.32 Julabo FL11006 chiller set point +20 deg C actual +20.0 deg C
      Water level c. 70% M-H markers + 0.5 jugful -> c. 80% M-H markers
      Temperature +24.0 deg C dew point +9.6 deg C RH 39.0%

      DAQ continues OK

      ASIC settings 2019May19-17.54.03
      slow comparator 0xa

      BNC PB-4 Pulser 
      Amplitude 90,000
      x5 attenuator IN
      Frequency 25Hz range
      t_r 100ns, tau_d 50us
      - polarity
      Delay MIN, tail pulse

      all system wide checks OK *except* nnaida7 fails ADC calibration

      detector biases & leakage currents OK - see attachments 1 & 2

      FEE64 temperatures OK - see attachment 3

      good event statistics - OK - see attachment 4
      8x <20k 23x < 50k 24x <100k cf. 7x <20k 23x < 50k 24x <100k yesterday evening
      Merger OK - see attachment 5
      TapeServer OK - see attachment 6

      p+n FEE64s 1.8.W spectra 20us FSR - attachment 7
      n+n FEE64s 1.8.W spectra 20us FSR - attachment 8
      1.8.L spectra - see attachments 9 & 10
      nnaida1 85 ch FWHM, nnaida3 86 ch FWHM - cf. 75 & 79 ch FWHM respectively 17.04 Tuesday 11 June 

      FEE64 Rate spectra - attachment 11
      Check ASIC Control *all* FEE64s & ASICs x2
      Check ASIC Control x3
      FEE64 ASIC
      13    1
      14    4
      16    4
      19    3
      21    2
      FEE64 Rate spectra - attachment 12 - some channels recovered

08.45 ADC data synchronised - attachment 13

08.52 zero all histograms
      zero DAQ stats


08.56 ASIC settings saved to new DB key 2019Jun13-08.56.35
      includes slow comparator 0xa
      DAQ options updated

15:18 
      DAQ continues okay.  Rates seem ok, see attachment 14.
      Biases shown as attachment 15 -- looks fine.

      (These are all as before we assume)
      ASIC settings 2019May19-17.54.03
      slow comparator 0xa

      BNC PB-4 Pulser 
      Amplitude 90,000
      x5 attenuator IN
      Frequency 25Hz range
      t_r 100ns, tau_d 50us
      - polarity
      Delay MIN, tail pulse

      all system wide checks OK *except* nnaida7 fails ADC calibration

      FEE64 temperatures OK - see attachment 16

      Merge ok, 570k items per second, see attachment 17
      TapeServer not storing but sitting around 4 MBytes/sec, see attachment 18
  907   Thu Oct 12 13:02:50 2023 TDThursday 12 October contd.
      ASIC settings 2021Apr29-13-16-00
      slow comparator 0xa ( all p+n junction FEE64s ) and 0xf ( all n+n Ohmic FEE64s )

      BNC PB-5
      amplitude 10.0V
      attenuation x10
      tail pulse
      decay time 1ms
      frequency 25Hz
      polarity -

      PB-5 output direct to aida02 *only*

      CAEN N1419ET non-floating outputs ( internal LK fitted )
      ch2 - polarity

      HV cable - standard coaxial cable to aida12 chained to aida03 & aida11
      chain ( Lemo-00 cables ) adaptor PCB gnd from aida09 to aida01 & aida10
      ground cable from aida04 adaptor PCB gnd to aida12, aida02 & aida09
      aida04 LK1 ( local gnd ) fitted
      aida03 LK3 fitted ( DSSSD PCB gnd )

      DSSSD bias -150V -6.510uA - attachment 1
      ADC data item stats - attachment 2
       p+n rates dominated by hot channels - most p+n channels < 1Hz/channel
       n+n rates c. 10Hz/channel 
       
      per FEE64 Rate spectra - attachment 3-5

      aida02 1.8.L pulser peak width 102 ch FWHM ( 70 keV FWHM )

      aida02 *.*.L spectra - attachments 6-9
       common x & y scales for all spectra - peak height proxy for peak width
       all channels have similar pulser peak widths 

      aida02 3.*.W spectra - 20us, 200us, 2ms & 20ms FSR - attachments 10-17


      per p+n FEE64 1.8.W spectra - 20us, 200us, 2ms & 20ms FSR - attachments 18-25

      per n+n FEE64 1.8.W spectra - 20us, 200us, 2ms & 20ms FSR - attachments 26-33


      DSSSD bias -150V -6.510uA - attachment 34
      ADC data item stats - attachment 35
       p+n rates dominated by hot channels - most p+n channels < 1Hz/channel
       n+n rates c. 10Hz/channel 
       
      per FEE64 Rate spectra - attachment 36-38

      aida12 1.8.L pulser peak width 56 ch FWHM ( 39keV FWHM )

      aida12 *.*.L spectra - attachments 39-42
       common x & y scales for all spectra - peak height proxy for peak width
       60 channels have similar pulser peak widths
       4 channels show peak widths c. 2x larger ( 'hot' channels )

      aida12 3.*.W spectra - 20us, 200us, 2ms & 20ms FSR - attachments 43-50
  906   Thu Oct 12 09:12:34 2023 TDThursday 12 October
10.10 Water flow & temp OK
      Power ON

      All system wide checks OK


      ASIC settings 2021Apr29-13-16-00
      slow comparator 0x64

      BNC PB-5
      amplitude 10.0V
      attenuation x10
      tail pulse
      decay time 1ms
      frequency 25Hz
      polarity -

      PB-5 output direct to aida01 *only*

      CAEN N1419ET non-floating outputs ( internal LK fitted )
      ch2 - polarity

      HV cable - standard coaxial cable to aida12 chained to aida03, aida11, aida09, aida01 & aida10
      aida04 LK1 ( local gnd ) fitted
      ground cable from aida04 adaptor PCB gnd to aida12 & aida02
      aida03 LK3 fitted ( DSSSD PCB gnd )

      DSSSD bias -150V -6.300uA - attachment 1
      FEE64 temps OK - attachment 2
      ADC data item stats - attachment 3
       
      per FEE64 Rate spectra - attachment 4
       ignore aida06 & adida08 - not connected to anything
       ignore known issue of high rates aida04 asic #1 and aida10 asic #4 - remediable

      aida01 1.8.L pulser peak width 75 ch FWHM ( 53keV FWHM )

      1.8.W spectra - 20us FSR - attachments 5 & 6


10.35 slow comparator 0x64 -> 0xa ( all p+n junction FEE64s ) and 0xf ( all n+n Ohmic FEE64s )

      ADC data item stats - attachment 7
       
      per FEE64 Rate spectra - attachment 8-10

      p+n rates dominated by hot channels - most p+n channels < 1Hz/channel
      n+n rates c. 50Hz/channel 



      per p+n FEE64 1.8.W spectra - 20us, 200us & 2ms FSR - attachments 11-13
      per n+n FEE64 1.8.W spectra - 20us, 200us & 2ms FSR - attachments 14-16



12.10 HV cable - standard coaxial cable to aida12 chained to aida03 & aida11
      chain ( Lemo-00 cables ) adaptor PCB gnd from aida09 to aida01 & aida10 

      DSSSD bias -150V -6.535uA - attachment 17
      ADC data item stats - attachment 18
       
      per FEE64 Rate spectra - attachment 19-21

      aida01 1.8.L pulser peak width 78 ch FWHM ( 55keV FWHM )

      1.8.W spectra - 20us FSR - attachments 22 & 23



12.40 HV cable - standard coaxial cable to aida12 chained to aida03 & aida11
      chain ( Lemo-00 cables ) adaptor PCB gnd from aida09 to aida01 & aida10
      ground cable from aida04 adaptor PCB gnd to aida12, aida02 & aida09

      DSSSD bias -150V -6.535uA - attachment 24
      ADC data item stats - attachment 25
       
      per FEE64 Rate spectra - attachment 26-28

      aida01 1.8.L pulser peak width 61 ch FWHM ( 42keV FWHM )

      1.8.W spectra - 20us FSR - attachments 29-32


      aida01 *.*.L spectra - attachments 33-36
       common x & y scales - pulser peak height proxy for peak width
      aida01 3.*.W spectra - 20us FSR - attachments 37-39


     per p+n FEE64 1.8.W spectra - 20us, 200us, 2ms & 20ms - attachments 40-47
  562   Thu May 11 05:43:30 2017 TD, OHThursday 11 May
13.43 DAQ continues OK 
      Current file May2017/R6_123

      ASIC settings 2017Mar27-16.12.39 *except*
      slow comparator 0x20
      LEC/MEC fast comparator 0xff

      Detector biases & leakage currents OK - see attachments 1 & 2
      FEE64 Temperatures OK - see attachment 3
      'good events' statistics OK - see attachment 4
      No warnings/errors reported by merger since DAQ GO - see attachment 5

      *all* system wide checks OK

13.37 E17/F11 ambient temperature +24.4 deg C, RH 37.3%, d.p. +9.1 deg C

13.58 1.8.L ADC spectra - see attachments 6 & 7 
      1.8.W waveforms - see attachments 8-11

14.16 Analysis of data file R6_124 - see attachment 12
      Zero AIDA pause/resume
      Zero idle-time
      AIDA SYNC100 variations ~20/468430

18.36 DAQ continues OK 
      Current file May2017/R6_137

      Detector biases & leakage currents OK - see attachments 13 & 14
      FEE64 Temperatures OK - see attachment 15
      'good events' statistics OK - see attachment 16

      *all* system wide checks OK
  451   Thu Nov 10 12:02:24 2016 TD, OH, CGThursday 10 November
21.17 DAQ starts (R30)

      Pulser walkthrough
      Amplitude 90,000 - 10,000 @ 10,000 step
      x5 attenuator IN
      t_r 50ns tau_d 50us
      polarity -, tail pulse, delay MIN
      frequency 250Hz range

21.30 DAQ stops OK 

21.32 DAQ starts (R31)

      Pulser walkthrough
      Amplitude 10,000 - 2,000 @ 2,000 step

21.40 DAQ stops OK

21.44 DAQ starts (R32)
     
      Background
      BNC PB-4 pulser OFF

21.59 DAQ stops OK

23.45 Started R35 so Jorge can do some tests.
      No storage mode.

00.20 Carried out manual fill on LN2 in advance of beam arriving later (~03.00).
      Took around 20mins.
      Continued writing to R35 after soft reset of DAQ.
  353   Thu Sep 1 03:45:34 2016 TDThursday 1 September
13.33 R11 starts

      ASIC settings 2016Aug20-15.34.53
      Discriminator masks -> 0x0
      Slow comparator 0x10
      LEC/MEC fast comparator 0xff
      From Correlation Status & Control tab change Trigger delay 0x180

      BNC PB-4 Pulser
      Amplitude 90,000
      x5 attenuator IN
      t_r 50ns tau_d 50us 
      - polarity
      INT ref, delay MIN, tail pulse
      Frequency c. 5Hz

      B2F/F11 temp +24.8 deg C, d.p. +11.9 deg C, RH 44.8%

      DSSSD bias/leakage current OK - see attachments 1-2
      FEE64 temperatures OK - see attachment 3

      System-wide checks OK - see attachments 4-9

      AIDA SYNC, PAUSE, RESUME, Correlation L, SYNC time warp, Good Events, AIDA disc, nnaida6, nnaida5 & nnaida20 statistics - see 
attachments 10-20
      Good event rate varies from 5-320k / FEE64

      Merger/tapeserver - see attachments 21-22
      Merged data rate ~2-3M data items/s, c. 16M to disk 

Analysis of R11_93 - FEE64 data synchronised - see attachment 23

aidas1> ./analyser2 /TapeData/Aug2016/R11_93
 *** GREAT format 3.2.0 analyser - TD - May 2014
 ***            ADC data: block:  3402 ptr: 15985 data: 0xC4C37FDB module: 19 fail: 0 range: 0 id:  1219 channel:  3 adc: 32731  ts:
0x00000120C00000A0 OLD: ts: 0x00000120D000008D tag: 3 type: 0
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  170966247 ( 1387907.5 Hz)
        Other data format:   90121753 (  731610.3 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:        106 (       0.9 Hz)
                               RESUME:        106 (       0.9 Hz)
                              SYNC100:    1124303 (    9127.1 Hz)
                           FEE64 disc:   88996299 (  722473.8 Hz)
                             MBS info:        939 (       7.6 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:        571 (       4.6 Hz)

                Timewarps:        ADC:          1 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 Timestamp elapsed time:      123.183 s
 FEE module #:   1 elapsed dead time       0.370 s
 FEE module #:   2 elapsed dead time       0.317 s
 FEE module #:   3 elapsed dead time       0.000 s
 FEE module #:   4 elapsed dead time       0.000 s
 FEE module #:   5 elapsed dead time       1.058 s
 FEE module #:   6 elapsed dead time       2.581 s
 FEE module #:   7 elapsed dead time       0.000 s
 FEE module #:   8 elapsed dead time       0.000 s
 FEE module #:   9 elapsed dead time       0.130 s
 FEE module #:  10 elapsed dead time       0.000 s
 FEE module #:  11 elapsed dead time       0.000 s
 FEE module #:  12 elapsed dead time       0.000 s
 FEE module #:  13 elapsed dead time       1.078 s
 FEE module #:  14 elapsed dead time       0.172 s
 FEE module #:  15 elapsed dead time       0.000 s
 FEE module #:  16 elapsed dead time       0.000 s
 FEE module #:  17 elapsed dead time       0.223 s
 FEE module #:  18 elapsed dead time       0.017 s
 FEE module #:  19 elapsed dead time       0.089 s
 FEE module #:  20 elapsed dead time       0.000 s
 FEE module #:  21 elapsed dead time       2.291 s
 FEE module #:  22 elapsed dead time       0.450 s
 FEE module #:  23 elapsed dead time       0.000 s
 FEE module #:  24 elapsed dead time       0.000 s
 FEE module #:  25 elapsed dead time       0.000 s
 FEE module #:  26 elapsed dead time       0.000 s
 FEE module #:  27 elapsed dead time       0.000 s
 FEE module #:  28 elapsed dead time       0.000 s
 FEE module #:  29 elapsed dead time       0.000 s
 FEE module #:  30 elapsed dead time       0.000 s
 FEE module #:  31 elapsed dead time       0.000 s
 FEE module #:  32 elapsed dead time       0.000 s

 *** Program elapsed time:   21.035s ( 1521.263 blocks/s,  95.079 Mb/s)

Verbose data dump around time warp (file R11_93, block 3402, ptr 15985)

 ***            ADC data: block:  3402 ptr: 15901 data: 0xC5777559 module: 21 fail: 0 range: 0 id:  1399 channel: 55 adc: 30041  ts:
0x00000120CFFFF895
 *** FEE64 discriminator: block:  3402 ptr: 15903 data: 0x85640080 module:  5 information type:  6 information field: 0x00040080 ts:
0x00000120CFFFF895
 ***            ADC data: block:  3402 ptr: 15905 data: 0xC17A793F module:  5 fail: 0 range: 0 id:   378 channel: 58 adc: 31039  ts:
0x00000120CFFFF895
 *** FEE64 discriminator: block:  3402 ptr: 15907 data: 0x86640080 module:  6 information type:  6 information field: 0x00040080 ts:
0x00000120CFFFF898
 *** FEE64 discriminator: block:  3402 ptr: 15909 data: 0x82640080 module:  2 information type:  6 information field: 0x00040080 ts:
0x00000120CFFFF89A
 *** FEE64 discriminator: block:  3402 ptr: 15911 data: 0x81640080 module:  1 information type:  6 information field: 0x00040080 ts:
0x00000120CFFFF89B
 ***            ADC data: block:  3402 ptr: 15913 data: 0xC5018140 module: 20 fail: 0 range: 0 id:  1281 channel:  1 adc: 33088  ts:
0x00000120CFFFF8D5
 ***            ADC data: block:  3402 ptr: 15915 data: 0xC3617FA1 module: 13 fail: 0 range: 0 id:   865 channel: 33 adc: 32673  ts:
0x00000120CFFFF92D
 ***            ADC data: block:  3402 ptr: 15917 data: 0xC5417DDE module: 21 fail: 0 range: 0 id:  1345 channel:  1 adc: 32222  ts:
0x00000120CFFFF95D
 ***            ADC data: block:  3402 ptr: 15919 data: 0xC57A7D7B module: 21 fail: 0 range: 0 id:  1402 channel: 58 adc: 32123  ts:
0x00000120CFFFF95D
 ***            ADC data: block:  3402 ptr: 15921 data: 0xC3687F55 module: 13 fail: 0 range: 0 id:   872 channel: 40 adc: 32597  ts:
0x00000120CFFFF9F5
 *** FEE64 discriminator: block:  3402 ptr: 15923 data: 0x85640080 module:  5 information type:  6 information field: 0x00040080 ts:
0x00000120CFFFFB5B
 *** FEE64 discriminator: block:  3402 ptr: 15925 data: 0x86640080 module:  6 information type:  6 information field: 0x00040080 ts:
0x00000120CFFFFB5C
 *** FEE64 discriminator: block:  3402 ptr: 15927 data: 0x82640080 module:  2 information type:  6 information field: 0x00040080 ts:
0x00000120CFFFFB5F
 ***            ADC data: block:  3402 ptr: 15929 data: 0xC35F7DAD module: 13 fail: 0 range: 0 id:   863 channel: 31 adc: 32173  ts:
0x00000120CFFFFB85
 ***            ADC data: block:  3402 ptr: 15931 data: 0xC3307F91 module: 12 fail: 0 range: 0 id:   816 channel: 48 adc: 32657  ts:
0x00000120CFFFFBB5
 ***            ADC data: block:  3402 ptr: 15933 data: 0xC5A67F6D module: 22 fail: 0 range: 0 id:  1446 channel: 38 adc: 32621  ts:
0x00000120CFFFFBDD
 ***            ADC data: block:  3402 ptr: 15935 data: 0xC0C0845E module:  3 fail: 0 range: 0 id:   192 channel:  0 adc: 33886  ts:
0x00000120CFFFFC35
 ***            ADC data: block:  3402 ptr: 15937 data: 0xC3657ED9 module: 13 fail: 0 range: 0 id:   869 channel: 37 adc: 32473  ts:
0x00000120CFFFFC4D
 *** FEE64 discriminator: block:  3402 ptr: 15939 data: 0x85640080 module:  5 information type:  6 information field: 0x00040080 ts:
0x00000120CFFFFC77
 *** FEE64 discriminator: block:  3402 ptr: 15941 data: 0x86640080 module:  6 information type:  6 information field: 0x00040080 ts:
0x00000120CFFFFC7A
 *** FEE64 discriminator: block:  3402 ptr: 15943 data: 0x81640080 module:  1 information type:  6 information field: 0x00040080 ts:
0x00000120CFFFFC7C
 *** FEE64 discriminator: block:  3402 ptr: 15945 data: 0x82640080 module:  2 information type:  6 information field: 0x00040080 ts:
0x00000120CFFFFC7C
 ***            ADC data: block:  3402 ptr: 15947 data: 0xC4DC8041 module: 19 fail: 0 range: 0 id:  1244 channel: 28 adc: 32833  ts:
0x00000120CFFFFCB8
 *** FEE64 discriminator: block:  3402 ptr: 15949 data: 0x85640080 module:  5 information type:  6 information field: 0x00040080 ts:
0x00000120CFFFFCC6
 ***            ADC data: block:  3402 ptr: 15951 data: 0xC38C7EF8 module: 14 fail: 0 range: 0 id:   908 channel: 12 adc: 32504  ts:
0x00000120CFFFFD3D
 ***            ADC data: block:  3402 ptr: 15953 data: 0xC4817ED8 module: 18 fail: 0 range: 0 id:  1153 channel:  1 adc: 32472  ts:
0x00000120CFFFFD85
 ***            ADC data: block:  3402 ptr: 15955 data: 0xC3577EE4 module: 13 fail: 0 range: 0 id:   855 channel: 23 adc: 32484  ts:
0x00000120CFFFFDDD
 ***            ADC data: block:  3402 ptr: 15957 data: 0xC1B67F41 module:  6 fail: 0 range: 0 id:   438 channel: 54 adc: 32577  ts:
0x00000120CFFFFE35
 *** FEE64 discriminator: block:  3402 ptr: 15959 data: 0x85640080 module:  5 information type:  6 information field: 0x00040080 ts:
0x00000120CFFFFF44
 ***            ADC data: block:  3402 ptr: 15961 data: 0xC5517FCD module: 21 fail: 0 range: 0 id:  1361 channel: 17 adc: 32717  ts:
0x00000120CFFFFF9D
 ***            ADC data: block:  3402 ptr: 15963 data: 0xC5957FEA module: 22 fail: 0 range: 0 id:  1429 channel: 21 adc: 32746  ts:
0x00000120CFFFFFC5
 ***            ADC data: block:  3402 ptr: 15965 data: 0xC5B37E90 module: 22 fail: 0 range: 0 id:  1459 channel: 51 adc: 32400  ts:
0x00000120CFFFFFC5
 *** FEE64 discriminator: block:  3402 ptr: 15967 data: 0x85640080 module:  5 information type:  6 information field: 0x00040080 ts:
0x00000120CFFFFFD9
 ***            ADC data: block:  3402 ptr: 15969 data: 0xC4B77FCE module: 18 fail: 0 range: 0 id:  1207 channel: 55 adc: 32718  ts:
0x00000120CFFFFFDD
 ***            ADC data: block:  3402 ptr: 15971 data: 0xC5047FBE module: 20 fail: 0 range: 0 id:  1284 channel:  4 adc: 32702  ts:
0x00000120CFFFFFDD
 ***            ADC data: block:  3402 ptr: 15973 data: 0xC3627FFD module: 13 fail: 0 range: 0 id:   866 channel: 34 adc: 32765  ts:
0x00000120D0000035
 *** FEE64 discriminator: block:  3402 ptr: 15975 data: 0x85640080 module:  5 information type:  6 information field: 0x00040080 ts:
0x00000120D0000059
 *** FEE64 discriminator: block:  3402 ptr: 15977 data: 0x86640080 module:  6 information type:  6 information field: 0x00040080 ts:
0x00000120D000005D
 *** FEE64 discriminator: block:  3402 ptr: 15979 data: 0x82640080 module:  2 information type:  6 information field: 0x00040080 ts:
0x00000120D000005F
 ***            ADC data: block:  3402 ptr: 15981 data: 0xC5437FC7 module: 21 fail: 0 range: 0 id:  1347 channel:  3 adc: 32711  ts:
0x00000120D0000065
 ***            ADC data: block:  3402 ptr: 15983 data: 0xC583802E module: 22 fail: 0 range: 0 id:  1411 channel:  3 adc: 32814  ts:
0x00000120D000008D
 ***            ADC data: block:  3402 ptr: 15985 data: 0xC4C37FDB module: 19 fail: 0 range: 0 id:  1219 channel:  3 adc: 32731  ts:
0x00000120C00000A0 OLD: ts: 0x00000120D000008D tag: 3 type: 0
 ***            ADC data: block:  3402 ptr: 15985 data: 0xC4C37FDB module: 19 fail: 0 range: 0 id:  1219 channel:  3 adc: 32731  ts:
0x00000120C00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 15987 data: 0x8140120D module:  1 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 15989 data: 0x8240120D module:  2 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 15991 data: 0x8340120D module:  3 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 15993 data: 0x8440120D module:  4 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 15995 data: 0x8540120D module:  5 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 15997 data: 0x8640120D module:  6 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 15999 data: 0x8740120D module:  7 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 16001 data: 0x8840120D module:  8 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 16003 data: 0x8940120D module:  9 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 16005 data: 0x8A40120D module: 10 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 16007 data: 0x8B40120D module: 11 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 16009 data: 0x8C40120D module: 12 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 16011 data: 0x8D40120D module: 13 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 16013 data: 0x8E40120D module: 14 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 16015 data: 0x8F40120D module: 15 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 16017 data: 0x9040120D module: 16 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 16019 data: 0x9140120D module: 17 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 16021 data: 0x9240120D module: 18 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 16023 data: 0x9340120D module: 19 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 16025 data: 0x9440120D module: 20 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 16027 data: 0x9540120D module: 21 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 16029 data: 0x9640120D module: 22 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 16031 data: 0x9740120D module: 23 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 16033 data: 0x9840120D module: 24 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***            ADC data: block:  3402 ptr: 16035 data: 0xC4BA7DF1 module: 18 fail: 0 range: 0 id:  1210 channel: 58 adc: 32241  ts:
0x00000120D00000A5
 *** FEE64 discriminator: block:  3402 ptr: 16037 data: 0x85640080 module:  5 information type:  6 information field: 0x00040080 ts:
0x00000120D00000A9
 *** FEE64 discriminator: block:  3402 ptr: 16039 data: 0x86640080 module:  6 information type:  6 information field: 0x00040080 ts:
0x00000120D00000AC
 ***            ADC data: block:  3402 ptr: 16041 data: 0xC5F7812E module: 23 fail: 0 range: 0 id:  1527 channel: 55 adc: 33070  ts:
0x00000120D000010D
 ***            ADC data: block:  3402 ptr: 16043 data: 0xC5467E32 module: 21 fail: 0 range: 0 id:  1350 channel:  6 adc: 32306  ts:
0x00000120D000012D
 ***            ADC data: block:  3402 ptr: 16045 data: 0xC4C4801A module: 19 fail: 0 range: 0 id:  1220 channel:  4 adc: 32794  ts:
0x00000120D0000168
 ***            ADC data: block:  3402 ptr: 16047 data: 0xC54F7E07 module: 21 fail: 0 range: 0 id:  1359 channel: 15 adc: 32263  ts:
0x00000120D00001F5
 ***            ADC data: block:  3402 ptr: 16049 data: 0xC1907F13 module:  6 fail: 0 range: 0 id:   400 channel: 16 adc: 32531  ts:
0x00000120D000021D
 ***            ADC data: block:  3402 ptr: 16051 data: 0xC1B76F59 module:  6 fail: 0 range: 0 id:   439 channel: 55 adc: 28505  ts:
0x00000120D000021D
 *** FEE64 discriminator: block:  3402 ptr: 16053 data: 0x85640080 module:  5 information type:  6 information field: 0x00040080 ts:
0x00000120D0000268
 ***            ADC data: block:  3402 ptr: 16055 data: 0xC519804A module: 20 fail: 0 range: 0 id:  1305 channel: 25 adc: 32842  ts:
0x00000120D00002FD
 *** FEE64 discriminator: block:  3402 ptr: 16057 data: 0x85640080 module:  5 information type:  6 information field: 0x00040080 ts:
0x00000120D0000326
 ***            ADC data: block:  3402 ptr: 16059 data: 0xC3A57F86 module: 14 fail: 0 range: 0 id:   933 channel: 37 adc: 32646  ts:
0x00000120D000037D
 ***            ADC data: block:  3402 ptr: 16061 data: 0xC5707DD1 module: 21 fail: 0 range: 0 id:  1392 channel: 48 adc: 32209  ts:
0x00000120D0000385
 ***            ADC data: block:  3402 ptr: 16063 data: 0xC5B57F01 module: 22 fail: 0 range: 0 id:  1461 channel: 53 adc: 32513  ts:
0x00000120D00003AD
 ***            ADC data: block:  3402 ptr: 16065 data: 0xC2457E6F module:  9 fail: 0 range: 0 id:   581 channel:  5 adc: 32367  ts:
0x00000120D00003BD
 *** FEE64 discriminator: block:  3402 ptr: 16067 data: 0x85640080 module:  5 information type:  6 information field: 0x00040080 ts:
0x00000120D00003BD
 ***            ADC data: block:  3402 ptr: 16069 data: 0xC4C181BD module: 19 fail: 0 range: 0 id:  1217 channel:  1 adc: 33213  ts:
0x00000120D00003C0
 ***            ADC data: block:  3402 ptr: 16071 data: 0xC4ED80E8 module: 19 fail: 0 range: 0 id:  1261 channel: 45 adc: 33000  ts:
0x00000120D00003C0
 ***            ADC data: block:  3402 ptr: 16073 data: 0xC4F6812B module: 19 fail: 0 range: 0 id:  1270 channel: 54 adc: 33067  ts:
0x00000120D00003C0
 ***            ADC data: block:  3402 ptr: 16075 data: 0xC3457F08 module: 13 fail: 0 range: 0 id:   837 channel:  5 adc: 32520  ts:
0x00000120D000041D
 ***            ADC data: block:  3402 ptr: 16077 data: 0xC37C7FB1 module: 13 fail: 0 range: 0 id:   892 channel: 60 adc: 32689  ts:
0x00000120D000041D
 *** FEE64 discriminator: block:  3402 ptr: 16079 data: 0x85640080 module:  5 information type:  6 information field: 0x00040080 ts:
0x00000120D000043B
 *** FEE64 discriminator: block:  3402 ptr: 16081 data: 0x86640080 module:  6 information type:  6 information field: 0x00040080 ts:
0x00000120D000043B
 *** FEE64 discriminator: block:  3402 ptr: 16083 data: 0x81640080 module:  1 information type:  6 information field: 0x00040080 ts:
0x00000120D000043F
 *** FEE64 discriminator: block:  3402 ptr: 16085 data: 0x82640080 module:  2 information type:  6 information field: 0x00040080 ts:
0x00000120D0000440
 ***            ADC data: block:  3402 ptr: 16087 data: 0xC38A7F89 module: 14 fail: 0 range: 0 id:   906 channel: 10 adc: 32649  ts:
0x00000120D0000445
 ***            ADC data: block:  3402 ptr: 16089 data: 0xC3A68005 module: 14 fail: 0 range: 0 id:   934 channel: 38 adc: 32773  ts:
0x00000120D0000445
 ***            ADC data: block:  3402 ptr: 16091 data: 0xC3B07E25 module: 14 fail: 0 range: 0 id:   944 channel: 48 adc: 32293  ts:
0x00000120D0000445
 ***            ADC data: block:  3402 ptr: 16093 data: 0xC5737ED1 module: 21 fail: 0 range: 0 id:  1395 channel: 51 adc: 32465  ts:
0x00000120D000044D
 ***            ADC data: block:  3402 ptr: 16095 data: 0xC5A17F32 module: 22 fail: 0 range: 0 id:  1441 channel: 33 adc: 32562  ts:
0x00000120D0000475
 ***            ADC data: block:  3402 ptr: 16097 data: 0xC4FB80F3 module: 19 fail: 0 range: 0 id:  1275 channel: 59 adc: 33011  ts:
0x00000120D0000488
 ***            ADC data: block:  3402 ptr: 16099 data: 0xC37F7E9C module: 13 fail: 0 range: 0 id:   895 channel: 63 adc: 32412  ts:
0x00000120D00004E5
 ***            ADC data: block:  3402 ptr: 16101 data: 0xC1837FED module:  6 fail: 0 range: 0 id:   387 channel:  3 adc: 32749  ts:
0x00000120D000053D

Note - system-wide checks still OK despite time warp observed above
       no errors reported by merger since start of R11


Free memory before and after saving all L and H spectra to disk - see attachments 24-25
Some merger errors observed during save of all L and H spectra to disk - see attachment 26

FEE64 temperatures - Julabo FL11006 set point + 20 deg C - see attachment 27
                                    set point + 16 deg C - see attachment 28
Temperatures decrease typically ~ 2-4 deg C which implies that the coolant loop is working as expected.
However, +16 deg C is marginal due to relative humidity variations ~40-55% corresponding to Dew Point
temperatures of ~12-14 deg C. Returning Julabo FL11006 set point to +20 deg C.
  756   Thu Nov 1 00:24:23 2018 TD, OH, CAThursday 1 November
09.24 DAQ continues OK - current file Oct18/R12_116
      alpha background run

09.20 all system wide checks OK *except* nnaida7 fails ADC calibration

      detector biases & leakage currents OK - see attachments 1 & 2

      FEE64 temperatures OK - see attachment 3
      good event statistics OK *except* nnaida17 c. 400k - see attachment 4
      nnaida2 rate due to one hot channel as before

      Merger - Link16 errors reported - see attachment 5
      TapeServer OK - see attachment 6

      problem with nnaida17 rate resolved with ASIC check load - see attachment 7
  
      1.8.L spectra - see attachments 7 & 8

       N.B. evidence of minimally ionising particles (presumably protons) from beam to F11 E detector
            ~10-15cm Pb bricks were placed within BRIKEN (CH2)n stack to stop heavy particles

      1.8.W spectra 20us FSR - see attachments 9 & 10

09.33 DAQ stop - file Oct18/R12_117
      All Oct18/R12_* files deleted

09.34 all spectra zero'd
      DAQ start - file Oct18/R13
      alpha background run

      all FEE64 good events statistics OK - see attachment 11

15.11 DAQ continues ok, on file Oct18/R13_2 (alpha run)
      system wide checks ok, except nnaida7 failing ADC calibration
      FEE64 temperatures ok (attachment 13)
      detector bias and leakage currents ok (attachment 14)
      good event statistics ok, except nnaida2 due to one hot channel (attachment 15)
      Merger and TapeServer ok, no errors in terminal

15.20 DAQ stop - file Oct18/R13_2
      
15.24 Lowered slow comparator threshold from 100 to 10
      good event statistics ok (attachment 16)

15.42 took waveforms, triggering ok (attachment 17)
      raised slow comparator threshold to 100 from 10
      start DAQ (R14)
      nnaida22, no statistics showing (see attachment 18)
      subsequent failure to connect to nnaida2

16:44 fixed by rebooting nnaida2 *only*, nnaida2 reset, setup all FEE64s
      slow comparator threshold re-raised from 10 to 100, as default was restored
      DAQ and alpha run restarted (R15)
      Merger and TapeServer ok, no errors in terminal
      good event statistics all ok, except for nnaida2 hot channel (attachment 19)
      
      
ELOG V3.1.3-7933898