AIDA GELINA BRIKEN nToF CRIB ISOLDE CIRCE nTOFCapture DESPEC DTAS EDI_PSA 179Ta CARME StellarModelling DCF K40
  AIDA, Page 2 of 46  ELOG logo
ID Date Authordown Subject
  338   Fri Aug 19 09:43:27 2016 TD, VP, reply PJCSFriday 19 August
> 
> 14.00 Both AIDA NIM bins U/S 
>       Upper NIM bin - BNC PB-4, Ortec 433, 2x CAEN N1419, 1x CAEN N1419B - ac mains fuse 100V/8A/slow? blowing
>       Lower NIM bin - 11x MACB - not powering up
> 
>       Replaced both NIM bins.
>       Upper NIM bin - 11x MACB
>       Lower NIM bin - BNC PB-4, Ortec 433, 2x CAEN N1419, 1x CAEN N1419B
> 
> 15.50 Julabo FL11006 chiller ON - set point +20 deg C
>       B2F/F11 ambient temp +24.0 deg C, RH 54%, DP +13.8 deg C
> 
>       Bias 6x MSL type BB18 DSSSDs - see attachments 1-2
> 
> 16.10 Startup DAQ nnaida1-24 *except* nnaida19
> 
>       System-wide checks
> 
>       Check clock status OK
>       Check ADC calibration - nnaida7 failed
>       Check ASIC clock timestamp - multiple failures - see attachment 3
>       Check SYNC errors not counted Since Baseline - see attachment 4
>       Check SYNC pulses received - see attachment 5
> 
>       BNC PB-4 
> 
>       Amplitude 90,000, x5 attenuator IN
>       t_r 50ns, tau_d 50us
>       Polarity -
>       INT ref, delay MIN, tail pulse
> 
>       FEE64 temperatures - see attachment 6
> 
> 16.34 R1 starts (directory Aug2016)
> 
>       slow comparator 0x10, LEC/MEC fast comparator 0x10
> 
>       merge 555k data items/s, tapeserver 4430 kb/s
Looks like a problem with the inter-MACB wiring.
The screen shots show groups of 4 with the problems.
I suggest re-seating the short HDMI cables and reset the system.
  339   Fri Aug 19 11:07:44 2016 TD, VP, reply PJCSFriday 19 August
> > 
> > 14.00 Both AIDA NIM bins U/S 
> >       Upper NIM bin - BNC PB-4, Ortec 433, 2x CAEN N1419, 1x CAEN N1419B - ac mains fuse 100V/8A/slow? blowing
> >       Lower NIM bin - 11x MACB - not powering up
> > 
> >       Replaced both NIM bins.
> >       Upper NIM bin - 11x MACB
> >       Lower NIM bin - BNC PB-4, Ortec 433, 2x CAEN N1419, 1x CAEN N1419B
> > 
> > 15.50 Julabo FL11006 chiller ON - set point +20 deg C
> >       B2F/F11 ambient temp +24.0 deg C, RH 54%, DP +13.8 deg C
> > 
> >       Bias 6x MSL type BB18 DSSSDs - see attachments 1-2
> > 
> > 16.10 Startup DAQ nnaida1-24 *except* nnaida19
> > 
> >       System-wide checks
> > 
> >       Check clock status OK
> >       Check ADC calibration - nnaida7 failed
> >       Check ASIC clock timestamp - multiple failures - see attachment 3
> >       Check SYNC errors not counted Since Baseline - see attachment 4
> >       Check SYNC pulses received - see attachment 5
> > 
> >       BNC PB-4 
> > 
> >       Amplitude 90,000, x5 attenuator IN
> >       t_r 50ns, tau_d 50us
> >       Polarity -
> >       INT ref, delay MIN, tail pulse
> > 
> >       FEE64 temperatures - see attachment 6
> > 
> > 16.34 R1 starts (directory Aug2016)
> > 
> >       slow comparator 0x10, LEC/MEC fast comparator 0x10
> > 
> >       merge 555k data items/s, tapeserver 4430 kb/s
> Looks like a problem with the inter-MACB wiring.
> The screen shots show groups of 4 with the problems.
> I suggest re-seating the short HDMI cables and reset the system.

Short HDMI cables re-seated. See attachment 1
Attachment 1: 7.png
7.png
  340   Fri Aug 19 12:41:43 2016 TD, VP, reply PJCSFriday 19 August
> > > 
> > > 14.00 Both AIDA NIM bins U/S 
> > >       Upper NIM bin - BNC PB-4, Ortec 433, 2x CAEN N1419, 1x CAEN N1419B - ac mains fuse 100V/8A/slow? blowing
> > >       Lower NIM bin - 11x MACB - not powering up
> > > 
> > >       Replaced both NIM bins.
> > >       Upper NIM bin - 11x MACB
> > >       Lower NIM bin - BNC PB-4, Ortec 433, 2x CAEN N1419, 1x CAEN N1419B
> > > 
> > > 15.50 Julabo FL11006 chiller ON - set point +20 deg C
> > >       B2F/F11 ambient temp +24.0 deg C, RH 54%, DP +13.8 deg C
> > > 
> > >       Bias 6x MSL type BB18 DSSSDs - see attachments 1-2
> > > 
> > > 16.10 Startup DAQ nnaida1-24 *except* nnaida19
> > > 
> > >       System-wide checks
> > > 
> > >       Check clock status OK
> > >       Check ADC calibration - nnaida7 failed
> > >       Check ASIC clock timestamp - multiple failures - see attachment 3
> > >       Check SYNC errors not counted Since Baseline - see attachment 4
> > >       Check SYNC pulses received - see attachment 5
> > > 
> > >       BNC PB-4 
> > > 
> > >       Amplitude 90,000, x5 attenuator IN
> > >       t_r 50ns, tau_d 50us
> > >       Polarity -
> > >       INT ref, delay MIN, tail pulse
> > > 
> > >       FEE64 temperatures - see attachment 6
> > > 
> > > 16.34 R1 starts (directory Aug2016)
> > > 
> > >       slow comparator 0x10, LEC/MEC fast comparator 0x10
> > > 
> > >       merge 555k data items/s, tapeserver 4430 kb/s
> > Looks like a problem with the inter-MACB wiring.
> > The screen shots show groups of 4 with the problems.
> > I suggest re-seating the short HDMI cables and reset the system.
> 
> Short HDMI cables re-seated. See attachment 1

ok, the discrepancy is odd. Not sure if it is due to an uneven reset or more noise in the wiring.
In system wide checks redo the baseline for the SYNC error counters and keep an eye on it.

Maybe a power cycle will bring all the SYNC received counters into line.

Certainly they should be exactly the same.

Is there any correlation between the ones that are wrong and the MACB layout/cabling ?
  529   Tue Dec 6 06:38:46 2016 TD, Updated PatrickCAEN N1419 HV output common mode noise
There appears to be significant common mode noise on the output of the
CAEN N1419 4 Ch Reversible 500 V/200 µA NIM HV Power Supply Module (USB)
- the specification quotes 'Max Ripple smaller than < 5mVpp'. We configure
the CAEN N1419 outputs as floating wrt NIM module/crate chassis.

For example, attachment 1, shows the output of module #2 (Addr 01) channel #3
(unused channel) set to 10V (leakage current 0.030uA) - core (Ch 1)/braid (Ch 2).
Tektronix 3034C channels 1 & 2 are both set ac/1M.

Attachment 2 shows math function Ch 1 - Ch 2 (50mV/division cf. 200mV/division
for Ch 1 and Ch 2)

Attachment 3 shows CAEN N1419 #2 settings

Attachment 4 per attachments 1 & 2 *except* the cables from channels 0 and 1
of CAEN N1419 #2 have been disconnected from the NIM module. The structure of
the common mode noise changes but its amplitude remains significant. This
presumably indicates that there are other sources of common mode noise in
addition to that observed at the output of the CAEN N1419 HV outputs.

Attachments 5 & 6 show the NIM crate front panel +6V output wrt ground
for the lower (NIM Bin type REPIC,  BNC PB-4, Ortec 433, 2x MACB, 2x CAEN N1419,
1x CAEN 1419B) and upper (NIM Bin type OKEN, 9x MACB) AIDA NIM bins respectively.
All +/-24V, +/-12V and +/-6V front panel outputs show the same noise structure.

Attachment 7 shows equivalent of attachment 6 but using Tektronix DPO3054
which can display FFT.

Update -----------------------------------------
Tested the CAEN HV supply in T9 using the same method and observed similar results.

With help from Mos Kogimtzis a better method of measuring the HV noise was used.
The co-ax from the isolated output of the HV module was connected to one input of the 'scope. HV set to 1V.
Thus the screen of the HV signal is grounded at the 'scope amplifier input. This nearer to how the HV is used with a detector. 
The single signal input channel was set to DC 1MR with an offset of 1V.
The 'scope can now display at 4mV/division. 
The peak/peak was less than 5mV.See attachment 8 slide 1

There are features at both high and low frequency, attachments slides 2 and 3. NB 1mV/division.

If a differential measurement is required then a suitable cable with a shielded twisted pair is needed.

Update #2 -----------------------------------------
Moved the AIDA T9 HV supply to a CAEN NIM bin. Newly purchased this year.
This is the only module in the bin.
 Used the simple method of noise measuring as before with the same cables and 'scope.
Attachment 9 shows there is a different type of noise. Not regular like attachment 8 but more random and larger.

The HV is set to 1V.

Further investigation will be carried out using AC coupling and HV set to 50V.
Attachment 1: 200.png
200.png
Attachment 2: 201.png
201.png
Attachment 3: 202.png
202.png
Attachment 4: 203.png
203.png
Attachment 5: 210.png
210.png
Attachment 6: 211.png
211.png
Attachment 7: 220.png
220.png
Attachment 8: HV_noise.pdf
HV_noise.pdf HV_noise.pdf HV_noise.pdf
Attachment 9: HV_Noise_Caen_in_Caen.pdf
HV_Noise_Caen_in_Caen.pdf
  68   Thu Apr 23 09:02:57 2015 TD, PatrickFEE64 Fast Discriminator OR o/p via MACB
> Illustration of the trigger timing of the AIDA FEE64 fast discriminator OR output via the
> MACB front panel Trigger outputs.
> 
> Channel 1: BNC PB-4 Pulser Trigger Output
> Channel 2: BNC PB-4 Pulser Analogue Output
> Channel 3: MACB Trigger Output
> 
> MACB Trigger Output: NIM complement
>                      width ~ 7us
>                      delay ~ 750ns (with respect to BNC PB_4 Pulser Analogue Output)
> 
> Example illustrates MAC Trigger Output from nnaida5 with standard ASIC settings and
> LEC/MEC fast discriminator 0x40

It would be useful to show the Trigger signal at the different levels of the MACB distribution system... then 
the difference will show the delay through the MACB layer.

Are you able to estimate the length of cable between the pulser and the adaptor boards.

What are the conclusions about the delay .... is it too much to be useful ?
  673   Mon Jun 19 08:58:00 2017 TD, PatrickReport - high - 'zero all histograms' doesn't
> 
> The DAQ Run Control 'zero all histograms' function appears to have stopped working
> - an issue related to the new RunControl/sys.tcl ... ?
> 
> See https://elog.ph.ed.ac.uk/AIDA/662

Fault discovered and file edited at Daresbury.
A piece of random text was in the " zero histograms" process.

The repaired file has been installed in RIKEN.
  608   Mon May 29 00:59:27 2017 TD, PV, CB, NN, OHMonday 29 May
09.00 DAQ continues OK 
      Current file May2017/R32_239

      Detector biases; leakage currents OK - see attachments 1 & 2
      FEE64 Temperatures OK - see attachment 3
      good events; statistics OK - see attachment 4
      Some error messages reported by merger yesterday but none overnight - see attachment 5

      *all* system wide checks OK *except* ADC calibration of nnaida1, 21 and nnaida1 clock status (status =6)

09.33 E17/F11 ambient temperature +24.0 deg C, RH 38.0%, d.p. +8.8 deg C
      Julabo FL11006 set point +20 deg C, actual +20.0 deg C, water level OK (c. 75%)

09.35 Analysis of R32_259 - OK see attachment 6

10.50 Offline analysis R32_277 - ADC & disc data synchronised - see attachments 7-9

11.00 DAQ stop OK 
      File May2017/R32_280

      Check ASIC control x2
      Zero all spectra

11.05 DAQ go
      File May2017/R33

      BNC PB-4
      Amplitude 90,000
      x5 attenuator IN
      t_r 100ns tau_d 50us
      - polarity
      frequency 25Hz range
      delay MIN, tail pulse, INT ref

      ASIC settings 2017Mar27-16.12.39 *except*
      slow comparator 0x0a
      LEC/MEC fast comparator 0x20

15.00 Merger crashed (SEGV) - see https://elog.ph.ed.ac.uk/AIDA/607

      DAQ stop
      Restart Merger
      DAQ stop OK following transient nnaida1 timeout

      Close merger/tapeserver browser, kill httpd for merger/tapeserver,merger and tapeserver terminal server
sessions
      Disable histogramming and data transfer #1
      DAQ reset, setup
      Restart merger and tapeserver
      Enable histogramming and data transfer #1

      *all* system wide checks OK *except* nnaida1 & nnaida21 fail ADC calibration, nnaida1 clock status=6

15.18 DAQ start
      File May2017/R34

15.25 no merger error messages
      nnaida1 & nnaida2 good events high - ~100k and ~120k respectively - see attachment 10

16.24 removed R32
      System wide checks - ASIC clock timestamp test fails on all nnaidas. Synchronised clocks. ASIC clock test
      passes.
      FEE temperatures, leakage currents - OK
      Merger reports 

      Merge: Restarting from timestamp 1 or greater
      Merge: Starting at timestamp 27d1e55c00a0
      Merge: Trying to add items to Q index 21 (Link 21) but queue already full

      Probably as a result of ADC clock synchronisation.

17:03 Used analyser on R34_23. No timewarps, negligible dead time. All other values as normal.

17.19 FEE64 temperatures, leakage currents - OK
      nnaida1 & nnaida 2 good events still high - ~100k roughly
      No further messages from merger

17.45 DAQ continues OK
      BRIKEN reports increased neutron and gamma activity. No apparent effect on AIDA rates.

18.50 DAQ continues OK
      FEE64 temperatures, leakage currents - OK
      No merger errors
      Used analyser on run R34_49 - no timewarps, rates as expected

19.30 BigRIPS optimisation ongoing. DAQ continues OK
      FEE64 temperatures, leakage currents - OK
      No merger error messages
      No panics from USB device monitor
      Used analyser on R34_58 - no timewarps, ADC data format ~ 1Mhz, other rates OK, 
                                highest dead time = ~2 s/254 s on nnaida 2 

20.00 BigRIPS optimisation ongoing. DAQ continues OK
      FEE64 temperatures, leakage currents - OK
      No merger error messages
      No panics from USB device monitor
      Used analyser on R34_63 - no timewarps, ADC data format ~ 1Mhz, other rates OK, 
                                highest dead time = ~1.3 s/255 s on nnaida 2 

20.15 BigRIPS reports beam optimisation may be over soon.
      DAQ continues OK.

20.47 BigRIPS optimisation ongoing. DAQ continues OK
      FEE64 temperatures, leakage currents - OK
      No merger error messages
      No panics from USB device monitor
      Used analyser on R34_76 - no timewarps, ADC data format ~ 1Mhz, other rates OK, 
                                highest dead time = ~1.1 s/255 s on nnaida 2 

21.49 BigRIPS optimisation ongoing. DAQ continues OK
      FEE64 temperatures, leakage currents - OK
      No merger error messages
      No panics from USB device monitor
      Used analyser on R34_90 - no timewarps, ADC data format ~ 1Mhz, other rates OK, 
                                highest dead time = ~2.0 s/258 s on nnaida 2 

23.05 BigRIPS optimisation ongoing. DAQ continues OK
      FEE64 temperatures, leakage currents - OK
      No merger error messages
      No panics from USB device monitor
      Used analyser on R34_109 - no timewarps, ADC data format ~ 1Mhz, other rates OK, 
                                highest dead time = ~1.9 s/256 s on nnaida 2 
Attachment 1: 1.png
1.png
Attachment 2: 2.png
2.png
Attachment 3: 3.png
3.png
Attachment 4: 4.png
4.png
Attachment 5: 5.png
5.png
Attachment 6: R32_259
 *** TDR format 3.3.0 analyser - TD - October 2016
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  258193721 (  926348.5 Hz)
        Other data format:    2894279 (   10384.1 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:         84 (       0.3 Hz)
                               RESUME:         84 (       0.3 Hz)
                              SYNC100:    2550936 (    9152.3 Hz)
                           FEE64 disc:     233790 (     838.8 Hz)
                             MBS info:     109385 (     392.5 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:       3405 (      12.2 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:      278.722 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  1                0.349                0.136
  2                0.125                0.000
  3                0.000                0.000
  4                0.000                0.000
  5                0.048                0.000
  6                0.000                0.000
  7                0.000                0.000
  8                0.000                0.000
  9                0.155                0.000
 10                0.145                0.000
 11                0.000                0.000
 12                0.000                0.000
 13                0.000                0.000
 14                0.001                0.000
 15                0.000                0.000
 16                0.000                0.000
 17                0.123                0.000
 18                0.382                0.000
 19                0.049                0.000
 20                0.000                0.000
 21                0.000                0.000
 22                0.004                0.000
 23                0.028                0.000
 24                0.010                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100       Disc        MBS      Other   HEC Data
  0          0          0          0          0          0          0          0          0          0          0          0
  1   24166310     115330          0          0         10         10     106183       9127          0          0        238
  2   21829349     119893          0          0          4          4     106267      13618          0          0          0
  3    8201298     115714          0          0          0          0     106309       9405          0          0          0
  4    2026665     113519          0          0          0          0     106310       7209          0          0         53
  5   11328404     117954          0          0         16         16     106295      11627          0          0          0
  6    1555200     222934          0          0          0          0     106312       7237     109385          0          7
  7    3064531     113484          0          0          0          0     106315       7169          0          0         21
  8    2396557     115694          0          0          0          0     106307       9387          0          0        182
  9   19087639     114054          0          0          6          6     106251       7791          0          0          0
 10   21158871     119871          0          0          5          5     106259      13602          0          0          0
 11    4618142     115488          0          0          0          0     106313       9175          0          0          0
 12    5119593     113434          0          0          0          0     106308       7126          0          0          0
 13    8516381     117178          0          0          0          0     106313      10865          0          0          0
 14    9884029     114016          0          0          1          1     106311       7703          0          0        864
 15    7843269     115863          0          0          0          0     106305       9558          0          0          1
 16    7429424     114651          0          0          0          0     106312       8339          0          0          0
 17   13649798     115646          0          0         12         12     106264       9358          0          0          3
 18   18654367     119620          0          0         15         15     106163      13427          0          0          0
 19   13181865     119343          0          0          5          5     106292      13041          0          0          1
 20    9350627     114203          0          0          0          0     106309       7894          0          0       1722
 21    8911645     120455          0          0          0          0     106311      14144          0          0        307
 22   10687802     116186          0          0          2          2     106311       9871          0          0          0
 23   13463277     113787          0          0          4          4     106304       7475          0          0          6
 24   12068678     115962          0          0          4          4     106312       9642          0          0          0
 25          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0

 *** Program elapsed time:   18.391s ( 1740.017 blocks/s, 108.751 Mb/s)
Attachment 7: 6.png
6.png
Attachment 8: 7.png
7.png
Attachment 9: 8.png
8.png
Attachment 10: 10.png
10.png
  620   Thu Jun 1 00:00:25 2017 TD, PV, CBThusrday 1 June 08.00-16.00
07.57 run continues
      BRIKEN start run 55
      BigRIPS start run 1066
      AIDA file RIBF127R1/R1_763

      BNC PB-4
      Amplitude 90,000
      x5 attenuator IN
      t_r 100ns tau_d 50us
      - polarity
      frequency 25Hz range
      delay MIN, tail pulse, INT ref

      ASIC settings 2017Mar27-16.12.39

      84Zn BigRIPS setting, 78Ni degrader setting - 5mm (in F7) + 9mm (in F11) + 1mm (in F11) = 16 mm Al


09.01 DAQ stop BigRIPS, BRIKEN
      AIDA file RIBF127R1/R1_779

09.03 BRIKEN start run 56
      BigRIPS start run 1067
      AIDA file RIBF127R1/R1_779

09.32 Beam dropped
      AIDA file RIBF127R1/R1_786

09.38 DAQ stop BigRIPS, BRIKEN
      AIDA file RIBF127R1/R1_788

09.43 Beam is back      
      BRIKEN start run 57
      BigRIPS start run 1068
      AIDA file RIBF127R1/R1_789      

09.55 Beam is off
      There will be no beam for 1 hour, accelerator people want to check the ion source.
      DAQ stop BigRIPS, BRIKEN
      AIDA file R1_792

10.29 Beam is back
      BRIKEN start run 58
      BigRIPS start run 1069
      AIDA file 799
      Beam intensity reduced half, then slowly increasing


11.29 DAQ stop BigRIPS, BRIKEN
      AIDA file RIBF127R1/R1_813

11.29 BRIKEN start run 59
      BigRIPS start run 1070
      AIDA file RIBF127R1/R1_813
      
11.32 Sorted file RIBF127R1/R1_811. DSSSD rates are as follows

*** data items:    2431382 ( 108760.05 Hz)
 *** ADC events:     260316 (  11644.40 Hz)
 *** time warps:          0 (      0.00 Hz)
 *** DSSSD # 1 count:    109746 old count:     88603 dt:      2.40 s  LEC rate:  45784.75 Hz
 *** DSSSD # 2 count:    148624 old count:    119105 dt:      2.40 s  LEC rate:  62004.19 Hz
 *** DSSSD # 3 count:     50556 old count:     40453 dt:      2.40 s  LEC rate:  21091.37 Hz
 *** DSSSD # 4 count:     43410 old count:     35484 dt:      2.40 s  LEC rate:  18110.14 Hz
 *** DSSSD # 5 count:     17933 old count:     14701 dt:      2.40 s  LEC rate:   7481.44 Hz
 *** DSSSD # 6 count:     36412 old count:     30468 dt:      2.40 s  LEC rate:  15190.66 Hz
 *** DSSSD # 1 count:        42 old count:        40 dt:      2.40 s  HEC rate:     17.52 Hz
 *** DSSSD # 2 count:        85 old count:        70 dt:      2.40 s  HEC rate:     35.46 Hz
 *** DSSSD # 3 count:        85 old count:        76 dt:      2.40 s  HEC rate:     35.46 Hz
 *** DSSSD # 4 count:        58 old count:        51 dt:      2.40 s  HEC rate:     24.20 Hz
 *** DSSSD # 5 count:        35 old count:        28 dt:      2.40 s  HEC rate:     14.60 Hz
 *** DSSSD # 6 count:         7 old count:         6 dt:      2.40 s  HEC rate:      2.92 Hz
     

11.40 Detector biases & leakage currents OK - see attachments 1
      FEE64 Temperatures OK - see attachment 2
      good events statistics OK - see attachment 3
      No new merger error messages - see attachment 4

      *all* system wide checks OK *except* ADC calibration of nnaida1, 21 and nnaida1 clock status (status=6)
      all SortSas spectra zero'd

11.45 Analysed RIBF127R1/R1_815 - see attachment 5
      No timewarps
      Negligible deadtime. No idle time issues.

11.49 System console log ttyUSB7 (nnaida1) attached - see attachment 6
      Current HEC hit pattern OK - see attachment 7


12.40 DAQ stop BigRIPS, BRIKEN
      AIDA file RIBF127R1/R1_829

12.43 BRIKEN start run 60
      BigRIPS start run 1071
      AIDA file RIBF127R1/R1_830

13.45 DAQ stop BigRIPS, BRIKEN
      AIDA file RIBF127R1/R1_844

13.46 BRIKEN start run 61
      BigRIPS start run 1072
      AIDA file RIBF127R1/R1_845
      
      all SortSas online spectra zero'd
      x-y hit pattern OK

13:56 System wide checks all ok
      Screenshots included for merger, statistics and FEE temperatures - attachments 8-10

14:04 leakages and Biases ok - attachment 11

14.46 DAQ stop BigRIPS, BRIKEN
      AIDA file RIBF127R1/R1_858

14.47 BRIKEN start run 62
      BigRIPS start run 1073
      AIDA file RIBF127R1/R1_858
      
      all SortSas online spectra zero'd

14:56 online analysis x-y hit pattern OK - attachment 12

15.46 DAQ stop BigRIPS, BRIKEN
      AIDA file RIBF127R1/R1_872

15.47 BRIKEN start run 63
      BigRIPS start run 1074
      AIDA file RIBF127R1/R1_872

15.57 R1_873.txt checked
      No timewarps
      Negligible deadtime. No idle time issues.


16.22 Detector biases & leakage currents OK - see attachments 14
      No new merger error messages - see attachment 15
      FEE64 Temperatures OK - see attachment 16
      good events statistics OK - see attachment 17


      
Attachment 1: 46.bias_current.png
46.bias_current.png
Attachment 2: 45.temperature.png
45.temperature.png
Attachment 3: 44.statistics.png
44.statistics.png
Attachment 4: 48.mergerstat.png
48.mergerstat.png
Attachment 5: analysis.815
 *** TDR format 3.3.0 analyser - TD - October 2016
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  256510495 (  991772.3 Hz)
        Other data format:    4577505 (   17698.5 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:         97 (       0.4 Hz)
                               RESUME:         97 (       0.4 Hz)
                              SYNC100:    2366841 (    9151.2 Hz)
                           FEE64 disc:    2156491 (    8337.9 Hz)
                             MBS info:      53979 (     208.7 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:     256300 (     991.0 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:      258.638 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  1                0.309                0.283
  2                0.653                0.600
  3                0.000                0.000
  4                0.000                0.000
  5                0.037                0.000
  6                0.011                0.000
  7                0.000                0.000
  8                0.000                0.000
  9                0.306                0.000
 10                0.092                0.000
 11                0.000                0.000
 12                0.000                0.000
 13                0.000                0.000
 14                0.000                0.000
 15                0.000                0.000
 16                0.000                0.000
 17                0.249                0.000
 18                0.202                0.000
 19                0.041                0.000
 20                0.000                0.000
 21                0.000                0.000
 22                0.031                0.000
 23                0.054                0.000
 24                0.009                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100       Disc        MBS      Other   HEC Data
  0          0          0          0          0          0          0          0          0          0          0          0
  1   23863105     213551          0          0          7          7      98535     115002          0          0      22930
  2   26671646     201124          0          0         13         13      98399     102699          0          0      18859
  3    7685889     111581          0          0          0          0      98653      12928          0          0        257
  4    2022109     122842          0          0          0          0      98652      24190          0          0       1626
  5   10324368     115031          0          0         14         14      98635      16368          0          0        482
  6   10535388     181261          0          0          4          4      98642      28632      53979          0       3063
  7    2836123     133202          0          0          0          0      98650      34552          0          0       3326
  8    2034879     113514          0          0          0          0      98651      14863          0          0        535
  9   18374439     242794          0          0         10         10      98534     144240          0          0      13931
 10   20003037     180032          0          0          3          3      98604      81422          0          0       8418
 11    4107837     144103          0          0          0          0      98646      45457          0          0       4631
 12    4979065     186442          0          0          0          0      98649      87793          0          0       8493
 13    8360349     184191          0          0          0          0      98646      85545          0          0       8877
 14    9734616     242049          0          0          0          0      98656     143393          0          0      15937
 15    7393917     233625          0          0          0          0      98648     134977          0          0      14603
 16    6245783     170966          0          0          0          0      98652      72314          0          0       9263
 17   13133414     128745          0          0         18         18      98556      30153          0          0       2259
 18   16347131     115952          0          0          9          9      98572      17362          0          0        312
 19   12610010     234139          0          0          5          5      98634     135495          0          0      12968
 20    8625573     304896          0          0          0          0      98658     206238          0          0      16652
 21    8833612     208365          0          0          0          0      98651     109714          0          0      22849
 22   10719884     233904          0          0          6          6      98638     135254          0          0      26499
 23   11144999     318294          0          0          6          6      98630     219652          0          0      20781
 24    9923322     256902          0          0          2          2      98650     158248          0          0      18749
 25          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0

 *** Program elapsed time:   41.762s (  766.252 blocks/s,  47.891 Mb/s)
Attachment 6: ttyUSB7
executing generic doStop
EXPERIMENTS/AIDA/Options/nnaida1 Stat.offset NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Aida_Hist_W_Enable NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 TS_SYNC_PHASE NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 ExtClk NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Aida.shift NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 MACB_TRIG_MODE NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Aida.offset NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Aida_GroupBase NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Rate.channels NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Stat.channels NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Aida.Vchannels NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 ASIC.settings NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 WAVE_DMA_HWM NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Aida_Hist_D_Enable NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Stat.shift NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Aida.Wchannels NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Aida_Hist_V_Enable NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Include.Aida NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Aida.channels NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 DataAcqPgm NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Aida_Hist_H_Enable NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 DataFormat NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 ASIC_DMA_HWM NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Aida_Hist_L_Enable NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Index NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
DataAcqCommand 1 Halt
Aida state now Stopped. AidaExecV8_52: Build 170816 
Halt (1)
DataAcqCommand 1 disconnect xfer stream #0
disconnect xfer stream #0 (1)
completed generic doStop
executing generic doGo
EXPERIMENTS/AIDA/Options/nnaida1 Stat.offset NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Aida_Hist_W_Enable NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 TS_SYNC_PHASE NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 ExtClk NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Aida.shift NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 MACB_TRIG_MODE NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Aida.offset NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Aida_GroupBase NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Rate.channels NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Stat.channels NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Aida.Vchannels NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 ASIC.settings NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 WAVE_DMA_HWM NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Aida_Hist_D_Enable NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Stat.shift NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Aida.Wchannels NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Aida_Hist_V_Enable NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Include.Aida NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Aida.channels NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 DataAcqPgm NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Aida_Hist_H_Enable NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 DataFormat NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 ASIC_DMA_HWM NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Aida_Hist_L_Enable NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Index NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
DataAcqCommand 3 connect xfer stream #0
Initialising communication with storage server myserver on port 11001
Setting Transfer Block Size 65536
Setting Transfer Mode 3
Setting Overlap Mode 0
Setting Blocking Mode 0
Setting nice 0
TCP transfer library version 3.12
TCP socket send buffer was 16384 - now 221184
TCP socket receive buffer was 87380 - now 221184
TCP socket created OK - now connecting to myserver port 11001
Connected to myserver port 11001
connect xfer stream #0 (1)
DataAcqCommand 2 Go
Data Acquisition Statistics counters now cleared
ASIC DMA buffer size 2097152; WAVE DMA buffer size 1048576
Aida state now Going. AidaExecV8_52: Build 170816 
Go (1)
Running Go_Electronics for nnaida1 with TSMaster nnaida6
ADCs Calibrated. 
get_WAVEBlk (A) which = 0 ---- status = 0048, State machines = 0201
WV:0:Buffer info. Length = 64 : Offset = 0 
WV:1:Buffer info. Length = 62 : Offset = 2 
WV:2:Buffer info. Length = 60 : Offset = 4 
WV:3:Buffer info. Length = 58 : Offset = 6 
WV:4:Buffer info. Length = 56 : Offset = 8 
WV:5:Buffer info. Length = 54 : Offset = 10 
WV:6:Buffer info. Length = 52 : Offset = 12 
WV:7:Buffer info. Length = 50 : Offset = 14 
WV:8:Buffer info. Length = 48 : Offset = 16 
WV:9:Buffer info. Length = 46 : Offset = 18 
Finished Go_Electronics for AIDA
get_WAVEBlk (A) which = 1 ---- status = 0088, State machines = 0504
completed generic doGo
get_WAVEBlk (A) which = 0 ---- status = 0048, State machines = 0201
get_WAVEBlk (A) which = 1 ---- status = 0088, State machines = 0201
get_WAVEBlk (A) which = 0 ---- status = 0048, State machines = 0201
get_WAVEBlk (A) which = 1 ---- status = 0088, State machines = 0201
get_WAVEBlk (A) which = 0 ---- status = 0048, State machines = 0201
get_WAVEBlk (A) which = 1 ---- status = 0088, State machines = 0201
get_WAVEBlk (A) which = 0 ---- status = 0048, State machines = 0201
get_WAVEBlk (A) which = 1 ---- status = 0088, State machines = 0404
In RDOGo_Operate: Enabled Correlation, ASIC and discriminator readout
executing generic doStop
EXPERIMENTS/AIDA/Options/nnaida1 Stat.offset NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Aida_Hist_W_Enable NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 TS_SYNC_PHASE NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 ExtClk NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Aida.shift NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 MACB_TRIG_MODE NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Aida.offset NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Aida_GroupBase NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Rate.channels NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Stat.channels NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Aida.Vchannels NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 ASIC.settings NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 WAVE_DMA_HWM NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Aida_Hist_D_Enable NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Stat.shift NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Aida.Wchannels NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Aida_Hist_V_Enable NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Include.Aida NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Aida.channels NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 DataAcqPgm NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Aida_Hist_H_Enable NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 DataFormat NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 ASIC_DMA_HWM NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Aida_Hist_L_Enable NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
EXPERIMENTS/AIDA/Options/nnaida1 Index NOT available: error 0x10004; unable to access CONTENTS for node /MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1: couldn't open "/MIDAS/DB/EXPERIMENTS/AIDA/Options/nnaida1/CONTENTS": permission denied
DataAcqCommand 1 Halt
Aida state now Stopped. AidaExecV8_52: Build 170816 
Halt (1)
DataAcqCommand 1 disconnect xfer stream #0
disconnect xfer stream #0 (1)
completed generic doStop


Flash base address=FC000000

Set Flash to ASync Mode

XFLASH_PART_NOT_SUPPORTED

Finished copying zImage to RAM 


Found 0 errors checking kernel image

VHDL version number 0X01900C1F 

Bootloader version number 1.2.7 -- 22nd August 2012

Starting LMK 3200 setup 


Setting LMK03200 to standard clock settings -- External Clock 23Nov15

.... SPI Base Address=0x81400000

clk_control_reg=0x4
Next step is SPIconfig

Control 32(0x81400000)=0x180

SlaveSel(0x81400000)=0x3

Ctrl(0x81400000)=0xE6

Ctrl(0x81400000)=0x86
SPIconfig done now to set up the LMK3200 registers
LMK #0 : regInit[0]=0x80000000
LMK #0 : regInit[1]=0x10070600
LMK #0 : regInit[2]=0x60601
LMK #0 : regInit[3]=0x60602
LMK #0 : regInit[4]=0x60603
LMK #0 : regInit[5]=0x70624
LMK #0 : regInit[6]=0x70605
LMK #0 : regInit[7]=0x70606
LMK #0 : regInit[8]=0x70627
LMK #0 : regInit[9]=0x10000908
LMK #0 : regInit[10]=0xA0022A09
LMK #0 : regInit[11]=0x82800B
LMK #0 : regInit[12]=0x28C800D
LMK #0 : regInit[13]=0x830020E
LMK #0 : regInit[14]=0xC800180F

Calibrate completed at 942 counts

Setting Clock Control =0x0000000B, to set GOE and sync bit

Ctrl @ SPIstop (0x81400000)=0x186

0 delay setup completed at 0 counts

Finished Clock setup LMK03200

completed LMK 3200 setup 

Loaded all four ASICs with default settings 

Setting the ADCs into calibration mode 


Control 32(0x81400400)=0x180

SlaveSel(0x81400400)=0xFF

Ctrl(0x81400400)=0xE6

Ctrl(0x81400400)=0x86

Init : Config of AD9252 SPI ok


Ctrl @ SPIstop (0x81400400)=0x186

ADCs initialised 

 waiting for 10 seconds 


ADCs calibrated


Control 32(0x81400400)=0x186

SlaveSel(0x81400400)=0xFF

Ctrl(0x81400400)=0xE6

Ctrl(0x81400400)=0x86Config of AD9252 SPI ok


Ctrl @ SPIstop (0x81400400)=0x186

ADCs set for PN-9

Jumping to kernel simpleboot...


zImage starting: loaded at 0x00a00000 (sp: 0x00bc4eb0)

Allocating 0x3b78cc bytes for kernel ...

gunzipping (0x00000000 <- 0x00a0f000:0x00bc380e)...done 0x39604c bytes


Linux/PowerPC load: console=ttyS0 root=/dev/nfs ip=on rw mem=112M

Finalizing device tree... flat tree at 0xbd1300

Probing IIC bus for MAC... MAC address = 0x0 0x4 0xa3 0x2a 0xd0 0x1b 
Using Xilinx Virtex440 machine description
Linux version 2.6.31 (nf@nnlxb.dl.ac.uk) (gcc version 4.2.2) #34 PREEMPT Tue Nov 15 15:57:04 GMT 2011
Zone PFN ranges:
  DMA      0x00000000 -> 0x00007000
  Normal   0x00007000 -> 0x00007000
Movable zone start PFN for each node
early_node_map[1] active PFN ranges
    0: 0x00000000 -> 0x00007000
MMU: Allocated 1088 bytes of context maps for 255 contexts
Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 28448
Kernel command line: console=ttyS0 root=/dev/nfs ip=on rw mem=112M
PID hash table entries: 512 (order: 9, 2048 bytes)
Dentry cache hash table entries: 16384 (order: 4, 65536 bytes)
Inode-cache hash table entries: 8192 (order: 3, 32768 bytes)
Memory: 109680k/114688k available (3500k kernel code, 4852k reserved, 144k data, 130k bss, 168k init)
Kernel virtual memory layout:
  * 0xffffe000..0xfffff000  : fixmap
  * 0xfde00000..0xfe000000  : consistent mem
  * 0xfde00000..0xfde00000  : early ioremap
  * 0xd1000000..0xfde00000  : vmalloc & ioremap
NR_IRQS:512
clocksource: timebase mult[a00000] shift[22] registered
Console: colour dummy device 80x25
Mount-cache hash table entries: 512
NET: Registered protocol family 16
PCI: Probing PCI hardware
bio: create slab <bio-0> at 0
NET: Registered protocol family 2
IP route cache hash table entries: 1024 (order: 0, 4096 bytes)
TCP established hash table entries: 4096 (order: 3, 32768 bytes)
TCP bind hash table entries: 4096 (order: 2, 16384 bytes)
TCP: Hash tables configured (established 4096 bind 4096)
TCP reno registered
NET: Registered protocol family 1
ROMFS MTD (C) 2007 Red Hat, Inc.
msgmni has been set to 214
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered
io scheduler cfq registered (default)
Serial: 8250/16550 driver, 4 ports, IRQ sharing disabled
83e00000.serial: ttyS0 at MMIO 0x83e01003 (irq = 16) is a 16550
console [ttyS0] enabled
brd: module loaded
loop: module loaded
Device Tree Probing 'ethernet'
xilinx_lltemac 81c00000.ethernet: MAC address is now  0: 4:a3:2a:d0:1b
xilinx_lltemac 81c00000.ethernet: XLlTemac: using DMA mode.
XLlTemac: DCR address: 0x80
XLlTemac: buffer descriptor size: 32768 (0x8000)
XLlTemac: Allocating DMA descriptors with kmalloc
XLlTemac: (buffer_descriptor_init) phy: 0x6938000, virt: 0xc6938000, size: 0x8000
XTemac: PHY detected at address 7.
xilinx_lltemac 81c00000.ethernet: eth0: Xilinx TEMAC at 0x81C00000 mapped to 0xD1024000, irq=17
fc000000.flash: Found 1 x16 devices at 0x0 in 16-bit bank
 Intel/Sharp Extended Query Table at 0x010A
 Intel/Sharp Extended Query Table at 0x010A
 Intel/Sharp Extended Query Table at 0x010A
 Intel/Sharp Extended Query Table at 0x010A
 Intel/Sharp Extended Query Table at 0x010A
 Intel/Sharp Extended Query Table at 0x010A
Using buffer write method
cfi_cmdset_0001: Erase suspend on write enabled
cmdlinepart partition parsing not available
RedBoot partition parsing not available
Creating 5 MTD partitions on "fc000000.flash":
0x000000000000-0x000000500000 : "golden_firmware"
0x000000500000-0x000000800000 : "golden_kernel"
0x000000800000-0x000000d00000 : "user_firmware"
0x000000d00000-0x000000fe0000 : "user_kernel"
0x000000fe0000-0x000001000000 : "env_variables"
xilinx-xps-spi 81400400.hd-xps-spi: at 0x81400400 mapped to 0xD1028400, irq=20
SPI: XIlinx spi: bus number now 32766
xilinx-xps-spi 81400000.xps-spi: at 0x81400000 mapped to 0xD102C000, irq=21
SPI: XIlinx spi: bus number now 32765
mice: PS/2 mouse device common for all mice
Device Tree Probing 'i2c'
 #0 at 0x81600000 mapped to 0xD1030000, irq=22
at24 0-0050: 1024 byte 24c08 EEPROM (writable)
TCP cubic registered
NET: Registered protocol family 17
RPC: Registered udp transport module.
RPC: Registered tcp transport module.
eth0: XLlTemac: Options: 0x3fa
eth0: XLlTemac: allocating interrupt 19 for dma mode tx.
eth0: XLlTemac: allocating interrupt 18 for dma mode rx.
eth0: XLlTemac: speed set to 1000Mb/s
eth0: XLlTemac: Send Threshold = 24, Receive Threshold = 4
eth0: XLlTemac: Send Wait bound = 254, Receive Wait bound = 254
Sending DHCP requests ., OK
IP-Config: Got DHCP answer from 10.1.1.250, my address is 10.1.1.1
IP-Config: Complete:
     device=eth0, addr=10.1.1.1, mask=255.255.255.0, gw=10.1.1.250,
     host=nnaida1, domain=, nis-domain=(none),
     bootserver=10.1.1.250, rootserver=10.1.1.250, rootpath=/MIDAS@aidas/XilinxLinux/ppc_4xx/rfs/nnaida1,tcp
... 4873 more lines ...
Attachment 7: 1.png
1.png
Attachment 8: 1.mergerstat.png
1.mergerstat.png
Attachment 9: 2.statistics.png
2.statistics.png
Attachment 10: 3.temperature.png
3.temperature.png
Attachment 11: 010617_bias1403.png
010617_bias1403.png
Attachment 12: 12.onlinehitxy.png
12.onlinehitxy.png
Attachment 13: R1_873.txt
 *** TDR format 3.3.0 analyser - TD - October 2016
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  256129954 ( 1006120.2 Hz)
        Other data format:    4958046 (   19476.0 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:         93 (       0.4 Hz)
                               RESUME:         93 (       0.4 Hz)
                              SYNC100:    2329339 (    9150.0 Hz)
                           FEE64 disc:    2573956 (   10110.9 Hz)
                             MBS info:      54565 (     214.3 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:     258704 (    1016.2 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:      254.572 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  1                0.607                0.488
  2                1.361                1.397
  3                0.000                0.000
  4                0.000                0.000
  5                0.036                0.000
  6                0.004                0.000
  7                0.000                0.000
  8                0.000                0.000
  9                0.078                0.000
 10                0.105                0.000
 11                0.000                0.000
 12                0.000                0.000
 13                0.000                0.000
 14                0.007                0.000
 15                0.000                0.000
 16                0.000                0.000
 17                0.251                0.000
 18                0.187                0.052
 19                0.113                0.000
 20                0.000                0.000
 21                0.000                0.000
 22                0.013                0.000
 23                0.024                0.000
 24                0.000                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100       Disc        MBS      Other   HEC Data
  0          0          0          0          0          0          0          0          0          0          0          0
  1   24074487     219268          0          0         14         14      96872     122368          0          0      24432
  2   27250454     592530          0          0         15         15      96582     495918          0          0      20237
  3    7563926     110073          0          0          0          0      97100      12973          0          0        229
  4    2008136     120561          0          0          0          0      97104      23457          0          0       1535
  5   10172382     112920          0          0         12         12      97091      15805          0          0        426
  6   10371326     178338          0          0          2          2      97094      26675      54565          0       2765
  7    2799928     130298          0          0          0          0      97097      33201          0          0       3131
  8    2010117     111262          0          0          0          0      97100      14162          0          0        530
  9   18734315     256021          0          0          3          3      97073     158942          0          0      15179
 10   20157337     183453          0          0          3          3      97056      86391          0          0       8811
 11    4132145     143629          0          0          0          0      97100      46529          0          0       4623
 12    4998044     187568          0          0          0          0      97098      90470          0          0       8781
 13    8257497     178925          0          0          0          0      97101      81824          0          0       8377
 14    9568788     236679          0          0          1          1      97099     139578          0          0      15401
 15    7310482     231313          0          0          0          0      97095     134218          0          0      14817
 16    6172105     169220          0          0          0          0      97102      72118          0          0       9208
 17   13016832     127759          0          0         20         20      97009      30710          0          0       2233
 18   16133394     114544          0          0          7          7      97025      17505          0          0        317
 19   12571526     234564          0          0          9          9      97057     137489          0          0      13290
 20    8656391     311902          0          0          0          0      97100     214802          0          0      17022
 21    8748693     203524          0          0          0          0      97099     106425          0          0      21904
 22   10571141     227499          0          0          3          3      97095     130398          0          0      25337
 23   11017094     318125          0          0          4          4      97089     221028          0          0      21090
 24    9833414     258071          0          0          0          0      97101     160970          0          0      19029
 25          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0

 *** Program elapsed time:   67.070s (  477.111 blocks/s,  29.819 Mb/s)
Attachment 14: 14.bias_current.png
14.bias_current.png
Attachment 15: 15.mergerstat.png
15.mergerstat.png
Attachment 16: 16.temperature.png
16.temperature.png
Attachment 17: 17.statistics.png
17.statistics.png
  337   Fri Aug 19 07:42:22 2016 TD, PVFriday 19 August
14.00 Both AIDA NIM bins U/S 
      Upper NIM bin - BNC PB-4, Ortec 433, 2x CAEN N1419, 1x CAEN N1419B - ac mains fuse 100V/8A/slow? blowing
      Lower NIM bin - 11x MACB - not powering up

      Replaced both NIM bins.
      Upper NIM bin - 11x MACB
      Lower NIM bin - BNC PB-4, Ortec 433, 2x CAEN N1419, 1x CAEN N1419B

15.50 Julabo FL11006 chiller ON - set point +20 deg C
      B2F/F11 ambient temp +24.0 deg C, RH 54%, DP +13.8 deg C

      Bias 6x MSL type BB18 DSSSDs - see attachments 1-2

16.10 Startup DAQ nnaida1-24 *except* nnaida19

      System-wide checks

      Check clock status OK
      Check ADC calibration - nnaida7 failed
      Check ASIC clock timestamp - multiple failures - see attachment 3
      Check SYNC errors not counted Since Baseline - see attachment 4
      Check SYNC pulses received - see attachment 5

      BNC PB-4 

      Amplitude 90,000, x5 attenuator IN
      t_r 50ns, tau_d 50us
      Polarity -
      INT ref, delay MIN, tail pulse

      FEE64 temperatures - see attachment 6

16.34 R1 starts (directory Aug2016)

      slow comparator 0x10, LEC/MEC fast comparator 0x10

      merge 555k data items/s, tapeserver 4430 kb/s

18.28 R4 starts

      Settings per R1

18.31 DAQ/merge stalls with (many) messages as follows

MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
Merge state now Paused
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in pending data, found 1146,
last 575
copyItems: queue 14, maybe copied in wrong buffer: sequence 1146, last 575
Merge_addItems: queue 14, maybe added wrong buffer: sequence 1146, last 575
MERGE Program (24316): check_for_data: index 14, unexpected header sequence number in new data, found 689, last 1258
copyItems: queue 14, maybe copied in wrong buffer: sequence 689, last 1258
Merge_addItems: queue 14, maybe added wrong buffer: sequence 689, last 1258
MERGE Data Link (24254): client closed connection
MERGE Data Link (24254): listening on port 11001
MERGE Data Link (24255): client closed connection
MERGE Data Link (24255): listening on port 11002
MERGE Data Link (24257): client closed connection
MERGE Data Link (24257): listening on port 11004
MERGE Data Link (24258): client closed connection
MERGE Data Link (24258): listening on port 11005
MERGE Data Link (24261): client closed connection
MERGE Data Link (24261): listening on port 11008
MERGE Data Link (24260): client closed connection
MERGE Data Link (24260): listening on port 11007
MERGE Data Link (24259): client closed connection
MERGE Data Link (24259): listening on port 11006
MERGE Data Link (24256): client closed connection
MERGE Data Link (24256): listening on port 11003
MERGE Data Link (24262): client closed connection
MERGE Data Link (24262): listening on port 11009
MERGE Data Link (24263): client closed connection
MERGE Data Link (24263): listening on port 11010
MERGE Data Link (24265): client closed connection
MERGE Data Link (24265): listening on port 11012
MERGE Data Link (24266): client closed connection
MERGE Data Link (24266): listening on port 11013
MERGE Data Link (24267): client closed connection
MERGE Data Link (24267): listening on port 11014
MERGE Data Link (24269): client closed connection
MERGE Data Link (24269): listening on port 11016
MERGE Data Link (24268): client closed connection
MERGE Data Link (24268): listening on port 11015
MERGE Data Link (24270): client closed connection
MERGE Data Link (24270): listening on port 11017
MERGE Data Link (24264): client closed connection
MERGE Data Link (24264): listening on port 11011
MERGE Data Link (24273): client closed connection
MERGE Data Link (24273): listening on port 11020
MERGE Data Link (24271): client closed connection
MERGE Data Link (24271): listening on port 11018
MERGE Data Link (24277): client closed connection
MERGE Data Link (24277): listening on port 11024
MERGE Data Link (24275): client closed connection
MERGE Data Link (24275): listening on port 11022
MERGE Data Link (24274): client closed connection
MERGE Data Link (24274): listening on port 11021
MERGE Data Link (24276): client closed connection
MERGE Data Link (24276): listening on port 11023
Attachment 1: 1.png
1.png
Attachment 2: 2.png
2.png
Attachment 3: 3.png
3.png
Attachment 4: 4.png
4.png
Attachment 5: 5.png
5.png
Attachment 6: 6.png
6.png
  870   Fri Jul 7 10:52:34 2023 TD, PJCSTest of AIDA FEE64 d8:80:39:42:0d:0b ( aida03 ) - ASIC mezzanine replaced
Test of AIDA FEE64 d8:80:39:42:0d:0b ( aida03 ) - ASIC mezzanine replaced

ISOL test station STFC DL, T9

Pulser BNC PB-5

Amplitude 1.0V
Attenuation x1
Polarity +
Frequency 100Hz
Tail pulse, decay time 1ms
Delay 250ns (min)

ASIC settings 2019May22-10.19.28
Slow comparator 0x80

Adaptor PCB - PJCS


FEE64 temperatures OK - attachments 1


System wide checks OK - attachments 2-5


Statistics OK - attachments 6-7

Hit/HitRate spectra OK - attachment 8

LEC spectra - attachments 9-12

Data observed for all channels of ASIC #1, 3, & 4
Data observed (double peaks) ASIC#2 channels 4-7 & 12-15, no data observed channels 0-3 & 8-11 - ASIC#2 address bit #2 set always ON? ASIC #2 fail or Mezzanine-FEE64 
connection issue?
Typical pulser peak widths 15-17 channels FWHM ASIC #1-4


Wave spectra OK - attachments 13-16

19/7/23 removed mezzanine and cleaned contacts with ipa. cleaned FEE contacts. reassembled mezzanine to FEE and tested. ASIC 2 now ok.
Attachment 1: Screenshot_from_2023-07-06_11-02-57.png
Screenshot_from_2023-07-06_11-02-57.png
Attachment 2: Screenshot_from_2023-07-06_11-03-52.png
Screenshot_from_2023-07-06_11-03-52.png
Attachment 3: Screenshot_from_2023-07-06_11-04-14.png
Screenshot_from_2023-07-06_11-04-14.png
Attachment 4: Screenshot_from_2023-07-06_11-04-18.png
Screenshot_from_2023-07-06_11-04-18.png
Attachment 5: Screenshot_from_2023-07-06_11-04-22.png
Screenshot_from_2023-07-06_11-04-22.png
Attachment 6: Screenshot_from_2023-07-06_11-04-57.png
Screenshot_from_2023-07-06_11-04-57.png
Attachment 7: Screenshot_from_2023-07-06_11-05-15.png
Screenshot_from_2023-07-06_11-05-15.png
Attachment 8: Screenshot_from_2023-07-06_11-07-18.png
Screenshot_from_2023-07-06_11-07-18.png
Attachment 9: Screenshot_from_2023-07-06_11-12-31.png
Screenshot_from_2023-07-06_11-12-31.png
Attachment 10: Screenshot_from_2023-07-06_11-14-24.png
Screenshot_from_2023-07-06_11-14-24.png
Attachment 11: Screenshot_from_2023-07-06_11-16-55.png
Screenshot_from_2023-07-06_11-16-55.png
Attachment 12: Screenshot_from_2023-07-06_11-18-49.png
Screenshot_from_2023-07-06_11-18-49.png
Attachment 13: Screenshot_from_2023-07-06_11-20-09.png
Screenshot_from_2023-07-06_11-20-09.png
Attachment 14: Screenshot_from_2023-07-06_11-20-36.png
Screenshot_from_2023-07-06_11-20-36.png
Attachment 15: Screenshot_from_2023-07-06_11-21-03.png
Screenshot_from_2023-07-06_11-21-03.png
Attachment 16: Screenshot_from_2023-07-06_11-21-40.png
Screenshot_from_2023-07-06_11-21-40.png
  945   Fri Mar 29 08:39:18 2024 TD, PJCSUnable to start MIDAS DAQ with 1x FEE64 ( aida04 )
> 
> At AIDA test station T9, STFC DL unable to start MIDAS DAQ with 1x FEE64 ( aida04 ) - see attachments
> 
> aida04 appears to have booted OK and I can connect using telnet
> 
> MIDAS 8015 server exits - signal 1

I’ve had this problem too. The solution is to have the single FEE twice in the list in the config file. The software is then quite happy.

Alternatively a single FEE can still be accessed directly and will operate successfully.  The only thing missing is the spectra function menu. They won’t work, so FWHM is harder to determine. 
  449   Thu Nov 10 09:56:20 2016 TD, OH, MLNP1412 R26 R27
start 18.55 10.11.16
stop 
AIDA filename R26_0
BRIKEN filename 161109_1852_767778Ni_045
BigRIPS filename 443
ASIC settings 2016Nov07_23.03.06
DSSSD bias & leakage currents OK attachments 1 and 2 

Degrader all degraders out
F11 rate 430Hz
BigRIPS setting 767778Ni  F5  out, F7 CH2 in, F11 6mm C in

From offline analysis of R26_2

 *** DSSSD # 1 count:       459 old count:       225 dt:      1.02 s  HEC rate:    229.83 Hz
 *** DSSSD # 2 count:       385 old count:       191 dt:      1.02 s  HEC rate:    190.54 Hz
 *** DSSSD # 3 count:       461 old count:       228 dt:      1.02 s  HEC rate:    228.85 Hz
 *** DSSSD # 4 count:       403 old count:       197 dt:      1.02 s  HEC rate:    202.33 Hz
 *** DSSSD # 5 count:       218 old count:       121 dt:      1.02 s  HEC rate:     95.27 Hz
 *** DSSSD # 6 count:        87 old count:        42 dt:      1.02 s  HEC rate:     44.20 Hz

19.02 FEE64 temperature OK - see attachment 3

19.16 BRIKEN DAQ problems following restart - multiple correlation scaler reset requests issued - ignore data
before R26_5
      New BRIKEN data file 161109_1852_767778Ni_046

19.20 AIDA DAQ stalled (presumably *end* of LN2 fill cycle)

      Soft reset OK
      Clock lock state status 0xd - see attachment 6

19.29 Start DAQ (R27) 

19.35 BRIKEN DAQ problems starting SyncCheck program - - multiple correlation scaler reset requests issued -
ignore data before R27_2

19.37 All degraders (5.4mm Al) in for new Takechi et al. setting
      BigRIPS setting 767778Ni  F5 in, F7 out, F11 6mm C in

BRIKEN filename 161109_1852_767778Ni_045
AIDA fileame R27_3
BigRIPS filename 444

19.40 All degraders out

DSSSD bias & leakage currents OK attachments 4 & 5 

From offline analysis of R27_4

 *** DSSSD # 1 count:       281 old count:       247 dt:      2.31 s  HEC rate:    121.43 Hz
 *** DSSSD # 2 count:       247 old count:       219 dt:      2.31 s  HEC rate:    106.74 Hz
 *** DSSSD # 3 count:       286 old count:       252 dt:      2.31 s  HEC rate:    123.59 Hz
 *** DSSSD # 4 count:       287 old count:       253 dt:      2.31 s  HEC rate:    124.02 Hz
 *** DSSSD # 5 count:       201 old count:       178 dt:      2.31 s  HEC rate:     86.86 Hz
 *** DSSSD # 6 count:        33 old count:        29 dt:      2.31 s  HEC rate:     14.26 Hz

20.36 Noted x4 increase in F11 rate to c. 2kHz
      All degraders in (5.4mm Al)

      BRIKEN DAQ shows x4-5 increase for c. 6 minutes
      DSSSD bias & leakage currents OK attachments 7 & 8
Attachment 1: 1.png
1.png
Attachment 2: 2.png
2.png
Attachment 3: 3.png
3.png
Attachment 4: 10.png
10.png
Attachment 5: 11.png
11.png
Attachment 6: 4.png
4.png
Attachment 7: 20.png
20.png
Attachment 8: 21.png
21.png
  433   Tue Nov 8 13:37:06 2016 TD, OH, DKNP1412 R2
10:36 Run 2 Start
      Degraders (5.4mm Al) in at start and all removed once started.
      Other settings same as R1.

22.45 DAQ stop OK 

      All variable degraders (5.4mm Al) in

From analysis of R2_3

S O R T    C O M P L E T E ..... Tue Nov  8 22:59:02 2016


 *** ENTRY finish

 *** data items:  146156010 ( 541115.06 Hz)
 *** ADC events:    7815683 (  28936.09 Hz)
 *** time warps:          0 (      0.00 Hz)
 *** DSSSD # 1 count:     51901 old count:     51732 dt:     84.55 s  HEC rate:    613.87 Hz
 *** DSSSD # 2 count:     42966 old count:     42831 dt:     84.55 s  HEC rate:    508.19 Hz
 *** DSSSD # 3 count:     37092 old count:     36983 dt:     84.55 s  HEC rate:    438.71 Hz
 *** DSSSD # 4 count:     12570 old count:     12532 dt:     84.55 s  HEC rate:    148.67 Hz
 *** DSSSD # 5 count:      1927 old count:      1921 dt:     84.55 s  HEC rate:     22.79 Hz
 *** DSSSD # 6 count:       659 old count:       658 dt:     84.55 s  HEC rate:      7.79 Hz

 *** ENTRY finish ends

S O R T    S T O P P E D ..... Tue Nov  8 22:59:16 2016

s2000-s2005 m_p versus m_n DSSSD #1-6
s2010-s2015 x versus y DSSSD #1-6
s2020-s2025 E_p versus E_n DSSSD #1-6

23.05 DSSSD bias & leakage currents - see attachments 5 & 6
      FEE64 temperatures - see attachment 7
Attachment 1: 32.png
32.png
Attachment 2: 31.png
31.png
Attachment 3: 30.png
30.png
Attachment 4: 40.png
40.png
Attachment 5: 41.png
41.png
Attachment 6: 42.png
42.png
  434   Tue Nov 8 14:22:16 2016 TD, OH, DKNP1412 R3
11:21 Run 3 Started
      Degrader moved upstream. AIDA moved to centre of BRIKEN. Fixed degrader moved upstream from centre of BRIKEN.
11:25 Run 3 Stopped
  435   Tue Nov 8 14:29:34 2016 TD, OH, DKNP1412 Run 4
23:28 Run 4 Start
      Thick 6mm C target in beam
      
      Running with 3.2mm (variable) + 8mm (fixed) of Al degrader. Fixed degrader in same position as R3.
      Variable degrader reduced to 1mm of Al.
  425   Sun Nov 6 01:34:15 2016 TD, OH, CGSun 6th November
10:34 Detector Bias a leakage currents all ok. (Attachments 1 and 2)
      Temperatures all ok (Attachment 3)
      All system wide checks ok other than clock status see attachment 4
      DAQ continues to run ok (R124) (No stop at 6:30am)
      DAQ running at about 14MB/s to disc which is faster than before.
      Most likely due to the increased rate in detector 1 which is represented at FEEs 17, 20, 22 and 23 in
      attachment 5.

      Also attached are the spectra for layouts 1-4 & 7-8 as attachments 6-11
      When looking at the pulser spectrum in layouts 3 and 4 (attachments 9 and 10) we see that the pulser peaks
relating to this detector is broader shown by
      the decreased peak height.

      Comparing the waveforms in attachments 11 and 12 to those taken on Monday 31st Oct we see that the noise
in nnaida 5 and 6 has been greatly reduced.
      On the others however there appears to be an increase in the amplitude of the noise.

      11:25 The second putty window for leakage currents was found to have been frozen for the past 24 hours.
Was reloaded and updated leakage currents are in attachment 13 and 14

12.15 Analysis of R124_291 shows ADC & disc data synchronised - see attachment 15
      Analysis of data file - see attachment 16

18:26 DAQ stopped, presumably during LN2 fill cycle.
      Restarted the merger and tried "Stop" on the DAQ control page. ~50% of nnaida now show "error."
      R124 closed 18.29
      Could not regain control of the system. Jorge switched BRIKEN to its internal clock and FEEs power cycled @
19.20.

23.35 DAQ started (R126 - no storage mode)

      DSSSD bias & leakage currents OK - see attachment 
Attachment 1: 10.png
10.png
Attachment 2: 11.png
11.png
Attachment 3: 12.png
12.png
Attachment 4: 13.png
13.png
Attachment 5: 20.png
20.png
Attachment 6: 15.png
15.png
Attachment 7: 14.png
14.png
Attachment 8: 16
Attachment 9: 17.png
17.png
Attachment 10: 21.png
21.png
Attachment 11: 18.png
18.png
Attachment 12: 19.png
19.png
Attachment 13: 22.png
22.png
Attachment 14: 23.png
23.png
Attachment 15: 30.png
30.png
Attachment 16: R124_291
 *** TDR format 3.3.0 analyser - TD - October 2016
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  230847656 ( 1588898.7 Hz)
        Other data format:   30240344 (  208140.9 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:        192 (       1.3 Hz)
                               RESUME:        192 (       1.3 Hz)
                              SYNC100:    1322421 (    9102.1 Hz)
                           FEE64 disc:   28913216 (  199006.4 Hz)
                             MBS info:       4323 (      29.8 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:       1948 (      13.4 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:      145.288 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  1                0.197                0.000
  2                0.538                0.566
  3                0.000                0.000
  4                0.000                0.000
  5                0.000                0.000
  6                0.102                0.000
  7                0.000                0.000
  8                0.000                0.000
  9                0.036                0.000
 10                0.000                0.000
 11                0.000                0.000
 12                0.000                0.000
 13                0.000                0.000
 14                0.021                0.000
 15                0.000                0.000
 16                0.000                0.000
 17                6.205                6.129
 18                0.007                0.000
 19                0.003                0.000
 20                0.295                0.236
 21                0.000                0.000
 22                0.590                0.582
 23               11.854               11.291
 24                0.000                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100       Disc        MBS      Other   HEC Data
  0          0          0          0          0          0          0          0          0          0          0          0
  1    1483749    9921002          0          0          6          6      55338    9865652          0          0         60
  2    5885786    9284877          0          0         11         11      55212    9229643          0          0          0
  3    4498675      60706          0          0          0          0      55415       5291          0          0          0
  4    1878077      61899          0          0          0          0      55418       6481          0          0          9
  5    7202645      62323          0          0          0          0      55418       6905          0          0          0
  6    9007161      69230          0          0          5          5      55375       9522       4323          0         19
  7    2676568      61859          0          0          0          0      55416       6443          0          0         22
  8    2052380      62598          0          0          0          0      55412       7186          0          0        531
  9    5155187    2222775          0          0          3          3      55402    2167367          0          0          0
 10    4376399     391579          0          0          0          0      55413     336166          0          0          0
 11     990180      60278          0          0          0          0      55417       4861          0          0          0
 12    1665947      59140          0          0          0          0      55416       3724          0          0          0
 13    4277688     735621          0          0          0          0      55419     680202          0          0          0
 14    5563108    3277421          0          0          1          1      55408    3222011          0          0        726
 15    4030541      60611          0          0          0          0      55415       5196          0          0          0
 16    4056015      60000          0          0          0          0      55416       4584          0          0          0
 17   42807103    1357446          0          0         40         40      53051    1304315          0          0          0
 18    5897459     156962          0          0          1          1      55413     101547          0          0          0
 19    6005138      62145          0          0          2          2      55419       6722          0          0          0
 20   16486896      60582          0          0          6          6      55306       5264          0          0        418
 21    4037137      77255          0          0          0          0      55418      21837          0          0        140
 22   26722373    1954203          0          0          7          7      55190    1898999          0          0          9
 23   59021079      59375          0          0        110        110      50899       8256          0          0         14
 24    5070365      60457          0          0          0          0      55415       5042          0          0          0
 25          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0

 *** Program elapsed time:   27.070s ( 1182.107 blocks/s,  73.882 Mb/s)
Attachment 17: 1.png
1.png
Attachment 18: 2.png
2.png
  451   Thu Nov 10 12:02:24 2016 TD, OH, CGThursday 10 November
21.17 DAQ starts (R30)

      Pulser walkthrough
      Amplitude 90,000 - 10,000 @ 10,000 step
      x5 attenuator IN
      t_r 50ns tau_d 50us
      polarity -, tail pulse, delay MIN
      frequency 250Hz range

21.30 DAQ stops OK 

21.32 DAQ starts (R31)

      Pulser walkthrough
      Amplitude 10,000 - 2,000 @ 2,000 step

21.40 DAQ stops OK

21.44 DAQ starts (R32)
     
      Background
      BNC PB-4 pulser OFF

21.59 DAQ stops OK

23.45 Started R35 so Jorge can do some tests.
      No storage mode.

00.20 Carried out manual fill on LN2 in advance of beam arriving later (~03.00).
      Took around 20mins.
      Continued writing to R35 after soft reset of DAQ.
Attachment 1: 30.png
30.png
Attachment 2: 31.png
31.png
Attachment 3: 32.png
32.png
Attachment 4: 34.png
34.png
  572   Thu May 18 03:07:47 2017 TD, OH, CBRasPi system console diagnostics
Connecting monitor to RasPi system console diagnostics

May 18 10:59:38 aidas1 dhcpd: DHCPREQUEST for 10.32.6.189 from b8:27:eb:6b:0a:a0 via p2p1: wrong network.
May 18 10:59:38 aidas1 dhcpd: DHCPNAK on 10.32.6.189 to b8:27:eb:6b:0a:a0 via p2p1
May 18 10:59:38 aidas1 dhcpd: DHCPDISCOVER from b8:27:eb:6b:0a:a0 via p2p1
May 18 10:59:39 aidas1 dhcpd: DHCPOFFER on 10.1.1.117 to b8:27:eb:6b:0a:a0 (npg-monitor) via p2p1
May 18 10:59:39 aidas1 dhcpd: Wrote 0 deleted host decls to leases file.
May 18 10:59:39 aidas1 dhcpd: Wrote 0 new dynamic host decls to leases file.
May 18 10:59:39 aidas1 dhcpd: Wrote 44 leases to leases file.
May 18 10:59:39 aidas1 dhcpd: DHCPREQUEST for 10.1.1.117 (10.1.1.250) from b8:27:eb:6b:0a:a0 (npg-monitor) via p2p1
May 18 10:59:39 aidas1 dhcpd: DHCPACK on 10.1.1.117 to b8:27:eb:6b:0a:a0 (npg-monitor) via p2p1
May 18 11:05:46 aidas1 dhcpd: DHCPREQUEST for 10.1.1.117 from b8:27:eb:6b:0a:a0 (npg-monitor) via p2p1
May 18 11:05:46 aidas1 dhcpd: DHCPACK on 10.1.1.117 to b8:27:eb:6b:0a:a0 (npg-monitor) via p2p1


ssh np-monitor -> could not resolve hostname
ssh 10.1.1.117 -> OK

Connecting remotely to RasPi system console diagnostics

http://10.1.1.117:8015/AIDA/Pi_Monitor/Pi_Monitor.tml -> Looks OK (see attached 1)
Connected 24 USB cables. 6 cables per HUB. Connected all HUBs to RasPi. Pressed Update USB terminal list. We see 24
USBs (0-23) (see attached 2)
Pressed Connect USB terminal. Parse USB Log file for details. We can only see ttyUSB0,1,2,3. Full log:

ttyUSB0 =>  last host=nnaida14, => last addr=193.62.115.227, ; #panics => 0 ; Finished OK 
ttyUSB1 =>  last host=nnlycca4, => last addr=193.62.115.240, ; #panics => 0 ; Finished OK 
ttyUSB10 =>  last  => last  ; #panics => 0 ; Not Finished 
ttyUSB11 =>  last  => last  ; #panics => 0 ; Not Finished 
ttyUSB12 =>  last  => last  ; #panics => 0 ; Not Finished 
ttyUSB13 =>  last  => last  ; #panics => 0 ; Not Finished 
ttyUSB14 =>  last  => last  ; #panics => 0 ; Not Finished 
ttyUSB15 =>  last  => last  ; #panics => 0 ; Not Finished 
ttyUSB16 =>  last  => last  ; #panics => 0 ; Not Finished 
ttyUSB17 =>  last  => last  ; #panics => 0 ; Not Finished 
ttyUSB18 =>  last  => last  ; #panics => 0 ; Not Finished 
ttyUSB19 =>  last  => last  ; #panics => 0 ; Not Finished 
ttyUSB2 =>  last host=nnaida11, => last addr=193.62.115.232, ; #panics => 0 ; Finished OK 
ttyUSB20 =>  last  => last  ; #panics => 0 ; Not Finished 
ttyUSB21 =>  last  => last  ; #panics => 0 ; Not Finished 
ttyUSB22 =>  last  => last  ; #panics => 0 ; Not Finished 
ttyUSB23 =>  last  => last  ; #panics => 0 ; Not Finished 
ttyUSB3 =>  last host=nnaida12, => last addr=193.62.115.233, ; #panics => 0 ; Finished OK 
ttyUSB4 =>  last  => last  ; #panics => 0 ; Not Finished 
ttyUSB5 =>  last  => last  ; #panics => 0 ; Not Finished 
ttyUSB6 =>  last  => last  ; #panics => 0 ; Not Finished 
ttyUSB7 =>  last  => last  ; #panics => 0 ; Not Finished 
ttyUSB8 =>  last  => last  ; #panics => 0 ; Not Finished 
ttyUSB9 =>  last  => last  ; #panics => 0 ; Not Finished 

ttyUSB0
ttyUSB1
ttyUSB10
ttyUSB11
ttyUSB12
ttyUSB13
ttyUSB14
ttyUSB15
ttyUSB16
ttyUSB17
ttyUSB18
ttyUSB19
ttyUSB2
ttyUSB20
ttyUSB21
ttyUSB22
ttyUSB23
ttyUSB3
ttyUSB4
ttyUSB5
ttyUSB6
ttyUSB7
ttyUSB8
ttyUSB9

Ssh'ed to RasPi. There are only four log files in ~/logs/

sudo lsusb -t results in

/:  Bus 01.Port 1: Dev 1, Class=root_hub, Driver=dwc_otg/1p, 480M
    |__ Port 1: Dev 2, If 0, Class=hub, Driver=hub/5p, 480M
        |__ Port 1: Dev 3, If 0, Class=vend., Driver=smsc95xx, 480M
        |__ Port 2: Dev 4, If 0, Class=hub, Driver=hub/4p, 480M
            |__ Port 1: Dev 5, If 0, Class=vend., Driver=ftdi_sio, 12M
            |__ Port 2: Dev 6, If 0, Class=vend., Driver=ftdi_sio, 12M
            |__ Port 3: Dev 7, If 0, Class=vend., Driver=ftdi_sio, 12M
            |__ Port 4: Dev 8, If 0, Class=hub, Driver=hub/4p, 480M
                |__ Port 1: Dev 9, If 0, Class=vend., Driver=ftdi_sio, 12M
                |__ Port 2: Dev 10, If 0, Class=vend., Driver=ftdi_sio, 12M
                |__ Port 3: Dev 11, If 0, Class=vend., Driver=ftdi_sio, 12M
        |__ Port 3: Dev 20, If 0, Class=hub, Driver=hub/4p, 480M
            |__ Port 1: Dev 21, If 0, Class=vend., Driver=ftdi_sio, 12M
            |__ Port 2: Dev 22, If 0, Class=vend., Driver=ftdi_sio, 12M
            |__ Port 3: Dev 23, If 0, Class=vend., Driver=ftdi_sio, 12M
            |__ Port 4: Dev 24, If 0, Class=hub, Driver=hub/4p, 480M
                |__ Port 1: Dev 25, If 0, Class=vend., Driver=ftdi_sio, 12M
                |__ Port 2: Dev 26, If 0, Class=vend., Driver=ftdi_sio, 12M
                |__ Port 3: Dev 27, If 0, Class=vend., Driver=ftdi_sio, 12M
        |__ Port 4: Dev 12, If 0, Class=hub, Driver=hub/4p, 480M
            |__ Port 1: Dev 13, If 0, Class=vend., Driver=ftdi_sio, 12M
            |__ Port 2: Dev 14, If 0, Class=vend., Driver=ftdi_sio, 12M
            |__ Port 3: Dev 15, If 0, Class=vend., Driver=ftdi_sio, 12M
            |__ Port 4: Dev 16, If 0, Class=hub, Driver=hub/4p, 480M
                |__ Port 1: Dev 17, If 0, Class=vend., Driver=ftdi_sio, 12M
                |__ Port 2: Dev 18, If 0, Class=vend., Driver=ftdi_sio, 12M
                |__ Port 3: Dev 19, If 0, Class=vend., Driver=ftdi_sio, 12M
        |__ Port 5: Dev 28, If 0, Class=hub, Driver=hub/4p, 480M
            |__ Port 1: Dev 29, If 0, Class=vend., Driver=ftdi_sio, 12M
            |__ Port 2: Dev 30, If 0, Class=vend., Driver=ftdi_sio, 12M
            |__ Port 3: Dev 31, If 0, Class=vend., Driver=ftdi_sio, 12M
            |__ Port 4: Dev 32, If 0, Class=hub, Driver=hub/4p, 480M
                |__ Port 1: Dev 33, If 0, Class=vend., Driver=ftdi_sio, 12M
                |__ Port 2: Dev 34, If 0, Class=vend., Driver=ftdi_sio, 12M
                |__ Port 3: Dev 35, If 0, Class=vend., Driver=ftdi_sio, 12M
Attachment 1: 105.png
105.png
Attachment 2: 105.png
105.png
Attachment 3: 106.png
106.png
  573   Thu May 18 09:29:50 2017 TD, OH, CBRasPi system console diagnostics
> Connecting monitor to RasPi system console diagnostics
> 
> May 18 10:59:38 aidas1 dhcpd: DHCPREQUEST for 10.32.6.189 from b8:27:eb:6b:0a:a0 via p2p1: wrong network.
> May 18 10:59:38 aidas1 dhcpd: DHCPNAK on 10.32.6.189 to b8:27:eb:6b:0a:a0 via p2p1
> May 18 10:59:38 aidas1 dhcpd: DHCPDISCOVER from b8:27:eb:6b:0a:a0 via p2p1
> May 18 10:59:39 aidas1 dhcpd: DHCPOFFER on 10.1.1.117 to b8:27:eb:6b:0a:a0 (npg-monitor) via p2p1
> May 18 10:59:39 aidas1 dhcpd: Wrote 0 deleted host decls to leases file.
> May 18 10:59:39 aidas1 dhcpd: Wrote 0 new dynamic host decls to leases file.
> May 18 10:59:39 aidas1 dhcpd: Wrote 44 leases to leases file.
> May 18 10:59:39 aidas1 dhcpd: DHCPREQUEST for 10.1.1.117 (10.1.1.250) from b8:27:eb:6b:0a:a0 (npg-monitor) via p2p1
> May 18 10:59:39 aidas1 dhcpd: DHCPACK on 10.1.1.117 to b8:27:eb:6b:0a:a0 (npg-monitor) via p2p1
> May 18 11:05:46 aidas1 dhcpd: DHCPREQUEST for 10.1.1.117 from b8:27:eb:6b:0a:a0 (npg-monitor) via p2p1
> May 18 11:05:46 aidas1 dhcpd: DHCPACK on 10.1.1.117 to b8:27:eb:6b:0a:a0 (npg-monitor) via p2p1
> 
> 
> ssh np-monitor -> could not resolve hostname
> ssh 10.1.1.117 -> OK
> 
> Connecting remotely to RasPi system console diagnostics
> 
> http://10.1.1.117:8015/AIDA/Pi_Monitor/Pi_Monitor.tml -> Looks OK (see attached 1)
> Connected 24 USB cables. 6 cables per HUB. Connected all HUBs to RasPi. Pressed Update USB terminal list. We see 24
> USBs (0-23) (see attached 2)
> Pressed Connect USB terminal. Parse USB Log file for details. We can only see ttyUSB0,1,2,3. Full log:
> 
> ttyUSB0 =>  last host=nnaida14, => last addr=193.62.115.227, ; #panics => 0 ; Finished OK 
> ttyUSB1 =>  last host=nnlycca4, => last addr=193.62.115.240, ; #panics => 0 ; Finished OK 
> ttyUSB10 =>  last  => last  ; #panics => 0 ; Not Finished 
> ttyUSB11 =>  last  => last  ; #panics => 0 ; Not Finished 
> ttyUSB12 =>  last  => last  ; #panics => 0 ; Not Finished 
> ttyUSB13 =>  last  => last  ; #panics => 0 ; Not Finished 
> ttyUSB14 =>  last  => last  ; #panics => 0 ; Not Finished 
> ttyUSB15 =>  last  => last  ; #panics => 0 ; Not Finished 
> ttyUSB16 =>  last  => last  ; #panics => 0 ; Not Finished 
> ttyUSB17 =>  last  => last  ; #panics => 0 ; Not Finished 
> ttyUSB18 =>  last  => last  ; #panics => 0 ; Not Finished 
> ttyUSB19 =>  last  => last  ; #panics => 0 ; Not Finished 
> ttyUSB2 =>  last host=nnaida11, => last addr=193.62.115.232, ; #panics => 0 ; Finished OK 
> ttyUSB20 =>  last  => last  ; #panics => 0 ; Not Finished 
> ttyUSB21 =>  last  => last  ; #panics => 0 ; Not Finished 
> ttyUSB22 =>  last  => last  ; #panics => 0 ; Not Finished 
> ttyUSB23 =>  last  => last  ; #panics => 0 ; Not Finished 
> ttyUSB3 =>  last host=nnaida12, => last addr=193.62.115.233, ; #panics => 0 ; Finished OK 
> ttyUSB4 =>  last  => last  ; #panics => 0 ; Not Finished 
> ttyUSB5 =>  last  => last  ; #panics => 0 ; Not Finished 
> ttyUSB6 =>  last  => last  ; #panics => 0 ; Not Finished 
> ttyUSB7 =>  last  => last  ; #panics => 0 ; Not Finished 
> ttyUSB8 =>  last  => last  ; #panics => 0 ; Not Finished 
> ttyUSB9 =>  last  => last  ; #panics => 0 ; Not Finished 
> 
> ttyUSB0
> ttyUSB1
> ttyUSB10
> ttyUSB11
> ttyUSB12
> ttyUSB13
> ttyUSB14
> ttyUSB15
> ttyUSB16
> ttyUSB17
> ttyUSB18
> ttyUSB19
> ttyUSB2
> ttyUSB20
> ttyUSB21
> ttyUSB22
> ttyUSB23
> ttyUSB3
> ttyUSB4
> ttyUSB5
> ttyUSB6
> ttyUSB7
> ttyUSB8
> ttyUSB9
> 
> Ssh'ed to RasPi. There are only four log files in ~/logs/
> 
> sudo lsusb -t results in
> 
> /:  Bus 01.Port 1: Dev 1, Class=root_hub, Driver=dwc_otg/1p, 480M
>     |__ Port 1: Dev 2, If 0, Class=hub, Driver=hub/5p, 480M
>         |__ Port 1: Dev 3, If 0, Class=vend., Driver=smsc95xx, 480M
>         |__ Port 2: Dev 4, If 0, Class=hub, Driver=hub/4p, 480M
>             |__ Port 1: Dev 5, If 0, Class=vend., Driver=ftdi_sio, 12M
>             |__ Port 2: Dev 6, If 0, Class=vend., Driver=ftdi_sio, 12M
>             |__ Port 3: Dev 7, If 0, Class=vend., Driver=ftdi_sio, 12M
>             |__ Port 4: Dev 8, If 0, Class=hub, Driver=hub/4p, 480M
>                 |__ Port 1: Dev 9, If 0, Class=vend., Driver=ftdi_sio, 12M
>                 |__ Port 2: Dev 10, If 0, Class=vend., Driver=ftdi_sio, 12M
>                 |__ Port 3: Dev 11, If 0, Class=vend., Driver=ftdi_sio, 12M
>         |__ Port 3: Dev 20, If 0, Class=hub, Driver=hub/4p, 480M
>             |__ Port 1: Dev 21, If 0, Class=vend., Driver=ftdi_sio, 12M
>             |__ Port 2: Dev 22, If 0, Class=vend., Driver=ftdi_sio, 12M
>             |__ Port 3: Dev 23, If 0, Class=vend., Driver=ftdi_sio, 12M
>             |__ Port 4: Dev 24, If 0, Class=hub, Driver=hub/4p, 480M
>                 |__ Port 1: Dev 25, If 0, Class=vend., Driver=ftdi_sio, 12M
>                 |__ Port 2: Dev 26, If 0, Class=vend., Driver=ftdi_sio, 12M
>                 |__ Port 3: Dev 27, If 0, Class=vend., Driver=ftdi_sio, 12M
>         |__ Port 4: Dev 12, If 0, Class=hub, Driver=hub/4p, 480M
>             |__ Port 1: Dev 13, If 0, Class=vend., Driver=ftdi_sio, 12M
>             |__ Port 2: Dev 14, If 0, Class=vend., Driver=ftdi_sio, 12M
>             |__ Port 3: Dev 15, If 0, Class=vend., Driver=ftdi_sio, 12M
>             |__ Port 4: Dev 16, If 0, Class=hub, Driver=hub/4p, 480M
>                 |__ Port 1: Dev 17, If 0, Class=vend., Driver=ftdi_sio, 12M
>                 |__ Port 2: Dev 18, If 0, Class=vend., Driver=ftdi_sio, 12M
>                 |__ Port 3: Dev 19, If 0, Class=vend., Driver=ftdi_sio, 12M
>         |__ Port 5: Dev 28, If 0, Class=hub, Driver=hub/4p, 480M
>             |__ Port 1: Dev 29, If 0, Class=vend., Driver=ftdi_sio, 12M
>             |__ Port 2: Dev 30, If 0, Class=vend., Driver=ftdi_sio, 12M
>             |__ Port 3: Dev 31, If 0, Class=vend., Driver=ftdi_sio, 12M
>             |__ Port 4: Dev 32, If 0, Class=hub, Driver=hub/4p, 480M
>                 |__ Port 1: Dev 33, If 0, Class=vend., Driver=ftdi_sio, 12M
>                 |__ Port 2: Dev 34, If 0, Class=vend., Driver=ftdi_sio, 12M
>                 |__ Port 3: Dev 35, If 0, Class=vend., Driver=ftdi_sio, 12M

Can you let me know when you power-cycled the FEEs please ? Or maybe just do a stop/go.
If there is nothing to log from the consoles then the Pi won't have made a log file. 
The software opens and closes the log file each time a line of text comes in from the FEE64.
  574   Thu May 18 09:46:36 2017 TD, OH, CBRasPi system console diagnostics
> Can you let me know when you power-cycled the FEEs please ? Or maybe just do a stop/go.
> If there is nothing to log from the consoles then the Pi won't have made a log file. 
> The software opens and closes the log file each time a line of text comes in from the FEE64.

The most recent power cycle of the FEE64s was May 5

DAQ stop/go per your request - see Elog https://elog.ph.ed.ac.uk/AIDA/571
ELOG V3.1.4-unknown