AIDA GELINA BRIKEN nToF CRIB ISOLDE CIRCE nTOFCapture DESPEC DTAS EDI_PSA 179Ta CARME StellarModelling DCF K40
  AIDA, Page 28 of 46  ELOG logo
  ID Date Author Subject
  382   Tue Oct 11 03:34:02 2016 CG & TDTuesday 11 October
10.40 DAQ found stopped

      All FEE64 AIDA SYNC rates zero, AIDA SYNC count ~ 13.8M => DAQ stopped @ 06.35

      System wide checks - see attachments 1-4 - all other system-wide checks OK

11.15 Replace cable for Master MACB external clock signal
           - change from c. 4m RG174 (Lemo-00 to Lemo-00) to c. 4m RG58 (BNC to BNC)
      Power cycle AIDA FEE64s
      Set TS_SYNC_PHASE 0

      DSSSD bias/leakage current OK - see attacment 5-6
      FEE64 temperatures OK - see attachment 7
      *All* system-wide checks OK (N.B. several ReSYNCs required) 

      B2F/F11 temperature + deg C, d.p. + deg C,RH %

      ASIC settings 2016Sep02-18.17.01
      slow comparator 0x10 -> 0x0a

      Master MACB serial #13 (see https://elog.ph.ed.ac.uk/AIDA/367)
      Master MACB mode 5

11.58 DAQ starts

15.41 DAQ OK

15.44 DAQ stop requested

15.46 DAQ start
      Data transfer to disk enabled to test DAQ correlation real-time monitor

22.50 AIDA SYNCs OK
      # Master SYNCs *not equal* to # FEE64 SYNCs - all FEE64 SYNCs # equal
            - all other system-wide checks OK - see attachments 8-15
      Merger and TapeServer OK

     R17_197 ADC data synchonised

aidas1> ./analyser2 /TapeData/Sept2016/R17_197
 *** GREAT format 3.2.0 analyser - TD - May 2014
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  165074646 ( 1182230.4 Hz)
        Other data format:   96013354 (  687627.8 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:        113 (       0.8 Hz)
                               RESUME:        113 (       0.8 Hz)
                              SYNC100:    1275326 (    9133.6 Hz)
                           FEE64 disc:   94733738 (  678463.4 Hz)
                             MBS info:       4064 (      29.1 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:        191 (       1.4 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 Timestamp elapsed time:      139.630 s
 FEE module #:   1 elapsed dead time       0.000 s
 FEE module #:   2 elapsed dead time       0.206 s
 FEE module #:   3 elapsed dead time       0.000 s
 FEE module #:   4 elapsed dead time       0.000 s
 FEE module #:   5 elapsed dead time       1.084 s
 FEE module #:   6 elapsed dead time       4.015 s
 FEE module #:   7 elapsed dead time       0.000 s
 FEE module #:   8 elapsed dead time       0.000 s
 FEE module #:   9 elapsed dead time       0.201 s
 FEE module #:  10 elapsed dead time       0.000 s
 FEE module #:  11 elapsed dead time       0.000 s
 FEE module #:  12 elapsed dead time       0.000 s
 FEE module #:  13 elapsed dead time       0.003 s
 FEE module #:  14 elapsed dead time       0.193 s
 FEE module #:  15 elapsed dead time       0.024 s
 FEE module #:  16 elapsed dead time       0.000 s
 FEE module #:  17 elapsed dead time       1.198 s
 FEE module #:  18 elapsed dead time       0.040 s
 FEE module #:  19 elapsed dead time       0.124 s
 FEE module #:  20 elapsed dead time       0.000 s
 FEE module #:  21 elapsed dead time       0.000 s
 FEE module #:  22 elapsed dead time       0.187 s
 FEE module #:  23 elapsed dead time       0.258 s
 FEE module #:  24 elapsed dead time       0.000 s
 FEE module #:  25 elapsed dead time       0.000 s
 FEE module #:  26 elapsed dead time       0.000 s
 FEE module #:  27 elapsed dead time       0.000 s
 FEE module #:  28 elapsed dead time       0.000 s
 FEE module #:  29 elapsed dead time       0.000 s
 FEE module #:  30 elapsed dead time       0.000 s
 FEE module #:  31 elapsed dead time       0.000 s
 FEE module #:  32 elapsed dead time       0.000 s

 *** Program elapsed time:   19.555s ( 1636.436 blocks/s, 102.277 Mb/s)
  381   Mon Oct 10 03:15:59 2016 CG & TDMonday 10 October
10.30 DAQ found stopped

      All FEE64 AIDA SYNC rates zero, AIDA SYNC count ~ 4.4M => DAQ stopped @ 01.40

      3He detector DAQ off - no 50MHz clock to Master MACB

      System wide checks - see attachments 26-18

      N.B. It would appear that the DAQ stalled (TS_SYNC_PHASE 1) c. 01.40 and at some
      later time (c. 06.00) the 3He detector DAQ was powered off which means that AIDA
      lost the external 50MHz clock to the Master MACB - system-wide screenshots should
      be interpreted with caution.

14.15 3He detector DAQ 50MHz clock restarted
 
      VME and NIM crates ON
      Excecute command ConfClock_50MHz on 3He detector DAQ computer

      Power cycle AIDA FEE64s
      Set TS_SYNC_PHASE 2

      DSSSD bias/leakage current OK
      FEE64 temperatures OK
      *All* system-wide checks OK

      B2F/F11 temperature + deg C, d.p. + deg C,RH %

      ASIC settings 2016Sep02-18.17.01
      slow comparator 0x10 -> 0x0a

      Master MACB serial #13 (see https://elog.ph.ed.ac.uk/AIDA/367)
      Master MACB mode 5

14.20 DAQ starts (no data transfer)

18.10 DAQ found stopped

      All FEE64 AIDA SYNC rates zero, AIDA SYNC count ~ 3.4M => DAQ stopped @ 16.50

      System-wide checks - see attachments 16-9

      Power cycle AIDA FEE64s
      Set TS_SYNC_PHASE 3

      ASIC settings 2016Sep02-18.17.01
      slow comparator 0x10 -> 0x0a

20.10 DAQ found stalled

      System-wide checks - see attachments 8-1

      Power cycle AIDA FEE64s
      Set TS_SYNC_PHASE 0

      ASIC settings 2016Sep02-18.17.01
      slow comparator 0x10 -> 0x0a

20.35 DAQ starts (no data transfer)

      slow comparator 0x10 -> 0x0a

18.35 DAQ starts (no data transfer)

20.16 DAQ found stopped
      All FEE64 AIDA SYNC rates zero, AIDA SYNC count ~ 120k (17/24 FEE64s) or 1.49M (7/24) => FEE64s stopped @ 18.40 & 19.40

20.36 DAQ starts (no data transfer)

23.47 DAQ OK
  380   Sun Oct 9 11:47:34 2016 CG, TDSunday 9th October
12.30 Following scheduled power outages of October 8

      power up AIDA and Julabo FL11006 recirculating chiller

      Julabo FL11006 set point +20 deg C
      Temperature +25.3 deg C, d.p. +10.6 deg C, RH 39.3%
     
      boot aidas1 
      aidas1 filesystem checks (fsck) run from c. 12.30 to 15.58

      System wide checks OK *except* nnaida21 failed ADC calibration

16.55 DAQ starts (no data transfer)

      ASIC settings 2016Sep02-18.17.01
      slow comparator threshold 0x10 -> 0x0a
      TS_SYNC_PHASE 0

      DSSSD bias & leakage current OK - see attachments 8 & 9
      FEE64 temperatures OK - see attachment 7

17.30 DAQ stops

      DSSSD bias off
      AIDA withdrawn from (CH2)n moderator 
      DSSSD bias on

17.40 DAQ starts

19.15 Noticed DAQ stopped producing SYNC pulses at some point.
      A reload of the run control tab sees them all as going still, but only 20% are reporting any SYNC output in the stats page.
      All FEEs have failed the SYNC errors since baseline check and the values reported by the SYNC pulses received tests vary
      by +- 3 of a central value.
      See attachments 1-6.
      The merger and tape server were not set up before this run and are not currently running.

      TS_SYNC phase changed from 0 -> 1 and ReSYNC

22.20 DAQ OK

      AIDA SYNCs OK
      All system-wide checks OK *except* nnaida21 fails ADC calibration (no change)
  379   Fri Oct 7 02:43:47 2016 TD & CGAnalysis of Sept2016/R13_47
Analysis of R13_47 - the data file that was being written when DAQ stalled
yesterday evening - see https://elog.ph.ed.ac.uk/AIDA/371

aidas1> ./analyser2 /TapeData/Sept2016/R13_46
 *** GREAT format 3.2.0 analyser - TD - May 2014
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  145759250 (  544585.9 Hz)
        Other data format:  115328750 (  430891.4 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:         74 (       0.3 Hz)
                               RESUME:         74 (       0.3 Hz)
                              SYNC100:    2449126 (    9150.4 Hz)
                           FEE64 disc:  112871466 (  421710.5 Hz)
                             MBS info:       8010 (      29.9 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:        382 (       1.4 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 Timestamp elapsed time:      267.652 s
 FEE module #:   1 elapsed dead time       0.000 s
 FEE module #:   2 elapsed dead time       0.824 s
 FEE module #:   3 elapsed dead time       0.000 s
 FEE module #:   4 elapsed dead time       0.000 s
 FEE module #:   5 elapsed dead time       0.275 s
 FEE module #:   6 elapsed dead time       0.488 s
 FEE module #:   7 elapsed dead time       0.000 s
 FEE module #:   8 elapsed dead time       0.000 s
 FEE module #:   9 elapsed dead time       0.017 s
 FEE module #:  10 elapsed dead time       0.000 s
 FEE module #:  11 elapsed dead time       0.000 s
 FEE module #:  12 elapsed dead time       0.000 s
 FEE module #:  13 elapsed dead time       0.000 s
 FEE module #:  14 elapsed dead time       0.023 s
 FEE module #:  15 elapsed dead time       0.000 s
 FEE module #:  16 elapsed dead time       0.000 s
 FEE module #:  17 elapsed dead time       0.012 s
 FEE module #:  18 elapsed dead time       0.000 s
 FEE module #:  19 elapsed dead time       0.912 s
 FEE module #:  20 elapsed dead time       0.000 s
 FEE module #:  21 elapsed dead time       0.000 s
 FEE module #:  22 elapsed dead time       0.000 s
 FEE module #:  23 elapsed dead time       0.000 s
 FEE module #:  24 elapsed dead time       0.000 s
 FEE module #:  25 elapsed dead time       0.000 s
 FEE module #:  26 elapsed dead time       0.000 s
 FEE module #:  27 elapsed dead time       0.000 s
 FEE module #:  28 elapsed dead time       0.000 s
 FEE module #:  29 elapsed dead time       0.000 s
 FEE module #:  30 elapsed dead time       0.000 s
 FEE module #:  31 elapsed dead time       0.000 s
 FEE module #:  32 elapsed dead time       0.000 s

 *** Program elapsed time:   17.016s ( 1880.624 blocks/s, 117.539 Mb/s)
aidas1> ./analyser2 /TapeData/Sept2016/R13_47
 *** GREAT format 3.2.0 analyser - TD - May 2014
 *** ERROR: READ I/O error:       5002
                   blocks:      11864
          ADC data format:   54019518 (  544839.2 Hz)
        Other data format:   42776197 (  431439.3 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:         29 (       0.3 Hz)
                               RESUME:         29 (       0.3 Hz)
                              SYNC100:     907301 (    9151.0 Hz)
                           FEE64 disc:   41865866 (  422257.8 Hz)
                             MBS info:       2972 (      30.0 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:        135 (       1.4 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 Timestamp elapsed time:       99.148 s
 FEE module #:   1 elapsed dead time       0.000 s
 FEE module #:   2 elapsed dead time       0.179 s
 FEE module #:   3 elapsed dead time       0.000 s
 FEE module #:   4 elapsed dead time       0.000 s
 FEE module #:   5 elapsed dead time       0.199 s
 FEE module #:   6 elapsed dead time       0.100 s
 FEE module #:   7 elapsed dead time       0.000 s
 FEE module #:   8 elapsed dead time       0.000 s
 FEE module #:   9 elapsed dead time       0.005 s
 FEE module #:  10 elapsed dead time       0.000 s
 FEE module #:  11 elapsed dead time       0.000 s
 FEE module #:  12 elapsed dead time       0.000 s
 FEE module #:  13 elapsed dead time       0.000 s
 FEE module #:  14 elapsed dead time       0.003 s
 FEE module #:  15 elapsed dead time       0.000 s
 FEE module #:  16 elapsed dead time       0.000 s
 FEE module #:  17 elapsed dead time       0.021 s
 FEE module #:  18 elapsed dead time       0.000 s
 FEE module #:  19 elapsed dead time       0.311 s
 FEE module #:  20 elapsed dead time       0.000 s
 FEE module #:  21 elapsed dead time       0.000 s
 FEE module #:  22 elapsed dead time       0.000 s
 FEE module #:  23 elapsed dead time       0.000 s
 FEE module #:  24 elapsed dead time       0.000 s
 FEE module #:  25 elapsed dead time       0.000 s
 FEE module #:  26 elapsed dead time       0.000 s
 FEE module #:  27 elapsed dead time       0.000 s
 FEE module #:  28 elapsed dead time       0.000 s
 FEE module #:  29 elapsed dead time       0.000 s
 FEE module #:  30 elapsed dead time       0.000 s
 FEE module #:  31 elapsed dead time       0.000 s
 FEE module #:  32 elapsed dead time       0.000 s

 *** Program elapsed time:    6.238s ( 1901.806 blocks/s, 118.863 Mb/s)

Final SYNCs of R13_47 

aidas1. ./analyser2 v /TapeData/Sept2016/R13_47 | grep SYNC
 :
 :
 ***   SYNC100 timestamp: block: 11864 ptr:  2151 data: 0x81401340 module:  1 information type:  4 information
field: 0x00001340 ts: 0x000001340B4800A0
 ***   SYNC100 timestamp: block: 11864 ptr:  2153 data: 0x82401340 module:  2 information type:  4 information
field: 0x00001340 ts: 0x000001340B4800A0
 ***   SYNC100 timestamp: block: 11864 ptr:  2155 data: 0x83401340 module:  3 information type:  4 information
field: 0x00001340 ts: 0x000001340B4800A0
 ***   SYNC100 timestamp: block: 11864 ptr:  2157 data: 0x84401340 module:  4 information type:  4 information
field: 0x00001340 ts: 0x000001340B4800A0
 ***   SYNC100 timestamp: block: 11864 ptr:  2159 data: 0x85401340 module:  5 information type:  4 information
field: 0x00001340 ts: 0x000001340B4800A0
 ***   SYNC100 timestamp: block: 11864 ptr:  2161 data: 0x86401340 module:  6 information type:  4 information
field: 0x00001340 ts: 0x000001340B4800A0
 ***   SYNC100 timestamp: block: 11864 ptr:  2163 data: 0x87401340 module:  7 information type:  4 information
field: 0x00001340 ts: 0x000001340B4800A0
 ***   SYNC100 timestamp: block: 11864 ptr:  2165 data: 0x88401340 module:  8 information type:  4 information
field: 0x00001340 ts: 0x000001340B4800A0
 ***   SYNC100 timestamp: block: 11864 ptr:  2167 data: 0x89401340 module:  9 information type:  4 information
field: 0x00001340 ts: 0x000001340B4800A0
 ***   SYNC100 timestamp: block: 11864 ptr:  2169 data: 0x8A401340 module: 10 information type:  4 information
field: 0x00001340 ts: 0x000001340B4800A0
 ***   SYNC100 timestamp: block: 11864 ptr:  2171 data: 0x8B401340 module: 11 information type:  4 information
field: 0x00001340 ts: 0x000001340B4800A0
 ***   SYNC100 timestamp: block: 11864 ptr:  2173 data: 0x8C401340 module: 12 information type:  4 information
field: 0x00001340 ts: 0x000001340B4800A0
 ***   SYNC100 timestamp: block: 11864 ptr:  2175 data: 0x8D401340 module: 13 information type:  4 information
field: 0x00001340 ts: 0x000001340B4800A0
 ***   SYNC100 timestamp: block: 11864 ptr:  2177 data: 0x8E401340 module: 14 information type:  4 information
field: 0x00001340 ts: 0x000001340B4800A0
 ***   SYNC100 timestamp: block: 11864 ptr:  2179 data: 0x8F401340 module: 15 information type:  4 information
field: 0x00001340 ts: 0x000001340B4800A0
 ***   SYNC100 timestamp: block: 11864 ptr:  2181 data: 0x90401340 module: 16 information type:  4 information
field: 0x00001340 ts: 0x000001340B4800A0
 ***   SYNC100 timestamp: block: 11864 ptr:  2183 data: 0x91401340 module: 17 information type:  4 information
field: 0x00001340 ts: 0x000001340B4800A0
 ***   SYNC100 timestamp: block: 11864 ptr:  2185 data: 0x92401340 module: 18 information type:  4 information
field: 0x00001340 ts: 0x000001340B4800A0
 ***   SYNC100 timestamp: block: 11864 ptr:  2187 data: 0x93401340 module: 19 information type:  4 information
field: 0x00001340 ts: 0x000001340B4800A0
 ***   SYNC100 timestamp: block: 11864 ptr:  2189 data: 0x94401340 module: 20 information type:  4 information
field: 0x00001340 ts: 0x000001340B4800A0
 ***   SYNC100 timestamp: block: 11864 ptr:  2191 data: 0x95401340 module: 21 information type:  4 information
field: 0x00001340 ts: 0x000001340B4800A0
 ***   SYNC100 timestamp: block: 11864 ptr:  2193 data: 0x96401340 module: 22 information type:  4 information
field: 0x00001340 ts: 0x000001340B4800A0
 ***   SYNC100 timestamp: block: 11864 ptr:  2195 data: 0x97401340 module: 23 information type:  4 information
field: 0x00001340 ts: 0x000001340B4800A0
 ***   SYNC100 timestamp: block: 11864 ptr:  2197 data: 0x98401340 module: 24 information type:  4 information
field: 0x00001340 ts: 0x000001340B4800A0
 ***   SYNC100 timestamp: block: 11864 ptr:  6807 data: 0x81401340 module:  1 information type:  4 information
field: 0x00001340 ts: 0x000001340B4C00A0
 ***   SYNC100 timestamp: block: 11864 ptr:  6809 data: 0x82401340 module:  2 information type:  4 information
field: 0x00001340 ts: 0x000001340B4C00A0
 ***   SYNC100 timestamp: block: 11864 ptr:  6811 data: 0x83401340 module:  3 information type:  4 information
field: 0x00001340 ts: 0x000001340B4C00A0
 ***   SYNC100 timestamp: block: 11864 ptr:  6813 data: 0x84401340 module:  4 information type:  4 information
field: 0x00001340 ts: 0x000001340B4C00A0
 ***   SYNC100 timestamp: block: 11864 ptr:  6815 data: 0x85401340 module:  5 information type:  4 information
field: 0x00001340 ts: 0x000001340B4C00A0
 ***   SYNC100 timestamp: block: 11864 ptr:  6817 data: 0x86401340 module:  6 information type:  4 information
field: 0x00001340 ts: 0x000001340B4C00A0
 ***   SYNC100 timestamp: block: 11864 ptr:  6819 data: 0x87401340 module:  7 information type:  4 information
field: 0x00001340 ts: 0x000001340B4C00A0
 ***   SYNC100 timestamp: block: 11864 ptr:  6821 data: 0x88401340 module:  8 information type:  4 information
field: 0x00001340 ts: 0x000001340B4C00A0
 ***   SYNC100 timestamp: block: 11864 ptr:  6823 data: 0x89401340 module:  9 information type:  4 information
field: 0x00001340 ts: 0x000001340B4C00A0
 ***   SYNC100 timestamp: block: 11864 ptr:  6825 data: 0x8A401340 module: 10 information type:  4 information
field: 0x00001340 ts: 0x000001340B4C00A0
 ***   SYNC100 timestamp: block: 11864 ptr:  6827 data: 0x8B401340 module: 11 information type:  4 information
field: 0x00001340 ts: 0x000001340B4C00A0
 ***   SYNC100 timestamp: block: 11864 ptr:  6829 data: 0x8C401340 module: 12 information type:  4 information
field: 0x00001340 ts: 0x000001340B4C00A0
 ***   SYNC100 timestamp: block: 11864 ptr:  6831 data: 0x8D401340 module: 13 information type:  4 information
field: 0x00001340 ts: 0x000001340B4C00A0
 ***   SYNC100 timestamp: block: 11864 ptr:  6833 data: 0x8E401340 module: 14 information type:  4 information
field: 0x00001340 ts: 0x000001340B4C00A0
 ***   SYNC100 timestamp: block: 11864 ptr:  6835 data: 0x8F401340 module: 15 information type:  4 information
field: 0x00001340 ts: 0x000001340B4C00A0
 ***   SYNC100 timestamp: block: 11864 ptr:  6837 data: 0x90401340 module: 16 information type:  4 information
field: 0x00001340 ts: 0x000001340B4C00A0
 ***   SYNC100 timestamp: block: 11864 ptr:  6839 data: 0x91401340 module: 17 information type:  4 information
field: 0x00001340 ts: 0x000001340B4C00A0
 ***   SYNC100 timestamp: block: 11864 ptr:  6841 data: 0x92401340 module: 18 information type:  4 information
field: 0x00001340 ts: 0x000001340B4C00A0
 ***   SYNC100 timestamp: block: 11864 ptr:  6843 data: 0x93401340 module: 19 information type:  4 information
field: 0x00001340 ts: 0x000001340B4C00A0
 ***   SYNC100 timestamp: block: 11864 ptr:  6845 data: 0x94401340 module: 20 information type:  4 information
field: 0x00001340 ts: 0x000001340B4C00A0
 ***   SYNC100 timestamp: block: 11864 ptr:  6847 data: 0x95401340 module: 21 information type:  4 information
field: 0x00001340 ts: 0x000001340B4C00A0
 ***   SYNC100 timestamp: block: 11864 ptr:  6849 data: 0x96401340 module: 22 information type:  4 information
field: 0x00001340 ts: 0x000001340B4C00A0
 ***   SYNC100 timestamp: block: 11864 ptr:  6851 data: 0x97401340 module: 23 information type:  4 information
field: 0x00001340 ts: 0x000001340B4C00A0
 ***   SYNC100 timestamp: block: 11864 ptr:  6853 data: 0x98401340 module: 24 information type:  4 information
field: 0x00001340 ts: 0x000001340B4C00A0

Analysis of the end of file R13_47 - see attachment 1

Offline analysis of R13_3 and R13_47 shows AIDA ADC data synchronised
  378   Fri Oct 7 02:29:19 2016 TD & CGFriday 7 October
10.29 DAQ left running overnight
      Histograms only - no data transfer to Merger & TapeServer

      DSSSD biases & leakage currents OK - see attachments 1 & 2
      FEE64 temperatures OK - see attachment 3

      DAQ run control OK - see attachment 4

      Statistics - see attachments 5-16
      
      N.B. some FEE64s are producing SYNCs, some not, in particular nnaida6 is not

      System-wide tests - see attachments 17-22

11.31 DAQ recovered with STOP-GO (no data transfer)
      AIDA SYNCs OK for all FEE64s

22.46 DAQ still running OK

      Power down in preparation for tomorrow's planned site-wide power outage 
  377   Thu Oct 6 13:22:24 2016 TDImages of setup at F11 - 4
  375   Thu Oct 6 13:20:34 2016 TDImages of setup at F11 - 3
  373   Thu Oct 6 13:09:50 2016 TDImages of setup at F11 - 2
  372   Thu Oct 6 12:39:14 2016 TDImages of setup at F11
  371   Thu Oct 6 11:16:40 2016 CG & TDThursday 6 October
DSSSD bias voltages and leakage currents OK - see attachments 1 & 2
FEE64 temperatures OK - see attachment 3

Install MACB serial #13 (firmware 16.4.15) as Master MACB, mode 5

System-wide checks all OK 
 N.B. nnaida19 ASIC clock OK (cf previous Elog entries) - see attachment 4

Setup AIDA-BELEN DAQ correlation - RIBF still to do - see attachments 5 & 6
  reset request and trigger signals to Master MACB - NIM, width ~200ns

BELEN clock (10Hz) triggers BELEN BNC PB-5 and AIDA Master MACB

 ***     MBS information: block:  9349 ptr:  3725 data: 0x86807FF5 module:  6 information type:  8 information index:  0 MBS data:7FF5 ts: 0x00000026D0FE47A2
 ***     MBS information: block:  9349 ptr:  3727 data: 0x8681AF75 module:  6 information type:  8 information index:  1 MBS data:AF75 ts: 0x00000026D0FE47A2
 ***     MBS information: block:  9349 ptr:  3729 data: 0x86820000 module:  6 information type:  8 information index:  2 MBS data:0000 ts: 0x00000026D0FE47A2
 ***     MBS information: block:  9362 ptr:  7641 data: 0x8680A5AD module:  6 information type:  8 information index:  0 MBS data:A5AD ts: 0x00000026D196DE82
 ***     MBS information: block:  9362 ptr:  7643 data: 0x8681AF9B module:  6 information type:  8 information index:  1 MBS data:AF9B ts: 0x00000026D196DE82
 ***     MBS information: block:  9362 ptr:  7645 data: 0x86820000 module:  6 information type:  8 information index:  2 MBS data:0000 ts: 0x00000026D196DE82

0x0000AF9BA5AD - 0x0000AF757FF5 = 0x2625B8 = 2500024 * 40ns = 100000960ns = 0.1s

0x26D196DE82 - 0x26D0FE47A2 = 0x9896E0 = 10000096 * 10ns = 100000960ns = 0.1s

BELEN DAQ manual reset -> Master MACB reset request

 ***     MBS information: block:  9375 ptr:  3043 data: 0x86808A8A module:  6 information type:  8 information index:  0 MBS data:8A8A ts: 0x00000026D22F755E
 ***     MBS information: block:  9375 ptr:  3045 data: 0x8681001F module:  6 information type:  8 information index:  1 MBS data:001F ts: 0x00000026D22F755E
 ***     MBS information: block:  9375 ptr:  3047 data: 0x86820000 module:  6 information type:  8 information index:  2 MBS data:0000 ts: 0x00000026D22F755E

0x0000001F8A8A = 2067082 * 40ns = 82683280ns = 82.7us (which is < 0.1s as expected)

 ***     MBS information: block:  9388 ptr:  3291 data: 0x8680B041 module:  6 information type:  8 information index:  0 MBS data:B041 ts: 0x00000026D2C80C3A
 ***     MBS information: block:  9388 ptr:  3293 data: 0x86810045 module:  6 information type:  8 information index:  1 MBS data:0045 ts: 0x00000026D2C80C3A
 ***     MBS information: block:  9388 ptr:  3295 data: 0x86820000 module:  6 information type:  8 information index:  2 MBS data:0000 ts: 0x00000026D2C80C3A
 ***     MBS information: block:  9401 ptr:  5841 data: 0x8680D5F9 module:  6 information type:  8 information index:  0 MBS data:D5F9 ts: 0x00000026D360A31A
 ***     MBS information: block:  9401 ptr:  5843 data: 0x8681006B module:  6 information type:  8 information index:  1 MBS data:006B ts: 0x00000026D360A31A
 ***     MBS information: block:  9401 ptr:  5845 data: 0x86820000 module:  6 information type:  8 information index:  2 MBS data:0000 ts: 0x00000026D360A31A

19.05 R13_0 starts

23.19 Returned from dinner to find DAQ had stopped writing to disk at 22.19. Merger paused and Tape run ended successfully.
      No SYNC pulses being issued.
      Carried out system-wide checks. Clock status, ADC calib and ASIC clock passed for all 24 FEEs.
      Attachments 7 & 8 show errors messages issued upon fail of SYNC errors and SYNC pulses system checks.

      From attachment 8

      ( 6016000 SYNC / 9150 SYNC/s ) * 24 ~ 15800s => DAQ stopped 23.07 which is not consistent with observation
      as final write to disk files was c. 22.19 - note 23.21 for R13_47 indicates file closed at 23.21 cf. access
      times for R13_46, _45 etc

-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 19:09 R13_0
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 19:13 R13_1
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 19:50 R13_10
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 19:54 R13_11
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 19:58 R13_12
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 20:02 R13_13
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 20:06 R13_14
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 20:10 R13_15
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 20:14 R13_16
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 20:19 R13_17
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 20:23 R13_18
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 20:27 R13_19
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 19:17 R13_2
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 20:31 R13_20
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 20:35 R13_21
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 20:39 R13_22
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 20:43 R13_23
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 20:47 R13_24
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 20:51 R13_25
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 20:55 R13_26
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 20:59 R13_27
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 21:03 R13_28
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 21:08 R13_29
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 19:21 R13_3
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 21:12 R13_30
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 21:16 R13_31
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 21:20 R13_32
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 21:24 R13_33
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 21:28 R13_34
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 21:32 R13_35
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 21:36 R13_36
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 21:40 R13_37
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 21:44 R13_38
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 21:48 R13_39
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 19:25 R13_4
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 21:52 R13_40
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 21:56 R13_41
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 22:00 R13_42
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 22:04 R13_43
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 22:08 R13_44
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 22:13 R13_45
-rw-rw-rw-. 1 npg npgstaff 2097152000 Oct  6 22:17 R13_46
-rw-rw-rw-. 1 npg npgstaff  777519104 Oct  6 23:21 R13_47

23.21 R13_47 file closed

23.50 On trying to stop DAQ received nnaida1 timeout error (attachment 9).
      DAQ power-cycled, re-started with no data transfer 
  370   Wed Oct 5 07:29:29 2016 CG & TDWednesday 5 October (inc AIDA+BRIKEN photos)
14.30 Adjusted and checked insertion of AIDA snout into BRIKEN (CH2)n moderator.
      up-down    AIDA snout appears centred (@ (CH2)n centre) and tracks into (CH2)n moderator with no
significant vertical movement
      left right AIDA snout appears centred (@ (CH2)n centre) and tracks into (CH2)n moderator with ~3mm
horizontal movement left to right (looking upstream)

15.28 DSSSD bias/leakage current OK - see attachments 1-2
      FEE64 temperatures OK - see attachment 3

      B2F/F11 temperature +24.8 deg C, d.p. +11.8 deg C,  RH 44.4%

16.00 Power off to place ac mains distribution unit between AIDA and BRIKEN

18.34 Power up PCS request for remote data/diagnostics collection
  369   Sun Oct 2 15:03:11 2016 CG, TDProblems compiling AIDAsort program on aidas1
I have been trying to compile the sort program I have been working on in Edinburgh so I can work on it locally
while at RIKEN.

When compiling i receive the error shown in make.log (attached) saying that there are undefined reference in
DataSource.cpp.
Also attached is the make output when compiled in Edinburgh - basically just 'unused variable' warnings.

This is exactly the same DataSource.cpp I am using in Edinburgh. I have carried out 'diff' on the DataSpyLib and
DataXferLib directories which are included
in the Makefile and no differences are present. I have also done this for DataSource directory and again, there
are no differences between what I am running here and in Edinburgh.

The only difference I have been able to observe so far is that in Edinburgh I am using g++ version:
 Using built-in specs.
 COLLECT_GCC=g++
 COLLECT_LTO_WRAPPER=/usr/libexec/gcc/x86_64-redhat-linux/4.8.5/lto-wrapper
 Target: x86_64-redhat-linux
 Configured with: ../configure --prefix=/usr --mandir=/usr/share/man --infodir=/usr/share/info
--with-bugurl=http://bugzilla.redhat.com/bugzilla --enable-bootstrap --enable-shared --enable-threads=posix
--enable-checking=release --with-system-zlib --enable-__cxa_atexit --disable-libunwind-exceptions
--enable-gnu-unique-object --enable-linker-build-id --with-linker-hash-style=gnu
--enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-initfini-array
--disable-libgcj --with-isl=/builddir/build/BUILD /gcc-4.8.5-20150702/obj-x86_64-redhat-linux/isl-install
--with-cloog=/builddir/build/BUILD/gcc-4.8.5-20150702/obj-x86_64-redhat-linux/cloog-install
--enable-gnu-indirect-function --with-tune=generic --with-arch_32=x86-64 --build=x86_64-redhat-linux
 Thread model: posix
 gcc version 4.8.5 20150623 (Red Hat 4.8.5-4) (GCC)

whereas on aidas1:
 Using built-in specs.
 Target: x86_64-redhat-linux
 Configured with: ../configure --prefix=/usr --mandir=/usr/share/man --infodir=/usr/share/info
--with-bugurl=http://bugzilla.redhat.com/bugzilla --enable-bootstrap --enable-shared --enable-threads=posix
--enable-checking=release --with-system-zlib --enable-__cxa_atexit --disable-libunwind-exceptions
--enable-gnu-unique-object --enable-languages=c,c++,objc,obj-c++,java,fortran,ada --enable-java-awt=gtk
--disable-dssi --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-1.5.0.0/jre --enable-libgcj-multifile
--enable-java-maintainer-mode --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --disable-libjava-multilib
--with-ppl --with-cloog --with-tune=generic --with-arch_32=i686 --build=x86_64-redhat-linux
 Thread model: posix
 gcc version 4.4.7 20120313 (Red Hat 4.4.7-17) (GCC)

The libraries used are all found in LD_LIBRARY_PATH.
On aidas1 this is: /MIDAS/Linux/lib64:/homes/npg/root/lib:/homes/npg/root/lib:/MIDAS/Linux/lib64:/homes/npg/root/lib
and in Edinburgh:
/Disk/ds-sopa-group/np/RIKEN/AIDAsort/MIDAS/Linux/lib64:/Disk/ds-sopa-group/np/thehubdata/thehub6/jlab_software/Linux_Scientific6-x86_64-gcc4.4.6/root/5.34.23/lib:


*********UPDATE 03/10/16 *************

The methods are defined in /MIDAS/DataPackage/DataXferLib/V4_TCP/transfer.c

This is in the expected INCLUDES path of: INCLUDES=  -I/MIDAS/DataPackage/DataXferLib/V4_TCP -I/MIDAS/DataPackage/DataSpyLib
  368   Sun Oct 2 06:12:54 2016 TDSunday 2 October
14.15 DSSSD bias/leakage current OK - see attachments 1-2
      FEE64 temperatures OK - see attachment 3

      B2F/F11 temperature +27.5 deg C, d.p. +10.6 deg C, 34.3 RH %

14.24 R8 starts

      ASIC settings 2016Sep02-18.17.01

      Master MACB serial #13 (see https://elog.ph.ed.ac.uk/AIDA/367)
      Master MACB mode 5

      NIM 50MHz -> Phillips 726 NIM-TTL-NIM -> Master MACB - external clock (rear panel)

      Note Fuji Diamond Tool Ltd 1020 NIM-TTL level adaptor (NIM, pink front panel) with signal
      rise and falltimes quoted as <10ns produced poor quality 25/50MHz clock - the Phillips 726
      has significantly faster rise and falltimes and drices a higher amplitude signal to 50R load.

      BNC PB-4 trigger output -> Ortec SCA -> LeCroy 429A (500ns width) -> Master MACB - Correlation DAQ
Accepted Trigger

      BNC PB-4 frequency c. 26Hz

      Statistics - see attachments 4-14
      Master Timestamp - see attachment 15
      Correlation Status & Control - see attachment 16

      Successive correlation scaler events from R8_0

 ***     MBS information: block:   120 ptr:  7827 data: 0x868068B4 module:  6 information type:  8 information
index:  0 MBS data:68B4 ts: 0x00000019979ADAF8
 ***     MBS information: block:   120 ptr:  7829 data: 0x86812F00 module:  6 information type:  8 information
index:  1 MBS data:2F00 ts: 0x00000019979ADAF8
 ***     MBS information: block:   120 ptr:  7831 data: 0x86820000 module:  6 information type:  8 information
index:  2 MBS data:0000 ts: 0x00000019979ADAF8

 ***     MBS information: block:   126 ptr:  7005 data: 0x8680FDF4 module:  6 information type:  8 information
index:  0 MBS data:FDF4 ts: 0x0000001997D52FF8
 ***     MBS information: block:   126 ptr:  7007 data: 0x86812F0E module:  6 information type:  8 information
index:  1 MBS data:2F0E ts: 0x0000001997D52FF8
 ***     MBS information: block:   126 ptr:  7009 data: 0x86820000 module:  6 information type:  8 information
index:  2 MBS data:0000 ts: 0x0000001997D52FF8

0x2F0EFDF4 - 0x2F0068B4 = 0xE9540 = 955712 * 40ns (assume 25MHz) = 38228480ns = 38.2ms

0x1997D52FF8 - 0x19979ADAF8 = 0x3A5500 = 3822848 * 10ns = 38228480ns = 38.2ms

=> correlation clock frequency = 25MHz

Master MACB (serial #13) mode = 5, 50MHz clock to external clock input (rear panel)
       clock output                             25MHz
       reset output                             reset not observed at DAQ GO
                                                reset observed using Correlation status & control tab -> Force
Correlation Reset
       reset request output                     not tested
       correlation DAQ accepted trigger output  c.26Hz

Could not persuade MACB serial #13 to operate in mode 0, external clock input (rear panel) disconnected) 
Persistent failures to ReSYNC by nnaida11, 12, 17, 18, 19, & 20 (see https://elog.ph.ed.ac.uk/AIDA/357)
following RESET/SETUP, FEE64 power cycle, MACB NIM bin power cycle and re-seating master MACB HDMI cables

Switch back to previous Master MACB serial #11 

Master MACB (serial #11) mode = 0
       clock output                             25MHz
       reset output                             reset not observed at DAQ GO
                                                reset not observed using Correlation status & control tab -> Force
Correlation Reset
       reset request output                     not tested
       correlation DAQ accepted trigger output  not observed
  367   Sat Oct 1 09:34:23 2016 TDInstalling latest (16 April 2015) MACB firmware
Installed Xilinx 14.7 LabTools + (free) WebPack license

Start iMPACT

Connect Xilinx programmer via 14-way ribbon cable to MACB PCB jtag connector
and connect USB cable to laptop

Powerup NIM bin with MACB (serial #13)

Auto-install Xilinx programmer driver

Use iMPACT Wizard to automagically find Xilinx device of MACB

Load new *.jed file
 Operations -> Program
 Operations -> Verify

TTY console log

Welcome to iMPACT
iMPACT Version: 14.7
Project: C:\Xilinx\14.7\LabTools\LabTools\auto_project.ipf created.
// *** BATCH CMD : setMode -bs
// *** BATCH CMD : setMode -bs
// *** BATCH CMD : setMode -bs
// *** BATCH CMD : setMode -bs
GUI --- Auto connect to cable...
// *** BATCH CMD : setCable -port auto
INFO:iMPACT - Digilent Plugin: Plugin Version: 2.4.4
INFO:iMPACT - Digilent Plugin: no JTAG device was found.
AutoDetecting cable. Please wait.
*** WARNING ***: When port is set to auto detect mode, cable speed is set to default 6 MHz regardless of explicit arguments supplied for 
setting the baud rates
PROGRESS_START - Starting Operation.
Connecting to cable (Usb Port - USB21).
Checking cable driver.
 Driver file xusb_xp2.sys found.
 Driver version: src=2301, dest=2301.
 Driver windrvr6.sys version = 10.2.1.0. WinDriver v10.21 Jungo (c) 1997 - 2010 Build Date: Aug 31 2010 x86_64 64bit SYS 14:14:44, 
version = 1021.
 Cable PID = 0008.
 Max current requested during enumeration is 300 mA.
Type = 0x0005.
write (count, cmdBuffer, dataBuffer) failed C0000004.
 Cable Type = 3, Revision = 0.
 Setting cable speed to 6 MHz.
Cable connection established.
Firmware version = 2301.
File version of C:/Xilinx/14.7/LabTools/LabTools/data/xusb_xp2.hex = 2401.
Firmware hex file version = 2401.
Downloading C:/Xilinx/14.7/LabTools/LabTools/data/xusb_xp2.hex.
Downloaded firmware version = 2401.
PLD file version = 200Dh.
 PLD version = 200Dh.
PROGRESS_END - End Operation.
Elapsed time =      1 sec.
Type = 0x0005.
ESN option: 000013E7C24E01.
Attempting to identify devices in the boundary-scan chain configuration...
INFO:iMPACT - Current time: 01/10/2016 09:30:42
// *** BATCH CMD : Identify -inferir 
PROGRESS_START - Starting Operation.
Identifying chain contents...'0': : Manufacturer's ID = Xilinx xc2c128, Version : 1
INFO:iMPACT:1777 - 
Reading C:/Xilinx/14.7/LabTools/LabTools/xbr/data/xc2c128.bsd...
INFO:iMPACT:501 - '1': Added Device xc2c128 successfully.
----------------------------------------------------------------------
----------------------------------------------------------------------
done.
PROGRESS_END - End Operation.
Elapsed time =      6 sec.
// *** BATCH CMD : identifyMPM 
// *** BATCH CMD : assignFile -p 1 -file "C:/Users/td/Local Documents/misc/macb_top_revB.jed"
'1': Loading file 'C:/Users/td/Local Documents/misc/macb_top_revB.jed' ...
done.
INFO:iMPACT:501 - '1': Added Device xc2c128 successfully.
----------------------------------------------------------------------
----------------------------------------------------------------------
INFO:iMPACT - Current time: 01/10/2016 09:32:54
// *** BATCH CMD : Program -p 1 -e -v 
PROGRESS_START - Starting Operation.
Maximum TCK operating frequency for this device chain: 33000000.
Validating chain...
Boundary-scan chain validated successfully.
'1': Erasing device...
'1': Erasure completed successfully.
'1': Programming device...
done.
'1': Verifying device...
done.
'1': Setting ISC done bits...done
'1': Programming completed successfully.
PROGRESS_END - End Operation.
Elapsed time =      2 sec.
INFO:iMPACT - Current time: 01/10/2016 09:33:01
// *** BATCH CMD : Verify -p 1 
PROGRESS_START - Starting Operation.
Maximum TCK operating frequency for this device chain: 33000000.
Validating chain...
Boundary-scan chain validated successfully.
'1': Verifying device...
done.
'1': Verification completed successfully.
PROGRESS_END - End Operation.
Elapsed time =      0 sec.
  366   Sat Oct 1 07:48:48 2016 CG & TDSaturday 1 October
11.00 Moved detector stack forward several cm. 1st DSSD now ~6cm from end of snout. Middle of stack now ~47cm from
base -> approx centre of BRIKEN.
      
      4 new 79cm ribbon cables (+kaptons) added to p-side of first two DSSDs.
      
      Bias and pulser re-connected to all relevant FEEs. 

      Detector order unchanged, i.e. DSSD1 has same serial number as in June 2016 expt. Same for DSSDs 2-6.
      
      DSSD-to-FEE map also unchanged.

15.45 R7 starts

      ASIC settings 2016Sep02-18.17.01

      BNC PB-4
       Amplitude 90,000, x2 attenuator IN
       Frequency c. 26Hz

      Master MACB
       mode 5
       50MHz external clock (rear panel)
       BNC PB-4 trigger output -> Ortec SCA -> LeCroy 429A -> Master MACB Correlation DAQ Accepted Trigger - not
working - firmware issue?

      DSSSD bias/leakage current OK - see attachments 1-2
      FEE64 temperatures OK - see attachment 3

      System-wide checks OK *except* nnaida19 fails ASIC timestamp check (no change) *and* nnaida7, nnaida21
fail ADC calibration

      AIDA SYNC, PAUSE, RESUME, Correlation L, SYNC time warp, Good Events, AIDA disc, nnaida6, nnaida5,
nnaida19 & nnaida20 statistics - see attachments 4-14

      Analysis of R7_0 - ADC data synchronised
  365   Sat Oct 1 01:57:56 2016 TD & PJCSLatest MACB firmware - 16 April 2015
  364   Fri Sep 30 07:52:56 2016 TDReport - low - AIDA correlation L/M/H statistics count 3x
The AIDA correlation L, M & H statistics count 3x for each correlation trigger,
i.e. counts and rates displayed by statistics are 3x actual counts and rates 
  363   Fri Sep 30 03:35:12 2016 TDFriday 30 September
11.37 Attempt to use external 50MHz clock for Master MACB (w/ 50MHz front panel label)

      NIM 50MHz -> NIM-TTL translator -> Master MACB (rear panel)

      Master MACB mode 0 -> 5

      Fails to ReSync, clock errors etc - see attachments 1-5

      Change NIM 50MHz -> 25MHz (to improve signal quality) and attempt ReSync (no power FEE64 power cycle) - no
change 

14.30 Master MACB mode -> 0

      NIM 25MHz -> Master MACB correlation clock input (front panel)

      BNC PB_4 frequency c. 26Hz
      Trigger output -> SCA -> LeCroy 429A -> Master MACB accepted trigger input

./analyser2 v /TapeData/Sept2016/R5_0 | grep MBS

 :
 :

 ***     MBS information: block:   471 ptr:  7203 data: 0x86807CAB module:  6 information type:  8 information
index:  0 MBS data:7CAB ts: 0x00000017AC2C4582
 ***     MBS information: block:   471 ptr:  7205 data: 0x8681575E module:  6 information type:  8 information
index:  1 MBS data:575E ts: 0x00000017AC2C4582
 ***     MBS information: block:   471 ptr:  7207 data: 0x86820000 module:  6 information type:  8 information
index:  2 MBS data:0000 ts: 0x00000017AC2C4582
 ***     MBS information: block:   471 ptr: 15767 data: 0x86800FA8 module:  6 information type:  8 information
index:  0 MBS data:0FA8 ts: 0x00000017AC669176
 ***     MBS information: block:   471 ptr: 15769 data: 0x8681576D module:  6 information type:  8 information
index:  1 MBS data:576D ts: 0x00000017AC669176
 ***     MBS information: block:   471 ptr: 15771 data: 0x86820000 module:  6 information type:  8 information
index:  2 MBS data:0000 ts: 0x00000017AC669176

0x576D0FA8 - 0x575E7CAB = 0xE92FD = 955133 * 40ns = 38205320ns = 38.2ms => 26Hz
0x00000017AC669176 - 0x00000017AC2C4582 = 0x3a4bf4 = 3820532 * 10ns = 38205320ns QED


15.45 Master MACB mode 0 -> 5
      
      NIM 50MHz -> Phillips 726 NIM-TTL-NIM -> Master MACB external clock (rear panel)
      Phillips 726 provides better quality TTL signal with c. 3ns rise/falltimes and 3.5V amplitude into 50 Ohm
cf. NIM-TTL-NIM module used previously
      See http://www.phillipsscientific.com/pdf/726ds.pdf

      RESET/SETUP DAQ OK 

      System-wide checks OK *except* nnaida19 fails ASIC timestamp check (no change)

      Start test run R6_0 to disk but no AIDA issue correlation triggers are recorded

      Can manually issue correlation triggers and resets via Correlation Status & Control tab

      Observe statistics count 3x for each trigger and reset - see https://elog.ph.ed.ac.uk/AIDA/362

aidas1> ./analyser2 v /TapeData/Sept2016/R6_0 | grep MBS

 :
 :
 Test #1 - manual correlation trigger

 ***     MBS information: block:  9626 ptr:  9991 data: 0x86807774 module:  6 information type:  8 information
index:  0 MBS data:7774 ts: 0x00000077517D2816
 ***     MBS information: block:  9626 ptr:  9993 data: 0x86817213 module:  6 information type:  8 information
index:  1 MBS data:7213 ts: 0x00000077517D2816
 ***     MBS information: block:  9626 ptr:  9995 data: 0x86820003 module:  6 information type:  8 information
index:  2 MBS data:0003 ts: 0x00000077517D2816

 :
 :
 Test #2 - manual correlation trigger x2 separated by ~10s

 ***     MBS information: block: 16751 ptr: 10787 data: 0x86807285 module:  6 information type:  8 information
index:  0 MBS data:7285 ts: 0x000000833335145A
 ***     MBS information: block: 16751 ptr: 10789 data: 0x86816A81 module:  6 information type:  8 information
index:  1 MBS data:6A81 ts: 0x000000833335145A
 ***     MBS information: block: 16751 ptr: 10791 data: 0x86820006 module:  6 information type:  8 information
index:  2 MBS data:0006 ts: 0x000000833335145A

 ***     MBS information: block: 16929 ptr:  8209 data: 0x86807BC5 module:  6 information type:  8 information
index:  0 MBS data:7BC5 ts: 0x000000837F39395A
 ***     MBS information: block: 16929 ptr:  8211 data: 0x86817D82 module:  6 information type:  8 information
index:  1 MBS data:7D82 ts: 0x000000837F39395A
 ***     MBS information: block: 16929 ptr:  8213 data: 0x86820006 module:  6 information type:  8 information
index:  2 MBS data:0006 ts: 0x000000837F39395A

0x67D827BC5 &#8722; 0x66A817285 = 0x13010940 = 318835008 × 20ns = 6376700160ns = 6.4s

0x837F39395A - 0x833335145A = 0x4C042500 = 1275340032 * 10ns = 12753400320ns = 12.8s => correlation clock
frequency = 25MHz *not* 50MHz

 :
 :
 Test #3 - manual correlation reset, followed by correlation trigger ~2s later 

 ***     MBS information: block: 17065 ptr: 15987 data: 0x86804D22 module:  6 information type:  8 information
index:  0 MBS data:4D22 ts: 0x00000083B96F05A6
 ***     MBS information: block: 17065 ptr: 15989 data: 0x86810344 module:  6 information type:  8 information
index:  1 MBS data:0344 ts: 0x00000083B96F05A6
 ***     MBS information: block: 17065 ptr: 15991 data: 0x86820000 module:  6 information type:  8 information
index:  2 MBS data:0000 ts: 0x00000083B96F05A6

0x3444d22 = 54807842 * 40ns = 2192313680ns = 2.2s

*re-check*

Correlation trigger input OK, pulse width 500ns
External clock is 50MHz
MACB master mode 6

So ... correlation clock frequency is 25MHz and Correlation DAQ Accepted Trigger not working

18.30 Per PCS request

      Master MACB clock output  25Mhz
                  reset output  not observed at DAQ GO as expected
  362   Thu Sep 29 03:20:38 2016 TD & CGThursday 29 September
11.20 R1 stops

      DSSSD bias/leakage current OK - see attachments 1-2
      FEE64 temperatures OK - see attachment 3

      System-wide checks OK *except* nnaida19 fails ASIC timestamp check (no change)

      No merger error messages - see attachment 4

      AIDA SYNC, PAUSE, RESUME, Correlation L, SYNC time warp, Good Events, AIDA disc, nnaida6, nnaida5,
nnaida19 & nnaida20 statistics - see attachments 5-15

      Analysis of R1_304 - ADC data synchronised

aidas1> ./analyser2 /TapeData/Sept2016/R1_304
 *** GREAT format 3.2.0 analyser - TD - May 2014
 *** ERROR: READ I/O error:       5002
                   blocks:      28207
          ADC data format:  105059677 (  495121.2 Hz)
        Other data format:  125077092 (  589458.4 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:        143 (       0.7 Hz)
                               RESUME:        143 (       0.7 Hz)
                              SYNC100:    1940061 (    9143.0 Hz)
                           FEE64 disc:  123135099 (  580306.3 Hz)
                             MBS info:       1646 (       7.8 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:        543 (       2.6 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 Timestamp elapsed time:      212.190 s
 FEE module #:   1 elapsed dead time       0.000 s
 FEE module #:   2 elapsed dead time       0.906 s
 FEE module #:   3 elapsed dead time       0.000 s
 FEE module #:   4 elapsed dead time       0.000 s
 FEE module #:   5 elapsed dead time       3.664 s
 FEE module #:   6 elapsed dead time       0.681 s
 FEE module #:   7 elapsed dead time       0.000 s
 FEE module #:   8 elapsed dead time       0.000 s
 FEE module #:   9 elapsed dead time       0.019 s
 FEE module #:  10 elapsed dead time       0.000 s
 FEE module #:  11 elapsed dead time       0.000 s
 FEE module #:  12 elapsed dead time       0.000 s
 FEE module #:  13 elapsed dead time       0.000 s
 FEE module #:  14 elapsed dead time       0.003 s
 FEE module #:  15 elapsed dead time       0.000 s
 FEE module #:  16 elapsed dead time       0.000 s
 FEE module #:  17 elapsed dead time       0.144 s
 FEE module #:  18 elapsed dead time       0.000 s
 FEE module #:  19 elapsed dead time       0.753 s
 FEE module #:  20 elapsed dead time       0.000 s
 FEE module #:  21 elapsed dead time       0.000 s
 FEE module #:  22 elapsed dead time       0.108 s
 FEE module #:  23 elapsed dead time       0.000 s
 FEE module #:  24 elapsed dead time       0.000 s
 FEE module #:  25 elapsed dead time       0.000 s
 FEE module #:  26 elapsed dead time       0.000 s
 FEE module #:  27 elapsed dead time       0.000 s
 FEE module #:  28 elapsed dead time       0.000 s
 FEE module #:  29 elapsed dead time       0.000 s
 FEE module #:  30 elapsed dead time       0.000 s
 FEE module #:  31 elapsed dead time       0.000 s
 FEE module #:  32 elapsed dead time       0.000 s

 *** Program elapsed time:    8.492s ( 3321.523 blocks/s, 207.595 Mb/s)

11.32 DSSSD Bias off
      FEE64 power off

17.00 nnaida1/nnaida2 & nnaida9/nnaida10
      AIDA adaptor PCB rev C -> AIDA adaptor PCB rev D

      Adaptor PCB damaged during re-install of AIDA DSSSD mounting bracket
      to adjust to vertical.

      nnaida13/nnaida14
      AIDA adaptor PCB rev D -> AIDA adaptor PCB rev D
  361   Wed Sep 28 07:51:45 2016 TD & CGNew spectrum display software installed
Spectrum display software updated
    maximum number of galleries increased to 30
    layouts may be saved to, and restored from, files /tmp/LayOut<n>.mlf where <n> = 1..8

mv /MIDAS/TclHttpd/Html/Spectrum /MIDAS/TclHttpd/Html/Spectrum.BAK-29.0916
mv /MIDAS/TclHttpd/Html/Spectrum_new_22Aug /MIDAS/TclHttpd/Html/Spectrum

aidas1> ls -l /MIDAS/TclHttpd/Html/Spectrum
total 136
-rw-r--r--. 1 npg npgstaff 32620 Aug 22 20:08 analysis.tcl
-rw-r--r--. 1 npg npgstaff  2179 Aug 22 20:08 example.html
drwxr-sr-x. 2 npg npgstaff  4096 Aug 22 20:11 images
-rwxr-xr-x. 1 npg npgstaff  5851 Aug 22 20:08 show.tcl
-rw-r--r--. 1 npg npgstaff  1246 Aug 22 20:08 SP2.txt
-rw-r--r--. 1 npg npgstaff     0 Aug 22 20:08 SP3.txt
-rw-r--r--. 1 npg npgstaff     0 Aug 22 20:08 SP4.txt
-rw-r--r--. 1 npg npgstaff     0 Aug 22 20:08 SP5.txt
-rw-r--r--. 1 npg npgstaff  6631 Aug 22 20:08 Spectrum.js
-rw-r--r--. 1 npg npgstaff 44386 Aug 22 20:08 Spectrum.tcl
-rw-r--r--. 1 npg npgstaff 30765 Aug 22 20:08 Spectrum.tml

aidas1> ls -l /MIDAS/TclHttpd/Html/Spectrum.BAK-280916
total 152
-rw-r--r--. 1 npg npgstaff 29462 Feb  2  2016 analysis.tcl
drwxr-sr-x. 2 npg npgstaff  4096 Oct  9  2013 flot
-rw-r--r--. 1 npg npgstaff   214 Mar 15  2016 fort.12
-rw-r--r--. 1 npg npgstaff   678 Mar 15  2016 fort.8
-rw-r--r--. 1 npg npgstaff  1253 Feb  2  2016 Global.tcl
drwxr-sr-x. 2 npg npgstaff  4096 Oct  9  2013 images
-rw-r--r--. 1 npg npgstaff  2173 Feb  2  2016 options.html
-rwxr-xr-x. 1 npg npgstaff  5851 Feb  2  2016 show.tcl
-rw-r--r--. 1 npg npgstaff  1246 Feb  2  2016 SP2.txt
-rw-r--r--. 1 npg npgstaff     0 Feb  2  2016 SP3.txt
-rw-r--r--. 1 npg npgstaff     0 Feb  2  2016 SP4.txt
-rw-r--r--. 1 npg npgstaff     0 Feb  2  2016 SP5.txt
-rw-r--r--. 1 npg npgstaff  6438 Feb  2  2016 Spectrum.js
-rw-r--r--. 1 npg npgstaff 43204 Feb  2  2016 Spectrum.tcl
-rw-r--r--. 1 npg npgstaff 29496 Feb  2  2016 Spectrum.tml
ELOG V3.1.4-unknown