AIDA GELINA BRIKEN nToF CRIB ISOLDE CIRCE nTOFCapture DESPEC DTAS EDI_PSA 179Ta CARME StellarModelling DCF K40
  AIDA  ELOG logo
Message ID: 311     Entry time: Sun Jun 12 03:05:37 2016
Author: TD, AE, CG, MA 
Subject: Sunday 12 June 2016 part 2 
BigRIPS switched from 60Ti to 64V

AIDA48 (AIDA)2034 (EURICA) 2153 (BigRIPS) 

start 08.44
stop 09.08 (FEE64 synchronisation lost -> power cycle & reboot FEE64s)

AIDA49 (AIDA) 2036 (EURICA) 2154 (BigRIPS) 

Power cycle and reboot FEE64s
FADC power down (per PJCS recommendation)
All FEE64s pass all system wide checks *except* nnaida16 which failed the ADC calibration (not significant
as waveforms are disabled and FADC powered down anyway)

start 09.30
stop 09.58

ASIC settings 2016Jun12-09.09.37


AIDA50 (AIDA) 2037(EURICA) 2155 (BigRIPS) 

start 10.02
stop 10.09 (beam lost)

ASIC settings 2016Jun12-10.10.08
  changes to nnaida15 discriminator settings to reduce deadtime (pause-resume rate)

AIDA51 (AIDA) 2038 (EURICA) 2156 (BigRIPS) 

start 10.45
stop 11.55

ASIC settings 2016Jun12-10.10.08

aidas1> ~/td/GREAT/analyser2 /TapeData/NP1512/AIDA51_0
 *** GREAT format 3.2.0 analyser - TD - May 2014
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  163625493 (  974305.9 Hz)
        Other data format:   97494507 (  580529.8 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:       1227 (       7.3 Hz)
                               RESUME:       1227 (       7.3 Hz)
                              SYNC100:      64065 (     381.5 Hz)
                           FEE64 disc:   96631002 (  575388.1 Hz)
                             MBS info:     796986 (    4745.6 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:     213982 (    1274.2 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 Timestamp elapsed time:      167.941 s
 FEE module #:   1 elapsed dead time       0.142 s
 FEE module #:   2 elapsed dead time       1.125 s
 FEE module #:   3 elapsed dead time       0.000 s
 FEE module #:   4 elapsed dead time       0.000 s
 FEE module #:   5 elapsed dead time       0.307 s
 FEE module #:   6 elapsed dead time       0.579 s
 FEE module #:   7 elapsed dead time       0.000 s
 FEE module #:   8 elapsed dead time       0.000 s
 FEE module #:   9 elapsed dead time       0.082 s
 FEE module #:  10 elapsed dead time       0.112 s
 FEE module #:  11 elapsed dead time       3.204 s
 FEE module #:  12 elapsed dead time       0.005 s
 FEE module #:  13 elapsed dead time       0.212 s
 FEE module #:  14 elapsed dead time       0.426 s
 FEE module #:  15 elapsed dead time       0.000 s
 FEE module #:  16 elapsed dead time       0.000 s
 FEE module #:  17 elapsed dead time       0.000 s
 FEE module #:  18 elapsed dead time       0.046 s
 FEE module #:  19 elapsed dead time       0.000 s
 FEE module #:  20 elapsed dead time       0.064 s
 FEE module #:  21 elapsed dead time       0.319 s
 FEE module #:  22 elapsed dead time       0.248 s
 FEE module #:  23 elapsed dead time       0.010 s
 FEE module #:  24 elapsed dead time       0.190 s
 FEE module #:  25 elapsed dead time       0.000 s
 FEE module #:  26 elapsed dead time       0.000 s
 FEE module #:  27 elapsed dead time       0.000 s
 FEE module #:  28 elapsed dead time       0.000 s
 FEE module #:  29 elapsed dead time       0.000 s
 FEE module #:  30 elapsed dead time       0.000 s
 FEE module #:  31 elapsed dead time       0.000 s
 FEE module #:  32 elapsed dead time       0.000 s

 *** Program elapsed time:   60.988s (  524.691 blocks/s,  32.793 Mb/s)

See attachments 1-7 for AIDA51 rates etc

See attachment 8 for FEE64 synchronisation check (file AIDA51_0) - OK

AIDA52 (AIDA) 2039 (EURICA) 2158 (BigRIPS)  

Start 11.56
Stop 12.54 (AIDA FEE lose sync)

Settings file 2016Jun12-10.10.08
Checked correlation of FEEs in file AIDA52_0 at 12.06 and everything seems ok.

aidas1> ~/td/GREAT/analyser2 /TapeData/NP1512/AIDA52_9
 *** GREAT format 3.2.0 analyser - TD - May 2014
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  163879044 (  985540.7 Hz)
        Other data format:   97240956 (  584790.6 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:       1315 (       7.9 Hz)
                               RESUME:       1315 (       7.9 Hz)
                              SYNC100:      63433 (     381.5 Hz)
                           FEE64 disc:   96378426 (  579603.4 Hz)
                             MBS info:     796467 (    4789.8 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:     215707 (    1297.2 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          1 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 Timestamp elapsed time:      166.283 s
 FEE module #:   1 elapsed dead time       0.088 s
 FEE module #:   2 elapsed dead time       0.724 s
 FEE module #:   3 elapsed dead time       0.000 s
 FEE module #:   4 elapsed dead time       0.000 s
 FEE module #:   5 elapsed dead time       0.510 s
 FEE module #:   6 elapsed dead time       1.337 s
 FEE module #:   7 elapsed dead time       0.000 s
 FEE module #:   8 elapsed dead time       0.000 s
 FEE module #:   9 elapsed dead time       0.087 s
 FEE module #:  10 elapsed dead time       0.121 s
 FEE module #:  11 elapsed dead time       2.706 s
 FEE module #:  12 elapsed dead time       0.000 s
 FEE module #:  13 elapsed dead time       0.127 s
 FEE module #:  14 elapsed dead time       0.191 s
 FEE module #:  15 elapsed dead time       0.000 s
 FEE module #:  16 elapsed dead time       0.000 s
 FEE module #:  17 elapsed dead time       0.000 s
 FEE module #:  18 elapsed dead time       0.058 s
 FEE module #:  19 elapsed dead time       0.000 s
 FEE module #:  20 elapsed dead time       0.071 s
 FEE module #:  21 elapsed dead time       0.399 s
 FEE module #:  22 elapsed dead time       0.222 s
 FEE module #:  23 elapsed dead time       0.015 s
 FEE module #:  24 elapsed dead time       0.061 s
 FEE module #:  25 elapsed dead time       0.000 s
 FEE module #:  26 elapsed dead time       0.000 s
 FEE module #:  27 elapsed dead time       0.000 s
 FEE module #:  28 elapsed dead time       0.000 s
 FEE module #:  29 elapsed dead time       0.000 s
 FEE module #:  30 elapsed dead time       0.000 s
 FEE module #:  31 elapsed dead time       0.000 s
 FEE module #:  32 elapsed dead time       0.000 s

 *** Program elapsed time:   47.215s (  677.753 blocks/s,  42.360 Mb/s)

12.20 FEE64 temperatures - see attachment 9
      Note with all FADC powered off all temperatures now green cf. attachment 8 https://elog.ph.ed.ac.uk/AIDA/305
      Julabo FL11006 set point +17 deg C (B3F ambient temperature +25.1 deg C, d.p. +11.2 deg C, RH 40.3%)

13.11 AIDA52_13 per FEE64 ADC timestamp activity OK

12.54 AIDA FEE64 lose synchronisation
      No change in system-wide checks 

AIDA53 (AIDA) 2040 (EURICA) 2159 (BigRIPS)

Power cycled and rebooted FEE64s
System-wide checks all OK except 6 failures for ADC calibration - not retried

Start 13.09
Stop 13.44 (stop to reset EURICA VME crate)

ASIC Settings file 2016Jun12-10.10.08

13.17 AIDA53_0 FEE64 sync check - OK

aidas1> ~/td/GREAT/analyser2 /TapeData/NP1512/AIDA53_0
 *** GREAT format 3.2.0 analyser - TD - May 2014
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  167386044 ( 1100597.1 Hz)
        Other data format:   93733956 (  616319.7 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:        714 (       4.7 Hz)
                               RESUME:        714 (       4.7 Hz)
                              SYNC100:      58017 (     381.5 Hz)
                           FEE64 disc:   92936706 (  611077.6 Hz)
                             MBS info:     737805 (    4851.2 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:     166106 (    1092.2 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          1 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 Timestamp elapsed time:      152.087 s
 FEE module #:   1 elapsed dead time       0.020 s
 FEE module #:   2 elapsed dead time       0.209 s
 FEE module #:   3 elapsed dead time       0.000 s
 FEE module #:   4 elapsed dead time       0.000 s
 FEE module #:   5 elapsed dead time       0.107 s
 FEE module #:   6 elapsed dead time       0.824 s
 FEE module #:   7 elapsed dead time       0.000 s
 FEE module #:   8 elapsed dead time       0.008 s
 FEE module #:   9 elapsed dead time       0.003 s
 FEE module #:  10 elapsed dead time       0.000 s
 FEE module #:  11 elapsed dead time       0.378 s
 FEE module #:  12 elapsed dead time       0.017 s
 FEE module #:  13 elapsed dead time       0.000 s
 FEE module #:  14 elapsed dead time       0.059 s
 FEE module #:  15 elapsed dead time       0.172 s
 FEE module #:  16 elapsed dead time       1.101 s
 FEE module #:  17 elapsed dead time       0.000 s
 FEE module #:  18 elapsed dead time       0.018 s
 FEE module #:  19 elapsed dead time       0.000 s
 FEE module #:  20 elapsed dead time       0.093 s
 FEE module #:  21 elapsed dead time       0.216 s
 FEE module #:  22 elapsed dead time       0.161 s
 FEE module #:  23 elapsed dead time       0.665 s
 FEE module #:  24 elapsed dead time       0.201 s
 FEE module #:  25 elapsed dead time       0.000 s
 FEE module #:  26 elapsed dead time       0.000 s
 FEE module #:  27 elapsed dead time       0.000 s
 FEE module #:  28 elapsed dead time       0.000 s
 FEE module #:  29 elapsed dead time       0.000 s
 FEE module #:  30 elapsed dead time       0.000 s
 FEE module #:  31 elapsed dead time       0.000 s
 FEE module #:  32 elapsed dead time       0.000 s

 *** Program elapsed time:   25.180s ( 1270.866 blocks/s,  79.429 Mb/s)

AIDA54 (AIDA) 2041 (EURICA) 2160 (BigRIPS) 

Start 13.46
Stop 13.53 (loss of sync AIDA54_0)

ASIC Settings file 2016Jun12-10.10.08

System-wide checks OK following loss of sync

19:25
Stable operation most of the afternoon through multiple DAQ start/stops.
FEEs remained synchronised throughout.
SYNCs lost in run AIDA57_37 leading to run stop/start.
-> in AIDA57_37 noticed relatively large chunks of data lost in nnaida6. (see attachments 10+11

19.40 Cumulative pause-resume time for AIDA57_37 (see above) and most recent
complete data file. The pause-resume times are relatively large compared to
other FEE64s but low relative to the measurement time. But we should remember
that we have observed periods of inactivity not bounded by pause-resume tags.

aidas1> ./analyser2 /TapeData/NP1512/AIDA57_37
 *** GREAT format 3.2.0 analyser - TD - May 2014
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  164401851 (  929891.0 Hz)
        Other data format:   96718149 (  547057.9 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:       1081 (       6.1 Hz)
                               RESUME:       1081 (       6.1 Hz)
                              SYNC100:      67440 (     381.5 Hz)
                           FEE64 disc:   95842999 (  542107.9 Hz)
                             MBS info:     805548 (    4556.3 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:     194112 (    1097.9 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 Timestamp elapsed time:      176.797 s
 FEE module #:   1 elapsed dead time       0.149 s
 FEE module #:   2 elapsed dead time       0.741 s
 FEE module #:   3 elapsed dead time       0.004 s
 FEE module #:   4 elapsed dead time       0.000 s
 FEE module #:   5 elapsed dead time       0.425 s
 FEE module #:   6 elapsed dead time       1.697 s
 FEE module #:   7 elapsed dead time       0.000 s
 FEE module #:   8 elapsed dead time       0.000 s
 FEE module #:   9 elapsed dead time       0.118 s
 FEE module #:  10 elapsed dead time       0.084 s
 FEE module #:  11 elapsed dead time       1.064 s
 FEE module #:  12 elapsed dead time       0.014 s
 FEE module #:  13 elapsed dead time       0.063 s
 FEE module #:  14 elapsed dead time       0.267 s
 FEE module #:  15 elapsed dead time       0.000 s
 FEE module #:  16 elapsed dead time       0.000 s
 FEE module #:  17 elapsed dead time       0.000 s
 FEE module #:  18 elapsed dead time       0.010 s
 FEE module #:  19 elapsed dead time       0.000 s
 FEE module #:  20 elapsed dead time       0.059 s
 FEE module #:  21 elapsed dead time       0.125 s
 FEE module #:  22 elapsed dead time       0.225 s
 FEE module #:  23 elapsed dead time       0.000 s
 FEE module #:  24 elapsed dead time       0.205 s
 FEE module #:  25 elapsed dead time       0.000 s
 FEE module #:  26 elapsed dead time       0.000 s
 FEE module #:  27 elapsed dead time       0.000 s
 FEE module #:  28 elapsed dead time       0.000 s
 FEE module #:  29 elapsed dead time       0.000 s
 FEE module #:  30 elapsed dead time       0.000 s
 FEE module #:  31 elapsed dead time       0.000 s
 FEE module #:  32 elapsed dead time       0.000 s

 *** Program elapsed time:   23.047s ( 1388.475 blocks/s,  86.780 Mb/s)

aidas1> ./analyser2 /TapeData/NP1512/AIDA58_6
 *** GREAT format 3.2.0 analyser - TD - May 2014
 ***            ADC data: block: 14849 ptr: 14685 data: 0xC40181C9 module: 16 fail: 0 range: 0 id:  1025 channel:  
1 adc: 33225  ts: 0x01AB000000A0 OLD: ts: 0x01AB1000003E tag: 3 type: 0
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  160685457 (  937303.1 Hz)
        Other data format:  100434543 (  585850.2 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:       1282 (       7.5 Hz)
                               RESUME:       1282 (       7.5 Hz)
                              SYNC100:      65397 (     381.5 Hz)
                           FEE64 disc:   99536560 (  580612.1 Hz)
                             MBS info:     830022 (    4841.6 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:     213213 (    1243.7 Hz)

                Timewarps:        ADC:          1 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 Timestamp elapsed time:      171.434 s
 FEE module #:   1 elapsed dead time       0.091 s
 FEE module #:   2 elapsed dead time       0.870 s
 FEE module #:   3 elapsed dead time       0.000 s
 FEE module #:   4 elapsed dead time       0.000 s
 FEE module #:   5 elapsed dead time       0.107 s
 FEE module #:   6 elapsed dead time       0.518 s
 FEE module #:   7 elapsed dead time       0.000 s
 FEE module #:   8 elapsed dead time       0.000 s
 FEE module #:   9 elapsed dead time       0.058 s
 FEE module #:  10 elapsed dead time       0.095 s
 FEE module #:  11 elapsed dead time       2.397 s
 FEE module #:  12 elapsed dead time       0.055 s
 FEE module #:  13 elapsed dead time       0.157 s
 FEE module #:  14 elapsed dead time       0.238 s
 FEE module #:  15 elapsed dead time       0.000 s
 FEE module #:  16 elapsed dead time       0.000 s
 FEE module #:  17 elapsed dead time       0.000 s
 FEE module #:  18 elapsed dead time       0.013 s
 FEE module #:  19 elapsed dead time       0.000 s
 FEE module #:  20 elapsed dead time       0.174 s
 FEE module #:  21 elapsed dead time       0.298 s
 FEE module #:  22 elapsed dead time       0.280 s
 FEE module #:  23 elapsed dead time       0.004 s
 FEE module #:  24 elapsed dead time       0.071 s
 FEE module #:  25 elapsed dead time       0.000 s
 FEE module #:  26 elapsed dead time       0.000 s
 FEE module #:  27 elapsed dead time       0.000 s
 FEE module #:  28 elapsed dead time       0.000 s
 FEE module #:  29 elapsed dead time       0.000 s
 FEE module #:  30 elapsed dead time       0.000 s
 FEE module #:  31 elapsed dead time       0.000 s
 FEE module #:  32 elapsed dead time       0.000 s

 *** Program elapsed time:   18.234s ( 1754.927 blocks/s, 109.683 Mb/s)
Attachment 1: 10.png  87 kB  | Hide | Hide all
10.png
Attachment 2: 11.png  90 kB  | Hide | Hide all
11.png
Attachment 3: 12.png  90 kB  | Hide | Hide all
12.png
Attachment 4: 13.png  83 kB  | Hide | Hide all
13.png
Attachment 5: 14.png  12 kB  | Hide | Hide all
14.png
Attachment 6: 15.png  12 kB  | Hide | Hide all
15.png
Attachment 7: 16.png  554 kB  | Hide | Hide all
16.png
Attachment 8: 17.png  192 kB  | Hide | Hide all
17.png
Attachment 9: 20.png  130 kB  Uploaded Sun Jun 12 05:31:30 2016  | Hide | Hide all
20.png
Attachment 10: AIDA57_37-pause.png  29 kB  Uploaded Sun Jun 12 12:28:11 2016  | Hide | Hide all
AIDA57_37-pause.png
Attachment 11: ADIA57_37.png  158 kB  Uploaded Sun Jun 12 12:29:49 2016  | Hide | Hide all
ADIA57_37.png
ELOG V3.1.4-unknown