AIDA GELINA BRIKEN nToF CRIB ISOLDE CIRCE nTOFCapture DESPEC DTAS EDI_PSA 179Ta CARME StellarModelling DCF K40
  AIDA, Page 32 of 46  ELOG logo
New entries since:Thu Jan 1 01:00:00 1970
ID Date Author Subjectdown
  454   Mon Nov 14 05:51:36 2016 TDMonday 14 November
14.51 DSSSD bias & leakage currents OK - see attachments 1 & 2
      Ambient temperature +24.8 deg C, d.p. +7.2 deg C, RH 32.6%
      FEE64 temperatures OK - see attachment 3
    
      
Attachment 1: 1.png
1.png
Attachment 2: 2.png
2.png
Attachment 3: 3.png
3.png
  795   Mon May 13 03:23:58 2019 CA, TD, OHMonday 13 May
09.55 all system wide checks OK *except* nnaida7 fails ADC calibration

      FEE64 temperatures OK - see attachment 1

      good event statistics OK - see attachment 2
      all FEE64s <100k, 11x < 20k

      1.8.L spectra - see attachments 3 & 4
      nnaida1 70ch FWHM, nnaida3 80 ch FWHM

      detector biases & leakage currents OK - see attachments 5 & 6

      1.8.W spectra 20us FSR - see attachments 7 & 8

      nnaida1 Options, Local Controls, Data Redaout, Discriminator Controls - see attachment 9-13

      Lost Activity Monitor -see attachment 14

18.01 DAQ found stopped

      This was caused by a chnage to the AIDA external clock frequency - see https://elog.ph.ed.ac.uk/AIDA/798

      Following change of AIDA external clock frequency to 50MHz

      DAQ RESET
      DAQ SETUP

      Sync all ASIC clocks using Resync
      
      all system wide checks OK *except* nnaida7 fails ADC calibration

      zero all histograms

      DAQ GO

18.31 FEE64 temperatures OK - see attachment 15

      good event statistics OK - see attachment 16
      all FEE64s <100k, 10x < 20k

      detector biases & leakage currents OK - see attachments 17 & 18
Attachment 1: 10.png
10.png
Attachment 2: 21.png
21.png
Attachment 3: 26.png
26.png
Attachment 4: 27.png
27.png
Attachment 5: 22.png
22.png
Attachment 6: 23.png
23.png
Attachment 7: 70.png
70.png
Attachment 8: 71.png
71.png
Attachment 9: 60.png
60.png
Attachment 10: 61.png
61.png
Attachment 11: 62.png
62.png
Attachment 12: 63.png
63.png
Attachment 13: 64.png
64.png
Attachment 14: 65.png
65.png
Attachment 15: 3.png
3.png
Attachment 16: 4.png
4.png
Attachment 17: 5.png
5.png
Attachment 18: 6.png
6.png
  313   Mon Jun 13 03:45:15 2016 TDMonday 13 June 2016
10.20 AIDA62 found stalled - no SYNCs, no data transfer
      All FEE64s pass all system-wide tests *except* nnaida3 & nnaida8 which fail ADC calibration
      Data files indicate DAQ stopped c. 06.56
      DAQ stop and file closed

10.30 Detector bias & leakage currents, trigger rates and FEE64 temperatures - see attcahments 1-4
      Julabo FL11006 set point +17 deg C (B2F/F11 ambient temperature +25.3 deg C, d.p. +11.6 deg C, RH 42.7%)

10.48 AIDA63
      Pulser walkthrough

      BNC PB4 settings

      Amplitudes 10,000-90,000 @ 10,000 step
      x5 attenuator IN
      Frequency 250Hz range 
      t_r 50ns tau_d 50us
      - polarity (+ polarity via EG&G Ortec 433A Sum & Invert Amp)
      INT ref, tail pulse, MIN delay

      ASIC settings 2016Jun12-09.09.37

      See attachment 5 showing 9x pulser peaks, noise/beta/background and low amplitude pulser-related peak

      Spectra saved to /MIDAS/SpecData c. 11.00 13 June 2016
      Note directory names are derived from internal FEE64 date/time settings which be wrong or unset

      All spectra cleared

11.06 AIDA64
     
      Per AIDA63 *except*
  
      BNC PB-4 amplitudes

      10,000-2,000 @ 2,000 step

      Spectra saved to /MIDAS/SpecData c. 11.13 13 June 2016

      Note that not all pulse peak amplitudes will be above the slow comparator threshold 

      Attachments 6-10 hit/stat spectra and example energy spectra

EURICA standalone gamma energy and efficiency measurements using 152Eu and 133Ba.
The gamma-ray sources were placed immediately upstream of DSSSD#1 inside the AIDA 
snout.

16.00 Obtained 'unable to connect' to nnaida1 through multiple power cycles/reboots and restarts
      of MERGE unable to clear problem. Finally reosrted to a reboot of aidas1 which did 'fix' the
      problem.

      AIDA65
      Brief test run  to check DAQ/merger/TapeServer - OK

16.06 AIDA66 (AIDA) 1 (EURICA)

      ~11kBq (current activity) 60Co source immediately upstream of DSSSD#1 inside the AIDA snout.

      ASIC settings 2016Jun12-09.09.37

      FADC disabled

      BNC PB-4 pulser
      Amplitude 90,000
      Frequency 25Hz range (probably ~1-few Hz)

      Attachments 11-12 Detector biases & leakage currents -OK

16.37 Attachment 13 - SyncCheck plots

16.50 FR adds ~40kBq 60Co source on top of the AIDA snout immediately above the DSSSDs
      DAQ continues

aidas1> ~/td/GREAT/analyser2 AIDA66_17
 *** GREAT format 3.2.0 analyser - TD - May 2014
 ***   SYNC100: block:     1 ptr:  5567 data: 0x82400595 module:  2 information type:  4 information field:
0x00000595 ts: 0x000000595DD400A0 OLD: ts: 0x07158F300DD4009D tag: 3 type: 0
 *** FEE64 discriminator: block: 15627 ptr: 14341 data: 0x97620008 module: 23 information type:  6 information
field: 0x00020008 ts: 0x005B300000A0 OLD: ts: 0x005B40000050 tag: 2 type: 6
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  161285942 (  973887.8 Hz)
        Other data format:   99834058 (  602824.8 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:        118 (       0.7 Hz)
                               RESUME:        118 (       0.7 Hz)
                              SYNC100:      63176 (     381.5 Hz)
                           FEE64 disc:   98983953 (  597691.6 Hz)
                             MBS info:     786693 (    4750.3 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:      26988 (     163.0 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          1 (       0.0 Hz)
                           FEE64 disc:          1 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 Timestamp elapsed time:      165.610 s
 FEE module #:   1 elapsed dead time       0.378 s
 FEE module #:   2 elapsed dead time       0.464 s
 FEE module #:   3 elapsed dead time       0.002 s
 FEE module #:   4 elapsed dead time       0.000 s
 FEE module #:   5 elapsed dead time       4.701 s
 FEE module #:   6 elapsed dead time       0.228 s
 FEE module #:   7 elapsed dead time       0.000 s
 FEE module #:   8 elapsed dead time       0.000 s
 FEE module #:   9 elapsed dead time       0.304 s
 FEE module #:  10 elapsed dead time       0.154 s
 FEE module #:  11 elapsed dead time       0.901 s
 FEE module #:  12 elapsed dead time       0.000 s
 FEE module #:  13 elapsed dead time       0.203 s
 FEE module #:  14 elapsed dead time       0.164 s
 FEE module #:  15 elapsed dead time       0.000 s
 FEE module #:  16 elapsed dead time       0.000 s
 FEE module #:  17 elapsed dead time       0.000 s
 FEE module #:  18 elapsed dead time       0.000 s
 FEE module #:  19 elapsed dead time       0.000 s
 FEE module #:  20 elapsed dead time       0.000 s
 FEE module #:  21 elapsed dead time       0.000 s
 FEE module #:  22 elapsed dead time       0.346 s
 FEE module #:  23 elapsed dead time       0.000 s
 FEE module #:  24 elapsed dead time       0.000 s
 FEE module #:  25 elapsed dead time       0.000 s
 FEE module #:  26 elapsed dead time       0.000 s
 FEE module #:  27 elapsed dead time       0.000 s
 FEE module #:  28 elapsed dead time       0.000 s
 FEE module #:  29 elapsed dead time       0.000 s
 FEE module #:  30 elapsed dead time       0.000 s
 FEE module #:  31 elapsed dead time       0.000 s
 FEE module #:  32 elapsed dead time       0.000 s

 *** Program elapsed time:  123.023s (  260.113 blocks/s,  16.257 Mb/s)

23.00 Found DAQ stalled - zero AIDA SYNCs from all FEE64s, and data trsabfer halted
      Disk files indicate stall at c. 18.58 (AIDA66_58)

      See attachments 14-19

      All FEE64s pass all system-wide tests

      Installed new versions of check.tcl/check.tml - see attachment 20
      Collect All SYNC Error Counters for Baseline selected

23.15 Standard DAQ stop/go sequence restarts DAQ

      AIDA67
   
      No changes from AIDA66

[td@localhost 1E47-5D81]$ ~/GREAT/analyser2 AIDA67_7
 *** GREAT format 3.2.0 analyser - TD - May 2014
 ***   SYNC100 timestamp: block:     1 ptr:  6123 data: 0x8B4028BF module: 11 information type:  4 information 
field: 0x000028BF ts: 0x0000028BF38C00A0 OLD: ts: 0x0DAF8F30038C0093 tag: 2 type: 6
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  162789406 (  931310.8 Hz)
        Other data format:   98330594 (  562544.8 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:         81 (       0.5 Hz)
                               RESUME:         81 (       0.5 Hz)
                              SYNC100:      66680 (     381.5 Hz)
                           FEE64 disc:   97373010 (  557066.5 Hz)
                             MBS info:     890742 (    5095.9 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:      40512 (     231.8 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          1 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 Timestamp elapsed time:      174.796 s
 FEE module #:   1 elapsed dead time       0.162 s
 FEE module #:   2 elapsed dead time       0.232 s
 FEE module #:   3 elapsed dead time       0.000 s
 FEE module #:   4 elapsed dead time       0.000 s
 FEE module #:   5 elapsed dead time       0.213 s
 FEE module #:   6 elapsed dead time       0.273 s
 FEE module #:   7 elapsed dead time       0.000 s
 FEE module #:   8 elapsed dead time       0.000 s
 FEE module #:   9 elapsed dead time       0.433 s
 FEE module #:  10 elapsed dead time       0.123 s
 FEE module #:  11 elapsed dead time       0.417 s
 FEE module #:  12 elapsed dead time       0.000 s
 FEE module #:  13 elapsed dead time       0.127 s
 FEE module #:  14 elapsed dead time       0.000 s
 FEE module #:  15 elapsed dead time       0.000 s
 FEE module #:  16 elapsed dead time       0.000 s
 FEE module #:  17 elapsed dead time       0.000 s
 FEE module #:  18 elapsed dead time       0.000 s
 FEE module #:  19 elapsed dead time       0.000 s
 FEE module #:  20 elapsed dead time       0.095 s
 FEE module #:  21 elapsed dead time       0.000 s
 FEE module #:  22 elapsed dead time       0.030 s
 FEE module #:  23 elapsed dead time       0.000 s
 FEE module #:  24 elapsed dead time       0.000 s
 FEE module #:  25 elapsed dead time       0.000 s
 FEE module #:  26 elapsed dead time       0.000 s
 FEE module #:  27 elapsed dead time       0.000 s
 FEE module #:  28 elapsed dead time       0.000 s
 FEE module #:  29 elapsed dead time       0.000 s
 FEE module #:  30 elapsed dead time       0.000 s
 FEE module #:  31 elapsed dead time       0.000 s
 FEE module #:  32 elapsed dead time       0.000 s

 *** Program elapsed time:  338.012s (   94.671 blocks/s,   5.917 Mb/s)

***            ADC data: block:     1 ptr:  6003 data: 0xC63781A0 module: 24 fail: 0 range: 0 id:  1591 
channel: 55 adc: 33184  ts: 0x************
 ***            ADC data: block:     1 ptr:  6005 data: 0xC2837F23 module: 10 fail: 0 range: 0 id:   643 
channel:  3 adc: 32547  ts: 0x************
 ***            ADC data: block:     1 ptr:  6007 data: 0xC27E7DF9 module:  9 fail: 0 range: 0 id:   638 
channel: 62 adc: 32249  ts: 0x************
 ***            ADC data: block:     1 ptr:  6009 data: 0xC1BA7D10 module:  6 fail: 0 range: 0 id:   442 
channel: 58 adc: 32016  ts: 0x************
 ***            ADC data: block:     1 ptr:  6011 data: 0xC37A7DE7 module: 13 fail: 0 range: 0 id:   890 
channel: 58 adc: 32231  ts: 0x************
 ***            ADC data: block:     1 ptr:  6013 data: 0xC62C8141 module: 24 fail: 0 range: 0 id:  1580 
channel: 44 adc: 33089  ts: 0x************
 *** FEE64 discriminator: block:     1 ptr:  6015 data: 0x81641120 module:  1 information type:  6 information 
field: 0x00041120 ts: 0x************
 *** FEE64 discriminator: block:     1 ptr:  6017 data: 0x81640806 module:  1 information type:  6 information 
field: 0x00040806 ts: 0x************
 *** FEE64 discriminator: block:     1 ptr:  6019 data: 0x8B622000 module: 11 information type:  6 information 
field: 0x00022000 ts: 0x************
 *** FEE64 discriminator: block:     1 ptr:  6021 data: 0x81621000 module:  1 information type:  6 information 
field: 0x00021000 ts: 0x************
 *** FEE64 discriminator: block:     1 ptr:  6023 data: 0x86640912 module:  6 information type:  6 information 
field: 0x00040912 ts: 0x************
 *** FEE64 discriminator: block:     1 ptr:  6025 data: 0x81640008 module:  1 information type:  6 information 
field: 0x00040008 ts: 0x************
 *** FEE64 discriminator: block:     1 ptr:  6027 data: 0x86644009 module:  6 information type:  6 information 
field: 0x00044009 ts: 0x************
 *** FEE64 discriminator: block:     1 ptr:  6029 data: 0x81622880 module:  1 information type:  6 information 
field: 0x00022880 ts: 0x************
 *** FEE64 discriminator: block:     1 ptr:  6031 data: 0x8B622000 module: 11 information type:  6 information 
field: 0x00022000 ts: 0x************
 *** FEE64 discriminator: block:     1 ptr:  6033 data: 0x81620510 module:  1 information type:  6 information 
field: 0x00020510 ts: 0x************
 ***            ADC data: block:     1 ptr:  6035 data: 0xC17774D5 module:  5 fail: 0 range: 0 id:   375 
channel: 55 adc: 29909  ts: 0x************
 ***            ADC data: block:     1 ptr:  6037 data: 0xC31480E9 module: 12 fail: 0 range: 0 id:   788 
channel: 20 adc: 33001  ts: 0x************
 ***            ADC data: block:     1 ptr:  6039 data: 0xC1BD7ED2 module:  6 fail: 0 range: 0 id:   445 
channel: 61 adc: 32466  ts: 0x************
 ***            ADC data: block:     1 ptr:  6041 data: 0xC3957E68 module: 14 fail: 0 range: 0 id:   917 
channel: 21 adc: 32360  ts: 0x************
 ***            ADC data: block:     1 ptr:  6043 data: 0xC25E7E3C module:  9 fail: 0 range: 0 id:   606 
channel: 30 adc: 32316  ts: 0x************
 ***            ADC data: block:     1 ptr:  6045 data: 0xC2777F9B module:  9 fail: 0 range: 0 id:   631 
channel: 55 adc: 32667  ts: 0x************
 ***            ADC data: block:     1 ptr:  6047 data: 0xC3627F99 module: 13 fail: 0 range: 0 id:   866 
channel: 34 adc: 32665  ts: 0x************
 ***            ADC data: block:     1 ptr:  6049 data: 0xC0C08485 module:  3 fail: 0 range: 0 id:   192 
channel:  0 adc: 33925  ts: 0x************
 ***            ADC data: block:     1 ptr:  6051 data: 0xC3B77E63 module: 14 fail: 0 range: 0 id:   951 
channel: 55 adc: 32355  ts: 0x************
 ***            ADC data: block:     1 ptr:  6053 data: 0xC28A7F9E module: 10 fail: 0 range: 0 id:   650 
channel: 10 adc: 32670  ts: 0x************
 ***            ADC data: block:     1 ptr:  6055 data: 0xC2B77ED9 module: 10 fail: 0 range: 0 id:   695 
channel: 55 adc: 32473  ts: 0x************
 ***            ADC data: block:     1 ptr:  6057 data: 0xC2657E47 module:  9 fail: 0 range: 0 id:   613 
channel: 37 adc: 32327  ts: 0x************
 ***            ADC data: block:     1 ptr:  6059 data: 0xC5417EB7 module: 21 fail: 0 range: 0 id:  1345 
channel:  1 adc: 32439  ts: 0x************
 ***            ADC data: block:     1 ptr:  6061 data: 0xC5777ECD module: 21 fail: 0 range: 0 id:  1399 
channel: 55 adc: 32461  ts: 0x************
 ***            ADC data: block:     1 ptr:  6063 data: 0xC3777D25 module: 13 fail: 0 range: 0 id:   887 
channel: 55 adc: 32037  ts: 0x************
 ***            ADC data: block:     1 ptr:  6065 data: 0xC2417E9B module:  9 fail: 0 range: 0 id:   577 
channel:  1 adc: 32411  ts: 0x************
 ***            ADC data: block:     1 ptr:  6067 data: 0xC63782CB module: 24 fail: 0 range: 0 id:  1591 
channel: 55 adc: 33483  ts: 0x************
 ***            ADC data: block:     1 ptr:  6069 data: 0xC24A7F3D module:  9 fail: 0 range: 0 id:   586 
channel: 10 adc: 32573  ts: 0x************
 ***            ADC data: block:     1 ptr:  6071 data: 0xC2DC8028 module: 11 fail: 0 range: 0 id:   732 
channel: 28 adc: 32808  ts: 0x************
 ***            ADC data: block:     1 ptr:  6073 data: 0xC281801A module: 10 fail: 0 range: 0 id:   641 
channel:  1 adc: 32794  ts: 0x************
 ***            ADC data: block:     1 ptr:  6075 data: 0xC1BA7E55 module:  6 fail: 0 range: 0 id:   442 
channel: 58 adc: 32341  ts: 0x************
 ***            ADC data: block:     1 ptr:  6077 data: 0xC1817EBA module:  6 fail: 0 range: 0 id:   385 
channel:  1 adc: 32442  ts: 0x************
 ***            ADC data: block:     1 ptr:  6079 data: 0xC4B67EFE module: 18 fail: 0 range: 0 id:  1206 
channel: 54 adc: 32510  ts: 0x************
 ***            ADC data: block:     1 ptr:  6081 data: 0xC3BA7DF5 module: 14 fail: 0 range: 0 id:   954 
channel: 58 adc: 32245  ts: 0x************
 ***            ADC data: block:     1 ptr:  6083 data: 0xC0BD7E2A module:  2 fail: 0 range: 0 id:   189 
channel: 61 adc: 32298  ts: 0x************
 ***            ADC data: block:     1 ptr:  6085 data: 0xC37A7D4F module: 13 fail: 0 range: 0 id:   890 
channel: 58 adc: 32079  ts: 0x************
 ***            ADC data: block:     1 ptr:  6087 data: 0xC2837F32 module: 10 fail: 0 range: 0 id:   643 
channel:  3 adc: 32562  ts: 0x************
 ***            ADC data: block:     1 ptr:  6089 data: 0xC17779E8 module:  5 fail: 0 range: 0 id:   375 
channel: 55 adc: 31208  ts: 0x************
 ***            ADC data: block:     1 ptr:  6091 data: 0xC0407D64 module:  1 fail: 0 range: 0 id:    64 
channel:  0 adc: 32100  ts: 0x************
 ***            ADC data: block:     1 ptr:  6093 data: 0xC27E7EBB module:  9 fail: 0 range: 0 id:   638 
channel: 62 adc: 32443  ts: 0x************
 ***            ADC data: block:     1 ptr:  6095 data: 0xC1BD7EA1 module:  6 fail: 0 range: 0 id:   445 
channel: 61 adc: 32417  ts: 0x************
 *** FEE64 discriminator: block:     1 ptr:  6097 data: 0x8B648040 module: 11 information type:  6 information 
field: 0x00048040 ts: 0x************
 *** FEE64 discriminator: block:     1 ptr:  6099 data: 0x8B632000 module: 11 information type:  6 information 
field: 0x00032000 ts: 0x************
 *** FEE64 discriminator: block:     1 ptr:  6101 data: 0x8B640014 module: 11 information type:  6 information 
field: 0x00040014 ts: 0x************
 *** FEE64 discriminator: block:     1 ptr:  6103 data: 0x8B622000 module: 11 information type:  6 information 
field: 0x00022000 ts: 0x************
 *** FEE64 discriminator: block:     1 ptr:  6105 data: 0x85640100 module:  5 information type:  6 information 
field: 0x00040100 ts: 0x************
 ***            ADC data: block:     1 ptr:  6107 data: 0xC2048185 module:  8 fail: 0 range: 0 id:   516 
channel:  4 adc: 33157  ts: 0x************
 ***            ADC data: block:     1 ptr:  6109 data: 0xC3817CB5 module: 14 fail: 0 range: 0 id:   897 
channel:  1 adc: 31925  ts: 0x************
 ***            ADC data: block:     1 ptr:  6111 data: 0xC0B76DE1 module:  2 fail: 0 range: 0 id:   183 
channel: 55 adc: 28129  ts: 0x************
 ***            ADC data: block:     1 ptr:  6113 data: 0xC5347FB5 module: 20 fail: 0 range: 0 id:  1332 
channel: 52 adc: 32693  ts: 0x************
 ***            ADC data: block:     1 ptr:  6115 data: 0xC2B87EFA module: 10 fail: 0 range: 0 id:   696 
channel: 56 adc: 32506  ts: 0x************
 *** FEE64 discriminator: block:     1 ptr:  6117 data: 0x82640010 module:  2 information type:  6 information 
field: 0x00040010 ts: 0x************
 *** FEE64 discriminator: block:     1 ptr:  6119 data: 0x82640008 module:  2 information type:  6 information 
field: 0x00040008 ts: 0x************
 *** FEE64 discriminator: block:     1 ptr:  6121 data: 0x82640003 module:  2 information type:  6 information 
field: 0x00040003 ts: 0x************
 ***   SYNC100 timestamp: block:     1 ptr:  6123 data: 0x8B4028BF module: 11 information type:  4 information 
field: 0x000028BF ts: 0x0000028BF38C00A0 OLD: 
ts: 0x0DAF8F30038C0093 tag: 2 type: 6
 ***   SYNC100 timestamp: block:     1 ptr:  6123 data: 0x8B4028BF module: 11 information type:  4 information 
field: 0x000028BF ts: 0x028BF38C00A0
 ***            ADC data: block:     1 ptr:  6125 data: 0xC30B80FA module: 12 fail: 0 range: 0 id:   779 
channel: 11 adc: 33018  ts: 0x028BF38C00BD
 ***            ADC data: block:     1 ptr:  6127 data: 0xC0817E77 module:  2 fail: 0 range: 0 id:   129 
channel:  1 adc: 32375  ts: 0x028BF38C00C2
 ***            ADC data: block:     1 ptr:  6129 data: 0xC277758A module:  9 fail: 0 range: 0 id:   631 
channel: 55 adc: 30090  ts: 0x028BF38C00CA
 *** FEE64 discriminator: block:     1 ptr:  6131 data: 0x8B648000 module: 11 information type:  6 information 
field: 0x00048000 ts: 0x028BF38C01D1
 *** FEE64 discriminator: block:     1 ptr:  6133 data: 0x8B640040 module: 11 information type:  6 information 
field: 0x00040040 ts: 0x028BF38C01D2
 *** FEE64 discriminator: block:     1 ptr:  6135 data: 0x8B640004 module: 11 information type:  6 information 
field: 0x00040004 ts: 0x028BF38C01D5
 *** FEE64 discriminator: block:     1 ptr:  6137 data: 0x8B640010 module: 11 information type:  6 information 
field: 0x00040010 ts: 0x028BF38C01D9
 ***            ADC data: block:     1 ptr:  6139 data: 0xC3B77874 module: 14 fail: 0 range: 0 id:   951 
channel: 55 adc: 30836  ts: 0x028BF38C020A
 ***            ADC data: block:     1 ptr:  6141 data: 0xC0C0848E module:  3 fail: 0 range: 0 id:   192 
channel:  0 adc: 33934  ts: 0x028BF38C0281
 ***            ADC data: block:     1 ptr:  6143 data: 0xC63C8026 module: 24 fail: 0 range: 0 id:  1596 
channel: 60 adc: 32806  ts: 0x028BF38C02DC
 *** FEE64 discriminator: block:     1 ptr:  6145 data: 0x81641102 module:  1 information type:  6 information 
field: 0x00041102 ts: 0x028BF38C0395
 *** FEE64 discriminator: block:     1 ptr:  6147 data: 0x81640020 module:  1 information type:  6 information 
field: 0x00040020 ts: 0x028BF38C0396
 *** FEE64 discriminator: block:     1 ptr:  6149 data: 0x8B620001 module: 11 information type:  6 information 
field: 0x00020001 ts: 0x028BF38C0397
 ***            ADC data: block:     1 ptr:  6151 data: 0xC2B77CE0 module: 10 fail: 0 range: 0 id:   695 
channel: 55 adc: 31968  ts: 0x028BF38C03E1
 *** FEE64 discriminator: block:     1 ptr:  6153 data: 0x8E640200 module: 14 information type:  6 information 
field: 0x00040200 ts: 0x028BF38C03E5
 *** FEE64 discriminator: block:     1 ptr:  6155 data: 0x82640010 module:  2 information type:  6 information 
field: 0x00040010 ts: 0x028BF38C046F
 *** FEE64 discriminator: block:     1 ptr:  6157 data: 0x82640009 module:  2 information type:  6 information 
field: 0x00040009 ts: 0x028BF38C0470
 *** FEE64 discriminator: block:     1 ptr:  6159 data: 0x82640002 module:  2 information type:  6 information 
field: 0x00040002 ts: 0x028BF38C0473
 ***            ADC data: block:     1 ptr:  6161 data: 0xC3777F1E module: 13 fail: 0 range: 0 id:   887 
channel: 55 adc: 32542  ts: 0x028BF38C05F3
 ***            ADC data: block:     1 ptr:  6163 data: 0xC0BA7F03 module:  2 fail: 0 range: 0 id:   186 
channel: 58 adc: 32515  ts: 0x028BF38C063A
 ***            ADC data: block:     1 ptr:  6165 data: 0xC63781EA module: 24 fail: 0 range: 0 id:  1591 
channel: 55 adc: 33258  ts: 0x028BF38C06C4
 ***            ADC data: block:     1 ptr:  6167 data: 0xC25E7EC0 module:  9 fail: 0 range: 0 id:   606 
channel: 30 adc: 32448  ts: 0x028BF38C070A
 ***            ADC data: block:     1 ptr:  6169 data: 0xC310814C module: 12 fail: 0 range: 0 id:   784 
channel: 16 adc: 33100  ts: 0x028BF38C07C5
 ***            ADC data: block:     1 ptr:  6171 data: 0xC2817FBE module: 10 fail: 0 range: 0 id:   641 
channel:  1 adc: 32702  ts: 0x028BF38C07C9
 *** FEE64 discriminator: block:     1 ptr:  6173 data: 0x82640010 module:  2 information type:  6 information 
field: 0x00040010 ts: 0x028BF38C0851
 *** FEE64 discriminator: block:     1 ptr:  6175 data: 0x82640008 module:  2 information type:  6 information 
field: 0x00040008 ts: 0x028BF38C0854
 ***            ADC data: block:     1 ptr:  6177 data: 0xC1817E3E module:  6 fail: 0 range: 0 id:   385 
channel:  1 adc: 32318  ts: 0x028BF38C095D
 *** FEE64 discriminator: block:     1 ptr:  6179 data: 0x86631000 module:  6 information type:  6 information 
field: 0x00031000 ts: 0x028BF38C0998
 ***            ADC data: block:     1 ptr:  6181 data: 0xC5807DFE module: 22 fail: 0 range: 0 id:  1408 
channel:  0 adc: 32254  ts: 0x028BF38C09BC
 ***     MBS information: block:     1 ptr:  6183 data: 0x8680FCC8 module:  6 information type:  8 information 
index:  0 MBS data:FCC8 ts: 0x028BF38C09F7
 ***     MBS information: block:     1 ptr:  6185 data: 0x8681680D module:  6 information type:  8 information 
index:  1 MBS data:680D ts: 0x028BF38C09F7
 ***     MBS information: block:     1 ptr:  6187 data: 0x86820007 module:  6 information type:  8 information 
index:  2 MBS data:0007 ts: 0x028BF38C09F7
 ***            ADC data: block:     1 ptr:  6189 data: 0xC0BD7F10 module:  2 fail: 0 range: 0 id:   189 
channel: 61 adc: 32528  ts: 0x028BF38C0A22
 ***            ADC data: block:     1 ptr:  6191 data: 0xC1777A9E module:  5 fail: 0 range: 0 id:   375 
channel: 55 adc: 31390  ts: 0x028BF38C0B47
 ***            ADC data: block:     1 ptr:  6193 data: 0xC3928023 module: 14 fail: 0 range: 0 id:   914 
channel: 18 adc: 32803  ts: 0x028BF38C0CFA
 ***            ADC data: block:     1 ptr:  6195 data: 0xC3427F14 module: 13 fail: 0 range: 0 id:   834 
channel:  2 adc: 32532  ts: 0x028BF38C0CFB
 *** FEE64 discriminator: block:     1 ptr:  6197 data: 0x85640100 module:  5 information type:  6 information 
field: 0x00040100 ts: 0x028BF38C0D7B
 *** FEE64 discriminator: block:     1 ptr:  6199 data: 0x85640028 module:  5 information type:  6 information 
field: 0x00040028 ts: 0x028BF38C0D7C
 *** FEE64 discriminator: block:     1 ptr:  6201 data: 0x85640020 module:  5 information type:  6 information 
field: 0x00040020 ts: 0x028BF38C0D7F
 ***            ADC data: block:     1 ptr:  6203 data: 0xC5817E5C module: 22 fail: 0 range: 0 id:  1409 
channel:  1 adc: 32348  ts: 0x028BF38C0DA4
 ***            ADC data: block:     1 ptr:  6205 data: 0xC3817F2D module: 14 fail: 0 range: 0 id:   897 
channel:  1 adc: 32557  ts: 0x028BF38C0DC2
 ***            ADC data: block:     1 ptr:  6207 data: 0xC0B76C9E module:  2 fail: 0 range: 0 id:   183 
channel: 55 adc: 27806  ts: 0x028BF38C0E0A
 *** FEE64 discriminator: block:     1 ptr:  6209 data: 0x82648000 module:  2 information type:  6 information 
field: 0x00048000 ts: 0x028BF38C0F44
 *** FEE64 discriminator: block:     1 ptr:  6211 data: 0x82640010 module:  2 information type:  6 information 
field: 0x00040010 ts: 0x028BF38C0F45
 *** FEE64 discriminator: block:     1 ptr:  6213 data: 0x82630008 module:  2 information type:  6 information 
field: 0x00030008 ts: 0x028BF38C0F46
 *** FEE64 discriminator: block:     1 ptr:  6215 data: 0x82640008 module:  2 information type:  6 information 
field: 0x00040008 ts: 0x028BF38C0F46
 ***            ADC data: block:     1 ptr:  6217 data: 0xC0817E94 module:  2 fail: 0 range: 0 id:   129 
channel:  1 adc: 32404  ts: 0x028BF38C0F9A
 *** FEE64 discriminator: block:     1 ptr:  6219 data: 0x82640010 module:  2 information type:  6 information 
field: 0x00040010 ts: 0x028BF38C1018
 ***            ADC data: block:     1 ptr:  6221 data: 0xC61980E8 module: 24 fail: 0 range: 0 id:  1561 
channel: 25 adc: 33000  ts: 0x028BF38C1024
 ***            ADC data: block:     1 ptr:  6223 data: 0xC6248081 module: 24 fail: 0 range: 0 id:  1572 
channel: 36 adc: 32897  ts: 0x028BF38C1024
 ***            ADC data: block:     1 ptr:  6225 data: 0xC5398017 module: 20 fail: 0 range: 0 id:  1337 
channel: 57 adc: 32791  ts: 0x028BF38C103B
 ***            ADC data: block:     1 ptr:  6227 data: 0xC4727E47 module: 17 fail: 0 range: 0 id:  1138 
channel: 50 adc: 32327  ts: 0x028BF38C1089
 ***            ADC data: block:     1 ptr:  6229 data: 0xC20080B8 module:  8 fail: 0 range: 0 id:   512 
channel:  0 adc: 32952  ts: 0x028BF38C10C1
 ***            ADC data: block:     1 ptr:  6231 data: 0xC0C08465 module:  3 fail: 0 range: 0 id:   192 
channel:  0 adc: 33893  ts: 0x028BF38C1159
 ***            ADC data: block:     1 ptr:  6233 data: 0xC2657E31 module:  9 fail: 0 range: 0 id:   613 
channel: 37 adc: 32305  ts: 0x028BF38C12C2
 *** FEE64 discriminator: block:     1 ptr:  6235 data: 0x82648010 module:  2 information type:  6 information 
field: 0x00048010 ts: 0x028BF38C12DF
 *** FEE64 discriminator: block:     1 ptr:  6237 data: 0x82640008 module:  2 information type:  6 information 
field: 0x00040008 ts: 0x028BF38C12E3
 ***            ADC data: block:     1 ptr:  6239 data: 0xC36C801D module: 13 fail: 0 range: 0 id:   876 
channel: 44 adc: 32797  ts: 0x028BF38C14CB
 *** FEE64 discriminator: block:     1 ptr:  6241 data: 0x81641000 module:  1 information type:  6 information 
field: 0x00041000 ts: 0x028BF38C153A
 *** FEE64 discriminator: block:     1 ptr:  6243 data: 0x8B632000 module: 11 information type:  6 information 
field: 0x00032000 ts: 0x028BF38C153A
 *** FEE64 discriminator: block:     1 ptr:  6245 data: 0x8B640040 module: 11 information type:  6 information 
field: 0x00040040 ts: 0x028BF38C153A
 ***            ADC data: block:     1 ptr:  6247 data: 0xC5F7816D module: 23 fail: 0 range: 0 id:  1527 
channel: 55 adc: 33133  ts: 0x028BF38C154C
 ***            ADC data: block:     1 ptr:  6249 data: 0xC3BB7E35 module: 14 fail: 0 range: 0 id:   955 
channel: 59 adc: 32309  ts: 0x028BF38C1592
 *** FEE64 discriminator: block:     1 ptr:  6251 data: 0x97630080 module: 23 information type:  6 information 
field: 0x00030080 ts: 0x028BF38C164D
Attachment 1: 1.png
1.png
Attachment 2: 2.png
2.png
Attachment 3: 3.png
3.png
Attachment 4: 4.png
4.png
Attachment 5: 5.png
5.png
Attachment 6: 6.png
6.png
Attachment 7: 7.png
7.png
Attachment 8: 8.png
8.png
Attachment 9: 9.png
9.png
Attachment 10: 10.png
10.png
Attachment 11: 20.png
20.png
Attachment 12: 21.png
21.png
Attachment 13: 3.png
3.png
Attachment 14: 31.png
31.png
Attachment 15: 32.png
32.png
Attachment 16: 33.png
33.png
Attachment 17: 35.png
35.png
Attachment 18: 36.png
36.png
Attachment 19: 37.png
37.png
Attachment 20: 40.png
40.png
  776   Mon Nov 12 08:59:43 2018 LS, CA, TDMonday 12 November 6pm onwards

17:59 DAQ continues OK
      Stats OK - attachment 1
      FEE temperatures OK - attachment 2
      Bias and leakage currents OK - attachment 3
      System-wide checks OK *except* nnaida7 fails ADC calibration


19:07 DAQ continues OK
      Stats OK - attachment 4
      FEE temperatures OK - attachment 5
      Bias and leakage currents OK - attachment 6
      System-wide checks OK *except* nnaida7 fails ADC calibration

20.19 DAQ starts
      AIDA file RIBF148/R5_4
      BRIKEN file 16
      BigRIPS 1001

      165Pm setting + 3mm Al degrader

20.21 all online & MIDASsort histograms zero'd

20.23 FEE64 good event statistics - see attachment 7
      Merger - see attachment 8
      TapeServer - see attachment 9

      HEC x versus y spectra - see attachment 10
       SN thinks DSSSD #3 are the ions of interest, #4 are the ions of interest at different charge state
       and #5 & #6 are lighter ions which do not stop in DSSSD #1-6

21.21 DAQ stops 

      DAQ starts
      AIDA file RIBF148/R5_14
      BRIKEN file 18
      BigRIPS 1003

21.26 HEC x vs y multiplicity spectra - attachment 11

21.29 HEC Ex vs Ey spectra - attachment 12
      FEE64 rate spectra - attachment 13

21.31 1.8.L front/rear energy spectra (attachments 14/15) LEC

21.33 1.8.H front/rear energy spectra (attachments 16/17) HEC

21.46 system wide checks ok, except nnaida7 ADC calibration failure
      FEE64 good event statistics ok (attachment 18)
      FEE64 temperatures ok (attachment 19)
      Leakage currents/detector bias ok (attachment 20)

21.49 Merger and TapeServer ok, no error messages in terminal
      DAQ still running (RIBF148/R5_18)

22.10 attachment 21 - pulser spectra in all channels fired at same time
                    - FEE64 in sync

22.12 SYNC100 at 9153.8 Hz
      FEE64 discriminator at ~15000 Hz - higher than expected
      ~1 second deadtime in FEE19 - due to nnaida12 running fast
      no timewarps observed in FEE64
      all of above in attachment 22
   
22:32 DAQ continues OK
      Stats OK - attachment 24
      FEE temperatures OK - attachment 23
      Bias and leakage currents OK - attachment 25
      System-wide checks OK *except* nnaida7 fails ADC calibration   

23:30 DAQ continues OK
      Stats OK - attachment 26
      FEE temperatures OK - attachment 27
      Bias and leakage currents OK - attachment 28
      System-wide checks OK *except* nnaida7 fails ADC calibration 
      
Attachment 1: 181112_1757_temp.png
181112_1757_temp.png
Attachment 2: 181112_1757_stats.png
181112_1757_stats.png
Attachment 3: 181112_1758_bias.png
181112_1758_bias.png
Attachment 4: 181112_1905_stats.png
181112_1905_stats.png
Attachment 5: 181112_1904_temp.png
181112_1904_temp.png
Attachment 6: 181112_1906_bias.png
181112_1906_bias.png
Attachment 7: 1.png
1.png
Attachment 8: 2.png
2.png
Attachment 9: 3.png
3.png
Attachment 10: 4.png
4.png
Attachment 11: 5.png
5.png
Attachment 12: 6.png
6.png
Attachment 13: 10.png
10.png
Attachment 14: 11.png
11.png
Attachment 15: 12.png
12.png
Attachment 16: 13.png
13.png
Attachment 17: 14.png
14.png
Attachment 18: 181112_2145_stats.png
181112_2145_stats.png
Attachment 19: 181112_2144_temp.png
181112_2144_temp.png
Attachment 20: 181112_2146_bias.png
181112_2146_bias.png
Attachment 21: 7.png
7.png
Attachment 22: R5_19
 *** MIDAS TDR format 3.3.0 AIDA data analyser - TD - November 2018
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  251785471 (  674265.2 Hz)
        Other data format:    9334529 (   24997.3 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:         38 (       0.1 Hz)
                               RESUME:         38 (       0.1 Hz)
                              SYNC100:    3418240 (    9153.8 Hz)
                           FEE64 disc:    5692161 (   15243.2 Hz)
                             MBS info:     224052 (     600.0 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:     652043 (    1746.1 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:      373.422 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  1                0.000                0.000
  2                0.000                0.000
  3                0.000                0.000
  4                0.000                0.000
  5                0.000                0.000
  6                0.000                0.000
  7                0.000                0.000
  8                0.000                0.000
  9                0.000                0.000
 10                0.000                0.000
 11                0.000                0.000
 12                0.000                0.000
 13                0.000                0.000
 14                0.000                0.000
 15                0.000                0.000
 16                0.000                0.000
 17                0.000                0.000
 18                0.000                0.000
 19                0.940                0.986
 20                0.409                0.000
 21                0.119                0.000
 22                0.000                0.000
 23                0.000                0.000
 24                0.000                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100       Disc        MBS      Other   HEC Data
  0          0          0          0          0          0          0          0          0          0          0          0
  1   11070744     334098          0          0          0          0     142450     191648          0          0      36093
  2    8576153     468860          0          0          0          0     142450     326410          0          0      34785
  3   10973824     253560          0          0          0          0     142450     111110          0          0       9150
  4    1818169     272357          0          0          0          0     142450     129907          0          0       9732
  5    6471297     234882          0          0          0          0     142450      92432          0          0      10432
  6    6580872     446352          0          0          0          0     142450      79850     224052          0      11381
  7    2754969     462351          0          0          0          0     142450     319901          0          0      25435
  8    2456580     395278          0          0          0          0     142450     252828          0          0      25164
  9   10408041     408896          0          0          0          0     142450     266446          0          0      43888
 10   11045650     361546          0          0          0          0     142450     219096          0          0      37946
 11    7410941     321361          0          0          0          0     142450     178911          0          0      16832
 12    8435308     514442          0          0          0          0     142450     371992          0          0      18236
 13   11850016     288920          0          0          0          0     142450     146470          0          0      23860
 14    7558149     340530          0          0          0          0     142450     198080          0          0      33128
 15    6623982     514843          0          0          0          0     142450     372393          0          0      35616
 16    4930586     427080          0          0          0          0     142450     284630          0          0      34734
 17    8299604     386492          0          0          0          0     142450     244042          0          0      34467
 18    7205990     379262          0          0          0          0     142450     236812          0          0      42704
 19   43068252     413864          0          0         17         17     142091     271739          0          0      17498
 20   32280297     405869          0          0         11         11     142295     263552          0          0      18298
 21   15409652     312773          0          0         10         10     142404     170349          0          0      32340
 22    9167131     294608          0          0          0          0     142450     152158          0          0      31445
 23    8553412     583714          0          0          0          0     142450     441264          0          0      34448
 24    8835852     512591          0          0          0          0     142450     370141          0          0      34431
 25          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0

 *** MBS Timewarps
 FEE 
  0          0
  1          0
  2          0
  3          0
  4          0
  5          0
  6          0
  7          0
  8          0
  9          0
 10          0
 11          0
 12          0
 13          0
 14          0
 15          0
 16          0
 17          0
 18          0
 19          0
 20          0
 21          0
 22          0
 23          0
 24          0
 25          0
 26          0
 27          0
 28          0
 29          0
 30          0
 31          0
 32          0

 *** Program elapsed time:   25.938s ( 1233.735 blocks/s,  77.108 Mb/s)
Attachment 23: 181112_2231_temp.png
181112_2231_temp.png
Attachment 24: 181112_2232_stats.png
181112_2232_stats.png
Attachment 25: 181112_2232_bias.png
181112_2232_bias.png
Attachment 26: 181112_2328_stats.png
181112_2328_stats.png
Attachment 27: 181112_2337_temp.png
181112_2337_temp.png
Attachment 28: 181112_2338_bias.png
181112_2338_bias.png
  775   Sun Nov 11 21:35:42 2018 CB, OH, CA, LSMonday 12 November
06:35 DAQ Continues ok
      Stats ok - attachment 1
      FEE Temps ok - attachment 2
      Bias and leakage currents ok - attachment 3
      System wide checks all ok
      Chiller refilled

07:57 DAQ continues OK
      Stats OK - attachment 4
      FEE temperatures OK - attachment 5
      Bias and leakage currents OK - attachment 6
      System-wide checks OK *except* nnaida7 fails ADC calibration

10:06 DAQ continues OK
      Stats OK - attachment 7
      FEE temperatures OK - attachment 8
      Bias and leakage currents OK - attachment 9
      System-wide checks OK *except* nnaida7 fails ADC calibration
      Workstation occasionally feels sluggish. See iostat 5 (attach 10) & top -a (attach 11)

12:08 DAQ continues OK
      Stats OK - attachment 12
      FEE temperatures OK - attachment 13
      Bias and leakage currents OK - attachment 14
      System-wide checks OK *except* nnaida7 fails ADC calibration
      

15:40 DAQ continues OK
      Stats OK - attachment 15
      FEE temperatures OK - attachment 16
      Bias and leakage currents OK - attachment 17
      System-wide checks OK *except* nnaida7 fails ADC calibration


16:58 DAQ continues OK
      Stats OK - attachment 18
      FEE temperatures OK - attachment 19
      Bias and leakage currents OK - attachment 20
      System-wide checks OK *except* nnaida7 fails ADC calibration
Attachment 1: 181112_0633_Stats.png
181112_0633_Stats.png
Attachment 2: 181112_0633_Temp.png
181112_0633_Temp.png
Attachment 3: 181112_0634_Bias.png
181112_0634_Bias.png
Attachment 4: 404.png
404.png
Attachment 5: 405.png
405.png
Attachment 6: 406.png
406.png
Attachment 7: 407.png
407.png
Attachment 8: 408.png
408.png
Attachment 9: 409.png
409.png
Attachment 10: 410.png
410.png
Attachment 11: 411.png
411.png
Attachment 12: 412.png
412.png
Attachment 13: 413.png
413.png
Attachment 14: 414.png
414.png
Attachment 15: 181112_1540_temp.png
181112_1540_temp.png
Attachment 16: 181112_1541_stats.png
181112_1541_stats.png
Attachment 17: 181112_1542_bias.png
181112_1542_bias.png
Attachment 18: 181112_1656_temp.png
181112_1656_temp.png
Attachment 19: 181112_1657_stats.png
181112_1657_stats.png
Attachment 20: 181112_1657_bias.png
181112_1657_bias.png
  658   Mon Jun 12 08:02:01 2017 TDMonday 12 June 16.00-24.00
16.01 DAQ continues

16.01 Detector biases & leakage currents OK - see attachments 1 & 2
      FEE64 Temperatures OK - see attachment 3
      good events statistics stable & OK - see attachment 4 
      No warnings/errors reported by merger since start of RIBF148/R3  - see attachment 5
      *all* system wide checks OK *except* nnaida13 fails ADC calibration

      BNC PB-4
      Amplitude 90,000
      x5 attenuator IN
      t_r 100ns tau_d 50us
      - polarity
      frequency 25Hz range 2.6Hz
      delay MIN, tail pulse, INT ref

      ASIC settings 2017Mar27-16.12.39

      147Sm BigRIPS setting - 0mm Al (at F7) + 2mm variable + 0mm Al fixed (at F11) = 2mm Al

16.08 *all* online histograms zero'd 

16.31 DAQ stop
      AIDA file RIBF148/R3_84

16.31 DAQ start
      AIDA file RIBF148/R3_84
      BigRIPS file 2504
      BRIKEN file 32

17.33 DAQ stop
      AIDA file RIBF148/R3_104

17.34 DAQ start
      AIDA file RIBF148/R3_104
      BigRIPS file 2505
      BRIKEN file 33

18.01 Detector biases & leakage currents OK - see attachments 6 & 7
      FEE64 Temperatures OK - see attachment 8
      good events statistics stable & OK - see attachment 9
      No warnings/errors reported by merger since start of RIBF148/R3  - see attachment 10
      *all* system wide checks OK *except* nnaida13 fails ADC calibration

18.03 online analysis file RIBF148/R3_113 - deadtime < 0.5%, 2 MBS & 0 ts timewarps - see attachment 11

18.04 DAQ stop
      AIDA file RIBF148/R3_114

18.05 DAQ start
      AIDA file RIBF148/R3_114
      BigRIPS file 2506
      BRIKEN file 34

      147Sm BigRIPS setting - 0mm Al (at F7) + 0mm variable + 0mm Al fixed (at F11) = 0mm Al

19.14 DAQ stop
      AIDA file RIBF148/R3_135

19.15 DAQ start
      AIDA file RIBF148/R3_135
      BigRIPS file 2507
      BRIKEN file 35

20.01 Detector biases & leakage currents OK - see attachments 12 & 13
      FEE64 Temperatures OK - see attachment 14
      good events statistics stable & OK - see attachment 15
      No warnings/errors reported by merger since start of RIBF148/R3  - see attachment 16
      *all* system wide checks OK *except* nnaida13 fails ADC calibration

20.03 online analysis file RIBF148/R3_150 - deadtime < 0.5%, 0 MBS & ts timewarps - see attachment 17

20.25 DAQ stop
      AIDA file RIBF148/R3_157

20.26 DAQ start
      AIDA file RIBF148/R3_158
      BigRIPS file 2508
      BRIKEN file 36

21.30 DAQ stop
      AIDA file RIBF148/R3_178

21.31 DAQ start
      AIDA file RIBF148/R3_179
      BigRIPS file 2509
      BRIKEN file 37

22.06 Detector biases & leakage currents OK - see attachments 18 & 19
      FEE64 Temperatures OK - see attachment 20
      good events statistics stable & OK - see attachment 21
      No warnings/errors reported by merger since start of RIBF148/R3  - see attachment 22
      *all* system wide checks OK *except* nnaida13 fails ADC calibration

22.08 online analysis file RIBF148/R3_190 - deadtime < 1%, 1 MBS & 0 ts timewarps - see attachment 23

22.26 DAQ stop
      AIDA file RIBF148/R3_196

22.27 DAQ start
      AIDA file RIBF148/R3_197
      BigRIPS file 2510
      BRIKEN file 38

23.03 online analysis
      per DSSSD x versus y (HEC) - see attachment 24
      per DSSSD E_P versus E_n (HEC) - see attachment 25
      ADC & disc data synchronised - see attachment 26

23.16 beam lost
      AIDA file RIBF148/R3_212

23.16 beam back within 1 min
      AIDA file RIBF148/R3_213

23.31 DAQ stop
      AIDA file RIBF148/R3_217

22.32 DAQ start
      AIDA file RIBF148/R3_218
      BigRIPS file 2511
      BRIKEN file 39
Attachment 1: 1.png
1.png
Attachment 2: 2.png
2.png
Attachment 3: 3.png
3.png
Attachment 4: 4.png
4.png
Attachment 5: 5.png
5.png
Attachment 6: 6.png
6.png
Attachment 7: 7.png
7.png
Attachment 8: 8.png
8.png
Attachment 9: 9.png
9.png
Attachment 10: 10.png
10.png
Attachment 11: R3_113.txt
 *** TDR format 3.3.0 analyser - TD - June 2017
 ***     MBS information: block:  2148 ptr:     7 data: 0x8682005E module:  6 information type:  8 information field: 0x0002005E ts: 0x0992E71B5D0B OLD ts: 0x0992E71B5D0B MBS 0x:005E00007AAA OLD MBS 0x:005E37975C80
 ***     MBS information: block:  8570 ptr:     7 data: 0x8682005E module:  6 information type:  8 information field: 0x0002005E ts: 0x0993C487EBDB OLD ts: 0x0993C487EBDB MBS 0x:005E00009E5E OLD MBS 0x:005E6EEE9E5B
 *** ERROR: READ I/O error:       5002
                   blocks:      19235
          ADC data format:  152250194 ( 1365779.6 Hz)
        Other data format:    4688171 (   42055.8 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:         71 (       0.6 Hz)
                               RESUME:         71 (       0.6 Hz)
                              SYNC100:    1019718 (    9147.5 Hz)
                           FEE64 disc:    3636426 (   32621.0 Hz)
                             MBS info:      31885 (     286.0 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:     223801 (    2007.6 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:      111.475 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  1                0.157                0.000
  2                0.125                0.000
  3                0.014                0.000
  4                0.000                0.000
  5                0.197                0.000
  6                0.015                0.000
  7                0.000                0.000
  8                0.009                0.000
  9                0.037                0.000
 10                0.059                0.000
 11                0.000                0.000
 12                0.000                0.000
 13                0.466                0.372
 14                0.023                0.000
 15                0.000                0.000
 16                0.000                0.000
 17                0.123                0.000
 18                0.172                0.000
 19                0.114                0.000
 20                0.031                0.000
 21                0.303                0.317
 22                0.149                0.000
 23                0.006                0.000
 24                0.000                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100       Disc        MBS      Other   HEC Data
  0          0          0          0          0          0          0          0          0          0          0          0
  1    8080990     110586          0          0          6          6      42457      68117          0          0       9654
  2    9116759     119236          0          0          4          4      42471      76757          0          0       9620
  3    3623641      88120          0          0          1          1      42516      45602          0          0       4765
  4    1756196     131083          0          0          0          0      42519      88564          0          0       5943
  5    5846898     170043          0          0         13         13      42440     127577          0          0       7065
  6    6279148     406019          0          0          1          1      42510     331622      31885          0      13903
  7    2095437     174911          0          0          0          0      42521     132390          0          0      11350
  8    1418751     100538          0          0          1          1      42519      58017          0          0       6589
  9    6479937     299485          0          0          2          2      42508     256973          0          0      10178
 10    6549588     372141          0          0          3          3      42499     329636          0          0      10791
 11    2101242     114288          0          0          0          0      42518      71770          0          0       5700
 12    3132786     129022          0          0          0          0      42522      86500          0          0       5897
 13   20157280     367648          0          0          9          9      42342     325288          0          0      13322
 14    8446616     375787          0          0          1          1      42513     333272          0          0      14037
 15    3800376     174071          0          0          0          0      42518     131553          0          0      10868
 16    3259188     153399          0          0          0          0      42521     110878          0          0      10342
 17    7098866     328427          0          0          5          5      42473     285944          0          0       8848
 18    7836080     180416          0          0          6          6      42455     137949          0          0       4654
 19    7308676     126739          0          0          6          6      42477      84250          0          0       5816
 20    6914903     143864          0          0          2          2      42508     101352          0          0       6570
 21   13015011     156931          0          0          5          5      42404     114517          0          0      13987
 22    8139422     148811          0          0          5          5      42468     106333          0          0      13449
 23    4933419     166952          0          0          1          1      42519     124431          0          0      10214
 24    4858984     149654          0          0          0          0      42520     107134          0          0      10239
 25          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0

 *** MBS Timewarps
 FEE 
  0          0
  1          0
  2          0
  3          0
  4          0
  5          0
  6          2
  7          0
  8          0
  9          0
 10          0
 11          0
 12          0
 13          0
 14          0
 15          0
 16          0
 17          0
 18          0
 19          0
 20          0
 21          0
 22          0
 23          0
 24          0
 25          0
 26          0
 27          0
 28          0
 29          0
 30          0
 31          0
 32          0

 *** Program elapsed time:   32.082s (  599.557 blocks/s,  37.472 Mb/s)
Attachment 12: 11.png
11.png
Attachment 13: 12.png
12.png
Attachment 14: 13.png
13.png
Attachment 15: 14.png
14.png
Attachment 16: 15.png
15.png
Attachment 17: R3_150.txt
 *** TDR format 3.3.0 analyser - TD - June 2017
 *** ERROR: READ I/O error:       5002
                   blocks:      18007
          ADC data format:  143128749 ( 1338927.9 Hz)
        Other data format:    3790364 (   35457.8 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:         58 (       0.5 Hz)
                               RESUME:         58 (       0.5 Hz)
                              SYNC100:     978040 (    9149.3 Hz)
                           FEE64 disc:    2782210 (   26026.8 Hz)
                             MBS info:      29998 (     280.6 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:     222065 (    2077.4 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:      106.898 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  1                0.125                0.000
  2                0.050                0.000
  3                0.000                0.000
  4                0.000                0.000
  5                0.153                0.000
  6                0.039                0.000
  7                0.000                0.000
  8                0.000                0.000
  9                0.073                0.000
 10                0.036                0.000
 11                0.000                0.000
 12                0.000                0.000
 13                0.107                0.000
 14                0.095                0.000
 15                0.000                0.000
 16                0.001                0.000
 17                0.025                0.000
 18                0.095                0.000
 19                0.111                0.000
 20                0.000                0.000
 21                0.420                0.440
 22                0.030                0.000
 23                0.000                0.000
 24                0.049                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100       Disc        MBS      Other   HEC Data
  0          0          0          0          0          0          0          0          0          0          0          0
  1    8336154     100020          0          0          4          4      40726      59286          0          0       8822
  2    9717581     106260          0          0          2          2      40751      65505          0          0       8650
  3    3743648     112853          0          0          0          0      40777      72076          0          0       5005
  4    1529946     127475          0          0          0          0      40775      86700          0          0       5391
  5    5990398     183763          0          0          8          8      40722     143025          0          0      12561
  6    5651510     240142          0          0          3          3      40762     169376      29998          0      13430
  7    1836745     175092          0          0          0          0      40773     134319          0          0      10637
  8    1667793     166561          0          0          0          0      40773     125788          0          0      10281
  9    6387677     189204          0          0          4          4      40748     148448          0          0       9070
 10    5961182     178918          0          0          3          3      40760     138152          0          0       9348
 11    1874753     102738          0          0          0          0      40774      61964          0          0       5094
 12    2670163     118865          0          0          0          0      40771      78094          0          0       5155
 13   19715172     234708          0          0          4          4      40732     193968          0          0      12641
 14    7668322     224215          0          0          3          3      40739     183470          0          0      12689
 15    3195975     162135          0          0          0          0      40774     121361          0          0       9953
 16    2721161     146595          0          0          1          1      40776     105817          0          0      10172
 17    6181884     163586          0          0          2          2      40762     122820          0          0       8043
 18    7933589     270210          0          0          4          4      40733     229469          0          0       9875
 19    6351009     114585          0          0          7          7      40731      73840          0          0       5141
 20    5842897     128043          0          0          0          0      40776      87267          0          0       5875
 21   12663512     120586          0          0          7          7      40612      79960          0          0      12606
 22    7850220     130389          0          0          1          1      40760      89627          0          0      12225
 23    3887987     154025          0          0          0          0      40775     113250          0          0       9709
 24    3749471     139396          0          0          5          5      40758      98628          0          0       9692
 25          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0

 *** MBS Timewarps
 FEE 
  0          0
  1          0
  2          0
  3          0
  4          0
  5          0
  6          0
  7          0
  8          0
  9          0
 10          0
 11          0
 12          0
 13          0
 14          0
 15          0
 16          0
 17          0
 18          0
 19          0
 20          0
 21          0
 22          0
 23          0
 24          0
 25          0
 26          0
 27          0
 28          0
 29          0
 30          0
 31          0
 32          0

 *** Program elapsed time:   40.266s (  447.205 blocks/s,  27.950 Mb/s)
Attachment 18: 16.png
16.png
Attachment 19: 17.png
17.png
Attachment 20: 18.png
18.png
Attachment 21: 19.png
19.png
Attachment 22: 20.png
20.png
Attachment 23: R3_190.txt
 *** TDR format 3.3.0 analyser - TD - June 2017
 ***     MBS information: block: 21764 ptr:     7 data: 0x868200B4 module:  6 information type:  8 information field: 0x000200B4 ts: 0x0AEB7BBAB26B OLD ts: 0x0AEB7BBAB26B MBS 0x:00B400005002 OLD MBS 0x:00B45CBEAF4A
 *** ERROR: READ I/O error:       5002
                   blocks:      31571
          ADC data format:  251037416 ( 1379837.4 Hz)
        Other data format:    6550373 (   36004.4 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:        101 (       0.6 Hz)
                               RESUME:        101 (       0.6 Hz)
                              SYNC100:    1663877 (    9145.6 Hz)
                           FEE64 disc:    4835680 (   26579.5 Hz)
                             MBS info:      50614 (     278.2 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:     384800 (    2115.1 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:      181.933 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  1                0.127                0.000
  2                0.277                0.000
  3                0.000                0.000
  4                0.000                0.000
  5                0.250                0.000
  6                0.057                0.000
  7                0.000                0.000
  8                0.000                0.000
  9                0.116                0.000
 10                0.085                0.000
 11                0.000                0.000
 12                0.001                0.000
 13                1.735                1.764
 14                0.231                0.000
 15                0.000                0.000
 16                0.000                0.000
 17                0.016                0.000
 18                0.305                0.000
 19                0.042                0.000
 20                0.048                0.000
 21                0.786                0.815
 22                0.066                0.000
 23                0.008                0.000
 24                0.015                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100       Disc        MBS      Other   HEC Data
  0          0          0          0          0          0          0          0          0          0          0          0
  1   13884297     170672          0          0          4          4      69345     101319          0          0      15155
  2   16026261     182332          0          0          9          9      69294     113020          0          0      14918
  3    6405755     191406          0          0          0          0      69397     122009          0          0       8704
  4    2758327     223120          0          0          0          0      69397     153723          0          0       9351
  5   10020772     316980          0          0         14         14      69302     247650          0          0      21957
  6    9539649     417578          0          0          4          4      69367     297589      50614          0      23347
  7    3360947     299571          0          0          0          0      69390     230181          0          0      18269
  8    3004568     285171          0          0          0          0      69385     215786          0          0      17838
  9   10893469     325413          0          0          5          5      69347     256056          0          0      15552
 10   10592473     307249          0          0          5          5      69363     237876          0          0      16165
 11    3359569     180765          0          0          0          0      69393     111372          0          0       9035
 12    5033930     202009          0          0          1          1      69395     132612          0          0       8902
 13   32509210     408735          0          0         14         14      68738     339969          0          0      21911
 14   13060463     391334          0          0          9          9      69303     322013          0          0      22091
 15    5984103     279862          0          0          0          0      69396     210466          0          0      17350
 16    5301135     252564          0          0          0          0      69396     183168          0          0      17523
 17   10852079     281086          0          0          1          1      69387     211697          0          0      13804
 18   13861224     470855          0          0         13         13      69275     401554          0          0      17002
 19   12268440     199614          0          0          2          2      69373     130237          0          0       8973
 20   11771773     220207          0          0          2          2      69379     150824          0          0      10107
 21   20898087     207533          0          0         12         12      69098     138411          0          0      21884
 22   13004570     224417          0          0          3          3      69370     155041          0          0      21249
 23    8365961     268325          0          0          1          1      69395     198928          0          0      16788
 24    8280354     243575          0          0          2          2      69392     174179          0          0      16925
 25          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0

 *** MBS Timewarps
 FEE 
  0          0
  1          0
  2          0
  3          0
  4          0
  5          0
  6          1
  7          0
  8          0
  9          0
 10          0
 11          0
 12          0
 13          0
 14          0
 15          0
 16          0
 17          0
 18          0
 19          0
 20          0
 21          0
 22          0
 23          0
 24          0
 25          0
 26          0
 27          0
 28          0
 29          0
 30          0
 31          0
 32          0

 *** Program elapsed time:   85.086s (  371.048 blocks/s,  23.191 Mb/s)
Attachment 24: 21.png
21.png
Attachment 25: 22.png
22.png
Attachment 26: 23.png
23.png
  656   Sun Jun 11 16:04:12 2017 DKMonday 12 June 0:00 ~ 8:00
0:04    Biases and leak currents shown as attachment #1, 12JunBias1.png
        System-wide checks: nnaida13 fails ADC calib, all others okay
        Temperatures shown as attachment #2, 12JunTemp1.png
        Implants are 20 to 40 cps, mostly in SSD2 and SSD6 see attachment #3 12JunImplant1.png
        Statistics shown attachment #4, 12JunStats1.png
        Analysis shown as R9_175.txt attachment #5
        

00:17   No implants in AIDA nor proper evt. numbers in BRIKEN R9_177, expect beam is down
        Operators call, RF dropped of IRC

00:23   Problem of another RF.

00:24   Beam is back R9_179 for AIDA

00:36   AIDA R9_182 at run close.

00:39   AIDA R9_183, BRIKEN 141, run BigRIPS 4031

00:50   We stop the beam to adjust degraders in F11.  AIDA R9_186
        BRIKEN and BigRIPS runs stopped

00:54   Removed 1.0 mm Al, added 0.5 mm (net is subtracting 0.5 mm Al)
        R9_187 AIDA run, BRIKEN #142, BigRIPS #4032

01:34   AIDA R9_198 at changeover

01:35   Same AIDA run R9_198, BRIKEN #143, BigRIPS #4033
        System wide checks okay (except ADC calib on nnaida13)

02:34   R9_214 at changeover.  

2:36    R9_215 with new runs BRIKEN 144 and BigRIPS 4034.
        More implants are now seen in SSD3 rather than SSD2.  Zeroed MIDAS histos, so updated later with stats.
        Biases as attachment #6, 12JunBiases2.png

02:45  Beam stopped R9_217.  Beam stripper has a problem.

02:48  Beam is back, R9_220

03:12  R9_224 operators call, beam is stopped from stripper foil issue

03:18  Beam is back, AIDA run R9_226

03:34  R9_230 at changeover
       System wide checks all okay, except nnaida13 ADC calib as above.

03:35  The end of R9_230 corresponds with BRIKEN 145 and BigRIPS 4034.

03:51  Operators call, beam looks stopped.  R9_235 at AIDA.  Change stripper foil

03:57  R9_236 when beam returns.

04:35  We noticed beam is gone.  R9_246 for AIDA.  

04:36  Beam comes back.  R9_247 BRIKEN 146 and BigRIPS 4035
       Attachment #7 12JunImplant2.png shows implantation profile, confirming SSD 3 is the main one with new
degrader setting
       Statistics shown as attachment #8, 12JunStats2.png
       Analysis shown as attachment #9, R9_244.txt
         No ts timewarps, no MBS timewarps, deadtime on nnaida13,21 nearly 1%, most others small.

05:20  Noticed /data10 only has ~250 GB left, so we should do something to resolve it.
       First thing is, not much compression is done recently.  So I begin to compress /TapeData/RIBF128/R7* with
nice 10
       However, compression at this rate will take much too long so it looks like something should be removed.
       Confirmed that RIBF127R1 data file names and sizes are the same between /TapeData and the new external HDD
at /ntfs

05:33  AIDA R9_262, BRIKEN 147, BigRIPS 4036

06:34  AIDA R9_279 at run change

06:36  BRIKEN run 148, BigRIPS 4037
       System-wide checks passed, except nnaida13 ADC calib still fails.

06:54  R9_284 beam is stopped.

6:59   Beam is back.

07:33  R9_295 at start of BRIKEN 149, BigRIPS 4037

07:36  No syncs are seen at BRIKEN (but they were seen at the start of other runs)
       Implant profiles shown as Attachment #10, 12JunImplants3.png
       Several resets or new runs on BRIKEN / BigRIPS are done to troubleshoot

07:48  AIDA passes all system checks (besides the nnaida13 ADC calib)
       It seems (part of) the issue is triggers from BigRIPS.

08:04  BigRIPS scalers show events are presented, but no triggers are accepted.
       Some part of the DAQ is vetoing the events basically.

08:11  Baba san came on shift.  Issue was ccnet03 crashed.  We reset the Camac crate and reinitialized, DAQ comes back
       AIDA R9_306, BRIKEN #152, BigRIPS # 4041
Attachment 1: 12JunBias1.png
12JunBias1.png
Attachment 2: 12JunTemp1.png
12JunTemp1.png
Attachment 3: 12JunImplant1.png
12JunImplant1.png
Attachment 4: 12JunStats1.png
12JunStats1.png
Attachment 5: R9_175.txt
 *** TDR format 3.3.0 analyser - TD - June 2017
 ***     MBS information: block:  3650 ptr:     7 data: 0x868200E8 module:  6 information type:  8 information field: 0x000200E8 ts: 0x03B7D6EDA22B OLD ts: 0x03B7D6EDA22B MBS 0x:00E80000D2E6 OLD MBS 0x:00E8005255EE
 ***     MBS information: block:  8210 ptr:     9 data: 0x868200E8 module:  6 information type:  8 information field: 0x000200E8 ts: 0x03B88A38D84B OLD ts: 0x03B88A38D84B MBS 0x:00E82D250000 OLD MBS 0x:00E82D251E47
 ***     MBS information: block: 11654 ptr:     7 data: 0x868200E8 module:  6 information type:  8 information field: 0x000200E8 ts: 0x03B913407867 OLD ts: 0x03B913407867 MBS 0x:00E800008875 OLD MBS 0x:00E84F671D8C
 ***     MBS information: block: 21709 ptr:     7 data: 0x868200E8 module:  6 information type:  8 information field: 0x000200E8 ts: 0x03BAAC9D507F OLD ts: 0x03BAAC9D507F MBS 0x:00E80000BE7B OLD MBS 0x:00E8B5BAC5FE
 ***     MBS information: block: 21754 ptr:     7 data: 0x868200E8 module:  6 information type:  8 information field: 0x000200E8 ts: 0x03BAAE69DB73 OLD ts: 0x03BAAE69DB73 MBS 0x:00E80000E138 OLD MBS 0x:00E8B630FB6A
 ***     MBS information: block: 21852 ptr:     9 data: 0x868200E8 module:  6 information type:  8 information field: 0x000200E8 ts: 0x03BAB296062F OLD ts: 0x03BAB296062F MBS 0x:00E8B73C0000 OLD MBS 0x:00E8B73C667D
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  256845838 ( 1184603.2 Hz)
        Other data format:    4242162 (   19565.3 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:         88 (       0.4 Hz)
                               RESUME:         88 (       0.4 Hz)
                              SYNC100:    1984006 (    9150.5 Hz)
                           FEE64 disc:    2189787 (   10099.6 Hz)
                             MBS info:      68193 (     314.5 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:     123157 (     568.0 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:      216.820 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  1                0.036                0.000
  2                0.122                0.000
  3                0.000                0.000
  4                0.000                0.000
  5                0.237                0.000
  6                0.009                0.000
  7                0.000                0.000
  8                0.000                0.000
  9                0.007                0.000
 10                0.023                0.000
 11                0.000                0.000
 12                0.000                0.000
 13                0.473                0.404
 14                0.190                0.000
 15                0.000                0.000
 16                0.000                0.000
 17                0.015                0.000
 18                0.122                0.000
 19                0.150                0.000
 20                0.192                0.000
 21                0.492                0.516
 22                0.088                0.000
 23                0.000                0.000
 24                0.002                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100       Disc        MBS      Other   HEC Data
  0          0          0          0          0          0          0          0          0          0          0          0
  1   13503596     189538          0          0          2          2      82688     106846          0          0       9030
  2   14745926     231651          0          0          5          5      82654     148987          0          0       8663
  3    6530190     110062          0          0          0          0      82702      27360          0          0       1932
  4    2003109     119133          0          0          0          0      82702      36431          0          0       2789
  5   10153436     142365          0          0         21         21      82606      59717          0          0       2946
  6    9353593     214643          0          0          2          2      82694      63752      68193          0       3151
  7    2577795     118419          0          0          0          0      82701      35718          0          0       3023
  8    2030076     114078          0          0          0          0      82701      31377          0          0       2711
  9    9769095     204445          0          0          2          2      82699     121742          0          0       5416
 10    9893539     228916          0          0          5          5      82698     146208          0          0       5337
 11    3110696     117791          0          0          0          0      82700      35091          0          0       2776
 12    4932447     128881          0          0          0          0      82704      46177          0          0       3374
 13   37417420     138975          0          0          8          8      82521      56438          0          0       3088
 14   13501224     158859          0          0          7          7      82628      76217          0          0       4245
 15    5478247     128883          0          0          0          0      82693      46190          0          0       3856
 16    4837434     116609          0          0          0          0      82702      33907          0          0       3082
 17   10744191     180971          0          0          2          2      82698      98269          0          0       3645
 18   14223118     173549          0          0          6          6      82656      90881          0          0       3039
 19   13438001     175749          0          0          7          7      82647      93088          0          0       6971
 20   12875331     198817          0          0          7          7      82633     116170          0          0       7868
 21   24186668     307473          0          0          9          9      82502     224953          0          0      11023
 22   14629552     412330          0          0          4          4      82668     329654          0          0      10797
 23    8458789     173838          0          0          0          0      82702      91136          0          0       6894
 24    8452365     156187          0          0          1          1      82707      73478          0          0       7501
 25          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0

 *** MBS Timewarps
 FEE 
  0          0
  1          0
  2          0
  3          0
  4          0
  5          0
  6          6
  7          0
  8          0
  9          0
 10          0
 11          0
 12          0
 13          0
 14          0
 15          0
 16          0
 17          0
 18          0
 19          0
 20          0
 21          0
 22          0
 23          0
 24          0
 25          0
 26          0
 27          0
 28          0
 29          0
 30          0
 31          0
 32          0

 *** Program elapsed time:   35.784s (  894.255 blocks/s,  55.891 Mb/s)
Attachment 6: 12JunBias2.png
12JunBias2.png
Attachment 7: 12JunImplant2.png
12JunImplant2.png
Attachment 8: 12JunStats2.png
12JunStats2.png
Attachment 9: R9_244.txt
 *** TDR format 3.3.0 analyser - TD - June 2017
 ***     MBS information: block:  4269 ptr:     7 data: 0x86820141 module:  6 information type:  8 information field: 0x00020141 ts: 0x051F386A0B7F OLD ts: 0x051F386A0B7F MBS 0x:01410000ED3B OLD MBS 0x:0141D8AE6253
 ***     MBS information: block: 20181 ptr:     9 data: 0x86820142 module:  6 information type:  8 information field: 0x00020142 ts: 0x0521B8C200C3 OLD ts: 0x0521B8C200C3 MBS 0x:014278C70000 OLD MBS 0x:014278C79B42
 ***     MBS information: block: 23476 ptr:     7 data: 0x86820142 module:  6 information type:  8 information field: 0x00020142 ts: 0x05223E484B47 OLD ts: 0x05223E484B47 MBS 0x:014200007D2D OLD MBS 0x:01429A254F63
 ***     MBS information: block: 29611 ptr:     7 data: 0x86820142 module:  6 information type:  8 information field: 0x00020142 ts: 0x052338CA34C3 OLD ts: 0x052338CA34C3 MBS 0x:01420000F78C OLD MBS 0x:0142D8C6A4E6
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  256490928 ( 1179425.3 Hz)
        Other data format:    4597072 (   21138.8 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:         98 (       0.5 Hz)
                               RESUME:         98 (       0.5 Hz)
                              SYNC100:    1989622 (    9148.9 Hz)
                           FEE64 disc:    2535193 (   11657.6 Hz)
                             MBS info:      72061 (     331.4 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:     152277 (     700.2 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:      217.471 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  1                0.082                0.000
  2                0.085                0.000
  3                0.000                0.000
  4                0.000                0.000
  5                0.134                0.000
  6                0.014                0.000
  7                0.000                0.000
  8                0.000                0.000
  9                0.037                0.000
 10                0.008                0.000
 11                0.000                0.000
 12                0.000                0.000
 13                0.937                0.886
 14                0.078                0.000
 15                0.000                0.000
 16                0.000                0.000
 17                0.025                0.000
 18                0.122                0.000
 19                0.213                0.000
 20                0.308                0.000
 21                0.924                0.967
 22                0.018                0.000
 23                0.068                0.000
 24                0.000                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100       Disc        MBS      Other   HEC Data
  0          0          0          0          0          0          0          0          0          0          0          0
  1   13167786     177701          0          0          5          5      82921      94770          0          0       9717
  2   13999920     215424          0          0          4          4      82916     132500          0          0       9819
  3    6572094     114056          0          0          0          0      82946      31110          0          0       2345
  4    2037247     124786          0          0          0          0      82945      41841          0          0       2983
  5   10315892     144198          0          0         12         12      82898      61276          0          0       3111
  6    9386945     219804          0          0          3          3      82948      64789      72061          0       3214
  7    2648431     124549          0          0          0          0      82948      41601          0          0       3475
  8    2076433     116754          0          0          0          0      82949      33805          0          0       3076
  9   10087149     348448          0          0          4          4      82939     265501          0          0       8674
 10    9696461     197086          0          0          1          1      82947     114137          0          0       5520
 11    3164192     118620          0          0          0          0      82948      35672          0          0       2792
 12    5356061     160377          0          0          0          0      82947      77430          0          0       7587
 13   36291328     139867          0          0         12         12      82593      57250          0          0       3143
 14   14842188     478995          0          0          4          4      82923     396064          0          0       9899
 15    5976764     161410          0          0          0          0      82954      78456          0          0       8856
 16    4885978     119515          0          0          0          0      82954      36561          0          0       3327
 17   10814272     203399          0          0          2          2      82939     120456          0          0       4549
 18   14266776     177547          0          0          5          5      82896      94641          0          0       3830
 19   13236547     187767          0          0          8          8      82870     104881          0          0       7087
 20   12550626     205783          0          0         13         13      82836     122921          0          0       8336
 21   23354593     279814          0          0         17         17      82596     197184          0          0      13110
 22   14483453     223561          0          0          1          1      82937     140622          0          0      11976
 23    8629169     185401          0          0          7          7      82924     102463          0          0       7859
 24    8650623     172210          0          0          0          0      82948      89262          0          0       7992
 25          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0

 *** MBS Timewarps
 FEE 
  0          0
  1          0
  2          0
  3          0
  4          0
  5          0
  6          4
  7          0
  8          0
  9          0
 10          0
 11          0
 12          0
 13          0
 14          0
 15          0
 16          0
 17          0
 18          0
 19          0
 20          0
 21          0
 22          0
 23          0
 24          0
 25          0
 26          0
 27          0
 28          0
 29          0
 30          0
 31          0
 32          0

 *** Program elapsed time:   19.678s ( 1626.203 blocks/s, 101.638 Mb/s)
Attachment 10: 12JunImplants3.png
12JunImplants3.png
  657   Mon Jun 12 00:31:29 2017 ZLiu, TD, OHMonday 12 June 08:00-16:00
09:00   Stop DAQ  to tune the Sm beam, may need 3 hours
        AIDA file RIBF128/R9_319
        
        removed the 1.5 mm degrader before the Pb box
     

09:  Start DAQ
        AIDA file RIBF128/R9


10.35     Detector biases & leakage currents OK - see attachments 1 & 2

             FEE64 Temperatures OK - see attachment 3

      good events statistics stable & OK - see attachment 4
 
      1x error reported by merger since c. 15.00 Sunday 12 June  - see attachment 5

      *all* system wide checks OK *except* nnaida13 fails ADC calibration

11.33 DAQ stop

          AIDA file RIBF128/R9_358

11.39 DAQ start

          AIDA file RIBF148/R3_0

          Correlation scaler reset request sent


11.58 analysis file RIBF148/R3_3 - deadtime < 0.5%, 2 MBS timewarps, zero ts timewarps - see attachment 6

13:33 Leakage currents as beam starts - attachment 7

13:40 BigRIPS starts run 2501
      BRIKEN starts run 29
      AIDA on file R3_31
      No degraders in at F7 and no variable degraders in

13:42 DSSD rates from R3_30
 *** DSSSD # 1 count:    111755 old count:     54792 dt:      1.01 s  LEC rate:  56401.81 Hz
 *** DSSSD # 2 count:    163809 old count:     82230 dt:      1.01 s  LEC rate:  80775.29 Hz
 *** DSSSD # 3 count:     61328 old count:     31972 dt:      1.01 s  LEC rate:  29066.79 Hz
 *** DSSSD # 4 count:     50635 old count:     25404 dt:      1.01 s  LEC rate:  24982.43 Hz
 *** DSSSD # 5 count:     23710 old count:     12126 dt:      1.01 s  LEC rate:  11469.88 Hz
 *** DSSSD # 6 count:     41872 old count:     21419 dt:      1.01 s  LEC rate:  20251.50 Hz
 *** DSSSD # 1 count:         2 old count:         0 dt:      1.01 s  HEC rate:      1.98 Hz
 *** DSSSD # 2 count:         8 old count:         5 dt:      1.01 s  HEC rate:      2.97 Hz
 *** DSSSD # 3 count:         0 old count:         0 dt:      1.01 s  HEC rate:      0.00 Hz
 *** DSSSD # 4 count:         0 old count:         0 dt:      1.01 s  HEC rate:      0.00 Hz
 *** DSSSD # 5 count:        20 old count:         8 dt:      1.01 s  HEC rate:     11.88 Hz
 *** DSSSD # 6 count:       192 old count:        91 dt:      1.01 s  HEC rate:    100.00 Hz

13:44 BRIKEN and BigRIPS stop their DAQs

13:44 BigRIPS setting 147Sm 0mm Al (at F7), 2mm Al (variable) + 0mm Al fixed (at F11)

13:50 DSSD rates from R3_33
 *** DSSSD # 1 count:    173930 old count:    115392 dt:      1.02 s  LEC rate:  57530.02 Hz
 *** DSSSD # 2 count:    247217 old count:    167042 dt:      1.02 s  LEC rate:  78794.45 Hz
 *** DSSSD # 3 count:    106853 old count:     71057 dt:      1.02 s  LEC rate:  35179.62 Hz
 *** DSSSD # 4 count:     87071 old count:     58930 dt:      1.02 s  LEC rate:  27656.43 Hz
 *** DSSSD # 5 count:     31923 old count:     21528 dt:      1.02 s  LEC rate:  10216.01 Hz
 *** DSSSD # 6 count:     61469 old count:     40889 dt:      1.02 s  LEC rate:  20225.63 Hz
 *** DSSSD # 1 count:         1 old count:         1 dt:      1.02 s  HEC rate:      0.00 Hz
 *** DSSSD # 2 count:        18 old count:        11 dt:      1.02 s  HEC rate:      6.88 Hz
 *** DSSSD # 3 count:        23 old count:        13 dt:      1.02 s  HEC rate:      9.83 Hz
 *** DSSSD # 4 count:       140 old count:        90 dt:      1.02 s  HEC rate:     49.14 Hz
 *** DSSSD # 5 count:       117 old count:        80 dt:      1.02 s  HEC rate:     36.36 Hz
 *** DSSSD # 6 count:        38 old count:        28 dt:      1.02 s  HEC rate:      9.83 Hz

13:52 BRIKEN starts run 30
      BigRIPS starts run 2502
      AIDA on file R3_35

13:54 System wide checks ok
      DSSD rates from R3_35
 *** DSSSD # 1 count:    112192 old count:     55424 dt:      1.03 s  LEC rate:  55291.13 Hz
 *** DSSSD # 2 count:    165577 old count:     82475 dt:      1.03 s  LEC rate:  80940.03 Hz
 *** DSSSD # 3 count:     64444 old count:     31995 dt:      1.03 s  LEC rate:  31604.81 Hz
 *** DSSSD # 4 count:     54003 old count:     26596 dt:      1.03 s  LEC rate:  26693.98 Hz
 *** DSSSD # 5 count:     29688 old count:     13945 dt:      1.03 s  LEC rate:  15333.43 Hz
 *** DSSSD # 6 count:     41562 old count:     21408 dt:      1.03 s  LEC rate:  19629.68 Hz
 *** DSSSD # 1 count:         0 old count:         0 dt:      1.03 s  HEC rate:      0.00 Hz
 *** DSSSD # 2 count:         4 old count:         2 dt:      1.03 s  HEC rate:      1.95 Hz
 *** DSSSD # 3 count:         9 old count:         5 dt:      1.03 s  HEC rate:      3.90 Hz
 *** DSSSD # 4 count:         8 old count:         3 dt:      1.03 s  HEC rate:      4.87 Hz
 *** DSSSD # 5 count:        85 old count:        34 dt:      1.03 s  HEC rate:     49.67 Hz
 *** DSSSD # 6 count:       102 old count:        50 dt:      1.03 s  HEC rate:     50.65 Hz

14:20   no beam now

14:22 Beam back

14.50 analysis file RIBF148/R3_50 - deadtime < 0.5%, 7 MBS timewarps, zero ts timewarps - see attachment 8

15.02 DAQ stop
      AIDA file RIBF148/R3_57

      Beam off - scheduled maintenance ~2h

15.18 online analysis
      per DSSSD x versus y (HEC) - see attachment 9
      per DSSSD E_p versus E_n (HEC) 20MeV/ch nominal - see attachment 10
      ADC & disc data synchronised - see attachment 11


15.30 DAQ start
      AIDA file RIBF148/R3_64
      BigRIPS file 2503
      BRIKEN file 31
Attachment 1: 1.png
1.png
Attachment 2: 2.png
2.png
Attachment 3: 3.png
3.png
Attachment 4: 4.png
4.png
Attachment 5: 5.png
5.png
Attachment 6: R3_3.txt
 *** TDR format 3.3.0 analyser - TD - June 2017
 ***     MBS information: block: 11043 ptr:     7 data: 0x86820001 module:  6 information type:  8 information field: 0x00020001 ts: 0x078F248E844B OLD ts: 0x078F248E844B MBS 0x:00010000B7FF OLD MBS 0x:00012C7A0B99
 ***     MBS information: block: 14050 ptr:     9 data: 0x86820001 module:  6 information type:  8 information field: 0x00020001 ts: 0x078FA7B16F17 OLD ts: 0x078FA7B16F17 MBS 0x:00014D430000 OLD MBS 0x:00014D43480E
 ***     MBS information: block: 14968 ptr:     7 data: 0x86820001 module:  6 information type:  8 information field: 0x00020001 ts: 0x078FCF637A6B OLD ts: 0x078FCF637A6B MBS 0x:00010000F587 OLD MBS 0x:0001572F4A40
 ***     MBS information: block: 16881 ptr:     7 data: 0x86820001 module:  6 information type:  8 information field: 0x00020001 ts: 0x079022797407 OLD ts: 0x079022797407 MBS 0x:0001000073EE OLD MBS 0x:00016BF49FCB
 ***     MBS information: block: 17934 ptr:     7 data: 0x86820001 module:  6 information type:  8 information field: 0x00020001 ts: 0x079050B9C833 OLD ts: 0x079050B9C833 MBS 0x:0001000088F9 OLD MBS 0x:00017781A45D
 ***     MBS information: block: 18244 ptr:     7 data: 0x86820001 module:  6 information type:  8 information field: 0x00020001 ts: 0x07905DF623A7 OLD ts: 0x07905DF623A7 MBS 0x:000100009FD6 OLD MBS 0x:00017AD07B1C
 ***     MBS information: block: 21875 ptr:     7 data: 0x86820001 module:  6 information type:  8 information field: 0x00020001 ts: 0x0790FBEBE80B OLD ts: 0x0790FBEBE80B MBS 0x:0001000010EF OLD MBS 0x:0001A251BA20
 *** ERROR: READ I/O error:       5002
                   blocks:      30739
          ADC data format:  248042755 ( 1104144.4 Hz)
        Other data format:    2756746 (   12271.5 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:         96 (       0.4 Hz)
                               RESUME:         96 (       0.4 Hz)
                              SYNC100:    2055610 (    9150.4 Hz)
                           FEE64 disc:     627202 (    2791.9 Hz)
                             MBS info:      73742 (     328.3 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:       2279 (      10.1 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:      224.647 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  1                0.099                0.000
  2                0.544                0.045
  3                0.000                0.000
  4                0.000                0.000
  5                0.121                0.000
  6                0.026                0.000
  7                0.000                0.000
  8                0.000                0.000
  9                0.115                0.000
 10                0.037                0.000
 11                0.000                0.000
 12                0.000                0.000
 13                0.429                0.346
 14                0.106                0.000
 15                0.000                0.000
 16                0.000                0.000
 17                0.035                0.000
 18                0.141                0.000
 19                0.004                0.000
 20                0.109                0.000
 21                0.360                0.380
 22                0.087                0.000
 23                0.000                0.000
 24                0.000                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100       Disc        MBS      Other   HEC Data
  0          0          0          0          0          0          0          0          0          0          0          0
  1   16036704     120101          0          0          4          4      85646      34447          0          0        186
  2   19813797     119700          0          0         15         15      85483      34187          0          0          0
  3    6595797      93292          0          0          0          0      85690       7602          0          0          0
  4    1764629      91324          0          0          0          0      85688       5636          0          0         44
  5   10416014     129080          0          0         13         13      85638      43416          0          0          0
  6    9578523     205926          0          0          5          5      85678      46496      73742          0          0
  7    2413175      91516          0          0          0          0      85692       5824          0          0         48
  8    1904326      93255          0          0          0          0      85687       7568          0          0        198
  9   12092951     139527          0          0          7          7      85647      53866          0          0          0
 10   10829494     135971          0          0          3          3      85660      50305          0          0          0
 11    2637964      92951          0          0          0          0      85677       7274          0          0          0
 12    4147857      91624          0          0          0          0      85682       5942          0          0          0
 13   33339317     119802          0          0          9          9      85517      34267          0          0          0
 14   11831289     125743          0          0          5          5      85645      40088          0          0          0
 15    5079353      93186          0          0          0          0      85684       7502          0          0          0
 16    4383516      92389          0          0          0          0      85685       6704          0          0          0
 17   10625403     140886          0          0          5          5      85675      55201          0          0          0
 18   14374937     142634          0          0          6          6      85631      56991          0          0          0
 19   12076004      96467          0          0          1          1      85688      10777          0          0          1
 20   10502790      92297          0          0          7          7      85649       6634          0          0       1548
 21   20593795     115871          0          0          8          8      85543      30312          0          0        246
 22   13134863     148259          0          0          8          8      85649      62594          0          0          0
 23    7108922      91658          0          0          0          0      85688       5970          0          0          8
 24    6761335      93287          0          0          0          0      85688       7599          0          0          0
 25          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0

 *** MBS Timewarps
 FEE 
  0          0
  1          0
  2          0
  3          0
  4          0
  5          0
  6          7
  7          0
  8          0
  9          0
 10          0
 11          0
 12          0
 13          0
 14          0
 15          0
 16          0
 17          0
 18          0
 19          0
 20          0
 21          0
 22          0
 23          0
 24          0
 25          0
 26          0
 27          0
 28          0
 29          0
 30          0
 31          0
 32          0

 *** Program elapsed time:   64.543s (  476.256 blocks/s,  29.766 Mb/s)
Attachment 7: 120617_bias1333.png
120617_bias1333.png
Attachment 8: R3_50.txt
 *** TDR format 3.3.0 analyser - TD - June 2017
 ***     MBS information: block:  2142 ptr:     7 data: 0x86820018 module:  6 information type:  8 information field: 0x00020018 ts: 0x087B3761C3F3 OLD ts: 0x087B3761C3F3 MBS 0x:001800001464 OLD MBS 0x:00184BABF4E4
 ***     MBS information: block:  8531 ptr:     7 data: 0x86820018 module:  6 information type:  8 information field: 0x00020018 ts: 0x087C14A23DE7 OLD ts: 0x087C14A23DE7 MBS 0x:0018000032E1 OLD MBS 0x:001882E880B0
 *** ERROR: READ I/O error:       5002
                   blocks:      28155
          ADC data format:  223027865 ( 1362205.5 Hz)
        Other data format:    6688780 (   40853.6 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:         99 (       0.6 Hz)
                               RESUME:         99 (       0.6 Hz)
                              SYNC100:    1497887 (    9148.8 Hz)
                           FEE64 disc:    5145582 (   31428.1 Hz)
                             MBS info:      45113 (     275.5 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:     315487 (    1926.9 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:      163.726 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  1                0.215                0.000
  2                0.150                0.045
  3                0.000                0.000
  4                0.000                0.000
  5                0.434                0.076
  6                0.092                0.000
  7                0.000                0.000
  8                0.000                0.000
  9                0.168                0.000
 10                0.048                0.000
 11                0.000                0.000
 12                0.000                0.000
 13                0.209                0.000
 14                0.066                0.000
 15                0.004                0.000
 16                0.000                0.000
 17                0.163                0.000
 18                0.051                0.000
 19                0.056                0.000
 20                0.018                0.000
 21                0.514                0.537
 22                0.088                0.000
 23                0.062                0.000
 24                0.000                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100       Disc        MBS      Other   HEC Data
  0          0          0          0          0          0          0          0          0          0          0          0
  1   12485600     157427          0          0          7          7      62365      95048          0          0      13584
  2   14721313     169057          0          0          4          4      62395     106654          0          0      13440
  3    5311318     130880          0          0          0          0      62449      68431          0          0       6580
  4    2539795     183683          0          0          0          0      62447     121236          0          0       8191
  5    8577137     243433          0          0         23         23      62283     181104          0          0      10095
  6    9268308     573911          0          0          5          5      62416     466372      45113          0      19725
  7    3012967     250512          0          0          0          0      62452     188060          0          0      16239
  8    2064787     148088          0          0          0          0      62448      85640          0          0       9306
  9   10236278     424368          0          0          7          7      62385     361969          0          0      14286
 10    9794631     528415          0          0          2          2      62433     465978          0          0      15064
 11    3047215     161052          0          0          0          0      62444      98608          0          0       7855
 12    4545203     181644          0          0          0          0      62449     119195          0          0       8080
 13   28602376     525031          0          0         12         12      62370     462637          0          0      19018
 14   12384684     525896          0          0          2          2      62423     463469          0          0      19811
 15    5398920     247162          0          0          1          1      62450     184710          0          0      15351
 16    4643593     225421          0          0          0          0      62446     162975          0          0      14776
 17   10423666     462146          0          0          7          7      62384     399748          0          0      12330
 18   11497546     271260          0          0          6          6      62431     208817          0          0       6365
 19   10562276     179222          0          0          3          3      62428     116788          0          0       8048
 20   10063973     201643          0          0          2          2      62444     139195          0          0       9033
 21   17921263     222590          0          0          9          9      62252     160320          0          0      19853
 22   11675858     212571          0          0          4          4      62414     150149          0          0      18982
 23    7129958     243602          0          0          5          5      62427     181165          0          0      14644
 24    7119200     219766          0          0          0          0      62452     157314          0          0      14831
 25          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0

 *** MBS Timewarps
 FEE 
  0          0
  1          0
  2          0
  3          0
  4          0
  5          0
  6          2
  7          0
  8          0
  9          0
 10          0
 11          0
 12          0
 13          0
 14          0
 15          0
 16          0
 17          0
 18          0
 19          0
 20          0
 21          0
 22          0
 23          0
 24          0
 25          0
 26          0
 27          0
 28          0
 29          0
 30          0
 31          0
 32          0

 *** Program elapsed time:  166.816s (  168.778 blocks/s,  10.549 Mb/s)
Attachment 9: 9.png
9.png
Attachment 10: 10.png
10.png
Attachment 11: 11.png
11.png
  937   Mon Dec 11 09:57:54 2023 TDMonday 11 December
Water flow and temperature ( gauges outside S4 entrance ) OK

BNC PB-5 pulser connected to p+n FEE64s by diasy chain of test + inputs

ASIC settings 2023Nov16-18.55.20
 p+n FEE64s slow comparator 0xa, n+n FEE64s 0xf

All system wide checkks OK

DSSSD bias -150V leakage current -5.37uA - OK - attachment 1

FEE64 temperatures OK - attachment 2

ADC data item stats - attachment 3
 rates dominated by relatively few 'hot' channels
 aida06 - no cables connected to FEE64 adaptor PCB

per FEE64 Rate spectra - attachment 4
 aida06 - no cables connected to FEE64 adaptor PCB 
 system relatively quiet but has been quieter - no grounding of bPlast cabling and PSUs?

p+n and n+n FEE64 1.8.W spectra - 20us FSR - attachments 5-8
 aida06 - no cables connected to FEE64 adaptor PCB
 aida08 - no ADC calibration 



14.43 Pulser walkthrough - p+n junction FEE64s

BNC PB-5 settings
amplitude 9.0-1.0V @ 1.0V step
x10 attenuation
tail pulse
polarity +
frequency 22Hz

file DEC23/R5

15.47 R45 ends OK - see attachments 9-10
aida01 1.8.L pulser peak width 53 ch FWHM
aida06 1.8.L pulser peak width 14 ch FWHM ( no input )

15.47 file DEC23/R6 

BNC PB-5 pulser
amplitude 9.0V
frequency 2Hz

c. 19.00
Low intensity 238U fully stripped/H+/He+ - attachments 11-14
Fully stripped close to centre of DSSSD
HEC energies observed from threshold to c. 1-2GeV

19.25 Beam off
      SC41 scaler input to level 1 MACB #3 ( of 4 ) moved to level 1 MACB #4 ( of 4 )


21.00 checks


DSSSD bias -150V leakage current -6.050uA - OK - attachment 15

FEE64 temperatures OK - attachment 16

ADC data item stats - attachment 17
 rates dominated by relatively few 'hot' channels
 aida06 - no cables connected to FEE64 adaptor PCB

BNC PB-5 config - attachment 18

Merger and TapeServer browser tabs and terminal servers - attachments 19-20
 c. 160k data items/s merged
 c. 600kb to disk and forwarded to MBS

21.05.37 *all* stats zero'd

22.18 ADC data, DISC data, PAUSE, RESUME, WR data item stats - attachments 21-28
zero rate PAUSE/RESUME - one observed in c. 75 minutes
Attachment 1: Screenshot_from_2023-12-11_10-50-57.png
Screenshot_from_2023-12-11_10-50-57.png
Attachment 2: Screenshot_from_2023-12-11_10-51-08.png
Screenshot_from_2023-12-11_10-51-08.png
Attachment 3: Screenshot_from_2023-12-11_10-51-16.png
Screenshot_from_2023-12-11_10-51-16.png
Attachment 4: Screenshot_from_2023-12-11_10-51-22.png
Screenshot_from_2023-12-11_10-51-22.png
Attachment 5: Screenshot_from_2023-12-11_10-53-06.png
Screenshot_from_2023-12-11_10-53-06.png
Attachment 6: Screenshot_from_2023-12-11_10-52-54.png
Screenshot_from_2023-12-11_10-52-54.png
Attachment 7: Screenshot_from_2023-12-11_10-52-39.png
Screenshot_from_2023-12-11_10-52-39.png
Attachment 8: Screenshot_from_2023-12-11_10-52-27.png
Screenshot_from_2023-12-11_10-52-27.png
Attachment 9: Screenshot_from_2023-12-11_15-46-41.png
Screenshot_from_2023-12-11_15-46-41.png
Attachment 10: Screenshot_from_2023-12-11_15-46-29.png
Screenshot_from_2023-12-11_15-46-29.png
Attachment 11: Screenshot_from_2023-12-11_19-16-25.png
Screenshot_from_2023-12-11_19-16-25.png
Attachment 12: Screenshot_from_2023-12-11_19-14-14.png
Screenshot_from_2023-12-11_19-14-14.png
Attachment 13: Screenshot_from_2023-12-11_19-13-51.png
Screenshot_from_2023-12-11_19-13-51.png
Attachment 14: Screenshot_from_2023-12-11_19-13-19.png
Screenshot_from_2023-12-11_19-13-19.png
Attachment 15: Screenshot_from_2023-12-11_21-00-56.png
Screenshot_from_2023-12-11_21-00-56.png
Attachment 16: Screenshot_from_2023-12-11_21-01-11.png
Screenshot_from_2023-12-11_21-01-11.png
Attachment 17: Screenshot_from_2023-12-11_21-01-19.png
Screenshot_from_2023-12-11_21-01-19.png
Attachment 18: Screenshot_from_2023-12-11_21-01-25.png
Screenshot_from_2023-12-11_21-01-25.png
Attachment 19: Screenshot_from_2023-12-11_21-01-43.png
Screenshot_from_2023-12-11_21-01-43.png
Attachment 20: Screenshot_from_2023-12-11_21-01-53.png
Screenshot_from_2023-12-11_21-01-53.png
Attachment 21: Screenshot_from_2023-12-11_22-19-18.png
Screenshot_from_2023-12-11_22-19-18.png
Attachment 22: Screenshot_from_2023-12-11_22-19-04.png
Screenshot_from_2023-12-11_22-19-04.png
Attachment 23: Screenshot_from_2023-12-11_22-18-45.png
Screenshot_from_2023-12-11_22-18-45.png
Attachment 24: Screenshot_from_2023-12-11_22-18-32.png
Screenshot_from_2023-12-11_22-18-32.png
Attachment 25: Screenshot_from_2023-12-11_22-18-22.png
Screenshot_from_2023-12-11_22-18-22.png
Attachment 26: Screenshot_from_2023-12-11_22-18-04.png
Screenshot_from_2023-12-11_22-18-04.png
Attachment 27: Screenshot_from_2023-12-11_22-17-45.png
Screenshot_from_2023-12-11_22-17-45.png
  381   Mon Oct 10 03:15:59 2016 CG & TDMonday 10 October
10.30 DAQ found stopped

      All FEE64 AIDA SYNC rates zero, AIDA SYNC count ~ 4.4M => DAQ stopped @ 01.40

      3He detector DAQ off - no 50MHz clock to Master MACB

      System wide checks - see attachments 26-18

      N.B. It would appear that the DAQ stalled (TS_SYNC_PHASE 1) c. 01.40 and at some
      later time (c. 06.00) the 3He detector DAQ was powered off which means that AIDA
      lost the external 50MHz clock to the Master MACB - system-wide screenshots should
      be interpreted with caution.

14.15 3He detector DAQ 50MHz clock restarted
 
      VME and NIM crates ON
      Excecute command ConfClock_50MHz on 3He detector DAQ computer

      Power cycle AIDA FEE64s
      Set TS_SYNC_PHASE 2

      DSSSD bias/leakage current OK
      FEE64 temperatures OK
      *All* system-wide checks OK

      B2F/F11 temperature + deg C, d.p. + deg C,RH %

      ASIC settings 2016Sep02-18.17.01
      slow comparator 0x10 -> 0x0a

      Master MACB serial #13 (see https://elog.ph.ed.ac.uk/AIDA/367)
      Master MACB mode 5

14.20 DAQ starts (no data transfer)

18.10 DAQ found stopped

      All FEE64 AIDA SYNC rates zero, AIDA SYNC count ~ 3.4M => DAQ stopped @ 16.50

      System-wide checks - see attachments 16-9

      Power cycle AIDA FEE64s
      Set TS_SYNC_PHASE 3

      ASIC settings 2016Sep02-18.17.01
      slow comparator 0x10 -> 0x0a

20.10 DAQ found stalled

      System-wide checks - see attachments 8-1

      Power cycle AIDA FEE64s
      Set TS_SYNC_PHASE 0

      ASIC settings 2016Sep02-18.17.01
      slow comparator 0x10 -> 0x0a

20.35 DAQ starts (no data transfer)

      slow comparator 0x10 -> 0x0a

18.35 DAQ starts (no data transfer)

20.16 DAQ found stopped
      All FEE64 AIDA SYNC rates zero, AIDA SYNC count ~ 120k (17/24 FEE64s) or 1.49M (7/24) => FEE64s stopped @ 18.40 & 19.40

20.36 DAQ starts (no data transfer)

23.47 DAQ OK
Attachment 1: 47.png
47.png
Attachment 2: 46.png
46.png
Attachment 3: 45.png
45.png
Attachment 4: 44.png
44.png
Attachment 5: 43.png
43.png
Attachment 6: 42.png
42.png
Attachment 7: 41.png
41.png
Attachment 8: 40.png
40.png
Attachment 9: 27.png
27.png
Attachment 10: 26.png
26.png
Attachment 11: 25.png
25.png
Attachment 12: 24.png
24.png
Attachment 13: 23.png
23.png
Attachment 14: 22.png
22.png
Attachment 15: 21.png
21.png
Attachment 16: 30.png
30.png
Attachment 17: 19.png
19.png
Attachment 18: 18.png
18.png
Attachment 19: 17.png
17.png
Attachment 20: 16.png
16.png
Attachment 21: 14.png
14.png
Attachment 22: 13.png
13.png
Attachment 23: 12.png
12.png
Attachment 24: 11.png
11.png
Attachment 25: 10.png
10.png
  835   Mon Jun 10 01:43:16 2019 CA, CB, TD, CG, OH, DKMonday 10 June
09:45 DAQ continues ok 

      all system wide checks OK *except* nnaida7 fails ADC calibration
      
      detector biases & leakage currents OK - see attachment 1

      FEE64 temperatures OK - see attachment 2

      Good event statistics prior to reload - glitch with display? - attachment 3

      Reload done - good event statistics ok - attachment 4

10.00 Merger & TapeServer ok - attachments 5 & 6

15.14 DAQ continues OK

      ASIC settings 2019May19-17.54.03
      slow comparator 0xa

      BNC PB-4 Pulser 
      Amplitude 90,000
      x5 attenuator IN
      Frequency 25Hz range, variable min. c. 2.5Hz
      t_r 100ns, tau_d 50us
      - polarity
      Delay MIN, tail pulse

      all system wide checks OK *except* nnaida7 fails ADC calibration

      detector biases & leakage currents OK - see attachments 7 & 8

      FEE64 temperatures OK - see attachment 9

      good event statistics - DSSSD#1 noisy - see attachments 10
      8x <20k, 23x <50k, 24x <100k cf. same as earlier today
      Merger OK - see attachment 11
      TapeServer OK - see attachment 12

      p+n FEE64s 1.8.W spectra 20us FSR - DSSSD#1 noisy - attachment 13
      n+n FEE64s 1.8.W spectra 20us FSR - DSSSD#1 noisy - attachment 14
      1.8.L spectra - see attachments 9 & 10
      nnaida1 73 ch FWHM, nnaida3 78 ch FWHM - cf. 76 & 83 ch FWHM respectively yesterday morning

      FEE64 Rate spectra - attachment 15
      Check ASIC Control *all* FEE64s & ASICs x2
      FEE64 Rate spectra - attachment 16

15.26 ADC data synchronised - attachment 17

16.55 Julabo FL11006 chiller set point +20 deg C actual +20.0 deg C
      Water level c. 80% M-H markers - topup to 100% with 0.5x jugful water
      Temperature +24.6 deg C dew point +8.1 deg C RH 34.5%
Attachment 1: 191006_0946_bias.png
191006_0946_bias.png
Attachment 2: 190610_0948_temp.png
190610_0948_temp.png
Attachment 3: 190609_1756_weirdstats.png
190609_1756_weirdstats.png
Attachment 4: 190610_0955_stats.png
190610_0955_stats.png
Attachment 5: 190610_tape.png
190610_tape.png
Attachment 6: 190619_merger.png
190619_merger.png
Attachment 7: 1.png
1.png
Attachment 8: 2.png
2.png
Attachment 9: 3.png
3.png
Attachment 10: 4.png
4.png
Attachment 11: 5.png
5.png
Attachment 12: 6.png
6.png
Attachment 13: 7.png
7.png
Attachment 14: 8.png
8.png
Attachment 15: 9.png
9.png
Attachment 16: 10.png
10.png
Attachment 17: 11.png
11.png
Attachment 18: 12.png
12.png
Attachment 19: 13.png
13.png
  745   Mon Oct 1 01:10:57 2018 OH, TDMonday 1 October
09.10 DAQ continues OK - current file Sep18/R2_16

09.15 all system wide checks OK *except* nnaida7 fails ADC calibration

      detector biases & leakage currents OK - see attachments 1 & 2

      FEE64 temperatures OK - see attachment 3
      good event statistics OK - see attachment 4
      nnaida2 rate due to one hot channel

      Merger OK - see attachment 5
      TapeServer OK - see attachment 6
      no errors or warnings shown by server terminal sessions 

      1.8.L spectra - see attachments 7 & 8
      1.8.W spectra 20us FSR - see attachments 9 & 10
      
09.24 temperature +25.5 deg C, RH 43.4%, d.p. +11.9 deg C
      Julabo FL11006 set point +20 deg C, actual +20.0 deg C, water level c. 75%

16.25 Julabo FL11006 refill to just below H indicator

      DAQ continues OK - current file Sep18/R2_19
Attachment 1: 10.png
10.png
Attachment 2: 11.png
11.png
Attachment 3: 12.png
12.png
Attachment 4: 13.png
13.png
Attachment 5: 14.png
14.png
Attachment 6: 15.png
15.png
Attachment 7: 16.png
16.png
Attachment 8: 17.png
17.png
Attachment 9: 18.png
18.png
Attachment 10: 19.png
19.png
  850   Mon Jun 17 08:03:37 2019 CA, CB, TD, OHMon Jun 17 16:00-24:00
16:04  DAQ continues running OK
       All system-wide checks OK except nnaida7 ADC calibration fails
       FEE64 temperatures OK - attach 1
       Merger and Tape Server OK - see attach 2 & 3

16:30 DTAS and BigRIPS stop
      AIDA on file R2_406

16:35 Beam stop.
      AIDA plastic gain increased by a factor 2
      Moved the lead bricks between AIDA and F11, 1 cm further away to the sides

      Chiller water level OK
      Humidity  34.6%
      Temperature 23.4 C
      Dew point 7.1 C
      

16:40 Beam restart
      AIDA run R2_408
      DTAS 70 (from DTAS ELOG)
      BigRIPS 2030  (from DTAS ELOG)

      No obvious changes to the implantation pattern. May need more stats.   

      Detector leakage current OK - see attach 4    

17.31 nnaida14 3.*.H & 4.*.H spectra - attachments 5 & 6

      Corresponds to RHS DSSSD#3 - decrease in rate observed but no evidence of systematic variation of HEC energy 

      Modified implantdecay4.f to select events with x & y energy > ADC ch 1600 (c. 1MeV) to observe x-y hit pattern
      of light particles - see attachments 7 & 8
      Low stats but light particle distribution appears to be symmetric with no obvious RHS cut


17:37 DTAS & BigRIPS DAQ stop
      Beam stop
      Lead moved back as before
      AIDA plastic gain decreased by a factor 5

17:40 DTAS and BigRIPS stop
      AIDA on file R2_416


17.48 zero *all* SortSas spectra

17:50 Beam restarting
      AIDA R2_418
      DTAS  73  (72 is a mistake - ignore)
      BigRIPS  2031


18:43 DAQ continues OK
      All system wide checks OK - except nnaida7 fails ADC calibration as usual
      FEE64 temperature OK - see attach 9
      Stats OK - see attach 10
      Merger & Tape Server OK - see attach 11 & 12
      Leakage currents OK - see attach 13
      HEC & LEC events plots attached - attach 14 & 15 - note LEC in DSSD#3 are > 3 MeV only (light particle-like)

18:50 AIDA R2_427
      DTAS 74
      BigRIPS 2031

19.08 DTAS & BigRIPS DAQ stop - beam lost
      AIDA file R2_429

21:15 Beam is back - briefly
      AIDA R2_446

21:17 Beam lost - operators advise "this will take a long time"

22:16 Beam is back!
      AIDA R2_454
      DTAS 78
      BigRIPS 2034

      Statistics OK - attach 15
      FEE64 temperatures OK - attach 16
      Merger & Tape Server OK - see attach 17 & 18
      System-wide checks as usual

      DTAS reports rate in F11 down by 20%, and rate in AIDA plastic sees similar drop.
Attachment 1: 190617_1607_tape.png
190617_1607_tape.png
Attachment 2: 190617_1607_temp.png
190617_1607_temp.png
Attachment 3: 190617_1647_bias.png
190617_1647_bias.png
Attachment 4: 1.png
1.png
Attachment 5: 2.png
2.png
Attachment 6: 3.png
3.png
Attachment 7: 4.png
4.png
Attachment 8: 190617_1845_stats.png
190617_1845_stats.png
Attachment 9: 190617_1845_temps.png
190617_1845_temps.png
Attachment 10: 190617_1846_merger.png
190617_1846_merger.png
Attachment 11: 190617_1846_tape.png
190617_1846_tape.png
Attachment 12: 190617_1847_bias.png
190617_1847_bias.png
Attachment 13: 190617_1848_HEC.png
190617_1848_HEC.png
Attachment 14: 190617_1848_LEC_3MeV.png
190617_1848_LEC_3MeV.png
Attachment 15: 190617_2224_merger.png
190617_2224_merger.png
Attachment 16: 190617_2224_stats.png
190617_2224_stats.png
Attachment 17: 190617_2224_temps.png
190617_2224_temps.png
Attachment 18: 190617_2225_tape.png
190617_2225_tape.png
Attachment 19: 190617_2230_bias.png
190617_2230_bias.png
  681   Mon Oct 23 11:50:09 2017 TD, OHMon 23 Oct - further information please.
> 10:18 Leakage and bias ok - Attachment 1
>       FEE temperatures ok - Attachment 2
>       Statistics - Attachment 3
>       DAQ continues ok
> 
> 10:23 DAQ stopped on R7_10
>       Alpha run through night
> 
> 10:28 MIDAS Sort spectra from the alpha run
>       Ep versus En - Attachment 4
>       x versus y 2D hit pattern - Attachment 5
>       Front versus back multiplicity - Attachment 6
> 
>       2D Hit pattern indicates detection of alphas in all 4 regions of each of the 6 detectors
>       indicates cabling is ok
> 
> 11:55 FEEs turned off after being unable to recover after crash
Please could you define this 'crash' to allow a better understanding of problems with the system. 
For example.... what is unresponsive.... does a parse of the FEE64 log files ( before doing anything ) reveal a panic that is new? Does a STOP of the Tape work ? Does a Toggle of the MERGE pause state 
work ? 
Thus it will be possible to say that ..... FEE # is always the one responsible for DAQ failure or by < ???? > or the MERGE has found < ??? > problem.
Thanks in advance ;-)))

> 
> 13:49 FEEs powered on again
>       Pi monitor indicates panic on nnaida22 the FEE that crashed
> 
>       ReSync done on setup except for 23 and 24
>       Master ReSync done succesfully
>       ASIC settings loaded default to 2017Mar27
>       Restoring 2017Oct22
>       
>       System wide checks ok
>       Leakage and bias ok - Attachment 7
>       FEE temperatures crashed - Attachment 8
> 
>       Upon reboot all rates across the FEEs appear lower
>       In particular 13 and 14. Thresholds have been reduced back to 0xa for all ASICs on both FEEs
> 
>       Layout 1 linear common y of 2000 - Attachment 9
>       Layout 1 log common y of 10 - Attachment 10
> 
>       All front side FEE64 1.8.W waveforms - 20us range - Attachment 11
>       All back side FEE64 1.8.W waveforms - 20us range - Attachment 12
> 
>       All front side FEE64 1.8.W waveforms - 2ms range - Attachment 13
>       All back side FEE64 1.8.W waveforms - 2m range - Attachment 14
> 
>       FEE64 nnaida13 1.*.W waveforms - Ibias LF 0xf - 2ms range - Attachment 15
> 
>       Statistics after switch and thresholds lowered - Attachment 16
>       Pulser widths measured. On boards changed 10 out of 12 FEEs show greater than 10% improvements
>       11 out of 24 total show greater than 10%
>       FEE stats post pulser width - Attachment 17
> 
>       New ASIC settings DB key: 2017Oct23-14.38.03
>       Slow comparator 0xa for all FEE64s and all ASICs
>       IBias LF feedback at 0xf for all front side FEEs except nnaida 2 which is at 0xc
>       IBias LF feedback at 0xb for all back side FEEs
>       ASIC settings DB file checked OK
> 
>       Ambient temperature +23.3 deg C, D.P +7.1 deg C,  R.H. 35.2%
>       Julabo FL11006 set point +20.0 deg C, water le
> 
> 15:38 Merger and TapeServer screenshots - Attachments 17-18
>       
  135   Mon Dec 14 19:25:35 2015 AE, CG ,PhongMerger/TapeServer trouble report
Sat. 12/12/15

Working with a 8-FEE setup (as in https://elog.ph.ed.ac.uk/AIDA/133). We could open a file with the 
TapeServer. Merger also seems to be working (cursor spinning, and merge statistics ~ok). However the 
TapeServer doesn’t write anything to disk (just empty an file).

A few observations; I only took ‘systematic’ notes after we had reduced the number of FEEs to 8, but it's 
likely we were also facing the same problems before with a full system:

+ When enabling data transfer from NNAIDA modules (in Run Control page), it switches to the right mode for 
all FEEs except for NNAIDA5. NNAIDA5 is the master FEE. The merger also doesn’t show any stats for NNAIDA5 
(but stats look ok for all other FEEs). The spectra for NNAIDA5 look ok, so the FEE is generating data.

+ A few times we observe the following behavior: DAQ running without trouble. We start Merger+TapeServer, 
and when attempting some actions in RunControl (start-stop, or reset), we loose the ability to communicate 
with a number of FEEs. These FEEs can not perform a ReSYNC, and the only way to get them back to life is 
going through a power cycle. It seems like the TaperServer or Merger is somehow upsetting the FEEs or the 
DAQ. We can still ‘ping’ all FEEs, even after the ‘connect failed’ message. 

Attached are a few screenshots, and the text in the terminals for Merger and TapeServer. The following is 
the error returned by one FEE when we can’t ReSync them:


STATE for nnaida3 returned with an error
connect failed 
NONE
connect failed 
    while executing
"::http::geturl http://nnaida3:8015/DataAcquisitionControlServer -headers {} -type text/xml -timeout 20000 
-query {<?xml version="1.0" encoding="UTF-8"..."
    ("eval" body line 1)
    invoked from within
"eval [list ::http::geturl $url] $args"
    (procedure "::http::geturl_followRedirects" line 4)
    invoked from within
"::http::geturl_followRedirects http://nnaida3:8015/DataAcquisitionControlServer -headers {} -type 
text/xml -timeout 20000 -query {<?xml version="1.0" ..."
    ("eval" body line 1)
    invoked from within
"eval ::http::geturl_followRedirects [list $url]  -headers [list $local_headers]  -type text/xml  -timeout 
$timeout  -query [list $request]  $local_pro..."
    (procedure "::SOAP::Transport::http::xfer" line 61)
    invoked from within
"$transport $procVarName $url $req"
    (procedure "::SOAP::invoke" line 18)
    invoked from within
"::SOAP::invoke ::SOAP::_DataAcquisitionControlClient__GetState"
    ("eval" body line 1)
    invoked from within
"eval ::SOAP::invoke ::SOAP::_DataAcquisitionControlClient__GetState $args"
    (procedure "DataAcquisitionControlClient__GetState" line 1)
    invoked from within
"DataAcquisitionControlClient__GetState"
GET OPTION for nnaida3 returned with an error
connect failed 
NONE
connect failed 
    while executing
"::http::geturl http://nnaida3:8015/DataAcquisitionControlServer -headers {} -type text/xml -timeout 60000 
-query {<?xml version="1.0" encoding="UTF-8"..."
    ("eval" body line 1)
    invoked from within
"eval [list ::http::geturl $url] $args"
    (procedure "::http::geturl_followRedirects" line 4)
    invoked from within
"::http::geturl_followRedirects http://nnaida3:8015/DataAcquisitionControlServer -headers {} -type 
text/xml -timeout 60000 -query {<?xml version="1.0" ..."
    ("eval" body line 1)
    invoked from within
"eval ::http::geturl_followRedirects [list $url]  -headers [list $local_headers]  -type text/xml  -timeout 
$timeout  -query [list $request]  $local_pro..."
    (procedure "::SOAP::Transport::http::xfer" line 61)
    invoked from within
"$transport $procVarName $url $req"
    (procedure "::SOAP::invoke" line 18)
    invoked from within
"::SOAP::invoke ::SOAP::_DataAcquisitionControlClient__GetOption NetVar=NetVar.DACQ.Chistenable"
    ("eval" body line 1)
    invoked from within
"eval ::SOAP::invoke ::SOAP::_DataAcquisitionControlClient__GetOption $args"
    (procedure "DataAcquisitionControlClient__GetOption" line 1)
    invoked from within
"DataAcquisitionControlClient__GetOption "$AcqGetOption""
Attachment 1: master_no_data_transfer.png
master_no_data_transfer.png
Attachment 2: master_no_data_transfer.png
master_no_data_transfer.png
Attachment 3: error_when_stop_daq_merger_running.png
error_when_stop_daq_merger_running.png
Attachment 4: error_show_1_3_8_kaput.png
error_show_1_3_8_kaput.png
Attachment 5: out_term.txt
=> "Httpd for Merger/Tape Server" terminal:



System identified is CPU x86_64; Platform is unix; OS is Linux and Version is 2.6.32-504.8.1.el6.x86_64
Environment selected is CPU x64_64; Platform unix; OS Linux64 and Operating System Linux64
MIDASBASE = /MIDAS@aidas and MIDAS_LIBRARY = /MIDAS@aidas/TclHttpd/Linux64
PATH = /MIDAS@aidas/bin_Linux64:/MIDAS@aidas/TclHttpd/Linux64:/homes/npg/root/bin:/homes/npg/root/bin:/homes/npg/root/lib:/MIDAS/Linux/bin64:/usr/lib64/qt-3.3/bin:/usr/local/bin:/usr/bin:/bin
package limit is not available: can't find package limit
Running with default file descriptor limit
package setuid is not available: can't find package setuid
Could not change to user 50 group 50: not owner
/debug user "debug" password "aegc.ur9z+3w"
httpd started on port 8115

Custom startup from /MIDAS@aidas/config/TclHttpd/aidas1@8115/startup.tcl
/TapeServer
/DataBaseAccessServer
Loaded MemSasAccess
/SpectrumService
/NetVarService
/SigTaskService
loading tcl/MERGERunControl.tcl for namespace ::
/DataAcquisitionControlServer
DefineMessage unknown
Run Control Server Implementation for MERGE
RunControlServer loaded
loading Html/RunControl/implementation.tcl for namespace ::
RunControl loaded
loading Html/MERGE/RunControl/implementation.tcl for namespace ::
ReadRegister failed: Name=NetVar.EXEC.ID; Code= 0x10004; Info= Register name does not exist
created SigTask registers 0 0  0 0
Created UI registers
MERGE RunControl loaded
Completed custom startup from /MIDAS@aidas/TclHttpd/Html/MERGE/RunControl/stats.defn.tcl
Shared memory area located at 0x7f6b51f67000
Tape Server comms table located at 0x7f6b51f67000
setup Merge
DataAcqCommand: 1 Halt
Halt (1)
DataAcqCommand: 8 Unmapping spectra
Unmapping spectra (1)
DataAcqCommand: 3 Setup
Setup (1)
go Merge
DataAcqCommand: 3 connect xfer stream
connect xfer stream (1)
DataAcqCommand: 2 Go
Go (1)
DataAcqCommand: 16 MergeStart
MergeStart (1)












=> "Merger" terminal:
.
.
.
MERGE Data Link (25178): Started with args 27 11000 11028
MERGE Data Link (25170): MIDAS MERGE Data Link Build Aug 12 2014
MERGE Data Link (25178): Configuration: index = 27, SHM key=11000, TCP port = 11028
MERGE Data Link (25178): File mapped object /SHM_11000 accessed
MERGE Data Link (25178): Shared memory ID is 3
MERGE Data Link (25178): Memory mapping 402732 bytes
MERGE Data Link (25178): Shared memory segment located at address 0x7f9815f0a000.
MERGE Data Link (25178): File mapped object /SHM_11001 accessed
MERGE Data Link (25178): Shared memory ID is 3
MERGE Data Link (25178): Memory mapping 1073741824 bytes
MERGE Data Link (25178): Shared memory segment located at address 0x7f97d5f0a000.
MERGE Data Link (25172): Message Initialisation failed.
MERGE Data Link (25172): Message logger not contacted.
MERGE Data Link (25181): Message Initialisation failed.
MERGE Data Link (25181): Message logger not contacted.
MERGE Data Link (25170): Started with args 19 11000 11020
MERGE Data Link (25170): Configuration: index = 19, SHM key=11000, TCP port = 11020
MERGE Data Link (25170): File mapped object /SHM_11000 accessed
MERGE Data Link (25170): Shared memory ID is 3
MERGE Data Link (25170): Memory mapping 402732 bytes
MERGE Data Link (25170): Shared memory segment located at address 0x7f5e73f1b000.
MERGE Data Link (25170): File mapped object /SHM_11001 accessed
MERGE Data Link (25170): Shared memory ID is 3
MERGE Data Link (25170): Memory mapping 1073741824 bytes
MERGE Data Link (25170): Shared memory segment located at address 0x7f5e33f1b000.
MRGE Stats created and initialised
MERGE Data Link (25153): Starting the network interface
MERGE Data Link (25153): TCP socket receive buffer was 87380 - now 249856
MERGE Data Link (25153): TCP socket send buffer was 16384 - now 249856
MERGE Data Link (25153): MERGE Data Link using TCP port 11003.
MERGE Data Link (25153): Entering server loop
MERGE Data Link (25153): listening on port 11003
MERGE Data Link (25180): Started with args 29 11000 11030
MERGE Data Link (25180): Configuration: index = 29, SHM key=11000, TCP port = 11030
MERGE Data Link (25180): File mapped object /SHM_11000 accessed
MERGE Data Link (25180): Shared memory ID is 3
MERGE Data Link (25180): Memory mapping 402732 bytes
MERGE Data Link (25180): Shared memory segment located at address 0x7fdf8abed000.
MERGE Data Link (25180): File mapped object /SHM_11001 accessed
MERGE Data Link (25180): Shared memory ID is 3
MERGE Data Link (25180): Memory mapping 1073741824 bytes
MERGE Data Link (25180): Shared memory segment located at address 0x7fdf4abed000.
MERGE Data Link (25172): MIDAS MERGE Data Link Build Aug 12 2014
MERGE Program (25183): Message Initialisation failed.
MERGE Program (25183): Message logger not contacted.
MERGE Program (25183): MIDAS MERGE Program (64-bit) Build Sep  3 2014
MERGE Program (25183): Started with args 11000
MERGE Program (25183): Configuration: SHM key=11000
MERGE Program (25183): File mapped object /SHM_11000 accessed
MERGE Program (25183): Shared memory ID is 3
MERGE Program (25183): Memory mapping 402732 bytes
MERGE Program (25183): Shared memory segment located at address 0x7f520d167000.
MERGE Program (25183): File mapped object /SHM_11001 accessed
MERGE Program (25183): Shared memory ID is 3
MERGE Program (25183): Memory mapping 1073741824 bytes
MERGE Program (25183): Shared memory segment located at address 0x7f51cd167000.
Creating NetVars #2
MERGE Data Link (25181): MIDAS MERGE Data Link Build Aug 12 2014
MERGE Data Link (25172): Started with args 21 11000 11022
MERGE Data Link (25172): Configuration: index = 21, SHM key=11000, TCP port = 11022
MERGE Data Link (25172): File mapped object /SHM_11000 accessed
MERGE Data Link (25172): Shared memory ID is 3
MERGE Data Link (25172): Memory mapping 402732 bytes
MERGE Data Link (25172): Shared memory segment located at address 0x7ff8a4728000.
MERGE Data Link (25172): File mapped object /SHM_11001 accessed
MERGE Data Link (25172): Shared memory ID is 3
MERGE Data Link (25172): Memory mapping 1073741824 bytes
MERGE Data Link (25172): Shared memory segment located at address 0x7ff864728000.
Output buffer length = 65504; format option = 4; transfer option = 3
NetVars created and initialised
MRGE Stats created and initialised
MERGE Data Link (25157): Starting the network interface
MERGE Data Link (25157): TCP socket receive buffer was 87380 - now 249856
MERGE Data Link (25157): TCP socket send buffer was 16384 - now 249856
MERGE Data Link (25157): MERGE Data Link using TCP port 11007.
MERGE Data Link (25157): Entering server loop
MERGE Data Link (25157): listening on port 11007
MRGE Stats created and initialised
MERGE Data Link (25160): Starting the network interface
MERGE Data Link (25160): TCP socket receive buffer was 87380 - now 249856
MERGE Data Link (25160): TCP socket send buffer was 16384 - now 249856
MERGE Data Link (25160): MERGE Data Link using TCP port 11010.
MERGE Data Link (25160): Entering server loop
MERGE Data Link (25160): listening on port 11010
MERGE Data Link (25181): Started with args 30 11000 11031
MERGE Data Link (25181): Configuration: index = 30, SHM key=11000, TCP port = 11031
MERGE Data Link (25182): Message Initialisation failed.
MERGE Data Link (25181): File mapped object /SHM_11000 accessed
MERGE Data Link (25182): Message logger not contacted.
MERGE Data Link (25181): Shared memory ID is 3
MERGE Data Link (25181): Memory mapping 402732 bytes
MERGE Data Link (25181): Shared memory segment located at address 0x7ffbe639a000.
MERGE Data Link (25181): File mapped object /SHM_11001 accessed
MERGE Data Link (25181): Shared memory ID is 3
MERGE Data Link (25181): Memory mapping 1073741824 bytes
MERGE Data Link (25181): Shared memory segment located at address 0x7ffba639a000.
MRGE Stats created and initialised
MERGE Data Link (25154): Starting the network interface
MERGE Data Link (25154): TCP socket receive buffer was 87380 - now 249856
MERGE Data Link (25154): TCP socket send buffer was 16384 - now 249856
MERGE Data Link (25154): MERGE Data Link using TCP port 11004.
MERGE Data Link (25154): Entering server loop
MERGE Data Link (25154): listening on port 11004
MERGE Data Link (25182): MIDAS MERGE Data Link Build Aug 12 2014
MERGE Data Link (25182): Started with args 31 11000 11032
MERGE Data Link (25182): Configuration: index = 31, SHM key=11000, TCP port = 11032
MERGE Data Link (25182): File mapped object /SHM_11000 accessed
MERGE Data Link (25182): Shared memory ID is 3
MERGE Data Link (25182): Memory mapping 402732 bytes
MERGE Data Link (25182): Shared memory segment located at address 0x7f2495805000.
MERGE Data Link (25182): File mapped object /SHM_11001 accessed
MERGE Data Link (25182): Shared memory ID is 3
MERGE Data Link (25182): Memory mapping 1073741824 bytes
MERGE Data Link (25182): Shared memory segment located at address 0x7f2455805000.
MRGE Stats created and initialised
MERGE Data Link (25167): Starting the network interface
MERGE Data Link (25167): TCP socket receive buffer was 87380 - now 249856
MERGE Data Link (25167): TCP socket send buffer was 16384 - now 249856
MERGE Data Link (25167): MERGE Data Link using TCP port 11017.
MERGE Data Link (25167): Entering server loop
MERGE Data Link (25167): listening on port 11017
MRGE Stats created and initialised
MERGE Data Link (25152): Starting the network interface
MERGE Data Link (25152): TCP socket receive buffer was 87380 - now 249856
MERGE Data Link (25152): TCP socket send buffer was 16384 - now 249856
MERGE Data Link (25152): MERGE Data Link using TCP port 11002.
MERGE Data Link (25152): Entering server loop
MERGE Data Link (25152): listening on port 11002
MRGE Stats created and initialised
MERGE Data Link (25169): Starting the network interface
MERGE Data Link (25169): TCP socket receive buffer was 87380 - now 249856
MERGE Data Link (25169): TCP socket send buffer was 16384 - now 249856
MERGE Data Link (25169): MERGE Data Link using TCP port 11019.
MERGE Data Link (25169): Entering server loop
MERGE Data Link (25169): listening on port 11019
MRGE Stats created and initialised
MERGE Data Link (25158): Starting the network interface
MERGE Data Link (25158): TCP socket receive buffer was 87380 - now 249856
MERGE Data Link (25158): TCP socket send buffer was 16384 - now 249856
MERGE Data Link (25158): MERGE Data Link using TCP port 11008.
MERGE Data Link (25158): Entering server loop
MERGE Data Link (25158): listening on port 11008
MRGE Stats created and initialised
MERGE Data Link (25166): Starting the network interface
MERGE Data Link (25166): TCP socket receive buffer was 87380 - now 249856
MERGE Data Link (25166): TCP socket send buffer was 16384 - now 249856
MERGE Data Link (25166): MERGE Data Link using TCP port 11016.
MERGE Data Link (25166): Entering server loop
MERGE Data Link (25166): listening on port 11016
MRGE Stats created and initialised
MERGE Data Link (25174): Starting the network interface
MERGE Data Link (25174): TCP socket receive buffer was 87380 - now 249856
MERGE Data Link (25174): TCP socket send buffer was 16384 - now 249856
MERGE Data Link (25174): MERGE Data Link using TCP port 11024.
MERGE Data Link (25174): Entering server loop
MERGE Data Link (25174): listening on port 11024
MRGE Stats created and initialised
MERGE Data Link (25175): Starting the network interface
MERGE Data Link (25175): TCP socket receive buffer was 87380 - now 249856
MERGE Data Link (25175): TCP socket send buffer was 16384 - now 249856
MERGE Data Link (25175): MERGE Data Link using TCP port 11025.
MERGE Data Link (25175): Entering server loop
MERGE Data Link (25175): listening on port 11025
MRGE Stats created and initialised
MERGE Data Link (25180): Starting the network interface
MERGE Data Link (25180): TCP socket receive buffer was 87380 - now 249856
MERGE Data Link (25180): TCP socket send buffer was 16384 - now 249856
MERGE Data Link (25180): MERGE Data Link using TCP port 11030.
MERGE Data Link (25180): Entering server loop
MERGE Data Link (25180): listening on port 11030
MRGE Stats created and initialised
MERGE Data Link (25179): Starting the network interface
MERGE Data Link (25179): TCP socket receive buffer was 87380 - now 249856
MERGE Data Link (25179): TCP socket send buffer was 16384 - now 249856
MERGE Data Link (25179): MERGE Data Link using TCP port 11029.
MERGE Data Link (25179): Entering server loop
MERGE Data Link (25179): listening on port 11029
MRGE Stats created and initialised
MERGE Data Link (25178): Starting the network interface
MERGE Data Link (25178): TCP socket receive buffer was 87380 - now 249856
MERGE Data Link (25178): TCP socket send buffer was 16384 - now 249856
MERGE Data Link (25178): MERGE Data Link using TCP port 11028.
MERGE Data Link (25178): Entering server loop
MERGE Data Link (25178): listening on port 11028
MRGE Stats created and initialised
MERGE Data Link (25161): Starting the network interface
MERGE Data Link (25161): TCP socket receive buffer was 87380 - now 249856
MERGE Data Link (25161): TCP socket send buffer was 16384 - now 249856
MERGE Data Link (25161): MERGE Data Link using TCP port 11011.
MERGE Data Link (25161): Entering server loop
MERGE Data Link (25161): listening on port 11011
MRGE Stats created and initialised
MERGE Data Link (25151): Starting the network interface
MERGE Data Link (25151): TCP socket receive buffer was 87380 - now 249856
MERGE Data Link (25151): TCP socket send buffer was 16384 - now 249856
MERGE Data Link (25151): MERGE Data Link using TCP port 11001.
MERGE Data Link (25151): Entering server loop
MERGE Data Link (25151): listening on port 11001
MRGE Stats created and initialised
MERGE Data Link (25182): Starting the network interface
MERGE Data Link (25182): TCP socket receive buffer was 87380 - now 249856
MERGE Data Link (25182): TCP socket send buffer was 16384 - now 249856
MERGE Data Link (25182): MERGE Data Link using TCP port 11032.
MERGE Data Link (25182): Entering server loop
MERGE Data Link (25182): listening on port 11032
MRGE Stats created and initialised
MERGE Data Link (25181): Starting the network interface
MERGE Data Link (25181): TCP socket receive buffer was 87380 - now 249856
MERGE Data Link (25181): TCP socket send buffer was 16384 - now 249856
MERGE Data Link (25181): MERGE Data Link using TCP port 11031.
MERGE Data Link (25181): Entering server loop
MERGE Data Link (25181): listening on port 11031
MRGE Stats created and initialised
MERGE Data Link (25156): Starting the network interface
MERGE Data Link (25156): TCP socket receive buffer was 87380 - now 249856
MERGE Data Link (25156): TCP socket send buffer was 16384 - now 249856
MERGE Data Link (25156): MERGE Data Link using TCP port 11006.
MERGE Data Link (25156): Entering server loop
MERGE Data Link (25156): listening on port 11006
MRGE Stats created and initialised
MERGE Data Link (25168): Starting the network interface
MERGE Data Link (25168): TCP socket receive buffer was 87380 - now 249856
MERGE Data Link (25168): TCP socket send buffer was 16384 - now 249856
MERGE Data Link (25168): MERGE Data Link using TCP port 11018.
MERGE Data Link (25168): Entering server loop
MERGE Data Link (25168): listening on port 11018
MRGE Stats created and initialised
MERGE Data Link (25173): Starting the network interface
MERGE Data Link (25173): TCP socket receive buffer was 87380 - now 249856
MERGE Data Link (25173): TCP socket send buffer was 16384 - now 249856
MERGE Data Link (25173): MERGE Data Link using TCP port 11023.
MERGE Data Link (25173): Entering server loop
... 317 more lines ...
  275   Sun Jun 5 01:20:39 2016 DK, AE, GL, PJWMerger wants first SYNC

Trying to start the AIDA DAQ now that the RI beam is (nearly) ready.  However, we cannot get merging to work.  But the merger status has "Merge State = GOing     :    paused     :    xfer enabled     :    want first SYNC"  but the last part ought to show "output paused" or after merge begins, "ready for SYNC".  We restarted the DAQ according to the procedure several times but this aspect of the messaging does not change, and the merging does not go live.

  610   Mon May 29 07:05:06 2017 TDMerger error messages and SEGV
Overnight and earlier today Obtained the following Merger error messages

Merge: Attempting resynchronisation to timestamp 26c3b4700056 or greater
Merge: Last sync pulse time: 26c3b46c00a0
Merge: Last timestamp seen: 26c3b4700055
Merge: Restarting at timestamp 26c3b47000a0
Merge: Timestamp (26c8062c00a0)[Q 5, Stream 5] is older than previous (26c8162bf81d) [Q 5, Stream 5]
Merge: Attempting resynchronisation to timestamp 26c8162bf81e or greater
Merge: Last sync pulse time: 26c8162800a0
Merge: Last timestamp seen: 26c8162bf81d
Merge: Restarting at timestamp 26c8162c00a0
Merge: Timestamp (26caa2109e35)[Q 5, Stream 5] is older than previous (26cab11e8415) [Q 5, Stream 5]
Merge: Attempting resynchronisation to timestamp 26cab11e8416 or greater
Merge: Last sync pulse time: 26cab11c00a0
Merge: Last timestamp seen: 26cab11e8415
Merge: Restarting at timestamp 26cab12000a0
Merge: Timestamp (26cbfe8400a0)[Q 5, Stream 5] is older than previous (26cc0e83f4e5) [Q 5, Stream 5]
Merge: Attempting resynchronisation to timestamp 26cc0e83f4e6 or greater
Merge: Last sync pulse time: 26cc0e8000a0
Merge: Last timestamp seen: 26cc0e83f4e5
Merge: Restarting at timestamp 26cc0e8400a0
Merge: Timestamp (26cf059000a0)[Q 5, Stream 5] is older than previous (26cf158ffb05) [Q 5, Stream 5]
Merge: Attempting resynchronisation to timestamp 26cf158ffb06 or greater
Merge: Last sync pulse time: 26cf158c00a0
Merge: Last timestamp seen: 26cf158ffb05
Merge: Restarting at timestamp 26cf159000a0
Merge: Timestamp (26cf899c00a0)[Q 5, Stream 5] is older than previous (26cf999bf9ad) [Q 5, Stream 5]
Merge: Attempting resynchronisation to timestamp 26cf999bf9ae or greater
Merge: Last sync pulse time: 26cf999800a0
Merge: Last timestamp seen: 26cf999bf9ad
Merge: Restarting at timestamp 26cf999c00a0
Merge: Timestamp (26dc07cac965)[Q 5, Stream 5] is older than previous (26dc16e6255d) [Q 5, Stream 5]
Merge: Attempting resynchronisation to timestamp 26dc16e6255e or greater
Merge: Last sync pulse time: 26dc16e400a0
Merge: Last timestamp seen: 26dc16e6255d
Merge: Restarting at timestamp 26dc16e800a0
Merge: Timestamp (26e035dac9cd)[Q 5, Stream 5] is older than previous (26e043cef5cd) [Q 5, Stream 5]
Merge: Attempting resynchronisation to timestamp 26e043cef5ce or greater
Merge: Last sync pulse time: 26e043cc00a0
Merge: Last timestamp seen: 26e043cef5cd
Merge: Restarting at timestamp 26e043d000a0
Merge: Timestamp (26e20f9000a0)[Q 5, Stream 5] is older than previous (26e21f8ffbdd) [Q 5, Stream 5]
Merge: Attempting resynchronisation to timestamp 26e21f8ffbde or greater
Merge: Last sync pulse time: 26e21f8c00a0
Merge: Last timestamp seen: 26e21f8ffbdd
Merge: Restarting at timestamp 26e21f9000a0
Merge: Timestamp (26e2817000a0)[Q 5, Stream 5] is older than previous (26e2916ffd25) [Q 5, Stream 5]

 :
 :
 :

This afternoon obtained the following error messages

MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Program (23229): check_for_data: index 6, unexpected header sequence number in pending data, found
787625409, last 27437
MERGE Program (23229): check_for_data: index 7, unexpected header sequence number in pending data, found
1814152641, last 82834
MERGE Data Link (23172): Received SEGV signal; exiting.
MERGE Server: Received signal 17.

Analysis of final two files of R33 - see attachments 1 & 2
Note idle time >> dead time (defined by PAUSE/RESUME) for nnaida5

Offline analysis R33_52 confirms ADC & disc data are synchronised - see attachments 3 & 4
Attachment 1: R33_51
 *** TDR format 3.3.0 analyser - TD - October 2016
 *** ERROR: READ I/O error:       5002
                   blocks:      11551
          ADC data format:   93349574 ( 1038435.7 Hz)
        Other data format:     895035 (    9956.5 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:         27 (       0.3 Hz)
                               RESUME:         27 (       0.3 Hz)
                              SYNC100:     820737 (    9130.0 Hz)
                           FEE64 disc:      74244 (     825.9 Hz)
                             MBS info:          0 (       0.0 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:       1092 (      12.1 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:       89.894 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  1                0.251                0.223
  2                0.065                0.000
  3                0.000                0.000
  4                0.000                0.000
  5                0.026                0.000
  6                0.007                4.983
  7                0.000                0.000
  8                0.000                0.000
  9                0.065                0.000
 10                0.000                0.000
 11                0.000                0.000
 12                0.000                0.000
 13                0.000                0.000
 14                0.000                0.000
 15                0.000                0.000
 16                0.000                0.000
 17                0.000                0.000
 18                0.031                0.000
 19                0.000                0.000
 20                0.009                0.000
 21                0.000                0.000
 22                0.000                0.000
 23                0.018                0.000
 24                0.023                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100       Disc        MBS      Other   HEC Data
  0          0          0          0          0          0          0          0          0          0          0          0
  1    9931066      37217          0          0          5          5      34185       3022          0          0        101
  2    7685025      38588          0          0          2          2      34262       4322          0          0          0
  3    2659776      37290          0          0          0          0      34284       3006          0          0          0
  4     736262      36738          0          0          0          0      34287       2451          0          0          3
  5    3771802      38043          0          0          5          5      34277       3756          0          0          0
  6    3593792      34786          0          0          2          2      32388       2394          0          0          1
  7    1055713      36749          0          0          0          0      34284       2465          0          0          9
  8     849108      37341          0          0          0          0      34282       3059          0          0         60
  9    7124329      36914          0          0          2          2      34260       2650          0          0          0
 10    8252837      38678          0          0          0          0      34286       4392          0          0          0
 11    1489705      37237          0          0          0          0      34283       2954          0          0          0
 12    1793276      36646          0          0          0          0      34284       2362          0          0          0
 13    2854363      37853          0          0          0          0      34285       3568          0          0          0
 14    3068885      36807          0          0          0          0      34283       2524          0          0        245
 15    2687159      37378          0          0          0          0      34282       3096          0          0          1
 16    2686667      36969          0          0          0          0      34288       2681          0          0          0
 17    2239560      36519          0          0          0          0      34287       2232          0          0          1
 18    6604207      38625          0          0          5          5      34269       4346          0          0          0
 19    4775544      38659          0          0          0          0      34280       4379          0          0          0
 20    3507053      36924          0          0          3          3      34282       2636          0          0        569
 21    3024115      38572          0          0          0          0      34282       4290          0          0         98
 22    3599466      36422          0          0          0          0      34287       2135          0          0          1
 23    4894276      36715          0          0          1          1      34276       2437          0          0          3
 24    4465588      37365          0          0          2          2      34274       3087          0          0          0
 25          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0

 *** Program elapsed time:    3.078s ( 3752.609 blocks/s, 234.538 Mb/s)
Attachment 2: R33_52
 *** TDR format 3.3.0 analyser - TD - October 2016
 *** ERROR: READ I/O error:       5002
                   blocks:      11551
          ADC data format:   93349574 ( 1038435.7 Hz)
        Other data format:     895035 (    9956.5 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:         27 (       0.3 Hz)
                               RESUME:         27 (       0.3 Hz)
                              SYNC100:     820737 (    9130.0 Hz)
                           FEE64 disc:      74244 (     825.9 Hz)
                             MBS info:          0 (       0.0 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:       1092 (      12.1 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:       89.894 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  1                0.251                0.223
  2                0.065                0.000
  3                0.000                0.000
  4                0.000                0.000
  5                0.026                0.000
  6                0.007                4.983
  7                0.000                0.000
  8                0.000                0.000
  9                0.065                0.000
 10                0.000                0.000
 11                0.000                0.000
 12                0.000                0.000
 13                0.000                0.000
 14                0.000                0.000
 15                0.000                0.000
 16                0.000                0.000
 17                0.000                0.000
 18                0.031                0.000
 19                0.000                0.000
 20                0.009                0.000
 21                0.000                0.000
 22                0.000                0.000
 23                0.018                0.000
 24                0.023                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100       Disc        MBS      Other   HEC Data
  0          0          0          0          0          0          0          0          0          0          0          0
  1    9931066      37217          0          0          5          5      34185       3022          0          0        101
  2    7685025      38588          0          0          2          2      34262       4322          0          0          0
  3    2659776      37290          0          0          0          0      34284       3006          0          0          0
  4     736262      36738          0          0          0          0      34287       2451          0          0          3
  5    3771802      38043          0          0          5          5      34277       3756          0          0          0
  6    3593792      34786          0          0          2          2      32388       2394          0          0          1
  7    1055713      36749          0          0          0          0      34284       2465          0          0          9
  8     849108      37341          0          0          0          0      34282       3059          0          0         60
  9    7124329      36914          0          0          2          2      34260       2650          0          0          0
 10    8252837      38678          0          0          0          0      34286       4392          0          0          0
 11    1489705      37237          0          0          0          0      34283       2954          0          0          0
 12    1793276      36646          0          0          0          0      34284       2362          0          0          0
 13    2854363      37853          0          0          0          0      34285       3568          0          0          0
 14    3068885      36807          0          0          0          0      34283       2524          0          0        245
 15    2687159      37378          0          0          0          0      34282       3096          0          0          1
 16    2686667      36969          0          0          0          0      34288       2681          0          0          0
 17    2239560      36519          0          0          0          0      34287       2232          0          0          1
 18    6604207      38625          0          0          5          5      34269       4346          0          0          0
 19    4775544      38659          0          0          0          0      34280       4379          0          0          0
 20    3507053      36924          0          0          3          3      34282       2636          0          0        569
 21    3024115      38572          0          0          0          0      34282       4290          0          0         98
 22    3599466      36422          0          0          0          0      34287       2135          0          0          1
 23    4894276      36715          0          0          1          1      34276       2437          0          0          3
 24    4465588      37365          0          0          2          2      34274       3087          0          0          0
 25          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0

 *** Program elapsed time:   11.207s ( 1030.692 blocks/s,  64.418 Mb/s)
Attachment 3: 11.png
11.png
Attachment 4: 12.png
12.png
  618   Wed May 31 16:43:52 2017 TDMerger & TapeServer server startup scripts modified
aidas1> cd /MIDAS/Merger/AIDA
aidas1> ls
GS_configuration   GS_configuration.BAK-030516  Startup~
GS_configuration~  Startup                      Startup.BAK-010617
aidas1> diff Startup Startup.BAK-010617
63,64c63
< # 1 June 2017 - increase sleep time from 1000000 (11.6 days) to 150000000 (4.75 years)
< sleep 150000000
---
> sleep 1000000
aidas1> cd /MIDAS/TapeServer/startup
aidas1> ls
AidaTapeServer  AidaTapeServer~  AidaTapeServer.BAK-010617
aidas1> diff AidaTapeServer AidaTapeServer.BAK-010617
24,26c24
< # 1 June 2017 - increase sleep time from 1000000 (11.6 days) to 150000000 (4.75 years)
< sleep 150000000
< 
---
> sleep 1000000
Attachment 1: Startup
#!/bin/bash

echo "Tidy up"
killall master64
killall link64
killall merge64.AD

echo "Starting Merge Server"

if [ "$MIDASBASE" = "" ]; then
export MIDASBASE=/MIDAS
fi

export PATH=${MIDASBASE}/Linux/bin64:${PATH}

if [ "$LD_LIBRARY_PATH" = "" ]; then
export LD_LIBRARY_PATH=${MIDASBASE}/Linux/lib64
else
export LD_LIBRARY_PATH=${MIDASBASE}/Linux/lib64:${LD_LIBRARY_PATH}
fi

#
#
#UM=`umask`
umask 0
#
#    load main data acquisition program
#    define netints and access registers
#    supply (non default) options
#
#
netstring TS_Server "localhost"
netstring TS2_Server ""
#netint DACQ_Swop 1
netint DACQ_TxInit 0
#
netint Output_BufferSize 64
netint Format_Option 4
netint Xfer_Option 3
netint Xfer_Overlap 0
netint Xfer_Priority 0
netint Merge_OutputAll 1
#

export MIDAS_MEMSAS_PORT=0

# Merge_OutputTrace : 1 - adc traces
# Merge_OutputTrace : 2 - raw traces
# Merge_OutputTrace : 3 - all traces
netint Merge_OutputTrace 1

export MIDASGSBASE=${MIDASBASE}/Merger/AIDA

cd ${MIDASBASE}/Merger
${MIDASBASE}/Merger/master64 &

#
#umask $UM
#
echo startup complete
#

# 1 June 2017 - increase sleep time from 1000000 (11.6 days) to 150000000 (4.75 years)
sleep 150000000



Attachment 2: AidaTapeServer
#!/bin/bash

echo "Tidy up"
killall master
killall stats
killall driver
killall linkTCP

echo "Starting Tape Server"

export MIDASBASE=/MIDAS

#
#
#UM=`umask`
umask 0
#

export MIDASTSBASE=${MIDASBASE}/TapeServer/Linux64

cd ${MIDASTSBASE}
./master &

# 1 June 2017 - increase sleep time from 1000000 (11.6 days) to 150000000 (4.75 years)
sleep 150000000


#
echo startup complete
#




  65   Wed Apr 22 07:28:25 2015 AE (PM)Mechanical setup instructions: AIDA+EURICA at F11
Attached are Paul Morrall's instructions on how to move new AIDA support table into place, for a setup with 
EURICA at F11 (March 2015).
Attachment 1: AIDA_procedure_document.docx
  312   Sun Jun 12 19:19:22 2016 DKMachine Time End

3:13 operators call to tell us the machine time is over.  No more EURICA!

          AIDA62_23 ought to be the last file with legitimate physics data

          We will leave the DAQ running overnight as a b/g run.

ELOG V3.1.3-7933898