AIDA GELINA BRIKEN nToF CRIB ISOLDE CIRCE nTOFCapture DESPEC DTAS EDI_PSA 179Ta CARME StellarModelling DCF K40
  AIDA, Page 29 of 46  ELOG logo
ID Date Author Subject
  359   Wed Sep 7 16:11:25 2016 Patrick Coleman-SmithUpdated layout.txt file in aidas1

Used the layout reported in ELOG357 and updated the layout.txt file used in the "Layout and Status" browser window.

The file is in /MIDAS/config/TclHttpd/aidas1

The browser window "Layout and Status" is accessed from the Control browser window.

It is intended to be used to determine if the Embedded Linux is operating in the FEE64. Each FEE64 in the layout.txt file is pinged with a timeout of 1 second. The layout then shows red for no response and green for a response.

  358   Mon Sep 5 06:54:02 2016 TDMonday 5 September
14.20 R17 continues

      DSSSD bias/leakage current OK - see attachments 1-2
      FEE64 temperatures OK - see attachment 3

      System-wide checks OK *except* nnaida19 fails ASIC timestamp check (no change)

      No merger error messages

     AIDA SYNC, PAUSE, RESUME, Correlation L, SYNC time warp, Good Events, AIDA disc, nnaida6, nnaida5 &
nnaida20 statistics - see attachments 4-14

     Analysis of R17_584 - FEE64 data synaidas1> ./analyser2 /TapeData/Aug2016/R17_584
 *** GREAT format 3.2.0 analyser - TD - May 2014
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  258868072 ( 1733415.6 Hz)
        Other data format:    2219928 (   14864.9 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:         94 (       0.6 Hz)
                               RESUME:         94 (       0.6 Hz)
                              SYNC100:    1365786 (    9145.5 Hz)
                           FEE64 disc:     842248 (    5639.8 Hz)
                             MBS info:      11706 (      78.4 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:        400 (       2.7 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 Timestamp elapsed time:      149.340 s
 FEE module #:   1 elapsed dead time       0.000 s
 FEE module #:   2 elapsed dead time       0.026 s
 FEE module #:   3 elapsed dead time       0.007 s
 FEE module #:   4 elapsed dead time       0.000 s
 FEE module #:   5 elapsed dead time       0.439 s
 FEE module #:   6 elapsed dead time       0.329 s
 FEE module #:   7 elapsed dead time       0.000 s
 FEE module #:   8 elapsed dead time       0.000 s
 FEE module #:   9 elapsed dead time       0.104 s
 FEE module #:  10 elapsed dead time       0.000 s
 FEE module #:  11 elapsed dead time       0.000 s
 FEE module #:  12 elapsed dead time       0.001 s
 FEE module #:  13 elapsed dead time       0.515 s
 FEE module #:  14 elapsed dead time       0.290 s
 FEE module #:  15 elapsed dead time       0.078 s
 FEE module #:  16 elapsed dead time       0.036 s
 FEE module #:  17 elapsed dead time       0.379 s
 FEE module #:  18 elapsed dead time       0.044 s
 FEE module #:  19 elapsed dead time       0.122 s
 FEE module #:  20 elapsed dead time       0.063 s
 FEE module #:  21 elapsed dead time       0.218 s
 FEE module #:  22 elapsed dead time       0.467 s
 FEE module #:  23 elapsed dead time       0.232 s
 FEE module #:  24 elapsed dead time       0.059 s
 FEE module #:  25 elapsed dead time       0.000 s
 FEE module #:  26 elapsed dead time       0.000 s
 FEE module #:  27 elapsed dead time       0.000 s
 FEE module #:  28 elapsed dead time       0.000 s
 FEE module #:  29 elapsed dead time       0.000 s
 FEE module #:  30 elapsed dead time       0.000 s
 FEE module #:  31 elapsed dead time       0.000 s
 FEE module #:  32 elapsed dead time       0.000 s

 *** Program elapsed time:   26.172s ( 1222.687 blocks/s,  76.418 Mb/s)
chronised - see attachment 16

aidas1> ./analyser2 /TapeData/Aug2016/R17_584
 *** GREAT format 3.2.0 analyser - TD - May 2014
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  258868072 ( 1733415.6 Hz)
        Other data format:    2219928 (   14864.9 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:         94 (       0.6 Hz)
                               RESUME:         94 (       0.6 Hz)
                              SYNC100:    1365786 (    9145.5 Hz)
                           FEE64 disc:     842248 (    5639.8 Hz)
                             MBS info:      11706 (      78.4 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:        400 (       2.7 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 Timestamp elapsed time:      149.340 s
 FEE module #:   1 elapsed dead time       0.000 s
 FEE module #:   2 elapsed dead time       0.026 s
 FEE module #:   3 elapsed dead time       0.007 s
 FEE module #:   4 elapsed dead time       0.000 s
 FEE module #:   5 elapsed dead time       0.439 s
 FEE module #:   6 elapsed dead time       0.329 s
 FEE module #:   7 elapsed dead time       0.000 s
 FEE module #:   8 elapsed dead time       0.000 s
 FEE module #:   9 elapsed dead time       0.104 s
 FEE module #:  10 elapsed dead time       0.000 s
 FEE module #:  11 elapsed dead time       0.000 s
 FEE module #:  12 elapsed dead time       0.001 s
 FEE module #:  13 elapsed dead time       0.515 s
 FEE module #:  14 elapsed dead time       0.290 s
 FEE module #:  15 elapsed dead time       0.078 s
 FEE module #:  16 elapsed dead time       0.036 s
 FEE module #:  17 elapsed dead time       0.379 s
 FEE module #:  18 elapsed dead time       0.044 s
 FEE module #:  19 elapsed dead time       0.122 s
 FEE module #:  20 elapsed dead time       0.063 s
 FEE module #:  21 elapsed dead time       0.218 s
 FEE module #:  22 elapsed dead time       0.467 s
 FEE module #:  23 elapsed dead time       0.232 s
 FEE module #:  24 elapsed dead time       0.059 s
 FEE module #:  25 elapsed dead time       0.000 s
 FEE module #:  26 elapsed dead time       0.000 s
 FEE module #:  27 elapsed dead time       0.000 s
 FEE module #:  28 elapsed dead time       0.000 s
 FEE module #:  29 elapsed dead time       0.000 s
 FEE module #:  30 elapsed dead time       0.000 s
 FEE module #:  31 elapsed dead time       0.000 s
 FEE module #:  32 elapsed dead time       0.000 s

 *** Program elapsed time:   26.172s ( 1222.687 blocks/s,  76.418 Mb/s)

15.08 R17 stops

Detector bias OFF
FEE64 power OFF 
USB-controlled ac mains relay OFF
Julabo FL11006 recirculating chiller OFF
ac mains cables to ac mains distributor disconnected
network cables aida1 and aida2 disconnected, rolled up and secured to stairwell rails

207Bi source removed and returned to B2F/F11 storage location
Attachment 1: 1.png
1.png
Attachment 2: 2.png
2.png
Attachment 3: 3.png
3.png
Attachment 4: 4.png
4.png
Attachment 5: 5.png
5.png
Attachment 6: 6.png
6.png
Attachment 7: 7.png
7.png
Attachment 8: 8.png
8.png
Attachment 9: 9.png
9.png
Attachment 10: 10.png
10.png
Attachment 11: 11.png
11.png
Attachment 12: 12.png
12.png
Attachment 13: 13.png
13.png
Attachment 14: 14.png
14.png
Attachment 15: 15.png
15.png
Attachment 16: 16.png
16.png
  357   Sun Sep 4 04:35:42 2016 TDFEE64 & MACB configuration


                                                   UP
                                       nnaida1  nnaida9   nnaida17
LEFT                                   nnaida2  nnaida10  nnaida18                                   RIGHT
          nnaida23  nnaida15  nnaida7                               nnaida3   nnaida11  nnaida19
          nnaida24  nnaida16  nnaida8                               nnaida4   nnaida12  nnaida20
                                       nnaida5  nnaida13  nnaida21
                                       nnaida6  nnaida14  nnaida22
                                                  DOWN

                                           <LOOKING UPSTREAM>

LEFT-RIGHT n+n ohmic strips
UP-DOWN    p+n junction strips


    1     2     3     4     5     6     7     8     9    10    11    MACB NIM Module #   spare 1  spare 2

        <- #1 <- #2 <- #2 <- #2 <- #2 <- #1 <- #7 <- #7 <- #7 <- #7  Next

  -> #2 -> #3   6*   21     7    23   -> #8   1    17     3    19    Port 1
  -> #7 -> #4   5    22     8    24   -> #9   2    18     4    20    Port 2
        -> #5  13    29    15    31   -> #10  9    25    11    27    Port 3
        -> #6  14    30    16    32   -> #11 10    26    12    28    Port 4

    **    2     2     3     3     3     3     3     3     3     3    Mode
          y     y                                                    Rev B                        y

* = Master Timestamp FEE64

** MACB (rev A serial #13 mode 5) external 50MHz clock
   or
   MACB (rev B serial #11 mode 0) internal 50MHz cloxk

MACB HDMI cabling mechanically secured by 1U cable organiser above MACB NIM bin and by AIDA frame
- see attachments 1-3
Attachment 1: IMG_6502.JPG
IMG_6502.JPG
Attachment 2: IMG_6503.JPG
IMG_6503.JPG
Attachment 3: IMG_6504.JPG
IMG_6504.JPG
  356   Sun Sep 4 04:26:23 2016 TDSunday 4 September
14.20 R13 continues

      DSSSD bias/leakage current OK - see attachments 1-2
      FEE64 temperatures OK - see attachment 3

      System-wide checks OK *except* nnaida19 fails ASIC timestamp check (no change)

      Merger errors messages for Q 19 - see attachment 4

     AIDA SYNC, PAUSE, RESUME, Correlation L, SYNC time warp, Good Events, AIDA disc, nnaida6, nnaida5 &
nnaida20 statistics - see attachments 6-16

     Analysis of R16_331 - FEE64 data synchronised - see attachment 17

aidas1> ./analyser2 /TapeData/Aug2016/R16_331
 *** GREAT format 3.2.0 analyser - TD - May 2014
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  182657196 ( 1048839.0 Hz)
        Other data format:   78430804 (  450358.8 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:         94 (       0.5 Hz)
                               RESUME:         95 (       0.5 Hz)
                              SYNC100:    1591884 (    9140.8 Hz)
                           FEE64 disc:   76825108 (  441138.8 Hz)
                             MBS info:      13623 (      78.2 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:       4398 (      25.3 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 Timestamp elapsed time:      174.152 s

 FEE module #:   1 elapsed dead time       0.189 s
 FEE module #:   2 elapsed dead time       0.705 s
 FEE module #:   3 elapsed dead time       0.000 s
 FEE module #:   4 elapsed dead time       0.000 s
 FEE module #:   5 elapsed dead time       3.321 s
 FEE module #:   6 elapsed dead time       0.467 s
 FEE module #:   7 elapsed dead time       0.000 s
 FEE module #:   8 elapsed dead time       0.000 s
 FEE module #:   9 elapsed dead time       0.124 s
 FEE module #:  10 elapsed dead time       0.000 s
 FEE module #:  11 elapsed dead time       0.000 s
 FEE module #:  12 elapsed dead time       0.000 s
 FEE module #:  13 elapsed dead time       0.284 s
 FEE module #:  14 elapsed dead time       0.035 s
 FEE module #:  15 elapsed dead time       0.000 s
 FEE module #:  16 elapsed dead time       0.000 s
 FEE module #:  17 elapsed dead time       0.684 s
 FEE module #:  18 elapsed dead time       0.012 s
 FEE module #:  19 elapsed dead time       0.000 s
 FEE module #:  20 elapsed dead time       0.000 s
 FEE module #:  21 elapsed dead time       0.000 s
 FEE module #:  22 elapsed dead time       0.158 s
 FEE module #:  23 elapsed dead time       0.000 s
 FEE module #:  24 elapsed dead time       0.000 s
 FEE module #:  25 elapsed dead time       0.000 s
 FEE module #:  26 elapsed dead time       0.000 s
 FEE module #:  27 elapsed dead time       0.000 s
 FEE module #:  28 elapsed dead time       0.000 s
 FEE module #:  29 elapsed dead time       0.000 s
 FEE module #:  30 elapsed dead time       0.000 s
 FEE module #:  31 elapsed dead time       0.000 s
 FEE module #:  32 elapsed dead time       0.000 s

 *** Program elapsed time:   27.594s ( 1159.683 blocks/s,  72.480 Mb/s)


14.29 R16 stops


15.30 Noise measurements
      Found incorrect test pulse polarity connected to p+n and n+n FEE64s - corrected - see attachment 18

DSSSD #1 FEE64s, shaping time(us) versus pulser peak widths ch FWHM

      17  22  20  23 spectrum 1.8.L 
0.5  180 202 130 104
1    147 177 121 128
2    110 164 116 128
2.5   97 154 103 131
3.5   82 123  93 110
4.5   75 105  88 104
5.5   71  93  86  99
6     71  90  84  97
6.5   69  91  87  94
7     70  87  80  94
7.5   70  84  86  93
8     71  87  87  92
      
      System-wide checks OK *except* nnaida19 fails ASIC timestamp check (no change)

16.26 R17 starts
      Pulser + 207Bi source

      ASIC settings 2016Sep02-18.17.01
      Discriminator masks -> 0-31 0x0 32-63 0x800000
      Correlation scaler trigger delay 0x180 -> 0x5
      Slow comparator 0x8

      Analysis of R17_0 - FEE64 data synchronised - see attachment 19

      top - attachment 20
      merger 1.9M items/s tapeserver 15Mb/s
Attachment 1: 1.png
1.png
Attachment 2: 2.png
2.png
Attachment 3: 3.png
3.png
Attachment 4: 4.png
4.png
Attachment 5: 5.png
5.png
Attachment 6: 6#.png
6#.png
Attachment 7: 7.png
7.png
Attachment 8: 8.png
8.png
Attachment 9: 9.png
9.png
Attachment 10: 10.png
10.png
Attachment 11: 11.png
11.png
Attachment 12: 12.png
12.png
Attachment 13: 13.png
13.png
Attachment 14: 16.png
16.png
Attachment 15: 17.png
17.png
Attachment 16: 19.png
19.png
Attachment 17: 20.png
20.png
Attachment 18: 40.png
40.png
Attachment 19: 41.png
41.png
Attachment 20: 42.png
42.png
  355   Sat Sep 3 05:54:14 2016 TDSaturday 3 September
14.20 R13 continues

      DSSSD bias/leakage current OK - see attachments 1-2
      FEE64 temperatures OK - see attachment 3

      System-wide checks OK *except* nnaida19 fails ASIC timestamp check (no change)

      Merger errors messages for Q 19 - see attachment 4

     AIDA SYNC, PAUSE, RESUME, Correlation L, SYNC time warp, Good Events, AIDA disc, nnaida6, nnaida5 &
nnaida20 statistics - see attachments 5-15

     Analysis of R13_317 - FEE64 data synchronised - see attachment 16

aidas1> ./analyser2 /TapeData/Aug2016/R13_317
 *** GREAT format 3.2.0 analyser - TD - May 2014
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  107206849 (  490913.0 Hz)
        Other data format:  153881151 (  704640.2 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:        134 (       0.6 Hz)
                               RESUME:        134 (       0.6 Hz)
                              SYNC100:    1997059 (    9144.8 Hz)
                           FEE64 disc:  151882150 (  695486.5 Hz)
                             MBS info:       1674 (       7.7 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:       1095 (       5.0 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 Timestamp elapsed time:      218.383 s
 FEE module #:   1 elapsed dead time       0.437 s
 FEE module #:   2 elapsed dead time       0.298 s
 FEE module #:   3 elapsed dead time       0.000 s
 FEE module #:   4 elapsed dead time       0.000 s
 FEE module #:   5 elapsed dead time       2.671 s
 FEE module #:   6 elapsed dead time       1.429 s
 FEE module #:   7 elapsed dead time       0.000 s
 FEE module #:   8 elapsed dead time       0.000 s
 FEE module #:   9 elapsed dead time       0.000 s
 FEE module #:  10 elapsed dead time       0.000 s
 FEE module #:  11 elapsed dead time       0.000 s
 FEE module #:  12 elapsed dead time       0.000 s
 FEE module #:  13 elapsed dead time       0.000 s
 FEE module #:  14 elapsed dead time       0.129 s
 FEE module #:  15 elapsed dead time       0.000 s
 FEE module #:  16 elapsed dead time       0.000 s
 FEE module #:  17 elapsed dead time       0.010 s
 FEE module #:  18 elapsed dead time       0.000 s
 FEE module #:  19 elapsed dead time       0.392 s
 FEE module #:  20 elapsed dead time       0.000 s
 FEE module #:  21 elapsed dead time       0.000 s
 FEE module #:  22 elapsed dead time       0.021 s
 FEE module #:  23 elapsed dead time       0.000 s
 FEE module #:  24 elapsed dead time       0.000 s
 FEE module #:  25 elapsed dead time       0.000 s
 FEE module #:  26 elapsed dead time       0.000 s
 FEE module #:  27 elapsed dead time       0.000 s
 FEE module #:  28 elapsed dead time       0.000 s
 FEE module #:  29 elapsed dead time       0.000 s
 FEE module #:  30 elapsed dead time       0.000 s
 FEE module #:  31 elapsed dead time       0.000 s
 FEE module #:  32 elapsed dead time       0.000 s

 *** Program elapsed time:   19.699s ( 1624.430 blocks/s, 101.527 Mb/s)

18.30 HDMI cabling to NIM MACB modules mechanically secured by 1U 'cable organiser' installed above MACB NIM bin
and by AIDA stand frame
  
      ALL system-wide checks OK *except* nnaida19 fails ASIC timestamp check (no change)

18.55 R16 starts

      ASIC settings 2016Sep02-18.17.01
      Discriminator masks -> 0x0
      Correlation scaler trigger delay 0x180 -> 0x5

      Analysis of R16_0 - FEE64 data synchronised
Attachment 1: 1.png
1.png
Attachment 2: 2.png
2.png
Attachment 3: 3.png
3.png
Attachment 4: 4.png
4.png
Attachment 5: 5.png
5.png
Attachment 6: 6.png
6.png
Attachment 7: 7.png
7.png
Attachment 8: 8.png
8.png
Attachment 9: 9.png
9.png
Attachment 10: 10.png
10.png
Attachment 11: 12.png
12.png
Attachment 12: 13.png
13.png
Attachment 13: 14.png
14.png
Attachment 14: 15.png
15.png
Attachment 15: 17.png
17.png
Attachment 16: 20.png
20.png
  354   Fri Sep 2 06:22:26 2016 TDFriday 2 September
14.20 R11 continues

      DSSSD bias/leakage current OK - see attachments 1-2
      FEE64 temperatures OK - see attachment 3

      System-wide checks OK *except* nnaida19 fails ASIC timestamp check (no change)
      Free memory - see attachment 4

      Merger errors messages for links 4 & 5 - see attachment 5

     AIDA SYNC, PAUSE, RESUME, Correlation L, SYNC time warp, Good Events, AIDA disc, nnaida6, nnaida5 &
nnaida20 statistics - see 
attachments 6-16

Analysis of R11_645 - FEE64 data synchronised - see attachment 17

aidas1> ./analyser2 /TapeData/Aug2016/R11_645
 *** GREAT format 3.2.0 analyser - TD - May 2014
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  156678476 ( 1098367.0 Hz)
        Other data format:  104409524 (  731944.6 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:         92 (       0.6 Hz)
                               RESUME:         92 (       0.6 Hz)
                              SYNC100:    1303563 (    9138.4 Hz)
                           FEE64 disc:  103104691 (  722797.4 Hz)
                             MBS info:       1086 (       7.6 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:        650 (       4.6 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 Timestamp elapsed time:      142.647 s
 FEE module #:   1 elapsed dead time       0.186 s
 FEE module #:   2 elapsed dead time       0.427 s
 FEE module #:   3 elapsed dead time       0.000 s
 FEE module #:   4 elapsed dead time       0.000 s
 FEE module #:   5 elapsed dead time       1.001 s
 FEE module #:   6 elapsed dead time       3.508 s
 FEE module #:   7 elapsed dead time       0.000 s
 FEE module #:   8 elapsed dead time       0.000 s
 FEE module #:   9 elapsed dead time       0.053 s
 FEE module #:  10 elapsed dead time       0.000 s
 FEE module #:  11 elapsed dead time       0.000 s
 FEE module #:  12 elapsed dead time       0.000 s
 FEE module #:  13 elapsed dead time       0.100 s
 FEE module #:  14 elapsed dead time       0.164 s
 FEE module #:  15 elapsed dead time       0.000 s
 FEE module #:  16 elapsed dead time       0.000 s
 FEE module #:  17 elapsed dead time       0.264 s
 FEE module #:  18 elapsed dead time       0.000 s
 FEE module #:  19 elapsed dead time       0.000 s
 FEE module #:  20 elapsed dead time       0.000 s
 FEE module #:  21 elapsed dead time       0.028 s
 FEE module #:  22 elapsed dead time       0.171 s
 FEE module #:  23 elapsed dead time       0.000 s
 FEE module #:  24 elapsed dead time       0.000 s
 FEE module #:  25 elapsed dead time       0.000 s
 FEE module #:  26 elapsed dead time       0.000 s
 FEE module #:  27 elapsed dead time       0.000 s
 FEE module #:  28 elapsed dead time       0.000 s
 FEE module #:  29 elapsed dead time       0.000 s
 FEE module #:  30 elapsed dead time       0.000 s
 FEE module #:  31 elapsed dead time       0.000 s
 FEE module #:  32 elapsed dead time       0.000 s

 *** Program elapsed time:   15.730s ( 2034.269 blocks/s, 127.142 Mb/s)

14.54 R11 stopped (two DAQ STOP commands required)

15.00 New firmware version 8.24 installed (/MIDAS/Aida/FEE_GF_Feb16_24.bin) 
      - guarantee SYNC is the last data item with timestamp ending 0x000000A0 to be output (merger assumes this)
      - ASIC clock runs when output disabled (ASIC requires periodic reset)

18.40 R13 starts

      ASIC settings 2016Sep02-18.17.01
      Discriminator masks -> 0x0
      Correlation scaler trigger delay 0x180 -> 0x5
Attachment 1: 1.png
1.png
Attachment 2: 2.png
2.png
Attachment 3: 3.png
3.png
Attachment 4: 4.png
4.png
Attachment 5: 5.png
5.png
Attachment 6: 6.png
6.png
Attachment 7: 7.png
7.png
Attachment 8: 8.png
8.png
Attachment 9: 9.png
9.png
Attachment 10: 10.png
10.png
Attachment 11: 11.png
11.png
Attachment 12: 12.png
12.png
Attachment 13: 13.png
13.png
Attachment 14: 14.png
14.png
Attachment 15: 20.png
20.png
Attachment 16: 21.png
21.png
Attachment 17: 22.png
22.png
  353   Thu Sep 1 03:45:34 2016 TDThursday 1 September
13.33 R11 starts

      ASIC settings 2016Aug20-15.34.53
      Discriminator masks -> 0x0
      Slow comparator 0x10
      LEC/MEC fast comparator 0xff
      From Correlation Status & Control tab change Trigger delay 0x180

      BNC PB-4 Pulser
      Amplitude 90,000
      x5 attenuator IN
      t_r 50ns tau_d 50us 
      - polarity
      INT ref, delay MIN, tail pulse
      Frequency c. 5Hz

      B2F/F11 temp +24.8 deg C, d.p. +11.9 deg C, RH 44.8%

      DSSSD bias/leakage current OK - see attachments 1-2
      FEE64 temperatures OK - see attachment 3

      System-wide checks OK - see attachments 4-9

      AIDA SYNC, PAUSE, RESUME, Correlation L, SYNC time warp, Good Events, AIDA disc, nnaida6, nnaida5 & nnaida20 statistics - see 
attachments 10-20
      Good event rate varies from 5-320k / FEE64

      Merger/tapeserver - see attachments 21-22
      Merged data rate ~2-3M data items/s, c. 16M to disk 

Analysis of R11_93 - FEE64 data synchronised - see attachment 23

aidas1> ./analyser2 /TapeData/Aug2016/R11_93
 *** GREAT format 3.2.0 analyser - TD - May 2014
 ***            ADC data: block:  3402 ptr: 15985 data: 0xC4C37FDB module: 19 fail: 0 range: 0 id:  1219 channel:  3 adc: 32731  ts:
0x00000120C00000A0 OLD: ts: 0x00000120D000008D tag: 3 type: 0
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  170966247 ( 1387907.5 Hz)
        Other data format:   90121753 (  731610.3 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:        106 (       0.9 Hz)
                               RESUME:        106 (       0.9 Hz)
                              SYNC100:    1124303 (    9127.1 Hz)
                           FEE64 disc:   88996299 (  722473.8 Hz)
                             MBS info:        939 (       7.6 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:        571 (       4.6 Hz)

                Timewarps:        ADC:          1 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 Timestamp elapsed time:      123.183 s
 FEE module #:   1 elapsed dead time       0.370 s
 FEE module #:   2 elapsed dead time       0.317 s
 FEE module #:   3 elapsed dead time       0.000 s
 FEE module #:   4 elapsed dead time       0.000 s
 FEE module #:   5 elapsed dead time       1.058 s
 FEE module #:   6 elapsed dead time       2.581 s
 FEE module #:   7 elapsed dead time       0.000 s
 FEE module #:   8 elapsed dead time       0.000 s
 FEE module #:   9 elapsed dead time       0.130 s
 FEE module #:  10 elapsed dead time       0.000 s
 FEE module #:  11 elapsed dead time       0.000 s
 FEE module #:  12 elapsed dead time       0.000 s
 FEE module #:  13 elapsed dead time       1.078 s
 FEE module #:  14 elapsed dead time       0.172 s
 FEE module #:  15 elapsed dead time       0.000 s
 FEE module #:  16 elapsed dead time       0.000 s
 FEE module #:  17 elapsed dead time       0.223 s
 FEE module #:  18 elapsed dead time       0.017 s
 FEE module #:  19 elapsed dead time       0.089 s
 FEE module #:  20 elapsed dead time       0.000 s
 FEE module #:  21 elapsed dead time       2.291 s
 FEE module #:  22 elapsed dead time       0.450 s
 FEE module #:  23 elapsed dead time       0.000 s
 FEE module #:  24 elapsed dead time       0.000 s
 FEE module #:  25 elapsed dead time       0.000 s
 FEE module #:  26 elapsed dead time       0.000 s
 FEE module #:  27 elapsed dead time       0.000 s
 FEE module #:  28 elapsed dead time       0.000 s
 FEE module #:  29 elapsed dead time       0.000 s
 FEE module #:  30 elapsed dead time       0.000 s
 FEE module #:  31 elapsed dead time       0.000 s
 FEE module #:  32 elapsed dead time       0.000 s

 *** Program elapsed time:   21.035s ( 1521.263 blocks/s,  95.079 Mb/s)

Verbose data dump around time warp (file R11_93, block 3402, ptr 15985)

 ***            ADC data: block:  3402 ptr: 15901 data: 0xC5777559 module: 21 fail: 0 range: 0 id:  1399 channel: 55 adc: 30041  ts:
0x00000120CFFFF895
 *** FEE64 discriminator: block:  3402 ptr: 15903 data: 0x85640080 module:  5 information type:  6 information field: 0x00040080 ts:
0x00000120CFFFF895
 ***            ADC data: block:  3402 ptr: 15905 data: 0xC17A793F module:  5 fail: 0 range: 0 id:   378 channel: 58 adc: 31039  ts:
0x00000120CFFFF895
 *** FEE64 discriminator: block:  3402 ptr: 15907 data: 0x86640080 module:  6 information type:  6 information field: 0x00040080 ts:
0x00000120CFFFF898
 *** FEE64 discriminator: block:  3402 ptr: 15909 data: 0x82640080 module:  2 information type:  6 information field: 0x00040080 ts:
0x00000120CFFFF89A
 *** FEE64 discriminator: block:  3402 ptr: 15911 data: 0x81640080 module:  1 information type:  6 information field: 0x00040080 ts:
0x00000120CFFFF89B
 ***            ADC data: block:  3402 ptr: 15913 data: 0xC5018140 module: 20 fail: 0 range: 0 id:  1281 channel:  1 adc: 33088  ts:
0x00000120CFFFF8D5
 ***            ADC data: block:  3402 ptr: 15915 data: 0xC3617FA1 module: 13 fail: 0 range: 0 id:   865 channel: 33 adc: 32673  ts:
0x00000120CFFFF92D
 ***            ADC data: block:  3402 ptr: 15917 data: 0xC5417DDE module: 21 fail: 0 range: 0 id:  1345 channel:  1 adc: 32222  ts:
0x00000120CFFFF95D
 ***            ADC data: block:  3402 ptr: 15919 data: 0xC57A7D7B module: 21 fail: 0 range: 0 id:  1402 channel: 58 adc: 32123  ts:
0x00000120CFFFF95D
 ***            ADC data: block:  3402 ptr: 15921 data: 0xC3687F55 module: 13 fail: 0 range: 0 id:   872 channel: 40 adc: 32597  ts:
0x00000120CFFFF9F5
 *** FEE64 discriminator: block:  3402 ptr: 15923 data: 0x85640080 module:  5 information type:  6 information field: 0x00040080 ts:
0x00000120CFFFFB5B
 *** FEE64 discriminator: block:  3402 ptr: 15925 data: 0x86640080 module:  6 information type:  6 information field: 0x00040080 ts:
0x00000120CFFFFB5C
 *** FEE64 discriminator: block:  3402 ptr: 15927 data: 0x82640080 module:  2 information type:  6 information field: 0x00040080 ts:
0x00000120CFFFFB5F
 ***            ADC data: block:  3402 ptr: 15929 data: 0xC35F7DAD module: 13 fail: 0 range: 0 id:   863 channel: 31 adc: 32173  ts:
0x00000120CFFFFB85
 ***            ADC data: block:  3402 ptr: 15931 data: 0xC3307F91 module: 12 fail: 0 range: 0 id:   816 channel: 48 adc: 32657  ts:
0x00000120CFFFFBB5
 ***            ADC data: block:  3402 ptr: 15933 data: 0xC5A67F6D module: 22 fail: 0 range: 0 id:  1446 channel: 38 adc: 32621  ts:
0x00000120CFFFFBDD
 ***            ADC data: block:  3402 ptr: 15935 data: 0xC0C0845E module:  3 fail: 0 range: 0 id:   192 channel:  0 adc: 33886  ts:
0x00000120CFFFFC35
 ***            ADC data: block:  3402 ptr: 15937 data: 0xC3657ED9 module: 13 fail: 0 range: 0 id:   869 channel: 37 adc: 32473  ts:
0x00000120CFFFFC4D
 *** FEE64 discriminator: block:  3402 ptr: 15939 data: 0x85640080 module:  5 information type:  6 information field: 0x00040080 ts:
0x00000120CFFFFC77
 *** FEE64 discriminator: block:  3402 ptr: 15941 data: 0x86640080 module:  6 information type:  6 information field: 0x00040080 ts:
0x00000120CFFFFC7A
 *** FEE64 discriminator: block:  3402 ptr: 15943 data: 0x81640080 module:  1 information type:  6 information field: 0x00040080 ts:
0x00000120CFFFFC7C
 *** FEE64 discriminator: block:  3402 ptr: 15945 data: 0x82640080 module:  2 information type:  6 information field: 0x00040080 ts:
0x00000120CFFFFC7C
 ***            ADC data: block:  3402 ptr: 15947 data: 0xC4DC8041 module: 19 fail: 0 range: 0 id:  1244 channel: 28 adc: 32833  ts:
0x00000120CFFFFCB8
 *** FEE64 discriminator: block:  3402 ptr: 15949 data: 0x85640080 module:  5 information type:  6 information field: 0x00040080 ts:
0x00000120CFFFFCC6
 ***            ADC data: block:  3402 ptr: 15951 data: 0xC38C7EF8 module: 14 fail: 0 range: 0 id:   908 channel: 12 adc: 32504  ts:
0x00000120CFFFFD3D
 ***            ADC data: block:  3402 ptr: 15953 data: 0xC4817ED8 module: 18 fail: 0 range: 0 id:  1153 channel:  1 adc: 32472  ts:
0x00000120CFFFFD85
 ***            ADC data: block:  3402 ptr: 15955 data: 0xC3577EE4 module: 13 fail: 0 range: 0 id:   855 channel: 23 adc: 32484  ts:
0x00000120CFFFFDDD
 ***            ADC data: block:  3402 ptr: 15957 data: 0xC1B67F41 module:  6 fail: 0 range: 0 id:   438 channel: 54 adc: 32577  ts:
0x00000120CFFFFE35
 *** FEE64 discriminator: block:  3402 ptr: 15959 data: 0x85640080 module:  5 information type:  6 information field: 0x00040080 ts:
0x00000120CFFFFF44
 ***            ADC data: block:  3402 ptr: 15961 data: 0xC5517FCD module: 21 fail: 0 range: 0 id:  1361 channel: 17 adc: 32717  ts:
0x00000120CFFFFF9D
 ***            ADC data: block:  3402 ptr: 15963 data: 0xC5957FEA module: 22 fail: 0 range: 0 id:  1429 channel: 21 adc: 32746  ts:
0x00000120CFFFFFC5
 ***            ADC data: block:  3402 ptr: 15965 data: 0xC5B37E90 module: 22 fail: 0 range: 0 id:  1459 channel: 51 adc: 32400  ts:
0x00000120CFFFFFC5
 *** FEE64 discriminator: block:  3402 ptr: 15967 data: 0x85640080 module:  5 information type:  6 information field: 0x00040080 ts:
0x00000120CFFFFFD9
 ***            ADC data: block:  3402 ptr: 15969 data: 0xC4B77FCE module: 18 fail: 0 range: 0 id:  1207 channel: 55 adc: 32718  ts:
0x00000120CFFFFFDD
 ***            ADC data: block:  3402 ptr: 15971 data: 0xC5047FBE module: 20 fail: 0 range: 0 id:  1284 channel:  4 adc: 32702  ts:
0x00000120CFFFFFDD
 ***            ADC data: block:  3402 ptr: 15973 data: 0xC3627FFD module: 13 fail: 0 range: 0 id:   866 channel: 34 adc: 32765  ts:
0x00000120D0000035
 *** FEE64 discriminator: block:  3402 ptr: 15975 data: 0x85640080 module:  5 information type:  6 information field: 0x00040080 ts:
0x00000120D0000059
 *** FEE64 discriminator: block:  3402 ptr: 15977 data: 0x86640080 module:  6 information type:  6 information field: 0x00040080 ts:
0x00000120D000005D
 *** FEE64 discriminator: block:  3402 ptr: 15979 data: 0x82640080 module:  2 information type:  6 information field: 0x00040080 ts:
0x00000120D000005F
 ***            ADC data: block:  3402 ptr: 15981 data: 0xC5437FC7 module: 21 fail: 0 range: 0 id:  1347 channel:  3 adc: 32711  ts:
0x00000120D0000065
 ***            ADC data: block:  3402 ptr: 15983 data: 0xC583802E module: 22 fail: 0 range: 0 id:  1411 channel:  3 adc: 32814  ts:
0x00000120D000008D
 ***            ADC data: block:  3402 ptr: 15985 data: 0xC4C37FDB module: 19 fail: 0 range: 0 id:  1219 channel:  3 adc: 32731  ts:
0x00000120C00000A0 OLD: ts: 0x00000120D000008D tag: 3 type: 0
 ***            ADC data: block:  3402 ptr: 15985 data: 0xC4C37FDB module: 19 fail: 0 range: 0 id:  1219 channel:  3 adc: 32731  ts:
0x00000120C00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 15987 data: 0x8140120D module:  1 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 15989 data: 0x8240120D module:  2 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 15991 data: 0x8340120D module:  3 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 15993 data: 0x8440120D module:  4 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 15995 data: 0x8540120D module:  5 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 15997 data: 0x8640120D module:  6 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 15999 data: 0x8740120D module:  7 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 16001 data: 0x8840120D module:  8 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 16003 data: 0x8940120D module:  9 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 16005 data: 0x8A40120D module: 10 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 16007 data: 0x8B40120D module: 11 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 16009 data: 0x8C40120D module: 12 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 16011 data: 0x8D40120D module: 13 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 16013 data: 0x8E40120D module: 14 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 16015 data: 0x8F40120D module: 15 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 16017 data: 0x9040120D module: 16 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 16019 data: 0x9140120D module: 17 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 16021 data: 0x9240120D module: 18 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 16023 data: 0x9340120D module: 19 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 16025 data: 0x9440120D module: 20 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 16027 data: 0x9540120D module: 21 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 16029 data: 0x9640120D module: 22 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 16031 data: 0x9740120D module: 23 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***   SYNC100 timestamp: block:  3402 ptr: 16033 data: 0x9840120D module: 24 information type:  4 information field: 0x0000120D ts:
0x00000120D00000A0
 ***            ADC data: block:  3402 ptr: 16035 data: 0xC4BA7DF1 module: 18 fail: 0 range: 0 id:  1210 channel: 58 adc: 32241  ts:
0x00000120D00000A5
 *** FEE64 discriminator: block:  3402 ptr: 16037 data: 0x85640080 module:  5 information type:  6 information field: 0x00040080 ts:
0x00000120D00000A9
 *** FEE64 discriminator: block:  3402 ptr: 16039 data: 0x86640080 module:  6 information type:  6 information field: 0x00040080 ts:
0x00000120D00000AC
 ***            ADC data: block:  3402 ptr: 16041 data: 0xC5F7812E module: 23 fail: 0 range: 0 id:  1527 channel: 55 adc: 33070  ts:
0x00000120D000010D
 ***            ADC data: block:  3402 ptr: 16043 data: 0xC5467E32 module: 21 fail: 0 range: 0 id:  1350 channel:  6 adc: 32306  ts:
0x00000120D000012D
 ***            ADC data: block:  3402 ptr: 16045 data: 0xC4C4801A module: 19 fail: 0 range: 0 id:  1220 channel:  4 adc: 32794  ts:
0x00000120D0000168
 ***            ADC data: block:  3402 ptr: 16047 data: 0xC54F7E07 module: 21 fail: 0 range: 0 id:  1359 channel: 15 adc: 32263  ts:
0x00000120D00001F5
 ***            ADC data: block:  3402 ptr: 16049 data: 0xC1907F13 module:  6 fail: 0 range: 0 id:   400 channel: 16 adc: 32531  ts:
0x00000120D000021D
 ***            ADC data: block:  3402 ptr: 16051 data: 0xC1B76F59 module:  6 fail: 0 range: 0 id:   439 channel: 55 adc: 28505  ts:
0x00000120D000021D
 *** FEE64 discriminator: block:  3402 ptr: 16053 data: 0x85640080 module:  5 information type:  6 information field: 0x00040080 ts:
0x00000120D0000268
 ***            ADC data: block:  3402 ptr: 16055 data: 0xC519804A module: 20 fail: 0 range: 0 id:  1305 channel: 25 adc: 32842  ts:
0x00000120D00002FD
 *** FEE64 discriminator: block:  3402 ptr: 16057 data: 0x85640080 module:  5 information type:  6 information field: 0x00040080 ts:
0x00000120D0000326
 ***            ADC data: block:  3402 ptr: 16059 data: 0xC3A57F86 module: 14 fail: 0 range: 0 id:   933 channel: 37 adc: 32646  ts:
0x00000120D000037D
 ***            ADC data: block:  3402 ptr: 16061 data: 0xC5707DD1 module: 21 fail: 0 range: 0 id:  1392 channel: 48 adc: 32209  ts:
0x00000120D0000385
 ***            ADC data: block:  3402 ptr: 16063 data: 0xC5B57F01 module: 22 fail: 0 range: 0 id:  1461 channel: 53 adc: 32513  ts:
0x00000120D00003AD
 ***            ADC data: block:  3402 ptr: 16065 data: 0xC2457E6F module:  9 fail: 0 range: 0 id:   581 channel:  5 adc: 32367  ts:
0x00000120D00003BD
 *** FEE64 discriminator: block:  3402 ptr: 16067 data: 0x85640080 module:  5 information type:  6 information field: 0x00040080 ts:
0x00000120D00003BD
 ***            ADC data: block:  3402 ptr: 16069 data: 0xC4C181BD module: 19 fail: 0 range: 0 id:  1217 channel:  1 adc: 33213  ts:
0x00000120D00003C0
 ***            ADC data: block:  3402 ptr: 16071 data: 0xC4ED80E8 module: 19 fail: 0 range: 0 id:  1261 channel: 45 adc: 33000  ts:
0x00000120D00003C0
 ***            ADC data: block:  3402 ptr: 16073 data: 0xC4F6812B module: 19 fail: 0 range: 0 id:  1270 channel: 54 adc: 33067  ts:
0x00000120D00003C0
 ***            ADC data: block:  3402 ptr: 16075 data: 0xC3457F08 module: 13 fail: 0 range: 0 id:   837 channel:  5 adc: 32520  ts:
0x00000120D000041D
 ***            ADC data: block:  3402 ptr: 16077 data: 0xC37C7FB1 module: 13 fail: 0 range: 0 id:   892 channel: 60 adc: 32689  ts:
0x00000120D000041D
 *** FEE64 discriminator: block:  3402 ptr: 16079 data: 0x85640080 module:  5 information type:  6 information field: 0x00040080 ts:
0x00000120D000043B
 *** FEE64 discriminator: block:  3402 ptr: 16081 data: 0x86640080 module:  6 information type:  6 information field: 0x00040080 ts:
0x00000120D000043B
 *** FEE64 discriminator: block:  3402 ptr: 16083 data: 0x81640080 module:  1 information type:  6 information field: 0x00040080 ts:
0x00000120D000043F
 *** FEE64 discriminator: block:  3402 ptr: 16085 data: 0x82640080 module:  2 information type:  6 information field: 0x00040080 ts:
0x00000120D0000440
 ***            ADC data: block:  3402 ptr: 16087 data: 0xC38A7F89 module: 14 fail: 0 range: 0 id:   906 channel: 10 adc: 32649  ts:
0x00000120D0000445
 ***            ADC data: block:  3402 ptr: 16089 data: 0xC3A68005 module: 14 fail: 0 range: 0 id:   934 channel: 38 adc: 32773  ts:
0x00000120D0000445
 ***            ADC data: block:  3402 ptr: 16091 data: 0xC3B07E25 module: 14 fail: 0 range: 0 id:   944 channel: 48 adc: 32293  ts:
0x00000120D0000445
 ***            ADC data: block:  3402 ptr: 16093 data: 0xC5737ED1 module: 21 fail: 0 range: 0 id:  1395 channel: 51 adc: 32465  ts:
0x00000120D000044D
 ***            ADC data: block:  3402 ptr: 16095 data: 0xC5A17F32 module: 22 fail: 0 range: 0 id:  1441 channel: 33 adc: 32562  ts:
0x00000120D0000475
 ***            ADC data: block:  3402 ptr: 16097 data: 0xC4FB80F3 module: 19 fail: 0 range: 0 id:  1275 channel: 59 adc: 33011  ts:
0x00000120D0000488
 ***            ADC data: block:  3402 ptr: 16099 data: 0xC37F7E9C module: 13 fail: 0 range: 0 id:   895 channel: 63 adc: 32412  ts:
0x00000120D00004E5
 ***            ADC data: block:  3402 ptr: 16101 data: 0xC1837FED module:  6 fail: 0 range: 0 id:   387 channel:  3 adc: 32749  ts:
0x00000120D000053D

Note - system-wide checks still OK despite time warp observed above
       no errors reported by merger since start of R11


Free memory before and after saving all L and H spectra to disk - see attachments 24-25
Some merger errors observed during save of all L and H spectra to disk - see attachment 26

FEE64 temperatures - Julabo FL11006 set point + 20 deg C - see attachment 27
                                    set point + 16 deg C - see attachment 28
Temperatures decrease typically ~ 2-4 deg C which implies that the coolant loop is working as expected.
However, +16 deg C is marginal due to relative humidity variations ~40-55% corresponding to Dew Point
temperatures of ~12-14 deg C. Returning Julabo FL11006 set point to +20 deg C.
Attachment 1: 1.png
1.png
Attachment 2: 2.png
2.png
Attachment 3: 3.png
3.png
Attachment 4: 4.png
4.png
Attachment 5: 5.png
5.png
Attachment 6: 6.png
6.png
Attachment 7: 7.png
7.png
Attachment 8: 9.png
9.png
Attachment 9: 10.png
10.png
Attachment 10: 11.png
11.png
Attachment 11: 12.png
12.png
Attachment 12: 13.png
13.png
Attachment 13: 15.png
15.png
Attachment 14: 16.png
16.png
Attachment 15: 17.png
17.png
Attachment 16: 18.png
18.png
Attachment 17: 19.png
19.png
Attachment 18: 20.png
20.png
Attachment 19: 21.png
21.png
Attachment 20: 22.png
22.png
Attachment 21: 23.png
23.png
Attachment 22: 25.png
25.png
Attachment 23: 28.png
28.png
Attachment 24: 29.png
29.png
Attachment 25: 30.png
30.png
Attachment 26: 31.png
31.png
Attachment 27: 32.png
32.png
Attachment 28: 33.png
33.png
  352   Tue Aug 30 08:26:33 2016 TDTuesday 30 August
16.18 R10 stops

      ASIC settings 2016Aug20-15.34.53
      Discriminator masks -> 0x0
      From Correlation Status & Control tab change Trigger delay 0x5

      BNC PB-4 Pulser
      Amplitude 90,000
      x5 attenuator IN
      t_r 50ns tau_d 50us 
      - polarity
      INT ref, delay MIN, tail pulse
      External (random) trigger from EG&G Ortec 462 Start output (Range 81.92us) - frequency c. 120Hz

      B2F/F11 temp +25.1 deg C, d.p. +14.1 deg C, RH 51.6%

      DSSSD bias/leakage current OK - see attachments 1-2
      FEE64 temperatures OK - see attachment 3

      Some error messages observed for merger - see attachment 4-10
      All related to Q5 (nnaida6)

      System-wide checks OK - see attachments 11-16

      AIDA SYNC, PAUSE, RESUME, Correlation L, SYNC time warp, Good Events, nnaida6, nnaida5 & nnaida20
statistics - see attachments
17-25

      Analysis of R10_272 shows data synchronised - see attachment 26

      FEE # versus timestamp (0.1ms / channel)

      nnaida1 - nnaid24 (stat) hit patterns - see attachments 27-28

aidas1> ./analyser2 /TapeData/Aug2016/R10_272
 *** GREAT format 3.2.0 analyser - TD - May 2014
 *** FEE64 discriminator: block: 15670 ptr:  2407 data: 0x81640080 module:  1 information type:  6 information
field: 0x00040080 ts: 0x000007BD800000A0 OLD: ts: 0x000007BD9000009E tag: 2 type: 6
 *** ERROR: READ I/O error:       5002
                   blocks:      24294
          ADC data format:   57829496 (  296793.6 Hz)
        Other data format:  140380504 (  720463.4 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:         59 (       0.3 Hz)
                               RESUME:         59 (       0.3 Hz)
                              SYNC100:    1783050 (    9151.0 Hz)
                           FEE64 disc:  138570073 (  711171.8 Hz)
                             MBS info:      27263 (     139.9 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:       9410 (      48.3 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                           FEE64 disc:          1 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 Timestamp elapsed time:      194.848 s
 FEE module #:   1 elapsed dead time       0.210 s
 FEE module #:   2 elapsed dead time       0.261 s
 FEE module #:   3 elapsed dead time       0.000 s
 FEE module #:   4 elapsed dead time       0.000 s
 FEE module #:   5 elapsed dead time       0.206 s
 FEE module #:   6 elapsed dead time       0.857 s
 FEE module #:   7 elapsed dead time       0.000 s
 FEE module #:   8 elapsed dead time       0.000 s
 FEE module #:   9 elapsed dead time       0.000 s
 FEE module #:  10 elapsed dead time       0.000 s
 FEE module #:  11 elapsed dead time       0.000 s
 FEE module #:  12 elapsed dead time       0.000 s
 FEE module #:  13 elapsed dead time       0.000 s
 FEE module #:  14 elapsed dead time       0.055 s
 FEE module #:  15 elapsed dead time       0.000 s
 FEE module #:  16 elapsed dead time       0.000 s
 FEE module #:  17 elapsed dead time       0.027 s
 FEE module #:  18 elapsed dead time       0.000 s
 FEE module #:  19 elapsed dead time       0.000 s
 FEE module #:  20 elapsed dead time       0.000 s
 FEE module #:  21 elapsed dead time       0.000 s
 FEE module #:  22 elapsed dead time       0.013 s
 FEE module #:  23 elapsed dead time       0.000 s
 FEE module #:  24 elapsed dead time       0.000 s
 FEE module #:  25 elapsed dead time       0.000 s
 FEE module #:  26 elapsed dead time       0.000 s
 FEE module #:  27 elapsed dead time       0.000 s
 FEE module #:  28 elapsed dead time       0.000 s
 FEE module #:  29 elapsed dead time       0.000 s
 FEE module #:  30 elapsed dead time       0.000 s
 FEE module #:  31 elapsed dead time       0.000 s
 FEE module #:  32 elapsed dead time       0.000 s

 *** Program elapsed time:   11.883s ( 2044.465 blocks/s, 127.779 Mb/s)
Attachment 1: 1.png
1.png
Attachment 2: 2.png
2.png
Attachment 3: 3.png
3.png
Attachment 4: 4.png
4.png
Attachment 5: 5.png
5.png
Attachment 6: 6.png
6.png
Attachment 7: 7.png
7.png
Attachment 8: 8.png
8.png
Attachment 9: 9.png
9.png
Attachment 10: 10.png
10.png
Attachment 11: 11.png
11.png
Attachment 12: 12.png
12.png
Attachment 13: 13.png
13.png
Attachment 14: 14.png
14.png
Attachment 15: 15.png
15.png
Attachment 16: 16.png
16.png
Attachment 17: 17.png
17.png
Attachment 18: 18.png
18.png
Attachment 19: 19.png
19.png
Attachment 20: 20.png
20.png
Attachment 21: 21.png
21.png
Attachment 22: 22.png
22.png
Attachment 23: 23.png
23.png
Attachment 24: 24.png
24.png
Attachment 25: 25.png
25.png
Attachment 26: 26.png
26.png
Attachment 27: 27.png
27.png
Attachment 28: 28.png
28.png
  351   Mon Aug 29 08:53:55 2016 TDnnaida19 restored
nnaida19 restored to configuration - /MIDAS/Aida/tclhttpd/aidas1/startup.tcl - see attachment 1

Latest version of firmware loaded - /MIDAS/Aida/FEE_GF_Feb16_21.bin

System power-cycled

ASIC settings 2016Aug20-15.34.53

slow comparator 0x20
LEC/MEC fast comparator 0xff

discriminator mask -> 0x0

All system-wide checks OK *except* nnaida19 fails ASIC clock timestamp synchronisation
Attachment 1: startup.tcl
Setting BGColor "BlanchedAlmond"
   Setting TextColor "red"

      Setting ProjectName  AIDA
      Setting ProjectImage AIDA.gif
      Setting ProjectURL   "http://npg.dl.ac.uk/NPG/Projects/Fair.html"


  Setting Option1Name STFC
  Setting Option1URL  "stfc.ac.uk"
  Setting Option1Image stfc.jpg


global MessageLoggerServerHost
  set  MessageLoggerServerHost elog.ph.ed.ac.uk

    package require  MessageLoggerClient 

  Setting Option3Name "Elog Server"
  Setting Option3URL  "https://elog.ph.ed.ac.uk/AIDA"

#    Install required services

   package require XAIDAAccessClient  ;# for Client end - ie AIDA server workstation  sets MIDAS_XAIDAAccessClient_Exists (SOAP)

   package require XAD9252AccessClient ;# for Client end - ie AIDA server workstation  sets MIDAS_XAD9252AccessClient_Exists (SOAP)

namespace eval DataAcquisition {
    variable PROJECT AIDA
    variable ACQSERVERS; set ACQSERVERS {}
    variable PACQSERVERS; set PACQSERVERS { nnaida1 nnaida2 nnaida5 nnaida6  nnaida9 nnaida10 nnaida13 nnaida14 nnaida17 nnaida18 nnaida21 nnaida22 }
    variable NACQSERVERS; set NACQSERVERS { nnaida3 nnaida4 nnaida7 nnaida8 nnaida11 nnaida12 nnaida15 nnaida16 nnaida19 nnaida20 nnaida23 nnaida24 }

    lappend ACQSERVERS nnaida1
    lappend ACQSERVERS nnaida2
    lappend ACQSERVERS nnaida3
    lappend ACQSERVERS nnaida4
    lappend ACQSERVERS nnaida5
    lappend ACQSERVERS nnaida6
    lappend ACQSERVERS nnaida7
    lappend ACQSERVERS nnaida8
    lappend ACQSERVERS nnaida9
    lappend ACQSERVERS nnaida10
    lappend ACQSERVERS nnaida11
    lappend ACQSERVERS nnaida12
    lappend ACQSERVERS nnaida13
    lappend ACQSERVERS nnaida14
    lappend ACQSERVERS nnaida15
    lappend ACQSERVERS nnaida16
    lappend ACQSERVERS nnaida17
    lappend ACQSERVERS nnaida18
    lappend ACQSERVERS nnaida19
    lappend ACQSERVERS nnaida20
    lappend ACQSERVERS nnaida21
    lappend ACQSERVERS nnaida22
    lappend ACQSERVERS nnaida23
    lappend ACQSERVERS nnaida24
#    lappend ACQSERVERS nnaida25
#    lappend ACQSERVERS nnaida26
#    lappend ACQSERVERS nnaida27
#    lappend ACQSERVERS nnaida28
#    lappend ACQSERVERS nnaida29
#    lappend ACQSERVERS nnaida30
#    lappend ACQSERVERS nnaida31
#    lappend ACQSERVERS nnaida32

    variable DataTransferStreams; set DataTransferStreams 2
}

namespace eval AIDA {
      variable ModuleMenu; set ModuleMenu $::DataAcquisition::ACQSERVERS
      variable TSMaster; set TSMaster nnaida6
      variable FEE64 [first $ModuleMenu]
      variable ConfigBase; set ConfigBase [file join $env(MIDASBASE) config TclHttpd]
}

    Setting DataBaseRoot "/MIDAS/DB"
    package require DataBaseAccessServer
    package require NetVarsServer 1.1
    package require SigTaskServer

    package require MemSasServer

#    Install services for Run Control

namespace eval $::DataAcquisition::PROJECT {
    variable DBRootName [file join EXPERIMENTS AIDA]
    variable DBNodeBase 2012
}

  package require AIDARunControl


  Setting Option7Name "Project Home Page"
  Setting Option7URL  "http://npg.dl.ac.uk/NPG/Projects/Fair.html"

  Setting Option8Name "Server Software Home Page"
  Setting Option8URL  "http://npg.dl.ac.uk/MIDAS/download/WebServices.html"
  350   Mon Aug 29 06:57:32 2016 TDMonday 29 August
Per the instructions provided by https://elog.ph.ed.ac.uk/AIDA/331 added Servisol Heat Sink Compound
to each of the 24x FEE64s currently installed (plus spare FEE module stored in the B3F AIDA storage
area).

Before adding the Servisol Heat Sink Compound - https://elog.ph.ed.ac.uk/AIDA/349 (attachment 3)

After adding the Servisol Heat Sink Compound - see attachment 1

With exception of nnaida8 & nnaida10 Virtex temperatures now ~ +44-55 deg C cf. ~ +55-70 deg C 

nnaida6 shows an increase in temperature for the PSU from ~ +35 deg C to ~ +40 deg C

All system-wide checks OK

Rate hit patterns for nnaida1-nnaida24 - see attachments 2-3
Should show uniform rate ~130Hz for all channels
Observe some channels are missing

N.B. 1x AIDA adaptor PCB rev D replaced by spare due to (single) bent ERNI pin
     All ERNI connectors of all AIDA adaptor PCBs checked before re-installation of FEE modules
     - it is possible that there are other AIDA adaptor PCBs with bent pins
     - the system is currently fairly noisy and this could be an alternative explanation of missing channels
 

16.55 R10

      FEE64 configuration includes nnaida19

      ASIC settings 2016Aug20-15.34.53
      Discriminator masks -> 0x0
      From Correlation Status & Control tab change Trigger delay from 0x180 to 0x5

      BNC PB-4 Pulser
      Amplitude 90,000
      x5 attenuator IN
      t_r 50ns tau_d 50us 
      - polarity
      INT ref, delay MIN, tail pulse
      External (random) trigger from EG&G Ortec 462 Start output (Range 81.92us) - frequency c. 120Hz

      B2F/F11 temp +25.0 deg C, d.p. +14.3 deg C, RH 51.6% (Julabo FL11006 set point +20 deg C)

      FEE64 temperatures - attachment 6
Attachment 1: 1.png
1.png
Attachment 2: 2.png
2.png
Attachment 3: 3.png
3.png
Attachment 4: 4.png
4.png
Attachment 5: 5.png
5.png
Attachment 6: 6.png
6.png
Attachment 7: 7.png
7.png
  349   Fri Aug 26 02:10:31 2016 TDFriday 26 August
10.11 R9 continues

      ASIC settings 2016Aug20-15.34.53
      Discriminator masks -> 0x0
      From Correlation Status & Control tab change Trigger delay from 0x180 to 0x5

      BNC PB-4 Pulser
      Amplitude 90,000
      x5 attenuator IN
      t_r 50ns tau_d 50us 
      - polarity
      INT ref, delay MIN, tail pulse
      External (random) trigger from EG&G Ortec 462 Start output (Range 81.92us) - frequency c. 120Hz

      B2F/F11 temp +24.8 deg C, d.p. +12.9 deg C, RH 46.8%

      DSSSD bias/leakage current OK - see attachments 1-2
      FEE64 temperatures OK - see attachment 3

      Some error messages observed for merger - see attachment 4-12
      All related to Q5 (nnaida6)

      System-wide checks OK - see attachments 13-18

      AIDA SYNC, PAUSE, RESUME, Correlation L, SYNC time warp, Good Events, nnaida6, nnaida5 & nnaida20
statistics - see attachments
19-28

      Analysis of R9_561 shows data synchronised - see attachmen

      FEE # versus timestamp (0.1ms / channel)
      Note nnaida19 not currently configured

10.49 R9 stops
Attachment 1: 1.png
1.png
Attachment 2: 2.png
2.png
Attachment 3: 3.png
3.png
Attachment 4: 4.png
4.png
Attachment 5: 5.png
5.png
Attachment 6: 6.png
6.png
Attachment 7: 7.png
7.png
Attachment 8: 8.png
8.png
Attachment 9: 9.png
9.png
Attachment 10: 10.png
10.png
Attachment 11: 11.png
11.png
Attachment 12: 12.png
12.png
Attachment 13: 13.png
13.png
Attachment 14: 14.png
14.png
Attachment 15: 15.png
15.png
Attachment 16: 16.png
16.png
Attachment 17: 17.png
17.png
Attachment 18: 18.png
18.png
Attachment 19: 20.png
20.png
Attachment 20: 21.png
21.png
Attachment 21: 22.png
22.png
Attachment 22: 23.png
23.png
Attachment 23: 24.png
24.png
Attachment 24: 25.png
25.png
Attachment 25: 26.png
26.png
Attachment 26: 27.png
27.png
Attachment 27: 28.png
28.png
Attachment 28: 29.png
29.png
  348   Thu Aug 25 02:10:10 2016 TDThursday 25 August
11.40 R9 continues

      ASIC settings 2016Aug20-15.34.53
      Discriminator masks -> 0x0
      From Correlation Status & Control tab change Trigger delay from 0x180 to 0x5

      BNC PB-4 Pulser
      Amplitude 90,000
      x5 attenuator IN
      t_r 50ns tau_d 50us 
      - polarity
      INT ref, delay MIN, tail pulse
      External (random) trigger from EG&G Ortec 462 Start output (Range 81.92us) - frequency c. 120Hz

      B2F/F11 temp +25.2 deg C, d.p. +14.5 deg C, RH 50.4%

      DSSSD bias/leakage current OK - see attachments 1-2
      FEE64 temperatures OK - see attachment 3

      Some error messages observed for merger - see attachment 4-6
      All related to Q5 (nnaida6)

      System-wide checks OK - see attachments 7-12

      AIDA SYNC, PAUSE, RESUME, Correlation L, SYNC time warp, Good Events, nnaida6, nnaida5 & nnaida20
statistics - see attachments
13-20

      Analysis of R9_213 shows data synchronised - see attachment 21

      FEE # versus timestamp (0.1ms / channel)
      Note nnaida19 not currently configured
Attachment 1: 1.png
1.png
Attachment 2: 2.png
2.png
Attachment 3: 3.png
3.png
Attachment 4: 4.png
4.png
Attachment 5: 5.png
5.png
Attachment 6: 6.png
6.png
Attachment 7: 7.png
7.png
Attachment 8: 8.png
8.png
Attachment 9: 9.png
9.png
Attachment 10: 10.png
10.png
Attachment 11: 11.png
11.png
Attachment 12: 12.png
12.png
Attachment 13: 13.png
13.png
Attachment 14: 14.png
14.png
Attachment 15: 15.png
15.png
Attachment 16: 16.png
16.png
Attachment 17: 17.png
17.png
Attachment 18: 18.png
18.png
Attachment 19: 19.png
19.png
Attachment 20: 20.png
20.png
Attachment 21: 21.png
21.png
  347   Wed Aug 24 03:43:44 2016 TDWednesday 24 August
11.40 R8 continues

      B2F/FF temp +25 deg C, d.p. +14 deg C, RH 51%

      DSSSD bias/leakage current OK - see attachments 1-2
      FEE64 temperatures OK - see attachment 3
      System-wide checks OK - see attachments 4-9

      AIDA SYNC, PAUSE, RESUME, Correlation L, SYNC time warp, Good Events, nnaida6 statistics - see attachments
10-16

      Some error messages observed for merger - see attachment 17-18
      All related to Q5 (nnaida6)

      Analysis of R8_231 shows data synchronised 

18.07 R8 stops

      At end of run (file R8_310) BNC PB-4 pulser ref switch INT -> EXT to check for possible skew in data
synchronisation

      Analysis of R8_310 shows no evidence of skew, i.e. all FEE64s are observed to stop producing pulser events
at same time

19.21 R9 starts

      ASIC settings 2016Aug20-15.34.53
      Discriminator masks -> 0x0

      BNC PB-4 Pulser
      Amplitude 90,000
      x5 attenuator IN
      t_r 50ns tau_d 50us 
      - polarity
      INT ref, delay MIN, tail pulse
      BNC PB-4 pulser triggered by EG&G Ortec 462 Start output - frequency ~120Hz - Range 81.92us
      From Correlation Status & Control tab change Trigger delay from 0x180 to 0x5

      ASIC Control -> Check ASIC Control required after DAQ GO

      BNC PB-4 pulser triggered by EG&G Ortec 462 Start output - frequency ~120Hz - Range 81.92us
      From Correlation Status & Control tab change Trigger delay from 0x180 to 0x5

      System-wide checks OK - see attachments 19-24
      AIDA SYNC, PAUSE, RESUME, Correlation L, SYNC time warp, Good Events, nnaida6 statistics x2 - see attachments
25-32
      
Attachment 1: 1.png
1.png
Attachment 2: 2.png
2.png
Attachment 3: 3.png
3.png
Attachment 4: 4.png
4.png
Attachment 5: 5.png
5.png
Attachment 6: 7.png
7.png
Attachment 7: 7.png
7.png
Attachment 8: 8.png
8.png
Attachment 9: 9.png
9.png
Attachment 10: 10.png
10.png
Attachment 11: 11.png
11.png
Attachment 12: 12.png
12.png
Attachment 13: 13.png
13.png
Attachment 14: 14.png
14.png
Attachment 15: 15.png
15.png
Attachment 16: 16.png
16.png
Attachment 17: 17.png
17.png
Attachment 18: 18.png
18.png
Attachment 19: 20.png
20.png
Attachment 20: 21.png
21.png
Attachment 21: 22.png
22.png
Attachment 22: 23.png
23.png
Attachment 23: 24.png
24.png
Attachment 24: 25.png
25.png
Attachment 25: 26.png
26.png
Attachment 26: 27.png
27.png
Attachment 27: 28.png
28.png
Attachment 28: 29.png
29.png
Attachment 29: 30.png
30.png
Attachment 30: 32.png
32.png
Attachment 31: 33.png
33.png
Attachment 32: 34.png
34.png
  346   Tue Aug 23 01:49:01 2016 TDTuesday 23 August
09.50 DAQ found stopped
      No error messages merge/tapeserver - see attachments 1-2
      Most recent data file R7_107 last written to 08.13 23.8.16

10.00 Electrical power to AIDA is off for reasons unknown (power saving/maintenance/trip)
      3-ph circuit to Julabo FL1106 recirculating chiller is unaffected

10.20 Analysis of R7_107 (most recent data file) shows data synchronised OK 

11.30 Yoshida-san informs us that the experimental power to F11 is off for annual inspection/maintenance.
      Power should be restored this evening, or possibly, sometime tomorrow.

19.00 Power restored

      FEE64 power *off* - as expected following power outage
      Detector bias *off* - as expected following power outage

      Startup AIDA
      System wide checks, FEE64 temperatures and DSSSD bias/leakage currents - see attachments 3-11

19.24 R8 starts

      slow comparator 0x10
      LEC/MEC fast comparator 0xff

      ASIC settings 2016Aug20-15.34.53
      Discriminator masks -> 0x0

      BNC PB-4 Pulser
      Amplitude 90,000
      x5 attenuator IN
      t_r 50ns tau_d 50us 
      - polarity
      INT ref, delay MIN, tail pulse

19.31 AIDA SYNC, PAUSE, RESUME, SYNCtime warp, Good data etc statistics - see attachments 12-18
Attachment 1: 60.png
60.png
Attachment 2: 61.png
61.png
Attachment 3: 70.png
70.png
Attachment 4: 71.png
71.png
Attachment 5: 72.png
72.png
Attachment 6: 73.png
73.png
Attachment 7: 74.png
74.png
Attachment 8: 75.png
75.png
Attachment 9: 76.png
76.png
Attachment 10: 77.png
77.png
Attachment 11: 78.png
78.png
Attachment 12: 80.png
80.png
Attachment 13: 81.png
81.png
Attachment 14: 82.png
82.png
Attachment 15: 83.png
83.png
Attachment 16: 84.png
84.png
Attachment 17: 85.png
85.png
Attachment 18: 86.png
86.png
  344   Mon Aug 22 13:37:30 2016 TDMonday 20 August
> 11.00 Restore power to AIDA following Saturday's shutdoen in preparation for the planned maintenance
>       outage on Sunday.
> 
>       Restart Julabo FL11006 chiller - set point +20 deg C
>       Restart AIDA
> 
>       Temperature +24.3 deg C, DP +15.2 deg C, RH 57.5%
> 
>       DSSSD #1-6 bias - see attachments 1-2
>      
>       FEE64 temperatures - attachment 3
> 
>       System-wide checks - see attachments 4-8
>       Note SYNC pulses received by *all* slave FEE64s = SYNC pulses sent by master FEE64 (nnaida6)
> 
> 11.35 R6 starts
>       slow comparator 0x10
>       LEC/MEC fast comparator 0x10
> 
>       All FEE64 discriminator masks -> 0x0
> 
>       observe very high rates (~400-500kHz/FEE64) from majority ofp+n junction FEE64s
> 
>       LEC/MEC fast comparator -> 0xff
> 
> 18.45 DAQ running OK
>       No merger error messages since change of LEC/MEC fast comparator threshold -> 0xff
>       Offline analysis of R6_79 confirms that all FEE64s are synchronised
> 
>       Added correlation trigger input
>       BNC PB-4 Pulser trigger output -> Ortec SCA + NIM output width 0.5us -> LeCroy 429A -> root MACB trigger
> #4 input
> 
> 21.05 R7 starts
> 
>       Attachments 9-16 show FEE64 temperatures and results of each system-wide check. 
> 
>       Note the result of the Master Timestamp Control -> Check Clock Lock States 
>       indicating clock state *not* locked
> 
>       slow comparator 0x10
>       LEC/MEC fast comparator 0xff
>       All FEE64 discriminator masks -> 0x0

The status is OK. I changed the system wide check to reflect the new value but forgot about the individual check.
I will update the software.
Note attachment 5 shows all is well.

Updated version of /MIDAS/TclHttpd/Html/AIDA/MasterTS/MasterTS.tcl installed with correction.
  343   Mon Aug 22 11:45:07 2016 Patrick Coleman-SmithSoftware updated in Aida

Logged into aidas1, installed AidaExecV8 with a test of the time difference between SYNC data items. Failure to be 0x40000 clocks will cause a statistic to be incremented. "SYNC Time Warp"

Installed updated versions of /MIDAS/TclHttpd/Html/AIDA/RunControl/sys.tcl and /MIDAS/TclHttpd/Html/AIDA/RunControl/implementation.tcl to allow latest System Wide Check to operate.

Installed updated versions of Check.tcl/.js/tml into /MIDAS/TclHttpd/Html/AIDA/Check/

Checked all the /MIDAS/linux-ppc_4xx/startup files including aidacommon for entries relating to the flush and push rates. Only aidacommon has an entry as required. Currently both are set to 30.

Changed the /etc/sysctl.conf file in each of the 32 root file systems (rfs) in /MIDAS/XilinxLinux/ppc_4xx/rfs/nnaida##/ to add the line "vm.min_free_kbytes=4096".

The changes will take effect from the next power-cycle of the FEEs and "reset" of the browser windows on the server.

  342   Mon Aug 22 10:35:31 2016 TDMonday 20 August
11.00 Restore power to AIDA following Saturday's shutdoen in preparation for the planned maintenance
      outage on Sunday.

      Restart Julabo FL11006 chiller - set point +20 deg C
      Restart AIDA

      Temperature +24.3 deg C, DP +15.2 deg C, RH 57.5%

      DSSSD #1-6 bias - see attachments 1-2
     
      FEE64 temperatures - attachment 3

      System-wide checks - see attachments 4-8
      Note SYNC pulses received by *all* slave FEE64s = SYNC pulses sent by master FEE64 (nnaida6)

11.35 R6 starts
      slow comparator 0x10
      LEC/MEC fast comparator 0x10

      All FEE64 discriminator masks -> 0x0

      observe very high rates (~400-500kHz/FEE64) from majority ofp+n junction FEE64s

      LEC/MEC fast comparator -> 0xff

18.45 DAQ running OK
      No merger error messages since change of LEC/MEC fast comparator threshold -> 0xff
      Offline analysis of R6_79 confirms that all FEE64s are synchronised

      Added correlation trigger input
      BNC PB-4 Pulser trigger output -> Ortec SCA + NIM output width 0.5us -> LeCroy 429A -> root MACB trigger
#4 input

21.05 R7 starts

      Attachments 9-16 show FEE64 temperatures and results of each system-wide check. 

      Note the result of the Master Timestamp Control -> Check Clock Lock States 
      indicating clock state *not* locked

      slow comparator 0x10
      LEC/MEC fast comparator 0xff
      All FEE64 discriminator masks -> 0x0
Attachment 1: 30.png
30.png
Attachment 2: 31.png
31.png
Attachment 3: 32.png
32.png
Attachment 4: 33.png
33.png
Attachment 5: 34.png
34.png
Attachment 6: 35.png
35.png
Attachment 7: 36.png
36.png
Attachment 8: 37.png
37.png
Attachment 9: 50.png
50.png
Attachment 10: 51.png
51.png
Attachment 11: 52.png
52.png
Attachment 12: 53.png
53.png
Attachment 13: 54.png
54.png
Attachment 14: 55.png
55.png
Attachment 15: 56.png
56.png
Attachment 16: 57.png
57.png
Attachment 17: 59.png
59.png
  341   Mon Aug 22 10:35:06 2016 TDSaturday 20 August
  340   Fri Aug 19 12:41:43 2016 TD, VP, reply PJCSFriday 19 August
> > > 
> > > 14.00 Both AIDA NIM bins U/S 
> > >       Upper NIM bin - BNC PB-4, Ortec 433, 2x CAEN N1419, 1x CAEN N1419B - ac mains fuse 100V/8A/slow? blowing
> > >       Lower NIM bin - 11x MACB - not powering up
> > > 
> > >       Replaced both NIM bins.
> > >       Upper NIM bin - 11x MACB
> > >       Lower NIM bin - BNC PB-4, Ortec 433, 2x CAEN N1419, 1x CAEN N1419B
> > > 
> > > 15.50 Julabo FL11006 chiller ON - set point +20 deg C
> > >       B2F/F11 ambient temp +24.0 deg C, RH 54%, DP +13.8 deg C
> > > 
> > >       Bias 6x MSL type BB18 DSSSDs - see attachments 1-2
> > > 
> > > 16.10 Startup DAQ nnaida1-24 *except* nnaida19
> > > 
> > >       System-wide checks
> > > 
> > >       Check clock status OK
> > >       Check ADC calibration - nnaida7 failed
> > >       Check ASIC clock timestamp - multiple failures - see attachment 3
> > >       Check SYNC errors not counted Since Baseline - see attachment 4
> > >       Check SYNC pulses received - see attachment 5
> > > 
> > >       BNC PB-4 
> > > 
> > >       Amplitude 90,000, x5 attenuator IN
> > >       t_r 50ns, tau_d 50us
> > >       Polarity -
> > >       INT ref, delay MIN, tail pulse
> > > 
> > >       FEE64 temperatures - see attachment 6
> > > 
> > > 16.34 R1 starts (directory Aug2016)
> > > 
> > >       slow comparator 0x10, LEC/MEC fast comparator 0x10
> > > 
> > >       merge 555k data items/s, tapeserver 4430 kb/s
> > Looks like a problem with the inter-MACB wiring.
> > The screen shots show groups of 4 with the problems.
> > I suggest re-seating the short HDMI cables and reset the system.
> 
> Short HDMI cables re-seated. See attachment 1

ok, the discrepancy is odd. Not sure if it is due to an uneven reset or more noise in the wiring.
In system wide checks redo the baseline for the SYNC error counters and keep an eye on it.

Maybe a power cycle will bring all the SYNC received counters into line.

Certainly they should be exactly the same.

Is there any correlation between the ones that are wrong and the MACB layout/cabling ?
  339   Fri Aug 19 11:07:44 2016 TD, VP, reply PJCSFriday 19 August
> > 
> > 14.00 Both AIDA NIM bins U/S 
> >       Upper NIM bin - BNC PB-4, Ortec 433, 2x CAEN N1419, 1x CAEN N1419B - ac mains fuse 100V/8A/slow? blowing
> >       Lower NIM bin - 11x MACB - not powering up
> > 
> >       Replaced both NIM bins.
> >       Upper NIM bin - 11x MACB
> >       Lower NIM bin - BNC PB-4, Ortec 433, 2x CAEN N1419, 1x CAEN N1419B
> > 
> > 15.50 Julabo FL11006 chiller ON - set point +20 deg C
> >       B2F/F11 ambient temp +24.0 deg C, RH 54%, DP +13.8 deg C
> > 
> >       Bias 6x MSL type BB18 DSSSDs - see attachments 1-2
> > 
> > 16.10 Startup DAQ nnaida1-24 *except* nnaida19
> > 
> >       System-wide checks
> > 
> >       Check clock status OK
> >       Check ADC calibration - nnaida7 failed
> >       Check ASIC clock timestamp - multiple failures - see attachment 3
> >       Check SYNC errors not counted Since Baseline - see attachment 4
> >       Check SYNC pulses received - see attachment 5
> > 
> >       BNC PB-4 
> > 
> >       Amplitude 90,000, x5 attenuator IN
> >       t_r 50ns, tau_d 50us
> >       Polarity -
> >       INT ref, delay MIN, tail pulse
> > 
> >       FEE64 temperatures - see attachment 6
> > 
> > 16.34 R1 starts (directory Aug2016)
> > 
> >       slow comparator 0x10, LEC/MEC fast comparator 0x10
> > 
> >       merge 555k data items/s, tapeserver 4430 kb/s
> Looks like a problem with the inter-MACB wiring.
> The screen shots show groups of 4 with the problems.
> I suggest re-seating the short HDMI cables and reset the system.

Short HDMI cables re-seated. See attachment 1
Attachment 1: 7.png
7.png
ELOG V3.1.4-unknown