AIDA GELINA BRIKEN nToF CRIB ISOLDE CIRCE nTOFCapture DESPEC DTAS EDI_PSA 179Ta CARME StellarModelling DCF K40 MONNET
  DESPEC, Page 37 of 37  ELOG logo
  ID Date Author Subjectdown
  600   Tue Apr 23 22:37:46 2024 TD00:00-08:00 Wednesday 24 April
23.34 23.4.24

      DSSSD bias & leakage current OK - attachment 2

      FEE64 temperatures OK - attachment 2

      ADC data item stats - attachment 3

      per FEE64 rate spectra - attachments 4

      Merger etc - attachment 5

03.41 fDSSSD bias & leakage current OK - attachment 6

      FEE64 temperatures OK - attachment 7

      ADC data item stats - attachment 8

      per FEE64 rate spectra (off and on spill) - attachments 9-10

      Merger etc - attachment 11

03.54 analysis data file R18_67 - attachment 12
      max deadtime 11% (aida04)
      HEC data item rate c. 1.5kHz
      no timewarps

0.35 fDSSSD bias & leakage current OK - attachment 13

      FEE64 temperatures OK - attachment 14

      ADC data item stats - attachment 15

      per FEE64 rate spectra - attachments 16

      Merger etc - attachment 17

03.54 analysis data file R18_96 - attachment 18
      max deadtime 12% (aida04)
      HEC data item rate c. 1.6kHz
      no timewarps
Attachment 1: Screenshot_from_2024-04-23_23-34-18.png
Screenshot_from_2024-04-23_23-34-18.png
Attachment 2: Screenshot_from_2024-04-23_23-34-54.png
Screenshot_from_2024-04-23_23-34-54.png
Attachment 3: Screenshot_from_2024-04-23_23-35-45.png
Screenshot_from_2024-04-23_23-35-45.png
Attachment 4: Screenshot_from_2024-04-23_23-36-31.png
Screenshot_from_2024-04-23_23-36-31.png
Attachment 5: Screenshot_from_2024-04-23_23-37-21.png
Screenshot_from_2024-04-23_23-37-21.png
Attachment 6: Screenshot_from_2024-04-24_03-41-40.png
Screenshot_from_2024-04-24_03-41-40.png
Attachment 7: Screenshot_from_2024-04-24_03-42-32.png
Screenshot_from_2024-04-24_03-42-32.png
Attachment 8: Screenshot_from_2024-04-24_03-42-58.png
Screenshot_from_2024-04-24_03-42-58.png
Attachment 9: Screenshot_from_2024-04-24_03-43-35.png
Screenshot_from_2024-04-24_03-43-35.png
Attachment 10: Screenshot_from_2024-04-24_03-44-11.png
Screenshot_from_2024-04-24_03-44-11.png
Attachment 11: Screenshot_from_2024-04-24_03-44-35.png
Screenshot_from_2024-04-24_03-44-35.png
Attachment 12: R18_67
 *** TDR format 3.3.0 analyser - TD - May 2021
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  250287937 (  518744.3 Hz)
        Other data format:   11632065 (   24108.5 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:       1106 (       2.3 Hz)
                               RESUME:       1109 (       2.3 Hz)
                              SYNC100:      33796 (      70.0 Hz)
                              WR48-63:      33796 (      70.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:   11562258 (   23963.8 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:     752941 (    1560.5 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                              WR48-63:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:      482.488 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  0                0.000                0.000
  1               23.222                0.000
  2                0.000                0.000
  3               56.625                0.000
  4                0.000                0.000
  5                0.704                0.000
  6                0.000                0.000
  7                0.939                0.000
  8                0.000                0.000
  9                0.000                0.000
 10                0.000                0.000
 11                0.000                0.000
 12                0.000                0.000
 13                0.000                0.000
 14                0.006                0.000
 15                0.000                0.000
 16                0.000                0.000
 17                0.000                0.000
 18                0.000                0.000
 19                0.000                0.000
 20                0.000                0.000
 21                0.000                0.000
 22                0.000                0.000
 23                0.000                0.000
 24                0.000                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100    WR48-63       Disc        MBS      Other   HEC Data
  0    3375676      15359          0          0          0          0        442        442          0      14475          0      75815
  1   47916692     537101          0          0        366        367       6254       6254          0     523860          0     139250
  2    3817331    4998323          0          0          0          0       1132       1132          0    4996059          0      51826
  3   75749746    4208495          0          0        548        550      10285      10285          0    4186827          0      40621
  4    3336977     792495          0          0          1          1        545        545          0     791403          0      53742
  5   23132211    1055976          0          0         83         83       3088       3088          0    1049634          0      49833
  6    3422365        890          0          0          0          0        445        445          0          0          0      14690
  7   56668346      14890          0          0        106        106       7339       7339          0          0          0     118883
  8    2824304        672          0          0          0          0        336        336          0          0          0      28810
  9    3844587        966          0          0          0          0        483        483          0          0          0      11512
 10    4370286       1248          0          0          0          0        624        624          0          0          0       5026
 11    3088851        802          0          0          0          0        401        401          0          0          0      98441
 12    5014612       1352          0          0          0          0        676        676          0          0          0      15213
 13    3462527        896          0          0          0          0        448        448          0          0          0      18001
 14    3185286        772          0          0          2          2        384        384          0          0          0      11128
 15    7078140       1828          0          0          0          0        914        914          0          0          0      20150
 16          0          0          0          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100    WR48-63       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0

 *** Program elapsed time:   30.998s ( 1032.323 blocks/s,  64.520 Mb/s)
Attachment 13: Screenshot_from_2024-04-24_07-35-18.png
Screenshot_from_2024-04-24_07-35-18.png
Attachment 14: Screenshot_from_2024-04-24_07-36-00.png
Screenshot_from_2024-04-24_07-36-00.png
Attachment 15: Screenshot_from_2024-04-24_07-36-29.png
Screenshot_from_2024-04-24_07-36-29.png
Attachment 16: Screenshot_from_2024-04-24_07-37-03.png
Screenshot_from_2024-04-24_07-37-03.png
Attachment 17: Screenshot_from_2024-04-24_07-37-45.png
Screenshot_from_2024-04-24_07-37-45.png
Attachment 18: R18_96
 *** TDR format 3.3.0 analyser - TD - May 2021
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  253809078 (  751826.0 Hz)
        Other data format:    8110924 (   24025.9 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:        844 (       2.5 Hz)
                               RESUME:        844 (       2.5 Hz)
                              SYNC100:      33258 (      98.5 Hz)
                              WR48-63:      33258 (      98.5 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:    8042720 (   23823.9 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:     529514 (    1568.5 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                              WR48-63:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:      337.590 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  0                0.000                0.000
  1               19.161                0.000
  2                0.007                0.000
  3               41.205                0.000
  4                0.172                0.000
  5                0.406                0.000
  6                0.000                0.000
  7                0.656                0.000
  8                0.010                0.000
  9                0.000                0.000
 10                0.193                0.000
 11                0.001                0.000
 12                0.000                0.000
 13                0.000                0.000
 14                0.023                0.000
 15                0.121                0.000
 16                0.000                0.000
 17                0.000                0.000
 18                0.000                0.000
 19                0.000                0.000
 20                0.000                0.000
 21                0.000                0.000
 22                0.000                0.000
 23                0.000                0.000
 24                0.000                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100    WR48-63       Disc        MBS      Other   HEC Data
  0    5871650      11620          0          0          0          0        746        746          0      10128          0      52136
  1   34432367     363819          0          0        263        263       4482       4482          0     354329          0      94194
  2    7680769    3497668          0          0          2          2       1401       1401          0    3494862          0      35954
  3   53024609    2927317          0          0        398        398       7008       7008          0    2912505          0      27672
  4    8502384     548708          0          0          9          9       1159       1159          0     546372          0      36407
  5   16750131     728930          0          0         53         53       2150       2150          0     724524          0      33989
  6    6256772       1674          0          0          0          0        837        837          0          0          0      10191
  7   41893078      10740          0          0         71         71       5299       5299          0          0          0      94711
  8    3653651        920          0          0          2          2        458        458          0          0          0      20092
  9    5991221       1564          0          0          0          0        782        782          0          0          0       8149
 10   16753048       4406          0          0          5          5       2198       2198          0          0          0       3402
 11    5222175       1254          0          0          1          1        626        626          0          0          0      68583
 12    7072961       1726          0          0          0          0        863        863          0          0          0      10498
 13    5337727       1396          0          0          0          0        698        698          0          0          0      12368
 14    4940099       1278          0          0          4          4        635        635          0          0          0       7688
 15   30426436       7904          0          0         36         36       3916       3916          0          0          0      13480
 16          0          0          0          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100    WR48-63       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0

 *** Program elapsed time:   30.307s ( 1055.874 blocks/s,  65.992 Mb/s)
  654   Tue Jun 11 23:13:44 2024 TD00:00-08:00 Wednesday 11 June
00.08 DSSSD bias & leakage current OK - attachment 1

      FEE64 temperatures OK - attachment 3

      ADC data items stats OK - attachment 2
   
      per FEE64 Rate spectra - attachment 7

      per p+n FEE64 1.8.L spectra - attachments 6
       aida09 pulser peak width 63 ch FWHM 

      Merger, TapeServer etc - attachments 4-5

      analysis data file S181/R6_274 - attachment 8
       max FEE64 deadtime 19% aida08
       HEC data rate 3.8kHz, LEC data rate 2.258M

      per FEE64 1.8.W spectra - 20us FSR - attachments 9-10

03.12 Merger, TapeServer etc - attachments 11-12
       before & after Merger restart

      per FEE64 Rate spectra - attachment 13

      ADC data items stats OK - attachment 14
       aida02 zero rate

      FEE64 temperatures OK - attachment 15

      DSSSD bias & leakage current OK - attachment 16

      analysis data file S181/R6_372 - attachment 17
       max FEE64 deadtime 22% aida08
       HEC data rate 4.4kHz, LEC data rate 2.295M

03.32 all histograms zero'd

03.57 per p+n FEE64 1.8.L spectra - attachment 18
       25 mins = 1500 @ 2Hz = 3000 cf. peak area c. 3000 => deadtime low
Attachment 1: Screenshot_from_2024-06-12_00-08-05.png
Screenshot_from_2024-06-12_00-08-05.png
Attachment 2: Screenshot_from_2024-06-12_00-11-04.png
Screenshot_from_2024-06-12_00-11-04.png
Attachment 3: Screenshot_from_2024-06-12_00-08-40.png
Screenshot_from_2024-06-12_00-08-40.png
Attachment 4: Screenshot_from_2024-06-12_00-13-13.png
Screenshot_from_2024-06-12_00-13-13.png
Attachment 5: Screenshot_from_2024-06-12_00-12-56.png
Screenshot_from_2024-06-12_00-12-56.png
Attachment 6: Screenshot_from_2024-06-12_00-12-08.png
Screenshot_from_2024-06-12_00-12-08.png
Attachment 7: Screenshot_from_2024-06-12_00-15-36.png
Screenshot_from_2024-06-12_00-15-36.png
Attachment 8: R6_274
 *** TDR format 3.3.0 analyser - TD - May 2021
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  258999041 ( 2257638.6 Hz)
        Other data format:    2920959 (   25461.4 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:       1511 (      13.2 Hz)
                               RESUME:       1510 (      13.2 Hz)
                              SYNC100:      32427 (     282.7 Hz)
                              WR48-63:      32427 (     282.7 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:    2853084 (   24869.7 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:     439283 (    3829.1 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                              WR48-63:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:      114.721 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  0                0.601                0.000
  1                7.539                0.000
  2                0.326                0.000
  3               16.402                0.000
  4                0.635                0.000
  5               17.425                0.000
  6                0.097                0.000
  7               21.859                0.000
  8                0.128                0.000
  9                3.673                0.000
 10                3.675                0.000
 11                0.154                0.000
 12                0.891                0.000
 13                0.524                0.000
 14                0.022                0.000
 15                2.309                0.000
 16                0.000                0.000
 17                0.000                0.000
 18                0.000                0.000
 19                0.000                0.000
 20                0.000                0.000
 21                0.000                0.000
 22                0.000                0.000
 23                0.000                0.000
 24                0.000                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100    WR48-63       Disc        MBS      Other   HEC Data
  0   15369403       7472          0          0         46         46       1974       1974          0       3432          0      22292
  1   15769502       4294          0          0        112        112       2035       2035          0          0          0      29638
  2   14433962    1024458          0          0         14         14       1879       1879          0    1020672          0      10278
  3   20761922       5804          0          0        295        295       2607       2607          0          0          0      20061
  4    9340460     275709          0          0         19         19       1175       1175          0     273321          0       7943
  5   21823754       5845          0          0        181        180       2742       2742          0          0          0      18704
  6    5422542     230099          0          0          5          5        701        701          0     228687          0       9316
  7   37349907       9452          0          0        244        244       4482       4482          0          0          0     214200
  8    5081034       1202          0          0          1          1        600        600          0          0          0      10181
  9   31593425     999213          0          0        129        129       4047       4047          0     990861          0       8738
 10   17180710       4686          0          0        246        246       2097       2097          0          0          0       5196
 11    7163253     337989          0          0         11         11        928        928          0     336111          0      29914
 12    8343534       2202          0          0         50         50       1051       1051          0          0          0       7185
 13   14807749       3744          0          0         49         49       1823       1823          0          0          0      15937
 14    5467474       1324          0          0          3          3        659        659          0          0          0       5944
 15   29090410       7466          0          0        106        106       3627       3627          0          0          0      23756
 16          0          0          0          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100    WR48-63       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0

 *** Program elapsed time:   36.896s (  867.303 blocks/s,  54.206 Mb/s)
Attachment 9: Screenshot_from_2024-06-12_00-24-11.png
Screenshot_from_2024-06-12_00-24-11.png
Attachment 10: Screenshot_from_2024-06-12_00-23-16.png
Screenshot_from_2024-06-12_00-23-16.png
Attachment 11: Screenshot_from_2024-06-12_03-11-52.png
Screenshot_from_2024-06-12_03-11-52.png
Attachment 12: Screenshot_from_2024-06-12_03-05-47.png
Screenshot_from_2024-06-12_03-05-47.png
Attachment 13: Screenshot_from_2024-06-12_03-04-36.png
Screenshot_from_2024-06-12_03-04-36.png
Attachment 14: Screenshot_from_2024-06-12_03-04-13.png
Screenshot_from_2024-06-12_03-04-13.png
Attachment 15: Screenshot_from_2024-06-12_03-02-04.png
Screenshot_from_2024-06-12_03-02-04.png
Attachment 16: Screenshot_from_2024-06-12_03-01-26.png
Screenshot_from_2024-06-12_03-01-26.png
Attachment 17: R6_372
 *** TDR format 3.3.0 analyser - TD - May 2021
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  260609951 ( 2295050.9 Hz)
        Other data format:    1310049 (   11536.9 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:       1765 (      15.5 Hz)
                               RESUME:       1765 (      15.5 Hz)
                              SYNC100:      32423 (     285.5 Hz)
                              WR48-63:      32423 (     285.5 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:    1241673 (   10934.7 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:     498232 (    4387.7 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                              WR48-63:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:      113.553 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  0                0.716                0.000
  1                0.000                0.000
  2                0.675                0.000
  3               20.755                0.000
  4                8.029                0.000
  5               21.275                0.000
  6                0.025                0.000
  7               25.466                0.000
  8                0.004                0.000
  9                3.222                0.000
 10                3.079                0.000
 11                0.541                0.000
 12                3.417                0.000
 13                0.637                0.000
 14                0.101                0.000
 15                2.523                0.000
 16                0.000                0.000
 17                0.000                0.000
 18                0.000                0.000
 19                0.000                0.000
 20                0.000                0.000
 21                0.000                0.000
 22                0.000                0.000
 23                0.000                0.000
 24                0.000                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100    WR48-63       Disc        MBS      Other   HEC Data
  0   16545027       7593          0          0         61         61       2039       2039          0       3393          0      34807
  1          0          0          0          0          0          0          0          0          0          0          0          0
  2   16018011       4126          0          0         31         31       2032       2032          0          0          0      16400
  3   22563914       6244          0          0        367        367       2755       2755          0          0          0      27855
  4   14584632     380495          0          0        101        101       1904       1904          0     376485          0      10790
  5   23574124       6600          0          0        239        239       3061       3061          0          0          0      28773
  6    6172794     333349          0          0          6          6        797        797          0     331743          0      14869
  7   36993806       9704          0          0        287        287       4565       4565          0          0          0     198994
  8    6095601       1620          0          0          1          1        809        809          0          0          0      16000
  9   30899077       7806          0          0        122        122       3781       3781          0          0          0      13820
 10   16520099       4484          0          0        262        262       1980       1980          0          0          0       8141
 11   10197807     532664          0          0         39         39       1267       1267          0     530052          0      46994
 12   11352337       3042          0          0        119        119       1402       1402          0          0          0      10315
 13   14645959       3712          0          0         38         38       1818       1818          0          0          0      24695
 14    5727639       1460          0          0          7          7        723        723          0          0          0       9258
 15   28719124       7150          0          0         85         85       3490       3490          0          0          0      36521
 16          0          0          0          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100    WR48-63       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0

 *** Program elapsed time:   37.054s (  863.611 blocks/s,  53.976 Mb/s)
Attachment 18: Screenshot_from_2024-06-12_03-57-50.png
Screenshot_from_2024-06-12_03-57-50.png
  604   Wed Apr 24 21:39:51 2024 TD00:00-08:00 Thursday 25 April
22.43 24.4.24

      DSSSD bias & leakage current OK - attachment 1

      FEE64 temperatures OK - attachment 2

      ADC data item stats - attachment 3

      per FEE64 rate spectra - attachments 4

      Merger etc - attachment 5

      analysis of data file R18_266 - attachment 6
       max dead time 12% (aida04)
       no timewarps
       HEC data item rate 1.7kHz

03.37 DSSSD bias & leakage current OK - attachments 7-8

      FEE64 temperatures OK - attachment 9

      ADC data item stats - attachment 10

      per FEE64 rate spectra - attachments 11

      Merger etc - attachment 12
Attachment 1: Screenshot_from_2024-04-24_22-43-23.png
Screenshot_from_2024-04-24_22-43-23.png
Attachment 2: Screenshot_from_2024-04-24_22-43-58.png
Screenshot_from_2024-04-24_22-43-58.png
Attachment 3: Screenshot_from_2024-04-24_22-44-50.png
Screenshot_from_2024-04-24_22-44-50.png
Attachment 4: Screenshot_from_2024-04-24_22-45-35.png
Screenshot_from_2024-04-24_22-45-35.png
Attachment 5: Screenshot_from_2024-04-24_22-46-21.png
Screenshot_from_2024-04-24_22-46-21.png
Attachment 6: R18_266
 *** TDR format 3.3.0 analyser - TD - May 2021
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  254416606 (  820824.6 Hz)
        Other data format:    7503396 (   24208.2 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:        846 (       2.7 Hz)
                               RESUME:        846 (       2.7 Hz)
                              SYNC100:      33155 (     107.0 Hz)
                              WR48-63:      33155 (     107.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:    7435394 (   23988.8 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:     524404 (    1691.9 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                              WR48-63:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:      309.952 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  0                0.014                0.000
  1               16.009                0.000
  2                0.003                0.000
  3               37.388                0.000
  4                0.176                0.000
  5                0.544                0.000
  6                0.000                0.000
  7                0.784                0.000
  8                0.015                0.000
  9                0.000                0.000
 10                0.083                0.000
 11                0.004                0.000
 12                0.000                0.000
 13                0.000                0.000
 14                0.017                0.000
 15                0.227                0.000
 16                0.000                0.000
 17                0.000                0.000
 18                0.000                0.000
 19                0.000                0.000
 20                0.000                0.000
 21                0.000                0.000
 22                0.000                0.000
 23                0.000                0.000
 24                0.000                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100    WR48-63       Disc        MBS      Other   HEC Data
  0    6529814      10932          0          0          4          4        812        812          0       9300          0      46302
  1   32238460     350302          0          0        231        231       4129       4129          0     341582          0      92776
  2    8209450    3208628          0          0          2          2       1421       1421          0    3205782          0      32990
  3   48353626    2676061          0          0        374        374       6369       6369          0    2662575          0      27015
  4   10911439     520528          0          0          9          9       1454       1454          0     517602          0      45169
  5   18550590     703657          0          0         64         64       2488       2488          0     698553          0      35506
  6    6051492       1578          0          0          0          0        789        789          0          0          0      10690
  7   41812278      11146          0          0         85         85       5488       5488          0          0          0      97961
  8    3594476        900          0          0          4          4        446        446          0          0          0      18281
  9    5838926       1490          0          0          0          0        745        745          0          0          0       8125
 10   18621964       4722          0          0         27         27       2334       2334          0          0          0       3637
 11    5447469       1386          0          0          1          1        692        692          0          0          0      60590
 12    7038926       1642          0          0          0          0        821        821          0          0          0      12101
 13    5011795       1240          0          0          0          0        620        620          0          0          0      12487
 14    5028304       1286          0          0          2          2        641        641          0          0          0       7019
 15   31177597       7898          0          0         43         43       3906       3906          0          0          0      13755
 16          0          0          0          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100    WR48-63       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0

 *** Program elapsed time:   32.508s (  984.379 blocks/s,  61.524 Mb/s)
Attachment 7: Screenshot_from_2024-04-25_03-37-40.png
Screenshot_from_2024-04-25_03-37-40.png
Attachment 8: Screenshot_from_2024-04-25_03-38-57.png
Screenshot_from_2024-04-25_03-38-57.png
Attachment 9: Screenshot_from_2024-04-25_03-39-38.png
Screenshot_from_2024-04-25_03-39-38.png
Attachment 10: Screenshot_from_2024-04-25_03-40-20.png
Screenshot_from_2024-04-25_03-40-20.png
Attachment 11: Screenshot_from_2024-04-25_03-40-52.png
Screenshot_from_2024-04-25_03-40-52.png
Attachment 12: Screenshot_from_2024-04-25_03-41-31.png
Screenshot_from_2024-04-25_03-41-31.png
  658   Wed Jun 12 23:00:16 2024 Marc00:00-08:00 Thursday 13 June

Starting a new night shift - All good

1am full check:
DSSSD bias & leakage current  ok - attachment # 1-2
FEE64 temperatures  ok - attachment # 3
ADC data item stats - attachment # 4
Merger ok - Attachement # 5
Tape service - attachement # 6

2:30am: AIDA02 FEE stopped working. DESPEC main DAQ was alerted and remobe AIDA from timestitcher while I was restarting AIDA DAQ.

2:45am: AIDA02  FEE is back and AIDA has been added to the timestitcher again in the main DAQ.

The AIDA runs at the time of the crash to look at are R7_348, 349.

All spectra were zeroed at this time and checked.

4:00 am full check:
DSSSD bias & leakage current  ok - attachment # 7-8
FEE64 temperatures  ok - attachment # 9
ADC data item stats - attachment # 10
Merger ok - attachement # 11
Tape service - attachement # 12
Spectra - attachement # 13
ucesb - attachement # 14

6:00am full check:
DSSSD bias & leakage current  ok - attachment # 15-16
FEE64 temperatures  ok - attachment # 17
ADC data item stats - attachment # 18
Merger ok - attachement # 19
Tape service - attachement # 20
Spectra - attachement # 21
ucesb - attachement # 22

6:30 the nearline/offline analysis team reported possible noise issue in DSSD#2 and asked if the threshold were changed at any point. I can't find any mention of changes in the elog. 
I've not done a setup of the all DAQ when AIDA02 fee crashes earlier this morning. I just did a setup of the merger. Thus I don't think the threshold have changed when I stopeed and restarted the DAQ.
I can see that currently slow comparator threshod are set to 0xa for most of the DSSD2 fees except for AIDA06 which is set to 0xf. I'm not sure this is the thershold we would need to increase. Something to check during the next shift.

In the UCESB window I can see that the number of decay in DSSD2 is double the number of decay in DSSD1 while the number of implant is similar. Looking at other shift it looks that this was alsready the case in prvious shifts.

 

07.06 analysis of data file S181/R7_457 - attachment 23

 max deadtime 5.8% aida08, all other FEE64s < 1.4%

LEC data rate 1.788M, HEC data rate 4.3k

 

Attachment 1: Screenshot_from_2024-06-13_01-04-30.png
Screenshot_from_2024-06-13_01-04-30.png
Attachment 2: Screenshot_from_2024-06-13_01-06-23.png
Screenshot_from_2024-06-13_01-06-23.png
Attachment 3: Screenshot_from_2024-06-13_01-07-02.png
Screenshot_from_2024-06-13_01-07-02.png
Attachment 4: Screenshot_from_2024-06-13_01-07-36.png
Screenshot_from_2024-06-13_01-07-36.png
Attachment 5: Screenshot_from_2024-06-13_01-08-39.png
Screenshot_from_2024-06-13_01-08-39.png
Attachment 6: Screenshot_from_2024-06-13_01-08-02.png
Screenshot_from_2024-06-13_01-08-02.png
Attachment 7: Screenshot_from_2024-06-13_04-41-04.png
Screenshot_from_2024-06-13_04-41-04.png
Attachment 8: Screenshot_from_2024-06-13_04-41-38.png
Screenshot_from_2024-06-13_04-41-38.png
Attachment 9: Screenshot_from_2024-06-13_04-42-19.png
Screenshot_from_2024-06-13_04-42-19.png
Attachment 10: Screenshot_from_2024-06-13_04-42-45.png
Screenshot_from_2024-06-13_04-42-45.png
Attachment 11: Screenshot_from_2024-06-13_04-46-50.png
Screenshot_from_2024-06-13_04-46-50.png
Attachment 12: Screenshot_from_2024-06-13_04-47-09.png
Screenshot_from_2024-06-13_04-47-09.png
Attachment 13: Screenshot_from_2024-06-13_04-45-02.png
Screenshot_from_2024-06-13_04-45-02.png
Attachment 14: Screenshot_from_2024-06-13_04-48-07.png
Screenshot_from_2024-06-13_04-48-07.png
Attachment 15: Screenshot_from_2024-06-13_06-01-55.png
Screenshot_from_2024-06-13_06-01-55.png
Attachment 16: Screenshot_from_2024-06-13_06-02-13.png
Screenshot_from_2024-06-13_06-02-13.png
Attachment 17: Screenshot_from_2024-06-13_06-03-06.png
Screenshot_from_2024-06-13_06-03-06.png
Attachment 18: Screenshot_from_2024-06-13_06-02-41.png
Screenshot_from_2024-06-13_06-02-41.png
Attachment 19: Screenshot_from_2024-06-13_06-04-13.png
Screenshot_from_2024-06-13_06-04-13.png
Attachment 20: Screenshot_from_2024-06-13_06-04-37.png
Screenshot_from_2024-06-13_06-04-37.png
Attachment 21: Screenshot_from_2024-06-13_06-03-37.png
Screenshot_from_2024-06-13_06-03-37.png
Attachment 22: Screenshot_from_2024-06-13_06-05-30.png
Screenshot_from_2024-06-13_06-05-30.png
Attachment 23: R7_457
 *** TDR format 3.3.0 analyser - TD - May 2021
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  257532265 ( 1788132.4 Hz)
        Other data format:    4387735 (   30465.5 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:       1032 (       7.2 Hz)
                               RESUME:       1032 (       7.2 Hz)
                              SYNC100:      32537 (     225.9 Hz)
                              WR48-63:      32537 (     225.9 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:    4320597 (   29999.3 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:     613796 (    4261.8 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                              WR48-63:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:      144.023 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  0                0.236                0.000
  1                0.214                0.000
  2                0.096                0.000
  3                0.448                0.000
  4                0.012                0.000
  5                0.887                0.000
  6                0.003                0.000
  7                8.383                0.000
  8                0.002                0.000
  9                3.230                0.000
 10                1.587                0.000
 11                0.001                0.000
 12                0.000                0.000
 13                0.540                0.000
 14                0.000                0.000
 15                1.978                0.000
 16                0.000                0.000
 17                0.000                0.000
 18                0.000                0.000
 19                0.000                0.000
 20                0.000                0.000
 21                0.000                0.000
 22                0.000                0.000
 23                0.000                0.000
 24                0.000                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100    WR48-63       Disc        MBS      Other   HEC Data
  0   13645957       7863          0          0         38         38       1738       1738          0       4311          0      14717
  1    9668775       2474          0          0         22         22       1215       1215          0          0          0      34051
  2   13971257    1386114          0          0         14         14       1900       1900          0    1382286          0      19760
  3   18385419       4726          0          0         51         51       2312       2312          0          0          0      26170
  4    5575749     526316          0          0          3          3        775        775          0     524760          0       8695
  5   17895997       4760          0          0        110        110       2270       2270          0          0          0      31206
  6    5682061     408056          0          0          1          1        783        783          0     406488          0      19551
  7   46828757      11780          0          0        204        204       5686       5686          0          0          0     333264
  8    6455085       1532          0          0          1          1        765        765          0          0          0      22949
  9   38428621    1359707          0          0        141        141       4975       4975          0    1349475          0      21660
 10   18781575       5148          0          0        247        247       2327       2327          0          0          0      13075
 11    4229184     654561          0          0          1          1        641        641          0     653277          0      20787
 12    4432128       1092          0          0          0          0        546        546          0          0          0       5445
 13   14014813       3450          0          0         86         86       1639       1639          0          0          0      19095
 14    5156679       1244          0          0          0          0        622        622          0          0          0      13849
 15   34380208       8912          0          0        113        113       4343       4343          0          0          0       9522
 16          0          0          0          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100    WR48-63       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0

 *** Program elapsed time:   52.717s (  607.017 blocks/s,  37.939 Mb/s)
  614   Sat Apr 27 23:04:42 2024 Marc00:00-08:00 Sunday 28 April

Encore un matin, un matin pour ..... a shift !!!ramping up again ! S4 temperature not really going down either: 25C

0:40 AIDA04 is down. I informed the DAQ shift crew and attempting to restart AIDA04.

After rebooting AIDA04 all seemed going until I reached the merger check. No data was being merged.

I realise then that AIDA01 data transfer was not active. I did not spot it when I enabled the data transfer for all.

I stopped the daq and rebooted AIDA01 following all the instructions in the ELOG and this worked.

We are now back in business with AIDA back in main DAQ at  01:40

01:45 full checks:

           Bias: AIDA-Graphana - Attachment 1

               Leakage current ramping up again ! S4 temperaturenot really going down either: 25C

      FEE64 temperatures OK - attachment 2

      ADC data item stats - attachment 3

      per FEE64 Rate spectra - attachment 4

      Merger etc - attachment 5

      ucesb - attachment 6

03:00 full checks

          No change to be highlighted. All pretty much the same as during previous full checks.

05:00 full checks

Expt still running very smoothly.

           Bias: AIDA-Graphana - Attachment 7-8

               Leakage current going down slightly

      FEE64 temperatures OK - attachment 9

      ADC data item stats - attachment 10
ramping up again ! S4 temperaturenot really going down either: 25C
      per FEE64 Rate spectra - attachment 11

      Merger etc - attachment 12

      ucesb - attachment 13

07:15 all running smoothly.

07:20 Spoke too fast AIDA DAQ is down. DAQ shift crew informed.

07:40: AIDA10 was rebooted successfully and AIDA is now back in the main DAQ.

 

Attachment 1: Screenshot_from_2024-04-28_01-51-37.png
Screenshot_from_2024-04-28_01-51-37.png
Attachment 2: Screenshot_from_2024-04-28_01-53-29.png
Screenshot_from_2024-04-28_01-53-29.png
Attachment 3: Screenshot_from_2024-04-28_01-53-52.png
Screenshot_from_2024-04-28_01-53-52.png
Attachment 4: Screenshot_from_2024-04-28_01-54-16.png
Screenshot_from_2024-04-28_01-54-16.png
Attachment 5: Screenshot_from_2024-04-28_01-56-14.png
Screenshot_from_2024-04-28_01-56-14.png
Attachment 6: Screenshot_from_2024-04-28_04-59-46.png
Screenshot_from_2024-04-28_04-59-46.png
Attachment 7: Screenshot_from_2024-04-28_04-59-51.png
Screenshot_from_2024-04-28_04-59-51.png
Attachment 8: Screenshot_from_2024-04-28_05-00-33.png
Screenshot_from_2024-04-28_05-00-33.png
Attachment 9: Screenshot_from_2024-04-28_05-00-25.png
Screenshot_from_2024-04-28_05-00-25.png
Attachment 10: Screenshot_from_2024-04-28_05-00-38.png
Screenshot_from_2024-04-28_05-00-38.png
Attachment 11: Screenshot_from_2024-04-28_05-02-44.png
Screenshot_from_2024-04-28_05-02-44.png
Attachment 12: Screenshot_from_2024-04-28_05-00-03.png
Screenshot_from_2024-04-28_05-00-03.png
  611   Fri Apr 26 23:04:51 2024 Marc00:00-08:00 Saturday 27 April

It's a new day, it's a new shift and I'm feeeeeliiiiing goooood !!!!!

0.15 Checks:
      DSSSD bias & leakage current - Grafana - attachments 1-2
       leakage current dropped a bit since the evening shift ~22:00.

      FEE64 temperatures OK - attachment 3

      ADC data item stats - attachment 4

      per FEE64 Rate spectra - attachment 5

      Merger etc - attachment 6

      ucesb - attachment 7

2:20 Nothing new to report. All good. Leakage currents continue to go down slowly. See attachement 8 to 12

3:30 Still running smoothly. 

5:20 AIDA 4 stop counting in the last 20 min. I informed the main DAQ and they started a new run without AIDA.

        DAQ restarted OK. Main DAQ informed.

 

Attachment 1: Screenshot_from_2024-04-27_00-17-00.png
Screenshot_from_2024-04-27_00-17-00.png
Attachment 2: Screenshot_from_2024-04-27_00-16-16.png
Screenshot_from_2024-04-27_00-16-16.png
Attachment 3: Screenshot_from_2024-04-27_00-18-49.png
Screenshot_from_2024-04-27_00-18-49.png
Attachment 4: Screenshot_from_2024-04-27_00-19-05.png
Screenshot_from_2024-04-27_00-19-05.png
Attachment 5: Screenshot_from_2024-04-27_00-19-19.png
Screenshot_from_2024-04-27_00-19-19.png
Attachment 6: Screenshot_from_2024-04-27_00-21-44.png
Screenshot_from_2024-04-27_00-21-44.png
Attachment 7: Screenshot_from_2024-04-27_00-21-00.png
Screenshot_from_2024-04-27_00-21-00.png
Attachment 8: Screenshot_from_2024-04-27_02-32-22.png
Screenshot_from_2024-04-27_02-32-22.png
Attachment 9: Screenshot_from_2024-04-27_02-37-20.png
Screenshot_from_2024-04-27_02-37-20.png
Attachment 10: Screenshot_from_2024-04-27_02-37-31.png
Screenshot_from_2024-04-27_02-37-31.png
Attachment 11: Screenshot_from_2024-04-27_02-40-39.png
Screenshot_from_2024-04-27_02-40-39.png
Attachment 12: Screenshot_from_2024-04-27_02-41-13.png
Screenshot_from_2024-04-27_02-41-13.png
  649   Mon Jun 10 23:36:14 2024 TD0000-08:00 Tuesday 11 June
00.09 DSSSD bias & leakage current OK - attachment 1

      FEE64 temperatures OK - attachment 2

      ADC data items stats OK - attachment 3
   
      per FEE64 Rate spectra - attachment 4

      per p+n FEE64 1.8.L spectra - attachments 5-6
       aida09 pulser peak width 53 ch FWHM 

      per FEE64 1.8.H spectra - attachments 7-8

      per n+n FEE64 1.8.W spectra - 20us FSR - attachment 9
       p+n 1.8.W not running currently

      Merger, TapeServer etc - attachments 10-11

      analysis data file S181/R4_427 - attachment 12
       max FEE64 deadtime 1.7%
       HEC data rate 3.1kHz

00.28 all histograms zero'd


02.39 DAQ continues data file S181/R4_460
      Beam off since 02.08

      DSSSD bias & leakage current OK - attachment 13

      FEE64 temperatures OK - attachment 14

      ADC data items stats OK - attachment 15
       9x < 20k, max 239k aida08
   
      per FEE64 Rate spectra - attachment 16


07.15 DAQ continues data file S181/R4_517
      Beam off since 02.08
      HKR report c 3-4 h until UNILAC fixed

      DSSSD bias & leakage current OK - attachment 17

      FEE64 temperatures OK - attachment 18

      ADC data items stats OK - attachment 19
       8x < 20k, max 238k aida08
   
      per FEE64 Rate spectra - attachment 20
Attachment 1: Screenshot_from_2024-06-11_00-09-43.png
Screenshot_from_2024-06-11_00-09-43.png
Attachment 2: Screenshot_from_2024-06-11_00-10-36.png
Screenshot_from_2024-06-11_00-10-36.png
Attachment 3: Screenshot_from_2024-06-11_00-11-13.png
Screenshot_from_2024-06-11_00-11-13.png
Attachment 4: Screenshot_from_2024-06-11_00-11-45.png
Screenshot_from_2024-06-11_00-11-45.png
Attachment 5: Screenshot_from_2024-06-11_00-13-25.png
Screenshot_from_2024-06-11_00-13-25.png
Attachment 6: Screenshot_from_2024-06-11_00-16-14.png
Screenshot_from_2024-06-11_00-16-14.png
Attachment 7: Screenshot_from_2024-06-11_00-24-51.png
Screenshot_from_2024-06-11_00-24-51.png
Attachment 8: Screenshot_from_2024-06-11_00-25-44.png
Screenshot_from_2024-06-11_00-25-44.png
Attachment 9: Screenshot_from_2024-06-11_00-27-29.png
Screenshot_from_2024-06-11_00-27-29.png
Attachment 10: Screenshot_from_2024-06-11_00-29-21.png
Screenshot_from_2024-06-11_00-29-21.png
Attachment 11: Screenshot_from_2024-06-11_00-29-41.png
Screenshot_from_2024-06-11_00-29-41.png
Attachment 12: R4_427
 *** TDR format 3.3.0 analyser - TD - May 2021
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  256031206 ( 1090943.7 Hz)
        Other data format:    5888794 (   25092.0 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:        689 (       2.9 Hz)
                               RESUME:        689 (       2.9 Hz)
                              SYNC100:      32874 (     140.1 Hz)
                              WR48-63:      32874 (     140.1 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:    5821668 (   24806.0 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:     725584 (    3091.7 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                              WR48-63:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:      234.688 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  0                0.082                0.000
  1                0.081                0.000
  2                0.099                0.000
  3                1.580                0.000
  4                0.860                0.000
  5                0.325                0.000
  6                0.000                0.000
  7                4.102                0.000
  8                0.020                0.000
  9                2.330                0.000
 10                0.170                0.000
 11                0.000                0.000
 12                0.000                0.000
 13                0.000                0.000
 14                0.000                0.000
 15                0.981                0.000
 16                0.000                0.000
 17                0.000                0.000
 18                0.000                0.000
 19                0.000                0.000
 20                0.000                0.000
 21                0.000                0.000
 22                0.000                0.000
 23                0.000                0.000
 24                0.000                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100    WR48-63       Disc        MBS      Other   HEC Data
  0    3851535       8075          0          0          3          3        517        517          0       7035          0      14311
  1   10547580       2760          0          0          9          9       1371       1371          0          0          0      35298
  2    7097044    2015426          0          0          1          1       1095       1095          0    2013234          0      19431
  3   24895003       6544          0          0        192        192       3080       3080          0          0          0      27887
  4    3219755     585586          0          0          4          4        493        493          0     584592          0      17915
  5   19996310       5104          0          0         46         46       2506       2506          0          0          0      32222
  6    5825374     446331          0          0          0          0        741        741          0     444849          0      18892
  7   61314555      15906          0          0        191        191       7762       7762          0          0          0     429462
  8    8374860       2050          0          0          1          1       1024       1024          0          0          0      21845
  9   43291179    2005473          0          0        168        168       5805       5805          0    1993527          0      21309
 10   13902520       3510          0          0          6          6       1749       1749          0          0          0      12563
 11    2813051     779317          0          0          0          0        443        443          0     778431          0      21093
 12    5093380       1266          0          0          0          0        633        633          0          0          0      11468
 13    7142579       1774          0          0          0          0        887        887          0          0          0      18724
 14    3712134        902          0          0          0          0        451        451          0          0          0      12892
 15   34954347       8770          0          0         68         68       4317       4317          0          0          0      10272
 16          0          0          0          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100    WR48-63       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0

 *** Program elapsed time:   34.627s (  924.132 blocks/s,  57.758 Mb/s)
Attachment 13: Screenshot_from_2024-06-11_02-36-59.png
Screenshot_from_2024-06-11_02-36-59.png
Attachment 14: Screenshot_from_2024-06-11_02-41-01.png
Screenshot_from_2024-06-11_02-41-01.png
Attachment 15: Screenshot_from_2024-06-11_02-41-50.png
Screenshot_from_2024-06-11_02-41-50.png
Attachment 16: Screenshot_from_2024-06-11_02-42-40.png
Screenshot_from_2024-06-11_02-42-40.png
Attachment 17: Screenshot_from_2024-06-11_07-13-28.png
Screenshot_from_2024-06-11_07-13-28.png
Attachment 18: Screenshot_from_2024-06-11_07-15-41.png
Screenshot_from_2024-06-11_07-15-41.png
Attachment 19: Screenshot_from_2024-06-11_07-16-08.png
Screenshot_from_2024-06-11_07-16-08.png
Attachment 20: Screenshot_from_2024-06-11_07-16-35.png
Screenshot_from_2024-06-11_07-16-35.png
  589   Mon Apr 22 22:35:59 2024 TD00.00-08.00 Tuesday 22 April
23.36 Analysis of data file R17_34 - attachment 1
      max deadtime c. 1% (aida02)
      no timewarps

23.38 DSSSD bias & leakage current OK - attachment 2

      FEE64 temperatures OK - attachment 3
       aida02 ASIC temp - known fault

      ADC data item stats - attachment 4

      per FEE64 Rate spectra - attachment 5

      Merger etc - attachment 6

01.03 DSSSD bias & leakage current OK - attachment 7

      FEE64 temperatures OK - attachment 8
       aida02 ASIC temp - known fault

      ADC data item stats - attachment 9

      per FEE64 Rate spectra - attachment 10

      Merger etc - attachment 11

03.06 DSSSD bias & leakage current OK - attachment 12

      FEE64 temperatures OK - attachment 13
       aida02 ASIC temp - known fault

      ADC data item stats - attachment 14

      per FEE64 Rate spectra - attachment 15

      Merger etc - attachment 16

05.04 DSSSD bias & leakage current OK - attachment 17

      FEE64 temperatures OK - attachment 18
       aida02 ASIC temp - known fault

      ADC data item stats - attachment 19

      per FEE64 Rate spectra - attachment 20

      Merger etc - attachment 21

07.29 DSSSD bias & leakage current OK - attachment 22

      FEE64 temperatures OK - attachment 23
       aida02 ASIC temp - known fault

      ADC data item stats - attachment 24

      per FEE64 Rate spectra - attachment 25

      Merger etc - attachment 26
Attachment 1: R17_34
 *** TDR format 3.3.0 analyser - TD - May 2021
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  242086746 (  241481.1 Hz)
        Other data format:   19833254 (   19783.6 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:        347 (       0.3 Hz)
                               RESUME:        347 (       0.3 Hz)
                              SYNC100:      35735 (      35.6 Hz)
                              WR48-63:      35735 (      35.6 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:   19761090 (   19711.7 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:     676877 (     675.2 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                              WR48-63:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:     1002.508 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  0                0.000                0.000
  1                7.276                0.000
  2                0.000                0.000
  3                3.384                0.000
  4                0.000                0.000
  5                0.005                0.000
  6                0.000                0.000
  7                0.131                0.000
  8                0.000                0.000
  9                0.000                0.000
 10                0.000                0.000
 11                0.000                0.000
 12                0.000                0.000
 13                0.000                0.000
 14                0.000                0.000
 15                0.020                0.000
 16                0.000                0.000
 17                0.000                0.000
 18                0.000                0.000
 19                0.000                0.000
 20                0.000                0.000
 21                0.000                0.000
 22                0.000                0.000
 23                0.000                0.000
 24                0.000                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100    WR48-63       Disc        MBS      Other   HEC Data
  0    2611636      30762          0          0          0          0        342        342          0      30078          0      64523
  1   15105593     133663          0          0        117        117       1949       1949          0     129531          0      31773
  2    4737354    9053995          0          0          0          0       1811       1811          0    9050373          0      45719
  3   93081574    8973436          0          0        187        187      14170      14170          0    8944722          0      56135
  4    2149658     687339          0          0          0          0        339        339          0     686661          0      47171
  5   16270251     924233          0          0          3          3       2251       2251          0     919725          0      42612
  6    4771409       1270          0          0          0          0        635        635          0          0          0      12858
  7   64665607      18074          0          0         39         39       8998       8998          0          0          0     197755
  8    1902284        428          0          0          0          0        214        214          0          0          0      25268
  9    4387089       1362          0          0          0          0        681        681          0          0          0      10256
 10    8523582       2388          0          0          0          0       1194       1194          0          0          0       4627
 11    2287700        576          0          0          0          0        288        288          0          0          0      83305
 12    4391198       1112          0          0          0          0        556        556          0          0          0      12633
 13    3103598        860          0          0          0          0        430        430          0          0          0      15208
 14    1965500        506          0          0          0          0        253        253          0          0          0      10217
 15   12132713       3250          0          0          1          1       1624       1624          0          0          0      16817
 16          0          0          0          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100    WR48-63       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0

 *** Program elapsed time:   30.539s ( 1047.838 blocks/s,  65.490 Mb/s)
Attachment 2: Screenshot_from_2024-04-22_23-38-08.png
Screenshot_from_2024-04-22_23-38-08.png
Attachment 3: Screenshot_from_2024-04-22_23-39-17.png
Screenshot_from_2024-04-22_23-39-17.png
Attachment 4: Screenshot_from_2024-04-22_23-39-44.png
Screenshot_from_2024-04-22_23-39-44.png
Attachment 5: Screenshot_from_2024-04-22_23-40-27.png
Screenshot_from_2024-04-22_23-40-27.png
Attachment 6: Screenshot_from_2024-04-22_23-40-54.png
Screenshot_from_2024-04-22_23-40-54.png
Attachment 7: Screenshot_from_2024-04-23_01-04-32.png
Screenshot_from_2024-04-23_01-04-32.png
Attachment 8: Screenshot_from_2024-04-23_01-05-40.png
Screenshot_from_2024-04-23_01-05-40.png
Attachment 9: Screenshot_from_2024-04-23_01-06-12.png
Screenshot_from_2024-04-23_01-06-12.png
Attachment 10: Screenshot_from_2024-04-23_01-06-40.png
Screenshot_from_2024-04-23_01-06-40.png
Attachment 11: Screenshot_from_2024-04-23_01-07-18.png
Screenshot_from_2024-04-23_01-07-18.png
Attachment 12: Screenshot_from_2024-04-23_03-06-28.png
Screenshot_from_2024-04-23_03-06-28.png
Attachment 13: Screenshot_from_2024-04-23_03-07-02.png
Screenshot_from_2024-04-23_03-07-02.png
Attachment 14: Screenshot_from_2024-04-23_03-07-35.png
Screenshot_from_2024-04-23_03-07-35.png
Attachment 15: Screenshot_from_2024-04-23_03-08-09.png
Screenshot_from_2024-04-23_03-08-09.png
Attachment 16: Screenshot_from_2024-04-23_03-08-43.png
Screenshot_from_2024-04-23_03-08-43.png
Attachment 17: Screenshot_from_2024-04-23_05-02-11.png
Screenshot_from_2024-04-23_05-02-11.png
Attachment 18: Screenshot_from_2024-04-23_05-03-10.png
Screenshot_from_2024-04-23_05-03-10.png
Attachment 19: Screenshot_from_2024-04-23_05-03-57.png
Screenshot_from_2024-04-23_05-03-57.png
Attachment 20: Screenshot_from_2024-04-23_05-04-37.png
Screenshot_from_2024-04-23_05-04-37.png
Attachment 21: Screenshot_from_2024-04-23_05-05-13.png
Screenshot_from_2024-04-23_05-05-13.png
Attachment 22: Screenshot_from_2024-04-23_07-29-15.png
Screenshot_from_2024-04-23_07-29-15.png
Attachment 23: Screenshot_from_2024-04-23_07-29-59.png
Screenshot_from_2024-04-23_07-29-59.png
Attachment 24: Screenshot_from_2024-04-23_07-30-27.png
Screenshot_from_2024-04-23_07-30-27.png
Attachment 25: Screenshot_from_2024-04-23_07-30-54.png
Screenshot_from_2024-04-23_07-30-54.png
Attachment 26: Screenshot_from_2024-04-23_07-31-16.png
Screenshot_from_2024-04-23_07-31-16.png
  661   Thu Jun 13 23:04:01 2024 Dan Judson, TD0.00-8.00 14/6/24

0.00 checks - all looks ok

Voltage/currents - attachment 1

Rates attachment 2 + 3

Temps - attachment 4

Merger - attachment 5

ucesb - attachment 6

Grafana - attachment 7

 

1.30 -aida1 in merger Links, aida02 in rate spectra, has stopped - resetting DAQ.

Datafile R7_961 being written when stopped

1.40 - seems ok

 

1.50 checks - seems ok

Voltage/currents - attachment 8

Rates attachment 9 + 10

Temps - attachment 11

Merger - attachment 12

ucesb - attachment 13

Grafana - attachment 14

 

3.30 -aida1 in merger Links, aida02 in rate spectra, has stopped again - resetting DAQ.

Datafile R7_1010 being written when stopped

3.38 - seems ok

 

3.40 checks - all looks ok

Voltage/currents - attachment 15

Rates attachment 16 + 17

Temps - attachment 18

Merger - attachment 19

ucesb - attachment 20

Grafana - attachment 21

 

Zeroed spectra - attachments 22-28

 

 

5.39 -aida1 in merger Links, aida02 in rate spectra, has stopped again - resetting DAQ.

Datafile R7_1062 being written when stopped

AIDA out of the main data

Could not get it to restart folowing the notes on the elog - SOAP errors as shown in attachment 29. called Tom who''s logged in 

6.10 - seems to be working again. Not sure what happened. Tom thinks multiple restarts fixed it

Started data file R8

AIDA back in the main data

 

FRS shifters report a problem with the AIDA white rabbit time stamp - attachment 30

The following are timestamp values from each of the FEEs taken in sequence
If time does not increase in a reasonable manner run the system wide checks

aida01 : White Rabbit=>  17D8C4ED 8F46CF7B , WR/10=>   2627A17C18714BF, Readout Time =>   2627A17C2A74000
aida02 : White Rabbit=>  17D8C4ED A0A1B623 , WR/10=>   2627A17C3435F03, Readout Time =>   2627A17C4410000
aida03 : White Rabbit=>  17D8C4ED AFDACE68 , WR/10=>   2627A17C4C914A4, Readout Time =>   2627A17C5D3C000
aida04 : White Rabbit=>  17D8C4ED C0516FC2 , WR/10=>   2627A17C66E8B2D, Readout Time =>   2627A17C7AC4000
aida05 : White Rabbit=>  17D8C4ED D3B93DAB , WR/10=>   2627A17C85F52F7, Readout Time =>   2627A17C9AEC000
aida06 : White Rabbit=>  17D8C4ED E8C9B243 , WR/10=>   2627A17CA7A91D3, Readout Time =>   2627A17CB704000
aida07 : White Rabbit=>  17D8C4ED FFE475FD , WR/10=>   2627A17CCCA0BCC, Readout Time =>   2627A17CDD94000
aida08 : White Rabbit=>  17D8C4EE 103232A6 , WR/10=>   2627A17CE6B6B77, Readout Time =>   2627A17CF7BC000
aida09 : White Rabbit=>  17D8C4EE 20A1F612 , WR/10=>   2627A17D0103235, Readout Time =>   2627A17D112C000
aida10 : White Rabbit=>  17D8C4EE 307D8FE7 , WR/10=>   2627A17D1A627FD, Readout Time =>   2627A17D2958000
aida11 : White Rabbit=>  17D8C4EE 4402829D , WR/10=>   2627A17D399D9DC, Readout Time =>   2627A17D4570000
aida12 : White Rabbit=>  17D8C4EE 6288B04D , WR/10=>   2627A17D6A744D4, Readout Time =>   2627A17D7D94000
aida13 : White Rabbit=>  17D8C4EE 751E1306 , WR/10=>   2627A17D88301E7, Readout Time =>   2627A17D9C34000
aida14 : White Rabbit=>  17D8C4EE 894E8806 , WR/10=>   2627A17DA87DA67, Readout Time =>   2627A17DBFF4000
aida15 : White Rabbit=>  17D8C4EE 9EEEB997 , WR/10=>   2627A17DCB178F5, Readout Time =>   2627A17DDC18000
aida16 : White Rabbit=>  17D8C4EE AF0BC923 , WR/10=>   2627A17DE4DFA83, Readout Time =>   2627A17DF5C8000

Tom thinks everything appears ok with AIDA

Have converted WR timestamp to data/time - see attachment 40

At the ~second timescale AIDA WR timestamp looks OK, i.e. no gross errors. Will need to check correlations with other detector sub-systems to confirm WR on the ~us time timescale.. 

However, ~10us offset reported by DESPEC online crew is correct (AIDA timestamps data at a later point in the signal processing cycle than other detector sub-systems). Have suggested online crew contact Nic or Calum to check what the AIDA WR timediff spectra should look like.

 

 

7.00 checks - all looks ok

Voltage/currents - attachment 31

Rates attachment 32 + 33

Temps - attachment 36

Merger - attachment 37

ucesb - attachment 39

Grafana - attachment 38

 

Handed over to Tom

 

Attachment 1: Screenshot_from_2024-06-13_23-58-44.png
Screenshot_from_2024-06-13_23-58-44.png
Attachment 2: Screenshot_from_2024-06-13_23-59-34.png
Screenshot_from_2024-06-13_23-59-34.png
Attachment 3: Screenshot_from_2024-06-14_00-00-09.png
Screenshot_from_2024-06-14_00-00-09.png
Attachment 4: Screenshot_from_2024-06-14_00-00-43.png
Screenshot_from_2024-06-14_00-00-43.png
Attachment 5: Screenshot_from_2024-06-14_00-01-36.png
Screenshot_from_2024-06-14_00-01-36.png
Attachment 6: Screenshot_from_2024-06-14_00-02-45.png
Screenshot_from_2024-06-14_00-02-45.png
Attachment 7: Screenshot_from_2024-06-14_00-03-26.png
Screenshot_from_2024-06-14_00-03-26.png
Attachment 8: Screenshot_from_2024-06-14_01-47-38.png
Screenshot_from_2024-06-14_01-47-38.png
Attachment 9: Screenshot_from_2024-06-14_01-48-12.png
Screenshot_from_2024-06-14_01-48-12.png
Attachment 10: Screenshot_from_2024-06-14_01-48-45.png
Screenshot_from_2024-06-14_01-48-45.png
Attachment 11: Screenshot_from_2024-06-14_01-49-16.png
Screenshot_from_2024-06-14_01-49-16.png
Attachment 12: Screenshot_from_2024-06-14_01-49-48.png
Screenshot_from_2024-06-14_01-49-48.png
Attachment 13: Screenshot_from_2024-06-14_01-50-46.png
Screenshot_from_2024-06-14_01-50-46.png
Attachment 14: Screenshot_from_2024-06-14_01-51-18.png
Screenshot_from_2024-06-14_01-51-18.png
Attachment 15: Screenshot_from_2024-06-14_03-40-33.png
Screenshot_from_2024-06-14_03-40-33.png
Attachment 16: Screenshot_from_2024-06-14_03-40-56.png
Screenshot_from_2024-06-14_03-40-56.png
Attachment 17: Screenshot_from_2024-06-14_03-41-35.png
Screenshot_from_2024-06-14_03-41-35.png
Attachment 18: Screenshot_from_2024-06-14_03-42-15.png
Screenshot_from_2024-06-14_03-42-15.png
Attachment 19: Screenshot_from_2024-06-14_03-42-42.png
Screenshot_from_2024-06-14_03-42-42.png
Attachment 20: Screenshot_from_2024-06-14_03-43-39.png
Screenshot_from_2024-06-14_03-43-39.png
Attachment 21: Screenshot_from_2024-06-14_03-44-11.png
Screenshot_from_2024-06-14_03-44-11.png
Attachment 22: Screenshot_from_2024-06-14_03-53-08.png
Screenshot_from_2024-06-14_03-53-08.png
Attachment 23: Screenshot_from_2024-06-14_03-53-51.png
Screenshot_from_2024-06-14_03-53-51.png
Attachment 24: Screenshot_from_2024-06-14_03-54-36.png
Screenshot_from_2024-06-14_03-54-36.png
Attachment 25: Screenshot_from_2024-06-14_03-55-19.png
Screenshot_from_2024-06-14_03-55-19.png
Attachment 26: Screenshot_from_2024-06-14_03-55-50.png
Screenshot_from_2024-06-14_03-55-50.png
Attachment 27: Screenshot_from_2024-06-14_03-56-56.png
Screenshot_from_2024-06-14_03-56-56.png
Attachment 28: Screenshot_from_2024-06-14_03-58-10.png
Screenshot_from_2024-06-14_03-58-10.png
Attachment 29: Screenshot_from_2024-06-14_05-52-47.png
Screenshot_from_2024-06-14_05-52-47.png
Attachment 30: Screenshot_2024-06-14_at_05.31.21.png
Screenshot_2024-06-14_at_05.31.21.png
Attachment 31: Screenshot_from_2024-06-14_07-02-14.png
Screenshot_from_2024-06-14_07-02-14.png
Attachment 32: Screenshot_from_2024-06-14_07-00-53.png
Screenshot_from_2024-06-14_07-00-53.png
Attachment 33: Screenshot_from_2024-06-14_07-01-20.png
Screenshot_from_2024-06-14_07-01-20.png
Attachment 34: Screenshot_from_2024-06-14_07-01-55.png
Screenshot_from_2024-06-14_07-01-55.png
Attachment 35: Screenshot_from_2024-06-14_07-02-47.png
Screenshot_from_2024-06-14_07-02-47.png
Attachment 36: Screenshot_from_2024-06-14_07-01-55.png
Screenshot_from_2024-06-14_07-01-55.png
Attachment 37: Screenshot_from_2024-06-14_07-02-47.png
Screenshot_from_2024-06-14_07-02-47.png
Attachment 38: Screenshot_from_2024-06-14_07-03-23.png
Screenshot_from_2024-06-14_07-03-23.png
Attachment 39: Screenshot_from_2024-06-14_07-04-01.png
Screenshot_from_2024-06-14_07-04-01.png
Attachment 40: Capture.PNG
Capture.PNG
  543   Wed Mar 20 17:02:53 2024 NH/dev/sdd
The following messages are in the system log very often:

Mar 20 18:00:56 aidas-gsi smartd[1076]: Device: /dev/sdd [SAT], 2224 Currently unreadable (pending) sectors
Mar 20 18:00:56 aidas-gsi smartd[1076]: Device: /dev/sdd [SAT], 257 Offline uncorrectable sectors

This (to me) suggests /dev/sdd may be failing. It should be backed up and later replaced (it is not used at the moment for /TapeData, older disk)
  129   Fri Feb 21 09:21:10 2020 NH(Early) Alpha Analysis
Overnight alpha data

======================================
AIDA Unpacker Analysis
--------------------------------------
First event: Thu Feb 20 17:46:47 2020
Last event : Fri Feb 21 10:07:57 2020
Duration   : 58869.9 seconds
--------------------------------------
MBS Events   (M):     1248648 (21 Hz)
AIDA Words   (W): 10222680133 (27 kHz)
ADC Words    (A):  3407431088 (-15076 Hz)
-- Decays    (D):  3407017078 (-15083 Hz)
-- Implants  (I):      414010 (7 Hz)
Info Words   (F):  6815249045 (-30146 Hz)
-- SYNC48    (S):  3407559635 (-15074 Hz)
-- SYNC63    (s):  3407559635 (-15074 Hz)
-- PAUSE     (P):         614 (0 Hz)
-- RESUME    (R):         614 (0 Hz)
-- Discrim   (D):      128547 (2 Hz)
-- Unknown   (U):           0 (0 Hz)
Timewarps    (T):          79 (0 Hz)
Dead Time    (X): 26.8658 s (0.04563588%)
======================================
======================================
Individual FEE Overview
======================================
 FEE |           W           A           D           I           F           S           s     P     R       D     U     T  X
   1 |        5025        1246        1093         153        3779        1675        1675     0     0     429     0     0  0
   2 |        6180         991         851         140        5189        2060        2060     0     0    1069     0     0  0
   3 |  7692461404  2564028610  2564028286         324  5128432794  2564153392  2564153392   614   614 	124782     0    58 26.8658
   4 |        2277         642         581          61        1635         759         759     0     0     117     0     0  0
   5 |        6174        1249        1010         239        4925        2058        2058     0     0     809     0     0  0
   6 |     2467062      822244      822191          53     1644818      822354      822354     0     0     110     0     0  0
   7 |        2484         740         701          39        1744         828         828     0     0      88     0     0  0
   8 |   358445004   119481621   119069026      412595   238963383   119481668   119481668     0     0      47     0     1  0
   9 |        7134        1530        1243         287        5604        2378        2378     0     0     848     0     0  0
  10 |  2168031885   722677295   722677295           0  1445354590   722677295   722677295     0     0       0     0    20  0
  11 |        3981        1252        1190          62        2729        1327        1327     0     0      75     0     0  0
  12 |     1241523      413668      413611          57      827855      413841      413841     0     0     173     0     0  0
**** DESPECAnalysis: PostLoop

A few FEEs running "hot", maybe check. 3 had some alignment issues may need rechecking.
Timewarps somehow in aida03 and aida10 but may be code mistake - must check.
Only aida03 ran fast enough to have dead time.

aida10 shows decay data now - DSSD seems ok

Fig 1: DSSD 1D hit pattern 

Fig 2: DSSD Energy

Fig 3: Single channel in aida03 that is hot

Fig 4: Channels 48-64 in aida08 are hot (wiring?)

Fig 5: Channels 17, 19 (crosstalk?) and 27, 33, 38, 39

All otehr channels quiet and OK. 
Attachment 1: DSSD_1d_HP.png
DSSD_1d_HP.png
Attachment 2: DSSD_E.png
DSSD_E.png
Attachment 3: FEE3_43_Hot.png
FEE3_43_Hot.png
Attachment 4: fee8_hot.png
fee8_hot.png
Attachment 5: Fee10_hot.png
Fee10_hot.png
  663   Fri Jun 14 15:00:47 2024 Norah , Muneerah 16:00-20:00 Friday 14 June

Everything appears to be running smoothly. Attachments 1-4 were taken around 16:00

DSSSD Bias & Leakage Current - Check: OK (see attachment 1)
FEE64 Temperature - Check: OK (see attachment 2)
ADC Data Item Stats and Spectrum Browser - Check: OK (see attachments 3 and 4)

Another set of screenshots was taken around 18:00, and everything looks good.

DSSSD bias & leakage current  ok - attachment # 5-6
FEE64 temperatures  ok - attachment # 7
ADC data item stats - attachment # 8
Merger ok - Attachement #9
Tape service - attachement # 10
ucesb - attachment #11

At 19:17, AIDA03 temperatures gave no response (see attachment 12), but after two minutes, they returned to normal.

I noted that the  bplse in ucesb has no data (see attachment 13). It may need to change the disc thresholds again
 it does not affect AIDA

At 19:30 most aida temperature are high and I spoke to people on site via zoom one of them she is working with AIDA so she was able to help. She called Nick and it is found that there is a problem in the cooling system so she stopped AIDA

At 22 the cooling system fixed and Nic and the other person on site restarted AIDA

 

 

 

 

 

Attachment 1: Screenshot_from_2024-06-14_16-06-09.png
Screenshot_from_2024-06-14_16-06-09.png
Attachment 2: Screenshot_from_2024-06-14_16-04-58.png
Screenshot_from_2024-06-14_16-04-58.png
Attachment 3: Screenshot_from_2024-06-14_16-04-23.png
Screenshot_from_2024-06-14_16-04-23.png
Attachment 4: Screenshot_from_2024-06-14_16-05-33.png
Screenshot_from_2024-06-14_16-05-33.png
Attachment 5: Screenshot_from_2024-06-14_18-02-36.png
Screenshot_from_2024-06-14_18-02-36.png
Attachment 6: Screenshot_from_2024-06-14_18-02-08.png
Screenshot_from_2024-06-14_18-02-08.png
Attachment 7: Screenshot_from_2024-06-14_18-04-40.png
Screenshot_from_2024-06-14_18-04-40.png
Attachment 8: Screenshot_from_2024-06-14_18-05-44.png
Screenshot_from_2024-06-14_18-05-44.png
Attachment 9: Screenshot_from_2024-06-14_18-08-50.png
Screenshot_from_2024-06-14_18-08-50.png
Attachment 10: Screenshot_from_2024-06-14_18-11-04.png
Screenshot_from_2024-06-14_18-11-04.png
Attachment 11: Screenshot_from_2024-06-14_18-17-15.png
Screenshot_from_2024-06-14_18-17-15.png
Attachment 12: Screenshot_from_2024-06-14_19-23-32.png
Screenshot_from_2024-06-14_19-23-32.png
Attachment 13: Screenshot_from_2024-06-14_19-35-11.png
Screenshot_from_2024-06-14_19-35-11.png
ELOG V3.1.3-7933898