AIDA GELINA BRIKEN nToF CRIB ISOLDE CIRCE nTOFCapture DESPEC DTAS EDI_PSA 179Ta CARME StellarModelling DCF K40
  AIDA  ELOG logo
Message ID: 843     Entry time: Sat Jun 15 16:53:22 2019
Author: CB, OH, DK, ML 
Subject: Sunday 16 June 
00.30 AIDA file R2_26
      DTAS run 007
      BigRIPS run 2006

00:55
      Merger status - attachment 1
      TapeSever status - attachment 2

01:40
      Before zeroing stats - attachment 3
      Histos up to now saved in /homes/npg/spectra/specs-2019Jun16-01.46.50
      Before zeroing histos - XY attachment 4

02:22  Up to AIDA R2_41
      Stats - attachment 5
      XY implants - attachment 6

02:29 AIDA R2_42 
      DTAS run 011
      BigRIPS still 2006

04:08 Up to AIDA R2_55
      Temps - attachment 7
      Biases - attachment 8
      Stats - attachment 9
      XY implants - attachment 10

04:50 Did some major UI updates to merger /data02/2019data/dtas/scripts/parallelscript/runall_xe19_dev.sh
         If no parameters are passed, it asks to select each option one-by-one, showing available options
             For DTAS, if there is only one run for a given header, it automatically selects it
         After that, it checks that all the raw files actually exist
         Finally, it composes the command, asks the user if it looks OK, and then launches the script (or quits)
         (For experts, it can still take the original case where all 7 parameters are passed at the command line)
         There may still be some minor bugs, so for now we don't replace the original one until Alvaro can check

06:09 Stats - attachment 11
      XY implant profiles -- attachment 12

06:30 DTAS 018; AIDA R2_80; BigRIPS 2009

Things getting a bit noisier?
      Merger - attachment 13
      TapeServer - attachment 14
      Stats - attachment 15

   The FEEs corresponding to DSSSD1 are all showing factors 2 to 10 higher than just 30 min. ago

   F11 rates still near 180 cps, primary beam still around 130 pnA.

06:43 Before I can diagnose the high noise problem in DSSSD1, it goes back to normal
      Merger - attachment 16
      TapeServer - attachment 17
      Stats - attachment 18
   Maybe the issue was from looking at the details too often :)

07:46 Shift change.

      DAQ continues running OK.
      Statistics show  noisy DSSD #1 (100-200kHz) - see attach 19
      Tapeserver also shows higher than normal write to disk rate - see attach 20
      After a few seconds write to disk rate goes back to normal - see attach 21
      Data items rate looks OK (500k). This was checked after the rates in DSSD#1 went back to normal - see attach 22
      FEE64 temperatures OK - see attach 23
      Implants look OK - see attach 24

      System-wide checks OK except nnaida7 fails ADC calibration as usual.

      Reset Statistics
      Stats now OK - see attach 25

      Reset HEC implants

      Timewarp events appear to be very frequent, consistently every 3-5 seconds.
      This seems to have been happening ever since beam was put on target.
      Analysed R2_94 using analyser in Desktop 3. No timewarps reported. See attach 26.
      
08:32 AIDA: R2_100,
      DTAS: 21  ,
      BigRips: 2010   

08:41 Another noise spike from DSSD#1
      Observed up to 1,600k data items per second - see attach 27
      Write to disk ~10 MB/s as before.
      See LEC xy plot - attach 28
      HEC xy plot shows no hints of issues - see attach 29
      
      Rate seems manageable - see attach 30 for analysis of noisy run R2_103. 
      Note few seconds deadtime in some FEE64 and unequal number of Pause/Resume in nnaida 22      

09:45 Rate in DSSD#1 back to normal. Data rate 500k, Write to disk 5 Mb/s.

10:00 Started compressing R2_* files to save disk space.
      Used nice gzip to compress to avoid conflicts with the DAQ.
      Status of compression can be checked in ELOG desktop in the terminal window running ls -alth

10:32 DTAS and BigRIPS stop runs
      AIDA on file R2_128

      DTAS:24
      BigRIPS 2011

10:56 Lost beam. BigRIPS and DTAS DAQs continue running. Accelerator operators advise beam should be back in 10 minutes.

11:12 Beam is back. BigRIPS & DTAS continue running and did not stop. AIDA file R2_133.

11:25 System-wide checks OK except nnaida7 fails ADC calibration as usual.
      Stats OK, but nnaida19 is a bit more noisy than befor (80k) - see attach 31
      Temperatures OK - see attach 32
      TapeServer & Merger OK - see attach 33, 34 - rates have been low since 10 am
      HEC xy plot OK - see attach 35

      Reset online spectra

      Leakage current OK - attach 36
     
Attachment 1: merger0055.png  39 kB  Uploaded Sat Jun 15 17:59:08 2019  | Hide | Hide all | Show all
merger0055.png
Attachment 2: tapeserver0055.png  47 kB  Uploaded Sat Jun 15 17:59:42 2019  | Hide | Hide all | Show all
tapeserver0055.png
Attachment 3: stats0140.png  57 kB  Uploaded Sat Jun 15 18:49:22 2019  | Hide | Hide all | Show all
stats0140.png
Attachment 4: xy0140.png  44 kB  Uploaded Sat Jun 15 18:49:27 2019  | Hide | Hide all | Show all
xy0140.png
Attachment 5: stats0222.png  55 kB  Uploaded Sat Jun 15 19:23:23 2019  | Hide | Hide all | Show all
stats0222.png
Attachment 6: xy0222.png  34 kB  Uploaded Sat Jun 15 19:24:19 2019  | Hide | Hide all | Show all
xy0222.png
Attachment 7: temps0408.png  107 kB  Uploaded Sat Jun 15 21:09:41 2019  | Hide | Hide all | Show all
temps0408.png
Attachment 8: bias0408.png  21 kB  Uploaded Sat Jun 15 21:09:47 2019  | Hide | Hide all | Show all
bias0408.png
Attachment 9: stats0408.png  56 kB  Uploaded Sat Jun 15 21:10:51 2019  | Hide | Hide all | Show all
stats0408.png
Attachment 10: xy0408.png  41 kB  Uploaded Sat Jun 15 21:11:16 2019  | Hide | Hide all | Show all
xy0408.png
Attachment 11: stats0609.png  56 kB  Uploaded Sat Jun 15 23:10:19 2019  | Hide | Hide all | Show all
stats0609.png
Attachment 12: xy0222.png  34 kB  Uploaded Sat Jun 15 23:10:25 2019  | Hide | Hide all | Show all
xy0222.png
Attachment 13: merger0637.png  40 kB  Uploaded Sat Jun 15 23:39:18 2019  | Hide | Hide all | Show all
merger0637.png
Attachment 14: tapeserver0637.png  72 kB  Uploaded Sat Jun 15 23:39:25 2019  | Hide | Hide all | Show all
tapeserver0637.png
Attachment 15: stats0637.png  57 kB  Uploaded Sat Jun 15 23:39:36 2019  | Hide | Hide all | Show all
stats0637.png
Attachment 16: merger0643.png  41 kB  Uploaded Sat Jun 15 23:45:45 2019  | Hide | Hide all | Show all
merger0643.png
Attachment 17: tapeserver0643.png  47 kB  Uploaded Sat Jun 15 23:45:55 2019  | Hide | Hide all | Show all
tapeserver0643.png
Attachment 18: stats0643.png  57 kB  Uploaded Sat Jun 15 23:46:03 2019  | Hide | Hide all | Show all
stats0643.png
Attachment 19: 190616_0752_stats.png  87 kB  Uploaded Sun Jun 16 01:05:11 2019  | Hide | Hide all | Show all
190616_0752_stats.png
Attachment 20: 190616_0753_Tape.png  94 kB  Uploaded Sun Jun 16 01:05:11 2019  | Hide | Hide all | Show all
190616_0753_Tape.png
Attachment 21: 190616_0754_Tape2.png  94 kB  Uploaded Sun Jun 16 01:05:11 2019  | Hide | Hide all | Show all
190616_0754_Tape2.png
Attachment 22: 190616_0755_Merger.png  97 kB  Uploaded Sun Jun 16 01:05:11 2019  | Hide | Hide all | Show all
190616_0755_Merger.png
Attachment 23: 190616_0756_temp.png  135 kB  Uploaded Sun Jun 16 01:05:11 2019  | Hide | Hide all | Show all
190616_0756_temp.png
Attachment 24: 190616_0757_bias.png  19 kB  Uploaded Sun Jun 16 01:05:11 2019  | Hide | Hide all | Show all
190616_0757_bias.png
Attachment 25: 190616_0758_implants.png  59 kB  Uploaded Sun Jun 16 01:05:11 2019  | Hide | Hide all | Show all
190616_0758_implants.png
Attachment 26: 190616_0759_stats2.png  85 kB  Uploaded Sun Jun 16 01:05:11 2019  | Hide | Hide all | Show all
190616_0759_stats2.png
Attachment 27: R2_94  10 kB  Uploaded Sun Jun 16 01:17:58 2019  | Show | Hide all | Show all
Attachment 28: 190616_0842_stats.png  97 kB  Uploaded Sun Jun 16 01:48:01 2019  | Hide | Hide all | Show all
190616_0842_stats.png
Attachment 29: 190616_0845_LECxy.png  88 kB  Uploaded Sun Jun 16 01:48:01 2019  | Hide | Hide all | Show all
190616_0845_LECxy.png
Attachment 30: 190616_0847_HEC.png  47 kB  Uploaded Sun Jun 16 01:48:01 2019  | Hide | Hide all | Show all
190616_0847_HEC.png
Attachment 31: R2_103  10 kB  Uploaded Sun Jun 16 01:50:43 2019  | Show | Hide all | Show all
Attachment 32: 190616_1127_stats.png  87 kB  Uploaded Sun Jun 16 04:30:40 2019  | Hide | Hide all | Show all
190616_1127_stats.png
Attachment 33: 190616_1128_merger.png  97 kB  Uploaded Sun Jun 16 04:30:40 2019  | Hide | Hide all | Show all
190616_1128_merger.png
Attachment 34: 190616_1128_tape.png  94 kB  Uploaded Sun Jun 16 04:30:40 2019  | Hide | Hide all | Show all
190616_1128_tape.png
Attachment 35: 190616_1128_temps.png  134 kB  Uploaded Sun Jun 16 04:30:40 2019  | Hide | Hide all | Show all
190616_1128_temps.png
Attachment 36: 190616_1129_HEC.png  54 kB  Uploaded Sun Jun 16 04:30:40 2019  | Hide | Hide all | Show all
190616_1129_HEC.png
Attachment 37: 190616_1130_bias.png  21 kB  Uploaded Sun Jun 16 04:31:18 2019  | Hide | Hide all | Show all
190616_1130_bias.png
ELOG V3.1.4-unknown