AIDA GELINA BRIKEN nToF CRIB ISOLDE CIRCE nTOFCapture DESPEC DTAS EDI_PSA 179Ta CARME StellarModelling DCF K40
  DESPEC  ELOG logo
Message ID: 690     Entry time: Sat Jan 11 14:05:03 2025
Author: TD 
Subject: Saturday 11 January 2024 
14.37 Detector bias & leakage current OK - attachment 1
  
      FEE64 temperatures OK - attachment 2

      WR timestamps - attachment 3
       aida06 out of sync

      global clock status - attachment 4
       aida06 fails

      ADC calibration - attachment 5
       all fail - probably due to ASIC synchronise *after* ADC calibration

      WR decoder & FPGA TS status - attachments 6-7 
       aida06 status 0xd

      DAQ run control - attachment 8
       aida06 undefined => aida06 has rebooted

      Merger & Tape Server - attachments 9-10
       merger, tape server and data transfer have stopped

      See https://elog.ph.ed.ac.uk/DESPEC/691
       aidao06 system console - aida06 rebooted sometime yesterday


*** Recovery

For FEE64 aida06 *only*

DAQ reset
DAQ setup


For all FEE64s

DAQ stop
Restart merger, merger setup, merger go 
 Following two merger restart cycles all FEE64s stopped OK
Recovery complete

       All system wide checks OK

       Disable data transfer, DAQ go

       per FEE64 rate spectra = attachment 11
        aida04 high rates

       per FEE64 1.8.W spectra - 20us FSR - attachments 12-13

       DAQ stop, enable data transfer, DAQ go

       Merger and server consoles - attachment 14
        merger and tape server (no storage mode) running OK but no data transfer to MBS server

       WR timestamps OK - attachment 15

       ADC and DISC data item stats - attachment 16-17
        aida04 & aida16 high rates - all others appear to be OK
        ASIC check load for all aida16 ASICs changes rate from c. 420k to 0 
        ASIC check load for all aida04 ASICs changes rate from c. 200k to c. 120k

18.00 No data transfer to MBS - nothing useful being donme at the moment - will place system in safe state

      DAQ stop
      Detector bias OFF
      FEE64 power OFF
Attachment 1: Screenshot_from_2025-01-11_14-37-29.png  37 kB  | Hide | Hide all | Show all
Screenshot_from_2025-01-11_14-37-29.png
Attachment 2: Screenshot_from_2025-01-11_14-55-21.png  159 kB  | Hide | Hide all | Show all
Screenshot_from_2025-01-11_14-55-21.png
Attachment 3: Screenshot_from_2025-01-11_14-56-44.png  233 kB  | Hide | Hide all | Show all
Screenshot_from_2025-01-11_14-56-44.png
Attachment 4: Screenshot_from_2025-01-11_14-57-14.png  128 kB  | Hide | Hide all | Show all
Screenshot_from_2025-01-11_14-57-14.png
Attachment 5: Screenshot_from_2025-01-11_14-57-37.png  139 kB  | Hide | Hide all | Show all
Screenshot_from_2025-01-11_14-57-37.png
Attachment 6: Screenshot_from_2025-01-11_14-58-05.png  129 kB  | Hide | Hide all | Show all
Screenshot_from_2025-01-11_14-58-05.png
Attachment 7: Screenshot_from_2025-01-11_14-58-25.png  119 kB  | Hide | Hide all | Show all
Screenshot_from_2025-01-11_14-58-25.png
Attachment 8: Screenshot_from_2025-01-11_14-59-24.png  165 kB  | Hide | Hide all | Show all
Screenshot_from_2025-01-11_14-59-24.png
Attachment 9: Screenshot_from_2025-01-11_15-00-00.png  707 kB  | Hide | Hide all | Show all
Screenshot_from_2025-01-11_15-00-00.png
Attachment 10: Screenshot_from_2025-01-11_15-00-31.png  120 kB  | Show | Hide all | Show all
Attachment 11: Screenshot_from_2025-01-11_15-29-32.png  199 kB  | Hide | Hide all | Show all
Screenshot_from_2025-01-11_15-29-32.png
Attachment 12: Screenshot_from_2025-01-11_15-30-35.png  220 kB  | Hide | Hide all | Show all
Screenshot_from_2025-01-11_15-30-35.png
Attachment 13: Screenshot_from_2025-01-11_15-31-29.png  172 kB  | Hide | Hide all | Show all
Screenshot_from_2025-01-11_15-31-29.png
Attachment 14: Screenshot_from_2025-01-11_15-35-14.png  738 kB  | Hide | Hide all | Show all
Screenshot_from_2025-01-11_15-35-14.png
Attachment 15: Screenshot_from_2025-01-11_15-38-24.png  232 kB  | Hide | Hide all | Show all
Screenshot_from_2025-01-11_15-38-24.png
Attachment 16: Screenshot_from_2025-01-11_15-27-28.png  122 kB  | Hide | Hide all | Show all
Screenshot_from_2025-01-11_15-27-28.png
Attachment 17: Screenshot_from_2025-01-11_15-26-39.png  120 kB  | Hide | Hide all | Show all
Screenshot_from_2025-01-11_15-26-39.png
ELOG V3.1.4-unknown