AIDA GELINA BRIKEN nToF CRIB ISOLDE CIRCE nTOFCapture DESPEC DTAS EDI_PSA 179Ta CARME StellarModelling DCF K40
  DESPEC, Page 22 of 34  ELOG logo
Entry  Sat Apr 24 10:21:06 2021, NH, Saturday 24.04.2021 AnyDesk_2021-04-24_11-27-49.pngAnyDesk_2021-04-24_11-28-50.png
I have restarted some more of the consoles that disappeared since the aidas-gsi issue last night
Grafana is working again
Entry  Sat Apr 24 05:17:51 2021, ML, End of beam 
Beam has now stopped (end of expriment) and background measurements starts.
Entry  Sat Apr 24 04:50:01 2021, ML, Spectra 8x
Some screenshot of spectra attached
Entry  Sat Apr 24 04:07:23 2021, ML, ucesb scalers 24-04-2021_5am_ucesb.png
ucesb is back - see attachment
Entry  Sat Apr 24 03:32:11 2021, ML, quick checks 24-04-2021_430am_GoodEvent.png
Quick system checks after crash

Temperature ok.

Still cannot connect remotely to /ucesb with my gsi web login and password (?).
Entry  Sat Apr 24 03:16:19 2021, TD, aida-gsi window manager/login session crashed 

Looks like the aida-gsi window manager/login session crashed.
Entry  Sat Apr 24 03:13:05 2021, ML, AIDA DAQ Reset 
AIDA PC crashe completely at ~3:30am CET.

Tom was called and he Restarted the AIDA system at ~4am with Run 52.

Not sure what cause the crash but AnyDesk remote connection was suddenly lost and once reconnected all Terminal sessions were gone.
Entry  Sat Apr 24 01:44:09 2021, ML, system wide checks 7x
system wide checks:

 

 
Entry  Fri Apr 23 20:19:52 2021, TD, Friday 23 April 20.00-00.00 7x

21.19 system wide checks
Entry  Fri Apr 23 15:13:28 2021, DSJ, 23 April 16.00-20.00 shift 6x
16:00 taking over from Muneerah

16:15 - temp, ucesb, database, stats etc. look ok.

16:41 - Nic restarting MBS
Entry  Fri Apr 23 13:13:46 2021, MA, TD, Friday 23 April 12.00-16.00 6x

14.15 System wide checks
Entry  Fri Apr 23 12:12:08 2021, TD, aida02 restart - 03.13UTC+2 Friday 23 April 

Overnight aida02 crashed and restarted itself. A power cycle of all FEE64s was required to recover.
Entry  Fri Apr 23 07:09:57 2021, LJW, Friday 23rd April 08:00-12:00 9x
08:30

System Checks

 
Entry  Thu Apr 22 23:17:46 2021, DJ , Friday 23rd April 00:00-08:00 27x
Took over from TD ... All is well.

00:45 System Wide Checks

Clock: 12 passed, 0 failed.
Entry  Thu Apr 22 15:18:20 2021, TD, Thursday 22 April 16.00-00.00 36x

16.20 zero all histograms, statistics & merger statistics
Entry  Thu Apr 22 11:03:57 2021, JS, Thursday 22nd April: 12:00-16:00 12x
12:00 Taking over from Liam, all is well.

12:10 Beam dropped out for a minute, implantation rate is down a bit, peaking around 300 Hz
Entry  Thu Apr 22 07:06:37 2021, LPG, Thursday 22nd April: 08:00-12:00 8x
08:01 - Taking over from Corrigan...

ucesb ok!
Entry  Wed Apr 21 23:05:39 2021, CA, 22nd April 00:00 - 08:00 16x
00:07 stats/ucesb/DB checks all ok

00:30 all system wide checks ok *except* fpga errors
Entry  Wed Apr 21 15:01:14 2021, LJW, MA, Wednesday 21st April 16:00-20:00 13x
16:30

All System checks okay, except for:
Entry  Wed Apr 21 11:27:55 2021, OH, Wed 21st April 12:00-16:00 6x
12:30 MBS has crashed
      This time AIDA is still running fine.
ELOG V3.1.4-unknown