ELOG DESPEC

AIDA GELINA BRIKEN nToF CRIB ISOLDE CIRCE nTOFCapture DESPEC DTAS EDI_PSA 179Ta CARME StellarModelling DCF K40

DESPEC

Fields marked with * are required
Entry time:	Sat Mar 29 11:28:36 2025
Author*:
Subject*:
> 00:15 Shift change near AIDA R6_475 > > We continue with spill cycles around 0.2 Hz or one beginning once each ~5 seconds. > > All system-wide checks passed successfully > Temperatures ok (aida01 still a bit hot) - see attachment #1 > Stats as normal (SSD3 still noisy) - see attachment #2 > Bias and pulser settings remain sane - see attachment #3 > Writing data to disk at ~26 MB/s as yesterday - see attachment #4 > Merging fine, 2.6 to 3.3 Mega items / sec (all aida## seen to go on) - see attachment #5 > Rates look not unreasonable for expected implantation in short time window - see attachment #6 > > 2:26 > We are near R6_574 > All system checks are fine > Temps are fine - attachment #7 > Stats look as before - attachment #8 > Biases and leaks typical - attachment #9 > Merger fine, 3 x 10^6 items / sec (skip screencap) > TapeServer still sits near 25 MB/s (skip screencap) > Cumulative implants look reasonable, but NB that histos have not been cleared - attachment #10 > > 2:44 R6_587 or R6_588 > The spills seem to have stopped based on the beeping scalars. Confirmed with other group there are no scint counts. > See attachment of AIDA rates where no implants can be seen. See attachment #11 > > 2:46 Spill beeps heard briefly, but they cut again. R6_590 > > 2:49 Beam seems to be back R6_592 > Scints have counts in DESPEC DAQ, scalars are beeping, AIDA sees implants. No problem. See attachment #12 for implants. > > 4:35 > System checks all pass (except expected error on master clock) > Temps okay - attachment #13 > Biases and leak currents normal - attachment #14 > Stats as before - attachment #15 > Merger going, 3 mega items per sec > TapeServer going, 25 MB/s > > 5:59 Beam is gone again, near R6_738. As before, we get consistent confirmation from the trigger clicks and the plastic scint data of DESPEC group. > See attachment #16 which shows no implants in the rate. > > > > > Contact phones for Control Room: 2222 > > We called, they are aware of a problem with the magnets and they are working to resolve it. So we will await them. > > Expert is scheduled for 7:30, but he may come earlier like 7:00 if he can make it in. > > We leave AIDA writing to disk since there are some longer lived daughters (hour or more) so we may still get some interesting decays with beam off > > 7:14 Beam is still off, but I make some notes > System wide checks all okay > Temps as normal (see attachment #17) > Biases and leak currents okay (see attachment #18) > Stats as normal (see attachment #19) > Merger going at 3 mega cps > TapeServer on, around 25 MB/sec > Implants not seen in histogram rate as expected (see attachment #20) > > 7:32 We called the operators to confirm that they don't change anything before calling us first. > Surely they said they don't touch the settings without telling us first, and just one magnet (maybe upstream of SIS) is down, and no plan to alter settings. > > 8.00 shift change at file R6_823 > beam is back on, no settings changed. > particles per spill is similar to before (2k~3k per spill) > implants now being seen in rate histogram (attachment 21) > > 8.32 system wide checks all okay > FEE temperatures are normal (attachment 22) > leak currents are okay and have been recorded to sheet (attachment 23) > good event stats seem normal, although noted that all FEEs in DSSD3 now over 100k (attachment 24) > merger rate is running around 3M items/sec > tape service rate is running around 26MB/sec > > 9.20 high energy spectra histograms for even FEEs was not displaying correctly (attachment 25). can also be seen on yesterdays elog on attachment 34 > problem can be seen clearly in /tmp/LayOut6.mlf for the line corresponding to aida4 was 1.8h not 1.8H as the information was somehow saved in the layout (attachment 26). > remaking each histogram and saving layout6 seems to be fixed (attachment 27) > > Top of the error message showed the problem, like: > ==== > Using /tmp/LayOut6.mlf > restore server=aida02 spectrum=1.8.H to gallery=1 overlap=1 > restore server=aida04 spectrum=1.8.h to gallery=2 overlap=1 > SpecDetails returned with an error > 0x30004 > SOAP-ENV:Server-Error detected in method SpecDetails > Invalid spectrum name > invoked from within > "SpecDetails 1.8.h" > (in namespace inscope "::urn:SpectrumService" script line 1) > invoked from within > ==== > > 10.05 beam is being stopped to change some thresholds > > 10.34 system wide checks all okay > FEE temperatures are normal (attachment 28) > leak currents are okay and have been recorded to spreadsheet (attachment 29) > good event stats are normal, as previously mentioned aida11 rate was over 100k this looks to have just been a fluctuation (attachment 30) > merger is running at a rate of 3M items/sec > tape service is running at a rate of 24MB/sec > implants not seen in histogram rate as expected as beam still down (see attachment 30) > > 10.42 beam still down but taking data, currently file finishing R6_946 > as of now we have 3.2Tb left which should correspond to around 26 hours left until space is full > have zeroed all histograms so will take screenshots at 11.00 > > 11.06 checked rates histograms, for aida3 some low energy channels in ASICs 1,2, and 3 were missing so performed ASIC control checks > > 11.25 beam back file S480/R6_975 > > 12.00 analysis file S480/R6_1001 - attachment 33 > FEE aida09 deadtime c. 5% (highest rate good events c. 250k), all other FEE64s << 1% > all HEC data rate c. 1kHz > all ADC data rate c. 1.2MHz > > 12.23 system wide checks all okay > FEE temperatures are normal (attachment 34) > leak currents are okay and have been recorded to spreadsheet (attachment 35) > good event stats are okay (attachment 36) > merger is running at a rate of 3M items/sec > tape service is running at a rate of 26MB/sec > > 13.00 beam off, unknown reason at the moment, but can confirm from rates histogram (attachment 37) > seems to be intermittent. file R6_1051 > > 13.10 beam back on, no one was called. currently on file R6_1061 > > 13.22 beam off as going to higher intensity beam. file R6_1069 > > 14.42 system wide checks all okay > FEE temperatures are normal (attachment 38) > leak currents are okay and have been recorded to spreadsheet (attachment 39) > good event stats are okay (attachment 40) > merger is running at a rate of 3M items/sec > tape service is running at a rate of 24M/sec > 14.48 on file R6_1131 > > 16.19 beam stop for 2 hours. TapeServer stopped and restarted - AIDA writing to No Storage > file R6_1193 > > 16:35 compression of files R6_[200-999] commenced (nice -20) > > 16:40 system wide checks all okay > FEE temperatures are normal (attachment 41) > leak currents are okay and have been recorded to spreadsheet (attachment 42) > good event stats are okay (attachment 43) Encoding: HTML ELCode plain Suppress Email notification

Attachment 1:
Drop attachments here...

ELOG V3.1.4-unknown