Thu Jul 17 07:07:56 2025, CB, CARME off   
|
08:07 CEST
Temperatures ok - attached
DSSDs on. Leakage currents still high. - attached
If ML & co cannot find the reason, will turn off FEEs later today
FEEs turned off, leakage current still high (DSSD off now).
Motors out. |
Wed Jul 9 11:21:14 2025, EW, CB, CARME restarted - long background R98 32x
|
---9 July---
11:00
Turned detectors on - all stable see attachment 1
AIDA started - all okay. See attachment 2 for FEE temps.
All FEEs set to LEC (0x0) and slow comparator threshold set to 300keV (0x1e). See attachment 3.
After some issues tape server and merger all set up, NetVar not working??? have tried to reboot things but still getting issues. See attachment 4 for tape service and attachment 5 for merger.
Currently writing to data to G22-205/R98 (R97 empty), doing background run.
13:30
All checks okay apart from white rabbit, see attachment 6.
Attachment 7 - stats
18:30 CEST
More issues with anydesk - now refuses to connect with error message desk_rt_ipc
May be as simple as the monitor being turned off. Will have to be checked in person
Connected to atppc025 via x2go and from there checked
- Temperatures are fine (attached)
- Detector bias / leakage current is fine (attached)
- Data rate from file size being written is around 500 kB/s (fine)
- A number of interesting features in the online background spectrum. Likely all non-physical (attached)
- Stats OK (attached)
20:50 CEST
All checks good.
22:28 CEST
All checks good.
Features in the XY plot rensemble beam hitting the detectors. Attached.
Leakage currents and rates are good - unlikely to be major detector damage. Attached.
Only beam in the ring between now and end of D+D was stable uranium.
Killed CARMEsort via terminal (still no access to anydesk).
Restarted CARMEsort. No obvious structures appear after a few minutes. Was there beam in the ring today?
23:09 CEST
All checks good
Features in the XY plot and Ey plots disappeared.
---10 July---
03:22 CEST
All checks good.
Features gone. Attached.
05:15 CEST
All checks good.
07:34 CEST
All checks good.
10:40 CEST
All checks good.
12:35 CEST
All checks good. Some features in plots again appeared in last 2 hours, attached Ey plot (attachment 15).
14:40 CEST
All checks okay.
16:40 CEST
All checks okay.
18:40 CEST
All checks okay. Attachment 16 leakage current stable.
Attachment 17 Ey plot.
19:35 CEST
All checks OK.
Reset the Root spectra again - highly unlikely to have beam overnight without experiments running.
23:39 CEST
All checks OK.
Still seeing peak at 6 MeV like attachment 17, after resetting the Root spectra. Detector damage? Still seems implausible.
Events are focussed as in attachment 12.
Reset again. No obvious peak or pattern after a few minutes running.
From Claude K
"CRYRING was running with the Uranium beam from ESR until Tuesday (8 July) night around 22:00.
From Wednesday noon we started to inject D+ from the local source and had the D+ beam stored at various energies from 14:30 until 17:40. During the night from Wednesday (9 July) to Thursday (10 July) there was no beam.
We then continued measurements with stored D+ On Thursday from ca. 11:00 to 21:00. Since then CRYRING is in shutdown."
---11 July---
08:07 CEST
All checks OK.
Peak at 6 MeV did not re-appear overnight. Attached x2.
12:00 CEST
All checks good! All plots look good!
16:00 CEST
All checks okay!
19:20 CEST
All checks OK.
Background peaks almost visible.
22:53 CEST
All checks OK.
---12 July---
07:25 CEST
All checks OK.
10:00 CEST
All checks OK. Temps attached.
11:00 CEST
All checks OK.
19:00 CEST
All checks OK.
23:00 CEST
All checks OK.
---13 July---
07:42 CEST
All checks OK.
11:00 CEST
All checks OK.
ELOG down during the afternoon
--14 July--
11:00 CEST
All checks ok.
14:40 CEST
Tape service and merger now working on atppc025
All checks ok, briefly went no storage at around 14:38 CEST for 1-2 minutes whilst getting tape service and merger up.
17:40 CEST
All checks ok.
21:30 CEST
All checks OK.
23:16 CEST
All checks OK. Several screenshots attached.
Calibration appears to hinders clear alpha peaks.
---15 July---
07:47 CEST
All checks OK.
11:55 CEST
All checks ok.
14:35 CEST
Issue with atppc025, see attachment 29 for error message (desktop 2, detectors etc)
Got error to go, all checks ok.
17:35 CEST
Same issue with atppc025, otherwise all checks ok.
20:30 CEST
All checks OK.
23:07 CEST
All checks OK
---16 July---
07:41 CEST
All checks OK
12:00 CEST
All check ok.
15:15 CEST
Some fees have high rates, all other checks ok.
15:32 CEST
The above behaviour appears to be correlated with an increase in leakage current across all four detectors. Most likely light?
The background is not reliable -> No storage.
Unfortunately the leakage current logger crashed a few days ago on the server, and without anydesk we did not realise. Restarted it on atppc025.
Informed ML about issue. If it cannot be solved we could increase the thresholds and keep going, but the background may not be representative.
16:35 CEST
Issue persists. ML and ZA are not aware of any changes, except power-saving mode enabled for cave AC. No effect on FEE temperatures - not the issue.
aida04 rates shows 0. Checkloaded. Fine for a few seconds. Back to 0. Data event rate 100,000 may be too high.
Increased thresholds to 1 MeV. Data rates lowered, but e.g. on aida04 still 40,000. Goes back to zero. Checkloaded. OK for a short while, then back to zero.
Tape server stopped. DAQ stopped - all FEEs respond, good! Merger still going.
DSSDs off. Will retry tomorrow morning.
23:44 CEST
Temps OK. |
Sun Jul 6 11:35:28 2025, CB, Anydesk version updated
|
Updated anydesk to 6.3.2 CentOS7 release.
Works now. |
Sat Jul 5 08:51:33 2025, EBM, anydesk connection settings
|
|
Wed Jun 18 14:21:39 2025, CB, CARME off
|
15:20
DAQ stopped
Merger & Tape Server stopped
FEEs off
All detectors off
Leakage current plot attached
Leakage current file moved to /TapeData/
Will restart for a long background when the next experiment is over. |
Tue Jun 17 23:51:58 2025, TD, CB, JG, Run 96 - continued 23x
|
00.31 DAQ continues data file G22-205/R96_27
DSSSD bias & leakage currents - attachments 7-8
FEE64 temps OK - attachment 6
ADC data item stats - attachment 5
per FEE64 Rate spectra - attachment 4
Merger & TapeServer - attachments 2-3
Online analysis - attachment 1
Analysis data file R96_29 - attachment 9
no timewarps, all FEE64 deadtimes <<1%
04.04 FEE64 temps OK - attachment 10
ADC data item stats - attachment 11
DSSSD bias & leakage currents - attachments 12 & 15
per FEE64 Rate spectra - attachment 13
TapeServer - attachment 14
08.26 DAQ continues data file G22-205/R96_64
DSSSD bias & leakage currents - attachments 16-17
FEE64 temps OK - attachment 18
ADC data item stats - attachment 19
per FEE64 Rate spectra - attachment 20
TapeServer - attachment 21
11:03 All checks OK
EyTotal histogram attached.
12:25 Temps OK. Rates OK.
15:03 run stopped - beam time over
all checks ok
EyTotal hist attached |
Tue Jun 17 19:10:07 2025, NH, PMH, Run 96 7x
|
20:00 - Go to YR cave to see what is going on
20:20 - Beam back
20:28 - Set Tape to Storage, rate ca 2500 kB/s
Temperature and rate OK, System wide checks OK
Target density low (4e12/cm2)
21:00 - target density still 4e12, Ey rate histograms attached (attach 4)
21:20 - Target density increased to 6e12, we see more indication of reactions
22:30 - All checks OK, tape rate still 2500 kB/s
Target density ~7e12/cm2, beam intensity ~1e9pps
23:00 - Target density 7.5e12/cm2, beam intensity: 1e9 pps. Particle detector rate: 8 kHz at injection
Gas bottle pressure still above first tick
Target position X=-1000, Y=1400
All running smoothly. CARME DAQ running OK. (Figs 5-7) |
Tue Jun 17 12:22:50 2025, CB EW JG AG SN, Run 94/95/96
|
Run 94
Background with beam at 150 keV and no target.
Note energy is 0.15% off vs. beam and target to have a more realistic orbit.
As prior run but thresholds changed to
DSSD1 - 0xc
DSSD2 - 0x8
DSSD3 - 0x8
DSSD4 - MEC
Run 95
DSSD 4 worked briefly. Tripped again a few minutes into this run. Ignore
Run 96 - as run 94
run stopped at 14:00
Zoran reset to with-target settings for later
The plotted readout for the G35 voltage divider over several injections for this run is attached. This kind of data can be obtained from Konstantin also after the experiment.
The average is something like 88.4808 V. |
Tue Jun 17 12:14:30 2025, EW, CB, AG, Run 93- Background with beam 150keV   
|
Run 93- New run at 150keV, background with beam
13:15 All checks ok |
Tue Jun 17 08:04:09 2025, EW, AG, CB, Run 92- Background with beam 90keV   
|
Run 92- started at 09:00, background with beam
Same settings as run 91
See attachments for rates etc
All checks okay
09:58 Run stopped as now tuning 150keV beam
10:00 All checks ok
10:25 D2 bottle pack pressure 30 bar approximately
12:18 All checks ok |
Mon Jun 16 22:06:00 2025, CB, AR, EW, RUN 90-91 14x
|
23:00 DAQ restored and data now being written okay. Checks all okay, see screenshots below. Histograms reset. 40 bars in bottle @ 23:45 - should last 30 hours.
12:00 Checks all ok. No problems with aidas or writing to disk.
01:10 Checks all ok.
02:05 Checks all ok. See attatchment 6 for peak update after reset histograms 3 hours prior. Target okay, dropped a little to 6e12 but seems to be going up itself. Will monitor and then move position if needed.
03:10 During checks, noticed detector 4 had tripped so turned it off. Writing to disk increased alot, statistics increased to alost 250000. Put aida13-16 in low/medium energy. Started new run. (see attatchment 7-14 for before and afters)
RUN 91
03:15 Checks all ok after turning off detector 4. Moved target around and got abit more density but x is very sensitive and y did not seem to do much. Density 5.5e12.
04:30 Checks all ok. Target decreasing in density - monitoring it.
04:35 Target density back up to 1e13 after moving in y.
05:30 Checks all ok. Target density decreased slightly to 8e12
06:30 Checks all ok, target density stable for past hour
07:30 Checks all ok
08:30 Checks all ok, target density at 1e13 for past two hours
09:00 Run stopped
|
Mon Jun 16 21:58:00 2025, CB AR, Runs 84-89
|
Found all Merger Links background black - inactive. Nontheless the tapeservice was working, the data rate to disk was normal, and the file was being written and the histograms were being updated.
Decided to stop DAQ, stop Merger, restart merger. Links rest to green background - but no more writing to disk!
Killed Merger, killed Tape Service. Restarted.
Netvar read out at 3 - set to 1. When the Output of the Merger is enabled Netvar returns to 3. Tapeservice not writing to disk
Killed Merger, killed Tape Service. Restarted x3. Same behaviour.
Not working. No blocks being written.
With Tape Server status Stopped Ticked No storage, Unticked No storage -> Now writing blocks ?!
Tape Server Go. Writing to disk. Merger OK. Histograms updated, observables as normal (see next ELOG).
Lost runs 84-89 in the process. |
Mon Jun 16 11:12:22 2025, JG, AK, AR, EH, run 83 8x
|
12:15 restarted measurement with target - Run 83
same settings as for runs 76, 77 etc
ROOT histograms NOT zeroed
Beam at 8e8, target density at 1.5e13, scintillator @ 0 deg. peak rate 5000
status screenshots attached
15:15: Checks all ok, peaks are peaky (attatchment 8)
16:45 Checks all ok.
17:45 Checks all ok. IMP Froze and has been restarted. Peaks good. Light turned off iin cave.
18:40: Checks all ok. Target great at 1e13.
22:20 Checks done - all okay except aida green-to-red was not working, but still writing data to disk. Carlo trying to figure it out now. All other checks were okay. Daedalus crashed, restarted and target still at 1e13. |
Mon Jun 16 10:46:11 2025, CB JM JG AK, Run82
|
Background without beam while source is optimised. |
Mon Jun 16 08:17:41 2025, JG, D2 consumption
|
The current bottle of D2 was installed on friday 06.06. at around 12:00. I assume we started at 200 bar.
Right now we have 50 bar remaining in this bottle (16.06. at 8:00).
This is an average consumption of ~15 bar/day
150 bar / 9.83 days
|
Sun Jun 15 10:46:35 2025, EW, EM, AR, AB, CB, JG, AK, Run 81 30x
|
11:45 New run started - run 81, same settings as previous runs (75, 76 etc)
ROOT histograms NOT zeroed
Beam at 2.5e8, target density at 3e12
11:50 All checks okay
12:45 All checks okay
13:45 All checks okay
14:45 All checks okay
15:45 All checks okay.
17:00 All Checks okay. Target temp manually dropped from 30.4K to 30.1K to try and improve density as would not get much above 2.5-3ish. Also played with target position for a while - now seemed to have stabilised it at 4.5e12 as of now.
18:00 All checkd okay. Target been stable at 4.5-5.3e12.
18:20 Done checks again (all ok) as the beam is being a little stange. Attatched ss of peaky peaks (some of them very nice) but detector 3 histogram wont cooperate and wont let me see the counts if I zoom further down, but can see proton peak fine. Seeing periodic spikes in the counts plot for the particle detector - monitoring. Also the tail of the beam seems more red than usual.
19:00 More photos of strange spikes in the counts for particle detector uploaded. Sometimes, the baseline has decent sized spikes too. Attatchments 10-14
19:20 Checks ok. Traget stable. Spikes in particle detector seem to be more frequent, uploading more photos below. Also attatched peaks at this stage (attatchemtn 15).
19:36 Very strange spikes in particle det. Two bigish peaks at baseline and then strange beginning at the injection. Attatchment 19.
19:45 Another spike in the baseline for particle det. Attatchment 20.
20:25 Checks ok. Spikes still in particle det plot.
21:20 Checks ok. Screenshot of peaks in attatchment 21.
22:20 Checks ok. Target been relativly stable all shift at 5e12. Spikes still periodically turning up in particle detector. Histograms are gaining counts, attatchment 22 is the peaks.
22:30 Target suddenly got really dense up to 1e13. Lifetime of the beam is ok. Trending down slowly. Did checks again and all is good.
01:45. Checks OK. Target seems thick.
04:30
Temperatures OK - attach
Rates OK - attach
Merger OK - attach
Hisograms look OK - attached
Target looks very thick from ring vacuum worsening.
7:15 all checks okay - historgams attached
beam 2e8, target 1e13, scintillator rate 2000 in peak
10:00
Run stopped to gain cave access.
Before beam was stopped, target was moved out. We still see some signal on the neutral particle detector, roughly a factor 10 below with target on at 1e13 at/cm2
Will need a beam background run for normalisation procedure. See attachment 29
10:30
Now we have no beam in the ring we still observe some events in the neutrals detector. Some spikes up to 150 counts observed, could explain some of what we have seen so far. See attachment 30
Note we are saving all this data to MBS so it is effectively background for the neutral detector. |
Sun Jun 15 07:01:37 2025, EW, EM, Run 80    
|
08:00 New run started - run 80
Run whilst they are optimising the beam after losing it, everything else same as previous runs
ROOT histograms NOT zeroed
All checks fine
09:05 All checks okay
Attachment 5 current histograms zoomed into area of interest, detector 3 only proton peak visible
10:00 All checks okay
11:00 All checks okay
11:45 Run stopped as beam is back |
Fri Jun 13 19:41:32 2025, JG, SHB, JM, AR, EW, OF, Run 77, 78, 79 17x
|
New run started - Run 77 after refilling LN2 dewar
Same settings as Run 75 & 76
The root histos have not been reset, i.e. they show combined statistics of run 75, 76 and 77.
20:45 - all checks OK
22:00 - all checks OK
00:10
Observed no data writing to disk. Checked merger no data merging. No ADC data items. Seems daq crashed again.
Appears aida09 had crashed causing system to stop. Tried fix suggested in earlier elog by Tom. No success. All FEEs show error and system became unresponsive.
Power cycling FEEs.
00:30
New run started Run 78. Same conditions as previous runs.
All thresholds remain unchanged ->0x28 (400 keV)
Had to reset monitoring histograms as they were unresponsive too.
All system checks OK.
Data rate is ~300 kB/sec
ADC data items rate is similar to previous run (screenshot already attached)
Detector leakage currents look OK. Plots attached.
WS6 (elog and internet) appeared to freeze before. This could be similar to the issue osserved last weekend. All seems fine now and DAQ continues. Should keep an eye on it.
02:00
Checls OK
05:00
Checks OK
7:10 Checks OK. Target was fluctuating over night, dropped around midnight then back up but had no target for about 2-3 hours overnight. Fixed target thickness this morning and now have 5e12.
8:15 Checks Ok.
9:15 Checks Ok.
10:15 Checks ok. Target good at 5e12. Attatched screenshots of the peaky peaks so far (can't put numbers on excel as lost the ability to see it - see 9 10 and 11)
11:35 All checks ok. Screenshot of peaks attatchment 12 (decently peaky).
12:30 All checks ok. Peaks are beginning to show, especially proton and triton but on det 3, cant distinguish trition from noise peak so no value in spreadhseet for that. Target stable at 4.8e12.
13:30 All Checks ok.
14:30 All Checks ok.
15:40 All checks okay, lost beam at 15:25, let HKR know and they are looking into it, have put to no storage.
16:35 All checks okay, still no beam, taget is steady at 3e12
17:35 All checks okay, beam is back but being optimised
18:33 New run started- run 79, same settings as previous runs, did NOT reset histograms, beam now 2e8 (previously was 7e8)
18:33 All checks okay apart from temp of aida 3 which is a little high (see attachment 13), rates also attached (attachemnt 14), current histogram attached (15)
19:35 All checks okay, aida 3 temp now back within range, target density dropped but have managed to get it back up to 2e12
21:30 All checks okay, target has been very unstable, beam now at 3.8e8
22:30 All checks fine, target at 3e12 for past 45 minutes, beam at 4e8, current histogram attachment 16
23:40 All checks ok. Integral value for range to 4000 seems to be increasing for all histograms - meaning target is probably ok for now. Vacuum plot doesnt show any issues.
02:00 All checks ok. Integral values for proton peak have increased so assuming target is still holding as of now (only peak I can clearly isolate to get value from) - no indication that it is off via vacuum plot.
5:00 All Checks ok. Integral values increasing.
7:00 All checks ok, can't see target density as of 6:20
08:00 Run stopped as lost beam, histogram attachment 17
|
Fri Jun 13 16:39:18 2025, JG, SHB, Run 76 7x
|
Same settings as run 75.
Detector 4 is biased at 100V and switched from MEC to LEC.
The root histos have not been reset, i.e. they show combined statistics of run 75 and 76.
|
Fri Jun 13 14:45:58 2025, JG, SS, JM, CB, EW, AR, Run 75 
|
90 keV/u beam on target, Target overlap confirmed with lifetime measurement using bunched beam - @ -12.5mm
We do not expect to see see Rutherford due to energy loss in the dead layer, using other particle detector for normalsiation.
Moved detectors in with servos only. Both arms are IN and stationary.
Left potentiometer = 36.54 mm
Right potentiometer = 37.96 mm
Horizontal beam position = -12.5 mm
Thresholds increased for all to 0x28 (400keV)
data rate is ~0.7 MB/sec
Electron cooler read values; Cooler voltage = 50V (dodgy accuracy need to ask about fc20 on monday), cooler current=0.26 mA.
15:50 All Checks ok. Overlap on beam found. Target at 4e12. Bottle at 90 bars.
|
|