Found temperatures and pressure stabilised overnight. See attached.

12:00 Began activation of 3x UHV1400 in channel 2, top module. Started using 90 W as per procedure. No effect on temperature. Increased to 120 W. OK

14:30 Began activation of 2x UHV1400 in channel 1, in front of the detectors. Considered moving detectors but decided against it since bellows are rated to move at 20C at most. Activated at 60 W (vs. 75 W in procedure). OK

All NEG elements off. CARME heaters ramping down to 60 C overnight. 

Ion pumps activated < 100 C. Valve closed. #4 doesn't come online properly. Sone issues with #2 as well but it recovered on its own. Left cooling down. No changes. Ion pumps off and valve open. Will try tomorrow. Could be faulty cable?

Vacuum division may want to activate their pump as well - times unclear.

Attempted to close CARME as carefully as possible.

Swapped out one foot for another one and temporarily removed a second to allow CARME to rotate slightly and get a better alignment of the two surfaces of the COF600 flange.

Closed CARME but realised carriages with struts are such that carriages touch before flanges do. Worse on side with leak than side without. See attached. As a result we would not be able to close properly.

DR to modify the holes in the feet closest to flange on CARME front to allow surfaces to touch before carriages come in contact. Hopefully close later today.

Issue was not encountered earlier because CARME was fully mounted before being dropped on feet. Struts were forcefully brought close to allow CARME to descend. Unclear how this was done in DL but may be baking had altered some sizes enough for the issue to appear. Spare feet do not help significantly.

Closed CARME . 1. Bolts finger tight. 2. Bolts tightened with tools stopping as soon as resistance is felt. Tightening done from the top descending towards the right (clockwise) and from the bottom counterclockwise. 3. 20 Nm applied in the same way 3. 40 4. 60 5. 80 6 80 again but single operator going round 6. 100 single operator

Pumping down overnight

Sudden and unexpected power cut at 10:02 German time, affecting all the target hall.

It has been caused by the emergency alarm being triggered. Reasons unclear. Electricians were informed.

CARME top gate valve closed.

10:33 power is back

Set point 120C
Scroll on, turbo on (980 Hz normal operation), valve open
Pressure at 1.34E-6 mbar

No obvious issues.

13:00
Power appears back for the whole ring. 

Set point 128C
Turbo normal operation - no apparent adverse effects of shutdown
Pressure at ~3E-7 mbar

Pi can again be accessed by ssh. Vacuum plot is updating again. 

Tuesday 15 September

08:40
Rates started working again. Unclear what yesterday evening's bug was caused by. Will investigate eventually.
Temperature setpoint reach T=150 , however even at full power (heating constantly on) the RE72 appear unable to
reach past T = 135
See attached.

Perhaps better insulation would be required. 
However, this temperature is sufficient to bake CARME with the detectors inserted.


Day shift
Baking continues and will be left overnight to gather more data. Vessel temperatures are increasing by roughly 1.5 deg/hour with the vessel average temperature now 141.5 
deg.

Wire seals fully closed and tightened. Bolts were tightened first finger tight, then to 50 N.m and finally to 80 N.m in a pattern so that seal is closed evenly. Leak and 
pump cart are ready to be connected to the turbo for leak testing tomorrow. 


19:20
Baking continues OK. Temperatures seem to increase slowly. See attached.

5 OCTOBER

08:21 Temperatures stable overnight. See attached. Baking continues.
Remember to visually inspect the tent for potential new drafts the next time in Daresbury.
Also remember to check on thermocouple 1-4 status / position.

10:15 Draft caused by section of top blanket collapsing slightly producing a hole at the top-back end of the volume. Only way to remove draft is to power down and shift 
some of the larger blanket sections over to support the collapsed bit. Keith requires temperatures >120C for the vessel average to proceed so heat was powered down and 
jacket reconstructed. See attached photos of the top of the baking volume (Sorry for quality).

Pressure on vessel when baking concluded: 2e-7mbar

13:00 Baking jacket all sorted, temperature set to 60C to equilibrate. New session had to be started as cooling then heating confuses the rates on the baking program. All 
looks good at the moment, will continue to monitor and increase temperature when needed. Automatic mode may be able to be utilised again as rectifying the insulation on 
the 
back has reduced the thermal gradients somewhat. 

Pressure on vessel when baking restarted: 1e-8 mbar
Bumax order has also been delivered

16:00 Monitoring remotely, bakeout has been on automatic for an hour and is currently at 67C. Vessel gradient ~7.5C

17:15 All looks okay, will leave for a few hours now. Temp is 73C, gradient ~8.2C

22:00 Automatic baking to 90C gradient >10C. Ramped to 105C for RE72-1 and 100C for RE72-2. Will leave overnight to stabilise

6 October

9:50 Temperatures stable, increasing to 115C, 105C 

11:20 Temperatures stable, Increasing to 120C, 115C

13:15 Temperatures stable, increasing to 125C, 120C. Vessel average ~115C. 

14:45 Temperatures stable (see attached). Increasing to 130C, 125C. Vessel average~120C

20:16 Temperatures stable, may be getting to edge of how hot we can get. Increasing to 135C, 130C overnight. Vessel average~128C should be sufficient.

7 October

07:30 Temperatures stable, have reached max temperature we can achieve 132C, 128C on RE-72 thermocouples. Vessel average~131C should be sufficient. Temperatures will be 
maintained until Monday when negs can be activated. 

20:30 Temperatures stable (see attached)

8 October

10:30 Temperatures stable

9 October 

8:30 Temoeratures remain stable 

ML reports power cut in CRYRING cave. Reasons unknown. No effect on vacuum, but top valve closed for safety reason. Ramping down temperature.

GSI vacuum division IE514 gauge connected.

Gleb reports gate downstream opened. Vacuum goes up and recovers as expected.

Saturday 12 Sep 08:43

Remotely checked status of baking. See attached.

Baking appears to be proceeding OK. No thermocouples disconnected.

Speed is slower than previously observed, limited by thermal gradients observed across both octagon and CARME
vessel as a result of new thermocouple placement.
Octagon gradient may not be real, and could be a result of placement of Octagon side thermocouple?

Main concern is temperature recorded by CJC in Picolog2 (aka Room temperature 2) at 31 C, increasing. 
The second picolog may be too close to the tent. If the temperature keeps increasing it may stop working. Will
keep monitoring.

Sun 13 Sep 08:06

Baking reached 93 C yesterday afternoon at 16:18 and paused as a result of a percieved temperature gradient in
the octagon. 
See attached.

Left system overnight to check whether octagon gradient was going to equilibrate via convection. 
No changes this morning.
Thermocouple 1-8 labeled "Octagon (side)" likely is not in thermal contact with the octagon. 
It appears to have a temperature lower than room temperature. Possibly sits outside the tent? Gradient will not
decrease with time.

Temporarily overrode automatic mode, set temperature to 100 C, restarted automatic mode. Will keep monitoring.


Sun 13 Sep 10:00

Vessel reached 100 C, no gradients. All OK, except octagon gradient (ignoring).
Manually increased temperature to 110 C. Restored automatic mode.

Sun 13 Sep 12:00

Baking stopped automatically at 10:30 due to CJC temperature (aka room temperature 2) in TC-08 Picolog 2
exceeding 40 C.
Max operating temperature of picolog TC08 is 50 C, and accuracy is lost above 30 C.
https://www.picotech.com/data-logger/tc-08/usb-tc-08-specifications

Stopped baking. Removed thermocouple 1-8 "Octagon (side)" from Octagon gradient calculation and recompiled.
Restarted manually at T = 80 C

Please move picolog away from the tent tomorrow, and we can then increase temperature. Tent does not need to be
opened.

Sun 13 Sep 19:00
Vessel temperature at 80 C stable. 
Other temperatures stable. 
Leaving at 80 C overnight.

16 September

08:50
Baking continues OK. Temperatures stable, did not increase with respect to yesterday evening.
See attached.

15:00
Baking continues OK.
See attached.

20:22
Baking continues OK.
See attached.

17 September

08:20
Baking continues OK. Temperatures slightly decreasing?
See attached.

(NOTE: Raspberry Pi internal clock appears to be on GMT, rather than GMT+1 due to daylight saving.)

Baking started on Mon 28 Sep. Due to WiFi connection authorisation expiring, no remote access was possible until
Tue 28 afternoon.

JM found remotely that temperature had increase up to 80 C, and baking had then been shut off due to negative
gradients. Unclear what happened. System was already cooling.

Restarted baking in automatic mode. Baking shut down automatically after few hours. It is likely the automatic
mode was being confused by vessel cooling and being heated at the same time. 

29 SEP

20:30 Switched to manual mode (60 C). Left overnight

---

30 SEPTEMBER

08:10 Temperatures seem stable, but slight temperature gradient across vessel would prevent automatic mode from
working. See attached.
Unclear why RE72-1 let temperature reach 64 C when setpoint is 60 C. May be affected by RE72-2. Not worrying,
but may confuse automatic mode.
Ramped up to 70 C manually.

11:10 Temperatures stable. Ramped to 80 C manually. Gradient in CARME vessel unchanged at ~11 C. See attached.

14:18 Found baking had stopped shortly after last check. One floating thermocouple reported temperatures above 300 C. 
Unclear what happened. Possible fault? See attached. 
Restarted baking manually at 40 C. Waiting for temperature to stablise. Vessel still cooling - cannot activate
automatic mode.

15:00 Temperatures OK. Ramped manually to 50C

18:10 Temperatures stable. Ramped manually to 60 C. Left automatic mode on

20:20 Found temperature setpoint at 66 C. See attached.
Huge spikes in thermocouple 1-4 Floating (side-low). Same thermocouple that reported temperature spikes earlier. May be
faulty or touching heater directly. Seems to happen for T=65 C and above.
Set to manual mode. Temperature setpoint 60 C. Left overnight.
Will ask local people to remove thermocouple 4 from picologger 1 (aka #A0067/395, port 4) to continue.

---

1 OCTOBER

08:00 Temperatures stable. Interesting behaviour of problematic thermocouple 1-4. Trend looks real. Seems to confirm
hypothesis it is touching a heater.
Waiting for DL locals to disconnect it.

09:49 Thermocouple 1-4 disconnected. Increased temperature manually to 75 C / 70 C. 
It appears RE72-1 consistently reports 5C above its set point. It controls 3 heaters vs. 8 heaters controlled by RE72-2. 
This is most likely due to RE72-2 needing greater power output to reach its setpoint, increasing RE72-1 thermocouple
temperature as a result. 
RE72-2 may be doing very little at the moment.
Hopefully placing its setpoint 5 C above will force both heaters to work together. This may decrease temperature
gradients observed in the vessel.

16:20 Increased temperature manually in steps up to 95 / 80 C.
The uneven temperature setpoints associated with the two RE72 appears to have reduced the temperature gradient in the vessel.
Will ramp up to 100 later this evening and leave overnight.
See attached.

22:00 Temperature stable. Rates are showing unphysical rates (too high / too low) and occasionally going all to zero at the
same time. 
Looks like a previously observed bug that I thought had been sorted. Will have to debug again. Does not affect manual mode.
Ramped temperature to 105 / 95 C. Leaving overnight.
See attached.

---

2 OCTOBER

07:58 Temperatures stable. See attached. Slight gradient in CARME vessel (~11 C). Not worrying.
Ramped manually to 115 / 105 C

12:16 Temperatures stable. See attached. Valve temperature at 46 C.
Ramped manually to 125 / 115 C

17:34 Temperatures stable. See attached. We seem to be getting close to the upper limit of what the tent can achieve.
Ramped manually to 135 / 125 C
Will leave overnight.

---

3 OCTOBER

08:32 We have been baking at full power (heaters always on). Temperatures stable. 
Appears to be as high as we can go with this tent configuration.
Will leave in manual mode and monitor throughout the day.
See attached.

17:00 Temperatures stable. No changes from this morning.

21:00 Temperatures stable. See attached. Baking continues overnight.

---

4 OCTOBER

07:30 Found temperatures decreased overnight by around 10 C. See attached. 
We are still baking at full power. Room temperature has not changed.
Most likely explanation is part of the tent giving / moving due to the baking and a draft being developed.
Will keep monitoring during the day.

13:50 Temperatures stable, no changes from last check.

20:22 Temperatures stable. See attached. Leaving overnight.

Thu 22 October

22:15 Temperatures stables, slowly decreasing.
Bump - rising front corresponds to heaters turned on. Falling front to D2000 turned off?
See attached.

Fri 23 October
09:57 Temperatures stable. See attached.
13:09 Temperatures remain stable. No significant changes.

Sat 24 October
21:27 Temperatures stable. See attached.

Sun 25 October
*Daylight saving is in effect. Time on the Raspberry Pi is no longer incorrect*
07:57 Temperatures stable. See attached.
19:05 Temperatues mostly stable. See attached. Will leave overnight and move setpoint to 80 C early tomorrow morning

Mon 26 October
07:37 Temperatures mostly stable. See attached. Setpoint to 80 C.

Accessed Pi remotely 

( 1. Without the Internet, the Pi has no way of knowing what time is it.
In case of power loss make sure to set correct date via

sudo date -s 'YYYY-MM-DD HH:MM:SS'

Or all log files will have wrong timestamp )

EDIT: Pi now connected to GSI time server.


2. Temperature logging OK


3. Commands/events logging enabled. Logging to file Log.dat, automatically moved to Logs/$(timestamp)_log.dat on
gracefuly quit.
Cannot test due to TC08 / RE72 not being connected. Please test when possible.


4. Plot_temps.gp gnuplot script currently optimised for 1080p monitor. Monitor in use is 1024x768. 
Please optimise first line of script (size, position) to make it fit while we search for a better monitor.


5. Hostname changed to CARMEbakingpi

CARME pressure moved to

https://uoe-my.sharepoint.com/:x:/g/personal/cbruno2_ed_ac_uk/EVbsVOubNHRLj0PKiFIvd00BClMJ6WSJ1UDAyLA2F3R4jA?e=hEoZt7


Some photos overnight are over-exposed and pressure cannot be read. 
Might be able to fix with image processing if needed, but likely not worth the time. 

Baking started: 23/09/2021 14:00	
Photo frequency changed to once per 10 minutes.

1. Connect to pi on CRYRING local network 
ssh pi@192.168.207.127

Password available on request


2. To check state of baking code

screen -x

please do not press any keyboard button if unsure how the code works. 
Pressing q instantly stops baking in case of emergencies

when done, to disconnect

CTRL+A 
d


3. To check log of commands / previous status of baking code

cd Programs/Baking
cat Log.dat


4. To check temperature plot

cd Programs/Baking
gnuplot Plot_temps.gp 

CTRL+C on terminal to quit

Please remember the Pi has limited computing power and the gnuplot window will consume some of that when open
One remote user is no problem, but multiple may give issues to the Pi


5. Check current pressure

Currently:
https://uoe-my.sharepoint.com/:x:/g/personal/cbruno2_ed_ac_uk/EVbsVOubNHRLj0PKiFIvd00BClMJ6WSJ1UDAyLA2F3R4jA?e=hEoZt7


(Pictures from webcam are in ~/Webcam on the pi
CM52 data also to be available online in real time soon)

Current temperature ~64 C

See plots attached

Current pressure ~ 2.5E-6 mbar

See
https://uoe-my.sharepoint.com/:x:/g/personal/cbruno2_ed_ac_uk/EVbsVOubNHRLj0PKiFIvd00BClMJ6WSJ1UDAyLA2F3R4jA?rtime=OK4kVZKB2Ug

and
http://web-docs.gsi.de/~lestinsk/vacplot.php

Current temperature ~90 C
However note setpoint is at 102 C. It appears we are baking at full power, but too many heat losses?
Temperature gradient still increasing. May just be a matter of time.

See plots attached


Current pressure ~ 1.9E-6 mbar decreasing

See
https://uoe-my.sharepoint.com/:x:/g/personal/cbruno2_ed_ac_uk/EVbsVOubNHRLj0PKiFIvd00BClMJ6WSJ1UDAyLA2F3R4jA?rtime=OK4kVZKB2Ug

and
http://web-docs.gsi.de/~lestinsk/vacplot.php

Baking automatically stopped due to negative gradient in on thermocouple for 10 minutes straight. 
Not surprising giving we were baking at full power bu making little progress. We should have switched to manual
mode.

Switched to manual mode for now at 60 C to recover temperature without excessive gradients. 
Will restart automatic mode later today. Should be back to full power tomorrow morning.

EDIT
21:42 CET - Temperature stabilised. Restarted automatic mode.

Current temperature ~87C

See plot and screen attached.
Note Baking code restarted yesterday evening.

Current pressure 2.1E-7 increasing

See
https://uoe-my.sharepoint.com/:x:/g/personal/cbruno2_ed_ac_uk/EVbsVOubNHRLj0PKiFIvd00BClMJ6WSJ1UDAyLA2F3R4jA?rtime=OK4kVZKB2Ug
http://web-docs.gsi.de/~lestinsk/vacplot.php

Attached.