12 October 

10:00 Bakeout temperatures stable. Pressure on the backing line is 3e-7mbar which is the lowest we have achieved on the backing line so far. Vessel pressure can't be measured at the moment as temperature exceeds the max operational temperature of 80C. 

14 October

11:30 Bakeout temperatures stable. Slight day/night cycle can be seen and a ~2-3C dip over the weekend, probably due to heating in ETC turning off at night and over the weekend. Vessel average remains ~130C. Pressure in the backing line dropped to 2.5e-7mbar. EU plug Adapters have been delivered, waiting on leads to begin activation of NEG pumps.  

5 OCTOBER

08:21 Temperatures stable overnight. See attached. Baking continues.
Remember to visually inspect the tent for potential new drafts the next time in Daresbury.
Also remember to check on thermocouple 1-4 status / position.

10:15 Draft caused by section of top blanket collapsing slightly producing a hole at the top-back end of the volume. Only way to remove draft is to power down and shift 
some of the larger blanket sections over to support the collapsed bit. Keith requires temperatures >120C for the vessel average to proceed so heat was powered down and 
jacket reconstructed. See attached photos of the top of the baking volume (Sorry for quality).

Pressure on vessel when baking concluded: 2e-7mbar

13:00 Baking jacket all sorted, temperature set to 60C to equilibrate. New session had to be started as cooling then heating confuses the rates on the baking program. All 
looks good at the moment, will continue to monitor and increase temperature when needed. Automatic mode may be able to be utilised again as rectifying the insulation on 
the 
back has reduced the thermal gradients somewhat. 

Pressure on vessel when baking restarted: 1e-8 mbar
Bumax order has also been delivered

16:00 Monitoring remotely, bakeout has been on automatic for an hour and is currently at 67C. Vessel gradient ~7.5C

17:15 All looks okay, will leave for a few hours now. Temp is 73C, gradient ~8.2C

22:00 Automatic baking to 90C gradient >10C. Ramped to 105C for RE72-1 and 100C for RE72-2. Will leave overnight to stabilise

6 October

9:50 Temperatures stable, increasing to 115C, 105C 

11:20 Temperatures stable, Increasing to 120C, 115C

13:15 Temperatures stable, increasing to 125C, 120C. Vessel average ~115C. 

14:45 Temperatures stable (see attached). Increasing to 130C, 125C. Vessel average~120C

20:16 Temperatures stable, may be getting to edge of how hot we can get. Increasing to 135C, 130C overnight. Vessel average~128C should be sufficient.

7 October

07:30 Temperatures stable, have reached max temperature we can achieve 132C, 128C on RE-72 thermocouples. Vessel average~131C should be sufficient. Temperatures will be 
maintained until Monday when negs can be activated. 

20:30 Temperatures stable (see attached)

8 October

10:30 Temperatures stable

9 October 

8:30 Temoeratures remain stable 

(NOTE: Raspberry Pi internal clock appears to be on GMT, rather than GMT+1 due to daylight saving.)

Baking started on Mon 28 Sep. Due to WiFi connection authorisation expiring, no remote access was possible until
Tue 28 afternoon.

JM found remotely that temperature had increase up to 80 C, and baking had then been shut off due to negative
gradients. Unclear what happened. System was already cooling.

Restarted baking in automatic mode. Baking shut down automatically after few hours. It is likely the automatic
mode was being confused by vessel cooling and being heated at the same time. 

29 SEP

20:30 Switched to manual mode (60 C). Left overnight

---

30 SEPTEMBER

08:10 Temperatures seem stable, but slight temperature gradient across vessel would prevent automatic mode from
working. See attached.
Unclear why RE72-1 let temperature reach 64 C when setpoint is 60 C. May be affected by RE72-2. Not worrying,
but may confuse automatic mode.
Ramped up to 70 C manually.

11:10 Temperatures stable. Ramped to 80 C manually. Gradient in CARME vessel unchanged at ~11 C. See attached.

14:18 Found baking had stopped shortly after last check. One floating thermocouple reported temperatures above 300 C. 
Unclear what happened. Possible fault? See attached. 
Restarted baking manually at 40 C. Waiting for temperature to stablise. Vessel still cooling - cannot activate
automatic mode.

15:00 Temperatures OK. Ramped manually to 50C

18:10 Temperatures stable. Ramped manually to 60 C. Left automatic mode on

20:20 Found temperature setpoint at 66 C. See attached.
Huge spikes in thermocouple 1-4 Floating (side-low). Same thermocouple that reported temperature spikes earlier. May be
faulty or touching heater directly. Seems to happen for T=65 C and above.
Set to manual mode. Temperature setpoint 60 C. Left overnight.
Will ask local people to remove thermocouple 4 from picologger 1 (aka #A0067/395, port 4) to continue.

---

1 OCTOBER

08:00 Temperatures stable. Interesting behaviour of problematic thermocouple 1-4. Trend looks real. Seems to confirm
hypothesis it is touching a heater.
Waiting for DL locals to disconnect it.

09:49 Thermocouple 1-4 disconnected. Increased temperature manually to 75 C / 70 C. 
It appears RE72-1 consistently reports 5C above its set point. It controls 3 heaters vs. 8 heaters controlled by RE72-2. 
This is most likely due to RE72-2 needing greater power output to reach its setpoint, increasing RE72-1 thermocouple
temperature as a result. 
RE72-2 may be doing very little at the moment.
Hopefully placing its setpoint 5 C above will force both heaters to work together. This may decrease temperature
gradients observed in the vessel.

16:20 Increased temperature manually in steps up to 95 / 80 C.
The uneven temperature setpoints associated with the two RE72 appears to have reduced the temperature gradient in the vessel.
Will ramp up to 100 later this evening and leave overnight.
See attached.

22:00 Temperature stable. Rates are showing unphysical rates (too high / too low) and occasionally going all to zero at the
same time. 
Looks like a previously observed bug that I thought had been sorted. Will have to debug again. Does not affect manual mode.
Ramped temperature to 105 / 95 C. Leaving overnight.
See attached.

---

2 OCTOBER

07:58 Temperatures stable. See attached. Slight gradient in CARME vessel (~11 C). Not worrying.
Ramped manually to 115 / 105 C

12:16 Temperatures stable. See attached. Valve temperature at 46 C.
Ramped manually to 125 / 115 C

17:34 Temperatures stable. See attached. We seem to be getting close to the upper limit of what the tent can achieve.
Ramped manually to 135 / 125 C
Will leave overnight.

---

3 OCTOBER

08:32 We have been baking at full power (heaters always on). Temperatures stable. 
Appears to be as high as we can go with this tent configuration.
Will leave in manual mode and monitor throughout the day.
See attached.

17:00 Temperatures stable. No changes from this morning.

21:00 Temperatures stable. See attached. Baking continues overnight.

---

4 OCTOBER

07:30 Found temperatures decreased overnight by around 10 C. See attached. 
We are still baking at full power. Room temperature has not changed.
Most likely explanation is part of the tent giving / moving due to the baking and a draft being developed.
Will keep monitoring during the day.

13:50 Temperatures stable, no changes from last check.

20:22 Temperatures stable. See attached. Leaving overnight.

I have (fingers crossed) got the baking stepping up nicely now. I have used some of the outer shell to act as a shield and to direct airflow towards the front and back of the baking volume. I also moved the RE-72 thermocouples to a higher temperature region and replaced the broken thermocouples. The program is on automatic mode and has currently stepped up to 40C with the max diff reduced to ~4C.

I will continue monitoring for a bit but all looks good at the moment. 

Additionally, our baking exploits over the weekend got us down to 9e-9 mbar when I came in this morning.

Sat 26 Sep

09:15 Baking started automatic mode

13:30 Baking continues, heating is slower than expected due to high chamber bottom temperatures

00:00 Baking stopped. Temperatures won't increase due to high temperature of the bottom of the chamber producing thermal gradients that are too high. I believe this is due to heaters being closer to the chamber as tray sits higher up than in previous test (see heaters.png). A shield above the heaters, similar to those we utilised in early tests in Edinburgh, may help to disperse the heat more evenly around the baking volume and not directly at the bottom of the chamber. I can improvise a shield similar to those using pieces of the aluminium outer layer of the baking setup I have spare on Monday and restart baking. This will also allow me to replace the two damaged thermocouples

Sun 27 Sep

11:50 Baking restarted. Manually set temperature to 50 C. Started automatic mode for additional safety checks. Will check again / increase temperature manually in a few hours

13:45 Found baking had stopped due to automatic mode detecting negative temperature gradient in TC7 Floating (bottom). See plot attached. Restarted baking at 50 C in manual mode

17:30 Found temperatures had stabilised. Increased temperature to 60 C. Issues seems to be that bottom thermocouples run hotter than the reference thermocouples of the RE72. The temperature the RE72 are set to maintain is not the temperature of the chamber. This is the cause of the strong gradients. Swapping the position of the thermocouples may be sufficient. Thermocouples presumed faulty on Friday may be working OK - could just be positioned in hot spot immediately above heaters.

18:00 Baking off to allow cooling down overnight.

10:00   Vessel P = 3.99e-8 mbar,  RGA P = 1.4e-6 mbar 

10:54   Vessel P = 3.89e-8 mbar,  RGA P = 1.4e-6 mbar

Vessel continues to pump down. Baking Jacket fully installed and testing of baking begins before leaving on automatic mode for the week. Some baking jacket pieces may need to be re-jigged a little for use in GSI with the interaction chamber but will be fine for this bakeout. Note that due to the valves 'being in the way' the front of the baking volume holds the majority of the heaters

During this testing phase I have noticed the vessel pressure increase slightly even with vessel temperatures of approx 30C. Pvessel = 5.66e-8 mbar currently. 

Automatic mode started 14:06. I will monitor to check everything is okay before letting it run over the weekend 

16:00 I have noticed that two of the thermocouples floating(back) and floating(top) may be damaged as they were giving sharp spikes in temperature. I have just removed these thermocouples so they should just read the picologger temp. The jacket looks like it is holding temperature quite well. I have set the temperature to 35C and am currently waiting for temperatures to equillibriate before putting back into automatic mode. Pvessel = 1.68e-7 mbar

19:00 Temperatures look good, I will begin bakeout tomorrow morning now, so if anything goes wrong its not in the middle of the night. Have a good weekend all!

Following overnight pumping by Leybold turbo pump

09.12 6.26e-8mbar, 2.8e-6mbar (RGA station), leak rate 5e-12 mbar.l/s

09:52 6.08e-8mbar, 2.8e-6mbar (RGA station), leak rate 8e-12 mbar.l/s

10.10 6.02e-8mbar, 2.8e-6mbar (RGA station), leak rate 8.5e-12mbar.l/s 
KM says leak cart currently isolated CARME chamber + RGA cart - no He
has been used around chamber this week so figure represents noise.

10.36 5.94e-8mbar, 2.8e-6mbar (RGA station), leak rate 4.7e-12 mbar.l/s

10.40 KM isolated RGA station (@RGA station) from CARME chamber to replace current RGA (FC sensor) with a more sensitive RGA (with multiplier + FC sensor) 

CARME vacuum pressure (with no backing) will rise somewhat during this process

11.17 1.35e-7mbar

11.20 New RGA install complete, backing line opened, CARME pressure recovers in < 10s to 5.83e-8mbar

14.08 5.59e-8mbar, 2.7e-6mbar (RGA station), leak cart disconnected (by KM)

Cables for neg and neg ion pumps connected with cables trailed out of the octagon through back and front of the octagon. Neg-ion pump connectors are labelled with Kapton 
tape to prevent confusion with neg connectors. Baking jacket has been partially constructed and will be completed tomorrow. 

Connected Leybold Ionivac IE514 to Leybold Combivac CM52 Vacuum Gauge Controller

Rear panel - power ON

POST checks OK

Change parameters by

select PARA

select <-> to display Sen

select PARA to display S-on

select <-> to display HAnd

select PARA and hold for 7s

select CH to select CH3

select -> hold for 2s 

With CARME gate valve closed for c. 24h CARME chamber pressure is 6.43e-5mbar @ 13.34, 6.52e-5mbar @ 14.15


15.45 CARME Leybold turbo restarted

16.06 1.58e-6mbar, 3.5e-5mbar (RGA station), leak rate 3.6e-10 mbar.l/s

16.27 9.44e-7mbar, 3.3e-5mbar (RGA station), leak rate 3.6e-10 mbar.l/s

16.39 7.67e-7mbar

17.00 5.85e-7mbar, 2.5e-5mbar (RGA station), leak rate 2.60e-10 mbar.l/s

17.20 4.83-7mbar, 2.3e-5mbar (RGA station), leak rate 2.17e-10 mbar.l/s

Baking octagon moved into position along with the bottom insulation and heaters
 

Turbo-pump Issue approximately 13:00 22/9/20.

While moving the baking octagon into position, the power connector became disconnected from the turbo pump. The pump controller provided the warnings of connector failure and high pump load (probably due to it reading the frequency of the pump as 0 Hz when disconnected and thinking this was due to a high pump load). I believe the valve then was slightly knocked causing a vibration in the turbo, which couldn't be corrected for by the controller as it had become disconnected. The result of this was the turbo noise growing louder (similar to the turbo in the edinburgh lab when venting). At the time I didn't know the connector had become disconnected, as it was still attached to the turbo, and due to the warning messages on the controller, noise of the turbo and lack of information on what had happend, I decided to close the valve connecting the chamber to the turbo and vent the backing line up to the turbo and in order to remove and replace the turbo. 

The chamber was in the high -6 mbar range when the valve was closed. The turbo was replaced with the second turbo which began pumping again (with the power connector properly secured this time) on 23/9/20. The turbo doesn't show any obvious sign of damage, the blades in it are free to spin with no hindrance, but we will have to get it tested by the vac lab to be sure. 

Cooling of baking volume finished over the weekend, attached are some plots of the bakeout test. Bakeout2.png is the thermocouple profile for the entire period over the week. The heating in the first seven hours followed a nice linear rise of ~5C/hour, in the 7-40 hour period the heating rate slowed due to an issue with our octagon average limiting the increase in the temperature. The period from 40-65 hours was due to the picologger heating up to unacceptbly high temperatures which paused the heating. The octagon average and picologger problems were solved after this, with hours 65-75 showing the linear increase seen previously of ~5C/hour until the maximum temperature of the was reached. The maximum of the RE-72 controllers was 135C with the chamber average ~140C. The next 48 hours the bakeout was left to maintain its temperature, with slight day/night variations observed. During this period both heaters were on in order to maintain the temperature as can be seen in RE72_test2.png, where 1 represents the heater on and 0 the heater off (note for RE72 1 I have shifted these values to 1.5 and 0.5 respectively to better show on the same plot). The rest of the bakeout time shows the cooling of the volume in a serious of 10C and 5C steps. 

Graphs for the cooling profiles of each step (5C and 10C) are attached. Keeping the chamber temperature gradient below 10C is most dependent upon the top and bottom temperatures of the chamber. The bottom of the chamber cools much faster than the top of the chamber, down to a minimum value before the heaters kick back in once the RE72 temperatures arrive at the set point. An equillibrium time is then required for the top of the chamber to cool before the next step can be implemented. The 5C steps are recommened for future cooling due to chamber gradients not exceeding the 10C limit and the shorter 'equillibrium time'. Top/Bottom_test2.png shows the difference in chamber and air temperatures between the top and bottom of the baking volume, with a large difference in the air temperature between top and bottom potentially having a significant effect on the cooling of the chamber. I hope improved insulation on the main chamber will result in less heat losses from the bottom of the baking volume and a smaller cooling gradient for the bottom of the chamber during the step down. 

I have deconstructed the baking jacket on the chamber and am ready to begin moving the jacket over to the other chamber. 

Pressure on the leak cart is 7.1e-7 mbar as of 09:44. 

10:28
Reducing temperature in steps. System cooling down. See attached.

Pressure on the leak cart: 1.6e-6 mbar

The Chamber has continued to pump overnight and we have reached a pressure of 3.3e-6 mbar as of 10:15. Power cable for the hot cathode gauge was found. Gauge did not give a reading so pin connections were checked, all is okay so it may be thepressure is still too high within the chamber, gauge was thus turned off. I have attached the RGA from this morning which has increased accuracy so has been cleared up for most of the noise from yesterday. I have begun removing the covers for the neg-ion pumps, attached is the how it looks without the cover. The covers have strong magnets in them so I will put in a box far away from our electronics.

10:15    3.3e-6 mbar (cart)

11:27    3.2e-6 mbar (cart)

13:26    3.2e-6 mbar (cart)

16:00    3.2e-6 mbar (cart)

I have begun manually reducing the temperature for the bakeout, to observe the rate of cooling across the vessel. I have noticed a bug in the program, the rate of each thermocouple reads as if it is increasing despite the decrease in temperature of the thermocouple. The actual temperatures and averages appear to be working okay. 

09:43   RE-72 temperatures are 135 deg. Temperature set to 125 deg.

11:01   RE-72 temperatures are 125 deg. Chamber temps equillibriating, average chamber temperature 125.5 deg and max difference is ~3 deg. Temperature set to 100 deg.

11:14   RE-72 temperatures are 115 deg. Chamber max difference exceeds 10 deg, chamber average is 115 deg. Temperature set to 115 deg will wait to equilllibriate. Recommend not to lower temperature by >10 deg. Top of the chamber cools much slower than the bottom. 

13:26   RE-72 temperatures are 115 deg. Chamber average is 115.3 deg, chamber max difference is 2.8 deg. Temperature set to 105 deg.

14:20 Previously unobserved bug occured - all temperature display frozen. Rates still OK. Temperature control still OK. Rebooted Baking.x remotely. Back OK. Reduced temperature to 90 C. See attached temperature plot before rebooting.

18:00 Temperature reduced to 80 deg.

21:25 Temperature reduced to 75 deg.

A pump cart and leak cart have been connected to the chamber via the top turbo at the back of the chamber. An air line has also been connected to the valve to open/close it. The pirani gaige has also been replaced by a blank flange, a gauge on the pump cart can measure the pressure in its range. The turbo fan and controller were set up and pumping was started after lunch. 

While pumping, the hot cathode gauge was connected to its controller and bakeable shell installed. Gauge will be turned on if pressure is sufficiently low tomorrow, currently no gauges are 'active' on the chamber with the only gauges on the pump cart. 

An RGA is attached to the pump cart and can be seen in attached photos. Majority of contribution in RGA is water with significant contributions from gases in air (nitrogen, oxygen etc) as expected during early pumping. RGA is also quite noisy. 

The leak rate observed is below the minimum value the leak cart can detect (<1e-12 mbar*l/s). Helium was sprayed around the chamber and on the wire seals, however no change in the leak rate was observed, so no significant leaks!

The turbo has been left to pump overnight with the pressure 2e-5 mbar at 16:15. Attached is the pressure against time from 15:00 till 16:15, the rate of pumping in this period was 0.68e-5 mbar/hour. 

16 September

08:50
Baking continues OK. Temperatures stable, did not increase with respect to yesterday evening.
See attached.

15:00
Baking continues OK.
See attached.

20:22
Baking continues OK.
See attached.

17 September

08:20
Baking continues OK. Temperatures slightly decreasing?
See attached.

Tuesday 15 September

08:40
Rates started working again. Unclear what yesterday evening's bug was caused by. Will investigate eventually.
Temperature setpoint reach T=150 , however even at full power (heating constantly on) the RE72 appear unable to
reach past T = 135
See attached.

Perhaps better insulation would be required. 
However, this temperature is sufficient to bake CARME with the detectors inserted.


Day shift
Baking continues and will be left overnight to gather more data. Vessel temperatures are increasing by roughly 1.5 deg/hour with the vessel average temperature now 141.5 
deg.

Wire seals fully closed and tightened. Bolts were tightened first finger tight, then to 50 N.m and finally to 80 N.m in a pattern so that seal is closed evenly. Leak and 
pump cart are ready to be connected to the turbo for leak testing tomorrow. 


19:20
Baking continues OK. Temperatures seem to increase slowly. See attached.

Mon 14 Sep 09:50

Jordan moved the TC08 picolog 2 away from the chamber and built a makeshit heatshield. 
Picolog 2 was facing a slit in the cloth thorugh which the scroll pump flexible hose is connected.
Baking restarted in automatic mode from 80 C

12:09
Baking progressed OK - see attached.

~13:00
CJC 2 getting too high again. Baking went off. Jordan caught it and temporarily set in manual mode.
Moved picolog 2 further away. Increased amount of heatshield. Restarted in auto

17:30
Baking continues OK - see attached.
Will leave overnight.

19:30
Baking continues OK, T=124C , see attached.
However rates shown on Baking.x program appear nonsensical. Too high, too low, sometimes they all go to zero.
Clearly a bug in the code. Should not affect baking for now.
Will try to debug.

Sun 13 Sep 08:06

Baking reached 93 C yesterday afternoon at 16:18 and paused as a result of a percieved temperature gradient in
the octagon. 
See attached.

Left system overnight to check whether octagon gradient was going to equilibrate via convection. 
No changes this morning.
Thermocouple 1-8 labeled "Octagon (side)" likely is not in thermal contact with the octagon. 
It appears to have a temperature lower than room temperature. Possibly sits outside the tent? Gradient will not
decrease with time.

Temporarily overrode automatic mode, set temperature to 100 C, restarted automatic mode. Will keep monitoring.


Sun 13 Sep 10:00

Vessel reached 100 C, no gradients. All OK, except octagon gradient (ignoring).
Manually increased temperature to 110 C. Restored automatic mode.

Sun 13 Sep 12:00

Baking stopped automatically at 10:30 due to CJC temperature (aka room temperature 2) in TC-08 Picolog 2
exceeding 40 C.
Max operating temperature of picolog TC08 is 50 C, and accuracy is lost above 30 C.
https://www.picotech.com/data-logger/tc-08/usb-tc-08-specifications

Stopped baking. Removed thermocouple 1-8 "Octagon (side)" from Octagon gradient calculation and recompiled.
Restarted manually at T = 80 C

Please move picolog away from the tent tomorrow, and we can then increase temperature. Tent does not need to be
opened.

Sun 13 Sep 19:00
Vessel temperature at 80 C stable. 
Other temperatures stable. 
Leaving at 80 C overnight.

Saturday 12 Sep 08:43

Remotely checked status of baking. See attached.

Baking appears to be proceeding OK. No thermocouples disconnected.

Speed is slower than previously observed, limited by thermal gradients observed across both octagon and CARME
vessel as a result of new thermocouple placement.
Octagon gradient may not be real, and could be a result of placement of Octagon side thermocouple?

Main concern is temperature recorded by CJC in Picolog2 (aka Room temperature 2) at 31 C, increasing. 
The second picolog may be too close to the tent. If the temperature keeps increasing it may stop working. Will
keep monitoring.

All neg feed-throughs have now been fully installed, with ground tags 
and power wires crimped and attached to the correct pins. Feed-throughs 
are installed as seen in Image 
1 of zip file, with mark at the top of the feed-through. The pin 
assignment is seen in Image 2. The pins are assigned letters A to F, 
with F the top pin and C the bottom 
pin as installed(refer to images 1+2). The ground is pin c, with the 
two power wires connected to the bottom pins either side of the ground 
(pins b and d). Connections of 
wires from the negs to the feed-through is seen in image 3. Feed-
throughs have been electrically checked. The ground pin is checked 
against the chamber giving 
approx 0.5 ohms and the power pins are checked together giving 5-10 
ohms. Each of the power pins are open circuit with respect to the 
ground. A 
thermocouple has been attached under the bolt of one of the neg pumps 
(image 4).

Pirani gauge and hot cathode gauge have been installed on the chamber 
(images 5,6,7,8) on the section furthest from the turbos. 

Upper valve, turbo and supports have all now been installed (images 
9,10,11). Images 12,13 are of the internal of the turbo and turbo 
ports. The lower valve supports 
produced by the Daresbury group (image 14) are also now attached. These 
supports were required as the lower valve sits higher than anticipated 
due to shorter right-angled 
flanges.

Chamber is now ready to close and leak test!

4/6 of the neg feedthroughs installed. Continuity between the power pins, ground pin and the chamber has been checked, we observe 5-10 ohms between the power pins similar to previous checks on the heaters. Also attached are the crimps for the ground tag and feedthrough connector pins.