Removed tent, octagon, Neg cables.

Disconnected and removed Baking Pi, TC08, thermocouples.

Tested new rails, plates, fees - it fits. Need to check on the flange next.

Will soon turn off CARME IE514 gauge to bias test the DSSDs.

All four detectors were bias tested using the new flexi-rigid adaptor cards. Note the LK-1 jumper was removed from the adaptor cards so that 'open line' was observed between the bias lemo and the ground. Attachment 1 shows VI curves for all detectors. The maximum leakage current for all detectors appears lower than previous bias tests eg elog 400 -> temperature was ~17C today compared to ~20C for elog 400. We also performed a bias test using the old adaptor cards to see if there was any difference between the old and new cards. No significant difference was observed. For the top left detector we initally observed a significantly large leakage current (4.2 uA at 20V, 8.7 uA at 30V) which had ~1 uA fluctuations. We left for 5 minutes to see if it stabilised and the leakage current suddenly dropped to what is shown in the plot. This leakage current then appeared stable for the rest of the test. Perhaps this effect was observed by Tom but for the top right detector in elog 421?

We plan to connect the bias as we did in the 14N+d measurement so that we can monitor and plot the leakage current over the weekend.

Local power outage at the CRYRING today, while JG was trying to activate the ion pumps. Unlcear what caused it.

Valve on scroll worked as intended, but CARME reacehd 1E-7 mbar from turbo (?) venting.

Power restored. Pressure back in the 1E-11 mbar range, decreasing.

Temperature still well above room.

09:40 - Found temperature and pressure stablised, but too high to comfortably activate NEGs closest to detectors. Detector temperature around 90C. This was expected. Ramped down UHV1400 #1,2,3,4 to P=50W (200C?). Ramped down heaters to 100, 80, 100C. Ramped down heating jacket to 60C.

10:00 - Activated set #5 (x2) at 80W tramp=30, thold=infinity; set#6 (x3) at 120W rest as #5. This is different from previous procedure because we have 4x DSSD but sensor only one one of them. It seems less dangerous to heat up everything at once so that the one TC we have is hopefully representative of the situation.

10:15 - CARME cooling. No visible effects on temperature. Tried P#5 100, P#6 150 W. (500C roughly?) Will probably have to decrease.

10:25 - Detectors getting hotter quickly, but still below 100C. No changes for now.

10:35 - As expected, detectors are getting too hot, too quickly. Decreased power to 60, 90 W

10:43 - Ramped down #5,6 to 40, 60 W. Should be around 200C at equilibrium.

10:45 - Also decreased #1,2,3,4 to 40W, and D2000 to 150C.

10:52 - Further decreased #5,6 to 10, 15W.

11:04 - Temperature back under control

11:10 - Detectors actually cooling now. Increased #5,6 to 20,30 W.

11:18 - Detectors still cooling. Increased #5.6 to 30,45W. If stable plan to leave like this until later this afternoon.

13:23 - Temperatures stable. Increased #5,6 to 40, 60 W. Decreased heaters to 80,80,80 C. Decreased jacket to 40C. Opened the tent partly to connect the vacuum division non-bakeable ion pump cable.

13:35 - Ion pump cable connected and tent closed as best I can. Interestingly, the pressure is going up probably as a result of the detector/kapton cables temperature going up due to the slight increase in #5,6 power.

14:15? - Graziano S. flashed the vacuum divison ion pump.

14:25 - Pressure keeps increasing slightly. I am taking this as a sign the kapton is outgassing, which is being made to out gass which is good. Decided to leave temperatures as they are until later today and start cooling down in the late afternoon / evening. Decreased slightly #5,6 to 34, 51W. Increased D2000 to 200C. Will leave like this if stable.

15:00 - Looks stable. See attachment 3. Leaving for a few hours, before proceeding to gradual cool down overnight. Will ask Jan for help in turning everything really off.

18:00 - All NEGs off. All apadev 10&11 channels to 40C. Ion pumps remain off. Asked JG to come tomorrow late morning and turn the apadev channels off and the ions pumps on.

9:00 - Michael's online vacuum pressure plot is no longer working - an old image is being displayed. CARME temperatures around 80-85C. Lowered heater temperatures to 150, 100, 150 C for safety. Lowered jacket temperature to 80C

9:15 - Flashed ion pumps several times. Small pressure increase, up to ~7E-9 but not macroscopic

9:30 - Started D-2000 #1,2. T=400, tramp 30, thold 90 (this was a mistake 1,3 are behind the detectors, 2,4 are to the side. They should ideally be activated together. Got confused. Not a big deal.)

9:50 - Online vacuum plot is working again. Pressure changing, internals around 80C

10:00 - Internal temperature still stable at 80C. Started D-2000 #3,4. T=400, tramp 30, thold 90

11:30 - For unclerar reasons the pressure has been increasing over the last half hour, after the four NEGs were activated. Nikos and the alignment group were adjusting the feet of the interaction chamber to improve the alignment. Hopefully this is not a leak. Section 10 was apparently vented overnight, and may be in air at the moment.

11:45 - D2000 activation complete. Set temperature to 200C for all four of them. Altough the temperature is still >375C, the pressure drops very quickly. This is good, but I have not observed this behaviour before.

13:10 - Pressure and temperature mostly stable. Turning on UHV1400 groups #1, 2 with at P=250W, tramp 30s, thold 90s.

13:35 - No effect on DSSD temperature. Increasing P->300W as per previous activation procedure.

13:43 - Still no sizeable effect. Increased P->350 W

15:00 - Completed activation of UHV1400 sets #1,2. Set power to 100W. Activated sets #3,4 at P=250W, same settings as other two.

15:30 - Increased UHV1400 #3,4 to P=300 W. Temperatures OK.

15:37 - Increased UHV1400 #3,4 to P=350 W. Temperatures increasing but still acceptable.

16:06 - Temperatures are starting to get a bit too high. Decreased P->300W. Also decreased heaters to 125, 80, 125C and baking jacket to 70 C.

16:26 - Decreased UHV1400 #3,4 to P=250W.

17:05 - Completed activation of UHV1400 sets #3,4. Set power to 100W. Planning to leave stabilising overnight.

10:40 - Status as attached. Heaters setpoint/read at 250 C, 150 C, 225 C. Power stable at 53%, 41%, 63%

10:45 - Informed HKR ramp down / pump activation is starting for CARME only. Setpoints to 200, 125, 200 C. Monitoring slow ramp down.

14:10 - Heater temperatures reached the set points. Power stabilising. CARME internals temperature dropped to around 100 C and still falling. Waiting until later today to further reduce heater setpoint. Will probably aim for 80 C before beginning activation.

15:45 - Heater setpoints to 175, 100, 175 C

15:50 - Interaction chamber jacket setpoints to 100C

18:00 -  CARME temperature decreasing, not stable yet. Will check later tonight.

20:43 - CARME internals around 85C, not quite stable still. Waiting overnight.

09.40 CARME IE514 1.79e-8 mbar, ambient temperature 20.7 deg C

      CARME bakeout monitor, ELOTECH R4000 temperature controller front panel and Grafana bakeout dashboard- attachments 1-3

      No change to ELOTECH R4000 set point

09.35 CARME IE514 1.95e-8 mbar, ambient temperature 20.8 deg C

      CARME bakeout monitor, ELOTECH R4000 temperature controller front panel and Grafana bakeout dashboard- attachments 1-3

      No change to ELOTECH R4000 set point

17.45 CARME IE514 1.91e-8 mbar, ambient temperature 20.8 deg C

      CARME bakeout monitor, ELOTECH R4000 temperature controller front panel and Grafana bakeout dashboard- attachments 4-6

      No change to ELOTECH R4000 set point

11.20 CARME IE514 3.53e-9 mbar, ambient temperature 20.6 deg C

      CARME bakeout monitor, ELOTECH R4000 temperature controller front panel and Grafana bakeout dashboard- attachments 1-3

      Change ELOTECH R4000 set points for CARME heaters #1 and #3 to 200 deg C, heater #2 to 150 deg C

14.10 CARME IE514 6.12e-9 mbar, ambient temperature 20.7 deg C

      CARME bakeout monitor, ELOTECH R4000 temperature controller front panel and Grafana bakeout dashboard- attachments 4-6

      Change ELOTECH R4000 set points for CARME heaters #1, #2 and #3 to 225, 175 and 225 deg C respectively.


18.10 CARME IE514 1.92e-8 mbar, ambient temperature 20.8 deg C

      CARME bakeout monitor, ELOTECH R4000 temperature controller front panel and Grafana bakeout dashboard- attachments 7-9

      Change ELOTECH R4000 set points for CARME heaters #1, #2 and #3 to 250, 150 and 225 deg C respectively.
      All other ( active ) ELOTECH R4000 set points ( interaction chamber etc ) to 130 deg C.

20.25 CARME IE514 2.14e-8 mbar, ambient temperature 20.8 deg C

      CARME bakeout monitor, ELOTECH R4000 temperature controller front panel and Grafana bakeout dashboard- attachments 10-12

      No change to ELOTECH R4000 set points

10.50 CARME IE514 7.14e-10 mbar, ambient temperature 20.8 deg C

      CARME bakeout monitor, ELOTECH R4000 temperature controller front panel and Grafana bakeout dashboard- attachments 1-3

      Change ELOTECH R4000 set points for CARME heaters #1 and #3 to 125 deg C

14.20 CARME IE514 8.25e-10 mbar, ambient temperature 20.8 deg C

      CARME bakeout monitor, ELOTECH R4000 temperature controller front panel and Grafana bakeout dashboard- attachments 4-6

      Change ELOTECH R4000 set points for CARME heaters #1 and #3 to 150 deg C

18.30 CARME IE514 1.29e-9 mbar, ambient temperature 20.7 deg C

      CARME bakeout monitor, ELOTECH R4000 temperature controller front panel and Grafana bakeout dashboard- attachments 7-9

      Change ELOTECH R4000 set points for CARME heaters #1 and #3 to 175 deg C and heater #2 to 125 deg C

09.50 CARME IE514 9.0e-11 mbar, ambient temperature 21.3 deg C

      CARME bakeout monitor and ELOTECH temperature controller - attachments 1 & 2


10.15 Commence bakeout ramp
      Set all ELOTECH PID temperature controller zones ( channels ) to 50 deg C
      Expect all non-CARME zones to reach temperature set point quickly. There will be a delay for the TCs corresponding to the CARME heaters but the internal CAME TCs 
will respond more slowly- will observe response of CARME TCs over time.

10.35 ELOTECH temperature controller - attachment 3

11.10 CARME TCs change from c. 25-28 deg C to 28-35 deg C

11.15 Set all ELOTECH PID temperature controller zones ( channels ) to 100 deg C

12.15 CARME IE514 1.39e-10 mbar, ambient temperature 20.8 deg C

      CARME bakeout monitor and ELOTECH temperature controller - attachments 4 & 5


14.20 CARME IE514 3.62e-10 mbar, ambient temperature 20.8 deg C

      CARME bakeout monitor, ELOTECH temperature controller front panel and Grafana bakeout dashboard- attachments 6-8

15.20 Whilst all of the ELOTECH temperature controller TCs are at their current set point ( 100 deg C ), the CARME TCs are not yet at equilibrium. Plan to leave system 
in current state until tomorrow morning. Assuming CARME is at equilibrium will then increment ELOTECH temperature controller TC set points.

17.50 CARME IE514 6.59e-10 mbar, ambient temperature 20.6 deg C

      CARME bakeout monitor, ELOTECH temperature controller front panel and Grafana bakeout dashboard- attachments 9-11

10.20 CARME IE514 8.6e-11 mbar

      CARME bakeout monitor and ELOTECH bakeout controller status - see attachments 1 & 2

      The CARME bakeout monitor shows recovery from test yesterday evening. The ELOTECH controller was switched to manual mode for the 3x CARME zones and 5% power selected 
for 45 minutes. CARME TCs increased from mid-20s to high 20s/low 30s over a period of 45 minutes. At the conclusion of the test power was set to 0% for all 3x CARME zones 
and the mode changed from manual to controlled.

16.55 CARME IE514 8.2e-11 mbar

      Vacuum pressure increased slowly overnight from c. 6e-11 mbar yesterday to c. 8e-11 mbar today following low power startup tests of the bakeout controller heating 
the CARME interaction and detector chambers yesterday and today.


Attachment 1 - bakeout controller config courtesy Anton Kalinin

Attachments 2 & 3 - bakeout controller summary displays and CARME bakeout monitor display c. 17.00 today

The 3x CARME heaters are connected to controller #4 zones # 1-3, i.e. lower right display, zones 1-3, mains fuses F9-F11

17.30 3x ( of 4x ) SAES D-2000 ion pump controllers ( SIP modules ) switched off. Fourth controller was already switched off and SHV cable disconnected from rear panel of 
SIP module.

09.07 IE514 pressure 6.4e-11 mbar, ambient temperature +20.3 deg C

      Using appc218 ( account carme ) workstation by the CARME 19" rack 
     
      ssh pi@carmebakingpi

      Re-connect to bakeout monitor app 

      screen -dR

      See attcahment 1


12.02 Vacuum group ion pump disconnected and RGA removed from CARME chamber -  outside of CARME bakeout tent 'closed' - see attachments 2-4

      Vacuum group IE514 to be disconnected


14.45 Vacuum group disconnect their IE514

      Inside of CARME bakeout tent closed

      Photos of the CARME bakeout tent inside and outside CRYRING - see attachments 5-7  

17.33 IE514 pressure 6.4e-11 mbar, ambient temperature +20.8 deg C

      The thermocouples on the 3x groups of heater elements have been detached from direct contact with the heating element and now float abpove the heating element by 2-
3cm - see attachments 1 & 2

      The vacuum group IE514 and Ametek RGA are still attached to CARME - see attachment 3. Have requested vacuum group remove them.

      The 'air side' of the Be window on the interaction chamber is under vacuum provided by small Agilent scroll pump.

      

Attached are plots for the previous bakeout of CARME which may aid in the bakeout to come in the following week.  

Plots relate the heater temperatures and heater powers with the chamber temperature (internal floating thermocouple) and pressure inside CARME. 

Attached are the plotted curves from vacuum and heater temperature (actual and set values from ISOHEAT controllers) during the bakeout process. Channel assignment as per post 433.

Found CARME in XHV at 1.1E-11 mbar. Chamber temperature around 30C cooling slowly.

Closed GV to top turbo. Pressure goes up but appears to recover around 2.5E-11 mbar, on line with several previous observations that sectioning off the turbo results in a higher reading in the IE514.

Left turbo on. Remember to not turn it off when removing the tent.

9:10 Set heaters temperature 300 -> 250 C in preparation for cooling down and to help keep DSSD temperature down. Started activating set 6 (3 X DSSD) at 120 W as per previous procedure.

9:15 Realised previous choice is a mistake in the current configuration as the DSSD TC is closer to set 5. Set 6 off. Set 5 to 60W. No effects in temperature. Ramped slowly to 200W. No immediate effect in temperature, while vacuum goes up.

9:30 Started activating set 6 at 300W (=100 per module). This should give us the best feedback on DSSD temperature from the only TC we have since they should all be at similar temperatures. 

9:40 DSSD TC shows temperature decreasing rapidly (-17C/h). That's nonsense. The TC cannot be working properly, which means activation is now quite dangerous. Looking at strain relief TC instead from now, which is still at 85C. Set 5 down to 30W for safety while set 6 finishes ramping up.

9:45 DSSD TC still reading nonsense at 35C cooling by 20C per hour. Strain relief TC at 85C heating up by 10C per hour is more realistic. Vacuum worsening as set 6 reached 300W. Immediately ramped down to 120W. Leaving for 30 minutes, or less if strain relief temperature increases too much.

9:57 Strain relief heating quickly at 90C. Decided to turn off ALL negs for safety. Set heaters to 200C.

10:18 Strain relief temperature finally slowing down heating rate. DSSD TC beings displaying increasing temperature. The TC wire on the TC-08 module is clearly damaged.

After lunch, turned on the four ion elements of the D-2000. Pump#4 is not working, and apparently module #2 also has issues. Used module #4 on pump#2 to get three working pumps. Others will have to be investigated when the tent is removed and we can have some access to the pumps.

Tried closing gate valve to turbo. Vacuum does not seem to really improve. Opened. Will try again tomorrow morning.

Vacuum division ion pump on as well.

Found CARME at 50C, a bit cooler than expected, probably due to invasive tent changes yesterday to mount missing wires. Increased heaters temperature to 300C

9:35 Started D-2000 #1,3 (behind the DSSD). T=400, tramp 30, thold 90

11:20 Set D-2000 1,3 to 200C. Turned on D-2000 2,4 as above 

13:15 Set D-2000 2,4 to 200C. Turned on UHV1400 set 1 at 250W, tramp 30, thold infinity (will ramp down manually as required)

13:20 No appreciable effects on DSSD temperature. Turned on set 2 as well, which should be mounted close nearby.

13:45 Both sets reached 250W. No effects on detector temperature. Increased to 300W. Vacuum gets slightly worse, but recovers quickly. Not worth further increasing power. Leaving for 90 minutes.

15:20 Strain relief TC at 75C quite hotter than detector TC at 35C. Might be normal. Vacuum division IE514 must have been degassed remotely? Decreased set 1,2 to 75W. Turned on sets 3,4 to 250W as above. 

15:45 Sets 3, 4 now at 250W. Detector TC heating quickly at 13C/h but nowhere near dangerous temperatures yet. Decreased sets 1,2 to 50W. Leaving for 90 minutes.

17:15 Sets 3, 4 to 50W. Slightly worrying temperature difference between detectors and strain relief around 65C. Different materials and different positions could explain this.

17:40 Oddly, detector temperature now going up sharply (temperature diff. down to 40C) since the uhv1400 power was decreased. Cannot think of s logical reason,  it may just be a coincidence and heat transfer is catching up.

Leaving overnight. Will turn on the last two groups of UHV1400 tomorrow morning.