AIDA GELINA BRIKEN nToF CRIB ISOLDE CIRCE nTOFCapture DESPEC DTAS EDI_PSA 179Ta CARME StellarModelling DCF K40
  CARME, Page 4 of 38  ELOG logo
Entry  Tue Jul 18 08:16:28 2023, TD, Pumping down. Issues found with one detector. 
09.15 Following overnight pumping of CARME chamber by Leybold turbo
      Pirani 1.00e-3 mbar IE514 2.83e-7 mbar

     The Leybold IE514 gauge currently in use is the CARME unit ( serial # 1054 ). The calibration data can be found at https://elog.ph.ed.ac.uk/CARME/56


09.44 Pirani 1.00e-3 mbar IE514 2.71e-7 mbar

10.10 Leak tester attached to backing line

      Valves to leak tester and turbo (connection to Edwards scroll pump in between) closed.

      Stop Edwards scroll pump with magnetic valve 'red' button - magnetic valves closes and Edwards scroll pump is switched off.

      Open valves to leak tester and then (slowly) turbo.

      Wait for leak tester to settle in e-12 mbar.l/s range. Leak tester pressure 3.6e-3 mbar. IE514 2.69e-7 mbar.

11.00 Pirani 1.00e-3 mbar IE514 2.42e-7 mbar
      Leak tester 1.8e-10 mbar.l/s

13.04 Pirani 1.00e-3 mbar IE514 2.06e-7 mbar

      Leak testing.
      Downstream DN100 flanges from CARME to dipole OK
      Lower NEG power connector feedhtrough (downstream chamber) OK
      Left hand side (looking downstream) bellows OK

      c. few e-9 mbar.l/s leak bottom left (lookimg downstream) of COF600 wire seal

      Additional torque to M16 bolts bottom left - c. 10 bolts -> 220Nm+

      c. 0.1-0.3e-11 mbar.l/s

      Further checks around circumference of COF600 seal reveal some small leaks c. e-11-12 mbar.l/s.? However background rate
      in leak tester too high for sensitive test - will await recovery to resume checking.

14.00 Pirani 9.8e-4 mbar IE514 1.96e-7 mbar
      Leak tester 4.9e-10 mbar.l/s


14.35 DSSSD test
      IE514 OFF

Ambient temperature 21.5 deg C

Top right
-10V -4uA
-20V 10uA
c. -30V > -20uA trip

Top left
-150V -5.15uA

Bottom left
-150V -4.97uA

Bottom right
-150V -6.33uA

Top right (repeat)
-20V -10uA
-25V -14uA

15.28 IE514 ON
      Pirani 9.8e-4 mbar IE514 1.87e-7 mbar

15.40 c. few e-9 mbar.l/s leak around magnetic valve - probably not an issue in terms of backing performance but may interfere with/confuse leak testing

16.05 Pirani 9.8e-4 mbar IE514 1.74e-7 mbar
      Leak tester 1.2e-9 mbar.l/s

Will leave CARME pumping with leak tester on roughing line and see whether leak rate recovers. If so, will continue leak tests tomorrow. 

18.50 Pirani 1.00e-3 mbar IE514 1.48e-7 mbar
      Leak tester < 1e-12 mbar.l/s (leak tester valved off)
Entry  Wed Jul 19 08:17:26 2023, TD, Leak testing 
09.16 Pirani 1.00e-3 mbar IE514 8.77e-8 mbar
      Leak tester c. 5e-12 mbar.l/s (leak tester valved off)

09.48 Pirani 1.00e-3 mbar IE514 8.67e-8 mbar
      Leak tester c. 3.5e-12 mbar.l/s (leak tester valved off)

10.33 Pirani 1.00e-3 mbar IE514 8.55e-8 mbar
      Leak tester c. 4e-10 mbar.l/s (leak tester connected to CARME roughing line)

10.55 Leak tester remains at few e-10 mbar.l/s - we do not understand why
      With leak tester in differential mode the highest reading around the COF600 seal is c. 3.5e-12 mbar.l/s
      Following checks elsewhere on the chamber we observe c. 6e-12 mbar.l/s which presumably reflects accumulation of He around the chamber 

      Dispersing He with compressed air reduces diff mode reading to c. 2e-12 mbar.l/s

11.00 Pirani 9.80e-4 mbar IE514 8.47e-8 mbar

14.49 Pirani 1.00e-3 mbar IE514 7.71e-8 mbar
      Leak tester isolated from CARME backing line - CARME Edwards scroll pump now backing turbo.
Entry  Thu Jul 20 08:29:26 2023, TD, Installing tent. Two NEG power cable broken. 11x
09.28 Pirani 1.00e-3 mbar IE514 5.45e-8 mbar

12.10 Bakeout tent frame installed
      SAES UHV1400 NEG pump power cables #1-6 installed
      See attachments 1 & 2

16.35 Attachments 3-6
      upstream baseplate
      3x sets of heaters beneath CARME chamber connected to CRYRING heater/TC manifold - attachments 7-8

      
16.45 Pirani 1.00e-3 mbar IE514 4.80e-8 mbar


17.10 SAES D-2000 #1 downstream, outside   NEG power + HV ( attachment 9 - OK cable connector )
      SAES D-2000 #3 downstream, inside   NEG power + HV
      SAES D-2000 #4 upstream, inside   HV
      SAES D-2000 #2 upstream, outside   HV

2x ( of 4x ) SAES D-2000 neg power cables were broken - forward-shell detached (unscrewed ) from back-shell remaining attached to D-2000 neg power connector. 
Re-assembly is straightforward but it is unclear how the 6x female sockets are aligned with the connector keys of the forward-shell (attachments 10-11 cf. attachment 9).
Until this is understood these 2x SAES D-2000 neg power cables should not be used.
Entry  Mon Sep 25 16:33:32 2023, TD, Removed tape from heaters TC 1000007072.jpg1000007067.jpg1000007070.jpg
17.33 IE514 pressure 6.4e-11 mbar, ambient temperature +20.8 deg C

      The thermocouples on the 3x groups of heater elements have been detached from direct contact with the heating element and now float abpove the heating element by 2-
3cm - see attachments 1 & 2

      The vacuum group IE514 and Ametek RGA are still attached to CARME - see attachment 3. Have requested vacuum group remove them.

      The 'air side' of the Be window on the interaction chamber is under vacuum provided by small Agilent scroll pump.

      
Entry  Tue Sep 26 08:08:42 2023, TD, Tuesday 26 September 7x
09.07 IE514 pressure 6.4e-11 mbar, ambient temperature +20.3 deg C

      Using appc218 ( account carme ) workstation by the CARME 19" rack 
     
      ssh pi@carmebakingpi

      Re-connect to bakeout monitor app 

      screen -dR

      See attcahment 1


12.02 Vacuum group ion pump disconnected and RGA removed from CARME chamber -  outside of CARME bakeout tent 'closed' - see attachments 2-4

      Vacuum group IE514 to be disconnected


14.45 Vacuum group disconnect their IE514

      Inside of CARME bakeout tent closed

      Photos of the CARME bakeout tent inside and outside CRYRING - see attachments 5-7  
Entry  Tue Sep 26 10:13:14 2023, TD, ELOTECH PID Temperature Controller R4000 manual ( German and English ) BA-Isoheat_R4000-XX-X-000-X-X_DE_V1.03.pdfR4000-XX-X-000-X-X_EN_V1.30.pdf
 
Entry  Wed Sep 27 15:56:41 2023, TD, Wednesday 27 September 1000007129.jpg1000007127.jpg1000007128.jpg
16.55 CARME IE514 8.2e-11 mbar

      Vacuum pressure increased slowly overnight from c. 6e-11 mbar yesterday to c. 8e-11 mbar today following low power startup tests of the bakeout controller heating 
the CARME interaction and detector chambers yesterday and today.


Attachment 1 - bakeout controller config courtesy Anton Kalinin

Attachments 2 & 3 - bakeout controller summary displays and CARME bakeout monitor display c. 17.00 today

The 3x CARME heaters are connected to controller #4 zones # 1-3, i.e. lower right display, zones 1-3, mains fuses F9-F11

17.30 3x ( of 4x ) SAES D-2000 ion pump controllers ( SIP modules ) switched off. Fourth controller was already switched off and SHV cable disconnected from rear panel of 
SIP module.
Entry  Thu Sep 28 09:19:50 2023, TD, Thursday 28 September 1000007142.jpg1000007143.jpg
10.20 CARME IE514 8.6e-11 mbar

      CARME bakeout monitor and ELOTECH bakeout controller status - see attachments 1 & 2

      The CARME bakeout monitor shows recovery from test yesterday evening. The ELOTECH controller was switched to manual mode for the 3x CARME zones and 5% power selected 
for 45 minutes. CARME TCs increased from mid-20s to high 20s/low 30s over a period of 45 minutes. At the conclusion of the test power was set to 0% for all 3x CARME zones 
and the mode changed from manual to controlled.
Entry  Fri Sep 29 08:54:29 2023, TD, Friday 29 September 11x
09.50 CARME IE514 9.0e-11 mbar, ambient temperature 21.3 deg C

      CARME bakeout monitor and ELOTECH temperature controller - attachments 1 & 2


10.15 Commence bakeout ramp
      Set all ELOTECH PID temperature controller zones ( channels ) to 50 deg C
      Expect all non-CARME zones to reach temperature set point quickly. There will be a delay for the TCs corresponding to the CARME heaters but the internal CAME TCs 
will respond more slowly- will observe response of CARME TCs over time.

10.35 ELOTECH temperature controller - attachment 3

11.10 CARME TCs change from c. 25-28 deg C to 28-35 deg C

11.15 Set all ELOTECH PID temperature controller zones ( channels ) to 100 deg C

12.15 CARME IE514 1.39e-10 mbar, ambient temperature 20.8 deg C

      CARME bakeout monitor and ELOTECH temperature controller - attachments 4 & 5


14.20 CARME IE514 3.62e-10 mbar, ambient temperature 20.8 deg C

      CARME bakeout monitor, ELOTECH temperature controller front panel and Grafana bakeout dashboard- attachments 6-8

15.20 Whilst all of the ELOTECH temperature controller TCs are at their current set point ( 100 deg C ), the CARME TCs are not yet at equilibrium. Plan to leave system 
in current state until tomorrow morning. Assuming CARME is at equilibrium will then increment ELOTECH temperature controller TC set points.

17.50 CARME IE514 6.59e-10 mbar, ambient temperature 20.6 deg C

      CARME bakeout monitor, ELOTECH temperature controller front panel and Grafana bakeout dashboard- attachments 9-11
Entry  Sat Sep 30 10:58:14 2023, TD, Saturday 30 September 9x
10.50 CARME IE514 7.14e-10 mbar, ambient temperature 20.8 deg C

      CARME bakeout monitor, ELOTECH R4000 temperature controller front panel and Grafana bakeout dashboard- attachments 1-3

      Change ELOTECH R4000 set points for CARME heaters #1 and #3 to 125 deg C

14.20 CARME IE514 8.25e-10 mbar, ambient temperature 20.8 deg C

      CARME bakeout monitor, ELOTECH R4000 temperature controller front panel and Grafana bakeout dashboard- attachments 4-6

      Change ELOTECH R4000 set points for CARME heaters #1 and #3 to 150 deg C

18.30 CARME IE514 1.29e-9 mbar, ambient temperature 20.7 deg C

      CARME bakeout monitor, ELOTECH R4000 temperature controller front panel and Grafana bakeout dashboard- attachments 7-9

      Change ELOTECH R4000 set points for CARME heaters #1 and #3 to 175 deg C and heater #2 to 125 deg C
Entry  Sun Oct 1 10:24:50 2023, TD, Sunday 1 October 12x
11.20 CARME IE514 3.53e-9 mbar, ambient temperature 20.6 deg C

      CARME bakeout monitor, ELOTECH R4000 temperature controller front panel and Grafana bakeout dashboard- attachments 1-3

      Change ELOTECH R4000 set points for CARME heaters #1 and #3 to 200 deg C, heater #2 to 150 deg C

14.10 CARME IE514 6.12e-9 mbar, ambient temperature 20.7 deg C

      CARME bakeout monitor, ELOTECH R4000 temperature controller front panel and Grafana bakeout dashboard- attachments 4-6

      Change ELOTECH R4000 set points for CARME heaters #1, #2 and #3 to 225, 175 and 225 deg C respectively.


18.10 CARME IE514 1.92e-8 mbar, ambient temperature 20.8 deg C

      CARME bakeout monitor, ELOTECH R4000 temperature controller front panel and Grafana bakeout dashboard- attachments 7-9

      Change ELOTECH R4000 set points for CARME heaters #1, #2 and #3 to 250, 150 and 225 deg C respectively.
      All other ( active ) ELOTECH R4000 set points ( interaction chamber etc ) to 130 deg C.

20.25 CARME IE514 2.14e-8 mbar, ambient temperature 20.8 deg C

      CARME bakeout monitor, ELOTECH R4000 temperature controller front panel and Grafana bakeout dashboard- attachments 10-12

      No change to ELOTECH R4000 set points
Entry  Mon Oct 2 08:41:43 2023, TD, Monday 2 October 6x
09.35 CARME IE514 1.95e-8 mbar, ambient temperature 20.8 deg C

      CARME bakeout monitor, ELOTECH R4000 temperature controller front panel and Grafana bakeout dashboard- attachments 1-3

      No change to ELOTECH R4000 set point

17.45 CARME IE514 1.91e-8 mbar, ambient temperature 20.8 deg C

      CARME bakeout monitor, ELOTECH R4000 temperature controller front panel and Grafana bakeout dashboard- attachments 4-6

      No change to ELOTECH R4000 set point
Entry  Tue Oct 3 08:48:36 2023, TD, Tuesday 3 October 1000007432.jpg1000007431.jpg1000007434.jpg
09.40 CARME IE514 1.79e-8 mbar, ambient temperature 20.7 deg C

      CARME bakeout monitor, ELOTECH R4000 temperature controller front panel and Grafana bakeout dashboard- attachments 1-3

      No change to ELOTECH R4000 set point
Entry  Tue Jan 16 14:36:30 2024, TD, CARME configuration dhcpd.confOptionsSettingsstartup.tclrfs
FEE64

#1 - #16 -> aida01 - aida16

Network configuration - /etc/dhcpd/dhcpd.conf - attachment 1

MIDAS Options

Added Options sub-directories for aida09-aida16 - attachment 2

MIDAS ASIC settings

Added sub-directories for aida09-aida16 - attachment 3

MIDAS configuration - /MIDAS/config/TclHttpd/carme-gsi"8015 - attachment 4
Currently only aida01-aida08 defined

MIDAS embedded rfs filesystems for aida01-aida24 alreday exist - attachment 5

All FEE64s connected to rev B CARME adaptor PCBs
LK1 fitted to n+n bias FEE64 ( aidaxx, aidaxx, aidaxx, aidaxx )
No other LKs fitted


MACB

WR source NIM WR emulator or VETAR2

See https://elog.ph.ed.ac.uk/DESPEC/517 for MACB mode configuration


CAEN N1419ET


EG&G Ortec 448 Pulser


ASIC settings


Options
Entry  Tue Jan 16 16:01:48 2024, TD, Change CARMEraspberrypi to nnrpi1 Capture.PNG
Change RPi from CARMEraspberrypi to nnrpi1 to provide carme-gsi access to Rly16 to control USB-controlled ac mains relay.
nnrpi1 is already defined in carme-gsi:/etc/dhcp/dhcpd.conf

Transfer RPi network connection from CRYRING local network to AIDA 24-port network Gbit switch

Change /etc/hostname from

CARMEraspberrypi

to

nnrpi1

Change /etc/hosts from

127.0.0.1	localhost
::1		localhost ip6-localhost ip6-loopback
ff02::1		ip6-allnodes
ff02::2		ip6-allrouters

127.0.1.1	raspberrypi	

to

127.0.0.1	localhost
::1		localhost ip6-localhost ip6-loopback
ff02::1		ip6-allnodes
ff02::2		ip6-allrouters

127.0.1.1	nnrpi1

Reboot RPi

Login to RPi and start MIDAS 8015 service

/MIDAS/TclHttpd/linux-arm/TclHttpd-server &

Open new browser tab on carme-gsi

http://nnrpi1:8015/AIDA/Rly16/Rly16.tml
Entry  Wed Jan 17 10:31:05 2024, TD, Remote control of CAEN N1419ET from nnrpi1 Capture.PNG
Login to nnrpi1 from carme-gsi using ssh

Execute the caen_screen.sh script

pi@nnrpi1:~ $ cat ./caen_screen.sh
if ! screen -list | grep -q "caenhv"; then
	screen -f -S caenhv /dev/ttyACM0 9600
else
	screen -x caenhv
fi
pi@nnrpi1:~ $ ./caen_screen.sh

Enter the text string 'caen'

If the CAEN display program is already running you will only see page updates/changes.
- enter q ( quit ) and then d ( display ) to re-display the entire screen.

See attachment 1
Entry  Wed Jan 17 19:15:47 2024, TD, Wednesday 17 January 
CAEN N1419ET remote control via carme-gsi and nnrpi1 - see https://elog.ph.ed.ac.uk/CARME/472

15x ( of 16x ) AIDA power cables available, labelled #1 - #15, installed

16x ( of 16x ) RJ45 Cat 6 network cables available, 15x labelled #1 - #15

16x ( of 16x ) HDMI cables available, labelled #1 - #16
Entry  Wed Jan 17 19:21:20 2024, TD, AIDA spares 
Spare AIDA hardware 

1x AIDA FEE64 PSU
1x USB-controlled ac mains relay 

Transferred from EX 2.039 store ( ESR roof ) to CARME storage bins adjacent to CRYRING counting room ( CRYRING roof ).

CRYRING Hall

12 USB-Jtag cables ( sys console ) + 1x to Edinburgh Jan 2024 to fabricate more with spare Jtag PCBs
7x HDMI FEE64 - MACB cables
0x 0.3m HDMI-HDMI cables - require 8x 0.3m HDMI - HDMI cables + 2x 3m HDMI-HDMI cables
2x MACB
1x NIM WR emulator
1x Dlink 7 port USB extender
1x Netgear 24-port Gbit network switch
1x CAEN N1419ET ( ch #0 u/s ? )
0x 10m RJ45 Cat 6 network cables yellow/green/purple/brown - require 2x of each
Entry  Thu Jan 18 17:21:00 2024, TD, Thursday 18 January Capture.PNG
Network ( dhcpd.conf ) and MIDAS startup.tcl/Options/ASIC settings/rfs filesystems configured


17.20 CARME IE514 4.1e-11mbar, ambient temperature 16.7 deg C
      Pressure appears to be drifting upwards - see attachment 1
Entry  Mon Jan 22 16:29:31 2024, TD, Saturday 20 January 30x
11.00 No WLAN/WiFi
      came-gsi private LAN appears to be OK

      AIDA FEE64 power ON

11.09 FEE64 temps - attachment 1
      aida06 low, otherwise OK

11:10 CARME IE514 4.0e-11 mbar, temp unknown
      IE514 OFF

11.22 Detector bias ON - attachment 2
      found ch 2 up ramp set to 63V/s! changed to 1V/s

11.30 system wide checks OK except 
      aida02 & aida06 fail WR decoder status

      WR ts control - attachments 3-4


12.02 ASIC settings updated for aida09-aida16
      ASIC settings DB key 2024Jan20-12:02:08

      Unable to save DB key to Options - use ASIC settings restore as workaround

12.30 Layouts for 16x FEE64s created - directory ~/LayOut/16xFEE64
      Note layouts include spectra from aida07, aida08 and aida16 so an error message will be generated but it can be ignored


12.40 per FEE64 Rate spectra - attachments 5-6
      per FEE64 p+n & nn 1.8.W spectra - attachments 7-8

12.57 per FEE64 p+n & n+n 1.8.W spectra 20us FSR - attachments 9-10

Test signals 

EG&G Ortec 448 Pulser
Amplitude 90,000
attenuation x10
Normalise 5.00
t_r 100ns
tau_d 50us
Frequency 50Hz ( relay line freq )
Polarity +

test + direct from 448, test - from Cooknell SA1 Sum & Invert 

Test + daisy chain -> aida01 - aida02 - aida05 - aida06 - 50 Ohm
Test - daisy chain -> aida03 - aida04 - aida07 - aida08 - 50 Ohm

aida08 ( DSSSD #2 n+n Ohmic bias ) LK2 removed, LK1 added
aida04 ( DSSSD #1 n+n Ohmic bias ) no LK2 fitted, LK1 added

DSSSD#1 SHV - 2x Lemo 00.250 cable replaced by standard SHV - BNC/BNC Lemo-00.250 coaxial cable

Adaptor PCB ground daisy chain aida01 - aida02 - aida03 - aida04

DSSSD#2 - DSSSD#4 HV cabling unchanged

15.30 Power ON
      System wide checks OK except
          aida02 fail WR decoder status - attachment 11

      FEE64 temperatures - attachment 12
       aida06 ASIC temp low

      DSSSD bias - attachment 13
     
      ADC data item stats - attachment 14
       slow comparator 0x64

      per FEE64 Rate and 1.8.W 20us FSR spectra - attachments 15-17

16.00 per FEE64 rate spectra - attachment 18

16.15 per FEE64 Rate and 1.8.W 20us FSR spectra - attachments 19-21

17.36 Switch from VETAR2 ( all MACB modules mode 0x3 ) to NIM WR emulator ( root MACB module 0xd, all others 0x3 )
      All FEE64s fail Global clock and WR decoder - attachments 22-24
      WR timetsamp control - attachment 25


18.10 Noted MACB #4 mode actually set to 0x2 *not* 0x3 - changed to 0x3

      Re-test with VETAR2 WR - same behaviour as observed this morning - see attachments 26-30




Summary

n+n sides appear to be OK but noisy

no data observed from aida06 & aida11
 aida11 known to be disconnected from adaptor PCB

aida15 asic #2 may be faulty

aida01, aida05, aida12 - data suggest FEE64/adaptor PCB alignment issue ?

aida02, aida03, aida09, aida14 - data suggest adaptor PCB damaged pins ?


aida07 - network config issue ?

aida08 - not completing boot

need to attach sys console to aida07 & aida08 to diagnose problem.
ELOG V3.1.4-unknown