AIDA GELINA BRIKEN nToF CRIB ISOLDE CIRCE nTOFCapture DESPEC DTAS EDI_PSA 179Ta CARME StellarModelling DCF K40
  CARME, Page 4 of 38  ELOG logo
  ID Date Authordown Subject
  421   Tue Jul 18 08:16:28 2023 TDPumping down. Issues found with one detector.
09.15 Following overnight pumping of CARME chamber by Leybold turbo
      Pirani 1.00e-3 mbar IE514 2.83e-7 mbar

     The Leybold IE514 gauge currently in use is the CARME unit ( serial # 1054 ). The calibration data can be found at https://elog.ph.ed.ac.uk/CARME/56


09.44 Pirani 1.00e-3 mbar IE514 2.71e-7 mbar

10.10 Leak tester attached to backing line

      Valves to leak tester and turbo (connection to Edwards scroll pump in between) closed.

      Stop Edwards scroll pump with magnetic valve 'red' button - magnetic valves closes and Edwards scroll pump is switched off.

      Open valves to leak tester and then (slowly) turbo.

      Wait for leak tester to settle in e-12 mbar.l/s range. Leak tester pressure 3.6e-3 mbar. IE514 2.69e-7 mbar.

11.00 Pirani 1.00e-3 mbar IE514 2.42e-7 mbar
      Leak tester 1.8e-10 mbar.l/s

13.04 Pirani 1.00e-3 mbar IE514 2.06e-7 mbar

      Leak testing.
      Downstream DN100 flanges from CARME to dipole OK
      Lower NEG power connector feedhtrough (downstream chamber) OK
      Left hand side (looking downstream) bellows OK

      c. few e-9 mbar.l/s leak bottom left (lookimg downstream) of COF600 wire seal

      Additional torque to M16 bolts bottom left - c. 10 bolts -> 220Nm+

      c. 0.1-0.3e-11 mbar.l/s

      Further checks around circumference of COF600 seal reveal some small leaks c. e-11-12 mbar.l/s.? However background rate
      in leak tester too high for sensitive test - will await recovery to resume checking.

14.00 Pirani 9.8e-4 mbar IE514 1.96e-7 mbar
      Leak tester 4.9e-10 mbar.l/s


14.35 DSSSD test
      IE514 OFF

Ambient temperature 21.5 deg C

Top right
-10V -4uA
-20V 10uA
c. -30V > -20uA trip

Top left
-150V -5.15uA

Bottom left
-150V -4.97uA

Bottom right
-150V -6.33uA

Top right (repeat)
-20V -10uA
-25V -14uA

15.28 IE514 ON
      Pirani 9.8e-4 mbar IE514 1.87e-7 mbar

15.40 c. few e-9 mbar.l/s leak around magnetic valve - probably not an issue in terms of backing performance but may interfere with/confuse leak testing

16.05 Pirani 9.8e-4 mbar IE514 1.74e-7 mbar
      Leak tester 1.2e-9 mbar.l/s

Will leave CARME pumping with leak tester on roughing line and see whether leak rate recovers. If so, will continue leak tests tomorrow. 

18.50 Pirani 1.00e-3 mbar IE514 1.48e-7 mbar
      Leak tester < 1e-12 mbar.l/s (leak tester valved off)
  422   Wed Jul 19 08:17:26 2023 TDLeak testing
09.16 Pirani 1.00e-3 mbar IE514 8.77e-8 mbar
      Leak tester c. 5e-12 mbar.l/s (leak tester valved off)

09.48 Pirani 1.00e-3 mbar IE514 8.67e-8 mbar
      Leak tester c. 3.5e-12 mbar.l/s (leak tester valved off)

10.33 Pirani 1.00e-3 mbar IE514 8.55e-8 mbar
      Leak tester c. 4e-10 mbar.l/s (leak tester connected to CARME roughing line)

10.55 Leak tester remains at few e-10 mbar.l/s - we do not understand why
      With leak tester in differential mode the highest reading around the COF600 seal is c. 3.5e-12 mbar.l/s
      Following checks elsewhere on the chamber we observe c. 6e-12 mbar.l/s which presumably reflects accumulation of He around the chamber 

      Dispersing He with compressed air reduces diff mode reading to c. 2e-12 mbar.l/s

11.00 Pirani 9.80e-4 mbar IE514 8.47e-8 mbar

14.49 Pirani 1.00e-3 mbar IE514 7.71e-8 mbar
      Leak tester isolated from CARME backing line - CARME Edwards scroll pump now backing turbo.
  423   Thu Jul 20 08:29:26 2023 TDInstalling tent. Two NEG power cable broken.
09.28 Pirani 1.00e-3 mbar IE514 5.45e-8 mbar

12.10 Bakeout tent frame installed
      SAES UHV1400 NEG pump power cables #1-6 installed
      See attachments 1 & 2

16.35 Attachments 3-6
      upstream baseplate
      3x sets of heaters beneath CARME chamber connected to CRYRING heater/TC manifold - attachments 7-8

      
16.45 Pirani 1.00e-3 mbar IE514 4.80e-8 mbar


17.10 SAES D-2000 #1 downstream, outside   NEG power + HV ( attachment 9 - OK cable connector )
      SAES D-2000 #3 downstream, inside   NEG power + HV
      SAES D-2000 #4 upstream, inside   HV
      SAES D-2000 #2 upstream, outside   HV

2x ( of 4x ) SAES D-2000 neg power cables were broken - forward-shell detached (unscrewed ) from back-shell remaining attached to D-2000 neg power connector. 
Re-assembly is straightforward but it is unclear how the 6x female sockets are aligned with the connector keys of the forward-shell (attachments 10-11 cf. attachment 9).
Until this is understood these 2x SAES D-2000 neg power cables should not be used.
  443   Mon Sep 25 16:33:32 2023 TDRemoved tape from heaters TC
17.33 IE514 pressure 6.4e-11 mbar, ambient temperature +20.8 deg C

      The thermocouples on the 3x groups of heater elements have been detached from direct contact with the heating element and now float abpove the heating element by 2-
3cm - see attachments 1 & 2

      The vacuum group IE514 and Ametek RGA are still attached to CARME - see attachment 3. Have requested vacuum group remove them.

      The 'air side' of the Be window on the interaction chamber is under vacuum provided by small Agilent scroll pump.

      
  444   Tue Sep 26 08:08:42 2023 TDTuesday 26 September
09.07 IE514 pressure 6.4e-11 mbar, ambient temperature +20.3 deg C

      Using appc218 ( account carme ) workstation by the CARME 19" rack 
     
      ssh pi@carmebakingpi

      Re-connect to bakeout monitor app 

      screen -dR

      See attcahment 1


12.02 Vacuum group ion pump disconnected and RGA removed from CARME chamber -  outside of CARME bakeout tent 'closed' - see attachments 2-4

      Vacuum group IE514 to be disconnected


14.45 Vacuum group disconnect their IE514

      Inside of CARME bakeout tent closed

      Photos of the CARME bakeout tent inside and outside CRYRING - see attachments 5-7  
  445   Tue Sep 26 10:13:14 2023 TDELOTECH PID Temperature Controller R4000 manual ( German and English )
  446   Wed Sep 27 15:56:41 2023 TDWednesday 27 September
16.55 CARME IE514 8.2e-11 mbar

      Vacuum pressure increased slowly overnight from c. 6e-11 mbar yesterday to c. 8e-11 mbar today following low power startup tests of the bakeout controller heating 
the CARME interaction and detector chambers yesterday and today.


Attachment 1 - bakeout controller config courtesy Anton Kalinin

Attachments 2 & 3 - bakeout controller summary displays and CARME bakeout monitor display c. 17.00 today

The 3x CARME heaters are connected to controller #4 zones # 1-3, i.e. lower right display, zones 1-3, mains fuses F9-F11

17.30 3x ( of 4x ) SAES D-2000 ion pump controllers ( SIP modules ) switched off. Fourth controller was already switched off and SHV cable disconnected from rear panel of 
SIP module.
  447   Thu Sep 28 09:19:50 2023 TDThursday 28 September
10.20 CARME IE514 8.6e-11 mbar

      CARME bakeout monitor and ELOTECH bakeout controller status - see attachments 1 & 2

      The CARME bakeout monitor shows recovery from test yesterday evening. The ELOTECH controller was switched to manual mode for the 3x CARME zones and 5% power selected 
for 45 minutes. CARME TCs increased from mid-20s to high 20s/low 30s over a period of 45 minutes. At the conclusion of the test power was set to 0% for all 3x CARME zones 
and the mode changed from manual to controlled.
  448   Fri Sep 29 08:54:29 2023 TDFriday 29 September
09.50 CARME IE514 9.0e-11 mbar, ambient temperature 21.3 deg C

      CARME bakeout monitor and ELOTECH temperature controller - attachments 1 & 2


10.15 Commence bakeout ramp
      Set all ELOTECH PID temperature controller zones ( channels ) to 50 deg C
      Expect all non-CARME zones to reach temperature set point quickly. There will be a delay for the TCs corresponding to the CARME heaters but the internal CAME TCs 
will respond more slowly- will observe response of CARME TCs over time.

10.35 ELOTECH temperature controller - attachment 3

11.10 CARME TCs change from c. 25-28 deg C to 28-35 deg C

11.15 Set all ELOTECH PID temperature controller zones ( channels ) to 100 deg C

12.15 CARME IE514 1.39e-10 mbar, ambient temperature 20.8 deg C

      CARME bakeout monitor and ELOTECH temperature controller - attachments 4 & 5


14.20 CARME IE514 3.62e-10 mbar, ambient temperature 20.8 deg C

      CARME bakeout monitor, ELOTECH temperature controller front panel and Grafana bakeout dashboard- attachments 6-8

15.20 Whilst all of the ELOTECH temperature controller TCs are at their current set point ( 100 deg C ), the CARME TCs are not yet at equilibrium. Plan to leave system 
in current state until tomorrow morning. Assuming CARME is at equilibrium will then increment ELOTECH temperature controller TC set points.

17.50 CARME IE514 6.59e-10 mbar, ambient temperature 20.6 deg C

      CARME bakeout monitor, ELOTECH temperature controller front panel and Grafana bakeout dashboard- attachments 9-11
  449   Sat Sep 30 10:58:14 2023 TDSaturday 30 September
10.50 CARME IE514 7.14e-10 mbar, ambient temperature 20.8 deg C

      CARME bakeout monitor, ELOTECH R4000 temperature controller front panel and Grafana bakeout dashboard- attachments 1-3

      Change ELOTECH R4000 set points for CARME heaters #1 and #3 to 125 deg C

14.20 CARME IE514 8.25e-10 mbar, ambient temperature 20.8 deg C

      CARME bakeout monitor, ELOTECH R4000 temperature controller front panel and Grafana bakeout dashboard- attachments 4-6

      Change ELOTECH R4000 set points for CARME heaters #1 and #3 to 150 deg C

18.30 CARME IE514 1.29e-9 mbar, ambient temperature 20.7 deg C

      CARME bakeout monitor, ELOTECH R4000 temperature controller front panel and Grafana bakeout dashboard- attachments 7-9

      Change ELOTECH R4000 set points for CARME heaters #1 and #3 to 175 deg C and heater #2 to 125 deg C
  450   Sun Oct 1 10:24:50 2023 TDSunday 1 October
11.20 CARME IE514 3.53e-9 mbar, ambient temperature 20.6 deg C

      CARME bakeout monitor, ELOTECH R4000 temperature controller front panel and Grafana bakeout dashboard- attachments 1-3

      Change ELOTECH R4000 set points for CARME heaters #1 and #3 to 200 deg C, heater #2 to 150 deg C

14.10 CARME IE514 6.12e-9 mbar, ambient temperature 20.7 deg C

      CARME bakeout monitor, ELOTECH R4000 temperature controller front panel and Grafana bakeout dashboard- attachments 4-6

      Change ELOTECH R4000 set points for CARME heaters #1, #2 and #3 to 225, 175 and 225 deg C respectively.


18.10 CARME IE514 1.92e-8 mbar, ambient temperature 20.8 deg C

      CARME bakeout monitor, ELOTECH R4000 temperature controller front panel and Grafana bakeout dashboard- attachments 7-9

      Change ELOTECH R4000 set points for CARME heaters #1, #2 and #3 to 250, 150 and 225 deg C respectively.
      All other ( active ) ELOTECH R4000 set points ( interaction chamber etc ) to 130 deg C.

20.25 CARME IE514 2.14e-8 mbar, ambient temperature 20.8 deg C

      CARME bakeout monitor, ELOTECH R4000 temperature controller front panel and Grafana bakeout dashboard- attachments 10-12

      No change to ELOTECH R4000 set points
  451   Mon Oct 2 08:41:43 2023 TDMonday 2 October
09.35 CARME IE514 1.95e-8 mbar, ambient temperature 20.8 deg C

      CARME bakeout monitor, ELOTECH R4000 temperature controller front panel and Grafana bakeout dashboard- attachments 1-3

      No change to ELOTECH R4000 set point

17.45 CARME IE514 1.91e-8 mbar, ambient temperature 20.8 deg C

      CARME bakeout monitor, ELOTECH R4000 temperature controller front panel and Grafana bakeout dashboard- attachments 4-6

      No change to ELOTECH R4000 set point
  452   Tue Oct 3 08:48:36 2023 TDTuesday 3 October
09.40 CARME IE514 1.79e-8 mbar, ambient temperature 20.7 deg C

      CARME bakeout monitor, ELOTECH R4000 temperature controller front panel and Grafana bakeout dashboard- attachments 1-3

      No change to ELOTECH R4000 set point
  470   Tue Jan 16 14:36:30 2024 TDCARME configuration
FEE64

#1 - #16 -> aida01 - aida16

Network configuration - /etc/dhcpd/dhcpd.conf - attachment 1

MIDAS Options

Added Options sub-directories for aida09-aida16 - attachment 2

MIDAS ASIC settings

Added sub-directories for aida09-aida16 - attachment 3

MIDAS configuration - /MIDAS/config/TclHttpd/carme-gsi"8015 - attachment 4
Currently only aida01-aida08 defined

MIDAS embedded rfs filesystems for aida01-aida24 alreday exist - attachment 5

All FEE64s connected to rev B CARME adaptor PCBs
LK1 fitted to n+n bias FEE64 ( aidaxx, aidaxx, aidaxx, aidaxx )
No other LKs fitted


MACB

WR source NIM WR emulator or VETAR2

See https://elog.ph.ed.ac.uk/DESPEC/517 for MACB mode configuration


CAEN N1419ET


EG&G Ortec 448 Pulser


ASIC settings


Options
  471   Tue Jan 16 16:01:48 2024 TDChange CARMEraspberrypi to nnrpi1
Change RPi from CARMEraspberrypi to nnrpi1 to provide carme-gsi access to Rly16 to control USB-controlled ac mains relay.
nnrpi1 is already defined in carme-gsi:/etc/dhcp/dhcpd.conf

Transfer RPi network connection from CRYRING local network to AIDA 24-port network Gbit switch

Change /etc/hostname from

CARMEraspberrypi

to

nnrpi1

Change /etc/hosts from

127.0.0.1	localhost
::1		localhost ip6-localhost ip6-loopback
ff02::1		ip6-allnodes
ff02::2		ip6-allrouters

127.0.1.1	raspberrypi	

to

127.0.0.1	localhost
::1		localhost ip6-localhost ip6-loopback
ff02::1		ip6-allnodes
ff02::2		ip6-allrouters

127.0.1.1	nnrpi1

Reboot RPi

Login to RPi and start MIDAS 8015 service

/MIDAS/TclHttpd/linux-arm/TclHttpd-server &

Open new browser tab on carme-gsi

http://nnrpi1:8015/AIDA/Rly16/Rly16.tml
  472   Wed Jan 17 10:31:05 2024 TDRemote control of CAEN N1419ET from nnrpi1
Login to nnrpi1 from carme-gsi using ssh

Execute the caen_screen.sh script

pi@nnrpi1:~ $ cat ./caen_screen.sh
if ! screen -list | grep -q "caenhv"; then
	screen -f -S caenhv /dev/ttyACM0 9600
else
	screen -x caenhv
fi
pi@nnrpi1:~ $ ./caen_screen.sh

Enter the text string 'caen'

If the CAEN display program is already running you will only see page updates/changes.
- enter q ( quit ) and then d ( display ) to re-display the entire screen.

See attachment 1
  473   Wed Jan 17 19:15:47 2024 TDWednesday 17 January
CAEN N1419ET remote control via carme-gsi and nnrpi1 - see https://elog.ph.ed.ac.uk/CARME/472

15x ( of 16x ) AIDA power cables available, labelled #1 - #15, installed

16x ( of 16x ) RJ45 Cat 6 network cables available, 15x labelled #1 - #15

16x ( of 16x ) HDMI cables available, labelled #1 - #16
  474   Wed Jan 17 19:21:20 2024 TDAIDA spares
Spare AIDA hardware 

1x AIDA FEE64 PSU
1x USB-controlled ac mains relay 

Transferred from EX 2.039 store ( ESR roof ) to CARME storage bins adjacent to CRYRING counting room ( CRYRING roof ).

CRYRING Hall

12 USB-Jtag cables ( sys console ) + 1x to Edinburgh Jan 2024 to fabricate more with spare Jtag PCBs
7x HDMI FEE64 - MACB cables
0x 0.3m HDMI-HDMI cables - require 8x 0.3m HDMI - HDMI cables + 2x 3m HDMI-HDMI cables
2x MACB
1x NIM WR emulator
1x Dlink 7 port USB extender
1x Netgear 24-port Gbit network switch
1x CAEN N1419ET ( ch #0 u/s ? )
0x 10m RJ45 Cat 6 network cables yellow/green/purple/brown - require 2x of each
  475   Thu Jan 18 17:21:00 2024 TDThursday 18 January
Network ( dhcpd.conf ) and MIDAS startup.tcl/Options/ASIC settings/rfs filesystems configured


17.20 CARME IE514 4.1e-11mbar, ambient temperature 16.7 deg C
      Pressure appears to be drifting upwards - see attachment 1
  477   Mon Jan 22 16:29:31 2024 TDSaturday 20 January
11.00 No WLAN/WiFi
      came-gsi private LAN appears to be OK

      AIDA FEE64 power ON

11.09 FEE64 temps - attachment 1
      aida06 low, otherwise OK

11:10 CARME IE514 4.0e-11 mbar, temp unknown
      IE514 OFF

11.22 Detector bias ON - attachment 2
      found ch 2 up ramp set to 63V/s! changed to 1V/s

11.30 system wide checks OK except 
      aida02 & aida06 fail WR decoder status

      WR ts control - attachments 3-4


12.02 ASIC settings updated for aida09-aida16
      ASIC settings DB key 2024Jan20-12:02:08

      Unable to save DB key to Options - use ASIC settings restore as workaround

12.30 Layouts for 16x FEE64s created - directory ~/LayOut/16xFEE64
      Note layouts include spectra from aida07, aida08 and aida16 so an error message will be generated but it can be ignored


12.40 per FEE64 Rate spectra - attachments 5-6
      per FEE64 p+n & nn 1.8.W spectra - attachments 7-8

12.57 per FEE64 p+n & n+n 1.8.W spectra 20us FSR - attachments 9-10

Test signals 

EG&G Ortec 448 Pulser
Amplitude 90,000
attenuation x10
Normalise 5.00
t_r 100ns
tau_d 50us
Frequency 50Hz ( relay line freq )
Polarity +

test + direct from 448, test - from Cooknell SA1 Sum & Invert 

Test + daisy chain -> aida01 - aida02 - aida05 - aida06 - 50 Ohm
Test - daisy chain -> aida03 - aida04 - aida07 - aida08 - 50 Ohm

aida08 ( DSSSD #2 n+n Ohmic bias ) LK2 removed, LK1 added
aida04 ( DSSSD #1 n+n Ohmic bias ) no LK2 fitted, LK1 added

DSSSD#1 SHV - 2x Lemo 00.250 cable replaced by standard SHV - BNC/BNC Lemo-00.250 coaxial cable

Adaptor PCB ground daisy chain aida01 - aida02 - aida03 - aida04

DSSSD#2 - DSSSD#4 HV cabling unchanged

15.30 Power ON
      System wide checks OK except
          aida02 fail WR decoder status - attachment 11

      FEE64 temperatures - attachment 12
       aida06 ASIC temp low

      DSSSD bias - attachment 13
     
      ADC data item stats - attachment 14
       slow comparator 0x64

      per FEE64 Rate and 1.8.W 20us FSR spectra - attachments 15-17

16.00 per FEE64 rate spectra - attachment 18

16.15 per FEE64 Rate and 1.8.W 20us FSR spectra - attachments 19-21

17.36 Switch from VETAR2 ( all MACB modules mode 0x3 ) to NIM WR emulator ( root MACB module 0xd, all others 0x3 )
      All FEE64s fail Global clock and WR decoder - attachments 22-24
      WR timetsamp control - attachment 25


18.10 Noted MACB #4 mode actually set to 0x2 *not* 0x3 - changed to 0x3

      Re-test with VETAR2 WR - same behaviour as observed this morning - see attachments 26-30




Summary

n+n sides appear to be OK but noisy

no data observed from aida06 & aida11
 aida11 known to be disconnected from adaptor PCB

aida15 asic #2 may be faulty

aida01, aida05, aida12 - data suggest FEE64/adaptor PCB alignment issue ?

aida02, aida03, aida09, aida14 - data suggest adaptor PCB damaged pins ?


aida07 - network config issue ?

aida08 - not completing boot

need to attach sys console to aida07 & aida08 to diagnose problem.
ELOG V3.1.4-unknown