ELOG AIDA

AIDA GELINA BRIKEN nToF CRIB ISOLDE CIRCE nTOFCapture DESPEC DTAS EDI_PSA 179Ta CARME StellarModelling DCF K40

AIDA

Fields marked with * are required

Entry time:

Tue Jun 7 19:19:34 2016

Author*:

Subject*:

(4 mm Al mask was put upstream of AIDA near 20:20 on 7 June)
&nbsp;
01.15 Run R1219 started on neutron rich setting.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Temps ok. Leakage currents ok.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Plate with holes in front of AIDA , after F11 plastic. F11 plastic count rate ~700cps.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Keeps getting 'Attempting resychronisation' message in merger terminal window.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; driver 0 10205 consuming almost 100% of CPU. Merger ~20% and data links ~1%
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; See attachments 1-4
&nbsp;
02.15 Run R1220 n-rich setting (BigRIPS run 1218, EURICA off)
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; EURICA team retires for the night and cannot get it up and running
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Biases and leak shown as attachments 5-6
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Merger info is shown in attachments 7-9
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; CPU Load in attachment 10
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Timestamps against the ADCs and also SYNCS, respectively, attachments 11 and 12
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 3:31: Run stopped for the operator to tune the beam
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; F11 plastic rate was 700 cps (~heavy ion injection rate)
&nbsp;
3:43 Run R1221 n-rich setting (BigRIPS 1219, no EURICA)
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 4 mm Al mask was removed.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Pause calls vs. Timestamp is attachment 13
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Merger screenshots are shown as attachments 14-16
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; F11 plastic rate is 850 or 900 cps after retune
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; ADC v Timestamp is shown as attachment 17.&nbsp; It can be seen the rate was roughly constant before the operators stopped (corresponding to a long gap of no hits, but now&nbsp; we go up and down quite a lot in a rather ugly way
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; CPU stats (driver to write to HDD in green, merger in red) as attachment 18
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; At the time of ~90 in attachment 18, the linkers start to consume all available CPU resources, shown as attachment 19
&nbsp;
04:35 Run R1222 n-rich setting (BigRIPS 1219 / 1220)
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Ask the operators to reduce the beam intensity by &quot;1/2&quot; -&gt; F11 plastic rate goes from 850 cps to 170 cps, so more like 1/4 effectively
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Merger stats are shown as attachments 20, 21, 22.&nbsp;
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; nnaida1 and nnaida24 seemed to often show pauses (among other ones)
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; trying to understand what's going on with the display in Midas, because it has looped around to time zero and is putting new data on to the old data...?
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; It seems this condition is much better than before, though
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 05:33 stop the run
&nbsp;
05:38 R R1223 n-rich setting (BigRIPS 1221)
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Ask the operators to resume the previous beam intensity.&nbsp; (Now like 600 to 800 cps at the F11 plastic)
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; attachment 23 shows the beam coming on near time zero.&nbsp; within &lt;100 seconds, the driver has to fight with many link64 instances and cannot operate correctly
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; we understood how to clear the midas histograms so that we can make sense of things.&nbsp; attachment 24 is ADC, and attachment 25 is pause.&nbsp;
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; you can see some data come smoothly until the system locks down
06.11 R1223 stopped.
&nbsp;
06.30 Started run R1224.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Moved Pb bricks downstream of F11 plastic inwards, from a separation of 15cm, to 4cm in an effort to reduce rate in AIDA.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; F11 plastic rate ~900cps.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; No change to vis scalar rates and data still being dropped.
06.45 Stopped run R1224.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; MIDAS plot of ADC vs Timestamp (attachment 26) shows characteristic behaviour.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Upon writing to disk, for the first minute or so link64 processes consume minimal CPU power. But then very quickly they ramp up consumption and ultimately choke the merger (it seems).
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; This is reflected in the ADC v TS plot. Continuous ADC data for first ~1min.
&nbsp;
06.54 Moved Pb bricks to separation of 2cm. Started run R1225.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; AIDA vis scalar rates reduced slightly, but no change to CPU usage and usual happens - data lost, link64 CPU usage spikes and chokes merger (seemingly).
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; F11 plastic rate ~900cps.
07.00 Run R1225 stopped.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; SYNCs stopped being produced. Lost contact with nnaida1.
&nbsp;
07.25 Pb bricks moved to 1cm apart. Run R1226 started.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; No change to CPU usage (link64 still hogging everything). MIDAS online monitor lost in power cycle so cant view in real-time, but anticipate same outcome.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Sopped producing SYNCs 07.39. Run 1226 stopped.
&nbsp;
08.20 Some trouble restarting DAQ and merger.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; As nnaida19 has lost the 'H' for histogramming on the run control page, nnaida21 has now lost the 'X' for data transfer (see attachment 27).
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Removed nnaida21 from merger and normal state of play resumed.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 4mm holey plate + the one attached to it we installed dowstream of F11 plastic.
&nbsp;
08.50 Run R1227 started.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; CPU usage by link64 ~1% and driver ~70%, much more reasonable. When reloading merger web page, channels flash between bright green and olive. Good.
09.09 Changed to reference mass setting. Run R1227 stopped.
&nbsp;
09.12 Run R1228 started on reference setting with holey plate still in place.
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; R1228 stopped 10.32 (for B2F/F11 entry)
&nbsp;

Encoding: HTML ELCode plain
Suppress Email notification Resubmit as new entry

Attachment 1: