If the merger doesn't show "xfer Links => Merger" at the top, it is probably the merger setting has been corrupted somehow. This is how to reset it

  If you go to the web page from which you started the Merge and TapeServer

    (probably    localhost:8115)

 Then select the item  NetVar Service  which is at the left hand end.

  Click on Inquire Registers

  then  enter    NetVar.MERGE.RunOptions  into the "Register Name" entry    and  when finished move the mouse out of the entry box.

 NetVar.MERGE.RunOptions will appear in the center of the top row.   (it is an item in the menu but not so easy to find)

 Click on Read and I expect you will get  0

 Type 1 into the data entry box     and click on Write

  Now return to the Merger and  click on  Reload

  The Merger State will now end as    xfer Links => Merger

 The button  Output:   will now toggle between this and   xfer links => Merger => Storage.

Plastic electronics have now been installed.

Water is not leaking still.

FEE64s powered on at 15:00 to test MBS connection (fig1: temperatures)

MBS relay connects to MBS server OK...

AIDA Merger does not accept any data... (links with data reads 0) and lots of timestamp errors in log? (Figs 2-4)

Startup procedure incorrect?

Otherwise things still OK.

End of the day - Detector unbiased and FEE64s turned off for the weekend as they won't be monitored.

Water will remain on.

Extra FEE information:

HV braid (0 V) goes into FEE10 (beam left) with LK1 jumper
HV core (-160 V) goes into FEE09 (top)

Could be related to noise in FEE09?
Both these FEEs have higher rates too

Other setup information:
According to the switch in S4, the AIDA workstation is only connected via 100Mbps rather than 1Gbps. (Fig 1)

Plastic is inside the snout, but is not yet connected to the electronics yet
Figures 2-4 Show the DSSD & Plastic in the Snout. Plastic is far upstream solely to ensure plenty of ribbon cable

Pulser widths of AIDA modules, resolution is fairly typical. AIDA09 still noisier than other DSSD channels.

Figure 1: Picture of pulser peaks
Figure 2: Raw waves (AIDA01 did not calibrate, so AIDA02 used instead as "non DSSD module")
Figure 3: Good Events

Fast comparator threshold (LEC/MEC) changed to 0xFF

AIDA09 seems noiser than before(?) but is known to be noisy.

AIDA01:  24.22

AIDA09: 205.21

AIDA10: 88.60

AIDA11: 63.33

AIDA12: 102.69

FEEs have been on this morning, temperatures attached

Leakage current attached

the DSSD is attached to the following AIDA modules:
Beam Left: 10
Beam Right: 12
Bottom: 11
Top: 9

MIDAS Servers on, will be looking at resolution (pulser)

The AIDA snout (with single DSSD and plastic) has been mounted in S4 cave again. DSSD was connected to the outer 4 FEEs again.

-160 V Bias applied and DSSD holds voltage with leakage current of around 1.3 uA (was dropping as only biased briefly)

Bias off and FEEs offline again now as day nearly done. MBS testing will be performed shortly, as well as resolution checks.

All 12 FEEs powered up, and temperatures are OK.

Passed ASIC checks and system wide checks - now checking cabling and to mount snout.

The AIDA water system has been repaired and not leaking.

The interlock did not light immediately, but power cable reconnected to box and now it works.

Currently

- 1 DSSD and Plastic is in the AIDA snout, which is not mounted

- The FEEs are offline due to a water supply issue, this will be repaired early 21/03/2019

- The pis & aida-3 are online

The water interlock also didn't clear, which will be investigated

Ideally installation can be completed tomorrow but this depends on water

Summary statistics for WR test data files R1_0, R2_0, R3_0, R4_0, R7_0 and R10_0 (attachments 1-6)

Latest version of WR TDR data analyser (attachment 7)

If you have a GSI account it should be possible to connect to aida-gsi remotely via the following
SSH into lx-pool.gsi.de with GSI Linux username/password (ssh username@lx-pool.gsi.de)
Then SSH into aida-gsi via ssh npg@aida-3

Two raspberry pis:

nnrpi1 - FEE64 system consoles
nnrpi2 - AC Mains Relay & CAEN HV

Startup:

1. Plug in micro-USB on pis
2. Connect via ssh: ssh pi@nnrpi1  or ssh pi@nnrpi2
3. Start MIDAS:
cd /MIDAS/TclHttpd/Linux-arm
./TclHttpd-server

4. Connect from aida-gsi web browser
http://nnrpi2:8015 - For AC Relay Control
http://nnrpi1:8015 - For Pi Monitoring (Get list of USB terminals, Connect)
-> Parse USB log for details to check if all FEEs have finished booting completely or not

5. For CAEN HV connect via ssh/X (ssh -X pi@nnrpi2) and run
putty &
Opens putty window to connect to the CAEN HV module (Serial /dev/ttyACM0)

09.30: AIDA still running, not writing to file
       Still running ok
       No water leaks

09.45: FEE64 temperatures ok (attachment 1)
       Good event statistics ok (attachment 2)

10.00: Results of System Wide Checks
       ADC Calibration check (attachment 3)
       Clock Status (attachment 4)
       Sync error counter (attachment 5)
       White Rabbit Decoder status (attachment 7)
       Memory Information (attachment 8) 
       
10.30: Clock ReSync performed (attachment 6)
       Start writing to file TapeData/NULL/R7_0

11.50: DAQ stopped, TapeServer stopped
       
       TapeServer restarted, DAQ restarted

       Writing to file TapeData/NULL/R9_0 with Clock ReSync at start.

       Wasn't writing to disk, restarting (DAQ stop, TapeServer stop, TapeServer start TO DISK, DAQ Start)

       Writing to file TapeData/NULL/R10_0

12.04: DAQ stopped, TapeServer stopped, merger stopped
       FEE64 power relay switched off
       Raspberry PIs switched off and disconnected
       water cooler stopped
       Mains IEC cables removed from relay

       
        

AIDA@DESPEC MACB time switch settings before and after WR are as follows.

Attachment 1 - MACB 1-4 from left to right

MACB number:                           1        2        3        4

100MHZ clock setting (before WR):      0        2        2        2

White Rabbit setting (after WR):       3        3        3        3

Attachment 1 - summary analysis R2_0

               increased slow comparator & LEC/MEC fast comparators cf. R1_0 to minimise random noise

Attachment 2 - summary analysis R3_0

               per R2_0 but BNC PB-5 pulser frequency increased from c. 2Hz to c. 1kHz
               pulser to *all* channels 12x FEE64s

Attachment 3 - summary analysis R4_0

               open TapeSever file, DAQ GO, Start ASIC Readout (*correct* DAQ start sequence)

Observations

- some RESUME but *zero* PAUSE data items observed

- information types 4 & 5 not equal for R2_0 and almost, but not quite, equal for R3_0 & R4_0 

- information types 4 & 5 start data file with 'correct' DAQ start sequence

           

Analysis of file GSIJan19/R1_0 (white rabbit data)

attachment 1 - overall statistics

attachment 2 - verbose output listing all data around first six identified timewarps

attachment 3 - analyser.f (old version for 48 bit timestamp)

attachment 4 - analyser.f (new version for 64 bit WR timestamp)

Observations

1) File does not commence with information type 4 & 5 data items

   DAQ/TapeServer start sequence issue??

2) DAQ RESUMEs observed for all FEE64s - DAQ PAUSEs *not* observed

3) Number of information type 4 & 5 data items for each FEE64 *not* the same

4) reported idle & elapsed times incorrect - presumably analyser.f bug

 

1) Click on item "Merger MK2" in top panel
   This kills any existing Merger existence and loads a new copy.

2) Start (if needed) browser conection to localhost:8115.

3) Click on "NewMerger Control"

4) In NewMerger Control, click "Reload"

5) If MergerState = IDLE, click "SETUP".

6) Wait until state = STOPed

7) If links shown are correct, click "GO"

8) Wait until popup about "Resume Merger" appears and click OK

9) when writing to disk, click "Forward Output to Data"

10.30 AIDA setup and DAQ start complete
      writing to file TapeData/NULL/R1

      FEE64 Temperatures and Good event statistics ok (attachments 1 and 2)

11.00 results of analyser - shows significant number of timewarps in aida07, and a few in aida01-04

11.24 compared timestamps between mbs and AIDA, agree to 8 digits (attachment 3)

12.49 DAQ and Merger stopped and restarted

      Raised slow comparator threshold from 0xa to 0x64

      Raised fast comparator threshold (LEC/MEC) from 0xf to 0xff

12.51 Good event statistics: aida08 running at a normal rate

      pulser peak (1.8.L) no longer has noise shoulder (attachment 4)

      writing to file TapeData/NULL/R2


13.58 stopped writing to file. Pulser frequency increased to 1 kHz

      writing to file TapeData/NULL/R3

15.00 file R4 - DAQ startup

17.58 trimmed and re-crimped ground wire on aida08
      lowered pulser freq back to 50Hz
      reduced slow comparator threshold to 0xa, fast comparator threshold (LEC) to 0xf

      good event stats ok, aida08 no longer running hot (attachment 6)
      1.8.L and 1.8.W spectra of aida08 (attachment 5)
      pulser peak width now at 55.71

      FEE64 temperatures ok (attachment 7)

Post White Rabbit update

Attachment 1 - 1.8.W pulser waveform spectra for all FEE64
             - pulser signals observed in all FEE64

Attachment 2 - good event statistics - aida08 has significant noise

Attachment 3 - FEE64 temperatures - all ok, but firmware version not displayed

Attachment 4 - 1.8.L pulser peak spectra

             - widths:

             aida01 - 23.66
             aida02 - 19.76
             aida03 - 20.43
             aida04 - 18.82
             aida05 - 20.05
             aida06 - 41.04
             aida07 - 21.24
             aida08 - 205.02 (noisy FEE64)
             aida09 - 24.81
             aida10 - 22.85
             aida11 - 13.98
             aida12 - 19.90

Attachment 5 - New Merger statistics

Attachment 6 - Raw data stream