MACB config 
1x level 0
4x level 1

Problem appears to related to level 1 MACB #3 ( 3 of 4 ). Transferring FEE64 inputs to MACB #4 appears to fix the problem.

Assume this means either MACB #3 or the cable to it from level 0 is the problem?

AIDA wave statistics

AIDA FEE adaptor cards only
BNC PB-4 pulser only to all channels (25Hz)

Visual scaler inputs

1 F11
2 upstream PL top
3 upstream PL bottom
4 Si top
5 Si bottom
6 AIDA PL
7 F11 x (upstream PL top + upstream PL bottom)
8 F11 x AIDA PL

nnaida2 , the bare test FEE64 in T9, is successfully running with two streams connected to nndhcp177 ( a Linux64 computer )

Merge running on nndhcp177 is receiving the streams and merging them.

nnaida2 has a slow pulser , 100Hz , connected to one waveform input.

Apparently waveforms are being merged with ASIC data. ( stream 0 and 1 from nnaida2 )

Next step is to add a Tape server to nndhcp177 and verify the recorded events.

Here is a document about the FEE64 waveform Vernier Timing.

Please comment/criticise/offer advice.

DSSSDs #1-6 slow comparator 0xa = 100keV - attachments 1-4

DSSSD2: attachments 5 to 8 (0xa to 0x8)

DSSSD3: attachments 9 to 12 (0xa to 0x8)

DSSSD4: attachments 13 to 16 (0xa to 0x8)

DSSSD5: attachments 17 to 20 (0xa to 0x8)

Global rates are >500 to <1000k items per second.  

Set all back to 0xa.

Now we try going to 60 keV (0x6)

DSSSD2: attachments 21 to 24 (0xa to 0x6) global ~1100k

DSSSD3: attachments 25 to 28 (0xa to 0x6) global ~1000k

DSSSD4: attachments 29 to 32 (0xa to 0x6) global ~1100k

Set all back to 0xa again.

The firmware of all FEEs was updated to the version in FEE_GF_Feb16_16.bin (https://elog.ph.ed.ac.uk/AIDA/215).
This provides a 25 MHz clock output from MACB, plus a manual reset request signal.

Attached are screen captures from smooth updating procedure. 

Checked correlation request signal from output2 of MACB: it's a pulse with ~180ns width and -0.7V. We could only
observe it when selecting 'act no all FEEs' in Correlation Control browser window (looking at MACB module on the
top of the tree). However, we didn't check that the output is produced from only one MACB module, if we select
the one of the corresponding FEE.

To update the FEE64 firmware:-

1. Power-up the FEE64 modules that you wish to update.
2. Identify the file to be used ( FEE_GF_Feb16_15.bin  at 14/4/2016 )
3. This file should be in the Server ( e.g. aidas1 ) at /MIDAS/Aida.
4. Edit the file /MIDAS/Aida/FlashPgm.csh and change the file name at the "flashcp" command line to be the file you wish to update the FEE64s with.
5. To run the file, and hence update the firmware, open the RunControl page and select "Program Flash Memories" from the menu of System Functions.
6. Each of the FEE64 cards in the system at the time will update their firmware using the commands from the  /MIDAS/Aida/FlashPgm.csh file.
7. Once complete a log window will be displayed with a report about each FEE64.
8. Power-cycle the FEE64s to load and run the new firmware.
9. Use the "FEE Temperatures" page to check that all the FEE64 cards have the same version of the firmware loaded as expected. ( 0x10300C12 at 14/4/2016 )
10.  

Used the layout reported in ELOG357 and updated the layout.txt file used in the "Layout and Status" browser window.

The file is in /MIDAS/config/TclHttpd/aidas1

The browser window "Layout and Status" is accessed from the Control browser window.

It is intended to be used to determine if the Embedded Linux is operating in the FEE64. Each FEE64 in the layout.txt file is pinged with a timeout of 1 second. The layout then shows red for no response and green for a response.

Attached is the updated leakage current spreadsheet (Attachment 1)  as pf 5/11/2016 it is up to date with the elog.

Also added is the recording of ambient temperature. This is recorded in degrees C and plotted relative to 21 degrees C to better show on the same plot as leakage currents. (Screenshot in attachement 2)

Also attached is the spreadsheet in csv formatting.

/etc/dhcp/dhcpd.conf updated to reflect actual MAC and IP 
addresses for nnrpi1 and to add nnrpi2 to /etc/hosts

nnrpi1

% /sbin/ifconfig -a
eth0      Link encap:Ethernet  HWaddr b8:27:eb:0b:f6:73  
          inet addr:10.1.1.114  Bcast:10.1.1.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:9315838 errors:0 dropped:0 overruns:0 frame:0
          TX packets:9579504 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:492141377 (469.3 MiB)  TX bytes:3950371110 (3.6 GiB)

lo        Link encap:Local Loopback  
          inet addr:127.0.0.1  Mask:255.0.0.0
          UP LOOPBACK RUNNING  MTU:65536  Metric:1
          RX packets:8485967 errors:0 dropped:0 overruns:0 frame:0
          TX packets:8485967 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:2807265055 (2.6 GiB)  TX bytes:2807265055 (2.6 GiB)

nnrpi2

pi@npg-monitor ~ $ ifconfig -a
eth0      Link encap:Ethernet  HWaddr b8:27:eb:6b:0a:a0  
          inet addr:10.1.1.117  Bcast:10.1.1.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:806 errors:0 dropped:0 overruns:0 frame:0
          TX packets:872 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:66327 (64.7 KiB)  TX bytes:548797 (535.9 KiB)

lo        Link encap:Local Loopback  
          inet addr:127.0.0.1  Mask:255.0.0.0
          UP LOOPBACK RUNNING  MTU:65536  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)

Leakage current spreadsheet has now been uploaded to google docs for ease of access.

It can be accessed and edited from the following link: https://docs.google.com/spreadsheets/d/12hgbrywB10hGsKt5uc2HnLfZymh8_uvM6cEASbbqnBE/edit?usp=sharing

Unable to start Rly16 server - see attachment 1

Added 16.10 6 July 2023

CU No /dev/ttyUSB* on Raspberry Pi

Re-seated USB cable at Raspberry Pi and USB-controlled ac mains relay, power cycled Raspberry Pi - return to normal operation.

At AIDA test station T9, STFC DL unable to start MIDAS DAQ with 1x FEE64 ( aida04 ) - see attachments

aida04 appears to have booted OK and I can connect using telnet

MIDAS 8015 server exits - signal 1

> 
> At AIDA test station T9, STFC DL unable to start MIDAS DAQ with 1x FEE64 ( aida04 ) - see attachments
> 
> aida04 appears to have booted OK and I can connect using telnet
> 
> MIDAS 8015 server exits - signal 1

I’ve had this problem too. The solution is to have the single FEE twice in the list in the config file. The software is then quite happy.

Alternatively a single FEE can still be accessed directly and will operate successfully.  The only thing missing is the spectra function menu. They won’t work, so FWHM is harder to determine. 

Got the error Server Internal Error
while trying to obtain /DataAcquisitionControl/DataAcquisitionStats.tml.
can't read "cgiNUMdata": no such variable while executing "InsertLog "cgidata= ([llength $cgidata]) $cgiNUMdata"" (procedure "do_click" line 9) invoked from within "do_click" invoked from within "if {$started != 0} { variable JS "" variable LogFlag if {$LogFlag == 1} {InsertLog "Last Updated: [clock format [clock seconds] -form..." (file "DataAcquisitionStats.tcl" line 8) invoked from within "source DataAcquisitionStats.tcl" (in namespace eval "::DataAcquisitionStats" script line 3) invoked from within "namespace eval DataAcquisitionStats { source Global.tcl source DataAcquisitionStats.tcl source DataAcquisitionStatsALL.tcl ..." invoked from within "subst { [Doc_Dynamic] [global env; source [file join $env(MIDASBASE) TclHttpd Html settings.tml]] <! [global Httpd; upvar #0 Httpd[set Httpd(curren..." ("uplevel" body line 1) invoked from within "uplevel #0 [list subst $script]" (procedure "SubstFile" line 12) invoked from within "SubstFile /MIDAS@aidas/TclHttpd/Html/DataAcquisitionControl/DataAcquisitionStats.tml {}" ("uplevel" body line 1) invoked from within "uplevel 1 [list SubstFile $path $interp]" (procedure "Subst_File" line 7) invoked from within "Subst_File $template $interp" invoked from within "TemplateInstantiate $sock $path {} $suffix {} $Template(templateInterp)" (procedure "Doc_application/x-tcl-template" line 9) invoked from within "$cmd $path $suffix $sock" (procedure "Doc_Handle" line 20) invoked from within "Doc_Handle $prefix $path $suffix $sock" (procedure "DocDomain" line 44) invoked from within "DocDomain / /MIDAS@aidas/TclHttpd/Html sock8 DataAcquisitionControl/DataAcquisitionStats.tml" ("eval" body line 1) invoked from within "eval $Url(command,$prefix) [list $sock $suffix]"

Tcl Call Trace

 Restarting Httpd for DataAcqusition and browser fixes problem.

10.25 DAQ continues OK 
      Current file May2017/R1_79

      ASIC settings 2017Mar27-16.12.39 *except*
      slow comparator 0x64
      LEC/MEC fast comparator 0xff

      BNC PB-4 pulser OFF

      Detector biases & leakage currents OK - see attachments 1 & 2
      FEE64 Temperatures OK - see attachment 3
      'good events' statistics OK - see attachment 4
      No warnings/errors reported by merger since DAQ GO - see attachment 5

      *all* system wide checks OK

10.28 1.8.L ADC spectra - see attachments 6 & 7 
      1.8.W waveforms - see attachments 8-11

10.43 DAQ stopped 
      Current file May2017/R1_79

10.48 E17/F11 ambient temperature +24.5 deg C, RH 29.0%, d.p. +5.0 deg C
      Julabo FL11006 set point +20 deg C, actual +20.0 deg C, water level OK (c. 65%)


10.58 DAQ starts
      File May2017/R2 *IGNORE*

      Pulser walkthough 

      BNC PB-4 settings 
      Amplitude 90,000 - 10,000 @ 10,000 step
      x5 attenuator IN
      t_r 50ns, tau_d 50us
      polarity -
      rate ~250Hz 
      delay MIN, tail pulse

      ASIC settings 2017Mar27-16.12.39
      Slow comparator 0x0a
 
      See attachment 12

11.02 DAQ starts
      File May2017/R3 *IGNORE*

      Pulser walkthough 

      BNC PB-4 settings 
      Amplitude 12,000 - 2,000 @ 2,000 step
      x5 attenuator IN
      t_r 50ns, tau_d 50us
      polarity -
      rate ~250Hz 
      delay MIN, tail pulse

      ASIC settings 2017Mar27-16.12.39

      See attachment 13

Pulser walkthroughs R2 & R3 should be ignored as + polarity test input
had significantly lower amplitude (x2 oor more) than - polarity test input.
The + polarity test input is derived from tee'd output from BNC PB-4 and
EG&G Ortec 433 Sum & Invert - physically moving the cabling and connectors
between these two points changed tail pulse amplitude or produced a transient
(non-tail) pulse with duration ~ 100ns. Not clear which cable or connector
is the issue (all cables and connectors were individually replaced) but output
amplitude currently correct so will proceed.

11.22 DAQ starts
      File May2017/R4

      Pulser walkthough 

      BNC PB-4 settings 
      Amplitude 90,000 - 10,000 @ 10,000 step
      x5 attenuator IN
      t_r 50ns, tau_d 50us
      polarity -
      rate ~250Hz 
      delay MIN, tail pulse

      ASIC settings 2017Mar27-16.12.39
 
      See attachment 14

11.28 DAQ starts
      File May2017/R5

      Pulser walkthough 

      BNC PB-4 settings 
      Amplitude 12,000 - 2,000 @ 2,000 step
      x5 attenuator IN
      t_r 50ns, tau_d 50us
      polarity -
      rate ~250Hz 
      delay MIN, tail pulse

      ASIC settings 2017Mar27-16.12.39

      See attachment 15

17.25 E17/F11 ambient temperature +24.7 deg C, RH 28.1%, d.p. +5.0 deg C
      Julabo FL11006 set point +20 deg C, actual +20.0 deg C, water level OK (c. 65%)

17.32 Detector biases & leakage currents OK - see attachments 16-17
      FEE64 Temperatures OK - see attachment 18

17.40 DAQ starts
      File May2017/R6

      Continuing DAQ test

      BNC PB-4 settings 
      Amplitude 90,000
      x5 attenuator IN
      t_r 50ns, tau_d 50us
      polarity -
      frequency 25Hz range 
      delay MIN, tail pulse

      ASIC settings 2017Mar27-16.12.39
      slow comparator 0x20

08.15 DAQ found stalled

      Soft reset OK

      DSSSD bias & leakage currents OK - see attachments 1 & 2
      FEE64 temperatures OK - see attachment 3

      Ambient temperature +25.0 deg C, d.p. -0.2 deg C, RH 19.2%

      System-wide checks OK *except* clock status errors for naida5, 7, 8, 15, 16

      ASIC settings 2016Nov07-23.03.06

      BNC PB-4 
      amplitude 90,000
      frequency 25Hz range

08.30 AIDA moved into (CH2)n moderator

08.46 Start DAQ (R141)
      BNC PB_4 pulser OFF
      Background run with AIDA inside (CH2)n moderator

      Statistics - good events - attachment 4

      per FEE64 1.8.W spectra - see attachments 5-8

09.00 DAQ stops OK
      System wide checks OK

      BNC PB-4 pulser ON
      amplitude 90,000
      x5 attenuator IN
      t_r 50ns tau_d 50us
      polarity -, delay MIN, tail pulse
      frequency 25Hz range

14.51 Bias and leakage voltages good (Attachments 9 and 10)

16.30 Ca beam delivered to F11 around 16:30.
      PB shield still in place up stream of AIDA.
      DAQ running in no storage mode. Leakage currents @ 16:40 in attachments 11+12.

18.28 DAQ stopped during LN2 fill cycle. Soft reset completed. 
      Will wait 15mins for cycle to complete and the start new run.

18.34 Ca beam stopped.

19.07 Run R146 started on no storage mode.

20.11 DAQ found stopped.
      Unable to perform soft reset. Power cycling FEEs.