AIDA GELINA BRIKEN nToF CRIB ISOLDE CIRCE nTOFCapture DESPEC DTAS EDI_PSA 179Ta CARME StellarModelling DCF K40
  AIDA, Page 23 of 46  ELOG logo
New entries since:Thu Jan 1 01:00:00 1970
ID Date Author Subjectdown
  328   Mon Jul 18 12:00:16 2016 Patrick Coleman-SmithReport of remote operation of Aida at RIKEN 11/7 to 14/7

11th July ---------------------------------------------------------------------------------------------------------

09:32 UK time, logged in and power-up all FEEs OK. Setup fine, Temperature Max 12@64

System Checks all fine SYNC count 2243584.

Start Merger and Toggle Pause for no merging.

DAQ start with output enabled.

Toggle Pause in Merger -> “Want First SYNC” with no change.

Tried this several times with the same result.

Checked DAQ statistics => Buffers/sec = 50 to 65, SYNC/sec = 40 to 80  ( should be 384 )

Disabled all ASIC readout and disable all discriminators. DAQ still in GO state.

Fetched new version of ASIC4 with Enable/Disable ASIC readout commands in the “Expert” menu.

SYNC statics now all FEEs are 384/sec.

Merger … Toggle Pause and its fine. 334 items/sec.

DAQ : ASIC4 : Set all slow comparator Thresholds to 250 : Enable ASICs for readout.

Merger now 532811 items/sec.

DAQ SYNC statistics range 307 to 390/sec

LT 22:36 System Checks => Sync counts 6518784 all ok, Sync errors all passed.

LT 23:30 Merger 539826 items/sec. Temperatures => 12@68.12 ; SYNC statistics 361 to 385 ; SYNC counts 8099840 all ok ; Sync errors all ok ; ASIC clock timestamp all ok.

STOP then Power-down all fine.

13th July ----------------------------------------------------------------------------------------------------------------------

Log in and power-up fine.

Backup Merger file ( merge.AD )  and copy latest version from DL. Won’t copy as file already open.

So instead …. Disable ASIC readout, disable Discriminators and run the system.

When Merger is operating , Enable ASIC readout => Merger rate is 8,058,412 items/sec.

LT 19:44 => Temperatures max 12@68.81 , SYNC received 845824 all ok; Sync errors all ok.

LT 20:11 => Merge rate 7,991,198 items/sec, SYNC received 1551359 all ok; Sync errors all ok.

LT 21:07 => Temperatures Max 12@69.00 ; SYNC received 2742272 all.

LT 23:20 => Stopped the whole system.

Kill the Merge process and the Startup process. Copy new Merge.AD successful. Edit Merger startup script to include netint OutputAll 1.

Start up Merger using /MIDAS/Merger/AIDA/Startup in terminal connected to aidas1.

Merger : Setup and configure ; Go ; Toggle Pause All Ok.

Go DAQ   - disable all ASIC readout.

Merger : Toggle Pause ; Merging 8832 items/sec ( = 384 x 23 …. OK )

Connect to TapeServer setup for R3 into /TapeData/July2016 , Go Tape ok.

Merger : Toggle Transfer.

LT 00:08 => enable ASICS for readout. Run for a short while. Merge spinner hesitates for 2 seconds at a time. Merge rate 5,951,471 items/sec. Tape server rate 3,5148 Kbytes/sec.

Stop system, SYNC received 8085504 all ok ; sync error all ok. Power down. Sftp tape data files to nndhcp052 in Daresbury.

14th July -------------------------------------------------------------------------------------------------------------------------

Startup and run the system to tape again R4, ASICs with no discriminators. All fine.

LT 20:19 Enable Discriminators. Merger rate 3.9Mi/sec ( Mega items/second)

LT 20:57 Temperature Max 12@69 , Merge rate 4.2Mi/sec

UK 14:49 Network failure between Daresbury and Edinburgh. Lost contact repeatedly 4 times in a row. Contacted DL network support. No local networking faults.

LT 23:05 Re-connected to Aida in RIKEN. Merger 3.3Mi/sec.

Decided to stop due to concerns about flaky network and leaving the system powered up over the weekend.

SYNC received 7222272 all ok; sync error ok.

Power down. R4_244 is the last file. Written.

 

  820   Wed May 29 06:53:56 2019 TDReport - medium - unable to monitor FEE64 logs using pi_monitor
Unable to monitor FEE64 logs using pi_monitor using instructions https://elog.ph.ed.ac.uk/AIDA/559

At first load of URL http://10.1.1.117:8015/AIDA/Pi_Monitor/Pi_Monitor.tml I obtain error messages - attachment 1

At reload of URL I obtain the expected page and 
Update USB Terminal List and Connect USB Terminals operate as expected - attachment  2

Selecting Parse USB Log Files for Details produces (after c. 60s) a connection reset error from the browser -
see attachment 3


pi@npg-monitor /tmp $ ls
log8015_19.05.28  log8015_counter  log8015_error  tcl2156  tclhttpd2156.default
pi@npg-monitor /tmp $ cat log8015_error
 [28/May/2019:09:18:01] sock8 error writing "sock8": broken pipe  /css/buttons.css
 [28/May/2019:09:18:11] sock8 DocSubstSystemFile {could not read "/MIDAS/TclHttpd/Html/error.html": no such file
or directory} /AIDA/Pi_Monitor/Pi_Monitor.tml
 [28/May/2019:09:18:11] sock8 Error 500 /AIDA/Pi_Monitor/Pi_Monitor.tml {can't read "JS": no such variable
    while executing
"if {$JS != ""} {
       append JS "\");"
       set html "<script>[set JS]</script>"
    }"
    (in namespace eval "::Pi_Monitor" script line 2)
    invoked from within
"namespace eval Pi_Monitor {
    if {$JS != ""} {
       append JS "\");"
       set html "<script>[set JS]</script>"
    }
}"
    invoked from within
"subst \n[Doc_Dynamic\]\n\n[global\ env\;\ source\ [file\ join\ \$env(MIDASBASE)\ TclHttpd\ Html\
settings.tml\]\]\n\n<!\n[global\ Httpd\;\ upvar\ ..."
    ("uplevel" body line 1)
    invoked from within
"uplevel #0 [list subst $script]"
    (procedure "SubstFile" line 12)
    invoked from within
"SubstFile /MIDAS/TclHttpd/Html/AIDA/Pi_Monitor/Pi_Monitor.tml {}"
    ("uplevel" body line 1)
    invoked from within
"uplevel 1 [list SubstFile $path $interp]"
    (procedure "Subst_File" line 7)
    invoked from within
"Subst_File $template $interp"
    invoked from within
"TemplateInstantiate $sock $path {} $suffix {} $Template(templateInterp)"
    (procedure "Doc_application/x-tcl-template" line 9)
    invoked from within
"$cmd $path $suffix $sock"
    (procedure "Doc_Handle" line 20)
    invoked from within
"Doc_Handle $prefix $path $suffix $sock"
    (procedure "DocDomain" line 44)
    invoked from within
"DocDomain / /MIDAS/TclHttpd/Html sock8 AIDA/Pi_Monitor/Pi_Monitor.tml"
    ("eval" body line 1)
    invoked from within
"eval $Url(command,$prefix) [list $sock $suffix]"} /AIDA/Pi_Monitor/Pi_Monitor.tml
pi@npg-monitor /tmp $ cat log8015_19.05.28
10.1.1.250 - - [28/May/2019:09:18:01 UTC] "GET / HTTP/1.1" 200 - - "Mozilla/5.0 (X11; Linux x86_64; rv:60.0)
Gecko/20100101 Firefox/60.0"
10.1.1.250 - - [28/May/2019:09:18:01 UTC] "GET /js/Common.js HTTP/1.1" 200 3828 "http://nnrpi2:8015/"
"Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Firefox/60.0"
10.1.1.250 - - [28/May/2019:09:18:11 UTC] "GET /AIDA/Pi_Monitor/Pi_Monitor.tml HTTP/1.1" 500 - - "Mozilla/5.0
(X11; Linux x86_64; rv:60.0) Gecko/20100101 Firefox/60.0"
10.1.1.250 - - [28/May/2019:09:18:30 UTC] "GET /AIDA/Pi_Monitor/Pi_Monitor.tml HTTP/1.1" 200 - - "Mozilla/5.0
(X11; Linux x86_64; rv:60.0) Gecko/20100101 Firefox/60.0"
10.1.1.250 - - [28/May/2019:09:18:30 UTC] "GET /AIDA/Pi_Monitor/Pi_Monitor.js HTTP/1.1" 200 542
"http://10.1.1.117:8015/AIDA/Pi_Monitor/Pi_Monitor.tml" "Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101
Firefox/60.0"
10.1.1.250 - - [28/May/2019:09:18:30 UTC] "GET /js/Common.js HTTP/1.1" 304 3828
"http://10.1.1.117:8015/AIDA/Pi_Monitor/Pi_Monitor.tml" "Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101
Firefox/60.0"
10.1.1.250 - - [28/May/2019:09:18:30 UTC] "GET /images/Space.gif HTTP/1.1" 200 -
"http://10.1.1.117:8015/AIDA/Pi_Monitor/Pi_Monitor.tml" "Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101
Firefox/60.0"
10.1.1.250 - - [28/May/2019:09:18:30 UTC] "GET /js/FormChek.js HTTP/1.1" 304 60521
"http://10.1.1.117:8015/AIDA/Pi_Monitor/Pi_Monitor.tml" "Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101
Firefox/60.0"
10.1.1.250 - - [28/May/2019:09:18:30 UTC] "GET /images/midas.gif HTTP/1.1" 200 2558
"http://10.1.1.117:8015/AIDA/Pi_Monitor/Pi_Monitor.tml" "Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101
Firefox/60.0"
10.1.1.250 - - [28/May/2019:09:18:30 UTC] "GET /images/Space.gif HTTP/1.1" 200 -
"http://10.1.1.117:8015/AIDA/Pi_Monitor/Pi_Monitor.tml" "Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101
Firefox/60.0"
10.1.1.250 - - [28/May/2019:09:18:30 UTC] "GET /images/tclp.gif HTTP/1.1" 200 1294
"http://10.1.1.117:8015/AIDA/Pi_Monitor/Pi_Monitor.tml" "Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101
Firefox/60.0"
10.1.1.250 - - [28/May/2019:09:18:32 UTC] "POST /AIDA/Pi_Monitor/Pi_Monitor.tml HTTP/1.1" 200 -
"http://10.1.1.117:8015/AIDA/Pi_Monitor/Pi_Monitor.tml" "Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101
Firefox/60.0"
10.1.1.250 - - [28/May/2019:09:18:32 UTC] "GET /images/Space.gif HTTP/1.1" 200 -
"http://10.1.1.117:8015/AIDA/Pi_Monitor/Pi_Monitor.tml" "Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101
Firefox/60.0"
10.1.1.250 - - [28/May/2019:09:18:39 UTC] "POST /AIDA/Pi_Monitor/Pi_Monitor.tml HTTP/1.1" 200 -
"http://10.1.1.117:8015/AIDA/Pi_Monitor/Pi_Monitor.tml" "Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101
Firefox/60.0"
10.1.1.250 - - [28/May/2019:09:18:39 UTC] "GET /images/Space.gif HTTP/1.1" 200 -
"http://10.1.1.117:8015/AIDA/Pi_Monitor/Pi_Monitor.tml" "Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101
Firefox/60.0"
pi@npg-monitor /tmp $ cat log8015_counter



set ::counter::H-urlhits(0) 0
set ::counter::H-urlhits(1) 0
set ::counter::H-urlhits(10) 0
set ::counter::H-urlhits(11) 0
set ::counter::H-urlhits(12) 0
set ::counter::H-urlhits(13) 0
set ::counter::H-urlhits(14) 0
set ::counter::H-urlhits(15) 0
set ::counter::H-urlhits(16) 0
set ::counter::H-urlhits(17) 0
set ::counter::H-urlhits(18) 0
set ::counter::H-urlhits(19) 0
set ::counter::H-urlhits(2) 0
set ::counter::H-urlhits(20) 0
set ::counter::H-urlhits(21) 0
set ::counter::H-urlhits(22) 0
set ::counter::H-urlhits(23) 0
set ::counter::H-urlhits(24) 0
set ::counter::H-urlhits(25) 0
set ::counter::H-urlhits(26) 0
set ::counter::H-urlhits(27) 0
set ::counter::H-urlhits(28) 0
set ::counter::H-urlhits(29) 0
set ::counter::H-urlhits(3) 0
set ::counter::H-urlhits(30) 0
set ::counter::H-urlhits(31) 0
set ::counter::H-urlhits(32) 0
set ::counter::H-urlhits(33) 0
set ::counter::H-urlhits(34) 0
set ::counter::H-urlhits(35) 0
set ::counter::H-urlhits(36) 0
set ::counter::H-urlhits(37) 0
set ::counter::H-urlhits(38) 0
set ::counter::H-urlhits(39) 0
set ::counter::H-urlhits(4) 0
set ::counter::H-urlhits(40) 0
set ::counter::H-urlhits(41) 0
set ::counter::H-urlhits(42) 0
set ::counter::H-urlhits(43) 0
set ::counter::H-urlhits(44) 0
set ::counter::H-urlhits(45) 0
set ::counter::H-urlhits(46) 0
set ::counter::H-urlhits(47) 0
set ::counter::H-urlhits(48) 0
set ::counter::H-urlhits(49) 0
set ::counter::H-urlhits(5) 0
set ::counter::H-urlhits(50) 0
set ::counter::H-urlhits(51) 0
set ::counter::H-urlhits(52) 0
set ::counter::H-urlhits(53) 0
set ::counter::H-urlhits(54) 0
set ::counter::H-urlhits(55) 0
set ::counter::H-urlhits(56) 0
set ::counter::H-urlhits(57) 0
set ::counter::H-urlhits(58) 0
set ::counter::H-urlhits(59) 0
set ::counter::H-urlhits(6) 0
set ::counter::H-urlhits(7) 0
set ::counter::H-urlhits(8) 0
set ::counter::H-urlhits(9) 0


set ::counter::Hour-urlhits(0) 0
set ::counter::Hour-urlhits(1) 0
set ::counter::Hour-urlhits(10) 0
set ::counter::Hour-urlhits(11) 0
set ::counter::Hour-urlhits(12) 0
set ::counter::Hour-urlhits(13) 0
set ::counter::Hour-urlhits(14) 0
set ::counter::Hour-urlhits(15) 0
set ::counter::Hour-urlhits(16) 0
set ::counter::Hour-urlhits(17) 0
set ::counter::Hour-urlhits(18) 0
set ::counter::Hour-urlhits(19) 0
set ::counter::Hour-urlhits(2) 0
set ::counter::Hour-urlhits(20) 0
set ::counter::Hour-urlhits(21) 0
set ::counter::Hour-urlhits(22) 0
set ::counter::Hour-urlhits(23) 0
set ::counter::Hour-urlhits(3) 0
set ::counter::Hour-urlhits(4) 0
set ::counter::Hour-urlhits(5) 0
set ::counter::Hour-urlhits(6) 0
set ::counter::Hour-urlhits(7) 0
set ::counter::Hour-urlhits(8) 0
set ::counter::Hour-urlhits(9) 0


set ::counter::Day-urlhits(0) 0

Before selecting Parse USB ...

pi@npg-monitor /tmp $ ps -ef
UID        PID  PPID  C STIME TTY          TIME CMD
root         1     0  0 09:16 ?        00:00:01 init [2]  
root         2     0  0 09:16 ?        00:00:00 [kthreadd]
root         3     2  0 09:16 ?        00:00:00 [ksoftirqd/0]
root         5     2  0 09:16 ?        00:00:00 [kworker/0:0H]
root         6     2  0 09:16 ?        00:00:00 [kworker/u8:0]
root         7     2  0 09:16 ?        00:00:00 [rcu_preempt]
root         8     2  0 09:16 ?        00:00:00 [rcu_sched]
root         9     2  0 09:16 ?        00:00:00 [rcu_bh]
root        10     2  0 09:16 ?        00:00:00 [migration/0]
root        11     2  0 09:16 ?        00:00:00 [migration/1]
root        12     2  0 09:16 ?        00:00:00 [ksoftirqd/1]
root        14     2  0 09:16 ?        00:00:00 [kworker/1:0H]
root        15     2  0 09:16 ?        00:00:00 [migration/2]
root        16     2  0 09:16 ?        00:00:00 [ksoftirqd/2]
root        17     2  0 09:16 ?        00:00:00 [kworker/2:0]
root        18     2  0 09:16 ?        00:00:00 [kworker/2:0H]
root        19     2  0 09:16 ?        00:00:00 [migration/3]
root        20     2  0 09:16 ?        00:00:00 [ksoftirqd/3]
root        21     2  0 09:16 ?        00:00:00 [kworker/3:0]
root        22     2  0 09:16 ?        00:00:00 [kworker/3:0H]
root        23     2  0 09:16 ?        00:00:00 [khelper]
root        24     2  0 09:16 ?        00:00:00 [kdevtmpfs]
root        25     2  0 09:16 ?        00:00:00 [netns]
root        26     2  0 09:16 ?        00:00:00 [perf]
root        27     2  0 09:16 ?        00:00:00 [khungtaskd]
root        28     2  0 09:16 ?        00:00:00 [writeback]
root        29     2  0 09:16 ?        00:00:00 [crypto]
root        30     2  0 09:16 ?        00:00:00 [bioset]
root        31     2  0 09:16 ?        00:00:00 [kblockd]
root        32     2  0 09:16 ?        00:00:00 [kworker/1:1]
root        33     2  0 09:16 ?        00:00:00 [rpciod]
root        34     2  0 09:16 ?        00:00:00 [kswapd0]
root        35     2  0 09:16 ?        00:00:00 [fsnotify_mark]
root        36     2  0 09:16 ?        00:00:00 [nfsiod]
root        42     2  0 09:16 ?        00:00:00 [kthrotld]
root        43     2  0 09:16 ?        00:00:00 [kworker/0:1]
root        44     2  0 09:16 ?        00:00:00 [VCHIQ-0]
root        45     2  0 09:16 ?        00:00:00 [VCHIQr-0]
root        46     2  0 09:16 ?        00:00:00 [VCHIQs-0]
root        47     2  0 09:16 ?        00:00:00 [iscsi_eh]
root        48     2  0 09:16 ?        00:00:00 [dwc_otg]
root        49     2  0 09:16 ?        00:00:00 [DWC Notificatio]
root        51     2  0 09:16 ?        00:00:00 [VCHIQka-0]
root        52     2  0 09:16 ?        00:00:00 [SMIO]
root        53     2  0 09:16 ?        00:00:00 [deferwq]
root        54     2  0 09:16 ?        00:00:00 [kworker/u8:2]
root        55     2  0 09:16 ?        00:00:00 [kworker/2:1]
root        56     2  0 09:16 ?        00:00:00 [mmcqd/0]
root        58     2  0 09:16 ?        00:00:00 [jbd2/mmcblk0p2-]
root        59     2  0 09:16 ?        00:00:00 [ext4-rsv-conver]
root        74     2  0 09:16 ?        00:00:00 [kworker/3:1]
root       176     1  0 09:16 ?        00:00:00 udevd --daemon
root       200     2  0 09:16 ?        00:00:00 [kworker/1:4]
root       260     2  0 09:16 ?        00:00:00 [3f204000.spi]
root       299   176  0 09:16 ?        00:00:00 udevd --daemon
root       319   176  0 09:16 ?        00:00:00 udevd --daemon
root      1619     1  0 09:17 ?        00:00:00 /usr/sbin/ifplugd -i lo -q -f -u0 -d10 -w -I
root      1642     1  0 09:17 ?        00:00:00 /usr/sbin/ifplugd -i eth0 -q -f -u0 -d10 -w -I
root      1836     1  0 09:17 ?        00:00:00 /bin/sh /etc/init.d/rc 2
root      1845  1836  0 09:17 ?        00:00:00 startpar -p 4 -t 20 -T 3 -M start -P N -R 2
nobody    1903     1  0 09:17 ?        00:00:00 /usr/sbin/thd --daemon --triggers /etc/triggerhappy/triggers.d/
--socket /var/run/thd.socket --pidfile /var/run/thd.pid --user nobody /dev/input/event*
root      1909     2  0 09:17 ?        00:00:00 [kworker/0:2]
root      1912     1  0 09:17 ?        00:00:00 /usr/sbin/rsyslogd -c5
root      2037     1  0 09:17 ?        00:00:00 /usr/sbin/cron
ntp       2050     1  0 09:17 ?        00:00:00 /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 102:104
104       2082     1  0 09:17 ?        00:00:00 /usr/bin/dbus-daemon --system
root      2087  2050  0 09:17 ?        00:00:00 /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 102:104
root      2142  1845  0 09:17 ?        00:00:00 /bin/sh /etc/init.d/rc.local start
root      2148  2142  0 09:17 ?        00:00:00 /bin/sh -e /etc/rc.local
root      2151  2148  0 09:17 ?        00:00:00 /bin/csh -f /MIDAS/TclHttpd/linux-arm/TclHttpd-server
root      2156  2151  0 09:17 ?        00:00:03 /usr/bin/tclsh /MIDAS/TclHttpd/bin/httpd_Server.tcl -uid 0 -gid 0
root      2165     1  0 09:17 ?        00:00:00 dhclient -v -pf /run/dhclient.eth0.pid -lf
/var/lib/dhcp/dhclient.eth0.leases eth0
root      2210     1  0 09:17 ?        00:00:00 /usr/sbin/sshd
root      2269  2210  0 09:18 ?        00:00:00 sshd: pi [priv]  
pi        2273  2269  0 09:19 ?        00:00:00 sshd: pi@pts/0   
pi        2278  2273  0 09:19 pts/0    00:00:00 -bash
pi        2306  2278  0 09:24 pts/0    00:00:00 ps -ef

After selecting Parse USB ...

pi@npg-monitor /tmp $ ps -ef
UID        PID  PPID  C STIME TTY          TIME CMD
root         1     0  0 09:16 ?        00:00:01 init [2]  
root         2     0  0 09:16 ?        00:00:00 [kthreadd]
root         3     2  0 09:16 ?        00:00:02 [ksoftirqd/0]
root         5     2  0 09:16 ?        00:00:00 [kworker/0:0H]
root         6     2  0 09:16 ?        00:00:00 [kworker/u8:0]
root         7     2  0 09:16 ?        00:00:00 [rcu_preempt]
root         8     2  0 09:16 ?        00:00:00 [rcu_sched]
root         9     2  0 09:16 ?        00:00:00 [rcu_bh]
root        10     2  0 09:16 ?        00:00:00 [migration/0]
root        11     2  0 09:16 ?        00:00:00 [migration/1]
root        12     2  0 09:16 ?        00:00:00 [ksoftirqd/1]
root        14     2  0 09:16 ?        00:00:00 [kworker/1:0H]
root        15     2  0 09:16 ?        00:00:00 [migration/2]
root        16     2  0 09:16 ?        00:00:00 [ksoftirqd/2]
root        17     2  0 09:16 ?        00:00:00 [kworker/2:0]
root        18     2  0 09:16 ?        00:00:00 [kworker/2:0H]
root        19     2  0 09:16 ?        00:00:00 [migration/3]
root        20     2  0 09:16 ?        00:00:00 [ksoftirqd/3]
root        21     2  0 09:16 ?        00:00:00 [kworker/3:0]
root        22     2  0 09:16 ?        00:00:00 [kworker/3:0H]
root        23     2  0 09:16 ?        00:00:00 [khelper]
root        24     2  0 09:16 ?        00:00:00 [kdevtmpfs]
root        25     2  0 09:16 ?        00:00:00 [netns]
root        26     2  0 09:16 ?        00:00:00 [perf]
root        27     2  0 09:16 ?        00:00:00 [khungtaskd]
root        28     2  0 09:16 ?        00:00:00 [writeback]
root        29     2  0 09:16 ?        00:00:00 [crypto]
root        30     2  0 09:16 ?        00:00:00 [bioset]
root        31     2  0 09:16 ?        00:00:00 [kblockd]
root        32     2  0 09:16 ?        00:00:00 [kworker/1:1]
root        33     2  0 09:16 ?        00:00:00 [rpciod]
root        34     2  0 09:16 ?        00:00:01 [kswapd0]
root        35     2  0 09:16 ?        00:00:00 [fsnotify_mark]
root        36     2  0 09:16 ?        00:00:00 [nfsiod]
root        42     2  0 09:16 ?        00:00:00 [kthrotld]
root        43     2  0 09:16 ?        00:00:01 [kworker/0:1]
root        44     2  0 09:16 ?        00:00:00 [VCHIQ-0]
root        45     2  0 09:16 ?        00:00:00 [VCHIQr-0]
root        46     2  0 09:16 ?        00:00:00 [VCHIQs-0]
root        47     2  0 09:16 ?        00:00:00 [iscsi_eh]
root        48     2  0 09:16 ?        00:00:00 [dwc_otg]
root        49     2  0 09:16 ?        00:00:00 [DWC Notificatio]
root        51     2  0 09:16 ?        00:00:00 [VCHIQka-0]
root        52     2  0 09:16 ?        00:00:00 [SMIO]
root        53     2  0 09:16 ?        00:00:00 [deferwq]
root        54     2  0 09:16 ?        00:00:00 [kworker/u8:2]
root        55     2  0 09:16 ?        00:00:00 [kworker/2:1]
root        56     2  0 09:16 ?        00:00:02 [mmcqd/0]
root        58     2  0 09:16 ?        00:00:00 [jbd2/mmcblk0p2-]
root        59     2  0 09:16 ?        00:00:00 [ext4-rsv-conver]
root        74     2  0 09:16 ?        00:00:00 [kworker/3:1]
root       176     1  0 09:16 ?        00:00:00 udevd --daemon
root       200     2  0 09:16 ?        00:00:00 [kworker/1:4]
root       260     2  0 09:16 ?        00:00:00 [3f204000.spi]
root       299   176  0 09:16 ?        00:00:00 udevd --daemon
root       319   176  0 09:16 ?        00:00:00 udevd --daemon
root      1619     1  0 09:17 ?        00:00:00 /usr/sbin/ifplugd -i lo -q -f -u0 -d10 -w -I
root      1642     1  0 09:17 ?        00:00:01 /usr/sbin/ifplugd -i eth0 -q -f -u0 -d10 -w -I
nobody    1903     1  0 09:17 ?        00:00:00 /usr/sbin/thd --daemon --triggers /etc/triggerhappy/triggers.d/
--socket /var/run/thd.socket --pidfile /var/run/thd.pid --user nobody /dev/input/event*
root      1909     2  0 09:17 ?        00:00:00 [kworker/0:2]
root      1912     1  0 09:17 ?        00:00:00 /usr/sbin/rsyslogd -c5
root      2037     1  0 09:17 ?        00:00:00 /usr/sbin/cron
ntp       2050     1  0 09:17 ?        00:00:00 /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 102:104
104       2082     1  0 09:17 ?        00:00:00 /usr/bin/dbus-daemon --system
root      2087  2050  0 09:17 ?        00:00:00 /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 102:104
root      2165     1  0 09:17 ?        00:00:00 dhclient -v -pf /run/dhclient.eth0.pid -lf
/var/lib/dhcp/dhclient.eth0.leases eth0
root      2210     1  0 09:17 ?        00:00:00 /usr/sbin/sshd
root      2269  2210  0 09:18 ?        00:00:00 sshd: pi [priv]  
pi        2273  2269  0 09:19 ?        00:00:00 sshd: pi@pts/0   
pi        2278  2273  0 09:19 pts/0    00:00:00 -bash
root      2309     2  0 09:28 ?        00:00:00 [kworker/1:1H]
root      2310     2  0 09:28 ?        00:00:00 [kworker/3:1H]
root      2311     2  0 09:29 ?        00:00:00 [kworker/0:0]
root      2312     1  0 09:29 tty1     00:00:00 /sbin/getty --noclear 38400 tty1
root      2313     1  0 09:29 tty2     00:00:00 /sbin/getty 38400 tty2
root      2314     1  0 09:29 tty3     00:00:00 /sbin/getty 38400 tty3
root      2315     1  0 09:29 tty4     00:00:00 /sbin/getty 38400 tty4
root      2316     1  0 09:29 tty5     00:00:00 /sbin/getty 38400 tty5
root      2317     1  0 09:29 tty6     00:00:00 /sbin/getty 38400 tty6
root      2318     1  0 09:29 ?        00:00:00 /sbin/getty -L ttyAMA0 115200 vt100
root      2319     2  0 09:29 ?        00:00:00 [kworker/u8:1]
pi        2332  2278  0 09:32 pts/0    00:00:00 ps -ef

The httpd server appears to have died
Attachment 1: 10.png
10.png
Attachment 2: 11.png
11.png
Attachment 3: 12.png
12.png
  541   Wed Mar 29 05:08:04 2017 TDReport - medium - delayed or missing authenticated mount requests following FEE64 power cycle
This is not, I think, a new observation.

Following FEE64 power cycles we sometimes observe delayed ( ~5-15 minutes ) authenticated mount requests
as the FEE64s mount their root filesystem from the AIDA server aidas1 - see attachment 1. 

There also appears to be an instance of a *missing* authenticated mount request - nnaida10 at 19.51

So this is *a* (but probably not *the*) cause of FEE64 timeouts observed following a FEE64 power cycle
and then waiting 10 minutes before attempting to start the MIDAS DAQ.


I have noticed that these issues appear to be significantly worse when we are using NTFS-mounted USB disks
to backup data from the AIDA server internal disks. Indeed, performance in general is noticeably slower when
using the NTFS-mounted USB disks.

Currently, we attempt to mitigate these issues by either throttling rsync or nice'ing cp. 
Attachment 1: messages.log
Mar 26 16:45:50 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.8:777 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida8 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 16:45:50 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.6:881 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida6 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 16:45:50 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.7:888 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida7 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 16:45:50 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.1:719 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida1 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 16:45:50 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.2:986 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida2 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 16:45:50 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.4:837 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida4 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 16:45:50 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.3:831 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida3 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 16:45:50 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.5:936 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida5 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 16:46:01 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.10:768 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida10 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 16:46:01 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.16:947 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida16 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 16:46:01 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.15:751 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida15 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 16:46:01 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.12:910 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida12 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 16:46:01 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.13:967 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida13 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 16:46:01 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.9:845 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida9 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 16:46:01 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.14:713 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida14 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 16:46:01 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.11:763 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida11 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 16:46:28 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.22:773 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida22 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 16:46:28 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.18:836 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida18 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 16:46:28 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.21:832 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida21 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 16:46:28 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.20:918 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida20 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 16:46:28 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.23:777 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida23 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 16:46:28 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.19:845 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida19 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 16:46:28 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.24:812 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida24 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 16:46:28 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.17:1008 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida17 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 16:46:42 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.8:865 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 16:46:42 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.7:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 16:46:42 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.3:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 16:46:44 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.2:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 16:46:44 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.4:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 16:46:44 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.6:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 16:46:44 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.1:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 16:46:52 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.5:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 16:46:59 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.10:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 16:47:02 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.15:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 16:47:02 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.13:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 16:47:03 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.16:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 16:47:03 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.9:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 16:47:04 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.12:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 16:47:05 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.14:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 16:47:08 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.11:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 16:47:43 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.24:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 16:47:44 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.20:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 16:47:49 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.22:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 16:47:51 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.23:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 16:47:53 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.21:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 16:47:53 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.18:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 16:47:54 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.19:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 16:47:57 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.17:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:16:23 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.6:933 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida6 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:16:23 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.8:695 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida8 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:16:23 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.1:691 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida1 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:16:23 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.2:841 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida2 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:16:23 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.4:747 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida4 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:16:23 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.5:900 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida5 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:16:23 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.3:835 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida3 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:16:23 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.7:1000 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida7 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:16:39 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.10:787 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida10 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:16:39 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.13:801 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida13 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:16:39 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.14:775 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida14 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:16:39 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.11:689 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida11 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:16:39 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.9:734 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida9 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:16:39 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.12:695 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida12 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:16:39 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.16:1006 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida16 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:16:39 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.15:939 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida15 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:16:52 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.22:969 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida22 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:16:52 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.18:799 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida18 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:16:52 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.20:824 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida20 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:16:52 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.23:751 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida23 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:16:52 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.19:709 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida19 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:16:52 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.21:875 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida21 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:16:52 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.24:668 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida24 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:16:52 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.17:814 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida17 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:16:55 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.7:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:16:58 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.4:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:17:00 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.3:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:17:01 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.1:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:17:01 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.8:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:17:02 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.2:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:17:02 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.5:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:17:02 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.6:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:17:24 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.9:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:17:25 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.10:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:17:25 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.13:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:17:26 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.15:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:17:26 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.12:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:17:26 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.14:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:17:27 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.16:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:17:27 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.11:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:17:37 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.20:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:17:38 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.22:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:17:39 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.24:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:17:41 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.23:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:17:47 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.18:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:17:48 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.19:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:17:48 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.21:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:17:50 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.17:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:41:44 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.1:1018 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida1 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:41:44 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.6:696 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida6 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:41:44 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.8:901 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida8 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:41:44 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.7:748 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida7 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:41:44 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.4:768 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida4 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:41:44 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.2:784 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida2 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:41:44 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.5:688 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida5 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:41:44 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.3:895 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida3 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:41:55 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.10:1011 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida10 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:41:55 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.12:844 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida12 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:41:55 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.13:754 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida13 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:41:55 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.16:885 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida16 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:41:55 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.15:904 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida15 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:41:55 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.9:868 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida9 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:41:55 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.14:1000 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida14 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:41:55 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.11:939 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida11 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:42:07 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.22:800 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida22 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:42:07 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.21:962 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida21 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:42:07 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.18:839 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida18 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:42:07 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.20:927 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida20 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:42:07 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.23:908 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida23 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:42:07 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.19:919 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida19 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:42:07 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.24:1010 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida24 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:42:08 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.17:1017 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida17 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 26 18:42:14 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.7:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:42:15 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.4:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:42:21 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.5:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:42:23 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.8:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:42:24 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.1:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:42:26 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.2:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:42:26 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.6:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:42:27 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.3:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:42:37 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.12:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:42:37 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.10:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:42:37 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.15:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:42:37 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.13:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:42:37 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.9:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:42:37 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.16:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:42:38 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.14:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:42:39 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.11:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:43:05 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.20:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:43:06 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.24:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:43:06 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.22:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:43:08 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.18:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:43:08 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.21:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:43:08 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.23:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:43:15 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.19:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 26 18:43:16 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.17:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:00:20 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.8:680 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida8 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:00:20 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.6:825 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida6 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:00:20 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.7:746 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida7 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:00:20 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.1:791 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida1 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:00:20 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.2:680 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida2 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:00:20 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.5:724 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida5 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:00:20 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.3:715 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida3 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:00:20 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.4:673 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida4 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:00:23 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.10:986 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida10 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:00:23 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.12:1005 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida12 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:00:23 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.11:968 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida11 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:00:23 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.16:687 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida16 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:00:23 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.13:838 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida13 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:00:23 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.15:872 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida15 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:00:23 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.9:827 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida9 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:00:23 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.14:809 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida14 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:00:26 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.22:807 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida22 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:00:26 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.18:732 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida18 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:00:26 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.20:870 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida20 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:00:26 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.23:995 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida23 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:00:26 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.21:720 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida21 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:00:26 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.19:777 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida19 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:00:26 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.24:767 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida24 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:00:26 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.17:973 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida17 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:01:08 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.7:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:01:17 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.3:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:01:17 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.1:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:01:17 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.5:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:01:17 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.4:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:01:17 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.8:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:01:18 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.2:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:01:19 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.6:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:01:19 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.10:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:01:20 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.13:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:01:20 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.15:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:01:20 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.9:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:01:20 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.12:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:01:20 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.16:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:01:20 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.14:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:01:20 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.20:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:01:20 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.11:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:01:21 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.24:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:01:21 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.22:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:01:21 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.18:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:01:21 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.23:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:01:21 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.19:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:01:21 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.21:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:01:34 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.17:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:14:32 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.6:817 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida6 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:14:32 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.8:758 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida8 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:14:32 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.7:869 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida7 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:14:32 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.1:881 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida1 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:14:32 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.2:920 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida2 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:14:32 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.4:994 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida4 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:14:32 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.5:900 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida5 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:14:32 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.3:1016 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida3 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:14:33 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.10:890 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida10 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:14:33 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.16:913 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida16 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:14:33 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.13:721 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida13 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:14:33 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.12:954 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida12 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:14:33 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.9:909 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida9 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:14:33 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.15:983 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida15 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:14:33 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.14:679 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida14 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:14:33 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.11:752 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida11 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:14:36 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.23:766 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida23 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:14:36 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.22:793 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida22 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:14:36 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.18:990 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida18 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:14:36 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.20:775 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida20 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:14:36 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.17:780 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida17 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:14:36 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.19:887 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida19 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:14:36 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.24:767 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida24 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:14:36 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.21:791 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida21 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 27 15:15:10 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.7:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:15:31 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.4:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:15:32 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.8:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:15:34 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.5:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:15:34 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.3:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:15:34 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.1:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:15:35 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.2:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:15:35 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.6:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:15:35 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.13:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:15:35 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.10:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:15:36 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.9:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:15:37 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.12:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:15:37 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.15:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:15:37 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.14:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:15:38 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.16:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:15:38 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.11:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:15:38 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.24:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:15:38 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.20:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:15:38 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.23:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:15:38 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.22:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:15:38 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.17:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:15:38 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.18:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:15:39 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.19:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 27 15:15:39 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.21:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 28 17:58:52 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.8:776 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida8 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 28 17:58:52 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.7:846 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida7 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 28 17:58:52 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.6:834 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida6 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 28 17:58:52 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.2:702 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida2 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 28 17:58:52 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.1:690 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida1 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 28 17:58:52 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.4:674 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida4 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 28 17:58:53 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.3:705 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida3 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 28 17:58:53 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.5:724 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida5 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 28 17:58:53 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.10:789 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida10 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 28 17:58:53 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.16:886 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida16 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 28 17:58:53 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.13:706 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida13 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 28 17:58:53 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.15:1009 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida15 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 28 17:58:53 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.12:776 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida12 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 28 17:58:53 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.9:956 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida9 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 28 17:58:53 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.11:682 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida11 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 28 17:58:53 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.14:774 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida14 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 28 17:58:56 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.22:863 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida22 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 28 17:58:56 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.24:847 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida24 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 28 17:58:56 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.18:714 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida18 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 28 17:58:56 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.20:956 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida20 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 28 17:58:56 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.23:909 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida23 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 28 17:58:57 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.19:768 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida19 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 28 17:58:57 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.21:966 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida21 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 28 17:58:57 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.17:767 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida17 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 28 18:00:12 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.7:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 28 18:00:38 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.4:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 28 18:00:38 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.3:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 28 18:00:39 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.20:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 28 18:00:39 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.10:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 28 18:00:39 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.15:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 28 18:00:39 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.24:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 28 18:00:39 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.16:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 28 18:00:39 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.1:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 28 18:00:39 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.2:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 28 18:00:39 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.9:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 28 18:00:39 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.6:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 28 18:00:40 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.22:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 28 18:00:40 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.8:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 28 18:00:40 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.12:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 28 18:00:40 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.14:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 28 18:00:40 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.23:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 28 18:00:40 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.21:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 28 18:00:40 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.13:865 for /MIDAS@aidas (/MIDAS@aidas)
Mar 28 18:00:40 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.11:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 28 18:00:40 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.18:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 28 18:00:41 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.19:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 28 18:00:43 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.5:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 28 18:00:44 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.17:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 28 18:04:58 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.13:936 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida13 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 28 18:05:24 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.13:864 for /MIDAS@aidas (/MIDAS@aidas)
Mar 28 18:55:05 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.8:873 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida8 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 28 18:55:05 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.6:1011 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida6 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 28 18:55:05 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.2:846 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida2 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 28 18:55:05 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.1:850 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida1 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 28 18:55:05 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.4:982 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida4 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 28 18:55:06 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.3:948 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida3 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 28 18:55:06 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.7:896 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida7 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 28 18:55:06 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.5:983 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida5 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 28 18:55:06 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.10:874 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida10 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 28 18:55:06 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.12:706 for /data10/XilinxLinux/ppc_4xx/rfs/nnaida12 (/data10/XilinxLinux/ppc_4xx/rfs)
... 185 more lines ...
  409   Sun Oct 30 03:26:55 2016 TDReport - medium - cannot restore layout if currently displaying >16 galleries
Cannot restore layout if currently displaying >16 galleries

Obtain the error message 'loading Spectrum.tcl > can't read "dbtagx(31,1)": no such element in array'
  430   Tue Nov 8 00:12:56 2016 TDReport - medium - TapeServer changes volume name following request for existing filename
When you request a filename that already exists and select OK to the prompt
suggesting a new filename, TapeServer adds an additional character to the 
volume name - see attachment 1
Attachment 1: 9.png
9.png
  528   Tue Dec 6 02:30:35 2016 TDReport - low - significant variation in FEE64 boot times
Not something we were not aware of already but /var/log/messages illustrate the issue.

Dec  6 11:13:02 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.2.8:713 for
/data10/XilinxLinux/ppc_4xx/rfs/nnaida8 (/data10/XilinxLinux/ppc_4xx/rfs)
Dec  6 11:13:02 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.1.6:819 for
/data10/XilinxLinux/ppc_4xx/rfs/nnaida6 (/data10/XilinxLinux/ppc_4xx/rfs)
Dec  6 11:13:02 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.2.4:964 for
/data10/XilinxLinux/ppc_4xx/rfs/nnaida4 (/data10/XilinxLinux/ppc_4xx/rfs)
Dec  6 11:13:02 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.1.18:698 for
/data10/XilinxLinux/ppc_4xx/rfs/nnaida18 (/data10/XilinxLinux/ppc_4xx/rfs)
Dec  6 11:13:02 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.2.7:668 for
/data10/XilinxLinux/ppc_4xx/rfs/nnaida7 (/data10/XilinxLinux/ppc_4xx/rfs)
Dec  6 11:13:02 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.1.5:855 for
/data10/XilinxLinux/ppc_4xx/rfs/nnaida5 (/data10/XilinxLinux/ppc_4xx/rfs)
Dec  6 11:13:02 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.1.17:726 for
/data10/XilinxLinux/ppc_4xx/rfs/nnaida17 (/data10/XilinxLinux/ppc_4xx/rfs)
Dec  6 11:13:03 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.1.10:676 for
/data10/XilinxLinux/ppc_4xx/rfs/nnaida10 (/data10/XilinxLinux/ppc_4xx/rfs)
Dec  6 11:13:03 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.2.16:881 for
/data10/XilinxLinux/ppc_4xx/rfs/nnaida16 (/data10/XilinxLinux/ppc_4xx/rfs)
Dec  6 11:13:03 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.2.12:813 for
/data10/XilinxLinux/ppc_4xx/rfs/nnaida12 (/data10/XilinxLinux/ppc_4xx/rfs)
Dec  6 11:13:03 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.2.11:855 for
/data10/XilinxLinux/ppc_4xx/rfs/nnaida11 (/data10/XilinxLinux/ppc_4xx/rfs)
Dec  6 11:13:03 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.1.14:761 for
/data10/XilinxLinux/ppc_4xx/rfs/nnaida14 (/data10/XilinxLinux/ppc_4xx/rfs)
Dec  6 11:13:03 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.1.9:814 for
/data10/XilinxLinux/ppc_4xx/rfs/nnaida9 (/data10/XilinxLinux/ppc_4xx/rfs)
Dec  6 11:13:03 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.1.13:803 for
/data10/XilinxLinux/ppc_4xx/rfs/nnaida13 (/data10/XilinxLinux/ppc_4xx/rfs)
Dec  6 11:13:03 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.2.15:803 for
/data10/XilinxLinux/ppc_4xx/rfs/nnaida15 (/data10/XilinxLinux/ppc_4xx/rfs)
Dec  6 11:13:06 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.2.19:821 for
/data10/XilinxLinux/ppc_4xx/rfs/nnaida19 (/data10/XilinxLinux/ppc_4xx/rfs)
Dec  6 11:13:07 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.1.22:747 for
/data10/XilinxLinux/ppc_4xx/rfs/nnaida22 (/data10/XilinxLinux/ppc_4xx/rfs)
Dec  6 11:13:07 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.1.1:920 for
/data10/XilinxLinux/ppc_4xx/rfs/nnaida1 (/data10/XilinxLinux/ppc_4xx/rfs)
Dec  6 11:13:07 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.2.23:810 for
/data10/XilinxLinux/ppc_4xx/rfs/nnaida23 (/data10/XilinxLinux/ppc_4xx/rfs)
Dec  6 11:13:07 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.2.20:780 for
/data10/XilinxLinux/ppc_4xx/rfs/nnaida20 (/data10/XilinxLinux/ppc_4xx/rfs)
Dec  6 11:13:07 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.2.24:805 for
/data10/XilinxLinux/ppc_4xx/rfs/nnaida24 (/data10/XilinxLinux/ppc_4xx/rfs)
Dec  6 11:13:07 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.1.21:694 for
/data10/XilinxLinux/ppc_4xx/rfs/nnaida21 (/data10/XilinxLinux/ppc_4xx/rfs)
Dec  6 11:14:57 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.1.14:864 for /MIDAS@aidas
(/MIDAS@aidas)
Dec  6 11:14:57 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.1.10:864 for /MIDAS@aidas
(/MIDAS@aidas)
Dec  6 11:14:57 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.2.8:864 for /MIDAS@aidas
(/MIDAS@aidas)
Dec  6 11:14:57 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.2.4:864 for /MIDAS@aidas
(/MIDAS@aidas)
Dec  6 11:14:57 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.2.7:864 for /MIDAS@aidas
(/MIDAS@aidas)
Dec  6 11:14:58 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.1.13:864 for /MIDAS@aidas
(/MIDAS@aidas)
Dec  6 11:14:58 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.2.12:864 for /MIDAS@aidas
(/MIDAS@aidas)
Dec  6 11:14:58 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.2.16:864 for /MIDAS@aidas
(/MIDAS@aidas)
Dec  6 11:14:58 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.2.15:864 for /MIDAS@aidas
(/MIDAS@aidas)
Dec  6 11:14:59 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.1.9:864 for /MIDAS@aidas
(/MIDAS@aidas)
Dec  6 11:15:00 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.1.1:864 for /MIDAS@aidas
(/MIDAS@aidas)
Dec  6 11:15:00 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.2.20:864 for /MIDAS@aidas
(/MIDAS@aidas)
Dec  6 11:15:00 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.2.23:864 for /MIDAS@aidas
(/MIDAS@aidas)
Dec  6 11:15:00 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.1.6:864 for /MIDAS@aidas
(/MIDAS@aidas)
Dec  6 11:15:00 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.1.18:864 for /MIDAS@aidas
(/MIDAS@aidas)
Dec  6 11:15:00 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.2.24:864 for /MIDAS@aidas
(/MIDAS@aidas)
Dec  6 11:15:00 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.1.22:864 for /MIDAS@aidas
(/MIDAS@aidas)
Dec  6 11:15:00 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.2.11:864 for /MIDAS@aidas
(/MIDAS@aidas)
Dec  6 11:15:00 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.2.19:864 for /MIDAS@aidas
(/MIDAS@aidas)
Dec  6 11:15:01 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.1.5:864 for /MIDAS@aidas
(/MIDAS@aidas)
Dec  6 11:15:01 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.1.21:864 for /MIDAS@aidas
(/MIDAS@aidas)
Dec  6 11:15:03 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.1.17:864 for /MIDAS@aidas
(/MIDAS@aidas)
Dec  6 11:15:58 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.1.2:1018 for
/data10/XilinxLinux/ppc_4xx/rfs/nnaida2 (/data10/XilinxLinux/ppc_4xx/rfs)
Dec  6 11:16:51 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.1.2:864 for /MIDAS@aidas
(/MIDAS@aidas)
Dec  6 11:17:06 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.2.3:785 for
/data10/XilinxLinux/ppc_4xx/rfs/nnaida3 (/data10/XilinxLinux/ppc_4xx/rfs)
Dec  6 11:17:47 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.2.3:864 for /MIDAS@aidas
(/MIDAS@aidas)
Dec  6 11:18:55 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.2.15:893 for
/data10/XilinxLinux/ppc_4xx/rfs/nnaida15 (/data10/XilinxLinux/ppc_4xx/rfs)
Dec  6 11:19:35 aidas1 rpc.mountd[2926]: authenticated mount request from 10.1.2.15:864 for /MIDAS@aidas
(/MIDAS@aidas)
  170   Tue Mar 8 15:32:53 2016 TDReport - low - run control frame issue with multiple streams
The run control frame does not appear to update the data transfer 'X' tag 
for all FEE modules after selecting 'Enable #1 All'
Attachment 1: 7.png
7.png
  797   Mon May 13 10:00:01 2019 TDReport - low - SETUP/Perform Timestamp Resync produces error message
AIDA@RIKEN

Selecting SETUP (Run Control tab) or Perform Timestamp Resync (AIDA Control tab) produces error message - see
attachment 1

Selecting Perform Resync (AIDA Master Timestamp Control) works OK
Attachment 1: 1.png
1.png
  161   Wed Feb 24 13:54:53 2016 TDReport - low - FEE temperature plot displays incorrect dates
See Attachment 1

FEE temperature plot shows data for incorrect dates
Attachment 1: 77.png
77.png
  522   Sun Dec 4 04:05:24 2016 TDReport - low - DAQ SETUP sometimes produces Javascript error
DAQ SETUP sometimes produces Javascript error instead of a pop-up displaying
the status of the ReSync - see attachment 1

Re-run ReSync by selecting 'Perform ReSync' from 'Master Timestamp Control' 
Attachment 1: 10.png
10.png
  364   Fri Sep 30 07:52:56 2016 TDReport - low - AIDA correlation L/M/H statistics count 3x
The AIDA correlation L, M & H statistics count 3x for each correlation trigger,
i.e. counts and rates displayed by statistics are 3x actual counts and rates 
  184   Mon Apr 25 08:58:25 2016 TDReport - high? - aidas1 - Binding NIS service FAILED
During a reboot of aidas1 the message 

Binding NIS service FAILED

was observed during the services startup sequence. Is this an issue?

I can ping/ssh w29.ph.ed.ac.uk (Edinburgh NP group Sun server).

/var/log/messages appended
Attachment 1: messages
Apr 24 04:17:01 aidas1 rsyslogd: [origin software="rsyslogd" swVersion="5.8.10" x-pid="2522" x-info="http://www.rsyslog.com"] rsyslogd was HUPed
Apr 25 12:26:10 aidas1 kernel: sort1[11124] trap divide error ip:4029a5 sp:7fffdd646190 error:0 in sort1[400000+b000]
Apr 25 16:34:04 aidas1 gnome-session[12447]: WARNING: Unable to query client: Client is not registered
Apr 25 16:34:04 aidas1 gnome-session[12447]: WARNING: Unable to query client: Client is not registered
Apr 25 16:34:04 aidas1 gnome-session[12447]: WARNING: Unable to query client: Client is not registered
Apr 25 16:34:04 aidas1 gnome-session[12447]: WARNING: Unable to query client: Client is not registered
Apr 25 16:34:04 aidas1 gnome-session[12447]: WARNING: Unable to stop client: Client is not registered
Apr 25 16:34:04 aidas1 gnome-session[12447]: WARNING: Unable to stop client: Client is not registered
Apr 25 16:34:15 aidas1 init: tty (/dev/tty2) main process (3379) killed by TERM signal
Apr 25 16:34:15 aidas1 init: tty (/dev/tty3) main process (3383) killed by TERM signal
Apr 25 16:34:15 aidas1 init: tty (/dev/tty4) main process (3385) killed by TERM signal
Apr 25 16:34:15 aidas1 init: tty (/dev/tty5) main process (3387) killed by TERM signal
Apr 25 16:34:15 aidas1 init: tty (/dev/tty6) main process (3389) killed by TERM signal
Apr 25 16:34:15 aidas1 kernel: type=1400 audit(1461569655.454:51): avc:  denied  { getattr } for  pid=14167 comm="gdm-session-wor" path="/homes/npg/.dmrc" dev=dm-0 ino=795717 scontext=system_u:system_r:xdm_t:s0-s0:c0.c1023 tcontext=system_u:object_r:default_t:s0 tclass=file
Apr 25 16:34:15 aidas1 kernel: type=1400 audit(1461569655.459:52): avc:  denied  { read } for  pid=14167 comm="gdm-session-wor" name=".dmrc" dev=dm-0 ino=795717 scontext=system_u:system_r:xdm_t:s0-s0:c0.c1023 tcontext=system_u:object_r:default_t:s0 tclass=file
Apr 25 16:34:15 aidas1 kernel: type=1400 audit(1461569655.459:53): avc:  denied  { open } for  pid=14167 comm="gdm-session-wor" name=".dmrc" dev=dm-0 ino=795717 scontext=system_u:system_r:xdm_t:s0-s0:c0.c1023 tcontext=system_u:object_r:default_t:s0 tclass=file
Apr 25 16:34:20 aidas1 kernel: nfsd: last server has exited, flushing export cache
Apr 25 16:34:20 aidas1 rpc.mountd[2959]: Caught signal 15, un-registering and exiting.
Apr 25 16:34:24 aidas1 acpid: exiting
Apr 25 16:34:24 aidas1 ntpd[3040]: ntpd exiting on signal 15
Apr 25 16:34:30 aidas1 NetworkManager[2615]: <info> caught signal 15, shutting down normally.
Apr 25 16:34:30 aidas1 NetworkManager[2615]: <info> (em2): cleaning up...
Apr 25 16:34:30 aidas1 NetworkManager[2615]: <info> (em2): taking down device.
Apr 25 16:34:30 aidas1 NetworkManager[2615]: <info> (p2p1): cleaning up...
Apr 25 16:34:30 aidas1 NetworkManager[2615]: <info> (p2p1): taking down device.
Apr 25 16:34:30 aidas1 NetworkManager[2615]: <info> (p2p2): cleaning up...
Apr 25 16:34:30 aidas1 NetworkManager[2615]: <info> (p2p2): taking down device.
Apr 25 16:34:30 aidas1 NetworkManager[2615]: <info> (p2p3): cleaning up...
Apr 25 16:34:30 aidas1 NetworkManager[2615]: <info> (p2p3): taking down device.
Apr 25 16:34:31 aidas1 NetworkManager[2615]: <info> (p2p4): cleaning up...
Apr 25 16:34:31 aidas1 NetworkManager[2615]: <info> (p2p4): taking down device.
Apr 25 16:34:31 aidas1 NetworkManager[2615]: <info> exiting (success)
Apr 25 16:34:31 aidas1 console-kit-daemon[3544]: WARNING: no sender#012
Apr 25 16:34:31 aidas1 init: Disconnected from system bus
Apr 25 16:34:31 aidas1 rtkit-daemon[3672]: Demoting known real-time threads.
Apr 25 16:34:31 aidas1 rtkit-daemon[3672]: Successfully demoted thread 12486 of process 12486 (/usr/bin/pulseaudio (deleted)).
Apr 25 16:34:31 aidas1 rtkit-daemon[3672]: Demoted 1 threads.
Apr 25 16:34:31 aidas1 rpcbind: rpcbind terminating on signal. Restart with "rpcbind -w"
Apr 25 16:34:31 aidas1 kernel: Kernel logging (proc) stopped.
Apr 25 16:34:31 aidas1 rsyslogd: [origin software="rsyslogd" swVersion="5.8.10" x-pid="2522" x-info="http://www.rsyslog.com"] exiting on signal 15.
Apr 25 16:40:32 aidas1 kernel: imklog 5.8.10, log source = /proc/kmsg started.
Apr 25 16:40:32 aidas1 rsyslogd: [origin software="rsyslogd" swVersion="5.8.10" x-pid="2510" x-info="http://www.rsyslog.com"] start
Apr 25 16:40:32 aidas1 kernel: Initializing cgroup subsys cpuset
Apr 25 16:40:32 aidas1 kernel: Initializing cgroup subsys cpu
Apr 25 16:40:32 aidas1 kernel: Linux version 2.6.32-504.8.1.el6.x86_64 (mockbuild@sl6-kojislave01.fnal.gov) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-11) (GCC) ) #1 SMP Tue Jan 27 13:39:10 CST 2015
Apr 25 16:40:32 aidas1 kernel: Command line: ro root=/dev/mapper/vg_aidas1-lv_root rd_NO_LUKS  KEYBOARDTYPE=pc KEYTABLE=uk LANG=en_US.UTF-8 rd_LVM_LV=vg_aidas1/lv_root rd_NO_MD SYSFONT=latarcyrheb-sun16 rd_LVM_LV=VolGroup00/LogVol01 rd_NO_DM rd_LVM_LV=vg_aidas1/lv_swap rhgb quiet crashkernel=auto
Apr 25 16:40:32 aidas1 kernel: KERNEL supported cpus:
Apr 25 16:40:32 aidas1 kernel:  Intel GenuineIntel
Apr 25 16:40:32 aidas1 kernel:  AMD AuthenticAMD
Apr 25 16:40:32 aidas1 kernel:  Centaur CentaurHauls
Apr 25 16:40:32 aidas1 kernel: BIOS-provided physical RAM map:
Apr 25 16:40:32 aidas1 kernel: BIOS-e820: 0000000000000000 - 00000000000a0000 (usable)
Apr 25 16:40:32 aidas1 kernel: BIOS-e820: 0000000000100000 - 00000000bf699000 (usable)
Apr 25 16:40:32 aidas1 kernel: BIOS-e820: 00000000bf699000 - 00000000bf6af000 (reserved)
Apr 25 16:40:32 aidas1 kernel: BIOS-e820: 00000000bf6af000 - 00000000bf6ce000 (ACPI data)
Apr 25 16:40:32 aidas1 kernel: BIOS-e820: 00000000bf6ce000 - 00000000c0000000 (reserved)
Apr 25 16:40:32 aidas1 kernel: BIOS-e820: 00000000e0000000 - 00000000f0000000 (reserved)
Apr 25 16:40:32 aidas1 kernel: BIOS-e820: 00000000fe000000 - 0000000100000000 (reserved)
Apr 25 16:40:32 aidas1 kernel: BIOS-e820: 0000000100000000 - 0000000240000000 (usable)
Apr 25 16:40:32 aidas1 kernel: DMI 2.6 present.
Apr 25 16:40:32 aidas1 kernel: SMBIOS version 2.6 @ 0xFCB00
Apr 25 16:40:32 aidas1 kernel: last_pfn = 0x240000 max_arch_pfn = 0x400000000
Apr 25 16:40:32 aidas1 kernel: x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106
Apr 25 16:40:32 aidas1 kernel: last_pfn = 0xbf699 max_arch_pfn = 0x400000000
Apr 25 16:40:32 aidas1 kernel: init_memory_mapping: 0000000000000000-00000000bf699000
Apr 25 16:40:32 aidas1 kernel: init_memory_mapping: 0000000100000000-0000000240000000
Apr 25 16:40:32 aidas1 kernel: RAMDISK: 36f41000 - 37fefc54
Apr 25 16:40:32 aidas1 kernel: ACPI: RSDP 00000000000f0e30 00024 (v02 DELL  )
Apr 25 16:40:32 aidas1 kernel: ACPI: XSDT 00000000000f0f34 0009C (v01 DELL   PE_SC3   00000001 DELL 00000001)
Apr 25 16:40:32 aidas1 kernel: ACPI: FACP 00000000bf6c3f9c 000F4 (v03 DELL   PE_SC3   00000001 DELL 00000001)
Apr 25 16:40:32 aidas1 kernel: ACPI: DSDT 00000000bf6af000 03898 (v01 DELL   PE_SC3   00000001 INTL 20050624)
Apr 25 16:40:32 aidas1 kernel: ACPI: FACS 00000000bf6c6000 00040
Apr 25 16:40:32 aidas1 kernel: ACPI: APIC 00000000bf6c3478 0015E (v01 DELL   PE_SC3   00000001 DELL 00000001)
Apr 25 16:40:32 aidas1 kernel: ACPI: SPCR 00000000bf6c35d8 00050 (v01 DELL   PE_SC3   00000001 DELL 00000001)
Apr 25 16:40:32 aidas1 kernel: ACPI: HPET 00000000bf6c362c 00038 (v01 DELL   PE_SC3   00000001 DELL 00000001)
Apr 25 16:40:32 aidas1 kernel: ACPI: DM__ 00000000bf6c3668 001C0 (v01 DELL   PE_SC3   00000001 DELL 00000001)
Apr 25 16:40:32 aidas1 kernel: ACPI: MCFG 00000000bf6c38c4 0003C (v01 DELL   PE_SC3   00000001 DELL 00000001)
Apr 25 16:40:32 aidas1 kernel: ACPI: WD__ 00000000bf6c3904 00134 (v01 DELL   PE_SC3   00000001 DELL 00000001)
Apr 25 16:40:32 aidas1 kernel: ACPI: SLIC 00000000bf6c3a3c 00024 (v01 DELL   PE_SC3   00000001 DELL 00000001)
Apr 25 16:40:32 aidas1 kernel: ACPI: ERST 00000000bf6b2a18 00270 (v01 DELL   PE_SC3   00000001 DELL 00000001)
Apr 25 16:40:32 aidas1 kernel: ACPI: HEST 00000000bf6b2c88 003A8 (v01 DELL   PE_SC3   00000001 DELL 00000001)
Apr 25 16:40:32 aidas1 kernel: ACPI: BERT 00000000bf6b2898 00030 (v01 DELL   PE_SC3   00000001 DELL 00000001)
Apr 25 16:40:32 aidas1 kernel: ACPI: EINJ 00000000bf6b28c8 00150 (v01 DELL   PE_SC3   00000001 DELL 00000001)
Apr 25 16:40:32 aidas1 kernel: ACPI: SRAT 00000000bf6c3bc0 00370 (v01 DELL   PE_SC3   00000001 DELL 00000001)
Apr 25 16:40:32 aidas1 kernel: ACPI: TCPA 00000000bf6c3f34 00064 (v02 DELL   PE_SC3   00000001 DELL 00000001)
Apr 25 16:40:32 aidas1 kernel: ACPI: SSDT 00000000bf6c7000 04604 (v01  INTEL PPM RCM  80000001 INTL 20061109)
Apr 25 16:40:32 aidas1 kernel: Setting APIC routing to flat.
Apr 25 16:40:32 aidas1 kernel: SRAT: PXM 1 -> APIC 16 -> Node 0
Apr 25 16:40:32 aidas1 kernel: SRAT: PXM 2 -> APIC 0 -> Node 1
Apr 25 16:40:32 aidas1 kernel: SRAT: PXM 1 -> APIC 18 -> Node 0
Apr 25 16:40:32 aidas1 kernel: SRAT: PXM 2 -> APIC 2 -> Node 1
Apr 25 16:40:32 aidas1 kernel: SRAT: PXM 1 -> APIC 20 -> Node 0
Apr 25 16:40:32 aidas1 kernel: SRAT: PXM 2 -> APIC 4 -> Node 1
Apr 25 16:40:32 aidas1 kernel: SRAT: PXM 1 -> APIC 22 -> Node 0
Apr 25 16:40:32 aidas1 kernel: SRAT: PXM 2 -> APIC 6 -> Node 1
Apr 25 16:40:32 aidas1 kernel: SRAT: PXM 1 -> APIC 17 -> Node 0
Apr 25 16:40:32 aidas1 kernel: SRAT: PXM 2 -> APIC 1 -> Node 1
Apr 25 16:40:32 aidas1 kernel: SRAT: PXM 1 -> APIC 19 -> Node 0
Apr 25 16:40:32 aidas1 kernel: SRAT: PXM 2 -> APIC 3 -> Node 1
Apr 25 16:40:32 aidas1 kernel: SRAT: PXM 1 -> APIC 21 -> Node 0
Apr 25 16:40:32 aidas1 kernel: SRAT: PXM 2 -> APIC 5 -> Node 1
Apr 25 16:40:32 aidas1 kernel: SRAT: PXM 1 -> APIC 23 -> Node 0
Apr 25 16:40:32 aidas1 kernel: SRAT: PXM 2 -> APIC 7 -> Node 1
Apr 25 16:40:32 aidas1 kernel: SRAT: Node 1 PXM 2 0-c0000000
Apr 25 16:40:32 aidas1 kernel: SRAT: Node 1 PXM 2 100000000-140000000
Apr 25 16:40:32 aidas1 kernel: SRAT: Node 0 PXM 1 140000000-240000000
Apr 25 16:40:32 aidas1 kernel: Bootmem setup node 0 0000000140000000-0000000240000000
Apr 25 16:40:32 aidas1 kernel:  NODE_DATA [0000000140000000 - 0000000140033fff]
Apr 25 16:40:32 aidas1 kernel:  bootmap [0000000140034000 -  0000000140053fff] pages 20
Apr 25 16:40:32 aidas1 kernel: (8 early reservations) ==> bootmem [0140000000 - 0240000000]
Apr 25 16:40:32 aidas1 kernel:  #0 [0000000000 - 0000001000]   BIOS data page
Apr 25 16:40:32 aidas1 kernel:  #1 [0000006000 - 0000008000]       TRAMPOLINE
Apr 25 16:40:32 aidas1 kernel:  #2 [0001000000 - 000202abe4]    TEXT DATA BSS
Apr 25 16:40:32 aidas1 kernel:  #3 [0036f41000 - 0037fefc54]          RAMDISK
Apr 25 16:40:32 aidas1 kernel:  #4 [000009e800 - 0000100000]    BIOS reserved
Apr 25 16:40:32 aidas1 kernel:  #5 [000202b000 - 000202b4a5]              BRK
Apr 25 16:40:32 aidas1 kernel:  #6 [0000008000 - 000000b000]          PGTABLE
Apr 25 16:40:32 aidas1 kernel:  #7 [000000b000 - 0000010000]          PGTABLE
Apr 25 16:40:32 aidas1 kernel: Bootmem setup node 1 0000000000000000-0000000140000000
Apr 25 16:40:32 aidas1 kernel:  NODE_DATA [0000000000010040 - 000000000004403f]
Apr 25 16:40:32 aidas1 kernel:  bootmap [0000000000045000 -  000000000006cfff] pages 28
Apr 25 16:40:32 aidas1 kernel: (8 early reservations) ==> bootmem [0000000000 - 0140000000]
Apr 25 16:40:32 aidas1 kernel:  #0 [0000000000 - 0000001000]   BIOS data page ==> [0000000000 - 0000001000]
Apr 25 16:40:32 aidas1 kernel:  #1 [0000006000 - 0000008000]       TRAMPOLINE ==> [0000006000 - 0000008000]
Apr 25 16:40:32 aidas1 kernel:  #2 [0001000000 - 000202abe4]    TEXT DATA BSS ==> [0001000000 - 000202abe4]
Apr 25 16:40:32 aidas1 kernel:  #3 [0036f41000 - 0037fefc54]          RAMDISK ==> [0036f41000 - 0037fefc54]
Apr 25 16:40:32 aidas1 kernel:  #4 [000009e800 - 0000100000]    BIOS reserved ==> [000009e800 - 0000100000]
Apr 25 16:40:32 aidas1 kernel:  #5 [000202b000 - 000202b4a5]              BRK ==> [000202b000 - 000202b4a5]
Apr 25 16:40:32 aidas1 kernel:  #6 [0000008000 - 000000b000]          PGTABLE ==> [0000008000 - 000000b000]
Apr 25 16:40:32 aidas1 kernel:  #7 [000000b000 - 0000010000]          PGTABLE ==> [000000b000 - 0000010000]
Apr 25 16:40:32 aidas1 kernel: found SMP MP-table at [ffff8800000fe710] fe710
Apr 25 16:40:32 aidas1 kernel: Reserving 129MB of memory at 48MB for crashkernel (System RAM: 9216MB)
Apr 25 16:40:32 aidas1 kernel: Zone PFN ranges:
Apr 25 16:40:32 aidas1 kernel:  DMA      0x00000001 -> 0x00001000
Apr 25 16:40:32 aidas1 kernel:  DMA32    0x00001000 -> 0x00100000
Apr 25 16:40:32 aidas1 kernel:  Normal   0x00100000 -> 0x00240000
Apr 25 16:40:32 aidas1 kernel: Movable zone start PFN for each node
Apr 25 16:40:32 aidas1 kernel: early_node_map[4] active PFN ranges
Apr 25 16:40:32 aidas1 kernel:    1: 0x00000001 -> 0x000000a0
Apr 25 16:40:32 aidas1 kernel:    1: 0x00000100 -> 0x000bf699
Apr 25 16:40:32 aidas1 kernel:    1: 0x00100000 -> 0x00140000
Apr 25 16:40:32 aidas1 kernel:    0: 0x00140000 -> 0x00240000
Apr 25 16:40:32 aidas1 kernel: ACPI: PM-Timer IO Port: 0x808
Apr 25 16:40:32 aidas1 kernel: Setting APIC routing to flat.
Apr 25 16:40:32 aidas1 kernel: ACPI: LAPIC (acpi_id[0x01] lapic_id[0x10] enabled)
Apr 25 16:40:32 aidas1 kernel: ACPI: LAPIC (acpi_id[0x02] lapic_id[0x00] enabled)
Apr 25 16:40:32 aidas1 kernel: ACPI: LAPIC (acpi_id[0x03] lapic_id[0x12] enabled)
Apr 25 16:40:32 aidas1 kernel: ACPI: LAPIC (acpi_id[0x04] lapic_id[0x02] enabled)
Apr 25 16:40:32 aidas1 kernel: ACPI: LAPIC (acpi_id[0x05] lapic_id[0x14] enabled)
Apr 25 16:40:32 aidas1 kernel: ACPI: LAPIC (acpi_id[0x06] lapic_id[0x04] enabled)
Apr 25 16:40:32 aidas1 kernel: ACPI: LAPIC (acpi_id[0x07] lapic_id[0x16] enabled)
Apr 25 16:40:32 aidas1 kernel: ACPI: LAPIC (acpi_id[0x08] lapic_id[0x06] enabled)
Apr 25 16:40:32 aidas1 kernel: ACPI: LAPIC (acpi_id[0x09] lapic_id[0x11] enabled)
Apr 25 16:40:32 aidas1 kernel: ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x01] enabled)
Apr 25 16:40:32 aidas1 kernel: ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x13] enabled)
Apr 25 16:40:32 aidas1 kernel: ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x03] enabled)
Apr 25 16:40:32 aidas1 kernel: ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x15] enabled)
Apr 25 16:40:32 aidas1 kernel: ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x05] enabled)
Apr 25 16:40:32 aidas1 kernel: ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x17] enabled)
Apr 25 16:40:32 aidas1 kernel: ACPI: LAPIC (acpi_id[0x10] lapic_id[0x07] enabled)
Apr 25 16:40:32 aidas1 kernel: ACPI: LAPIC (acpi_id[0x11] lapic_id[0x30] disabled)
Apr 25 16:40:32 aidas1 kernel: ACPI: LAPIC (acpi_id[0x12] lapic_id[0x31] disabled)
Apr 25 16:40:32 aidas1 kernel: ACPI: LAPIC (acpi_id[0x13] lapic_id[0x32] disabled)
Apr 25 16:40:32 aidas1 kernel: ACPI: LAPIC (acpi_id[0x14] lapic_id[0x33] disabled)
Apr 25 16:40:32 aidas1 kernel: ACPI: LAPIC (acpi_id[0x15] lapic_id[0x34] disabled)
Apr 25 16:40:32 aidas1 kernel: ACPI: LAPIC (acpi_id[0x16] lapic_id[0x35] disabled)
Apr 25 16:40:32 aidas1 kernel: ACPI: LAPIC (acpi_id[0x17] lapic_id[0x36] disabled)
Apr 25 16:40:32 aidas1 kernel: ACPI: LAPIC (acpi_id[0x18] lapic_id[0x37] disabled)
Apr 25 16:40:32 aidas1 kernel: ACPI: LAPIC (acpi_id[0x19] lapic_id[0x38] disabled)
Apr 25 16:40:32 aidas1 kernel: ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x39] disabled)
Apr 25 16:40:32 aidas1 kernel: ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x3a] disabled)
Apr 25 16:40:32 aidas1 kernel: ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x3b] disabled)
Apr 25 16:40:32 aidas1 kernel: ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x3c] disabled)
Apr 25 16:40:32 aidas1 kernel: ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x3d] disabled)
Apr 25 16:40:32 aidas1 kernel: ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x3e] disabled)
Apr 25 16:40:32 aidas1 kernel: ACPI: LAPIC (acpi_id[0x20] lapic_id[0x3f] disabled)
Apr 25 16:40:32 aidas1 kernel: ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1])
Apr 25 16:40:32 aidas1 kernel: ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
Apr 25 16:40:32 aidas1 kernel: IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
Apr 25 16:40:32 aidas1 kernel: ACPI: IOAPIC (id[0x01] address[0xfec80000] gsi_base[32])
Apr 25 16:40:32 aidas1 kernel: IOAPIC[1]: apic_id 1, version 32, address 0xfec80000, GSI 32-55
Apr 25 16:40:32 aidas1 kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
Apr 25 16:40:32 aidas1 kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
Apr 25 16:40:32 aidas1 kernel: Using ACPI (MADT) for SMP configuration information
Apr 25 16:40:32 aidas1 kernel: ACPI: HPET id: 0x8086a301 base: 0xfed00000
Apr 25 16:40:32 aidas1 kernel: SMP: Allowing 32 CPUs, 16 hotplug CPUs
Apr 25 16:40:32 aidas1 kernel: PM: Registered nosave memory: 00000000000a0000 - 0000000000100000
Apr 25 16:40:32 aidas1 kernel: PM: Registered nosave memory: 00000000bf699000 - 00000000bf6af000
Apr 25 16:40:32 aidas1 kernel: PM: Registered nosave memory: 00000000bf6af000 - 00000000bf6ce000
Apr 25 16:40:32 aidas1 kernel: PM: Registered nosave memory: 00000000bf6ce000 - 00000000c0000000
Apr 25 16:40:32 aidas1 kernel: PM: Registered nosave memory: 00000000c0000000 - 00000000e0000000
Apr 25 16:40:32 aidas1 kernel: PM: Registered nosave memory: 00000000e0000000 - 00000000f0000000
Apr 25 16:40:32 aidas1 kernel: PM: Registered nosave memory: 00000000f0000000 - 00000000fe000000
Apr 25 16:40:32 aidas1 kernel: PM: Registered nosave memory: 00000000fe000000 - 0000000100000000
Apr 25 16:40:32 aidas1 kernel: Allocating PCI resources starting at c0000000 (gap: c0000000:20000000)
Apr 25 16:40:32 aidas1 kernel: Booting paravirtualized kernel on bare hardware
Apr 25 16:40:32 aidas1 kernel: NR_CPUS:4096 nr_cpumask_bits:32 nr_cpu_ids:32 nr_node_ids:2
Apr 25 16:40:32 aidas1 kernel: PERCPU: Embedded 30 pages/cpu @ffff880028200000 s90968 r8192 d23720 u131072
Apr 25 16:40:32 aidas1 kernel: pcpu-alloc: s90968 r8192 d23720 u131072 alloc=1*2097152
Apr 25 16:40:32 aidas1 kernel: pcpu-alloc: [0] 00 02 04 06 08 10 12 14 16 18 20 22 24 26 28 30 
Apr 25 16:40:32 aidas1 kernel: pcpu-alloc: [1] 01 03 05 07 09 11 13 15 17 19 21 23 25 27 29 31 
Apr 25 16:40:32 aidas1 kernel: Built 2 zonelists in Node order, mobility grouping on.  Total pages: 2062284
Apr 25 16:40:32 aidas1 kernel: Policy zone: Normal
Apr 25 16:40:32 aidas1 kernel: Kernel command line: ro root=/dev/mapper/vg_aidas1-lv_root rd_NO_LUKS  KEYBOARDTYPE=pc KEYTABLE=uk LANG=en_US.UTF-8 rd_LVM_LV=vg_aidas1/lv_root rd_NO_MD SYSFONT=latarcyrheb-sun16 rd_LVM_LV=VolGroup00/LogVol01 rd_NO_DM rd_LVM_LV=vg_aidas1/lv_swap rhgb quiet crashkernel=129M@0M
Apr 25 16:40:32 aidas1 kernel: PID hash table entries: 4096 (order: 3, 32768 bytes)
Apr 25 16:40:32 aidas1 kernel: Checking aperture...
Apr 25 16:40:32 aidas1 kernel: No AGP bridge found
Apr 25 16:40:32 aidas1 kernel: PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
Apr 25 16:40:32 aidas1 kernel: Placing 64MB software IO TLB between ffff880020000000 - ffff880024000000
Apr 25 16:40:32 aidas1 kernel: software IO TLB at phys 0x20000000 - 0x24000000
Apr 25 16:40:32 aidas1 kernel: Memory: 8027428k/9437184k available (5336k kernel code, 1058592k absent, 351164k reserved, 7016k data, 1292k init)
Apr 25 16:40:32 aidas1 kernel: Hierarchical RCU implementation.
Apr 25 16:40:32 aidas1 kernel: NR_IRQS:33024 nr_irqs:1208
Apr 25 16:40:32 aidas1 kernel: Extended CMOS year: 2000
Apr 25 16:40:32 aidas1 kernel: Console: colour VGA+ 80x25
Apr 25 16:40:32 aidas1 kernel: console [tty0] enabled
Apr 25 16:40:32 aidas1 kernel: allocated 33554432 bytes of page_cgroup
Apr 25 16:40:32 aidas1 kernel: please try 'cgroup_disable=memory' option if you don't want memory cgroups
Apr 25 16:40:32 aidas1 kernel: Fast TSC calibration using PIT
Apr 25 16:40:32 aidas1 kernel: Detected 2526.717 MHz processor.
Apr 25 16:40:32 aidas1 kernel: Calibrating delay loop (skipped), value calculated using timer frequency.. 5053.43 BogoMIPS (lpj=2526717)
Apr 25 16:40:32 aidas1 kernel: pid_max: default: 32768 minimum: 301
Apr 25 16:40:32 aidas1 kernel: Security Framework initialized
Apr 25 16:40:32 aidas1 kernel: SELinux:  Initializing.
Apr 25 16:40:32 aidas1 kernel: Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes)
Apr 25 16:40:32 aidas1 kernel: Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes)
Apr 25 16:40:32 aidas1 kernel: Mount-cache hash table entries: 256
Apr 25 16:40:32 aidas1 kernel: Initializing cgroup subsys ns
Apr 25 16:40:32 aidas1 kernel: Initializing cgroup subsys cpuacct
Apr 25 16:40:32 aidas1 kernel: Initializing cgroup subsys memory
Apr 25 16:40:32 aidas1 kernel: Initializing cgroup subsys devices
Apr 25 16:40:32 aidas1 kernel: Initializing cgroup subsys freezer
Apr 25 16:40:32 aidas1 kernel: Initializing cgroup subsys net_cls
Apr 25 16:40:32 aidas1 kernel: Initializing cgroup subsys blkio
Apr 25 16:40:32 aidas1 kernel: Initializing cgroup subsys perf_event
Apr 25 16:40:32 aidas1 kernel: Initializing cgroup subsys net_prio
Apr 25 16:40:32 aidas1 kernel: CPU: Physical Processor ID: 1
Apr 25 16:40:32 aidas1 kernel: CPU: Processor Core ID: 0
Apr 25 16:40:32 aidas1 kernel: mce: CPU supports 9 MCE banks
Apr 25 16:40:32 aidas1 kernel: CPU0: Thermal monitoring enabled (TM1)
Apr 25 16:40:32 aidas1 kernel: using mwait in idle threads.
Apr 25 16:40:32 aidas1 kernel: ACPI: Core revision 20090903
Apr 25 16:40:32 aidas1 kernel: ftrace: converting mcount calls to 0f 1f 44 00 00
Apr 25 16:40:32 aidas1 kernel: ftrace: allocating 21918 entries in 86 pages
Apr 25 16:40:32 aidas1 kernel: APIC routing finalized to physical flat.
Apr 25 16:40:32 aidas1 kernel: ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
Apr 25 16:40:32 aidas1 kernel: CPU0: Intel(R) Xeon(R) CPU           E5540  @ 2.53GHz stepping 05
Apr 25 16:40:32 aidas1 kernel: Performance Events: PEBS fmt1+, 16-deep LBR, Nehalem events, Intel PMU driver.
Apr 25 16:40:32 aidas1 kernel: CPU erratum AAJ80 worked around
Apr 25 16:40:32 aidas1 kernel: CPUID marked event: 'bus cycles' unavailable
Apr 25 16:40:32 aidas1 kernel: ... version:                3
Apr 25 16:40:32 aidas1 kernel: ... bit width:              48
Apr 25 16:40:32 aidas1 kernel: ... generic registers:      4
Apr 25 16:40:32 aidas1 kernel: ... value mask:             0000ffffffffffff
Apr 25 16:40:32 aidas1 kernel: ... max period:             000000007fffffff
Apr 25 16:40:32 aidas1 kernel: ... fixed-purpose events:   3
Apr 25 16:40:32 aidas1 kernel: ... event mask:             000000070000000f
Apr 25 16:40:32 aidas1 kernel: NMI watchdog enabled, takes one hw-pmu counter.
Apr 25 16:40:32 aidas1 kernel: Booting Node   1, Processors  #1 Ok.
Apr 25 16:40:32 aidas1 kernel: Booting Node   0, Processors  #2 Ok.
Apr 25 16:40:32 aidas1 kernel: Booting Node   1, Processors  #3 Ok.
Apr 25 16:40:32 aidas1 kernel: Booting Node   0, Processors  #4 Ok.
Apr 25 16:40:32 aidas1 kernel: Booting Node   1, Processors  #5 Ok.
Apr 25 16:40:32 aidas1 kernel: Booting Node   0, Processors  #6 Ok.
Apr 25 16:40:32 aidas1 kernel: Booting Node   1, Processors  #7 Ok.
Apr 25 16:40:32 aidas1 kernel: Booting Node   0, Processors  #8 Ok.
Apr 25 16:40:32 aidas1 kernel: Booting Node   1, Processors  #9 Ok.
Apr 25 16:40:32 aidas1 kernel: Booting Node   0, Processors  #10 Ok.
Apr 25 16:40:32 aidas1 kernel: Booting Node   1, Processors  #11 Ok.
Apr 25 16:40:32 aidas1 kernel: Booting Node   0, Processors  #12 Ok.
Apr 25 16:40:32 aidas1 kernel: Booting Node   1, Processors  #13 Ok.
Apr 25 16:40:32 aidas1 kernel: Booting Node   0, Processors  #14 Ok.
Apr 25 16:40:32 aidas1 kernel: Booting Node   1, Processors  #15
Apr 25 16:40:32 aidas1 kernel: Brought up 16 CPUs
Apr 25 16:40:32 aidas1 kernel: Total of 16 processors activated (80853.18 BogoMIPS).
Apr 25 16:40:32 aidas1 kernel: devtmpfs: initialized
Apr 25 16:40:32 aidas1 kernel: regulator: core version 0.5
Apr 25 16:40:32 aidas1 kernel: NET: Registered protocol family 16
Apr 25 16:40:32 aidas1 kernel: ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
Apr 25 16:40:32 aidas1 kernel: ACPI: bus type pci registered
Apr 25 16:40:32 aidas1 kernel: PCI: MCFG configuration 0: base e0000000 segment 0 buses 0 - 255
Apr 25 16:40:32 aidas1 kernel: PCI: MCFG area at e0000000 reserved in E820
Apr 25 16:40:32 aidas1 kernel: PCI: Using MMCONFIG at e0000000 - efffffff
Apr 25 16:40:32 aidas1 kernel: PCI: Using configuration type 1 for base access
Apr 25 16:40:32 aidas1 kernel: bio: create slab <bio-0> at 0
Apr 25 16:40:32 aidas1 kernel: ACPI Error (psargs-0359): [CDW1] Namespace lookup failure, AE_NOT_FOUND
Apr 25 16:40:32 aidas1 kernel: ACPI Error (psparse-0537): Method parse/execution failed [\_SB_._OSC] (Node ffff88013ebfb588), AE_NOT_FOUND
Apr 25 16:40:32 aidas1 kernel: ACPI: BIOS _OSI(Linux) query ignored
Apr 25 16:40:32 aidas1 kernel: ACPI: Interpreter enabled
Apr 25 16:40:32 aidas1 kernel: ACPI: (supports S0 S4 S5)
Apr 25 16:40:32 aidas1 kernel: ACPI: Using IOAPIC for interrupt routing
Apr 25 16:40:32 aidas1 kernel: ACPI: No dock devices found.
Apr 25 16:40:32 aidas1 kernel: HEST: Table parsing has been initialized.
Apr 25 16:40:32 aidas1 kernel: PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
Apr 25 16:40:32 aidas1 kernel: ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
Apr 25 16:40:32 aidas1 kernel: pci_root PNP0A08:00: host bridge window [io  0x0000-0x0cf7]
Apr 25 16:40:32 aidas1 kernel: pci_root PNP0A08:00: host bridge window [io  0x0d00-0xffff]
Apr 25 16:40:32 aidas1 kernel: pci_root PNP0A08:00: host bridge window [mem 0x000a0000-0x000bffff]
Apr 25 16:40:32 aidas1 kernel: pci_root PNP0A08:00: host bridge window [mem 0xc0000000-0xfdffffff]
Apr 25 16:40:32 aidas1 kernel: pci_root PNP0A08:00: host bridge window [mem 0xfed40000-0xfed44fff]
... 895 more lines ...
  917   Tue Nov 14 17:08:49 2023 TDReport - high - unable to change ASIC settings directory in Options
Attempting to change the text string specifying the ASIC settings directory ( 2023Nov14-15.25.24 ) in Options produces an error - see attachments 1 & 2

System aida-gsi, anydesk 246 067 683
Attachment 1: Screenshot_from_2023-11-14_18-07-27.png
Screenshot_from_2023-11-14_18-07-27.png
Attachment 2: Screenshot_from_2023-11-14_18-07-56.png
Screenshot_from_2023-11-14_18-07-56.png
  400   Sun Oct 23 10:22:36 2016 TDReport - high - merger SEGV
Merger crashed during operation - see https://elog.ph.ed.ac.uk/AIDA/399
  543   Wed Mar 29 13:02:17 2017 TDReport - high - interaction between DHCP and FEE64 authenticated mount requests
What has happened here?

Power cycle of FEE64s 
24x authenticated mount request c. 20.56

Followed by repeat for nnaida20 following DHCP activity c. 21.00

Mar 29 20:56:44 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.1:864 for /MIDAS@aidas
(/MIDAS@aidas)
Mar 29 20:56:44 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.2:864 for /MIDAS@aidas
(/MIDAS@aidas)
Mar 29 20:56:45 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.7:864 for /MIDAS@aidas
(/MIDAS@aidas)
Mar 29 20:56:45 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.4:864 for /MIDAS@aidas
(/MIDAS@aidas)
Mar 29 20:56:46 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.3:864 for /MIDAS@aidas
(/MIDAS@aidas)
Mar 29 20:56:46 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.5:864 for /MIDAS@aidas
(/MIDAS@aidas)
Mar 29 20:56:46 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.8:864 for /MIDAS@aidas
(/MIDAS@aidas)
Mar 29 20:56:47 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.9:864 for /MIDAS@aidas
(/MIDAS@aidas)
Mar 29 20:56:47 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.10:864 for /MIDAS@aidas
(/MIDAS@aidas)
Mar 29 20:56:47 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.12:864 for /MIDAS@aidas
(/MIDAS@aidas)
Mar 29 20:56:47 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.24:864 for /MIDAS@aidas
(/MIDAS@aidas)
Mar 29 20:56:47 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.13:864 for /MIDAS@aidas
(/MIDAS@aidas)
Mar 29 20:56:47 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.6:864 for /MIDAS@aidas
(/MIDAS@aidas)
Mar 29 20:56:47 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.20:864 for /MIDAS@aidas
(/MIDAS@aidas)
Mar 29 20:56:47 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.14:864 for /MIDAS@aidas
(/MIDAS@aidas)
Mar 29 20:56:48 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.15:864 for /MIDAS@aidas
(/MIDAS@aidas)
Mar 29 20:56:48 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.16:864 for /MIDAS@aidas
(/MIDAS@aidas)
Mar 29 20:56:48 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.22:864 for /MIDAS@aidas
(/MIDAS@aidas)
Mar 29 20:56:48 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.18:864 for /MIDAS@aidas
(/MIDAS@aidas)
Mar 29 20:56:48 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.23:864 for /MIDAS@aidas
(/MIDAS@aidas)
Mar 29 20:56:48 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.11:864 for /MIDAS@aidas
(/MIDAS@aidas)
Mar 29 20:56:49 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.19:864 for /MIDAS@aidas
(/MIDAS@aidas)
Mar 29 20:56:49 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.21:864 for /MIDAS@aidas
(/MIDAS@aidas)
Mar 29 20:56:49 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.1.17:864 for /MIDAS@aidas
(/MIDAS@aidas)


Mar 29 21:00:43 aidas1 dhcpd: DHCPDISCOVER from 00:04:a3:2a:d0:11 via p2p2
Mar 29 21:00:43 aidas1 dhcpd: DHCPOFFER on 10.1.2.20 to 00:04:a3:2a:d0:11 via p2p2
Mar 29 21:00:43 aidas1 dhcpd: DHCPREQUEST for 10.1.2.20 (10.1.2.250) from 00:04:a3:2a:d0:11 via p2p2
Mar 29 21:00:43 aidas1 dhcpd: DHCPACK on 10.1.2.20 to 00:04:a3:2a:d0:11 via p2p2
Mar 29 21:00:43 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.20:686 for
/data10/XilinxLinux/ppc_4xx/rfs/nnaida20 (/data10/XilinxLinux/ppc_4xx/rfs)
Mar 29 21:01:08 aidas1 rpc.mountd[2812]: authenticated mount request from 10.1.2.20:864 for /MIDAS@aidas
(/MIDAS@aidas)
  627   Sat Jun 3 05:32:09 2017 TDReport - high - MBS correlation scaler anomalies
The analysis of files RIBF127R1/R1_1478 to R1_1486 is appended. This sequence of files should
encompass a correlation reset request (from BRIKEN to AIDA)

There appear to be a number of anomalies

1) MBS correlation scalers observed with one missing 16-bit data value (bits 16-31 or bits 0-15)
   across approximately five files (~20 minutes)

2) The first (presumably) MBS correlation scaler following reset corresponds to a time ~300s (25MHz clock)   
Attachment 1: testmbs
 *** TDR format 3.3.0 analyser - TD - June 2017
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  256012767 ( 1010540.5 Hz)
        Other data format:    5075233 (   20033.1 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:        110 (       0.4 Hz)
                               RESUME:        110 (       0.4 Hz)
                              SYNC100:    2318352 (    9151.1 Hz)
                           FEE64 disc:    2687999 (   10610.1 Hz)
                             MBS info:      68662 (     271.0 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:     324989 (    1282.8 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:      253.342 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  1                0.461                0.362
  2                0.432                0.372
  3                0.000                0.000
  4                0.000                0.000
  5                0.033                0.000
  6                0.008                0.000
  7                0.000                0.000
  8                0.000                0.000
  9                0.136                0.000
 10                0.253                0.000
 11                0.000                0.000
 12                0.000                0.000
 13                0.000                0.000
 14                0.015                0.000
 15                0.000                0.000
 16                0.000                0.000
 17                0.296                0.000
 18                0.246                0.000
 19                0.067                0.000
 20                0.002                0.000
 21                0.000                0.000
 22                0.056                0.000
 23                0.016                0.000
 24                0.009                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100       Disc        MBS      Other   HEC Data
  0          0          0          0          0          0          0          0          0          0          0          0
  1   23827409     247824          0          0         10         10      96456     151348          0          0      30101
  2   26893872     229471          0          0          9          9      96470     132983          0          0      25043
  3    7522738     110432          0          0          0          0      96635      13797          0          0        303
  4    1988666     123443          0          0          0          0      96630      26813          0          0       1900
  5   10145804     113870          0          0         12         12      96616      17230          0          0        611
  6   10432440     198603          0          0          3          3      96632      33303      68662          0       3617
  7    2852750     136892          0          0          0          0      96632      40260          0          0       3951
  8    2020571     112427          0          0          0          0      96631      15796          0          0        658
  9   18250698     287605          0          0          6          6      96579     191014          0          0      18403
 10   19491923     198127          0          0          8          8      96529     101582          0          0      10631
 11    3481673     150680          0          0          0          0      96638      54042          0          0       5778
 12    4683871     207871          0          0          0          0      96627     111244          0          0      10878
 13    8398785     199146          0          0          0          0      96634     102512          0          0      11064
 14    9766674     276355          0          0          5          5      96624     179721          0          0      19830
 15    7765995     264175          0          0          0          0      96631     167544          0          0      18705
 16    6473467     185564          0          0          0          0      96631      88933          0          0      11722
 17   12971805     131658          0          0         21         21      96518      35098          0          0       2692
 18   15994110     114475          0          0         11         11      96536      17917          0          0        380
 19   13058754     262312          0          0          5          5      96604     165698          0          0      16447
 20    8418973     358868          0          0          1          1      96626     262240          0          0      20618
 21    8973288     230842          0          0          0          0      96630     134212          0          0      28146
 22   10800388     264565          0          0         13         13      96599     167940          0          0      32543
 23   11464870     371615          0          0          4          4      96618     274989          0          0      26781
 24   10333243     298413          0          0          2          2      96626     201783          0          0      24187
 25          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0

 *** MBS Timewarps
 FEE 
  0          0
  1          0
  2          0
  3          0
  4          0
  5          0
  6          0
  7          0
  8          0
  9          0
 10          0
 11          0
 12          0
 13          0
 14          0
 15          0
 16          0
 17          0
 18          0
 19          0
 20          0
 21          0
 22          0
 23          0
 24          0
 25          0
 26          0
 27          0
 28          0
 29          0
 30          0
 31          0
 32          0

 *** Program elapsed time:   27.859s ( 1148.626 blocks/s,  71.789 Mb/s)
 *** TDR format 3.3.0 analyser - TD - June 2017
 ***     MBS information: block: 11447 ptr:     7 data: 0x86820235 module:  6 information type:  8 information field: 0x00020235 ts: 0x4E0F0BC1AC36 OLD ts: 0x4E0F0BC1AC36 MBS 0x:02350000C70D OLD MBS 0x:0235A8742E87
 *** ERROR: READ I/O error:       5002
                   blocks:      32000
          ADC data format:  255997417 ( 1012682.2 Hz)
        Other data format:    5090583 (   20137.5 Hz)
 Sample trace data format:          0 (       0.0 Hz)
         Undefined format:          0 (       0.0 Hz)
   Other data format type:      PAUSE:         94 (       0.4 Hz)
                               RESUME:         94 (       0.4 Hz)
                              SYNC100:    2313391 (    9151.4 Hz)
                           FEE64 disc:    2709923 (   10720.0 Hz)
                             MBS info:      67081 (     265.4 Hz)
                           Other info:          0 (       0.0 Hz)

   ADC data range bit set:     326876 (    1293.1 Hz)

                Timewarps:        ADC:          0 (       0.0 Hz)
                                PAUSE:          0 (       0.0 Hz)
                               RESUME:          0 (       0.0 Hz)
                              SYNC100:          0 (       0.0 Hz)
                           FEE64 disc:          0 (       0.0 Hz)
                             MBS info:          0 (       0.0 Hz)
                            Undefined:          0 (       0.0 Hz)
                         Sample trace:          0 (       0.0 Hz)

 *** Timestamp elapsed time:      252.791 s
 FEE  elapsed dead time(s) elapsed idle time(s)
  1                0.455                0.359
  2                0.391                0.412
  3                0.000                0.000
  4                0.000                0.000
  5                0.054                0.000
  6                0.023                0.000
  7                0.000                0.000
  8                0.000                0.000
  9                0.211                0.000
 10                0.194                0.000
 11                0.000                0.000
 12                0.000                0.000
 13                0.000                0.000
 14                0.006                0.000
 15                0.000                0.000
 16                0.000                0.000
 17                0.137                0.000
 18                0.267                0.000
 19                0.083                0.000
 20                0.000                0.000
 21                0.000                0.000
 22                0.014                0.000
 23                0.037                0.000
 24                0.000                0.000
 25                0.000                0.000
 26                0.000                0.000
 27                0.000                0.000
 28                0.000                0.000
 29                0.000                0.000
 30                0.000                0.000
 31                0.000                0.000
 32                0.000                0.000

 *** Statistics
 FEE  ADC Data Other Data     Sample  Undefined      Pause     Resume    SYNC100       Disc        MBS      Other   HEC Data
  0          0          0          0          0          0          0          0          0          0          0          0
  1   24008443     246196          0          0         10         10      96248     149928          0          0      30120
  2   26817429     228137          0          0          7          7      96274     131849          0          0      24967
  3    7517127     110911          0          0          0          0      96416      14495          0          0        336
  4    1995261     124381          0          0          0          0      96412      27969          0          0       1965
  5   10113618     113727          0          0         16         16      96404      17291          0          0        537
  6   10410564     196957          0          0          7          7      96415      33447      67081          0       3669
  7    2856194     137197          0          0          0          0      96420      40777          0          0       3972
  8    2020874     112152          0          0          0          0      96424      15728          0          0        602
  9   18191334     287338          0          0          8          8      96342     190980          0          0      18425
 10   19480773     198683          0          0          6          6      96345     102326          0          0      10658
 11    3478267     151699          0          0          0          0      96419      55280          0          0       5816
 12    4677362     208197          0          0          0          0      96421     111776          0          0      10974
 13    8391268     200686          0          0          0          0      96414     104272          0          0      11023
 14    9748802     276070          0          0          2          2      96421     179645          0          0      19842
 15    7766350     264024          0          0          0          0      96424     167600          0          0      18801
 16    6478103     183766          0          0          0          0      96423      87343          0          0      11626
 17   12985052     132045          0          0         10         10      96376      35649          0          0       2722
 18   15979427     114951          0          0         12         12      96325      18602          0          0        424
 19   13078506     265556          0          0          6          6      96388     169156          0          0      16862
 20    8445348     367486          0          0          1          1      96418     271066          0          0      21088
 21    8954022     232729          0          0          0          0      96417     136312          0          0      28668
 22   10748429     265512          0          0          3          3      96415     169091          0          0      33182
 23   11499670     374227          0          0          6          6      96406     277809          0          0      26600
 24   10355194     297956          0          0          0          0      96424     201532          0          0      23997
 25          0          0          0          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0          0          0          0
 32          0          0          0          0          0          0          0          0          0          0          0

 *** Timewarps
 FEE       ADC      Pause     Resume    SYNC100       Disc        MBS  Undefined    Samples
  0          0          0          0          0          0          0          0          0
  1          0          0          0          0          0          0          0          0
  2          0          0          0          0          0          0          0          0
  3          0          0          0          0          0          0          0          0
  4          0          0          0          0          0          0          0          0
  5          0          0          0          0          0          0          0          0
  6          0          0          0          0          0          0          0          0
  7          0          0          0          0          0          0          0          0
  8          0          0          0          0          0          0          0          0
  9          0          0          0          0          0          0          0          0
 10          0          0          0          0          0          0          0          0
 11          0          0          0          0          0          0          0          0
 12          0          0          0          0          0          0          0          0
 13          0          0          0          0          0          0          0          0
 14          0          0          0          0          0          0          0          0
 15          0          0          0          0          0          0          0          0
 16          0          0          0          0          0          0          0          0
 17          0          0          0          0          0          0          0          0
 18          0          0          0          0          0          0          0          0
 19          0          0          0          0          0          0          0          0
 20          0          0          0          0          0          0          0          0
 21          0          0          0          0          0          0          0          0
 22          0          0          0          0          0          0          0          0
 23          0          0          0          0          0          0          0          0
 24          0          0          0          0          0          0          0          0
 25          0          0          0          0          0          0          0          0
 26          0          0          0          0          0          0          0          0
 27          0          0          0          0          0          0          0          0
 28          0          0          0          0          0          0          0          0
 29          0          0          0          0          0          0          0          0
 30          0          0          0          0          0          0          0          0
 31          0          0          0          0          0          0          0          0
... 1236 more lines ...
  169   Tue Mar 8 15:09:49 2016 TDReport - high - LEC/MEC fast comparator issues
Fast comparator rate spectra and statistics do not appear to working as expected. See enclosed screenshots.
Have the hit/rate spectra and statistics been updated to reflect the firmware version 8 data format?
Attachment 1: 1.png
1.png
Attachment 2: 2.png
2.png
Attachment 3: 3.png
3.png
Attachment 4: 4.png
4.png
Attachment 5: 5.png
5.png
Attachment 6: 6.png
6.png
  175   Wed Mar 9 17:31:58 2016 TDReport - high - LEC/MEC fast comparator issues
> 
> Fast comparator rate spectra and statistics do not appear to working as expected. See enclosed screenshots.
> Have the hit/rate spectra and statistics been updated to reflect the firmware version 8 data format?

I have done a simple test using the system in T9.
Detector on.
Acquisition only ... no Merge
Set pulser attenuation to 2X instead of 10X.

Set Fast Comparator threshold to 50 to be well out of the detector noise.

See attached rate spectrum which shows system operating as I think it should.
Attachment 1: Discriminator_Thresh_50
  172   Tue Mar 8 16:29:07 2016 TDReport - high - AIDA timestamps
Version 8 firmware

Analysing R37_* data files (see https://elog.ph.ed.ac.uk/AIDA/160)

Usinmg MIDASsort, I generate a spectrum showing the time difference (10ns clock cycles)
between sequential ADC data items. There is an offset of 1000.

I observe peaks at 1000, 1200, 1400 etc - as expected

I also observe peaks at +/-10 clock cycles relative to these main peaks - not expected

I also observe some discrete intermediate peaks - not expected 
Attachment 1: 8.png
8.png
  176   Thu Mar 10 16:35:39 2016 TD : PJCSReport - high - AIDA timestamps
> Version 8 firmware
> 
> Analysing R37_* data files (see https://elog.ph.ed.ac.uk/AIDA/160)
> 
> Usinmg MIDASsort, I generate a spectrum showing the time difference (10ns clock cycles)
> between sequential ADC data items. There is an offset of 1000.
> 
> I observe peaks at 1000, 1200, 1400 etc - as expected
> 
> I also observe peaks at +/-10 clock cycles relative to these main peaks - not expected
> 
> I also observe some discrete intermediate peaks - not expected 

I have investigated this timing using a sort program and R37_0.

If I only work with data from one module there is no problem. Peaks in the time difference spectrum are the
expected 200 apart.

If I then include a second module's ADC data the time difference spectrum starts to look as the one  Tom attached
but with a fixed 45 ticks offset from the '200' peaks.

I conclude the spectra appearance is due to the 500KHz ASIC readout clocks not being synchronized between the
different FEE64 modules.
Attachment 1: Time_Difference_FEE13to14.png
Time_Difference_FEE13to14.png
ELOG V3.1.3-7933898