AIDA GELINA BRIKEN nToF CRIB ISOLDE CIRCE nTOFCapture DESPEC DTAS EDI_PSA 179Ta CARME StellarModelling DCF K40
  AIDA, Page 32 of 46  ELOG logo
ID Date Author Subject
  299   Fri Jun 10 02:25:45 2016 TD, ML & YSDAQ State of Play - Friday 10 June 2016
10.25 Screenshots showing DAQ state of play during NP1512
  298   Wed Jun 8 20:56:28 2016 CGThurs 9th June
04.45 Lowered slow comp threshold on all FEEs bar nnaida24 to 8 (nnaida24 @ 12).
      Fast comp thresh @ 6 on all nnaida.
      See CPU load and MIDASsort in attachments 1+2.

11.20 Directory /MIDAS/SpecData moved to /ntfs/TapeData/NP1306/ (Edinburgh Seagate USB 8Tb disk Z840DXMA)
      to create disk space on root filesystem (100% usage, 134M remaining space) 

11.36 Saved current *.L spectra to /MIDAS/SpecData
 
11.40 Detector biases & leakage currents - OK - see attachments 3-4
      FEE64 temperatures - see attachment 5

12.15 Julabo FL11006 set point +15 deg C (B2F/F11 temp +25.5 deg C, d.p. +12.9 deg C , RH 45.4% )
      changed set point from +15 to +17 deg C

13.18 FEE64 temperatures - see attachment 6
  297   Wed Jun 8 09:29:55 2016 TDDAQ state of play
17.25 State of play

      Running data to disk (uncompressed)

      link #18 (nnaida19 disabled)

      ~1.3m data items/s
      ~10.5Mb/s

      merge64.AD ~30% CPU
      driver ~4% CPU
      link64 <1% CPU

      nnaida19 ~20Hz PAUSE, increase LEC/MEC fast comparator from 0x5 to 0x20 -> PAUSE ~0Hz
  296   Wed Jun 8 05:00:53 2016 TDAnalysis of R1229
Files R1229_0 ... R1229_3 (written by TapeServer without data compression)

Timestamp data per FEE per 10s (i.e. 1 ch = 10s)

s3501-s3524 ADC data
s3601-s3624 PAUSE
s3701-s3724 RESUME
s3801-s3824 SYNC
  295   Wed Jun 8 04:24:04 2016 TDaidas1 disk statistics (without data compression)
aidas1> iostat -xn
Linux 2.6.32-504.8.1.el6.x86_64 (aidas1) 	06/08/2016 	_x86_64_	(16 CPU)

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await  svctm  %util
sda               0.03     0.00    0.01    0.00     0.10     0.00     8.53     0.00    1.37   0.96   0.00
sdc               0.01     0.00    0.01    1.46     0.04     0.00     0.03     0.00    0.38   0.31   0.05
sdg               0.02     0.00    1.16    1.46   280.02     0.01   106.79     0.00    1.05   0.74   0.20
sdf               0.23   496.52    6.59    7.52  1630.98  4020.60   400.58     0.72   50.70   3.81   5.38
sdd               0.20     3.48    0.05    0.09     1.50    28.52   217.54     0.00    6.63   3.64   0.05
sdb               1.39    35.64    2.06    3.35   171.52   310.29    89.17     0.13   24.09   2.59   1.40
sde               0.01     3.89    3.13    4.56    56.50    56.00    14.63     0.27   35.22   3.91   3.01
dm-0              0.00     0.00    3.45   38.79   171.28   310.29    11.40    11.07  261.99   0.33   1.40
dm-1              0.00     0.00    0.01    0.00     0.05     0.00     8.00     0.00    3.24   1.03   0.00
dm-2              0.00     0.00    0.17    3.57     1.39    28.52     8.00     0.04   11.44   0.13   0.05
dm-3              0.00     0.00    0.00    0.00     0.01     0.00     8.00     0.00    1.05   1.05   0.00
dm-4              0.00     0.00   11.11  510.60  1967.40  4076.62    11.59    60.80  116.54   0.16   8.35
dm-5              0.00     0.00    0.01    0.00     0.07     0.00     7.96     0.00    3.64   0.68   0.00

Filesystem:              rBlk_nor/s   wBlk_nor/s   rBlk_dir/s   wBlk_dir/s   rBlk_svr/s   wBlk_svr/s     ops/s 
  rops/s    wops/s

aidas1> iostat -x
Linux 2.6.32-504.8.1.el6.x86_64 (aidas1) 	06/08/2016 	_x86_64_	(16 CPU)

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          17.42    3.35    1.10    0.72    0.00   77.41

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await  svctm  %util
sda               0.03     0.00    0.01    0.00     0.10     0.00     8.53     0.00    1.37   0.96   0.00
sdc               0.01     0.00    0.01    1.46     0.04     0.00     0.03     0.00    0.38   0.31   0.05
sdg               0.02     0.00    1.16    1.46   279.98     0.01   106.78     0.00    1.05   0.74   0.20
sdf               0.23   496.63    6.62    7.52  1636.72  4021.54   400.39     0.72   50.64   3.81   5.39
sdd               0.20     3.48    0.05    0.09     1.50    28.52   217.54     0.00    6.63   3.64   0.05
sdb               1.39    35.64    2.06    3.35   171.49   310.28    89.16     0.13   24.09   2.59   1.40
sde               0.01     3.89    3.13    4.56    56.49    56.00    14.63     0.27   35.22   3.91   3.01
dm-0              0.00     0.00    3.45   38.78   171.26   310.28    11.40    11.06  261.97   0.33   1.40
dm-1              0.00     0.00    0.01    0.00     0.05     0.00     8.00     0.00    3.24   1.03   0.00
dm-2              0.00     0.00    0.17    3.56     1.39    28.52     8.00     0.04   11.44   0.13   0.05
dm-3              0.00     0.00    0.00    0.00     0.01     0.00     8.00     0.00    1.05   1.05   0.00
dm-4              0.00     0.00   11.13  510.72  1973.09  4077.56    11.59    60.83  116.57   0.16   8.36
dm-5              0.00     0.00    0.01    0.00     0.07     0.00     7.96     0.00    3.64   0.68   0.00
  294   Wed Jun 8 03:57:59 2016 TDAnalysis of R1222
Timestamp data per FEE per 10s (i.e. 1 ch = 10s)

s3501-s3524 ADC data
s3601-s3624 PAUSE
s3701-s3724 RESUME
s3801-s3824 SYNC

Little evidence of data loss or high dead time
  293   Wed Jun 8 03:46:51 2016 TD & MLTapeServer compression disabled
CHnaged TapeServer configuration file to disable data compression

tapeserver options 6 -> tapeserver options 4

See http://npg.dl.ac.uk/MIDAS/download/tapeserver.html

aidas1> cat /MIDAS/TapeServer/Linux64/TS_configuration
#device configuration information
#    any line starting with a # is a comment and is ignored
stats  ./stats
#    devices available   -   list ends with a null line or line starting with a &
#    format       class_name     device_name    driver_task_path_name
#       class_name MUST be one of dlt, exabyte, scsitape, sink
#       driver_task_path_name normally is omitted
#dlt           /dev/nst0    ./driver
file          /dev/file/0  ./driver
sink          /dev/null/0  ./driver
&
#data link configuration information  - list end with a null line
#    format   link_task_path_name  
./linkTCP
&
#program options - list end with a null line
msg_reporting_level 0x0180fff8
#   use 0x0080fff8 to enable msg logging
msg_logging_level 0xfff8
tapeserver_options 4
#   use 0x0080fff8 to enable msg logging
#    default for following is 16Kbytes - both MUST be the same at present
data_buffer_size 64
tape_block_size 64
disc_file_size 2000
#
file_path_base /TapeData
&
#end of information

Merger ~600k items/s, TapeServer ~4500kb/s, driver process CPU ~1.3%

Tasks: 519 total,   2 running, 512 sleeping,   3 stopped,   2 zombie
Cpu(s):  0.5%us,  0.5%sy,  7.1%ni, 91.9%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Mem:   8048160k total,  7877128k used,   171032k free,    54624k buffers
Swap: 18415608k total,   124036k used, 18291572k free,  6509416k cached

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND            
22565 npg       30  10  327m  13m  12m R 100.0  0.2 115:05.32 sort2b            
 6055 npg       22   2 2117m 718m 635m S 13.9  9.1   1:03.67 merge64.AD         
 4398 npg       20   0 1523m 317m  31m S  5.0  4.0  78:36.04 firefox            
 3795 root      20   0  248m  92m 8272 S  4.0  1.2  98:58.94 Xorg               
 4655 npg       20   0  402m  20m 8964 S  2.6  0.3  19:33.57 gnome-terminal     
 6091 npg       20   0 19676 1284 1100 S  1.3  0.0   0:07.01 driver             
 6088 npg       20   0 21592 6740 6544 S  0.7  0.1   0:03.07 master             
 6093 npg       20   0 17880 1260 1028 S  0.7  0.0   0:03.12 linkTCP            
 6486 npg       20   0 15304 1576  924 R  0.7  0.0   0:02.66 top                
18761 npg       20   0 15304 1572  916 S  0.7  0.0   1:29.13 top                
   69 root      20   0     0    0    0 S  0.3  0.0   0:35.68 events/2           
 3270 root      20   0     0    0    0 S  0.3  0.0   0:10.29 nfsd               
 4124 npg       20   0 1080m  33m  13m S  0.3  0.4   3:03.69 nautilus           
 5994 npg       20   0 2021m  49m  49m S  0.3  0.6   0:01.46 link64             
 5997 npg       20   0 2021m  49m  49m S  0.3  0.6   0:01.61 link64             
 5998 npg       20   0 2021m  49m  49m S  0.3  0.6   0:02.41 link64             
 6003 npg       20   0 2021m  49m  49m S  0.3  0.6   0:00.30 link64  
  292   Wed Jun 8 02:31:20 2016 TDaidas1 disk statistics
DAQ running to disk at relatively low rate (merger ~600k item/s, tapeserver ~4700kb/s)

Do these disk statistics look OK

aidas1> iostat -x
Linux 2.6.32-504.8.1.el6.x86_64 (aidas1) 	06/08/2016 	_x86_64_	(16 CPU)

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          19.56    3.00    1.15    0.74    0.00   75.55

Device:         rrqm/s   wrqm/s     r/s     w/s   rsec/s   wsec/s avgrq-sz avgqu-sz   await  svctm  %util
sda               0.04     0.00    0.01    0.00     0.11     0.00     8.53     0.00    1.37   0.96   0.00
sdc               0.01     0.00    0.01    1.58     0.05     0.00     0.03     0.00    0.38   0.31   0.05
sdg               0.02     0.00    0.18    1.58    42.62     0.01    24.21     0.00    0.59   0.41   0.07
sdf               0.05   507.94    2.16    7.81   516.00  4113.00   464.34     0.69   69.54   4.77   4.76
sdd               0.19     3.95    0.05    0.10     1.36    32.36   225.17     0.00    6.63   3.57   0.05
sdb               1.40    38.38    2.17    3.35   185.34   332.20    93.75     0.14   26.19   2.60   1.44
sde               0.01     4.25    3.54    4.94    64.06    60.96    14.74     0.30   35.48   3.90   3.30
dm-0              0.00     0.00    3.56   41.53   185.07   332.20    11.47    12.54  278.00   0.32   1.44
dm-1              0.00     0.00    0.01    0.00     0.05     0.00     8.00     0.00    3.24   1.03   0.00
dm-2              0.00     0.00    0.15    4.05     1.23    32.36     8.00     0.05   11.49   0.12   0.05
dm-3              0.00     0.00    0.00    0.00     0.02     0.00     8.00     0.00    1.05   1.05   0.00
dm-4              0.00     0.00    5.92  522.90   622.57  4174.35     9.07    59.55  112.60   0.15   7.94
dm-5              0.00     0.00    0.01    0.00     0.07     0.00     7.95     0.00    3.11   0.69   0.00

aidas1> iostat
Linux 2.6.32-504.8.1.el6.x86_64 (aidas1) 	06/08/2016 	_x86_64_	(16 CPU)

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
          19.55    3.00    1.15    0.74    0.00   75.57

Device:            tps   Blk_read/s   Blk_wrtn/s   Blk_read   Blk_wrtn
sda               0.01         0.11         0.00       5682          0
sdc               1.58         0.05         0.00       2312        112
sdg               1.76        42.56         0.01    2170822        648
sdf               9.98       519.68      4114.55   26505990  209861264
sdd               0.15         1.38        32.32      70150    1648496
sdb               5.52       185.27       331.95    9449724   16931146
sde               8.47        63.97        60.90    3263022    3106264
dm-0             45.06       185.01       331.95    9436314   16931104
dm-1              0.01         0.05         0.00       2696          0
dm-2              4.20         1.24        32.32      63432    1648496
dm-3              0.00         0.02         0.00        864          0
dm-4            528.96       626.10      4175.46   31934274  212968288
dm-5              0.01         0.07         0.00       3778         24
  291   Tue Jun 7 19:19:34 2016 CG, TD, DK, AEWednesday 8th June

(4 mm Al mask was put upstream of AIDA near 20:20 on 7 June)

 

01.15 Run R1219 started on neutron rich setting.

            Temps ok. Leakage currents ok.

             Plate with holes in front of AIDA , after F11 plastic. F11 plastic count rate ~700cps.

             Keeps getting 'Attempting resychronisation' message in merger terminal window.

             driver 0 10205 consuming almost 100% of CPU. Merger ~20% and data links ~1%

              See attachments 1-4

 

02.15 Run R1220 n-rich setting (BigRIPS run 1218, EURICA off)

          EURICA team retires for the night and cannot get it up and running

          Biases and leak shown as attachments 5-6

          Merger info is shown in attachments 7-9

          CPU Load in attachment 10

          Timestamps against the ADCs and also SYNCS, respectively, attachments 11 and 12

          3:31: Run stopped for the operator to tune the beam

          F11 plastic rate was 700 cps (~heavy ion injection rate)

 

3:43 Run R1221 n-rich setting (BigRIPS 1219, no EURICA)

          4 mm Al mask was removed.

          Pause calls vs. Timestamp is attachment 13

          Merger screenshots are shown as attachments 14-16

          F11 plastic rate is 850 or 900 cps after retune

          ADC v Timestamp is shown as attachment 17.  It can be seen the rate was roughly constant before the operators stopped (corresponding to a long gap of no hits, but now  we go up and down quite a lot in a rather ugly way

          CPU stats (driver to write to HDD in green, merger in red) as attachment 18

          At the time of ~90 in attachment 18, the linkers start to consume all available CPU resources, shown as attachment 19

 

04:35 Run R1222 n-rich setting (BigRIPS 1219 / 1220)

          Ask the operators to reduce the beam intensity by "1/2" -> F11 plastic rate goes from 850 cps to 170 cps, so more like 1/4 effectively

          Merger stats are shown as attachments 20, 21, 22. 

          nnaida1 and nnaida24 seemed to often show pauses (among other ones)

          trying to understand what's going on with the display in Midas, because it has looped around to time zero and is putting new data on to the old data...?

         It seems this condition is much better than before, though

         05:33 stop the run

 

05:38 R R1223 n-rich setting (BigRIPS 1221)

           Ask the operators to resume the previous beam intensity.  (Now like 600 to 800 cps at the F11 plastic)

           attachment 23 shows the beam coming on near time zero.  within <100 seconds, the driver has to fight with many link64 instances and cannot operate correctly

           we understood how to clear the midas histograms so that we can make sense of things.  attachment 24 is ADC, and attachment 25 is pause. 

           you can see some data come smoothly until the system locks down

06.11 R1223 stopped.

 

06.30 Started run R1224.

            Moved Pb bricks downstream of F11 plastic inwards, from a separation of 15cm, to 4cm in an effort to reduce rate in AIDA.

            F11 plastic rate ~900cps.

            No change to vis scalar rates and data still being dropped.

06.45 Stopped run R1224.

            MIDAS plot of ADC vs Timestamp (attachment 26) shows characteristic behaviour.

            Upon writing to disk, for the first minute or so link64 processes consume minimal CPU power. But then very quickly they ramp up consumption and ultimately choke the merger (it seems).

            This is reflected in the ADC v TS plot. Continuous ADC data for first ~1min.

 

06.54 Moved Pb bricks to separation of 2cm. Started run R1225.

            AIDA vis scalar rates reduced slightly, but no change to CPU usage and usual happens - data lost, link64 CPU usage spikes and chokes merger (seemingly).

            F11 plastic rate ~900cps.

07.00 Run R1225 stopped.

           SYNCs stopped being produced. Lost contact with nnaida1.

 

07.25 Pb bricks moved to 1cm apart. Run R1226 started.

            No change to CPU usage (link64 still hogging everything). MIDAS online monitor lost in power cycle so cant view in real-time, but anticipate same outcome.

            Sopped producing SYNCs 07.39. Run 1226 stopped.

 

08.20 Some trouble restarting DAQ and merger.

            As nnaida19 has lost the 'H' for histogramming on the run control page, nnaida21 has now lost the 'X' for data transfer (see attachment 27).

           Removed nnaida21 from merger and normal state of play resumed.

           4mm holey plate + the one attached to it we installed dowstream of F11 plastic.

 

08.50 Run R1227 started.

           CPU usage by link64 ~1% and driver ~70%, much more reasonable. When reloading merger web page, channels flash between bright green and olive. Good.

09.09 Changed to reference mass setting. Run R1227 stopped.

 

09.12 Run R1228 started on reference setting with holey plate still in place.

           R1228 stopped 10.32 (for B2F/F11 entry)

 

  290   Tue Jun 7 10:59:20 2016 TDmerge stats
Let me which merge stats for all data links would be most useful and I will upload screenshots. 
  289   Tue Jun 7 10:36:14 2016 TDnnaida19
aidas1> cat var/log/dmesg
Using Xilinx Virtex440 machine description
Linux version 2.6.31 (nf@nnlxb.dl.ac.uk) (gcc version 4.2.2) #34 PREEMPT Tue Nov 15 15:57:04 GMT 2011
Top of RAM: 0x7000000, Total RAM: 0x7000000
Memory hole size: 0MB
Zone PFN ranges:
  DMA      0x00000000 -> 0x00007000
  Normal   0x00007000 -> 0x00007000
Movable zone start PFN for each node
early_node_map[1] active PFN ranges
    0: 0x00000000 -> 0x00007000
On node 0 totalpages: 28672
free_area_init_node: node 0, pgdat c038c384, node_mem_map c03b8000
  DMA zone: 224 pages used for memmap
  DMA zone: 0 pages reserved
  DMA zone: 28448 pages, LIFO batch:7
MMU: Allocated 1088 bytes of context maps for 255 contexts
Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 28448
Kernel command line: console=ttyS0 root=/dev/nfs ip=on rw mem=112M
PID hash table entries: 512 (order: 9, 2048 bytes)
Dentry cache hash table entries: 16384 (order: 4, 65536 bytes)
Inode-cache hash table entries: 8192 (order: 3, 32768 bytes)
Memory: 109680k/114688k available (3500k kernel code, 4852k reserved, 144k data, 130k bss, 168k init)
Kernel virtual memory layout:
  * 0xffffe000..0xfffff000  : fixmap
  * 0xfde00000..0xfe000000  : consistent mem
  * 0xfde00000..0xfde00000  : early ioremap
  * 0xd1000000..0xfde00000  : vmalloc & ioremap
NR_IRQS:512
time_init: decrementer frequency = 400.000000 MHz
time_init: processor frequency   = 400.000000 MHz
clocksource: timebase mult[a00000] shift[22] registered
clockevent: decrementer mult[66666666] shift[32] cpu[0]
Console: colour dummy device 80x25
Mount-cache hash table entries: 512
NET: Registered protocol family 16
PCI: Probing PCI hardware
bio: create slab <bio-0> at 0
NET: Registered protocol family 2
IP route cache hash table entries: 1024 (order: 0, 4096 bytes)
TCP established hash table entries: 4096 (order: 3, 32768 bytes)
TCP bind hash table entries: 4096 (order: 2, 16384 bytes)
TCP: Hash tables configured (established 4096 bind 4096)
TCP reno registered
NET: Registered protocol family 1
ROMFS MTD (C) 2007 Red Hat, Inc.
msgmni has been set to 214
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered
io scheduler cfq registered (default)
Serial: 8250/16550 driver, 4 ports, IRQ sharing disabled
irq: irq 2 on host /plb@0/interrupt-controller@81800000 mapped to virtual irq 16
83e00000.serial: ttyS0 at MMIO 0x83e01003 (irq = 16) is a 16550
console [ttyS0] enabled
brd: module loaded
loop: module loaded
Device Tree Probing 'ethernet'
irq: irq 1 on host /plb@0/interrupt-controller@81800000 mapped to virtual irq 17
irq: irq 3 on host /plb@0/interrupt-controller@81800000 mapped to virtual irq 18
irq: irq 4 on host /plb@0/interrupt-controller@81800000 mapped to virtual irq 19
xilinx_lltemac 81c00000.ethernet: MAC address is now  0: 4:a3:2a:ed:9a
xilinx_lltemac 81c00000.ethernet: XLlTemac: using DMA mode.
XLlTemac: DCR address: 0x80
XLlTemac: buffer descriptor size: 32768 (0x8000)
XLlTemac: Allocating DMA descriptors with kmalloc
XLlTemac: (buffer_descriptor_init) phy: 0x6938000, virt: 0xc6938000, size: 0x8000
XTemac: PHY detected at address 7.
xilinx_lltemac 81c00000.ethernet: eth0: Xilinx TEMAC at 0x81C00000 mapped to 0xD1024000, irq=17
fc000000.flash: Found 1 x16 devices at 0x0 in 16-bit bank
 Intel/Sharp Extended Query Table at 0x010A
 Intel/Sharp Extended Query Table at 0x010A
 Intel/Sharp Extended Query Table at 0x010A
 Intel/Sharp Extended Query Table at 0x010A
 Intel/Sharp Extended Query Table at 0x010A
 Intel/Sharp Extended Query Table at 0x010A
Using buffer write method
cfi_cmdset_0001: Erase suspend on write enabled
erase region 0: offset=0x0,size=0x20000,blocks=127
erase region 1: offset=0xfe0000,size=0x8000,blocks=4
fc000000.flash: 1 set(s) of 1 interleaved chips --> 16 partitions of 1024 KiB
cmdlinepart partition parsing not available
RedBoot partition parsing not available
Creating 5 MTD partitions on "fc000000.flash":
0x000000000000-0x000000500000 : "golden_firmware"
0x000000500000-0x000000800000 : "golden_kernel"
0x000000800000-0x000000d00000 : "user_firmware"
0x000000d00000-0x000000fe0000 : "user_kernel"
0x000000fe0000-0x000001000000 : "env_variables"
irq: irq 6 on host /plb@0/interrupt-controller@81800000 mapped to virtual irq 20
xilinx-xps-spi 81400400.hd-xps-spi: at 0x81400400 mapped to 0xD1028400, irq=20
SPI: XIlinx spi: bus number now 32766
irq: irq 5 on host /plb@0/interrupt-controller@81800000 mapped to virtual irq 21
xilinx-xps-spi 81400000.xps-spi: at 0x81400000 mapped to 0xD102C000, irq=21
SPI: XIlinx spi: bus number now 32765
mice: PS/2 mouse device common for all mice
Device Tree Probing 'i2c'
irq: irq 7 on host /plb@0/interrupt-controller@81800000 mapped to virtual irq 22
 #0 at 0x81600000 mapped to 0xD1030000, irq=22
at24 0-0050: 1024 byte 24c08 EEPROM (writable)
TCP cubic registered
NET: Registered protocol family 17
RPC: Registered udp transport module.
RPC: Registered tcp transport module.
eth0: XLlTemac: Options: 0x3fa
eth0: XLlTemac: allocating interrupt 19 for dma mode tx.
eth0: XLlTemac: allocating interrupt 18 for dma mode rx.
eth0: XLlTemac: speed set to 1000Mb/s
eth0: XLlTemac: Send Threshold = 24, Receive Threshold = 4
eth0: XLlTemac: Send Wait bound = 254, Receive Wait bound = 254
Sending DHCP requests ., OK
IP-Config: Got DHCP answer from 10.1.2.250, my address is 10.1.2.19
IP-Config: Complete:
     device=eth0, addr=10.1.2.19, mask=255.255.255.0, gw=10.1.2.250,
     host=nnaida19, domain=, nis-domain=(none),
     bootserver=10.1.2.250, rootserver=10.1.2.250, rootpath=/MIDAS@aidas/XilinxLinux/ppc_4xx/rfs/nnaida19,tcp
Looking up port of RPC 100003/2 on 10.1.2.250
Looking up port of RPC 100005/1 on 10.1.2.250
VFS: Mounted root (nfs filesystem) on device 0:12.
Freeing unused kernel memory: 168k init

cat var/log/messages
Jun  7 00:20:33 nnaida19 syslogd 1.4.2: restart.
Jun  7 00:20:38 nnaida19 kernel: klogd 1.4.2, log source = /proc/kmsg started.
Jun  7 00:20:38 nnaida19 kernel: Using Xilinx Virtex440 machine description
Jun  7 00:20:39 nnaida19 kernel: Linux version 2.6.31 (nf@nnlxb.dl.ac.uk) (gcc version 4.2.2) #34 PREEMPT Tue
Nov 15 15:57:04 GMT 2011
Jun  7 00:20:39 nnaida19 kernel: Zone PFN ranges:
Jun  7 00:20:39 nnaida19 kernel:   DMA      0x00000000 -> 0x00007000
Jun  7 00:20:39 nnaida19 kernel:   Normal   0x00007000 -> 0x00007000
Jun  7 00:20:39 nnaida19 kernel: Movable zone start PFN for each node
Jun  7 00:20:40 nnaida19 kernel: early_node_map[1] active PFN ranges
Jun  7 00:20:40 nnaida19 kernel:     0: 0x00000000 -> 0x00007000
Jun  7 00:20:40 nnaida19 kernel: MMU: Allocated 1088 bytes of context maps for 255 contexts
Jun  7 00:20:40 nnaida19 kernel: Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 28448
Jun  7 00:20:40 nnaida19 kernel: Kernel command line: console=ttyS0 root=/dev/nfs ip=on rw mem=112M
Jun  7 00:20:41 nnaida19 kernel: PID hash table entries: 512 (order: 9, 2048 bytes)
Jun  7 00:20:41 nnaida19 kernel: Dentry cache hash table entries: 16384 (order: 4, 65536 bytes)
Jun  7 00:20:41 nnaida19 kernel: Inode-cache hash table entries: 8192 (order: 3, 32768 bytes)
Jun  7 00:20:41 nnaida19 kernel: Memory: 109680k/114688k available (3500k kernel code, 4852k reserved, 144k
data, 130k bss, 168k init)
Jun  7 00:20:41 nnaida19 kernel: Kernel virtual memory layout:
Jun  7 00:20:42 nnaida19 kernel:   * 0xffffe000..0xfffff000  : fixmap
Jun  7 00:20:43 nnaida19 kernel:   * 0xfde00000..0xfe000000  : consistent mem
Jun  7 00:20:43 nnaida19 kernel:   * 0xfde00000..0xfde00000  : early ioremap
Jun  7 00:20:44 nnaida19 kernel:   * 0xd1000000..0xfde00000  : vmalloc & ioremap
Jun  7 00:20:44 nnaida19 kernel: NR_IRQS:512
Jun  7 00:20:44 nnaida19 kernel: clocksource: timebase mult[a00000] shift[22] registered
Jun  7 00:20:44 nnaida19 kernel: Console: colour dummy device 80x25
Jun  7 00:20:44 nnaida19 kernel: Mount-cache hash table entries: 512
Jun  7 00:20:45 nnaida19 kernel: NET: Registered protocol family 16
Jun  7 00:20:45 nnaida19 kernel: PCI: Probing PCI hardware
Jun  7 00:20:45 nnaida19 kernel: bio: create slab <bio-0> at 0
Jun  7 00:20:45 nnaida19 kernel: NET: Registered protocol family 2
Jun  7 00:20:45 nnaida19 kernel: IP route cache hash table entries: 1024 (order: 0, 4096 bytes)
Jun  7 00:20:46 nnaida19 kernel: TCP established hash table entries: 4096 (order: 3, 32768 bytes)
Jun  7 00:20:46 nnaida19 kernel: TCP bind hash table entries: 4096 (order: 2, 16384 bytes)
Jun  7 00:20:46 nnaida19 kernel: TCP: Hash tables configured (established 4096 bind 4096)
Jun  7 00:20:46 nnaida19 kernel: TCP reno registered
Jun  7 00:20:47 nnaida19 kernel: NET: Registered protocol family 1
Jun  7 00:20:47 nnaida19 kernel: ROMFS MTD (C) 2007 Red Hat, Inc.
Jun  7 00:20:47 nnaida19 kernel: msgmni has been set to 214
Jun  7 00:20:47 nnaida19 kernel: io scheduler noop registered
Jun  7 00:20:47 nnaida19 kernel: io scheduler anticipatory registered
Jun  7 00:20:48 nnaida19 kernel: io scheduler deadline registered
Jun  7 00:20:48 nnaida19 kernel: io scheduler cfq registered (default)
Jun  7 00:20:48 nnaida19 kernel: Serial: 8250/16550 driver, 4 ports, IRQ sharing disabled
Jun  7 00:20:48 nnaida19 kernel: 83e00000.serial: ttyS0 at MMIO 0x83e01003 (irq = 16) is a 16550
Jun  7 00:20:48 nnaida19 kernel: console [ttyS0] enabled
Jun  7 00:20:49 nnaida19 kernel: brd: module loaded
Jun  7 00:20:49 nnaida19 kernel: loop: module loaded
Jun  7 00:20:49 nnaida19 kernel: Device Tree Probing 'ethernet'
Jun  7 00:20:49 nnaida19 kernel: xilinx_lltemac 81c00000.ethernet: MAC address is now  0: 4:a3:2b:27:54
Jun  7 00:20:49 nnaida19 kernel: xilinx_lltemac 81c00000.ethernet: XLlTemac: using DMA mode.
Jun  7 00:20:49 nnaida19 kernel: XLlTemac: DCR address: 0x80
Jun  7 00:20:50 nnaida19 kernel: XLlTemac: buffer descriptor size: 32768 (0x8000)
Jun  7 00:20:50 nnaida19 kernel: XLlTemac: Allocating DMA descriptors with kmalloc
Jun  7 00:20:50 nnaida19 kernel: XLlTemac: (buffer_descriptor_init) phy: 0x6938000, virt: 0xc6938000, size: 0x8000
Jun  7 00:20:50 nnaida19 kernel: XTemac: PHY detected at address 7.
Jun  7 00:20:50 nnaida19 kernel: xilinx_lltemac 81c00000.ethernet: eth0: Xilinx TEMAC at 0x81C00000 mapped to
0xD1024000, irq=17
Jun  7 00:20:50 nnaida19 kernel: fc000000.flash: Found 1 x16 devices at 0x0 in 16-bit bank
Jun  7 00:20:50 nnaida19 kernel:  Intel/Sharp Extended Query Table at 0x010A
Jun  7 00:20:50 nnaida19 last message repeated 5 times
Jun  7 00:20:50 nnaida19 kernel: Using buffer write method
Jun  7 00:20:51 nnaida19 kernel: cfi_cmdset_0001: Erase suspend on write enabled
Jun  7 00:20:51 nnaida19 kernel: cmdlinepart partition parsing not available
Jun  7 00:20:51 nnaida19 kernel: RedBoot partition parsing not available
Jun  7 00:20:51 nnaida19 kernel: Creating 5 MTD partitions on "fc000000.flash":
Jun  7 00:20:51 nnaida19 kernel: 0x000000000000-0x000000500000 : "golden_firmware"
Jun  7 00:20:51 nnaida19 kernel: 0x000000500000-0x000000800000 : "golden_kernel"
Jun  7 00:20:51 nnaida19 kernel: 0x000000800000-0x000000d00000 : "user_firmware"
Jun  7 00:20:51 nnaida19 kernel: 0x000000d00000-0x000000fe0000 : "user_kernel"
Jun  7 00:20:51 nnaida19 kernel: 0x000000fe0000-0x000001000000 : "env_variables"
Jun  7 00:20:52 nnaida19 kernel: xilinx-xps-spi 81400400.hd-xps-spi: at 0x81400400 mapped to 0xD1028400, irq=20
Jun  7 00:20:52 nnaida19 kernel: SPI: XIlinx spi: bus number now 32766
Jun  7 00:20:52 nnaida19 kernel: xilinx-xps-spi 81400000.xps-spi: at 0x81400000 mapped to 0xD102C000, irq=21
Jun  7 00:20:52 nnaida19 kernel: SPI: XIlinx spi: bus number now 32765
Jun  7 00:20:52 nnaida19 kernel: mice: PS/2 mouse device common for all mice
Jun  7 00:20:52 nnaida19 kernel: Device Tree Probing 'i2c'
Jun  7 00:20:52 nnaida19 kernel:  #0 at 0x81600000 mapped to 0xD1030000, irq=22
Jun  7 00:20:52 nnaida19 kernel: at24 0-0050: 1024 byte 24c08 EEPROM (writable)
Jun  7 00:20:53 nnaida19 kernel: TCP cubic registered
Jun  7 00:20:53 nnaida19 kernel: NET: Registered protocol family 17
Jun  7 00:20:53 nnaida19 kernel: RPC: Registered udp transport module.
Jun  7 00:20:53 nnaida19 kernel: RPC: Registered tcp transport module.
Jun  7 00:20:53 nnaida19 kernel: eth0: XLlTemac: Options: 0x3fa
Jun  7 00:20:53 nnaida19 kernel: eth0: XLlTemac: allocating interrupt 19 for dma mode tx.
Jun  7 00:20:53 nnaida19 kernel: eth0: XLlTemac: allocating interrupt 18 for dma mode rx.
Jun  7 00:20:53 nnaida19 kernel: eth0: XLlTemac: speed set to 1000Mb/s
Jun  7 00:20:53 nnaida19 kernel: eth0: XLlTemac: Send Threshold = 24, Receive Threshold = 4
Jun  7 00:20:53 nnaida19 kernel: eth0: XLlTemac: Send Wait bound = 254, Receive Wait bound = 254
Jun  7 00:20:54 nnaida19 kernel: Sending DHCP requests ., OK
Jun  7 00:20:54 nnaida19 kernel: IP-Config: Got DHCP answer from 10.1.2.250, my address is 10.1.2.19
Jun  7 00:20:54 nnaida19 kernel: IP-Config: Complete:
Jun  7 00:20:54 nnaida19 kernel:      device=eth0, addr=10.1.2.19, mask=255.255.255.0, gw=10.1.2.250,
Jun  7 00:20:54 nnaida19 kernel:      host=nnaida19, domain=, nis-domain=(none),
Jun  7 00:20:54 nnaida19 kernel:      bootserver=10.1.2.250, rootserver=10.1.2.250,
rootpath=/MIDAS@aidas/XilinxLinux/ppc_4xx/rfs/nnaida26,tcp
Jun  7 00:20:54 nnaida19 kernel: Looking up port of RPC 100003/2 on 10.1.2.250
Jun  7 00:20:54 nnaida19 kernel: Looking up port of RPC 100005/1 on 10.1.2.250
Jun  7 00:20:55 nnaida19 kernel: VFS: Mounted root (nfs filesystem) on device 0:12.
Jun  7 00:20:55 nnaida19 kernel: Freeing unused kernel memory: 168k init
Jun  7 00:20:56 nnaida19 rpcbind: cannot create socket for udp6
Jun  7 00:20:56 nnaida19 rpcbind: cannot create socket for tcp6
Jun  7 00:21:06 nnaida19 xinetd[275]: IPv6 socket creation failed for service telnet, trying IPv4
Jun  7 00:21:06 nnaida19 xinetd[275]: IPv6 socket creation failed for service ftp, trying IPv4
Jun  7 00:21:06 nnaida19 xinetd[275]: xinetd Version 2.3.14 started with libwrap loadavg options compiled in.
Jun  7 00:21:06 nnaida19 xinetd[275]: Started working: 2 available services
Jun  7 00:21:15 nnaida19 kernel: Trying to free nonexistent resource <0000000081000000-00000000811fffff>
Jun  7 00:21:15 nnaida19 kernel: XAIDA: xaida: mem region start 0x81000000 for 0x200000 mapped at 0xd2100000
Jun  7 00:21:15 nnaida19 kernel: XAIDA: xaida: driver assigned major number 254
Jun  7 00:21:22 nnaida19 kernel: Trying to free nonexistent resource <0000000007000000-0000000007ffffff>
Jun  7 00:21:22 nnaida19 kernel: AIDAMEM: aidamem: mem region start 0x7000000 for 0x1000000 mapped at 0xd2380000
Jun  7 00:21:22 nnaida19 kernel: AIDAMEM: aidamem: driver assigned major number 253
Jun  7 00:21:39 nnaida19 kernel: XAIDA: xaida_open:
Jun  7 00:21:39 nnaida19 kernel: AIDAMEM: aidamem_open:
Jun  7 00:36:12 nnaida19 syslogd 1.4.2: restart.
Jun  7 00:36:19 nnaida19 kernel: klogd 1.4.2, log source = /proc/kmsg started.
Jun  7 00:36:20 nnaida19 kernel: Using Xilinx Virtex440 machine description
Jun  7 00:36:20 nnaida19 kernel: Linux version 2.6.31 (nf@nnlxb.dl.ac.uk) (gcc version 4.2.2) #34 PREEMPT Tue
Nov 15 15:57:04 GMT 2011
Jun  7 00:36:20 nnaida19 kernel: Zone PFN ranges:
Jun  7 00:36:20 nnaida19 kernel:   DMA      0x00000000 -> 0x00007000
Jun  7 00:36:20 nnaida19 kernel:   Normal   0x00007000 -> 0x00007000
Jun  7 00:36:21 nnaida19 kernel: Movable zone start PFN for each node
Jun  7 00:36:21 nnaida19 kernel: early_node_map[1] active PFN ranges
Jun  7 00:36:21 nnaida19 kernel:     0: 0x00000000 -> 0x00007000
Jun  7 00:36:21 nnaida19 kernel: MMU: Allocated 1088 bytes of context maps for 255 contexts
Jun  7 00:36:22 nnaida19 kernel: Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 28448
Jun  7 00:36:22 nnaida19 kernel: Kernel command line: console=ttyS0 root=/dev/nfs ip=on rw mem=112M
Jun  7 00:36:22 nnaida19 kernel: PID hash table entries: 512 (order: 9, 2048 bytes)
Jun  7 00:36:22 nnaida19 kernel: Dentry cache hash table entries: 16384 (order: 4, 65536 bytes)
Jun  7 00:36:23 nnaida19 kernel: Inode-cache hash table entries: 8192 (order: 3, 32768 bytes)
Jun  7 00:36:23 nnaida19 kernel: Memory: 109680k/114688k available (3500k kernel code, 4852k reserved, 144k
data, 130k bss, 168k init)
Jun  7 00:36:23 nnaida19 kernel: Kernel virtual memory layout:
Jun  7 00:36:23 nnaida19 kernel:   * 0xffffe000..0xfffff000  : fixmap
Jun  7 00:36:24 nnaida19 kernel:   * 0xfde00000..0xfe000000  : consistent mem
Jun  7 00:36:24 nnaida19 kernel:   * 0xfde00000..0xfde00000  : early ioremap
Jun  7 00:36:24 nnaida19 kernel:   * 0xd1000000..0xfde00000  : vmalloc & ioremap
Jun  7 00:36:24 nnaida19 kernel: NR_IRQS:512
Jun  7 00:36:25 nnaida19 kernel: clocksource: timebase mult[a00000] shift[22] registered
Jun  7 00:36:25 nnaida19 kernel: Console: colour dummy device 80x25
Jun  7 00:36:25 nnaida19 kernel: Mount-cache hash table entries: 512
Jun  7 00:36:25 nnaida19 kernel: NET: Registered protocol family 16
Jun  7 00:36:25 nnaida19 kernel: PCI: Probing PCI hardware
Jun  7 00:36:25 nnaida19 kernel: bio: create slab <bio-0> at 0
Jun  7 00:36:25 nnaida19 kernel: NET: Registered protocol family 2
Jun  7 00:36:26 nnaida19 kernel: IP route cache hash table entries: 1024 (order: 0, 4096 bytes)
Jun  7 00:36:26 nnaida19 kernel: TCP established hash table entries: 4096 (order: 3, 32768 bytes)
Jun  7 00:36:26 nnaida19 kernel: TCP bind hash table entries: 4096 (order: 2, 16384 bytes)
Jun  7 00:36:26 nnaida19 kernel: TCP: Hash tables configured (established 4096 bind 4096)
Jun  7 00:36:26 nnaida19 kernel: TCP reno registered
Jun  7 00:36:26 nnaida19 kernel: NET: Registered protocol family 1
Jun  7 00:36:26 nnaida19 kernel: ROMFS MTD (C) 2007 Red Hat, Inc.
Jun  7 00:36:27 nnaida19 kernel: msgmni has been set to 214
Jun  7 00:36:27 nnaida19 kernel: io scheduler noop registered
Jun  7 00:36:27 nnaida19 kernel: io scheduler anticipatory registered
Jun  7 00:36:27 nnaida19 kernel: io scheduler deadline registered
Jun  7 00:36:27 nnaida19 kernel: io scheduler cfq registered (default)
Jun  7 00:36:27 nnaida19 kernel: Serial: 8250/16550 driver, 4 ports, IRQ sharing disabled
Jun  7 00:36:27 nnaida19 kernel: 83e00000.serial: ttyS0 at MMIO 0x83e01003 (irq = 16) is a 16550
Jun  7 00:36:28 nnaida19 kernel: console [ttyS0] enabled
Jun  7 00:36:28 nnaida19 kernel: brd: module loaded
Jun  7 00:36:28 nnaida19 kernel: loop: module loaded
Jun  7 00:36:28 nnaida19 kernel: Device Tree Probing 'ethernet'
Jun  7 00:36:28 nnaida19 kernel: xilinx_lltemac 81c00000.ethernet: MAC address is now  0: 4:a3:2b:27:54
Jun  7 00:36:28 nnaida19 kernel: xilinx_lltemac 81c00000.ethernet: XLlTemac: using DMA mode.
Jun  7 00:36:29 nnaida19 kernel: XLlTemac: DCR address: 0x80
Jun  7 00:36:29 nnaida19 kernel: XLlTemac: buffer descriptor size: 32768 (0x8000)
Jun  7 00:36:29 nnaida19 kernel: XLlTemac: Allocating DMA descriptors with kmalloc
Jun  7 00:36:29 nnaida19 kernel: XLlTemac: (buffer_descriptor_init) phy: 0x6938000, virt: 0xc6938000, size: 0x8000
Jun  7 00:36:29 nnaida19 kernel: XTemac: PHY detected at address 7.
Jun  7 00:36:29 nnaida19 kernel: xilinx_lltemac 81c00000.ethernet: eth0: Xilinx TEMAC at 0x81C00000 mapped to
0xD1024000, irq=17
Jun  7 00:36:29 nnaida19 kernel: fc000000.flash: Found 1 x16 devices at 0x0 in 16-bit bank
Jun  7 00:36:29 nnaida19 kernel:  Intel/Sharp Extended Query Table at 0x010A
Jun  7 00:36:30 nnaida19 last message repeated 5 times
Jun  7 00:36:30 nnaida19 kernel: Using buffer write method
Jun  7 00:36:30 nnaida19 kernel: cfi_cmdset_0001: Erase suspend on write enabled
Jun  7 00:36:30 nnaida19 kernel: cmdlinepart partition parsing not available
Jun  7 00:36:30 nnaida19 kernel: RedBoot partition parsing not available
Jun  7 00:36:30 nnaida19 kernel: Creating 5 MTD partitions on "fc000000.flash":
Jun  7 00:36:30 nnaida19 kernel: 0x000000000000-0x000000500000 : "golden_firmware"
Jun  7 00:36:31 nnaida19 kernel: 0x000000500000-0x000000800000 : "golden_kernel"
Jun  7 00:36:31 nnaida19 kernel: 0x000000800000-0x000000d00000 : "user_firmware"
Jun  7 00:36:31 nnaida19 kernel: 0x000000d00000-0x000000fe0000 : "user_kernel"
Jun  7 00:36:31 nnaida19 kernel: 0x000000fe0000-0x000001000000 : "env_variables"
Jun  7 00:36:31 nnaida19 kernel: xilinx-xps-spi 81400400.hd-xps-spi: at 0x81400400 mapped to 0xD1028400, irq=20
Jun  7 00:36:31 nnaida19 kernel: SPI: XIlinx spi: bus number now 32766
Jun  7 00:36:31 nnaida19 kernel: xilinx-xps-spi 81400000.xps-spi: at 0x81400000 mapped to 0xD102C000, irq=21
Jun  7 00:36:31 nnaida19 kernel: SPI: XIlinx spi: bus number now 32765
Jun  7 00:36:32 nnaida19 kernel: mice: PS/2 mouse device common for all mice
Jun  7 00:36:32 nnaida19 kernel: Device Tree Probing 'i2c'
Jun  7 00:36:32 nnaida19 kernel:  #0 at 0x81600000 mapped to 0xD1030000, irq=22
Jun  7 00:36:32 nnaida19 kernel: at24 0-0050: 1024 byte 24c08 EEPROM (writable)
Jun  7 00:36:32 nnaida19 kernel: TCP cubic registered
Jun  7 00:36:32 nnaida19 kernel: NET: Registered protocol family 17
Jun  7 00:36:32 nnaida19 kernel: RPC: Registered udp transport module.
Jun  7 00:36:32 nnaida19 kernel: RPC: Registered tcp transport module.
Jun  7 00:36:32 nnaida19 kernel: eth0: XLlTemac: Options: 0x3fa
Jun  7 00:36:32 nnaida19 kernel: eth0: XLlTemac: allocating interrupt 19 for dma mode tx.
Jun  7 00:36:32 nnaida19 kernel: eth0: XLlTemac: allocating interrupt 18 for dma mode rx.
Jun  7 00:36:33 nnaida19 kernel: eth0: XLlTemac: speed set to 1000Mb/s
Jun  7 00:36:33 nnaida19 kernel: eth0: XLlTemac: Send Threshold = 24, Receive Threshold = 4
Jun  7 00:36:33 nnaida19 kernel: eth0: XLlTemac: Send Wait bound = 254, Receive Wait bound = 254
Jun  7 00:36:33 nnaida19 kernel: Sending DHCP requests ., OK
Jun  7 00:36:33 nnaida19 kernel: IP-Config: Got DHCP answer from 10.1.2.250, my address is 10.1.2.19
Jun  7 00:36:33 nnaida19 kernel: IP-Config: Complete:
Jun  7 00:36:33 nnaida19 kernel:      device=eth0, addr=10.1.2.19, mask=255.255.255.0, gw=10.1.2.250,
Jun  7 00:36:33 nnaida19 kernel:      host=nnaida19, domain=, nis-domain=(none),
Jun  7 00:36:34 nnaida19 kernel:      bootserver=10.1.2.250, rootserver=10.1.2.250,
rootpath=/MIDAS@aidas/XilinxLinux/ppc_4xx/rfs/nnaida26,tcp
Jun  7 00:36:34 nnaida19 kernel: Looking up port of RPC 100003/2 on 10.1.2.250
Jun  7 00:36:34 nnaida19 kernel: Looking up port of RPC 100005/1 on 10.1.2.250
Jun  7 00:36:34 nnaida19 kernel: VFS: Mounted root (nfs filesystem) on device 0:12.
Jun  7 00:36:34 nnaida19 kernel: Freeing unused kernel memory: 168k init
Jun  7 00:36:35 nnaida19 rpcbind: cannot create socket for udp6
Jun  7 00:36:35 nnaida19 rpcbind: cannot create socket for tcp6
Jun  7 00:36:40 nnaida19 xinetd[275]: IPv6 socket creation failed for service telnet, trying IPv4
Jun  7 00:36:40 nnaida19 xinetd[275]: IPv6 socket creation failed for service ftp, trying IPv4
Jun  7 00:36:40 nnaida19 xinetd[275]: xinetd Version 2.3.14 started with libwrap loadavg options compiled in.
Jun  7 00:36:40 nnaida19 xinetd[275]: Started working: 2 available services
Jun  7 00:36:47 nnaida19 kernel: Trying to free nonexistent resource <0000000081000000-00000000811fffff>
Jun  7 00:36:48 nnaida19 kernel: XAIDA: xaida: mem region start 0x81000000 for 0x200000 mapped at 0xd2100000
Jun  7 00:36:48 nnaida19 kernel: XAIDA: xaida: driver assigned major number 254
Jun  7 00:36:57 nnaida19 kernel: Trying to free nonexistent resource <0000000007000000-0000000007ffffff>
Jun  7 00:36:57 nnaida19 kernel: AIDAMEM: aidamem: mem region start 0x7000000 for 0x1000000 mapped at 0xd2380000
Jun  7 00:36:57 nnaida19 kernel: AIDAMEM: aidamem: driver assigned major number 253
Jun  7 00:37:13 nnaida19 kernel: XAIDA: xaida_open:
Jun  7 00:37:13 nnaida19 kernel: AIDAMEM: aidamem_open:
Jun  7 00:47:40 nnaida19 kernel: XAIDA: xaida_open:
Jun  7 11:10:26 nnaida19 xinetd[275]: START: telnet pid=395 from=10.1.2.250
Jun  7 11:11:36 nnaida19 xinetd[275]: EXIT: telnet status=0 pid=395 duration=70(sec)
Jun  7 11:11:56 nnaida19 xinetd[275]: START: telnet pid=397 from=10.1.2.250
  288   Tue Jun 7 05:48:13 2016 TD, AE, ML & PJWHEC spectra & implant profile
DSSSD#1 and DSSSD#6 ADC hit patterns (profile) and 1*H (ASIC#1 20GeV FSR) energy spectra 
  287   Mon Jun 6 19:26:38 2016 CG, DK, BM, AETues 7th June

02.08 Tried updating AIDA SYNC on stats page and got this message.

            See attachment 8

 

02.16 Runs R1201-1206 are short runs on the 1GeV, each wit the variable degrader thickness changed to alter the depth of implantation (estimated by visual scalar rates per DSSD)

            Started 02.16 - 02.47

 

02.56 Started R1207 (EURICA run_1407, BigRIPS run 1192).

           Settings file 2016Jun07-05.50.53. All nnaida back to 20MeV setting.

           Temps ok. Leakage currents ok.

           3.68mm variable degrader in + 19.3mm fixed degrader.

           Operator stopped beam @ 03.41. Run stopped.

           Merger outputting some info to terminal re. unexpected header found (attachment 3)

 

04:05 Beam is back, but some trouble to get AIDA DAQ happy

04:52 Started R1208 (EURICA run_1408, BigRIPS 1193)

           Settings file 2016June07-02.50.53

           From 5:05 to 5:20, F82a, and F51a (twice) trip.  We reduced the F51a from -745 V; -735 V; to -720 V settings.

 

 06:51 Continued with R1208_19 (EURICA has 1410 begin at 6:40, BigRIPS began 1195 at ~7:00)

          Biases uploaded as attachments 4 and 5

          7:13 data stopped going to disk

          Shortly after that (7:15) operator calls to take control of the beam.

 

07.40 Beam returned. Some trouble restarting DAQ.

 

07.56 Run R1209 started.

           Settings file 2016Jun07-02.50.53

           No changes to settings or degraders. Temps ok. Leakage currents ok.

           PPACs tripped repeatedly around 08.10.

09.13 Beam setting changed and run stopped.

 

11.25 Current status

          Julabo FL11006 recirculating chiller set point +15.0deg C (B3F +24.6 deg C, dew point +10.3 deg C, RH 40.7%)

           System-wide checks - all FEE64s pass all tests *except* nnaida19 which fails ASIC clock timestamp and SYNC errors not counting

                 i.e. status is unchanged

                nnaida19 merge data link (#18) disabled - see attachment 12

                nnaida19 ReSYNCs OK but timestamp is adrift of other FEE64s - see attachment 11

           Detector biases & leakage currents - OK - see attachments 9-10

 

R1211 neutron-rich setting *tuning*

R1212 Prior to start of run, AIDA trigger rates (1GeV FSR MEC setting)

             #1 670Hz, #2 820Hz, #3 680Hz, #4 540Hz, #5 900Hz, #6 440Hz F11 650Hz, beta trigger 360Hz

start 15.10

stop 15.41 (run stopped to reboot EURICA VME crate)

ASIC settings DB key 2016Jun07-02.50.53

4mm Be target

Degrader (17+1)mm + 1.08mm (17+1)mm fixed #1 out #2 out #3 in (1.08mm) #4 no change, cannot be observed

Trigger = OR ( DSSSD#1 - #6 ) .AND. EURICA .AND. .NOT.veto (plastic downstream AIDA)

 

R1213

N.B. EURICA offline due to fault with VME crate RIO3 interface card continue with AIDA+BigRIPS

start 15.05

stop 17.34 (beam lost)

ASIC settings DB key 2016Jun07-02.50.53

4mm Be target

Degrader (17+1)mm + 1.08mm (17+1)mm fixed #1 out #2 out #3 in (1.08mm) #4 no change, cannot be observed

Trigger = OR ( DSSSD#1 - #6 ) .AND. EURICA .AND. .NOT.veto (plastic downstream AIDA)

Attachments 20-28 1*H spectra, FEE64 'right' (n+n ohmic strip, 20GeV FSR energy spectra) & stat/rate hit patterns

 

17.40 Julabo FL11006 set point +15.0deg C B2F/F11 temp 25.3 deg C, dew point 11.0 deg C, RH 41.8%

  286   Mon Jun 6 15:57:51 2016 TD, ML & YSR1121 (AIDA)
R1120 stalled shortly after DAQ GO
      'unable to connect' etc

      power cycle & reboot FEE64s

R1121 currently running 
      AIDA SYNCs currently but rates <100Hz in many FEE64s - see attachment 2
      link64 processes consuming large fraction of available CPU - see attachment 1
  285   Mon Jun 6 15:06:22 2016 1TD, ML & YSR1119
R1118 ended OK

R1119 DAQ GO, check AIDA SYNCs OK, toggle merge input etc 

Merge then halted with the usual unable to connect to COUNTER, nnaida1, nnaida1 etc error messages
so unable to reset, setup etc

Power-cycling and rebooting
  284   Mon Jun 6 14:24:07 2016 TD, ML & YSR1118 (AIDA)
22.14 R1118 starts

      aidas1 has been rebooted


      Changed /MIDAS/linux-ppc_4xx/startup/aidacommon from

     netint DACQ_PushEnable 60
     netint DACQ_FlushEnable 60

     to

     netint DACQ_PushEnable 10
     netint DACQ_FlushEnable 10

      AIDA FEE64s then power-cycled and rebooted  

      nnaida19 data link to merger disabled

      see attachments 1-8

22.30 R1118 stops

      AIDA SYNCs & good events at end of R1118 - see attachments 9-10
  283   Mon Jun 6 13:52:10 2016 TD, ML & YSFEE64 power-cycle, FEE64 & aidas1 reboot
21.40 toggled merge input pause state  - merge pause stopped at link 18 (nnaida19 - this link is supposed
      to be disabled 
      
      obtained 'unable to connect' to nnaida1 for DAQ stop

      reboot aidas1, power cycle and reboot FEE64s 
  282   Mon Jun 6 13:46:45 2016 TD, ML & YS/var/log/messages
aidas1 log
  281   Mon Jun 6 11:17:30 2016 TD, ML & YSRe-configure merger to ignore nnaida19
19.00 Power-cycled and rebooted AIDA FEE64s

      Temperatures are lower - see attachment 1

      Re-configured merge to ignore problem child nnaida19 which continues to ReSYNC but fails
      to pass SYNC errors counting and ASIC clock timestamp system-wide checks - see attachment 2
  280   Mon Jun 6 08:57:34 2016 GL,PW, YS, TD, MLAIDA run 1112 - Sync problem

After starting run 1112, we noticed that the merge program was waiting for a first sync. It then turned out that all syncs had disappeared. This required an entire reboot of the AIDA DAQ. Consequently, AIDA run 1112 should not be used.

ELOG V3.1.4-unknown