AIDA GELINA BRIKEN nToF CRIB ISOLDE CIRCE nTOFCapture DESPEC DTAS EDI_PSA 179Ta CARME StellarModelling DCF K40
  DESPEC, Page 33 of 35  ELOG logo
ID Date Author Subject
  51   Mon May 20 13:33:06 2019 NHNew Merger/MBS Test Runs

New merger has been worked on by VP which fixes the timewarp issues and MBS integration.

Currently no WAVE capture is supported, VP will re-add WAVE histogramming for startup testing.

10.05.2019 - Pulser walkthrough
-> Pulser rate 50 Hz
-> 1 minute per 0.1 V (0.1 to 1 V)
-> extra time on 1 V

With this 95% of channels calibrate easily (good statistics)
Issue: ~16 channels (most of ASIC3) in FEE10 are horrificly noisy. Not calibrated

Fig 1. Pulser of FEE1 (no DSSD)
Fig 2. Pulser of FEE9 (DSSD)
Fig 3&4. Pulser of FEE10 noisy channels

Future TODO: Will investigate WAVE data and look if issue can be found.

20.05.2019 - Alpha walkthrough
-> Pulser off
-> FEE10ASIC3 has readout off & discriminator masked
-> Slow threshold 0x64
-> Fast threshold 0xff
-> HEC threshold 0x2

File is nyx/gamma/nhubbard/AIDA/alpha_bg_200519_

Rate is approx. 1MB/s still of WR timestamp data.

(NB, MIDAS Alpha walkthrough before beamtime I see no alpha events in!)

Fig 5: Temps
Fig 6: Stats
Fig 7: Merger Stats
Fig 8: MBS Stats

Attachment 1: 20190522-PulserFEE1.png
20190522-PulserFEE1.png
Attachment 2: 20190522-PulserFEE9.png
20190522-PulserFEE9.png
Attachment 3: 20190522-PulserFEE10-Bad.png
20190522-PulserFEE10-Bad.png
Attachment 4: 20190522-PulserFEE10-VBad.png
20190522-PulserFEE10-VBad.png
Attachment 5: 20190522-Temps.png
20190522-Temps.png
Attachment 6: 20190522-Stats.png
20190522-Stats.png
Attachment 7: 20190522-StatsMerger.png
20190522-StatsMerger.png
Attachment 8: 20190522-MBSRate.png
20190522-MBSRate.png
  50   Fri Apr 12 15:15:33 2019 NHReport - FEE Kernel Panics (Update on 48)

Update on issue #48 - the "confusing state" is that the FEE has restarted and hence is undefined again.

An attached TTY log from the pi shows that the module is kernel panicking.
I have seen a couple of FEEs panic with the same error now.

(NB. The Day/time of the logs is wrong as the pi does not have the correct time - pis dont have a RTC or Internet access so the time isn't corrected)

Temperature of the modules is fine.

Aida is currently powered off (and I am away from GSI)

Quote:

it seems a FEE somtimes enters a confusing state and stops sending data
the current merger requires all FEEs to be active and so this stops the entire system from proceeding.

On MIDAS the page reports the module is "undefined"

On the TTY console (PUTTY) it returns: do_GetState returned z=0 and 8

Resetting the DAQ in question via MIDAS works (Putty logs of the stages shown) and then the merger resumes without trouble.

 

Attachment 1: aida01_log.txt
30/11:31:53|completed generic doGo
30/11:31:53|do_GetState returned z=0 and 1
30/11:31:53|get_ASICBlk : Blk=1 : bytes = 98048 : Blk_Status = 00000088 : Offset = 00100000 : Databuffer : 273090556 : 0 => 80500228 : 1 => 0AE18000
30/11:31:53|Last Data : Databuffer  273188600 : 0 => 80468F1E : 1 => 00DD4000
30/11:31:53| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:53| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:54| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:54| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:54| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:54| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:54| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:54| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:54|get_ASICBlk : Blk=0 : bytes = 98048 : Blk_Status = 00000048 : Offset = 00000000 : Databuffer : 273090556 : 0 => 80500228 : 1 => 00DD8000
30/11:31:54|Last Data : Databuffer  273188600 : 0 => 80468F1E : 1 => 06D94000
30/11:31:54| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:54| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:55| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:55| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:55| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:55| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:55| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:55| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:55|get_ASICBlk : Blk=1 : bytes = 98048 : Blk_Status = 00000088 : Offset = 00100000 : Databuffer : 273090556 : 0 => 80500228 : 1 => 06D98000
30/11:31:55|Last Data : Databuffer  273188600 : 0 => 80468F1E : 1 => 0CD54000
30/11:31:55| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:55| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:56| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:56| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:56| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:56| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:56| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:56| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:56|get_ASICBlk : Blk=0 : bytes = 98048 : Blk_Status = 00000048 : Offset = 00000000 : Databuffer : 273090556 : 0 => 80500228 : 1 => 0CD58000
30/11:31:56|Last Data : Databuffer  273188600 : 0 => 80468F1F : 1 => 02D14000
30/11:31:56| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:56| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:57| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:57| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:57| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:57| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:57| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:57| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:57|get_ASICBlk : Blk=1 : bytes = 98048 : Blk_Status = 00000088 : Offset = 00100000 : Databuffer : 273090556 : 0 => 80500228 : 1 => 02D18000
30/11:31:57|Last Data : Databuffer  273188600 : 0 => 80468F1F : 1 => 08CD4000
30/11:31:57| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:57| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:58| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:58| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:58| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:58| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:58| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:58| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:58|get_ASICBlk : Blk=0 : bytes = 98048 : Blk_Status = 00000048 : Offset = 00000000 : Databuffer : 273090556 : 0 => 80500228 : 1 => 08CD8000
30/11:31:58|Last Data : Databuffer  273188600 : 0 => 80468F1F : 1 => 0EC94000
30/11:31:58| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:58| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:59| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:59| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:59| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:59| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:59| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:59| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:59|get_ASICBlk : Blk=1 : bytes = 98048 : Blk_Status = 00000088 : Offset = 00100000 : Databuffer : 273090556 : 0 => 80500228 : 1 => 0EC98000
30/11:31:59|Last Data : Databuffer  273188600 : 0 => 80468F20 : 1 => 04C54000
30/11:31:59| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:31:59| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:32:00| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:32:00| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:32:00| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:32:00| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:32:00| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:32:00| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:32:00|get_ASICBlk : Blk=0 : bytes = 98048 : Blk_Status = 00000048 : Offset = 00000000 : Databuffer : 273090556 : 0 => 80500228 : 1 => 04C58000
30/11:32:00|Last Data : Databuffer  273188600 : 0 => 80468F20 : 1 => 0AC14000
30/11:32:00| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:32:00| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:32:01| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:32:01| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:32:01| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:32:01| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:32:01| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:32:01| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:32:01|get_ASICBlk : Blk=1 : bytes = 98816 : Blk_Status = 00000088 : Offset = 00100000 : Databuffer : 273090556 : 0 => 80500228 : 1 => 0AC18000
30/11:32:01|Last Data : Databuffer  273189368 : 0 => 80468F21 : 1 => 00C94000
30/11:32:01| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:32:01| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:32:02| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:32:02| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:32:02| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:32:02| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:32:02| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:32:02| 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000 | 00000000 : 00000000
30/11:32:02|do_GetState returned z=0 and 1
30/11:32:58|In RDOGo_Operate: Enabled Correlation, ASIC and discriminator readout
30/11:32:59|do_GetState returned z=0 and 1
30/11:33:00|Unable to handle kernel paging request for data at address 0x80501594
30/12:52:57|Faulting instruction address: 0xc0072d74
30/12:52:57|Oops: Kernel access of bad area, sig: 11 [#1]
30/12:52:57|PREEMPT Xilinx Virtex440
30/12:52:57|Modules linked in: aidamem xdriver xh_spidev_register
30/12:52:57|NIP: c0072d74 LR: c021671c CTR: c000da98
30/12:52:57|REGS: c0391cf0 TRAP: 0300   Not tainted  (2.6.31)
30/12:52:57|MSR: 00021000 <ME,CE>  CR: 22000044  XER: 20000000
30/12:52:57|DEAR: 80501594, ESR: 00000000
30/12:52:57|TASK = c036e318[0] 'swapper' THREAD: c0390000
30/12:52:57|GPR00: c021671c c0391da0 c036e318 80501594 c69352e0 00000000 0694009e 00000042
30/12:52:58|GPR08: 00000001 c69400e0 c03b8000 00000000 22000022 00005aa8 fffbbfff fff77fff
30/12:52:58|GPR16: fffff77f fffffbbf fffffffb c0390000 c0391de8 c68e13b4 c0390000 c0385dc8
30/12:52:58|GPR24: c0385bf8 c68e1000 00000055 00029000 00000042 00000002 c6935520 80501594
30/12:52:58|NIP [c0072d74] put_page+0x14/0x1a0
30/12:52:58|LR [c021671c] skb_release_data+0xac/0xd4
30/12:52:58|Call Trace:
30/12:52:58|[c0391da0] [c009191c] kfree+0x68/0xe4 (unreliable)
30/12:52:58|[c0391dc0] [c021671c] skb_release_data+0xac/0xd4
30/12:52:58|[c0391dd0] [c0216338] __kfree_skb+0x18/0xe8
30/12:52:58|[c0391de0] [c01d54a4] DmaSendHandlerBH+0x1c4/0x298
30/12:52:58|[c0391e30] [c003a968] tasklet_action+0x6c/0xec
30/12:52:58|[c0391e50] [c003aaa4] __do_softirq+0xbc/0x138
30/12:52:58|[c0391e90] [c0003c1c] do_softirq+0x74/0x7c
30/12:52:58|[c0391ea0] [c003a6b8] irq_exit+0x64/0x7c
30/12:52:58|[c0391eb0] [c000410c] do_IRQ+0x9c/0xb4
30/12:52:58|[c0391ed0] [c000e9c4] ret_from_except+0x0/0x18
30/12:52:58|[c0391f90] [c0006fac] cpu_idle+0xcc/0xdc
30/12:52:58|[c0391fb0] [c000172c] rest_init+0x70/0x84
30/12:52:58|[c0391fc0] [c0341854] start_kernel+0x230/0x2ac
30/12:52:58|[c0391ff0] [c0000204] skpinv+0x194/0x1d0
30/12:52:59|Instruction dump:
30/12:52:59|387d0140 4bfffdb9 7fe00106 4bffffb0 48235409 4bffffc0 4bffff50 9421ffe0
30/12:52:59|7c0802a6 bfa10014 90010024 7c7f1b78 <80030000> 7009c000 40820170 38030004
30/12:52:59|Kernel panic - not syncing: Fatal exception in interrupt
30/12:52:59|Call Trace:
30/12:52:59|[c0391c20] [c0005de8] show_stack+0x44/0x16c (unreliable)
30/12:52:59|[c0391c60] [c00345bc] panic+0x94/0x168
30/12:52:59|[c0391cb0] [c000bd44] die+0x178/0x18c
30/12:52:59|[c0391cd0] [c001191c] bad_page_fault+0x90/0xd8
30/12:52:59|[c0391ce0] [c000e834] handle_page_fault+0x7c/0x80
30/12:52:59|[c0391da0] [c009191c] kfree+0x68/0xe4
30/12:52:59|[c0391dc0] [c021671c] skb_release_data+0xac/0xd4
30/12:52:59|[c0391dd0] [c0216338] __kfree_skb+0x18/0xe8
30/12:52:59|[c0391de0] [c01d54a4] DmaSendHandlerBH+0x1c4/0x298
30/12:52:59|[c0391e30] [c003a968] tasklet_action+0x6c/0xec
30/12:52:59|[c0391e50] [c003aaa4] __do_softirq+0xbc/0x138
30/12:52:59|[c0391e90] [c0003c1c] do_softirq+0x74/0x7c
30/12:52:59|[c0391ea0] [c003a6b8] irq_exit+0x64/0x7c
30/12:52:59|[c0391eb0] [c000410c] do_IRQ+0x9c/0xb4
30/12:52:59|[c0391ed0] [c000e9c4] ret_from_except+0x0/0x18
30/12:52:59|[c0391f90] [c0006fac] cpu_idle+0xcc/0xdc
30/12:53:00|[c0391fb0] [c000172c] rest_init+0x70/0x84
30/12:53:00|[c0391fc0] [c0341854] start_kernel+0x230/0x2ac
30/12:53:00|[c0391ff0] [c0000204] skpinv+0x194/0x1d0
30/12:53:00|Rebooting in 180 seconds..
  49   Thu Apr 11 15:28:10 2019 CA, OH, CB, TDOffline analysis of 290319 files R13 and R16
X projection of high energy channel ADC hits from R13 (attachment 1)

XY hit pattern from R13 (attachment 2)
    -discontinuity observed
    -possible timing issues or issues with Event Clustering

X projection of high energy channel ADC hits from R16 (attachment 3)

XY hit pattern from R16 (attachment 4)
    -Beam was being diffused at this point, and tpcs were being calibrated.
    -Gap between Y strips ~ 23 -> 30

High Energy Ey vs Ex plots from R13 and R16 (attachments 5 and 6 respectively)
Attachment 1: R13highEnergyhitpattern.pdf
R13highEnergyhitpattern.pdf
Attachment 2: R13highEnergyXYhitpattern.pdf
R13highEnergyXYhitpattern.pdf
Attachment 3: R16highEnergyhitpattern.pdf
R16highEnergyhitpattern.pdf
Attachment 4: R16highEnergyXYhitpattern.pdf
R16highEnergyXYhitpattern.pdf
Attachment 5: R13HighEnergyExEy.pdf
R13HighEnergyExEy.pdf
Attachment 6: R16HighEnergyExEy.pdf
R16HighEnergyExEy.pdf
  48   Wed Apr 10 14:53:50 2019 NHReport - FEE stops sending data

it seems a FEE somtimes enters a confusing state and stops sending data
the current merger requires all FEEs to be active and so this stops the entire system from proceeding.

On MIDAS the page reports the module is "undefined"

On the TTY console (PUTTY) it returns: do_GetState returned z=0 and 8

Resetting the DAQ in question via MIDAS works (Putty logs of the stages shown) and then the merger resumes without trouble.

Attachment 1: Report-PUTTY.png
Report-PUTTY.png
Attachment 2: Report-_Merger.png
Report-_Merger.png
Attachment 3: Report_-_DAQ.png
Report_-_DAQ.png
Attachment 4: Report_-_PuTTY_Reset.png
Report_-_PuTTY_Reset.png
Attachment 5: Report_-_PUTTY_Setup.png
Report_-_PUTTY_Setup.png
Attachment 6: Report_-_PUTTY_GO.png
Report_-_PUTTY_GO.png
  47   Wed Apr 10 12:33:58 2019 NH VPAIDA Firmware Update

All AIDA modules have been updated to a new firmware 0xd330701 which should fix the merger issues.
A new GSI WR timestamp page has been added to MIDAS - the SYNC rollover is suggested to be 0xe for now.
(VP is working on lowering the rate of WR SYNC infowords)

Tested yesterday and Merger no longer reported major timestamp issues
n.b. aida11 and aida12 didn't update properly until today, this may have caused a few.

MBS relay is currently not functioning (data is confusing) but this is under investigation by VP ASAP.

 

Attachment 1: 20191004-FeeTemps.png
20191004-FeeTemps.png
Attachment 2: 20191004-GSIWR.png
20191004-GSIWR.png
  46   Thu Apr 4 14:07:45 2019 NHPulser Configuration

Pulser settings during April run:

Rate 2Hz
Delay 250 NS
Amplitude 1 V
Fall 1 ms
Polarity Pos
Pulse Top Tail
Attenuation 1X
PB5 Pulse On
Clamp Off

 

  45   Wed Apr 3 15:24:06 2019 CA, TDreport - low inquire save state
On Save/Restore Module Settings Tab - "inquire save state" returns an error. See attachment 1.
Attachment 1: 030419_1614_savestate.png
030419_1614_savestate.png
  44   Wed Apr 3 13:29:20 2019 CA, CB, TDreport - high DAQ stall
aida10 runs very fast for a period, then stops.

Have to restart Merger and TapeServer to get it running again.

As shown in attachment 1, aida10 records very high number of bad events.

Waveform for all FEE64s are disabled (see for example attachment 4) *BUT* note that 'wave events' are reported
in aida10 stats (attachment 1)
Attachment 1: 030419_1416_aida10stats.png
030419_1416_aida10stats.png
Attachment 2: 030419_1417_aida09stats.png
030419_1417_aida09stats.png
Attachment 3: 030419_1417_aida11stats.png
030419_1417_aida11stats.png
Attachment 4: 030419_1418_aida12stats.png
030419_1418_aida12stats.png
Attachment 5: 030419_1419_aida10_led.png
030419_1419_aida10_led.png
  43   Wed Apr 3 09:28:07 2019 CA, CB, TDWednesday April 3rd 2018
Arrived at 09:54 - sequenced all FEE64 on

FEE64 not mounted properly - something happened to network overnight, see attachment 1,2 for AIDA system log

10.23 - FEE64 still not mounted properly, power cycling FEE64

10.30 - sequenced all FEE64 on

10.43 - FEE64 mounted successfully

      - DAQ reset and setup - looks ok

      - histogram enabled on aida12

      - clock ReSYNC

      - system wide checks - all FEE64 pass clock status check
           
                           - aida2 and aida12 fail ADC calibration

                           - SYNC pulse and SYNC error checks ok

                           - WR decoder check returns errors (attachment 3)


10.53 - FEE64 temperatures ok (attachment 4)

      - detector bias/leakage current ok (attachment 5)

11.04 - TapeServer start - not writing to storage

      - ASIC check load performed

      - DAQ start

      - ASIC control tab (attachment 6)

      - Run control keeps reloading - has returned to 'reset' screen with aida11 showing "undefined" (attachment 7)

      - good event statistics - all FEE64 showing 0 *except* aida09 (attachment 8)

11.20 - stopped tape server

      - reset daq - returns error (attachment 9)

11.41 DAQ off, detector bias off, FEE64 off

13.30 detector bias on, FEE64 sequenced on

      all browser tabs reopened

      merger set back up - ok

      mbs data relay set back up - ok

      DAQ setup and started, initially ok

      good event statistics (attachment 10)

16.25 FEE64 restarted, along with Merger, TapeServer, DAQ (not writing to file)

      thresholds (slow comparator, fast comparator HEC, fast comparator LEC) raised to 0xff for testing.

      aida10 stats appear reasonable, however wave events still reported despite being deactivated (see report entry
on DAQ stall) (attachment 11)

17.00 DAQ, TapeServer, Merger all stopped

      Detector bias off

      FEE64s switched off

      coolant water still running (cannot be disabled due to lack of access)

      AIDA in safe state
Attachment 1: 030419_aidasystemlog.txt
Apr  3 04:06:56 aidas-gsi NetworkManager[3917]: <info>   nameserver '140.181.96.11'
Apr  3 04:06:56 aidas-gsi NetworkManager[3917]: <info>   nameserver '140.181.96.29'
Apr  3 04:06:56 aidas-gsi NetworkManager[3917]: <info>   domain name 'gsi.de'
Apr  3 04:08:00 aidas-gsi dhcpd: Dynamic and static leases present for 192.168.11.117.
Apr  3 04:08:00 aidas-gsi dhcpd: Remove host declaration nnrpi2 or remove 192.168.11.117
Apr  3 04:08:00 aidas-gsi dhcpd: from the dynamic address pool for 192.168.11.0/24
Apr  3 04:08:00 aidas-gsi dhcpd: uid lease 192.168.11.104 for client b8:27:eb:40:53:e8 is duplicate on 192.168.11.0/24
Apr  3 04:08:00 aidas-gsi dhcpd: DHCPREQUEST for 192.168.11.117 from b8:27:eb:40:53:e8 via p4p1
Apr  3 04:08:00 aidas-gsi dhcpd: DHCPACK on 192.168.11.117 to b8:27:eb:40:53:e8 via p4p1
Apr  3 04:36:05 aidas-gsi dhcpd: DHCPREQUEST for 192.168.11.251 from b8:27:eb:bb:46:7b via p4p1
Apr  3 04:36:05 aidas-gsi dhcpd: DHCPACK on 192.168.11.251 to b8:27:eb:bb:46:7b via p4p1
Apr  3 04:38:00 aidas-gsi dhcpd: Dynamic and static leases present for 192.168.11.117.
Apr  3 04:38:00 aidas-gsi dhcpd: Remove host declaration nnrpi2 or remove 192.168.11.117
Apr  3 04:38:00 aidas-gsi dhcpd: from the dynamic address pool for 192.168.11.0/24
Apr  3 04:38:00 aidas-gsi dhcpd: uid lease 192.168.11.104 for client b8:27:eb:40:53:e8 is duplicate on 192.168.11.0/24
Apr  3 04:38:00 aidas-gsi dhcpd: DHCPREQUEST for 192.168.11.117 from b8:27:eb:40:53:e8 via p4p1
Apr  3 04:38:00 aidas-gsi dhcpd: DHCPACK on 192.168.11.117 to b8:27:eb:40:53:e8 via p4p1
Apr  3 04:54:49 aidas-gsi dhclient[3982]: DHCPREQUEST on eth0 to 10.99.0.13 port 67 (xid=0x2d1bd666)
Apr  3 04:54:49 aidas-gsi dhclient[3982]: DHCPACK from 10.99.0.13 (xid=0x2d1bd666)
Apr  3 04:54:49 aidas-gsi dhclient[3982]: bound to 10.99.2.56 -- renewal in 2761 seconds.
Apr  3 04:54:49 aidas-gsi NetworkManager[3917]: <info> (eth0): DHCPv4 state changed renew -> renew
Apr  3 04:54:49 aidas-gsi NetworkManager[3917]: <info>   address 10.99.2.56
Apr  3 04:54:49 aidas-gsi NetworkManager[3917]: <info>   prefix 17 (255.255.128.0)
Apr  3 04:54:49 aidas-gsi NetworkManager[3917]: <info>   gateway 10.99.0.1
Apr  3 04:54:49 aidas-gsi NetworkManager[3917]: <info>   hostname 'aida-3'
Apr  3 04:54:49 aidas-gsi NetworkManager[3917]: <info>   nameserver '140.181.96.11'
Apr  3 04:54:49 aidas-gsi NetworkManager[3917]: <info>   nameserver '140.181.96.29'
Apr  3 04:54:49 aidas-gsi NetworkManager[3917]: <info>   domain name 'gsi.de'
Apr  3 05:06:05 aidas-gsi dhcpd: DHCPREQUEST for 192.168.11.251 from b8:27:eb:bb:46:7b via p4p1
Apr  3 05:06:05 aidas-gsi dhcpd: DHCPACK on 192.168.11.251 to b8:27:eb:bb:46:7b via p4p1
Apr  3 05:07:22 aidas-gsi yum[25016]: Updated: tzdata-2019a-1.el6.noarch
Apr  3 05:07:23 aidas-gsi yum[25016]: Updated: tzdata-java-2019a-1.el6.noarch
Apr  3 05:08:00 aidas-gsi dhcpd: Dynamic and static leases present for 192.168.11.117.
Apr  3 05:08:00 aidas-gsi dhcpd: Remove host declaration nnrpi2 or remove 192.168.11.117
Apr  3 05:08:00 aidas-gsi dhcpd: from the dynamic address pool for 192.168.11.0/24
Apr  3 05:08:00 aidas-gsi dhcpd: uid lease 192.168.11.104 for client b8:27:eb:40:53:e8 is duplicate on 192.168.11.0/24
Apr  3 05:08:00 aidas-gsi dhcpd: DHCPREQUEST for 192.168.11.117 from b8:27:eb:40:53:e8 via p4p1
Apr  3 05:08:00 aidas-gsi dhcpd: DHCPACK on 192.168.11.117 to b8:27:eb:40:53:e8 via p4p1
Apr  3 05:36:05 aidas-gsi dhcpd: DHCPREQUEST for 192.168.11.251 from b8:27:eb:bb:46:7b via p4p1
Apr  3 05:36:05 aidas-gsi dhcpd: DHCPACK on 192.168.11.251 to b8:27:eb:bb:46:7b via p4p1
Apr  3 05:38:00 aidas-gsi dhcpd: Dynamic and static leases present for 192.168.11.117.
Apr  3 05:38:00 aidas-gsi dhcpd: Remove host declaration nnrpi2 or remove 192.168.11.117
Apr  3 05:38:00 aidas-gsi dhcpd: from the dynamic address pool for 192.168.11.0/24
Apr  3 05:38:00 aidas-gsi dhcpd: uid lease 192.168.11.104 for client b8:27:eb:40:53:e8 is duplicate on 192.168.11.0/24
Apr  3 05:38:00 aidas-gsi dhcpd: DHCPREQUEST for 192.168.11.117 from b8:27:eb:40:53:e8 via p4p1
Apr  3 05:38:00 aidas-gsi dhcpd: DHCPACK on 192.168.11.117 to b8:27:eb:40:53:e8 via p4p1
Apr  3 05:40:50 aidas-gsi dhclient[3982]: DHCPREQUEST on eth0 to 10.99.0.13 port 67 (xid=0x2d1bd666)
Apr  3 05:40:50 aidas-gsi dhclient[3982]: DHCPACK from 10.99.0.13 (xid=0x2d1bd666)
Apr  3 05:40:50 aidas-gsi dhclient[3982]: bound to 10.99.2.56 -- renewal in 3003 seconds.
Apr  3 05:40:50 aidas-gsi NetworkManager[3917]: <info> (eth0): DHCPv4 state changed renew -> renew
Apr  3 05:40:50 aidas-gsi NetworkManager[3917]: <info>   address 10.99.2.56
Apr  3 05:40:50 aidas-gsi NetworkManager[3917]: <info>   prefix 17 (255.255.128.0)
Apr  3 05:40:50 aidas-gsi NetworkManager[3917]: <info>   gateway 10.99.0.1
Apr  3 05:40:50 aidas-gsi NetworkManager[3917]: <info>   hostname 'aida-3'
Apr  3 05:40:50 aidas-gsi NetworkManager[3917]: <info>   nameserver '140.181.96.11'
Apr  3 05:40:50 aidas-gsi NetworkManager[3917]: <info>   nameserver '140.181.96.29'
Apr  3 05:40:50 aidas-gsi NetworkManager[3917]: <info>   domain name 'gsi.de'
Apr  3 06:06:05 aidas-gsi dhcpd: DHCPREQUEST for 192.168.11.251 from b8:27:eb:bb:46:7b via p4p1
Apr  3 06:06:05 aidas-gsi dhcpd: DHCPACK on 192.168.11.251 to b8:27:eb:bb:46:7b via p4p1
Apr  3 06:08:00 aidas-gsi dhcpd: Dynamic and static leases present for 192.168.11.117.
Apr  3 06:08:00 aidas-gsi dhcpd: Remove host declaration nnrpi2 or remove 192.168.11.117
Apr  3 06:08:00 aidas-gsi dhcpd: from the dynamic address pool for 192.168.11.0/24
Apr  3 06:08:00 aidas-gsi dhcpd: uid lease 192.168.11.104 for client b8:27:eb:40:53:e8 is duplicate on 192.168.11.0/24
Apr  3 06:08:00 aidas-gsi dhcpd: DHCPREQUEST for 192.168.11.117 from b8:27:eb:40:53:e8 via p4p1
Apr  3 06:08:00 aidas-gsi dhcpd: DHCPACK on 192.168.11.117 to b8:27:eb:40:53:e8 via p4p1
Apr  3 06:30:53 aidas-gsi dhclient[3982]: DHCPREQUEST on eth0 to 10.99.0.13 port 67 (xid=0x2d1bd666)
Apr  3 06:30:53 aidas-gsi dhclient[3982]: DHCPACK from 10.99.0.13 (xid=0x2d1bd666)
Apr  3 06:30:53 aidas-gsi dhclient[3982]: bound to 10.99.2.56 -- renewal in 3269 seconds.
Apr  3 06:30:53 aidas-gsi NetworkManager[3917]: <info> (eth0): DHCPv4 state changed renew -> renew
Apr  3 06:30:53 aidas-gsi NetworkManager[3917]: <info>   address 10.99.2.56
Apr  3 06:30:53 aidas-gsi NetworkManager[3917]: <info>   prefix 17 (255.255.128.0)
Apr  3 06:30:53 aidas-gsi NetworkManager[3917]: <info>   gateway 10.99.0.1
Apr  3 06:30:53 aidas-gsi NetworkManager[3917]: <info>   hostname 'aida-3'
Apr  3 06:30:53 aidas-gsi NetworkManager[3917]: <info>   nameserver '140.181.96.11'
Apr  3 06:30:53 aidas-gsi NetworkManager[3917]: <info>   nameserver '140.181.96.29'
Apr  3 06:30:53 aidas-gsi NetworkManager[3917]: <info>   domain name 'gsi.de'
Apr  3 06:36:05 aidas-gsi dhcpd: DHCPREQUEST for 192.168.11.251 from b8:27:eb:bb:46:7b via p4p1
Apr  3 06:36:05 aidas-gsi dhcpd: DHCPACK on 192.168.11.251 to b8:27:eb:bb:46:7b via p4p1
Apr  3 06:38:00 aidas-gsi dhcpd: Dynamic and static leases present for 192.168.11.117.
Apr  3 06:38:00 aidas-gsi dhcpd: Remove host declaration nnrpi2 or remove 192.168.11.117
Apr  3 06:38:00 aidas-gsi dhcpd: from the dynamic address pool for 192.168.11.0/24
Apr  3 06:38:00 aidas-gsi dhcpd: uid lease 192.168.11.104 for client b8:27:eb:40:53:e8 is duplicate on 192.168.11.0/24
Apr  3 06:38:00 aidas-gsi dhcpd: DHCPREQUEST for 192.168.11.117 from b8:27:eb:40:53:e8 via p4p1
Apr  3 06:38:00 aidas-gsi dhcpd: DHCPACK on 192.168.11.117 to b8:27:eb:40:53:e8 via p4p1
Apr  3 07:06:05 aidas-gsi dhcpd: DHCPREQUEST for 192.168.11.251 from b8:27:eb:bb:46:7b via p4p1
Apr  3 07:06:05 aidas-gsi dhcpd: DHCPACK on 192.168.11.251 to b8:27:eb:bb:46:7b via p4p1
Apr  3 07:08:00 aidas-gsi dhcpd: Dynamic and static leases present for 192.168.11.117.
Apr  3 07:08:00 aidas-gsi dhcpd: Remove host declaration nnrpi2 or remove 192.168.11.117
Apr  3 07:08:00 aidas-gsi dhcpd: from the dynamic address pool for 192.168.11.0/24
Apr  3 07:08:00 aidas-gsi dhcpd: uid lease 192.168.11.104 for client b8:27:eb:40:53:e8 is duplicate on 192.168.11.0/24
Apr  3 07:08:00 aidas-gsi dhcpd: DHCPREQUEST for 192.168.11.117 from b8:27:eb:40:53:e8 via p4p1
Apr  3 07:08:00 aidas-gsi dhcpd: DHCPACK on 192.168.11.117 to b8:27:eb:40:53:e8 via p4p1
Apr  3 07:25:22 aidas-gsi dhclient[3982]: DHCPREQUEST on eth0 to 10.99.0.13 port 67 (xid=0x2d1bd666)
Apr  3 07:25:22 aidas-gsi dhclient[3982]: DHCPACK from 10.99.0.13 (xid=0x2d1bd666)
Apr  3 07:25:22 aidas-gsi dhclient[3982]: bound to 10.99.2.56 -- renewal in 2773 seconds.
Apr  3 07:25:22 aidas-gsi NetworkManager[3917]: <info> (eth0): DHCPv4 state changed renew -> renew
Apr  3 07:25:22 aidas-gsi NetworkManager[3917]: <info>   address 10.99.2.56
Apr  3 07:25:22 aidas-gsi NetworkManager[3917]: <info>   prefix 17 (255.255.128.0)
Apr  3 07:25:22 aidas-gsi NetworkManager[3917]: <info>   gateway 10.99.0.1
Apr  3 07:25:22 aidas-gsi NetworkManager[3917]: <info>   hostname 'aida-3'
Apr  3 07:25:22 aidas-gsi NetworkManager[3917]: <info>   nameserver '140.181.96.11'
Apr  3 07:25:22 aidas-gsi NetworkManager[3917]: <info>   nameserver '140.181.96.29'
Apr  3 07:25:22 aidas-gsi NetworkManager[3917]: <info>   domain name 'gsi.de'
Apr  3 07:36:05 aidas-gsi dhcpd: DHCPREQUEST for 192.168.11.251 from b8:27:eb:bb:46:7b via p4p1
Apr  3 07:36:05 aidas-gsi dhcpd: DHCPACK on 192.168.11.251 to b8:27:eb:bb:46:7b via p4p1
Apr  3 07:38:00 aidas-gsi dhcpd: Dynamic and static leases present for 192.168.11.117.
Apr  3 07:38:00 aidas-gsi dhcpd: Remove host declaration nnrpi2 or remove 192.168.11.117
Apr  3 07:38:00 aidas-gsi dhcpd: from the dynamic address pool for 192.168.11.0/24
Apr  3 07:38:00 aidas-gsi dhcpd: uid lease 192.168.11.104 for client b8:27:eb:40:53:e8 is duplicate on 192.168.11.0/24
Apr  3 07:38:00 aidas-gsi dhcpd: DHCPREQUEST for 192.168.11.117 from b8:27:eb:40:53:e8 via p4p1
Apr  3 07:38:00 aidas-gsi dhcpd: DHCPACK on 192.168.11.117 to b8:27:eb:40:53:e8 via p4p1
Apr  3 08:06:05 aidas-gsi dhcpd: DHCPREQUEST for 192.168.11.251 from b8:27:eb:bb:46:7b via p4p1
Apr  3 08:06:05 aidas-gsi dhcpd: DHCPACK on 192.168.11.251 to b8:27:eb:bb:46:7b via p4p1
Apr  3 08:08:00 aidas-gsi dhcpd: Dynamic and static leases present for 192.168.11.117.
Apr  3 08:08:00 aidas-gsi dhcpd: Remove host declaration nnrpi2 or remove 192.168.11.117
Apr  3 08:08:00 aidas-gsi dhcpd: from the dynamic address pool for 192.168.11.0/24
Apr  3 08:08:00 aidas-gsi dhcpd: uid lease 192.168.11.104 for client b8:27:eb:40:53:e8 is duplicate on 192.168.11.0/24
Apr  3 08:08:00 aidas-gsi dhcpd: DHCPREQUEST for 192.168.11.117 from b8:27:eb:40:53:e8 via p4p1
Apr  3 08:08:00 aidas-gsi dhcpd: DHCPACK on 192.168.11.117 to b8:27:eb:40:53:e8 via p4p1
Apr  3 08:11:35 aidas-gsi dhclient[3982]: DHCPREQUEST on eth0 to 10.99.0.13 port 67 (xid=0x2d1bd666)
Apr  3 08:11:35 aidas-gsi dhclient[3982]: DHCPACK from 10.99.0.13 (xid=0x2d1bd666)
Apr  3 08:11:35 aidas-gsi dhclient[3982]: bound to 10.99.2.56 -- renewal in 3455 seconds.
Apr  3 08:11:35 aidas-gsi NetworkManager[3917]: <info> (eth0): DHCPv4 state changed renew -> renew
Apr  3 08:11:35 aidas-gsi NetworkManager[3917]: <info>   address 10.99.2.56
Apr  3 08:11:35 aidas-gsi NetworkManager[3917]: <info>   prefix 17 (255.255.128.0)
Apr  3 08:11:35 aidas-gsi NetworkManager[3917]: <info>   gateway 10.99.0.1
Apr  3 08:11:35 aidas-gsi NetworkManager[3917]: <info>   hostname 'aida-3'
Apr  3 08:11:35 aidas-gsi NetworkManager[3917]: <info>   nameserver '140.181.96.11'
Apr  3 08:11:35 aidas-gsi NetworkManager[3917]: <info>   nameserver '140.181.96.29'
Apr  3 08:11:35 aidas-gsi NetworkManager[3917]: <info>   domain name 'gsi.de'
Apr  3 08:36:05 aidas-gsi dhcpd: DHCPREQUEST for 192.168.11.251 from b8:27:eb:bb:46:7b via p4p1
Apr  3 08:36:05 aidas-gsi dhcpd: DHCPACK on 192.168.11.251 to b8:27:eb:bb:46:7b via p4p1
Apr  3 08:38:00 aidas-gsi dhcpd: Dynamic and static leases present for 192.168.11.117.
Apr  3 08:38:00 aidas-gsi dhcpd: Remove host declaration nnrpi2 or remove 192.168.11.117
Apr  3 08:38:00 aidas-gsi dhcpd: from the dynamic address pool for 192.168.11.0/24
Apr  3 08:38:00 aidas-gsi dhcpd: uid lease 192.168.11.104 for client b8:27:eb:40:53:e8 is duplicate on 192.168.11.0/24
Apr  3 08:38:00 aidas-gsi dhcpd: DHCPREQUEST for 192.168.11.117 from b8:27:eb:40:53:e8 via p4p1
Apr  3 08:38:00 aidas-gsi dhcpd: DHCPACK on 192.168.11.117 to b8:27:eb:40:53:e8 via p4p1
Apr  3 09:06:05 aidas-gsi dhcpd: DHCPREQUEST for 192.168.11.251 from b8:27:eb:bb:46:7b via p4p1
Apr  3 09:06:05 aidas-gsi dhcpd: DHCPACK on 192.168.11.251 to b8:27:eb:bb:46:7b via p4p1
Apr  3 09:08:00 aidas-gsi dhcpd: Dynamic and static leases present for 192.168.11.117.
Apr  3 09:08:00 aidas-gsi dhcpd: Remove host declaration nnrpi2 or remove 192.168.11.117
Apr  3 09:08:00 aidas-gsi dhcpd: from the dynamic address pool for 192.168.11.0/24
Apr  3 09:08:00 aidas-gsi dhcpd: uid lease 192.168.11.104 for client b8:27:eb:40:53:e8 is duplicate on 192.168.11.0/24
Apr  3 09:08:00 aidas-gsi dhcpd: DHCPREQUEST for 192.168.11.117 from b8:27:eb:40:53:e8 via p4p1
Apr  3 09:08:00 aidas-gsi dhcpd: DHCPACK on 192.168.11.117 to b8:27:eb:40:53:e8 via p4p1
Apr  3 09:09:10 aidas-gsi dhclient[3982]: DHCPREQUEST on eth0 to 10.99.0.13 port 67 (xid=0x2d1bd666)
Apr  3 09:09:10 aidas-gsi dhclient[3982]: DHCPACK from 10.99.0.13 (xid=0x2d1bd666)
Apr  3 09:09:10 aidas-gsi dhclient[3982]: bound to 10.99.2.56 -- renewal in 2865 seconds.
Apr  3 09:09:10 aidas-gsi NetworkManager[3917]: <info> (eth0): DHCPv4 state changed renew -> renew
Apr  3 09:09:10 aidas-gsi NetworkManager[3917]: <info>   address 10.99.2.56
Apr  3 09:09:10 aidas-gsi NetworkManager[3917]: <info>   prefix 17 (255.255.128.0)
Apr  3 09:09:10 aidas-gsi NetworkManager[3917]: <info>   gateway 10.99.0.1
Apr  3 09:09:10 aidas-gsi NetworkManager[3917]: <info>   hostname 'aida-3'
Apr  3 09:09:10 aidas-gsi NetworkManager[3917]: <info>   nameserver '140.181.96.11'
Apr  3 09:09:10 aidas-gsi NetworkManager[3917]: <info>   nameserver '140.181.96.29'
Apr  3 09:09:10 aidas-gsi NetworkManager[3917]: <info>   domain name 'gsi.de'
Apr  3 09:36:05 aidas-gsi dhcpd: DHCPREQUEST for 192.168.11.251 from b8:27:eb:bb:46:7b via p4p1
Apr  3 09:36:05 aidas-gsi dhcpd: DHCPACK on 192.168.11.251 to b8:27:eb:bb:46:7b via p4p1
Apr  3 09:38:00 aidas-gsi dhcpd: Dynamic and static leases present for 192.168.11.117.
Apr  3 09:38:00 aidas-gsi dhcpd: Remove host declaration nnrpi2 or remove 192.168.11.117
Apr  3 09:38:00 aidas-gsi dhcpd: from the dynamic address pool for 192.168.11.0/24
Apr  3 09:38:00 aidas-gsi dhcpd: uid lease 192.168.11.104 for client b8:27:eb:40:53:e8 is duplicate on 192.168.11.0/24
Apr  3 09:38:00 aidas-gsi dhcpd: DHCPREQUEST for 192.168.11.117 from b8:27:eb:40:53:e8 via p4p1
Apr  3 09:38:00 aidas-gsi dhcpd: DHCPACK on 192.168.11.117 to b8:27:eb:40:53:e8 via p4p1
Apr  3 09:53:59 aidas-gsi dhcpd: DHCPDISCOVER from d8:80:39:41:f6:b7 via p4p1
Apr  3 09:53:59 aidas-gsi dhcpd: DHCPOFFER on 192.168.11.4 to d8:80:39:41:f6:b7 via p4p1
Apr  3 09:53:59 aidas-gsi dhcpd: DHCPREQUEST for 192.168.11.4 (192.168.11.99) from d8:80:39:41:f6:b7 via p4p1
Apr  3 09:53:59 aidas-gsi dhcpd: DHCPACK on 192.168.11.4 to d8:80:39:41:f6:b7 via p4p1
Apr  3 09:53:59 aidas-gsi dhcpd: DHCPDISCOVER from d8:80:39:41:d8:21 via p4p1
Apr  3 09:53:59 aidas-gsi dhcpd: DHCPOFFER on 192.168.11.3 to d8:80:39:41:d8:21 via p4p1
Apr  3 09:53:59 aidas-gsi dhcpd: DHCPREQUEST for 192.168.11.3 (192.168.11.99) from d8:80:39:41:d8:21 via p4p1
Apr  3 09:53:59 aidas-gsi dhcpd: DHCPACK on 192.168.11.3 to d8:80:39:41:d8:21 via p4p1
Apr  3 09:53:59 aidas-gsi dhcpd: DHCPDISCOVER from d8:80:39:41:d7:cc via p4p1
Apr  3 09:53:59 aidas-gsi dhcpd: DHCPOFFER on 192.168.11.5 to d8:80:39:41:d7:cc via p4p1
Apr  3 09:53:59 aidas-gsi dhcpd: DHCPREQUEST for 192.168.11.5 (192.168.11.99) from d8:80:39:41:d7:cc via p4p1
Apr  3 09:53:59 aidas-gsi dhcpd: DHCPACK on 192.168.11.5 to d8:80:39:41:d7:cc via p4p1
Apr  3 09:53:59 aidas-gsi dhcpd: DHCPDISCOVER from d8:80:39:41:ba:2b via p4p1
Apr  3 09:53:59 aidas-gsi dhcpd: DHCPOFFER on 192.168.11.8 to d8:80:39:41:ba:2b via p4p1
Apr  3 09:53:59 aidas-gsi dhcpd: DHCPREQUEST for 192.168.11.8 (192.168.11.99) from d8:80:39:41:ba:2b via p4p1
Apr  3 09:53:59 aidas-gsi dhcpd: DHCPACK on 192.168.11.8 to d8:80:39:41:ba:2b via p4p1
Apr  3 09:53:59 aidas-gsi dhcpd: DHCPDISCOVER from d8:80:39:41:ba:8a via p4p1
Apr  3 09:53:59 aidas-gsi dhcpd: DHCPOFFER on 192.168.11.1 to d8:80:39:41:ba:8a via p4p1
Apr  3 09:53:59 aidas-gsi dhcpd: DHCPREQUEST for 192.168.11.1 (192.168.11.99) from d8:80:39:41:ba:8a via p4p1
Apr  3 09:53:59 aidas-gsi dhcpd: DHCPACK on 192.168.11.1 to d8:80:39:41:ba:8a via p4p1
Apr  3 09:53:59 aidas-gsi dhcpd: DHCPDISCOVER from d8:80:39:41:ba:22 via p4p1
Apr  3 09:53:59 aidas-gsi dhcpd: DHCPOFFER on 192.168.11.2 to d8:80:39:41:ba:22 via p4p1
Apr  3 09:53:59 aidas-gsi dhcpd: DHCPDISCOVER from d8:80:39:41:ee:72 via p4p1
Apr  3 09:53:59 aidas-gsi dhcpd: DHCPOFFER on 192.168.11.6 to d8:80:39:41:ee:72 via p4p1
Apr  3 09:53:59 aidas-gsi dhcpd: DHCPREQUEST for 192.168.11.6 (192.168.11.99) from d8:80:39:41:ee:72 via p4p1
Apr  3 09:53:59 aidas-gsi dhcpd: DHCPACK on 192.168.11.6 to d8:80:39:41:ee:72 via p4p1
Apr  3 09:53:59 aidas-gsi dhcpd: DHCPREQUEST for 192.168.11.2 (192.168.11.99) from d8:80:39:41:ba:22 via p4p1
Apr  3 09:53:59 aidas-gsi dhcpd: DHCPACK on 192.168.11.2 to d8:80:39:41:ba:22 via p4p1
Apr  3 09:54:00 aidas-gsi dhcpd: DHCPDISCOVER from d8:80:39:41:b4:0c via p4p1
Apr  3 09:54:00 aidas-gsi dhcpd: DHCPOFFER on 192.168.11.7 to d8:80:39:41:b4:0c via p4p1
Apr  3 09:54:00 aidas-gsi dhcpd: DHCPREQUEST for 192.168.11.7 (192.168.11.99) from d8:80:39:41:b4:0c via p4p1
Apr  3 09:54:00 aidas-gsi dhcpd: DHCPACK on 192.168.11.7 to d8:80:39:41:b4:0c via p4p1
Apr  3 09:54:00 aidas-gsi rpc.mountd[4324]: authenticated mount request from 192.168.11.4:666 for /home/Embedded/XilinxLinux/ppc_4xx/rfs/aida04 (/home/Embedded/XilinxLinux/ppc_4xx/rfs)
Apr  3 09:54:00 aidas-gsi rpc.mountd[4324]: authenticated mount request from 192.168.11.3:1013 for /home/Embedded/XilinxLinux/ppc_4xx/rfs/aida03 (/home/Embedded/XilinxLinux/ppc_4xx/rfs)
Apr  3 09:54:00 aidas-gsi rpc.mountd[4324]: authenticated mount request from 192.168.11.5:904 for /home/Embedded/XilinxLinux/ppc_4xx/rfs/aida05 (/home/Embedded/XilinxLinux/ppc_4xx/rfs)
Apr  3 09:54:00 aidas-gsi rpc.mountd[4324]: authenticated mount request from 192.168.11.8:890 for /home/Embedded/XilinxLinux/ppc_4xx/rfs/aida08 (/home/Embedded/XilinxLinux/ppc_4xx/rfs)
Apr  3 09:54:00 aidas-gsi rpc.mountd[4324]: authenticated mount request from 192.168.11.1:1007 for /home/Embedded/XilinxLinux/ppc_4xx/rfs/aida01 (/home/Embedded/XilinxLinux/ppc_4xx/rfs)
Apr  3 09:54:00 aidas-gsi rpc.mountd[4324]: authenticated mount request from 192.168.11.6:710 for /home/Embedded/XilinxLinux/ppc_4xx/rfs/aida06 (/home/Embedded/XilinxLinux/ppc_4xx/rfs)
Apr  3 09:54:00 aidas-gsi rpc.mountd[4324]: authenticated mount request from 192.168.11.2:727 for /home/Embedded/XilinxLinux/ppc_4xx/rfs/aida02 (/home/Embedded/XilinxLinux/ppc_4xx/rfs)
Apr  3 09:54:00 aidas-gsi rpc.mountd[4324]: authenticated mount request from 192.168.11.7:698 for /home/Embedded/XilinxLinux/ppc_4xx/rfs/aida07 (/home/Embedded/XilinxLinux/ppc_4xx/rfs)
Apr  3 09:54:00 aidas-gsi dhcpd: DHCPDISCOVER from d8:80:39:42:0d:0c via p4p1
Apr  3 09:54:00 aidas-gsi dhcpd: DHCPOFFER on 192.168.11.9 to d8:80:39:42:0d:0c via p4p1
Apr  3 09:54:00 aidas-gsi dhcpd: DHCPREQUEST for 192.168.11.9 (192.168.11.99) from d8:80:39:42:0d:0c via p4p1
Apr  3 09:54:00 aidas-gsi dhcpd: DHCPACK on 192.168.11.9 to d8:80:39:42:0d:0c via p4p1
Apr  3 09:54:00 aidas-gsi dhcpd: DHCPDISCOVER from d8:80:39:41:cf:ac via p4p1
Apr  3 09:54:00 aidas-gsi dhcpd: DHCPOFFER on 192.168.11.12 to d8:80:39:41:cf:ac via p4p1
Apr  3 09:54:00 aidas-gsi dhcpd: DHCPREQUEST for 192.168.11.12 (192.168.11.99) from d8:80:39:41:cf:ac via p4p1
Apr  3 09:54:00 aidas-gsi dhcpd: DHCPACK on 192.168.11.12 to d8:80:39:41:cf:ac via p4p1
Apr  3 09:54:00 aidas-gsi dhcpd: DHCPDISCOVER from d8:80:39:41:f6:5a via p4p1
Apr  3 09:54:00 aidas-gsi dhcpd: DHCPOFFER on 192.168.11.11 to d8:80:39:41:f6:5a via p4p1
Apr  3 09:54:00 aidas-gsi dhcpd: DHCPREQUEST for 192.168.11.11 (192.168.11.99) from d8:80:39:41:f6:5a via p4p1
Apr  3 09:54:00 aidas-gsi dhcpd: DHCPACK on 192.168.11.11 to d8:80:39:41:f6:5a via p4p1
Apr  3 09:54:00 aidas-gsi dhcpd: DHCPDISCOVER from d8:80:39:41:ee:10 via p4p1
Apr  3 09:54:00 aidas-gsi dhcpd: DHCPOFFER on 192.168.11.10 to d8:80:39:41:ee:10 via p4p1
Apr  3 09:54:00 aidas-gsi dhcpd: DHCPREQUEST for 192.168.11.10 (192.168.11.99) from d8:80:39:41:ee:10 via p4p1
Apr  3 09:54:00 aidas-gsi dhcpd: DHCPACK on 192.168.11.10 to d8:80:39:41:ee:10 via p4p1
Apr  3 09:54:01 aidas-gsi rpc.mountd[4324]: authenticated mount request from 192.168.11.9:907 for /home/Embedded/XilinxLinux/ppc_4xx/rfs/aida09 (/home/Embedded/XilinxLinux/ppc_4xx/rfs)














































































... 190 more lines ...
Attachment 2: 030419_usb.png
030419_usb.png
Attachment 3: WRerrorcheck.png
WRerrorcheck.png
Attachment 4: 030419_1051_temp.png
030419_1051_temp.png
Attachment 5: 030419_1052)bias.png
030419_1052)bias.png
Attachment 6: 030519_asiccontrol.png
030519_asiccontrol.png
Attachment 7: 030419_runcontrol.png
030419_runcontrol.png
Attachment 8: 030419_1116_stats.png
030419_1116_stats.png
Attachment 9: 030419_runcontrol_1120.png
030419_runcontrol_1120.png
Attachment 10: 030419_1343_stats.png
030419_1343_stats.png
Attachment 11: 030419_1652_stats10.png
030419_1652_stats10.png
  42   Tue Apr 2 09:42:20 2019 NHMBS Server setup

MBS is currently configured and accepting data:

x86l-94 : AIDA Foreign data receiver

x86l-4 : DESPEC Time sorter

The time sorter is complaining about AIDA time warps (around 1 Hz) it is assumed this is related to other merger / timestamping issues being worked on by Vic

  41   Tue Apr 2 07:39:44 2019 CB, TD, CATuesday 2nd April 2019
08:15 beam tuning in progress

08.30 System wide checks 

- aida06 global clock failure (check clock status)
- aida02 , aida04, aida06 fail calibration (ADC calibration)
- SYNC error counter ok
- SYNC pulse check ok
- 'collect memory information from FEE64 Linux' still returns scripting error -> will not check again until update
- WR decoder test passes
- good event statistics OK, except aida 09, 10, 11, 12 as yesterday morning (see attach 1)
- FEE temperature OK (see attach 2)
- Detector OK (see attach 3)
- NewMerger. MergerHTTPd, newMerger Terminal, data relay MBS screenshots attached (4,5,6,7)

10:37 Issues with magnets due to the new control system. Beam tuning continues

AIDA continues running OK
- aida06 global clock failure (check clock status)
- aida02 , aida04, aida06 fail calibration (ADC calibration)
- SYNC error counter ok
- SYNC pulse check ok
- WR decoder test passes
- good event statistics OK, except aida 09, 10 (see attach 8). Aida 9 & 12 rates now lower
- FEE temperature OK
- Detector OK
- Merger OK

12:21 Beam start
AIDA continues running OK
- aida06 global clock failure (check clock status)
- aida02 , aida04, aida06 fail calibration (ADC calibration)
- SYNC error counter ok
- SYNC pulse check ok
- WR decoder test passes
-ASIC check load performed
-Writing to file R11 in directory 290319
-histograms zeroed
-good event statistics OK, except aida 09, 10 (attachment 9)
-FEE temperatures ok (attachment 10)
-detector bias ok (attachment 11)

-thick degrader was placed in front of snout during beam operation

12:40 beam stop
      TapeServer stopped, file R11_0 in 290319
      TapeServer restarted, not writing to file

      low energy spectra for aida09 (attachment 12)

      high energy spectra for aida09 (attachment 13)

      high energy spectra for aida11 (attachment 14)

      1D hit patterns (stat) in aida09,10,11,12 (attachment 15)

      ASIC control settings used during beam, including thresholds (attachment 16)

14.20 *NOTE degrader setting different from yesterday, silver beam still not observed, just unidentified light ions.

      AIDA continues running OK
      aida06 global clock failure (check clock status)
      aida02 , aida04, aida06 fail calibration (ADC calibration)
      SYNC error counter ok
      SYNC pulse check ok
      WR decoder test passes

14.37 good event statistics OK, except aida 10 (attachment 17)
      detector bias ok (attachment 18)
      FEE temperatures ok (attachment 19)

14.54 Degrader removed 

16:13 AIDA continues running OK
      aida06 global clock failure (check clock status)
      aida02 , aida04, aida06 fail calibration (ADC calibration)
      SYNC error counter ok
      SYNC pulse check ok
      WR decoder test passes
      FEE64 temperatures OK
      good event statistics OK, except aida 3, 9, 10 running hot (see attach 18)

17:00 Beam start - no degrader
      AIDA running OK
      Writing on file R13
      Beam is better focused (see attach 19). Appears to be off-centre in the bottom right part of the detector
      Rates OK (see attach 20)
      DSSD bias/current OK (see attach 21)

17:21 Beam re-centred. Histograms cleared - see attach 22
      AIDA continues OK
      Run continues

      High energy spectra in aida09 (attachment 25)

      Beam rate approx 5000 ions/s

      Beam being diffused
      TapeServer start stop - AIDA writing to file R14 in 290319

17:48 1D hit patterns - beam in process of being diffused (attachment 26)

17:57 leakage current back at 1.465 uA (attachment 27)

18:08 beam stopped
      TapeServer stopped and restarted - not writing to file

      updated hit patterns from beam diffusing (attachment 28)

      aida10, ADC3 high energy spectra (attachment 29)

18.11 calibrating tpc with masks

      TapeServer stop/start R16, 290319

18.49 leakage current briefly fluctuating between ~1.2 uA and ~2 uA, but has returned to stability at ~ 1.4 uA
(attachment 30)

18.55 beam stopped for tuning - TapeServer stop/start. Not writing to file.

18.58 leakage current still stable after beam off (attachment 31)

19.10 beam start. TapeServer stop/start writing to file R18 in 290319

19.15 leakage current still ok after beam activation

19.34 fee12 high energy spectra (attachment 32)

20.35 beam stop, tapeserver stopped

      histogramming link dropped on aida 12

20.38 beam start. TapeServer start R20
      
      
Attachment 1: 71.png
71.png
Attachment 2: 72.png
72.png
Attachment 3: 73.png
73.png
Attachment 4: 74.png
74.png
Attachment 5: 75.png
75.png
Attachment 6: 76.png
76.png
Attachment 7: 76.png
76.png
Attachment 8: 78.png
78.png
Attachment 9: 020419_1227_stats.png
020419_1227_stats.png
Attachment 10: 020419_1228_temp.png
020419_1228_temp.png
Attachment 11: 020419_1230_bias.png
020419_1230_bias.png
Attachment 12: 020419_1235_lowenergyspectraaida09.png
020419_1235_lowenergyspectraaida09.png
Attachment 13: 020419_HEspectra_09(2).png
020419_HEspectra_09(2).png
Attachment 14: 040219_1257_HEspectra11.png
040219_1257_HEspectra11.png
Attachment 15: highenergyhitpatters020419_1300.png
highenergyhitpatters020419_1300.png
Attachment 16: 020419_noon_asiccontrol.png
020419_noon_asiccontrol.png
Attachment 17: 020419_1434_stats.png
020419_1434_stats.png
Attachment 18: 020419_1436_bias.png
020419_1436_bias.png
Attachment 19: 040219_1454_temp.png
040219_1454_temp.png
Attachment 20: 79.png
79.png
Attachment 21: 80.png
80.png
Attachment 22: 81.png
81.png
Attachment 23: 82.png
82.png
Attachment 24: 84.png
84.png
Attachment 25: 020419_1737_HEspectra09.png
020419_1737_HEspectra09.png
Attachment 26: 020419_1748_hitpattern.png
020419_1748_hitpattern.png
Attachment 27: 020419_1756_bias.png
020419_1756_bias.png
Attachment 28: 020419_1803_hitpattern.png
020419_1803_hitpattern.png
Attachment 29: 020419_1807_315H.png
020419_1807_315H.png
Attachment 30: 020418_1851_bias.png
020418_1851_bias.png
Attachment 31: 020419_1859_bias.png
020419_1859_bias.png
Attachment 32: 040219_1932_22h_12.png
040219_1932_22h_12.png
Attachment 33: 020419_1954_hitpatter.png
020419_1954_hitpatter.png
Attachment 34: 020419_2003_hitpattern.png
020419_2003_hitpattern.png
Attachment 35: 020419_2006_waveforms.png
020419_2006_waveforms.png
Attachment 36: 020419_2035_bias.png
020419_2035_bias.png
  40   Mon Apr 1 10:20:20 2019 CA, NH, TDMBS Relay startup
To start the MBS Data Relay, click on the top rightmost of the MIDAS icons (MBS relay, Data Relay => MBS) in
Desktop 3. (attachment 1)

This will bring up the Data Relay MBS terminal.

Ensure the path defined in the datarelaymbs is set to the correct directory (shown in attachment 2) 
Attachment 1: mbsrealaypic.png
mbsrealaypic.png
Attachment 2: mbscommand.png
mbscommand.png
  39   Mon Apr 1 10:14:09 2019 CA, NH, TDFriday 29th March 2019
16:30 good event statistics ok, with 9,10,11,12 running faster (detector FEE64s) (attachment 1)

      FEE temperatures ok (attachment 2)

      detector bias/leakage currents ok (attachment 3)

      system wide checks ok *except* FEE64 Linux memory information check causes script error,
                                     WR decoder status returns errors

      DAQ & Merger running ok

      slow comparator threshold raised to 0x64

   
Attachment 1: 290319_stats.png
290319_stats.png
Attachment 2: 290319_temp.png
290319_temp.png
Attachment 3: 290913_bias.png
290913_bias.png
  38   Mon Apr 1 08:50:35 2019 CA, TDMonday April 1st 2019 - BEAM START
09.28 System wide checks - aida06 global clock failure (check clock status)

                         - aida02 , aida04, aida06 fail calibration (ADC calibration)

                         - SYNC error counter ok

                         - SYNC pulse check ok

                         - 'collect memory information from FEE64 Linux' still returns scripting error

                         - WR decoder test passes

09.33 good event statistics ok, except aida09, aida10 running hot. (attachment 1)

      FEE temperatures ok (attachment 2)

      detector bias/leakage current ok (attachment 3)

09.38 screenshots of NewMerger tab, Merger/Tape HTTPd and NewMerger terminal (attachments 4, 5, 6)

10.05 1.8.L pulser peak spectra (attachment 7)

10.13 1.8.W waveform spectra (attachment 8)

21.13 Beam on

      AIDA DAQ running - writing to file R9 in directory 290319

      System wide checks - same as above

      good event statistics ok - although rates on 9,10,11,12 have dropped (attachment 10)

      ASIC check load performed

      FEE temperatures ok (attachment 9)

      detector bias leakage currents ok (attachment 11)

      Scintillator 41 -> approx 1000 ions/s, 11 second super cycle (beam on 10s, beam off 1s)
      c. 130-150MeV/u 107Ag ions incident on plastic scintillator + AIDA DSSSD

21.36 High energy spectra for aida09 - (attachment 12)

      High energy spectra for aida11 - (attachment 13)

      Low energy spectra - (attachment 14)

      1D hit pattern - (attachment 15)

21.53 ASIC control settings - see for slow comparator threshold, fast comparator threshold (HEC) and fast
      comparator threshold (LEC) (attachment 16)

      NewMerger screenshot - working (attachment 17)

22.00 ASIC options - including directory path to saved ASIC settings (attachment 18)

22.09 beam stop
      TapeServer stopped, restarted not writing to storage
      one complete file produced R9_0 (2.0 GB)
      plus R9_1 (154 MB)

*NOTE FROM 02/04/19 - DEGRADER in front of detector, silver beam not observed, just unidentified light ions.
Attachment 1: 010419_0930_stats.png
010419_0930_stats.png
Attachment 2: 010419_0933_temp.png
010419_0933_temp.png
Attachment 3: 010419_0933_bias.png
010419_0933_bias.png
Attachment 4: 010419_0936_mergertab.png
010419_0936_mergertab.png
Attachment 5: 010419_0937_mergerterm.png
010419_0937_mergerterm.png
Attachment 6: 010419_0938_newmergerterm.png
010419_0938_newmergerterm.png
Attachment 7: 010419_1005_18L.png
010419_1005_18L.png
Attachment 8: 101419_1013_18W.png
101419_1013_18W.png
Attachment 9: 010419_2108_temp.png
010419_2108_temp.png
Attachment 10: 010419_2109_stats.png
010419_2109_stats.png
Attachment 11: 010419_2111_bias.png
010419_2111_bias.png
Attachment 12: 010419_2136_115Haida09.png
010419_2136_115Haida09.png
Attachment 13: 010419_2139_1H_aida11.png
010419_2139_1H_aida11.png
Attachment 14: 010419_lowenergyspectra.png
010419_lowenergyspectra.png
Attachment 15: 010419_1Dhitpatternstat.png
010419_1Dhitpatternstat.png
Attachment 16: 010419_AsicSettings.png
010419_AsicSettings.png
Attachment 17: 010419_newmerger_2150.png
010419_newmerger_2150.png
Attachment 18: 010419_asicsettings.png
010419_asicsettings.png
  37   Tue Mar 26 14:59:30 2019 NH26.03.2019

Fig1: FEE temperatures from 26.03.2019  all OK

AIDA has been on today and merger setting fixed (see previous ELOG entry https://elog.ph.ed.ac.uk/DESPEC/36)

Still diagnosing issues with MBS (figure 2) but local data acquisition should be functional.

Detector has not been biased.

Attachment 1: 20190326Temps.png
20190326Temps.png
Attachment 2: aidambsrelay-error.png
aidambsrelay-error.png
  36   Tue Mar 26 14:58:09 2019 NH, VPHow to reset merger

If the merger doesn't show "xfer Links => Merger" at the top, it is probably the merger setting has been corrupted somehow. This is how to reset it

  If you go to the web page from which you started the Merge and TapeServer

    (probably    localhost:8115)

 Then select the item  NetVar Service  which is at the left hand end.

  Click on Inquire Registers

  then  enter    NetVar.MERGE.RunOptions  into the "Register Name" entry    and  when finished move the mouse out of the entry box.

 NetVar.MERGE.RunOptions will appear in the center of the top row.   (it is an item in the menu but not so easy to find)

 Click on Read and I expect you will get  0

 Type 1 into the data entry box     and click on Write

  Now return to the Merger and  click on  Reload

  The Merger State will now end as    xfer Links => Merger

 The button  Output:   will now toggle between this and   xfer links => Merger => Storage.

  35   Mon Mar 25 14:44:33 2019 NHMerger issues

Plastic electronics have now been installed.

Water is not leaking still.

FEE64s powered on at 15:00 to test MBS connection (fig1: temperatures)

MBS relay connects to MBS server OK...

AIDA Merger does not accept any data... (links with data reads 0) and lots of timestamp errors in log? (Figs 2-4)


Startup procedure incorrect?

Otherwise things still OK.

Attachment 1: Temps.png
Temps.png
Attachment 2: AIDARUNv2.png
AIDARUNv2.png
Attachment 3: Mergerv2.png
Mergerv2.png
Attachment 4: Tapev2.png
Tapev2.png
Attachment 5: MergerConsolev2.png
MergerConsolev2.png
  34   Fri Mar 22 15:44:20 2019 NHEnd of 22.03.2019

End of the day - Detector unbiased and FEE64s turned off for the weekend as they won't be monitored.

Water will remain on.

  33   Fri Mar 22 14:31:24 2019 NHA few more setup notes I forgot

Extra FEE information:

HV braid (0 V) goes into FEE10 (beam left) with LK1 jumper
HV core (-160 V) goes into FEE09 (top)

Could be related to noise in FEE09?
Both these FEEs have higher rates too

Other setup information:
According to the switch in S4, the AIDA workstation is only connected via 100Mbps rather than 1Gbps. (Fig 1)

Plastic is inside the snout, but is not yet connected to the electronics yet
Figures 2-4 Show the DSSD & Plastic in the Snout. Plastic is far upstream solely to ensure plenty of ribbon cable

Attachment 1: 20190322_132528s.jpg
20190322_132528s.jpg
Attachment 2: 20190319_131821s.jpg
20190319_131821s.jpg
Attachment 3: 20190313_161102s.jpg
20190313_161102s.jpg
Attachment 4: 20190313_155418s.jpg
20190313_155418s.jpg
  32   Fri Mar 22 13:47:32 2019 NHResolution Checks

Pulser widths of AIDA modules, resolution is fairly typical. AIDA09 still noisier than other DSSD channels.

Figure 1: Picture of pulser peaks
Figure 2: Raw waves (AIDA01 did not calibrate, so AIDA02 used instead as "non DSSD module")
Figure 3: Good Events

Fast comparator threshold (LEC/MEC) changed to 0xFF

AIDA09 seems noiser than before(?) but is known to be noisy.

AIDA01:  24.22

AIDA09: 205.21

AIDA10: 88.60

AIDA11: 63.33

AIDA12: 102.69

Attachment 1: 20190322Resolutions.png
20190322Resolutions.png
Attachment 2: 20190323Waves.png
20190323Waves.png
Attachment 3: 20190322Rates.png
20190322Rates.png
ELOG V3.1.4-unknown