Workshop IX on Streaming Readout

Dec 8, 2021, 9:00 AM → Dec 10, 2021, 6:15 PM America/New_York

Welcome to Workshop IX on Streaming Readout

The workshop will be held online from December 8-10, 2021

The purpose of this workshop is to bring together researchers interested in detector design, electronics, data acquisition, and analysis to present and discuss ways to realize a streaming readout system for future nuclear and particle physics experiments.

Streaming readout leverages the advances in electronics and computing to achieve continuous readout of all detector signals without requiring a "trigger" as was common in traditional readout schemes.  This enables detector signal processing, zero suppression, and extraction of signal information (amplitude, timing, integrated charge, etc.) using ASIC chips or FPGAs in parallel on the data streams with unbiased event selection and reconstruction downstream with online computer processing in clusters of CPUs or GPUs.

Almost all future experiments, particularly future EIC experiments, will use streaming readout in some form.  Furthermore, many existing experiments are converting to a streaming readout paradigm.  The purpose for this workshop is to present current work and plans, illustrate existing designs and available hardware, and to discuss signal processing, data formats, software libraries, and networking. The goal is to achieve a common streaming readout framework that can be used by many experiments.

Everyone is welcome to attend, listen, and participate in the discussion but we are very interested in the work you are doing in this area and invite you to give a brief (20 minute) presentation on your detector, expected data rate, and readout strategy.  Please submit an abstract, using the link to the left, or contact schambachjj@ornl.gov if you would be willing to give a presentation.

---

7 Dec 2021: Registration for the workshop is now closed. Everyone registered for the workshop should have received an email with the zoom link for the sessions. If you registered and have not received this email, please contact us directly via email.

 

A read only version of the live notes google doc that was collected throughout the workshop can be found here.

Wednesday Recordings (passcode: 1=Hc57AD)

Thursday Recordings (passcode: j*#a?c4+)

Friday Recordings (passcode: 29BG3@b?)

---

Here is a link to the previous workshop held at MIT in April this year.

 

JinsScreenshot.png

Screenshot 2021-12-08 120104.jpg

Screenshot 2021-12-08 120129.jpg

Screen Shot 2021-12-08 at 12.01.06.png

Workshop VIII at MIT earlier this year

Wednesday, December 8

9:00 AM → 12:00 PM Detector Status Updates 1

Convener: Joachim Schambach (Oak Ridge National Laboratory)

9:00 AM Welcome

Speaker: Dr Joachim Schambach (Oak Ridge National Laboratory)

SRO_Welcome.pptx

9:15 AM ALICE Streaming Readout

Speaker: Filippo Costa (CERN)

ALICE_v2.pptx

9:45 AM LHCb: Trigger-less Readout at 40 MHz

Speakers: Aristeidis Fkiaras (CERN), Niko Neufeld (CERN)

LHCb_ Trigger-less Readout at 40Mhz (1).pdf

10:15 AM The readout system of the DUNE experiment

The Deep Underground Neutrino Experiment (DUNE) is a neutrino experiment under construction with a near detector at Fermilab and a far detector at the Sanford Underground Research Facility that will observe neutrinos produced at Fermilab. The far detector electronics are streaming out a constant rate of ADC data at 2 MHz. As the signals can be very small, no zero suppression is applied. The new technical design of the DAQ system for the experiment has major differences compared to its prototypes. Its interfaces with the front-end electronics rely on high-speed I/O cards that are hosted in commodity servers. Data is received over DMA to memory buffers dedicated to the devices, from where it is serialized and moved to a parallel processing pipeline that implements data driven algorithms like hit-finding or calibration and error handling. After that, data is stored in high-performance software buffers. The parallelized request-response domain answers to data requests, based on unique identifiers (e.g.: timestamp) in the front-end frames. The latency buffer lookup mechanism copies out the requested data and forms responses with additional metadata. This experiment must also be capable of persisting, upon a specific request, incoming data for up to 100 seconds, with a throughput of 1.5 TB/s, for an aggregate size of 150 TB. The modular nature of the apparatus enables splitting the problem into 150 identical units operating in parallel, each at 10 GB/s. These numbers correspond to one detector super module. Two are planned for initial construction and four is the final configuration of the experiment. In order to maintain the performance requirements of such a system, a generic, modular and scalable readout system was designed and developed.

Speaker: Roland Sipos (CERN)

DUNEDAQ-Readout-StreamingReadout-Workshop2021.pdf

10:45 AM Virtual Coffee Break

11:00 AM A novel continuous readout for the NA62 data acquisition system

Speaker: Marco Boretto (CERN)

08-12-21 A novel continuous readout for the NA62 data acquisition system - Streaming Readout conference.pdf

11:30 AM Free-running data acquisition system for the AMBER experiment

Triggered data acquisition systems provide only limited possibilities of triggering methods. In our paper, we propose a novel approach that completely removes the hardware trigger and its logic. It introduces an innovative free-running mode instead, which provides unprecedented possibilities to physics experiments. We would like to present such system, which is being developed for the AMBER experiment at CERN. It is based on an intelligent data acquisition framework including FPGA modules and advanced software processing. The system provides a triggerless mode that allows more time for data filtering and implementation of more complex algorithms. Moreover, it utilises a custom data protocol optimized for needs of the free-running system. The filtering procedure takes place in a server farm playing the role of the highlevel trigger. For this purpose, we introduce a high-performance filtering framework providing optimized algorithms and load balancing to cope with excessive data rates. Furthermore, this paper also describes the filter pipeline as well as the simulation chain that is being used for production of artificial data, for testing, and validation.

Speaker: Mr Martin Zemko (CERN)

Zemko-AMBER_DAQ.pdf

12:00 PM → 12:15 PM Group Photo

12:15 PM → 1:30 PM Lunch

1:30 PM → 5:05 PM Detector Status Updates 2

Convener: Dr Douglas Hasell (MIT)

1:30 PM The readout system of the CBM experiment

Speaker: Dr David Emschermann (GSI)

20211208_169_sro9_cbm_daq_v02.pdf

2:00 PM CLAS12 Streaming Readout

Speaker: Patrick Moran (MIT)

CLAS12_SRO_Fall2021.pdf

2:30 PM Streaming Mode Data Acquisition and Data Processing at the Jefferson Lab

Speaker: Vardan Gyurjyan

sro-IX.pptx

3:00 PM Virtual Coffee Break

3:30 PM Simple and Scalable Streaming: The GRETA Data Pipeline

Speaker: Mario Cromaz (LBNL)

greta-streaming.pdf

4:00 PM sPHENIX Streaming Readout

Speaker: Martin Purschke (BNL)

SRO_sPHENIX_Purschke.pptx

4:30 PM Discussion on Detector Updates

Speaker: Dr Douglas Hasell (MIT)

Thursday, December 9

9:00 AM → 12:30 PM Computing, Data Rates

Conveners: Joe Osborn (ORNL), Markus Diefenthaler (Jefferson Lab)

9:00 AM LHCb Data Processing and Allen

Speaker: Dorothea Vom Bruch (CNRS Marseille)

LHCb_data_processing_and_Allen_vomBruch_v2.pdf

9:30 AM ALICE Online-Offline

Speaker: David Rohr (CERN)

2021-12-09 Streaming Readout Workshop O2.pdf

10:00 AM ATHENA Computing Model

Speaker: Jeff Landgraf (Brookhaven National Laboratory)

Athena DAQ Streaming Readout IX.pptx

10:30 AM ECCE Computing Model

Speaker: David Lawrence (Jefferson Lab)

2021.12.09.ecce_computing_SRO_IX (1).pdf

Google Slides

11:00 AM Exascale Role

Speaker: Ana Gainaru (Oak Ridge National Laboratory)

2021_12_09.pptx

11:30 AM AI Resources for EIC

Speaker: Dylan Rankin (MIT)

ai_resources_streaming_dsr.pdf

12:00 PM Discussion Session

Speakers: Joe Osborn (ORNL), Markus Diefenthaler (Jefferson Lab)

ComputingDiscussion.pdf

2:00 PM → 5:20 PM Hardware Vendors

Convener: Mr Chris Cuevas (Jefferson Lab)

2:00 PM Future Perspectives of Digital DAQ

Speaker: Dr Yuri Venturini (CAEN)

PerspectiveDAQ_EIC_streaming_Dec_2021.pdf

2:30 PM A new front-end ASIC for MPGDs at EIC

Speaker: Dr Damien Neyret (CEA)

NewChip_SRworkshop_20211209.pdf

3:00 PM CAEN QDC and Digitizers from the 2019 test beam period

Speaker: Ivica Friščić (Department of Physics, PMF, University of Zagreb)

CAEN QDC and Digitizers_TPEX_IF.pdf

3:30 PM 32-Channel ASICS for SRO

Speaker: Dr Dalius Baranauskas (Pacific Microchip Corp)

Pacific Microchip_StreamingReadout_WorkshopIX_120921.pdf

4:00 PM Alphacore's Mixed-Signal IC Update

Speaker: Dr Esko Mikkola (Alphacore)

Alphacore_Streaming.pdf

4:30 PM Nalu HDSoC Update

Speaker: Dr Isar Mostafanezhad (Nalu Scientific, LLC)

2021-Dec- Nalu - Streaming DAQ workshop Slides.pdf

Friday, December 10

9:30 AM → 3:30 PM DAQ, Future & Test Plans: Data Acquisition, Future & Test Plans

Conveners: David Abbott (Jefferson Lab), Jin Huang (Brookhaven National Lab)

9:30 AM TriDAS SRO Framework

Trigger and Data Acquisition System, or TriDAS for short, is a triggerless streaming readout software developed initially for the NEMO neutrino telescope project. Since then, thanks to its scalability and modularity, the system has been adapted to collect data from different phases of the project and also from other detectors. In summer 2020, TriDAS was used to implement a prototype streaming readout data-taking with the CLAS12 detector, at JLAB. These days, a new TriDAS version is under development for the integration in the ERSAP microservices architecture. This implementation sketches preliminary studies toward the streaming readout for the EIC project.

Speaker: Ms Laura Cappelli (INFN - CNAF)

Cappelli-Tridas-SROW.pdf

10:00 AM Scalable Online Processing for Trigger-less DAQ

Speaker: Jacopo Pazzini

StreamingReadoutWorkshopIX_2021-12-10.pdf

10:30 AM EJFAT - A Joint ESnet / JLAB prototype load balancer for large scale DAQ processing

Jlab and ESnet jointly identified a need for terabit scale data processing of DAQ data from new large scale accelerator facilities. Most DOE instruments are evolving to provide 100's of gigabits to many terabits of raw data, which needs to be processed in hundreds of hardware accelerated DSP equipped servers for event extraction and data set recording. In this talk we describe the implications on IP based protocols used to transport this data, as well as a trigger and event aware load balancer that can sort data with nanosecond trigger granularity and direct it to a flexible cloud of processing elements. The load balancer can be implemented in hardware with a combination of FPGAs and terabit data center top of rack switches.

Speaker: Yatish Kumar (ESNET)

EJFAT slides.pdf

11:00 AM Break

11:15 AM Development of FELIX for DAQ System for Nuclear and Particle Physics experiments

Speaker: Hao Xu (Brookhaven National Laboratory)

FELIX_Hao_20211210V1.2.pdf

11:45 AM Machine Learning for HF identification in sPHENIX and EIC Streaming Readout

Speaker: Cameron Dean (Los Alamos National Laboratory)

ML_with_SRO_C_Dean_20211210.pdf

12:20 PM Lunch

1:30 PM INTERSECT

Speaker: Ben Mintz (ORNL)

20211210_INTERSECT_ORNL_StreamingData_Workshop.pdf

2:00 PM Real-time Machine Learning at BNL CSI

Speaker: Yihui Ren (Brookhaven National Laboratory)

RTML_BNL_yren.pdf

2:30 PM Discussion: challenges and opportunities in high noise/background mitigation

Speakers: Jan Bernauer (Stony Brook University), Jin Huang (Brookhaven National Lab)

SRO.pdf

3:00 PM Closeout

Speaker: Joe Osborn (ORNL)

SRO9CloseOut.pdf