Dec 8 – 10, 2021
America/New_York timezone

EJFAT - A Joint ESnet / JLAB prototype load balancer for large scale DAQ processing

Dec 10, 2021, 10:30 AM
25m
DAQ, Future & Test Plans DAQ, Future & Test Plans

Speaker

Yatish Kumar (ESNET)

Description

Jlab and ESnet jointly identified a need for terabit scale data processing of DAQ data from new large scale accelerator facilities. Most DOE instruments are evolving to provide 100's of gigabits to many terabits of raw data, which needs to be processed in hundreds of hardware accelerated DSP equipped servers for event extraction and data set recording. In this talk we describe the implications on IP based protocols used to transport this data, as well as a trigger and event aware load balancer that can sort data with nanosecond trigger granularity and direct it to a flexible cloud of processing elements. The load balancer can be implemented in hardware with a combination of FPGAs and terabit data center top of rack switches.

Primary author

Presentation materials