High-speed zero-copy data transfer for DAQ applications

16th International workshop on Advanced Computing and Analysis Techniques in physics research

物理学;计算机科学

Pisani, Flavio^1,2 ; Pérez, Daniel Hugo Cámpora^1 ; Neufeld, Niko^1

CERN, Geneva 23

CH-1211, Switzerland^1

Dipartimento di Fisica, Università Degli Studi di Roma la Sapienza, Piazzale Aldo Moro 5, Roma

00185, Italy^2

关键词: High throughput;    Measurements of;    Memory bandwidths;    Network Capacity;    Network configuration;    Remote direct memory access;    Test applications;    Transport layers;   

Others  :  https://iopscience.iop.org/article/10.1088/1742-6596/608/1/012028/pdf
DOI  :  10.1088/1742-6596/608/1/012028

学科分类：计算机科学（综合）

来源: IOP

【 摘 要 】

The LHCb Data Acquisition (DAQ) will be upgraded in 2020 to a trigger-free readout. In order to achieve this goal we will need to connect around 500 nodes with a total network capacity of 32 Tb/s. To get such an high network capacity we are testing zero-copy technology in order to maximize the theoretical link throughput without adding excessive CPU and memory bandwidth overhead, leaving free resources for data processing resulting in less power, space and money used for the same result. We develop a modular test application which can be used with different transport layers. For the zero-copy implementation we choose the OFED IBVerbs API because it can provide low level access and high throughput. We present throughput and CPU usage measurements of 40 GbE solutions using Remote Direct Memory Access (RDMA), for several network configurations to test the scalability of the system.