Time Structure Analysis of the LHCb DAQ Network

Gianni Antichi; Marc Bruyere; Daniel Hugo Cámpora Pérez; Guoming Liu; Niko Neufeld; Stefano Giordano; Philippe Owezarski; Andrew W Moore

doi:10.1088/1742-6596/513/6/062009

Time Structure Analysis of the LHCb DAQ Network

Gianni Antichi^*, Marc Bruyere, Daniel Hugo Cámpora Pérez, Guoming Liu, Niko Neufeld, Stefano Giordano, Philippe Owezarski, Andrew W Moore

^*Corresponding author for this work

Research output: Contribution to journal › Article › Academic › peer-review

Abstract

The LHCb DAQ Network is a real time high performance network, in which 350 data sources send data over a Gigabit Ethernet LAN to more than 1500 receiving nodes. The aggregated throughput of the application, called Event Building, is more than 60 Gbps. The protocol employed by LHCb makes the sending nodes transmit simultaneously portions of events to one receiving node at a time, which is selected using a credit-token scheme. The resulting traffic is very bursty and sensitive to irregularities in the temporal distribution of packet-bursts to the same destination or region of the network.In order to study the relevant properties of such a dataflow, a non-disruptive monitoring setup based on a networking capable FPGA (Netfpga) has been deployed. The Netfpga allows order of hundred nano-second precise time-stamping of packets. We study in detail the timing structure of the Event Building communication, and we identify potential effects of micro-bursts like buffer packet drops or jitter.

Original language	English
Article number	062009
Number of pages	6
Journal	Journal of Physics: Conference Series
Volume	513
Issue number	6
DOIs	https://doi.org/10.1088/1742-6596/513/6/062009
Publication status	Published - 1 Jun 2014
Externally published	Yes

Access to Document

10.1088/1742-6596/513/6/062009Licence: CC BY

http://stacks.iop.org/1742-6596/513/i=6/a=062009?key=crossref.9051985feb442f49c7e9c404559e5abc

Cite this

@article{1cbc6a262365441fa639955563033875,

title = "Time Structure Analysis of the LHCb DAQ Network",

abstract = "The LHCb DAQ Network is a real time high performance network, in which 350 data sources send data over a Gigabit Ethernet LAN to more than 1500 receiving nodes. The aggregated throughput of the application, called Event Building, is more than 60 Gbps. The protocol employed by LHCb makes the sending nodes transmit simultaneously portions of events to one receiving node at a time, which is selected using a credit-token scheme. The resulting traffic is very bursty and sensitive to irregularities in the temporal distribution of packet-bursts to the same destination or region of the network.In order to study the relevant properties of such a dataflow, a non-disruptive monitoring setup based on a networking capable FPGA (Netfpga) has been deployed. The Netfpga allows order of hundred nano-second precise time-stamping of packets. We study in detail the timing structure of the Event Building communication, and we identify potential effects of micro-bursts like buffer packet drops or jitter.",

author = "Gianni Antichi and Marc Bruyere and {C{\'a}mpora P{\'e}rez}, {Daniel Hugo} and Guoming Liu and Niko Neufeld and Stefano Giordano and Philippe Owezarski and Moore, {Andrew W}",

year = "2014",

month = jun,

day = "1",

doi = "10.1088/1742-6596/513/6/062009",

language = "English",

volume = "513",

journal = "Journal of Physics: Conference Series",

issn = "1742-6588",

publisher = "IOP Publishing Ltd.",

number = "6",

}

TY - JOUR

T1 - Time Structure Analysis of the LHCb DAQ Network

AU - Antichi, Gianni

AU - Bruyere, Marc

AU - Cámpora Pérez, Daniel Hugo

AU - Liu, Guoming

AU - Neufeld, Niko

AU - Giordano, Stefano

AU - Owezarski, Philippe

AU - Moore, Andrew W

PY - 2014/6/1

Y1 - 2014/6/1

N2 - The LHCb DAQ Network is a real time high performance network, in which 350 data sources send data over a Gigabit Ethernet LAN to more than 1500 receiving nodes. The aggregated throughput of the application, called Event Building, is more than 60 Gbps. The protocol employed by LHCb makes the sending nodes transmit simultaneously portions of events to one receiving node at a time, which is selected using a credit-token scheme. The resulting traffic is very bursty and sensitive to irregularities in the temporal distribution of packet-bursts to the same destination or region of the network.In order to study the relevant properties of such a dataflow, a non-disruptive monitoring setup based on a networking capable FPGA (Netfpga) has been deployed. The Netfpga allows order of hundred nano-second precise time-stamping of packets. We study in detail the timing structure of the Event Building communication, and we identify potential effects of micro-bursts like buffer packet drops or jitter.

AB - The LHCb DAQ Network is a real time high performance network, in which 350 data sources send data over a Gigabit Ethernet LAN to more than 1500 receiving nodes. The aggregated throughput of the application, called Event Building, is more than 60 Gbps. The protocol employed by LHCb makes the sending nodes transmit simultaneously portions of events to one receiving node at a time, which is selected using a credit-token scheme. The resulting traffic is very bursty and sensitive to irregularities in the temporal distribution of packet-bursts to the same destination or region of the network.In order to study the relevant properties of such a dataflow, a non-disruptive monitoring setup based on a networking capable FPGA (Netfpga) has been deployed. The Netfpga allows order of hundred nano-second precise time-stamping of packets. We study in detail the timing structure of the Event Building communication, and we identify potential effects of micro-bursts like buffer packet drops or jitter.

U2 - 10.1088/1742-6596/513/6/062009

DO - 10.1088/1742-6596/513/6/062009

M3 - Article

SN - 1742-6588

VL - 513

JO - Journal of Physics: Conference Series

JF - Journal of Physics: Conference Series

IS - 6

M1 - 062009

ER -