Re: FOSDEM 2024 talk recording - Flying higher: hardware offloading with BIRD
Hi Tim, Thanks for posting. On 2/20/24 09:14, Tim Small wrote:
If anyone is looking to reproduce this setup, then ConnectX 5 NICs (both 25Gb and 100Gb) seem to be available used on online auction sites from around 150 Euro.
The talk was a bit crammed for time, but the next speaker didn't show up, so we unexpectedly had time for questions. Once I get the last bit's done, I will do a more detailed blog post, about the setup we are making at my hackerspace Labitat (AS2052350), for that we also need forwarding to directly connected hosts and reverse path filtering. One of the last slides has a picture of this setup, with a thin client and a ConnectX-5 running at <15W while doing 10G routing (DAC). Currently I am trying to fix kernel performance, for the non-offloaded long-tail traffic: https://lore.kernel.org/netdev/20240215160458.1727237-1-ast@fiberby.net/ -- Best regards Asbjørn Sloth Tønnesen
On Tue, Feb 20, 2024 at 10:22:00AM +0000, Asbjørn Sloth Tønnesen wrote:
Hi Tim,
The talk was a bit crammed for time, but the next speaker didn't show up, so we unexpectedly had time for questions.
Once I get the last bit's done, I will do a more detailed blog post, about the setup we are making at my hackerspace Labitat (AS2052350), for that we also need forwarding to directly connected hosts and reverse path filtering. One of the last slides has a picture of this setup, with a thin client and a ConnectX-5 running at <15W while doing 10G routing (DAC).
Hi Thanks for the post, that seems like an interesting way to do high-performance forwarding. Is is possible to use this approach when a packet is forwarded between NICs (or at least between multiple ports on one NIC)? So it seems there are at least three ways how to do high-performance forwarding with Linux and BIRD: 1) White-box routers with hardware forwarding plane 2) VPP dataplane 3) tc-based rules that are offloaded to NIC -- Elen sila lumenn' omentielvo Ondrej 'Santiago' Zajicek (email: santiago@crfreenet.org) "To err is human -- to blame it on a computer is even more so."
Hi Ondrej, On 2/22/24 2:08 PM, Ondrej Zajicek wrote:
Is is possible to use this approach when a packet is forwarded between NICs (or at least between multiple ports on one NIC)?
It depends on the hardware, in case of ConnectX, then no. Each port is a isolated NIC, they just happen to be in the same chip. AFAIK they don't have a link between them, at least the firmware doesn't support it. In the case of Spectrum it is possible: https://github.com/Mellanox/mlxsw/wiki/ACLs#mirroring-packets https://github.com/Mellanox/mlxsw/wiki/Port-Mirroring I don't have the full overview of which hardware has which capabilities, as it requires understanding all of the individual kernel drivers. $ git grep FLOW_DISSECTOR_KEY_ -- Best regards Asbjørn Sloth Tønnesen
participants (2)
-
Asbjørn Sloth Tønnesen -
Ondrej Zajicek