Help with Route Reflector and BGP multipath.
Hi. We are using bird for BGP/OSPF routing on our FreeBSD routers/firewalls for quite some time now. I'm trying to setup linux server load-balancing using ExaBGP, and bird as Route-Reflectors. Between the bird machines and linux servers, we got Force10 L3 switchs, also setup as route-reflector clients. I have no problem setting up the BGP sessions, bird receives both routes from the 2 servers. But I can't manage to have the L3 switchs getting both routes in return. birdc's "show route export bgp_sw3" only shows one of the 2 routes. I tried enabling add-path without success. Maybe I'm missing something ? Thanks for your help. -- Arnaud Houdelette-Langlois Administrateur des infrastructures systèmes et réseaux
W dniu 3.03.2023 o 14:30, Arnaud Houdelette-Langlois pisze:
Hi.
We are using bird for BGP/OSPF routing on our FreeBSD routers/firewalls for quite some time now.
I'm trying to setup linux server load-balancing using ExaBGP, and bird as Route-Reflectors.
Between the bird machines and linux servers, we got Force10 L3 switchs, also setup as route-reflector clients.
I have no problem setting up the BGP sessions, bird receives both routes from the 2 servers. But I can't manage to have the L3 switchs getting both routes in return.
birdc's "show route export bgp_sw3" only shows one of the 2 routes.
I tried enabling add-path without success. Maybe I'm missing something ?
Thanks for your help.
-- Arnaud Houdelette-Langlois Administrateur des infrastructures systèmes et réseaux
BIRD under FreeBSD supports multipath, but not the standard rtsock build. For achieving your aim you have to run BIRD 2.0.12 built with bsd-netlink target[1]. Building and running netlink flavor of BIRD under FreeBSD requires 13.2-RC1 or later. [1] https://bird.network.cz/pipermail/bird-users/2022-December/016412.html -- Marek Zarychta
Thanks for your answer. That's was an expected one, but as I send routes to another router and not to the kernel i would have expected that this would not have been an issue. I will try to update bird. Do you know if BSD port is up to date ? Le 3 mars 2023 15:53:15 GMT+01:00, Marek Zarychta <zarychtam@plan-b.pwste.edu.pl> a écrit :
W dniu 3.03.2023 o 14:30, Arnaud Houdelette-Langlois pisze:
Hi.
We are using bird for BGP/OSPF routing on our FreeBSD routers/firewalls for quite some time now.
I'm trying to setup linux server load-balancing using ExaBGP, and bird as Route-Reflectors.
Between the bird machines and linux servers, we got Force10 L3 switchs, also setup as route-reflector clients.
I have no problem setting up the BGP sessions, bird receives both routes from the 2 servers. But I can't manage to have the L3 switchs getting both routes in return.
birdc's "show route export bgp_sw3" only shows one of the 2 routes.
I tried enabling add-path without success. Maybe I'm missing something ?
Thanks for your help.
-- Arnaud Houdelette-Langlois Administrateur des infrastructures systèmes et réseaux
BIRD under FreeBSD supports multipath, but not the standard rtsock build. For achieving your aim you have to run BIRD 2.0.12 built with bsd-netlink target[1]. Building and running netlink flavor of BIRD under FreeBSD requires 13.2-RC1 or later.
[1] https://bird.network.cz/pipermail/bird-users/2022-December/016412.html
-- Marek Zarychta
W dniu 3.03.2023 o 16:27, Arnaud Houdelette-Langlois pisze:
That's was an expected one, but as I send routes to another router and not to the kernel i would have expected that this would not have been an issue. I will try to update bird. I might be wrong and misleading you then. Perhaps someone from BIRD developers can shed more light on this, but if you can give try building 2.0.12 with netlink support. Do you know if BSD port is up to date ?
No, it's still 2.0.11 in ports, but you can use the patch from bugzilla[1]. You'll need the most recent 13-STABLE or 14-CURRENT built or 13.2-RC1 to build and run netlink flavor or the port. [1] https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=269553 -- Marek Zarychta
What's your `show protocols all` output for the BIRD side for the sessions with the switches, to confirm BIRD is advertising add-path TX and the switches advertising add-path RX? Do you see ADD-PATH capabilities showing up properly both on the local and neighbor capabilities (TX for local capabilities; RX neighbor capabilities (switches)?) On Fri, Mar 3, 2023 at 7:49 AM Marek Zarychta <zarychtam@plan-b.pwste.edu.pl> wrote:
W dniu 3.03.2023 o 16:27, Arnaud Houdelette-Langlois pisze:
That's was an expected one, but as I send routes to another router and not to the kernel i would have expected that this would not have been an issue. I will try to update bird. I might be wrong and misleading you then. Perhaps someone from BIRD developers can shed more light on this, but if you can give try building 2.0.12 with netlink support. Do you know if BSD port is up to date ?
No, it's still 2.0.11 in ports, but you can use the patch from bugzilla[1]. You'll need the most recent 13-STABLE or 14-CURRENT built or 13.2-RC1 to build and run netlink flavor or the port.
[1] https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=269553 <https://isolate-menlo.menlosecurity.com/0/eJyrViotylGyUsooKSkottLXTypNL9ZLK0pNTSpO0csvSgcJVGXm5CTqF2fkl8cDeXrJ6Zn2mSm2RmaWpqbGSjpKRflKVoY6SiWZKUBzDE0szZVqARLCG8c>
-- Marek Zarychta
Thanks for your answer. The switches weren't properly configured. I managed to get multipath working. At least with ipv4. When enabling "add paths" on ipv6 channel, I get an "Received: Invalid OPEN message" error (although the switch is advertising the capability). I wont blame bird yet, as ExaBGP peers dont care at all. to be continued ... Arnaud Houdelette-Langlois Administrateur des infrastructures systèmes et réseaux Normandie Université +33 2 31 56 69 54 Le 04/03/2023 à 00:29, Hugo Slabbert a écrit :
What's your `show protocols all` output for the BIRD side for the sessions with the switches, to confirm BIRD is advertising add-path TX and the switches advertising add-path RX? Do you see ADD-PATH capabilities showing up properly both on the local and neighbor capabilities (TX for local capabilities; RX neighbor capabilities (switches)?)
On Fri, Mar 3, 2023 at 7:49 AM Marek Zarychta <zarychtam@plan-b.pwste.edu.pl> wrote:
W dniu 3.03.2023 o 16:27, Arnaud Houdelette-Langlois pisze: > That's was an expected one, but as I send routes to another router and > not to the kernel i would have expected that this would not have been > an issue. I will try to update bird. I might be wrong and misleading you then. Perhaps someone from BIRD developers can shed more light on this, but if you can give try building 2.0.12 with netlink support. > Do you know if BSD port is up to date ?
No, it's still 2.0.11 in ports, but you can use the patch from bugzilla[1]. You'll need the most recent 13-STABLE or 14-CURRENT built or 13.2-RC1 to build and run netlink flavor or the port.
[1] https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=269553
-- Marek Zarychta
participants (3)
-
Arnaud Houdelette-Langlois -
Hugo Slabbert -
Marek Zarychta