September 2021 - Bird-users

Re: BIRD trying to reinsert existing kernel routes, netlink issue?
by Zhaofeng Li 18 Feb '22

18 Feb '22

I know this was an old thread, but would really appreciate if anyone is interested in digging in deeper. I can confirm the exact same behavior happens to me on NixOS with the 5.4.69 kernel but not on 4.19.149. BIRD 2.0.7 on 5.4.69 would incessantly attempt to insert the same routes, rendering birdc unusable as it was presumably taking up so much time in the main loop (it was receiving an IPv4 full table over iBGP as well). While it was doing that, it stopped announcing the prefixes of stub interfaces to OSPF neighbors. Thanks, Zhaofeng Li On Sun, Aug 2, 2020, at 17:36 PM, Sasha Romijn wrote: > Hello, > I’m running into a rather complex issue where BIRD tries to reinsert routes into the kernel routing table that are already in there. I’m at the point of suspecting a netlink bug in the 5.x linux kernel. However, I may be entirely off, and would like to hear what people with more BIRD and/or netlink expertise think about it. > My setup is bird 2.0.7 on Ubuntu 20.04. I’ve been able to reproduce this with the default 5.4.0-42-generic kernel as well as the ubuntu mainline 5.7.0-050700-generic kernel. This bird instance has an IBGP peering with another bird 2.0.7 instance, which sends an IPv4 full table. The IBGP peering is set up over a GRE tunnel. There is no other routing software running. I am seeing this issue on another server too, ubuntu 20.04 with 5.4.0-42-generic. A third one with ubuntu 18.04 and a 4.15.0-20-generic kernel, is fine.

3 2

Route Flapping and Bird - RFD and MRAI
by Douglas Fischer 16 Feb '22

16 Feb '22

Hello all. Last weeks I'm noticing the increase the increase of BGP messages on some routers that I have access to. Specially those connected to IXPs with a considerable number of participants. I Checked and the BGP process has increased a bit the use of CPU Also. So, I suspect that Route-Servers are receiving and forwarding Route Flaps from one or more participants... I know that the right place to fix that would be on the source of those flaps... But... Considering IXPs with one ou two thousand participants, there will always be someone flapping some routes. Bird is widely used as the BGP engine on IXP route-servers. And exactly because of that I came here to ask about Route Flap avoidance mechanisms on Bird. The discussion of methods to avoid Route Flapping in BGP is very controversial. - RFD - Route Flapping Dampening comes and goes. - MRAI is not a consensus, but there is a lot of effort on that, including som magic algorithms define some variable interval according to conditions. - I even saw some ultra-rigorous ideas like rate limiting the BGP messages... Before I come here to bore you with this, I searched a bit on mail list and documentation of Bird and I found the links bellow related to that: There is any work running to deal with that route-flapping question? https://bird.network.cz/ - 7.1 Future work <https://bird.network.cz/?get_doc&v=20&f=bird-7.html> Question about BGP advertisement-interval in BIRD <http://trubka.network.cz/pipermail/bird-users/2020-August/014786.html> [BGP] MRAI connection-based implementation review <http://trubka.network.cz/pipermail/bird-users/2020-April/014433.html> Route Flap Dampening <http://trubka.network.cz/pipermail/bird-users/2019-July/013589.html> [BGP] bird and RFD <http://trubka.network.cz/pipermail/bird-users/2020-May/014612.html> Thank you all! -- Douglas Fernando Fischer Engº de Controle e Automação

3 4

BGP strict bind socket error
by Ben Tremblay 09 Jan '22

09 Jan '22

Hi all, I have encountered a problem with how BIRD opens the listening socket for strict bind BGP. In particular, BIRD sometimes tries to open the listening socket for the protocol when the configured local IP is not yet present on the interface. It seems that BIRD will try to bind the BGP socket to the configured IP if any address exists on the protocol interface that can be used to reach the neighbor. Let me give an example to clarify. I have a minimal reproducible example with the following BGP configuration: router id 192.168.0.1; protocol device { scan time 10; } protocol bgp bgp_01 { ipv4 { import all; export all; }; debug all; local 192.168.0.1 port 179 as 1; neighbor 192.168.0.2 port 179 as 1; interface "host1"; direct; strict bind yes; } Given this configuration, I can reproduce the problem behaviour by starting the protocol with no addressing on the host1 interface and then adding an address which includes the neighbor IP in its subnet, e.g. 192.168.0.3/24. Once this address/route is added, BIRD logs the following: Jan 07 12:09:31 router03 bird[57497]: bgp_01: Neighbor ready Jan 07 12:09:31 router03 bird[57497]: bgp_01: Socket error: bind: Cannot assign requested address Jan 07 12:09:31 router03 bird[57497]: bgp_01: Cannot open listening socket And the protocol enters an error state: BIRD 2.0.6 ready. Name Proto Table State Since Info device1 Device --- up 11:55:51.049 bgp_01 BGP --- down 12:09:31.264 Error: No listening socket The reason this error is so problematic for me is that the protocol cannot recover from this state without administrative intervention (e.g. configuring bird or restarting the protocol). So, I have two questions: 1. Is this correct behaviour? 2. Can I configure BIRD so that my protocol is able to recover after suffering a socket error like this? I should also mention I can actually observe this socket error occur when adding the 'correct' address to the protocol interface, but only in the context of a larger application and only some of the time. Thanks, Ben

4 12

[BIRD 2.0.x] Netlink: ignore dead routes
by Vincent Bernat 09 Jan '22

09 Jan '22

With net.ipv4.conf.XXX.ignore_routes_with_linkdown sysctl, a user can ensure the kernel does not use a route whose target interface is down. The route is marked with a "dead"/RTNH_F_DEAD flag. Currently, BIRD still uses and distributes this route. This patch just ignores such a route. This patch could be backported to 1.6.x. Signed-off-by: Vincent Bernat <vincent(a)bernat.ch> --- sysdep/linux/netlink.c | 3 +++ 1 file changed, 3 insertions(+) diff --git a/sysdep/linux/netlink.c b/sysdep/linux/netlink.c index f85bcf35685b..c28126510e6e 100644 --- a/sysdep/linux/netlink.c +++ b/sysdep/linux/netlink.c @@ -1690,6 +1690,9 @@ nl_parse_route(struct nl_parse_state *s, struct nlmsghdr *h) if (i->rtm_flags & RTNH_F_ONLINK) ra->nh.flags |= RNF_ONLINK; + if (i->rtm_flags & RTNH_F_DEAD) + return; + neighbor *nbr; nbr = neigh_find(&p->p, ra->nh.gw, ra->nh.iface, (ra->nh.flags & RNF_ONLINK) ? NEF_ONLINK : 0); -- 2.28.0

5 15

Possibility to treat /32 and /128 non-gateway routes as onlink on BSD?
by Stefan Haller 27 Dec '21

27 Dec '21

Hi everyone, In a recent change in the FreeBSD Wireguard kernel module the POINTTOPOINT interface flag is dropped for wg interfaces[1]. This behaviour will probably not change, because Wireguard is not peer-to-peer or a broadcast domain, but peer-to-multipoint. Hence my previous configuration of setting peer addresses on the interface is not working anymore: ifconfig wg0 inet 192.168.0.10/32 192.168.0.4 The above syntax is for POINTTOPOINT interfaces. In this case 192.168.0.10 is the local address of the interface and 192.168.0.4 is the address of the remote peer. So if one does not want to add a dedicated subnet to every tunnel device, one has to add static host routes similar to these ones: ifconfig wg0 192.168.0.10/32 route add 192.168.0.4 -iface wg0 Note that this actually models the real world better, because Wireguard is not point-to-point but point-to-multipoint. So multiple peers can be done in the following way: ifconfig wg0 192.168.0.10/32 route add 192.168.0.4 -iface wg0 route add 192.168.0.8 -iface wg0 However, this does not work with bird 2.0.8: bird will not recognize the p2p peer addresses as gateways and it will log on kernel table rescan: KRT: Received route 192.168.42.0/24 with strange next-hop 192.168.0.4 KRT: Error sending route 192.168.42.0/24 to kernel: File exists I did have a look why this is happening: bird discards the route, because the gateway does not belong to any of its interface's addresses (the peer address is configured as a static host route and not on the interface). At the same time it forgets that it was bird itself who added the route (because the route is discarded on kernel table rescan, it thinks it is absent in the kernel table but present in bird's internal routing table -> "add" logic triggers) and tries to add the route again (instead of replacing/keeping the route). This explains the cascade of error messages above. While the Linux netlink code allows to handle onlink routes, this functionality is absent in the BSD code path. Unfortunately, on BSD there is no dedicated flag to mark routes as being directly connected onlink routes. On Linux one could add an onlink route like so: ip route add 192.168.0.4 via 192.168.0.4 dev wg0 onlink The command looks quite odd, but it is working. The via clause is necessary in conjunction with onlink. Afterwards a `birdc dump neighbors` verifies that the peer is recognized: 000055db793035c0 192.168.0.4 wg0 wg0 kernel1 000000000000000000000000 scope univ ONLINK (Also the "strange next-hop" message will go away.) I created a patch that emulates the behaviour on FreeBSD. In this patch the onlink setting is heuristically determined by inspecting the RTF_GATEWAY flag (which must be absent) and checking for a /32 or /128 prefix length. I do not see how to handle cases where the destination is a subnet. The patch was tested on FreeBSD 13.0-RELEASE and 14.0-CURRENT. During rescan of the kernel table the above route is now not dropped because the gateway is recognized to be onlink. While in the Linux route the gateway is still set, on FreeBSD it is unset (~RTF_GATEWAY). So I actually use the destination address of the route, because that's the address of the peer. While I tested the functionality on my machines and also checked the output of `birdc dump neighbors`, the patch might be faulty. Please be kind with me and treat it more as a proof of concept. As I am not experienced with bird's code base I do not fully understand how the neighbor cache is working in detail, so the suggested patch might have unexpected side effects. I would appreciate feedback. In case you think the whole idea is not sensible, I would also love to hear suggestions how to get the above setup working. Kind regards, Stefan [1]: https://git.zx2c4.com/wireguard-freebsd/commit/?id=8801509656e955c27ebf4b9b… sysdep/bsd/krt-sock.c | 6 ++++++ 1 file changed, 6 insertions(+) diff --git a/sysdep/bsd/krt-sock.c b/sysdep/bsd/krt-sock.c index ea0cc4d9..4a0f3a7a 100644 --- a/sysdep/bsd/krt-sock.c +++ b/sysdep/bsd/krt-sock.c @@ -547,6 +547,12 @@ krt_read_route(struct ks_msg *msg, struct krt_proto *p, int scan) net->n.addr, a.nh.gw); return; } + } else if ((!ipv6 && pxlen == 32) || (ipv6 && pxlen == 128)) { + /* Treat non gateway /32 and /128 routes as onlink routes and inject this + information into neighbor cache. */ + if (!neigh_find(&p->p, idst, a.nh.iface, NEF_ONLINK)) + log(L_ERR, "KRT: Failed to inject onlink neighbor %I for interface %s", + idst, a.nh.iface->name); } done: -- 2.31.1

2 5

[patch] Add contextual out-of-bound checks in RTR Prefix PDU handler
by Job Snijders 18 Dec '21

18 Dec '21

Hi, A broken RPKI Cache could contextually underflow or overflow the Max Length value in RTR IPv4 / IPv6 Prefix PDUs. Below is a changeset proposal which adds specific out-of-bounds checks and schedules a reconnect for a later moment. This aligns BIRD's behavior with other COTS BGP implementations. RFC 6810 and RFC 8210 specify that the "Max Length" value MUST NOT be less than the Prefix Length element (underflow). On the other side overflow of the Max Length element also is possible, it being an 8-bit unsigned integer allows for values larger than 32 or 128. When a PDU is received where the Max Length field is corrputed, the RTR client (BIRD) should immediately terminate the session, flush all data learned from that cache, and log an error for the operator. If this condition is hit, it seems better to follow the same approach as for RPKI_CS_ERROR_TRANSPORT, because rpki_force_restart_proto() causes an "as fast as possible" reconnect loop between BIRD and the RPKI Cache server, which increases resource consumption on both sides. Kind regards, Job diff --git proto/rpki/packets.c proto/rpki/packets.c index dd11f997..09e20f38 100644 --- proto/rpki/packets.c +++ proto/rpki/packets.c @@ -737,6 +737,22 @@ rpki_handle_prefix_pdu(struct rpki_cache *cache, const struct pdu_header *pdu) net_addr_union addr = {}; rpki_prefix_pdu_2_net_addr(pdu, &addr); + if (type == IPV4_PREFIX) { + if (addr.roa4.max_pxlen > IP4_MAX_PREFIX_LENGTH || addr.roa4.max_pxlen < addr.roa4.pxlen) { + RPKI_WARN(cache->p, "Received a corrupted packet from cache server"); + rpki_send_error_pdu(cache, CORRUPT_DATA, pdu->len, pdu, "Corrupted PDU"); + rpki_cache_change_state(cache, RPKI_CS_ERROR_FATAL); + return RPKI_ERROR; + } + } else { + if (addr.roa6.max_pxlen > IP6_MAX_PREFIX_LENGTH || addr.roa6.max_pxlen < addr.roa6.pxlen) { + RPKI_WARN(cache->p, "Received a corrupted packet from cache server"); + rpki_send_error_pdu(cache, CORRUPT_DATA, pdu->len, pdu, "Corrupted PDU"); + rpki_cache_change_state(cache, RPKI_CS_ERROR_FATAL); + return RPKI_ERROR; + } + } + if (cf->ignore_max_length) { if (type == IPV4_PREFIX) diff --git proto/rpki/rpki.c proto/rpki/rpki.c index ab0837f3..91b69da0 100644 --- proto/rpki/rpki.c +++ proto/rpki/rpki.c @@ -288,9 +288,6 @@ rpki_cache_change_state(struct rpki_cache *cache, const enum rpki_cache_state ne case RPKI_CS_ERROR_FATAL: /* Fatal protocol error occurred. */ - rpki_force_restart_proto(cache->p); - break; - case RPKI_CS_ERROR_TRANSPORT: /* Error on the transport socket occurred. */ rpki_close_connection(cache);

2 5

bgp_large_community wildcard in conditional
by Brooks Swinnerton 18 Oct '21

18 Oct '21

Hello, I was wondering if it's possible to create a conditional that matches on a wildcard for a part of a BGP large community. For example: if ([*, 600, 6939]) ~ bgp_large_community then reject; This currently results in a syntax error at the position of the comma after the *.

5 7

bird-2.0.8 in Debian testing
by Jakub Ružička 03 Oct '21

03 Oct '21

Hello Community, latest bird2-2.0.8 is now available from Debian testing (and unstable) \o/ HOWTO get on Debian bullseye: echo "deb http://deb.debian.org/debian testing main" >> /etc/apt/sources.list apt update apt -t testing install bird2 # TEST ALL THE THINGS This can be backported into bullseye-backports. Cheers, Jakub Ružička CZ.NIC packager 📦

3 2

OSPF on OpenBSD
by Bastien Durel 30 Sep '21

30 Sep '21

Hello, I'm trying to use bird to replace ospfd on OpenBSD, but it seems to have a strange effect on the networking stack :( I've tried multiple times, from OpenBSD 6.6 to 6.9, with bird2 (2.0.8 now) Here is my bird config: openbsd-test# cat /etc/bird.conf|grep -v ^#|grep -v '^$' log "/var/log/bird.log" { debug, trace, info, remote, warning, error, auth, fatal, bug }; router id 10.42.42.69; debug protocols all; protocol device { } protocol direct { disabled; # Disable by default ipv4; # Connect to default IPv4 table ipv6; # ... and to default IPv6 table } protocol kernel { ipv4 { # Connect protocol to IPv4 table by channel export all; # Export to protocol. default is export none }; } protocol kernel { ipv6 { export all; }; } protocol static { ipv4; # Again, IPv4 channel with default options } protocol ospf v2 ospfv2 { rfc1583compat yes; tick 2; ipv4 {}; area 0 { interface "em0" { cost 5; }; }; } And the em0 config: em0: flags=248843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,AUTOCONF6TEMP,AUTOC ONF6> mtu 1500 lladdr 08:00:27:d6:6e:dd index 1 priority 0 llprio 3 groups: egress media: Ethernet autoselect (1000baseT full-duplex) status: active inet6 fe80::a00:27ff:fed6:6edd%em0 prefixlen 64 scopeid 0x1 inet 10.42.42.69 netmask 0xffffff00 broadcast 10.42.42.255 Before starting bird, I have a simple routing table : openbsd-test# route -n show - inet Routing tables Internet: Destination Gateway Flags Refs Use Mtu Prio Iface default 10.42.42.1 UGS 6 12 - 8 em0 224/4 127.0.0.1 URS 0 0 32768 8 lo0 10.42.42/24 10.42.42.69 UCn 2 0 - 4 em0 10.42.42.1 40:62:31:07:55:11 UHLch 1 2 - 3 em0 10.42.42.21 00:25:22:1e:0b:b7 UHLc 0 1 - 3 em0 10.42.42.69 08:00:27:d6:6e:dd UHLl 0 4 - 1 em0 10.42.42.255 10.42.42.69 UHb 0 0 - 1 em0 127/8 127.0.0.1 UGRS 0 0 32768 8 lo0 127.0.0.1 127.0.0.1 UHhl 1 2 32768 1 lo0 When bird is started, it inserts routes as intended: openbsd-test# route -n show -inet Routing tables Internet: Destination Gateway Flags Refs Use Mtu Prio Iface default 10.42.42.1 UGS 5 314 - 8 em0 default 10.42.42.1 UG1 0 0 - 56 em0 224/4 127.0.0.1 URS 0 19 32768 8 lo0 5.39.65.35 10.42.42.1 UGH1 0 0 - 56 em0 10.0.42.21 10.42.42.21 UGH1 0 0 - 56 em0 10.2.0/24 10.42.42.1 UG1 0 0 - 56 em0 10.42.0/24 10.42.42.1 UG1 0 0 - 56 em0 10.42.1.56/30 10.42.42.21 UG1 0 0 - 56 em0 10.42.1.64/30 10.42.42.21 UG1 0 0 - 56 em0 10.42.7.6 10.42.42.21 UGH1 0 0 - 56 em0 10.42.7.7 10.42.42.21 UGH1 0 0 - 56 em0 10.42.7.53 10.42.42.21 UGH1 0 0 - 56 em0 10.42.42/24 10.42.42.69 U1h 66 193 - 56 em0 10.42.42.69 08:00:27:d6:6e:dd UHLl 0 104 - 1 em0 10.42.42.255 10.42.42.69 UHb 0 13 - 1 em0 10.60.77.5 10.42.42.1 UGH1 0 0 - 56 em0 [...] But after that, the box cannot join anythin with IPv4. Established connections (eg. ssh) over IPv4 fails. Even the gateway is unreachable: openbsd-test# ping 10.42.42.1 PING 10.42.42.1 (10.42.42.1): 56 data bytes ping: sendmsg: Invalid argument ping: wrote 10.42.42.1 64 chars, ret=-1 ping: sendmsg: Invalid argument ping: wrote 10.42.42.1 64 chars, ret=-1 ^C --- 10.42.42.1 ping statistics --- 2 packets transmitted, 0 packets received, 100.0% packet loss With no ospfv3 configured, ipv6 connections are not lost dmesg returns theses messages : arp_rtrequest: bad gateway value: em0 arpresolve: 10.42.42.1: route contains no arp information arpresolve: 10.42.42.0: route contains no arp information arpresolve: 10.42.42.1: route contains no arp information The last ones beeing flooded when the box tries to send packets Whatever bird makes to the networking stack persists even if bird is shut down. A reboot is necessary to recover. On OpenBSD mailing list, someone said the problem may be bird overwriting the 10.42.42/24 route (which was directly connected) by another (the flags changed from UCn to U1h) After stopping bird, flags and prios are not restored (10.42.42/24 gets U1 / prio 56), and the default route kept is the one bird inserted openbsd-test# route -n show -inet Routing tables Internet: Destination Gateway Flags Refs Use Mtu Prio Iface default 10.42.42.1 UG1 2 2 - 56 em0 224/4 127.0.0.1 URS 0 13 32768 8 lo0 10.42.42/24 10.42.42.69 U1 0 76 - 56 em0 10.42.42.69 08:00:27:d6:6e:dd UHLl 0 23 - 1 em0 10.42.42.255 10.42.42.69 UHb 0 6 - 1 em0 127/8 127.0.0.1 UGRS 0 0 32768 8 lo0 127.0.0.1 127.0.0.1 UHhl 1 2 32768 1 lo0 Do you know how to prevent that ? Thanks, -- Bastien

3 3

Bird2 not distributing IPv6 address on dummy to OSPF
by Blažej Krajňák 28 Sep '21

28 Sep '21

Hello, I just installed fresh Debian 11 server and I need to distribute IPv6 /128 address from dummy1 interface to OSPF. Direct protocol see that address, but neighbour not. Am I missing something? ip -6 route 2a02:6ca3:0:2::25 dev dummy1 proto bird metric 32 pref medium 2a02:6ca3:0:2::25 dev dummy1 proto kernel metric 256 pref medium bird> show route table master6 Table master6: 2a02:6ca3:0:2::25/128 unicast [ospf2 00:32:34.008] I (150/0) [172.20.12.25] dev dummy1 log syslog all; router id 172.20.12.25; protocol device { } protocol direct { disabled; # Disable by default ipv4; # Connect to default IPv4 table ipv6; # ... and to default IPv6 table } protocol kernel { ipv4 { export all; }; } protocol kernel { ipv6 { export all; }; } protocol static { ipv4; } protocol static { ipv6; } protocol ospf v2 { ipv4 { import all; }; area 0 { interface "ens192" { type broadcast; }; interface "dummy1" { stub; }; }; } protocol ospf v3 { ipv6 { import all; }; area 0 { interface "ens192" { type broadcast; }; interface "dummy1" { stub; }; }; }

3 3