BIRD is taking too much time to converge 106362 prefixes from a non-client iBGP neighbor
Dear Concern, After installing BIRD, I made iBGP neighbor with 8 routers. From a non-client neighbor it should receive about 106362 prefixes but I found it is taking huge time to process and converge the mentioned prefixes. It took about 35 minutes to process, converge and advertise prefixes to other neighbors. Is it normal behavior or am I missing sometime to make faster convergence? Kindly suggest me. Related configuration parts are given below (actual IP and names are changed): router id <local_ip>; vpn4 table vpntab4; template bgp template_rr_non_client { local <local_ip> as as_number; neighbor as as_number; vpn4 mpls { table vpntab4; import all; export all; }; } protocol bgp <non_client_neighbor> from template_rr_non_client { neighbor non_client_neighbor_ip; } template bgp template_rr_client2 { local <local_ip> as as_number; neighbor as as_number; rr client; rr cluster id <local_ip>; vpn4 mpls { table vpntab4; import all; export all; }; } # protocol bgp client1 from template_rr_client2 { neighbor client1_ip; . . . } protocol bgp client7 from template_rr_client2 { neighbor client7_ip; } Thanks & Regards Saifullah Nasar Connecting our future with light
On Wed, Apr 12, 2023 at 10:19:29PM +0600, saifullah@fiberathome.net wrote:
Dear Concern,
After installing BIRD, I made iBGP neighbor with 8 routers. From a non-client neighbor it should receive about 106362 prefixes but I found it is taking huge time to process and converge the mentioned prefixes. It took about 35 minutes to process, converge and advertise prefixes to other neighbors. Is it normal behavior or am I missing sometime to make faster convergence? Kindly suggest me.
Hi That is definitely not a normal behavior. Especially if you have no filters, it should be orders of magnitude faster. You wrote you receive 106k prefixes from the non-client, do you also receive prefixes from clients? Are you sure that BIRD was working full-time (full single core cpu load) during that 35 minutes? If you monitor number of received routes during that time (using 'show route count table vpntab4' or 'show protocols all <non_client_neighbor>'), you can see if all these prefixes are already here or if they arrive continuously dyring that time. -- Elen sila lumenn' omentielvo Ondrej 'Santiago' Zajicek (email: santiago@crfreenet.org) OpenPGP encrypted e-mails preferred (KeyID 0x11DEADC3, wwwkeys.pgp.net) "To err is human -- to blame it on a computer is even more so."
Hi, Thanks for your feedback. The topology is BIRD is connected with total 8 neighbors (1 is non-client and 7 are in client mode) for my setup. The non-client neighbor is actually a high end central RR router which advertise about 106k prefixes to BIRD and with other 7 client, the prefix count is below 100. 1. During that time, I have checked and found that CPU load was normal. 2. I also checking prefix count using command "show protocols all <non_client_neighbor>" and found prefixes were increasing gradually. In think I am missing something to make the prefix learning faster. Pls help me. Thanks & Regards Abu Nasar Md. Saifullah -----Original Message----- From: Ondrej Zajicek <santiago@crfreenet.org> Sent: Thursday, April 13, 2023 8:16 PM To: saifullah@fiberathome.net Cc: bird-users@network.cz Subject: Re: BIRD is taking too much time to converge 106362 prefixes from a non-client iBGP neighbor On Wed, Apr 12, 2023 at 10:19:29PM +0600, saifullah@fiberathome.net wrote:
Dear Concern,
After installing BIRD, I made iBGP neighbor with 8 routers. From a non-client neighbor it should receive about 106362 prefixes but I found it is taking huge time to process and converge the mentioned prefixes. It took about 35 minutes to process, converge and advertise prefixes to other neighbors. Is it normal behavior or am I missing sometime to make faster convergence? Kindly suggest me.
Hi That is definitely not a normal behavior. Especially if you have no filters, it should be orders of magnitude faster. You wrote you receive 106k prefixes from the non-client, do you also receive prefixes from clients? Are you sure that BIRD was working full-time (full single core cpu load) during that 35 minutes? If you monitor number of received routes during that time (using 'show route count table vpntab4' or 'show protocols all <non_client_neighbor>'), you can see if all these prefixes are already here or if they arrive continuously dyring that time. -- Elen sila lumenn' omentielvo Ondrej 'Santiago' Zajicek (email: santiago@crfreenet.org) OpenPGP encrypted e-mails preferred (KeyID 0x11DEADC3, wwwkeys.pgp.net) "To err is human -- to blame it on a computer is even more so." Connecting our future with light
On Thu, Apr 13, 2023 at 11:47:12PM +0600, saifullah@fiberathome.net wrote:
Hi,
Thanks for your feedback. The topology is BIRD is connected with total 8 neighbors (1 is non-client and 7 are in client mode) for my setup. The non-client neighbor is actually a high end central RR router which advertise about 106k prefixes to BIRD and with other 7 client, the prefix count is below 100.
1. During that time, I have checked and found that CPU load was normal. 2. I also checking prefix count using command "show protocols all <non_client_neighbor>" and found prefixes were increasing gradually.
Hi If CPU was normal (idle), then it is unlikely an issue with BIRD. Prefixes are processed as they arrive, so they are delayed only if BIRD cannot catch up and use 100% CPU (note that it is single-threaded, so you have to check load on individual CPUs and not aggregate load, like is default in 'top'). Perhaps the other side send prefixes slowly? -- Elen sila lumenn' omentielvo Ondrej 'Santiago' Zajicek (email: santiago@crfreenet.org) OpenPGP encrypted e-mails preferred (KeyID 0x11DEADC3, wwwkeys.pgp.net) "To err is human -- to blame it on a computer is even more so."
Hi Dear, Thank you for your feedback. The server I am using of 16 VCPU with 2 threads per CPU and 16 GB RAM. I found that CPU utilizations is crossing 100% in a CPU. Any way to install and configure BIRD so that it uses all CPU simultaneously? Thanks & Regards Abu Nasar Md. Saifullah -----Original Message----- From: Ondrej Zajicek <santiago@crfreenet.org> Sent: Monday, April 17, 2023 6:17 PM To: saifullah@fiberathome.net Cc: bird-users@network.cz Subject: Re: BIRD is taking too much time to converge 106362 prefixes from a non-client iBGP neighbor On Thu, Apr 13, 2023 at 11:47:12PM +0600, saifullah@fiberathome.net wrote:
Hi,
Thanks for your feedback. The topology is BIRD is connected with total 8 neighbors (1 is non-client and 7 are in client mode) for my setup. The non-client neighbor is actually a high end central RR router which advertise about 106k prefixes to BIRD and with other 7 client, the prefix count is below 100.
1. During that time, I have checked and found that CPU load was normal. 2. I also checking prefix count using command "show protocols all <non_client_neighbor>" and found prefixes were increasing gradually.
Hi If CPU was normal (idle), then it is unlikely an issue with BIRD. Prefixes are processed as they arrive, so they are delayed only if BIRD cannot catch up and use 100% CPU (note that it is single-threaded, so you have to check load on individual CPUs and not aggregate load, like is default in 'top'). Perhaps the other side send prefixes slowly? -- Elen sila lumenn' omentielvo Ondrej 'Santiago' Zajicek (email: santiago@crfreenet.org) OpenPGP encrypted e-mails preferred (KeyID 0x11DEADC3, wwwkeys.pgp.net) "To err is human -- to blame it on a computer is even more so." Connecting our future with light
Hi, Another point is my setup is Ubuntu 22.04.2 LTS with VCPU 16 and RAM 16GB. Thanks & Regards Saifullah Nasar -----Original Message----- From: saifullah@fiberathome.net <saifullah@fiberathome.net> Sent: Thursday, April 13, 2023 11:47 PM To: 'Ondrej Zajicek' <santiago@crfreenet.org> Cc: 'bird-users@network.cz' <bird-users@network.cz> Subject: RE: BIRD is taking too much time to converge 106362 prefixes from a non-client iBGP neighbor Hi, Thanks for your feedback. The topology is BIRD is connected with total 8 neighbors (1 is non-client and 7 are in client mode) for my setup. The non-client neighbor is actually a high end central RR router which advertise about 106k prefixes to BIRD and with other 7 client, the prefix count is below 100. 1. During that time, I have checked and found that CPU load was normal. 2. I also checking prefix count using command "show protocols all <non_client_neighbor>" and found prefixes were increasing gradually. In think I am missing something to make the prefix learning faster. Pls help me. Thanks & Regards Abu Nasar Md. Saifullah -----Original Message----- From: Ondrej Zajicek <santiago@crfreenet.org> Sent: Thursday, April 13, 2023 8:16 PM To: saifullah@fiberathome.net Cc: bird-users@network.cz Subject: Re: BIRD is taking too much time to converge 106362 prefixes from a non-client iBGP neighbor On Wed, Apr 12, 2023 at 10:19:29PM +0600, saifullah@fiberathome.net wrote:
Dear Concern,
After installing BIRD, I made iBGP neighbor with 8 routers. From a non-client neighbor it should receive about 106362 prefixes but I found it is taking huge time to process and converge the mentioned prefixes. It took about 35 minutes to process, converge and advertise prefixes to other neighbors. Is it normal behavior or am I missing sometime to make faster convergence? Kindly suggest me.
Hi That is definitely not a normal behavior. Especially if you have no filters, it should be orders of magnitude faster. You wrote you receive 106k prefixes from the non-client, do you also receive prefixes from clients? Are you sure that BIRD was working full-time (full single core cpu load) during that 35 minutes? If you monitor number of received routes during that time (using 'show route count table vpntab4' or 'show protocols all <non_client_neighbor>'), you can see if all these prefixes are already here or if they arrive continuously dyring that time. -- Elen sila lumenn' omentielvo Ondrej 'Santiago' Zajicek (email: santiago@crfreenet.org) OpenPGP encrypted e-mails preferred (KeyID 0x11DEADC3, wwwkeys.pgp.net) "To err is human -- to blame it on a computer is even more so." Connecting our future with light
Hi, One more information. The prefixes here are actually vpnv4 prefixes. Is there any known slow convergence issue with VPNv4 prefixes for high count like 106K? Thanks & Regards Abu Nasar Md. Saifullah -----Original Message----- From: saifullah@fiberathome.net <saifullah@fiberathome.net> Sent: Thursday, April 13, 2023 11:51 PM To: 'Ondrej Zajicek' <santiago@crfreenet.org> Cc: 'bird-users@network.cz' <bird-users@network.cz> Subject: RE: BIRD is taking too much time to converge 106362 prefixes from a non-client iBGP neighbor Hi, Another point is my setup is Ubuntu 22.04.2 LTS with VCPU 16 and RAM 16GB. Thanks & Regards Saifullah Nasar -----Original Message----- From: saifullah@fiberathome.net <saifullah@fiberathome.net> Sent: Thursday, April 13, 2023 11:47 PM To: 'Ondrej Zajicek' <santiago@crfreenet.org> Cc: 'bird-users@network.cz' <bird-users@network.cz> Subject: RE: BIRD is taking too much time to converge 106362 prefixes from a non-client iBGP neighbor Hi, Thanks for your feedback. The topology is BIRD is connected with total 8 neighbors (1 is non-client and 7 are in client mode) for my setup. The non-client neighbor is actually a high end central RR router which advertise about 106k prefixes to BIRD and with other 7 client, the prefix count is below 100. 1. During that time, I have checked and found that CPU load was normal. 2. I also checking prefix count using command "show protocols all <non_client_neighbor>" and found prefixes were increasing gradually. In think I am missing something to make the prefix learning faster. Pls help me. Thanks & Regards Abu Nasar Md. Saifullah -----Original Message----- From: Ondrej Zajicek <santiago@crfreenet.org> Sent: Thursday, April 13, 2023 8:16 PM To: saifullah@fiberathome.net Cc: bird-users@network.cz Subject: Re: BIRD is taking too much time to converge 106362 prefixes from a non-client iBGP neighbor On Wed, Apr 12, 2023 at 10:19:29PM +0600, saifullah@fiberathome.net wrote:
Dear Concern,
After installing BIRD, I made iBGP neighbor with 8 routers. From a non-client neighbor it should receive about 106362 prefixes but I found it is taking huge time to process and converge the mentioned prefixes. It took about 35 minutes to process, converge and advertise prefixes to other neighbors. Is it normal behavior or am I missing sometime to make faster convergence? Kindly suggest me.
Hi That is definitely not a normal behavior. Especially if you have no filters, it should be orders of magnitude faster. You wrote you receive 106k prefixes from the non-client, do you also receive prefixes from clients? Are you sure that BIRD was working full-time (full single core cpu load) during that 35 minutes? If you monitor number of received routes during that time (using 'show route count table vpntab4' or 'show protocols all <non_client_neighbor>'), you can see if all these prefixes are already here or if they arrive continuously dyring that time. -- Elen sila lumenn' omentielvo Ondrej 'Santiago' Zajicek (email: santiago@crfreenet.org) OpenPGP encrypted e-mails preferred (KeyID 0x11DEADC3, wwwkeys.pgp.net) "To err is human -- to blame it on a computer is even more so." Connecting our future with light
Hi, Can you anyone please help me? Kindly. Thanks & Regards Abu Nasar Md. Saifullah -----Original Message----- From: saifullah@fiberathome.net <saifullah@fiberathome.net> Sent: Saturday, April 15, 2023 1:54 AM To: 'Ondrej Zajicek' <santiago@crfreenet.org>; 'bird-users@network.cz' <bird-users@network.cz> Subject: RE: BIRD is taking too much time to converge 106362 prefixes from a non-client iBGP neighbor Hi, One more information. The prefixes here are actually vpnv4 prefixes. Is there any known slow convergence issue with VPNv4 prefixes for high count like 106K? Thanks & Regards Abu Nasar Md. Saifullah -----Original Message----- From: saifullah@fiberathome.net <saifullah@fiberathome.net> Sent: Thursday, April 13, 2023 11:51 PM To: 'Ondrej Zajicek' <santiago@crfreenet.org> Cc: 'bird-users@network.cz' <bird-users@network.cz> Subject: RE: BIRD is taking too much time to converge 106362 prefixes from a non-client iBGP neighbor Hi, Another point is my setup is Ubuntu 22.04.2 LTS with VCPU 16 and RAM 16GB. Thanks & Regards Saifullah Nasar -----Original Message----- From: saifullah@fiberathome.net <saifullah@fiberathome.net> Sent: Thursday, April 13, 2023 11:47 PM To: 'Ondrej Zajicek' <santiago@crfreenet.org> Cc: 'bird-users@network.cz' <bird-users@network.cz> Subject: RE: BIRD is taking too much time to converge 106362 prefixes from a non-client iBGP neighbor Hi, Thanks for your feedback. The topology is BIRD is connected with total 8 neighbors (1 is non-client and 7 are in client mode) for my setup. The non-client neighbor is actually a high end central RR router which advertise about 106k prefixes to BIRD and with other 7 client, the prefix count is below 100. 1. During that time, I have checked and found that CPU load was normal. 2. I also checking prefix count using command "show protocols all <non_client_neighbor>" and found prefixes were increasing gradually. In think I am missing something to make the prefix learning faster. Pls help me. Thanks & Regards Abu Nasar Md. Saifullah -----Original Message----- From: Ondrej Zajicek <santiago@crfreenet.org> Sent: Thursday, April 13, 2023 8:16 PM To: saifullah@fiberathome.net Cc: bird-users@network.cz Subject: Re: BIRD is taking too much time to converge 106362 prefixes from a non-client iBGP neighbor On Wed, Apr 12, 2023 at 10:19:29PM +0600, saifullah@fiberathome.net wrote:
Dear Concern,
After installing BIRD, I made iBGP neighbor with 8 routers. From a non-client neighbor it should receive about 106362 prefixes but I found it is taking huge time to process and converge the mentioned prefixes. It took about 35 minutes to process, converge and advertise prefixes to other neighbors. Is it normal behavior or am I missing sometime to make faster convergence? Kindly suggest me.
Hi That is definitely not a normal behavior. Especially if you have no filters, it should be orders of magnitude faster. You wrote you receive 106k prefixes from the non-client, do you also receive prefixes from clients? Are you sure that BIRD was working full-time (full single core cpu load) during that 35 minutes? If you monitor number of received routes during that time (using 'show route count table vpntab4' or 'show protocols all <non_client_neighbor>'), you can see if all these prefixes are already here or if they arrive continuously dyring that time. -- Elen sila lumenn' omentielvo Ondrej 'Santiago' Zajicek (email: santiago@crfreenet.org) OpenPGP encrypted e-mails preferred (KeyID 0x11DEADC3, wwwkeys.pgp.net) "To err is human -- to blame it on a computer is even more so." Connecting our future with light
participants (2)
-
Ondrej Zajicek -
saifullah＠fiberathome.net