<html><head><meta http-equiv="Content-Type" content="text/html; charset=us-ascii"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">Hi,<div class=""><br class=""></div><div class="">There is a known issue with with Open vSwitch (OVS) performance with BGP.</div><div class="">Even without OVS we hit IRQ (too many) issue on "physical" network in our KVM</div><div class="">environment.</div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""><div class="">Official OVS quote:</div><div class=""><pre class="" style="white-space: pre-wrap; background-color: rgb(255, 255, 255);">><i class=""> We'd accept patches to improve OVS's routing table code. It's not
</i>><i class=""> designed to scale to 1,800,000 routes. We'd also take code to suppress
</i>><i class=""> the routing table code in cases where it isn't actually needed, since
</i>><i class=""> it's not always needed. But we can't take a patch to just delete it;
</i>><i class=""> I'm sure you understand.</i></pre></div><div class="">I tried to apply this patch at that time, but was already useless for newer versions:</div><div class=""><br class=""></div><div class=""><font color="#0068da" class=""><span class=""><u class=""><a href="https://mail.openvswitch.org/pipermail/ovs-discuss/attachments/20161123/5379b333/attachment.bin" class="">https://mail.openvswitch.org/pipermail/ovs-discuss/attachments/20161123/5379b333/attachment.bin</a></u></span></font></div><div class=""><br class=""></div><div class="">Our workaround was to scale VM with 3 vCPU-s, since our average system load is 1.5 for BGP.</div><div class=""><br class=""></div><div class="">You can see what is happening:</div><div class=""><br class=""></div><div class=""><div class="" style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(171, 205, 239);"><span class="" style="font-variant-ligatures: no-common-ligatures;">[root@bgp1 ~]# top</span></div></div><div class="" style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(171, 205, 239);"><span class="" style="font-variant-ligatures: no-common-ligatures;">...</span></div><div class=""><div class="" style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; color: rgb(171, 205, 239); background-color: rgb(0, 0, 0);"><span class="" style="font-variant-ligatures: no-common-ligatures;"> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND </span></div><div class="" style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(171, 205, 239);"><span class="" style="font-variant-ligatures: no-common-ligatures;"><b class=""> 654 root 10 -10 1284492 1.0g 20276 R 98.0 27.0 2513:01 ovs-vswitchd </b></span></div><div class="" style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(171, 205, 239);"><span class="" style="font-variant-ligatures: no-common-ligatures;"> 16 root 20 0 0 0 0 S 2.0 0.0 24:45.60 ksoftirqd/1 </span></div></div><div class=""><br class=""></div><div class=""><div class="" style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(171, 205, 239);"><span class="" style="font-variant-ligatures: no-common-ligatures;">[root@bgp1 ~]# ip route show</span></div></div><div class="" style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(171, 205, 239);"><span class="" style="font-variant-ligatures: no-common-ligatures;">...</span></div><div class=""><div class="" style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(171, 205, 239);"><span class="" style="font-variant-ligatures: no-common-ligatures;">1.0.0.0/24 via 89.212.xx.xx dev t2-v24-ha proto bird </span></div><div class="" style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(171, 205, 239);"><span class="" style="font-variant-ligatures: no-common-ligatures;">1.0.4.0/24 via 89.212.xx.xx dev t2-v24-ha proto bird </span></div><div class="" style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(171, 205, 239);"><span class="" style="font-variant-ligatures: no-common-ligatures;">1.0.4.0/22 via 89.212.xx.xx dev t2-v24-ha proto bird </span></div><div class="" style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(171, 205, 239);"><span class="" style="font-variant-ligatures: no-common-ligatures;">1.0.5.0/24 via 89.212.xx.xx dev t2-v24-ha proto bird</span></div></div><div class=""><br class=""></div><div class=""><br class=""></div><div class="">Routes being constantly added and deleted:</div><div class=""><br class=""></div><div class=""><div class="" style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(171, 205, 239);"><span class="" style="font-variant-ligatures: no-common-ligatures;">[root@bgp1 ~]# ip monitor</span></div><div class="" style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(171, 205, 239);"><span class="" style="font-variant-ligatures: no-common-ligatures;">...</span></div><div class="" style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(171, 205, 239);"><span class="" style="font-variant-ligatures: no-common-ligatures;">Deleted 2620:11d:6000::/42 via 2a01:xxx:xxx::1 dev t2-v26-ha proto bird metric 1024 pref medium</span></div><div class="" style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(171, 205, 239);"><span class="" style="font-variant-ligatures: no-common-ligatures;">2620:11d:6000::/42 via 2a01:xxx:xxx::1 dev t2-v26-ha proto bird metric 1024 pref medium</span></div><div class="" style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(171, 205, 239);"><span class="" style="font-variant-ligatures: no-common-ligatures;">Deleted 2620:11d:6000::/42 via 2a01:xxx:xxx::1 dev t2-v26-ha proto bird metric 1024 pref medium</span></div><div class="" style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(171, 205, 239);"><span class="" style="font-variant-ligatures: no-common-ligatures;">2620:11d:6000::/42 via 2a01:xxx:xxx::1 dev t2-v26-ha proto bird metric 1024 pref medium</span></div><div class="" style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(171, 205, 239);"><span class="" style="font-variant-ligatures: no-common-ligatures;">Deleted 2620:11d:6000::/42 via 2a01:xxx:xxx::1 dev t2-v26-ha proto bird metric 1024 pref medium</span></div><div class="" style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(171, 205, 239);"><span class="" style="font-variant-ligatures: no-common-ligatures;">2620:11d:6000::/42 via 2a01:xxx:xxx::1 dev t2-v26-ha proto bird metric 1024 pref medium</span></div><div class="" style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(171, 205, 239);"><span class="" style="font-variant-ligatures: no-common-ligatures;">Deleted 68.69.37.0/24 via 89.212.xx.xx dev t2-v24-ha proto bird </span></div><div class="" style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(171, 205, 239);"><span class="" style="font-variant-ligatures: no-common-ligatures;">68.69.37.0/24 via 89.212.xx.xx dev t2-v24-ha proto bird </span></div><div class="" style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(171, 205, 239);"><span class="" style="font-variant-ligatures: no-common-ligatures;">Deleted 103.115.180.0/22 via 89.212.xx.xx dev t2-v24-ha proto bird </span></div><div class="" style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(171, 205, 239);"><span class="" style="font-variant-ligatures: no-common-ligatures;">103.115.180.0/22 via 89.212.xx.xx dev t2-v24-ha proto bird </span></div><div class="" style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(171, 205, 239);"><span class="" style="font-variant-ligatures: no-common-ligatures;">Deleted 103.115.180.0/22 via 89.212.xx.xx dev t2-v24-ha proto bird </span></div><div class="" style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(171, 205, 239);"><span class="" style="font-variant-ligatures: no-common-ligatures;">103.115.180.0/22 via 89.212.xx.xx dev t2-v24-ha proto bird </span></div><div class="" style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(171, 205, 239);"><span class="" style="font-variant-ligatures: no-common-ligatures;">Deleted 2.16.70.0/23 via 89.212.xx.xx dev t2-v24-ha proto bird </span></div><div class="" style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(171, 205, 239);"><span class="" style="font-variant-ligatures: no-common-ligatures;">Deleted 88.221.28.0/22 via 89.212.xx.xx dev t2-v24-ha proto bird </span></div><div class="" style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(171, 205, 239);"><span class="" style="font-variant-ligatures: no-common-ligatures;">Deleted 23.50.188.0/22 via 89.212.xx.xx dev t2-v24-ha proto bird </span></div><div class="" style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(171, 205, 239);"><span class="" style="font-variant-ligatures: no-common-ligatures;">Deleted 92.122.68.0/22 via 89.212.xx.xx dev t2-v24-ha proto bird </span></div><div class="" style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(171, 205, 239);"><span class="" style="font-variant-ligatures: no-common-ligatures;">Deleted 88.221.100.0/22 via 89.212.xx.xx dev t2-v24-ha proto bird </span></div><div class="" style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(171, 205, 239);"><span class="" style="font-variant-ligatures: no-common-ligatures;">Deleted 92.123.208.0/22 via 89.212.xx.xx dev t2-v24-ha proto bird</span></div><div class="" style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(171, 205, 239);"><span class="" style="font-variant-ligatures: no-common-ligatures;">..... </span></div></div><div class=""><br class=""></div></div><div class=""><br class=""></div><div class=""><br class=""></div><div class="">Regards,</div><div class="">saso<br class=""><div><br class=""><blockquote type="cite" class=""><div class="">On 8 Jul 2020, at 08:05, Mike Neo <<a href="mailto:neomikemac@gmail.com" class="">neomikemac@gmail.com</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div dir="ltr" class="">Hi,<div class=""><br class=""></div><div class="">what is your experience with installing bird on virtual server (ESXi)? Is there any limitation of this kind of deployment for example problems with performance etc.?</div><div class=""><br class=""></div><div class="">Regards,</div><div class="">Mike</div></div>
</div></blockquote></div><br class=""></div></body></html>