BIRD multithreaded progress
Hi BIRD team, I have been periodically checking the cz.nic blog for more posts in the "BIRD multithreading" saga, but the latest one was about 5.5 months ago ( https://en.blog.nic.cz/2021/06/14/bird-journey-to-threads-chapter-2-asynchro...). Has any more progress been made on this? I understand the team is busy and I'm not trying to push, but I enjoy reading these posts and keeping up with the work being done. Best, Ross
Hello! If you are brave, you can try out the alderney branch. I suppose there are still lots of bugs and inefficiencies, yet pipes, table maintenance and rpki loading is multithreaded there. That branch is still in internal testing and I do not recommend using that branch in production at all. It has been quite a huge load of work, including major rewrites of route propagation machinery. Feel free to test the "alderney" branch and report any bugs. If you manage to measure the time and memory consumption difference, you're welcome to share that. Thank you for asking, I hope we push this to a release as soon as possible. Maria On 11/26/21 6:11 AM, Ross Tajvar wrote:
Hi BIRD team,
I have been periodically checking the cz.nic blog for more posts in the "BIRD multithreading" saga, but the latest one was about 5.5 months ago (https://en.blog.nic.cz/2021/06/14/bird-journey-to-threads-chapter-2-asynchro... <https://en.blog.nic.cz/2021/06/14/bird-journey-to-threads-chapter-2-asynchronous-route-export/>). Has any more progress been made on this? I understand the team is busy and I'm not trying to push, but I enjoy reading these posts and keeping up with the work being done.
Best, Ross
Hey Maria and everyone else. Any updates on this multithreading mission? Could we hope for something in this quarter? Thanks in advance! Em sex., 26 de nov. de 2021 às 14:19, Maria Matejka <maria.matejka@nic.cz> escreveu:
Hello!
If you are brave, you can try out the alderney branch. I suppose there are still lots of bugs and inefficiencies, yet pipes, table maintenance and rpki loading is multithreaded there.
That branch is still in internal testing and I do not recommend using that branch in production at all. It has been quite a huge load of work, including major rewrites of route propagation machinery.
Feel free to test the "alderney" branch and report any bugs. If you manage to measure the time and memory consumption difference, you're welcome to share that.
Thank you for asking, I hope we push this to a release as soon as possible.
Maria
On 11/26/21 6:11 AM, Ross Tajvar wrote:
Hi BIRD team,
I have been periodically checking the cz.nic blog for more posts in the "BIRD multithreading" saga, but the latest one was about 5.5 months ago ( https://en.blog.nic.cz/2021/06/14/bird-journey-to-threads-chapter-2-asynchro... < https://en.blog.nic.cz/2021/06/14/bird-journey-to-threads-chapter-2-asynchronous-route-export/>).
Has any more progress been made on this? I understand the team is busy and I'm not trying to push, but I enjoy reading these posts and keeping up with the work being done.
Best, Ross
-- Douglas Fernando Fischer Engº de Controle e Automação
Another silly question: Sark, Alderney... Islands? Why? Em qua., 26 de jan. de 2022 às 18:09, Douglas Fischer < fischerdouglas@gmail.com> escreveu:
Hey Maria and everyone else.
Any updates on this multithreading mission?
Could we hope for something in this quarter?
Thanks in advance!
Em sex., 26 de nov. de 2021 às 14:19, Maria Matejka <maria.matejka@nic.cz> escreveu:
Hello!
If you are brave, you can try out the alderney branch. I suppose there are still lots of bugs and inefficiencies, yet pipes, table maintenance and rpki loading is multithreaded there.
That branch is still in internal testing and I do not recommend using that branch in production at all. It has been quite a huge load of work, including major rewrites of route propagation machinery.
Feel free to test the "alderney" branch and report any bugs. If you manage to measure the time and memory consumption difference, you're welcome to share that.
Thank you for asking, I hope we push this to a release as soon as possible.
Maria
On 11/26/21 6:11 AM, Ross Tajvar wrote:
Hi BIRD team,
I have been periodically checking the cz.nic blog for more posts in the "BIRD multithreading" saga, but the latest one was about 5.5 months ago ( https://en.blog.nic.cz/2021/06/14/bird-journey-to-threads-chapter-2-asynchro... < https://en.blog.nic.cz/2021/06/14/bird-journey-to-threads-chapter-2-asynchronous-route-export/>).
Has any more progress been made on this? I understand the team is busy and I'm not trying to push, but I enjoy reading these posts and keeping up with the work being done.
Best, Ross
-- Douglas Fernando Fischer Engº de Controle e Automação
-- Douglas Fernando Fischer Engº de Controle e Automação
st 26. 1. 2022 o 22:38 Douglas Fischer <fischerdouglas@gmail.com> napísal(a):
Another silly question:
Sark, Alderney... Islands? Why?
"The development is now being done mostly in the branch alderney. If you asked why such strange branch names like jersey, guernsey and alderney, here is a kind-of reason. Yes, these branches could be named mq-async-export, mq-async-export-new, mq-async-export-new-new, mq-another-async-export and so on. That’s so ugly, isn’t it? Let’s be creative. Jersey is an island where a same-named knit was first produced – and knits are made of threads. Then, you just look into a map and find nearby islands." https://en.blog.nic.cz/2021/06/14/bird-journey-to-threads-chapter-2-asynchro...
Hello! Off-topic: How I made up the branch names. Nothing to actual multithreading. On 1/27/22 1:13 PM, Blažej Krajňák wrote:
st 26. 1. 2022 o 22:38 Douglas Fischer <fischerdouglas@gmail.com> napísal(a):
Another silly question:
Sark, Alderney... Islands? Why?
"The development is now being done mostly in the branch alderney. If you asked why such strange branch names like jersey, guernsey and alderney, here is a kind-of reason. Yes, these branches could be named mq-async-export, mq-async-export-new, mq-async-export-new-new, mq-another-async-export and so on. That’s so ugly, isn’t it? Let’s be creative. Jersey is an island where a same-named knit was first produced – and knits are made of threads. Then, you just look into a map and find nearby islands."
https://en.blog.nic.cz/2021/06/14/bird-journey-to-threads-chapter-2-asynchro...
To elaborate more on that, there are several people around me doing sewing and other textile work. We communicate quite often as I'm the person who does the geometry thing for them occasionally, and when I was starting the multithreaded project, there was jersey fabric just everywhere around. The multithreading project is full of dead ends. There is an ugly lot of corner cases where priority inversion happens and I went to several of these dead ends where I found out that something has to be done _before_ the actual goal is attempted but the old branch was to be kept to rebase and cherry-pick the _following_ work onto the new branch. And here comes my love for geography and word play. When the Jersey branch got to a dead end, I just picked Guernsey. Then I reached another dead end on Guernsey ... It should be noted that these branches got rebased a lot, even the public branches are quite a mess. (You don't want to see my local repository.) BTW, after the COVID thing gets less dangerous, hopefully, I'd like to visit the Channel Islands for a short holiday ... and take a photo of some birds there, of course. And the trains ... hey, there are railroads there! Needa see them as well, no doubt. (Well, you see, I'm a bit crazy.) Maria
Hello! I hope for something (Pipe and RPKI in threads) very, very soon. For now, it is the "sark" branch. And currently, on my local machne, I have an unstable version running BGP in threads. That said, there are still some cryptic bugs in multithreaded BGP to be addressed. Also, several blog posts are waiting until I find some time and determination to read them once again, finish them and push them for publishing. There will be also probably a long pause in multithreaded development after Pipe+RPKI+BGP to allow for stabilizing these and merging with the 2.0.x branch. There is also a long backlog of feature requests to be implemented before other protocols get their own threads. Maria On 1/26/22 10:09 PM, Douglas Fischer wrote:
Hey Maria and everyone else.
Any updates on this multithreading mission?
Could we hope for something in this quarter?
Thanks in advance!
Em sex., 26 de nov. de 2021 às 14:19, Maria Matejka <maria.matejka@nic.cz <mailto:maria.matejka@nic.cz>> escreveu:
Hello!
If you are brave, you can try out the alderney branch. I suppose there are still lots of bugs and inefficiencies, yet pipes, table maintenance and rpki loading is multithreaded there.
That branch is still in internal testing and I do not recommend using that branch in production at all. It has been quite a huge load of work, including major rewrites of route propagation machinery.
Feel free to test the "alderney" branch and report any bugs. If you manage to measure the time and memory consumption difference, you're welcome to share that.
Thank you for asking, I hope we push this to a release as soon as possible.
Maria
On 11/26/21 6:11 AM, Ross Tajvar wrote: > Hi BIRD team, > > I have been periodically checking the cz.nic blog for more posts in the > "BIRD multithreading" saga, but the latest one was about 5.5 months ago > (https://en.blog.nic.cz/2021/06/14/bird-journey-to-threads-chapter-2-asynchro... <https://en.blog.nic.cz/2021/06/14/bird-journey-to-threads-chapter-2-asynchronous-route-export/>
> <https://en.blog.nic.cz/2021/06/14/bird-journey-to-threads-chapter-2-asynchro... <https://en.blog.nic.cz/2021/06/14/bird-journey-to-threads-chapter-2-asynchronous-route-export/>>).
> Has any more progress been made on this? I understand the team is busy > and I'm not trying to push, but I enjoy reading these posts and keeping > up with the work being done. > > Best, > Ross
-- Douglas Fernando Fischer Engº de Controle e Automação
I was waiting that Maria would bring the news to this mail-list. But I'm a bit anxious... Excellent reading material! https://en.blog.nic.cz/2022/02/09/bird-journey-to-threads-chapter-3-parallel... Things that I found important, and I believe are interesting to highlight: "Version 3.0-alpha0 (2022-02-07)" Wow! Version 3 instead of v2.1... https://gitlab.nic.cz/labs/bird/-/commit/935c066402d56d9b01ae41527c2e760d189... "Version 2.0.9 (2022-02-09) o Filter: Faster (16-way) prefix sets" Performance improvements at the master release! This is great! https://gitlab.nic.cz/labs/bird/-/commit/71c9484b00b4428ae6c7d7c8eea6d960736... Em qui., 27 de jan. de 2022 às 11:58, Maria Matejka <maria.matejka@nic.cz> escreveu:
Hello!
I hope for something (Pipe and RPKI in threads) very, very soon. For now, it is the "sark" branch. And currently, on my local machne, I have an unstable version running BGP in threads.
That said, there are still some cryptic bugs in multithreaded BGP to be addressed. Also, several blog posts are waiting until I find some time and determination to read them once again, finish them and push them for publishing.
There will be also probably a long pause in multithreaded development after Pipe+RPKI+BGP to allow for stabilizing these and merging with the 2.0.x branch. There is also a long backlog of feature requests to be implemented before other protocols get their own threads.
Maria
On 1/26/22 10:09 PM, Douglas Fischer wrote:
Hey Maria and everyone else.
Any updates on this multithreading mission?
Could we hope for something in this quarter?
Thanks in advance!
Em sex., 26 de nov. de 2021 às 14:19, Maria Matejka <maria.matejka@nic.cz <mailto:maria.matejka@nic.cz>> escreveu:
Hello!
If you are brave, you can try out the alderney branch. I suppose there are still lots of bugs and inefficiencies, yet pipes, table maintenance and rpki loading is multithreaded there.
That branch is still in internal testing and I do not recommend using that branch in production at all. It has been quite a huge load of work, including major rewrites of route propagation machinery.
Feel free to test the "alderney" branch and report any bugs. If you manage to measure the time and memory consumption difference, you're welcome to share that.
Thank you for asking, I hope we push this to a release as soon as possible.
Maria
On 11/26/21 6:11 AM, Ross Tajvar wrote: > Hi BIRD team, > > I have been periodically checking the cz.nic blog for more posts in the > "BIRD multithreading" saga, but the latest one was about 5.5 months ago > ( https://en.blog.nic.cz/2021/06/14/bird-journey-to-threads-chapter-2-asynchro... < https://en.blog.nic.cz/2021/06/14/bird-journey-to-threads-chapter-2-asynchro...
> < https://en.blog.nic.cz/2021/06/14/bird-journey-to-threads-chapter-2-asynchro... < https://en.blog.nic.cz/2021/06/14/bird-journey-to-threads-chapter-2-asynchro...
).
> Has any more progress been made on this? I understand the team is busy > and I'm not trying to push, but I enjoy reading these posts and keeping > up with the work being done. > > Best, > Ross
-- Douglas Fernando Fischer Engº de Controle e Automação
-- Douglas Fernando Fischer Engº de Controle e Automação
participants (4)
-
Blažej Krajňák -
Douglas Fischer -
Maria Matejka -
Ross Tajvar