I'm trying to get bird 1.5.0 to have BFD work with Juniper MX Routers. Sessions get stuck in Init state with the Juniper side in Down state. Any suggestions? I'm happy to share Juniper traces if that would lend some insight. Thx in advance. -Russ Russell Leighton Senior Software Development Engineer Amazon Web Services / EC2 Networking leightr@amazon.com Mobile: 301.828.8458
On Sat, Aug 15, 2015 at 02:42:11PM +0000, Leighton, Russell wrote:
I'm trying to get bird 1.5.0 to have BFD work with Juniper MX Routers.
Sessions get stuck in Init state with the Juniper side in Down state.
Any suggestions?
On the BIRD box, set this in sysctl.conf: net.ipv4.ip_local_port_range="49152 65535" BIRD config: protocol bfd bfd1 { interface "xxxx"; } protocol bgp neighbor1 { [ ... ] bfd on; } On the Juniper side something like this: job@eunetworks-1.router.nl.coloclue.net> show configuration protocols bgp group internal-ipv4 neighbor 94.142.247.237 bfd-liveness-detection minimum-interval 10; multiplier 5; transmit-interval { minimum-interval 100; } Kind regards, Job
Thank you for the suggestion but no joy. The below was similar to my config but I switched to your exact config. Bird is still stuck in Init. Bird keeps sending bfd messages with state=Init to Juniper which has state=Down but the Juniper won't transition to Init or Up. Does it matter I am in 'rr client' mode? -----Original Message----- From: Job Snijders [mailto:job@instituut.net] Sent: Saturday, August 15, 2015 10:52 AM To: Leighton, Russell Cc: bird-users@network.cz Subject: Re: BFD and Juniper? On Sat, Aug 15, 2015 at 02:42:11PM +0000, Leighton, Russell wrote:
I'm trying to get bird 1.5.0 to have BFD work with Juniper MX Routers.
Sessions get stuck in Init state with the Juniper side in Down state.
Any suggestions?
On the BIRD box, set this in sysctl.conf: net.ipv4.ip_local_port_range="49152 65535" BIRD config: protocol bfd bfd1 { interface "xxxx"; } protocol bgp neighbor1 { [ ... ] bfd on; } On the Juniper side something like this: job@eunetworks-1.router.nl.coloclue.net> show configuration protocols bgp group internal-ipv4 neighbor 94.142.247.237 bfd-liveness-detection minimum-interval 10; multiplier 5; transmit-interval { minimum-interval 100; } Kind regards, Job
Hi. What Junos version on you router ? There is a bug in Junos 10.4 (and maybe early versions) with SRC address for BFD session if router have several IP`s on one iface. --- With best regards, Dmitry S. Nikolaev Moscow, Russia phone: +7 (499) 678 8007 [ext. 6003] fax: +7 (499) 678 8007 [ext. 7777] www: http://www.mega-net.ru mail: dnikolaev@mega-net.ru On 15.08.2015 17:42, Leighton, Russell wrote:
I’m trying to get bird 1.5.0 to have BFD work with Juniper MX Routers.
Sessions get stuck in Init state with the Juniper side in Down state.
Any suggestions?
I’m happy to share Juniper traces if that would lend some insight.
Thx in advance.
-Russ
Russell Leighton
Senior Software Development Engineer
Amazon Web Services / EC2 Networking
leightr@amazon.com
Mobile: 301.828.8458
12.3 I'll try Job Snijders suggestions soon. From: Dmitry S. Nikolaev [mailto:dnikolaev@mega-net.ru] Sent: Saturday, August 15, 2015 11:14 AM To: Leighton, Russell Cc: bird-users@network.cz Subject: Re: BFD and Juniper? Hi. What Junos version on you router ? There is a bug in Junos 10.4 (and maybe early versions) with SRC address for BFD session if router have several IP`s on one iface. --- With best regards, Dmitry S. Nikolaev Moscow, Russia phone: +7 (499) 678 8007 [ext. 6003] fax: +7 (499) 678 8007 [ext. 7777] www: http://www.mega-net.ru mail: dnikolaev@mega-net.ru<mailto:dnikolaev@mega-net.ru> On 15.08.2015 17:42, Leighton, Russell wrote: I'm trying to get bird 1.5.0 to have BFD work with Juniper MX Routers. Sessions get stuck in Init state with the Juniper side in Down state. Any suggestions? I'm happy to share Juniper traces if that would lend some insight. Thx in advance. -Russ Russell Leighton Senior Software Development Engineer Amazon Web Services / EC2 Networking leightr@amazon.com<mailto:leightr@amazon.com> Mobile: 301.828.8458
Hi. 1. What output on MX for: # show bfd session extensive 2. What output on BIRD for:
show bfd sessions
3. Try to enable debug for BFD on bird and see what happens in log file. 4. Use tcpdump on BIRD side to see all BFD packets are send or recieved. 5. Do you have firewall on MX ? Check firewall, it must not block ports: UDP 3784, 4784 for your neighbor`s IP. --- With best regards, Dmitry S. Nikolaev Moscow, Russia phone: +7 (499) 678 8007 [ext. 6003] fax: +7 (499) 678 8007 [ext. 7777] www: http://www.mega-net.ru mail: dnikolaev@mega-net.ru On 15.08.2015 22:57, Leighton, Russell wrote:
12.3
I’ll try Job Snijders suggestions soon.
*From:*Dmitry S. Nikolaev [mailto:dnikolaev@mega-net.ru] *Sent:* Saturday, August 15, 2015 11:14 AM *To:* Leighton, Russell *Cc:* bird-users@network.cz *Subject:* Re: BFD and Juniper?
Hi.
What Junos version on you router ? There is a bug in Junos 10.4 (and maybe early versions) with SRC address for BFD session if router have several IP`s on one iface.
--- With best regards, Dmitry S. Nikolaev
Moscow, Russia phone: +7 (499) 678 8007 [ext. 6003] fax: +7 (499) 678 8007 [ext. 7777] www: http://www.mega-net.ru mail: dnikolaev@mega-net.ru <mailto:dnikolaev@mega-net.ru>
On 15.08.2015 17:42, Leighton, Russell wrote:
I’m trying to get bird 1.5.0 to have BFD work with Juniper MX Routers.
Sessions get stuck in Init state with the Juniper side in Down state.
Any suggestions?
I’m happy to share Juniper traces if that would lend some insight.
Thx in advance.
-Russ
Russell Leighton
Senior Software Development Engineer
Amazon Web Services / EC2 Networking
leightr@amazon.com <mailto:leightr@amazon.com>
Mobile: 301.828.8458
Thx, replies below. I sent another email with Juniper traces and Wireshark screenshots but it is big and waiting on moderator approval. It is interesting that the MX thinks Bird is in AdminDown but bird thinks it is in Init MX "show bfd sessions extensive": Address State Interface Time Interval Multiplier 169.254.255.1 Down xe-2/0/0.2 0.000 1.000 5 Client BGP, TX interval 0.100, RX interval 0.010 Local diagnostic None, remote diagnostic None Remote state AdminDown, version 1 Replicated Min async interval 0.100, min slow interval 1.000 Adaptive async TX interval 0.100, RX interval 0.010 Local min TX interval 1.000, minimum RX interval 0.010, multiplier 5 Remote min TX interval 0.000, min RX interval 0.000, multiplier 0 Local discriminator 2058, remote discriminator 0 Echo mode disabled/inactive, no-absorb, no-refresh Session ID: 0x87f 1 sessions, 1 clients Cumulative transmit rate 1.0 pps, cumulative receive rate 0.0 pps Bird "show bfd sessions": bird> show bfd sessions bfd1: IP address Interface State Since Interval Timeout 169.254.255.3 --- Init 18:47:50 1.000 5.000 169.254.255.2 --- Init 18:47:49 1.000 3.000 169.254.255.4 --- Init 18:47:46 1.000 3.000 The bird debug logs were not informative. I will check the firewall ... good point. The MX is getting some bfd based on the traces but maybe the firewall is disrupting things. From: Dmitry S. Nikolaev [mailto:dnikolaev@mega-net.ru] Sent: Sunday, August 16, 2015 1:25 AM To: Leighton, Russell Cc: bird-users@network.cz Subject: Re: BFD and Juniper? Hi. 1. What output on MX for: # show bfd session extensive 2. What output on BIRD for:
show bfd sessions
3. Try to enable debug for BFD on bird and see what happens in log file. 4. Use tcpdump on BIRD side to see all BFD packets are send or recieved. 5. Do you have firewall on MX ? Check firewall, it must not block ports: UDP 3784, 4784 for your neighbor`s IP. --- With best regards, Dmitry S. Nikolaev Moscow, Russia phone: +7 (499) 678 8007 [ext. 6003] fax: +7 (499) 678 8007 [ext. 7777] www: http://www.mega-net.ru mail: dnikolaev@mega-net.ru<mailto:dnikolaev@mega-net.ru> On 15.08.2015 22:57, Leighton, Russell wrote: 12.3 I'll try Job Snijders suggestions soon. From: Dmitry S. Nikolaev [mailto:dnikolaev@mega-net.ru] Sent: Saturday, August 15, 2015 11:14 AM To: Leighton, Russell Cc: bird-users@network.cz<mailto:bird-users@network.cz> Subject: Re: BFD and Juniper? Hi. What Junos version on you router ? There is a bug in Junos 10.4 (and maybe early versions) with SRC address for BFD session if router have several IP`s on one iface. --- With best regards, Dmitry S. Nikolaev Moscow, Russia phone: +7 (499) 678 8007 [ext. 6003] fax: +7 (499) 678 8007 [ext. 7777] www: http://www.mega-net.ru mail: dnikolaev@mega-net.ru<mailto:dnikolaev@mega-net.ru> On 15.08.2015 17:42, Leighton, Russell wrote: I'm trying to get bird 1.5.0 to have BFD work with Juniper MX Routers. Sessions get stuck in Init state with the Juniper side in Down state. Any suggestions? I'm happy to share Juniper traces if that would lend some insight. Thx in advance. -Russ Russell Leighton Senior Software Development Engineer Amazon Web Services / EC2 Networking leightr@amazon.com<mailto:leightr@amazon.com> Mobile: 301.828.8458
This is the Juniper trace below. If anyone can see what is wrong that would be very helpful. Russ --- 8< --- I see "MultiHop (64) len 1: (hex) 01" being sent from Bird but I have no mutlihop configured and the routers are directly connected. Is that an issue? Juniper Trace when I restart bird (169.254.255.1) on one of my routers (169.254.255.3) : Aug 15 22:40:38 Received Downstream RcvPkt (19) len 99: Aug 15 22:40:38 IfIndex (3) len 4: 65546 Aug 15 22:40:38 Protocol (1) len 1: BFD Aug 15 22:40:38 SrcAddr (5) len 8: 169.254.255.1 Aug 15 22:40:38 DestAddr (8) len 8: 169.254.255.3 Aug 15 22:40:38 Data (9) len 24: (hex) 20 40 05 18 1a 02 af 59 00 00 00 00 00 0f 42 40 00 00 27 Aug 15 22:40:38 PktError (26) len 4: 0 Aug 15 22:40:38 RtblIdx (24) len 4: 2365 Aug 15 22:40:38 MultiHop (64) len 1: (hex) 01 Aug 15 22:40:38 Authenticated (121) len 1: (hex) 00 Aug 15 22:40:38 BFD m-hops packet from 169.254.255.1 to 169.254.255.3 (IFL 65546), len 24 Aug 15 22:40:38 Ver 1, diag 0, mult 5, len 24 Aug 15 22:40:38 Flags: , State: Down Aug 15 22:40:38 My discr 0x1a02af59, your discr 0x00000000 Aug 15 22:40:38 Tx ivl 1000000, rx ivl 10000, echo rx ivl 0 Aug 15 22:40:38 Packet from 169.254.255.1 to 169.254.255.3 (ifl 65546, rtbl 2365), discr 0x0, label 0, matches no session Aug 15 22:40:39 Received Downstream RcvPkt (19) len 99: Aug 15 22:40:39 IfIndex (3) len 4: 65546 Aug 15 22:40:39 Protocol (1) len 1: BFD Aug 15 22:40:39 SrcAddr (5) len 8: 169.254.255.1 Aug 15 22:40:39 DestAddr (8) len 8: 169.254.255.3 Aug 15 22:40:39 Data (9) len 24: (hex) 20 40 05 18 1a 02 af 59 00 00 00 00 00 0f 42 40 00 00 27 Aug 15 22:40:39 PktError (26) len 4: 0 Aug 15 22:40:39 RtblIdx (24) len 4: 2365 Aug 15 22:40:39 MultiHop (64) len 1: (hex) 01 Aug 15 22:40:39 Authenticated (121) len 1: (hex) 00 Aug 15 22:40:39 BFD m-hops packet from 169.254.255.1 to 169.254.255.3 (IFL 65546), len 24 Aug 15 22:40:39 Ver 1, diag 0, mult 5, len 24 Aug 15 22:40:39 Flags: , State: Down Aug 15 22:40:39 My discr 0x1a02af59, your discr 0x00000000 Aug 15 22:40:39 Tx ivl 1000000, rx ivl 10000, echo rx ivl 0 Aug 15 22:40:39 Packet from 169.254.255.1 to 169.254.255.3 (ifl 65546, rtbl 2365), discr 0x0, label 0, matches no session Aug 15 22:40:39 Received Downstream RcvPkt (19) len 99: Aug 15 22:40:39 IfIndex (3) len 4: 65546 Aug 15 22:40:39 Protocol (1) len 1: BFD Aug 15 22:40:39 SrcAddr (5) len 8: 169.254.255.1 Aug 15 22:40:39 DestAddr (8) len 8: 169.254.255.3 Aug 15 22:40:39 Data (9) len 24: (hex) 20 40 05 18 1a 02 af 59 00 00 00 00 00 0f 42 40 00 00 27 Aug 15 22:40:39 PktError (26) len 4: 0 Aug 15 22:40:39 RtblIdx (24) len 4: 2365 Aug 15 22:40:39 MultiHop (64) len 1: (hex) 01 Aug 15 22:40:39 Authenticated (121) len 1: (hex) 00 Aug 15 22:40:39 BFD m-hops packet from 169.254.255.1 to 169.254.255.3 (IFL 65546), len 24 Aug 15 22:40:39 Ver 1, diag 0, mult 5, len 24 Aug 15 22:40:39 Flags: , State: Down Aug 15 22:40:39 My discr 0x1a02af59, your discr 0x00000000 Aug 15 22:40:39 Tx ivl 1000000, rx ivl 10000, echo rx ivl 0 Aug 15 22:40:39 Packet from 169.254.255.1 to 169.254.255.3 (ifl 65546, rtbl 2365), discr 0x0, label 0, matches no session Aug 15 22:40:40 Received Downstream RcvPkt (19) len 99: Aug 15 22:40:40 IfIndex (3) len 4: 65546 Aug 15 22:40:40 Protocol (1) len 1: BFD Aug 15 22:40:40 SrcAddr (5) len 8: 169.254.255.1 Aug 15 22:40:40 DestAddr (8) len 8: 169.254.255.3 Aug 15 22:40:40 Data (9) len 24: (hex) 20 40 05 18 1a 02 af 59 00 00 00 00 00 0f 42 40 00 00 27 Aug 15 22:40:40 PktError (26) len 4: 0 Aug 15 22:40:40 RtblIdx (24) len 4: 2365 Aug 15 22:40:40 MultiHop (64) len 1: (hex) 01 Aug 15 22:40:40 Authenticated (121) len 1: (hex) 00 Aug 15 22:40:40 BFD m-hops packet from 169.254.255.1 to 169.254.255.3 (IFL 65546), len 24 Aug 15 22:40:40 Ver 1, diag 0, mult 5, len 24 Aug 15 22:40:40 Flags: , State: Down Aug 15 22:40:40 My discr 0x1a02af59, your discr 0x00000000 Aug 15 22:40:40 Tx ivl 1000000, rx ivl 10000, echo rx ivl 0 Aug 15 22:40:40 Packet from 169.254.255.1 to 169.254.255.3 (ifl 65546, rtbl 2365), discr 0x0, label 0, matches no session Aug 15 22:40:41 Received Downstream RcvPkt (19) len 99: Aug 15 22:40:41 IfIndex (3) len 4: 65546 Aug 15 22:40:41 Protocol (1) len 1: BFD Aug 15 22:40:41 SrcAddr (5) len 8: 169.254.255.1 Aug 15 22:40:41 DestAddr (8) len 8: 169.254.255.3 Aug 15 22:40:41 Data (9) len 24: (hex) 20 40 05 18 1a 02 af 59 00 00 00 00 00 0f 42 40 00 00 27 Aug 15 22:40:41 PktError (26) len 4: 0 Aug 15 22:40:41 RtblIdx (24) len 4: 2365 Aug 15 22:40:41 MultiHop (64) len 1: (hex) 01 Aug 15 22:40:41 Authenticated (121) len 1: (hex) 00 Aug 15 22:40:41 BFD m-hops packet from 169.254.255.1 to 169.254.255.3 (IFL 65546), len 24 Aug 15 22:40:41 Ver 1, diag 0, mult 5, len 24 Aug 15 22:40:41 Flags: , State: Down Aug 15 22:40:41 My discr 0x1a02af59, your discr 0x00000000 Aug 15 22:40:41 Tx ivl 1000000, rx ivl 10000, echo rx ivl 0 Aug 15 22:40:41 Packet from 169.254.255.1 to 169.254.255.3 (ifl 65546, rtbl 2365), discr 0x0, label 0, matches no session Aug 15 22:40:42 Received Upstream SetSession (2) len 154: Aug 15 22:40:42 Version (0) len 1: 255 Aug 15 22:40:42 ClientName (2) len 4: BGP Aug 15 22:40:42 IfName (4) len 11: xe-2/0/0.2 Aug 15 22:40:42 IfIndex (3) len 4: 65546 Aug 15 22:40:42 DestAddr (6) len 8: 169.254.255.1 Aug 15 22:40:42 Handle (13) len 4: 0x800b10 Aug 15 22:40:42 TxInterval (7) len 4: 100000 Aug 15 22:40:42 RxInterval (8) len 4: 10000 Aug 15 22:40:42 HighTransmitInterval (10) len 4: 0 Aug 15 22:40:42 Multiplier (9) len 4: 5 Aug 15 22:40:42 HoldownInterval (24) len 4: 0 Aug 15 22:40:42 CntrlFlags (15) len 4: 0x0 Aug 15 22:40:42 RouteTblIdx (20) len 4: 2365 Aug 15 22:40:42 AdaptationType (22) len 1: 0 Aug 15 22:40:42 HighDetectionTime (23) len 4: 0 Aug 15 22:40:42 RefreshDeadtime (25) len 4: 0 Aug 15 22:40:42 Unknown (30) len 1: (hex) 00 Aug 15 22:40:42 Session id (31) len 4: 2131230720 Aug 15 22:40:42 Replicate: added session (discr 2057) Aug 15 22:40:42 Session 169.254.255.1 (IFL 65546) state Down -> AdminDown Aug 15 22:40:42 Session 169.254.255.1 (IFL 65546) starting version negotiation Aug 15 22:40:42 Encoded session add for session Aug 15 22:40:42 Replication packet sent (add): Aug 15 22:40:42 FormatVersion 1.1 Aug 15 22:40:42 LocalDiscr 2057 Aug 15 22:40:42 SessionCreate Aug 15 22:40:42 InterfaceName xe-2/0/0.2 Aug 15 22:40:42 InterfaceIndex 139659364 Aug 15 22:40:42 LogicalRouterId 0 Aug 15 22:40:42 RoutingTableIndex 2365 Aug 15 22:40:42 PW demux label 0 Aug 15 22:40:42 NeighborAddr 169.254.255.1 Aug 15 22:40:42 EchoMinTxInterval 0 Aug 15 22:40:42 CurrentTxInterval 1000000 Aug 15 22:40:42 AdaptAsyncTxInterval 100000 Aug 15 22:40:42 LastAdaptRxInterval 10000 Aug 15 22:40:42 LocalDiag None Aug 15 22:40:42 Session id 2175 Aug 15 22:40:42 MultihopMinRxTTL 255 Aug 15 22:40:42 ISSUState Idle Aug 15 22:40:42 RemoteHeard False Aug 15 22:40:42 DemandMode False Aug 15 22:40:42 EchoModeActive False Aug 15 22:40:42 Multihop False Aug 15 22:40:42 RouteLookup False Aug 15 22:40:42 Uptime Thu Jan 1 00:00:00 1970 Aug 15 22:40:42 Downtime Thu Jan 1 00:00:00 1970 Aug 15 22:40:42 RefreshDeadtime 0 Aug 15 22:40:42 LastProgramPkt (hex) 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 Aug 15 22:40:42 BFD packet to 169.254.255.1 (IFL 65546), len 24 Aug 15 22:40:42 Ver 1, diag 0, mult 5, len 24 Aug 15 22:40:42 Flags: , State: AdminDown Aug 15 22:40:42 My discr 0x00000809, your discr 0x00000000 Aug 15 22:40:42 Tx ivl 1000000, rx ivl 10000, echo rx ivl 0 Aug 15 22:40:42 Sent Downstream ProgramXmit (9) len 141: Aug 15 22:40:42 IfIndex (3) len 4: 65546 Aug 15 22:40:42 SrcAddr (5) len 8: 169.254.255.3 Aug 15 22:40:42 DestAddr (8) len 8: 169.254.255.1 Aug 15 22:40:42 Data (9) len 24: (hex) 20 00 05 18 00 00 08 09 00 00 00 00 00 0f 42 40 00 00 27 Aug 15 22:40:42 Interval (12) len 8: 1 sec 0 nsec Aug 15 22:40:42 Jitter (13) len 1: 25 Aug 15 22:40:42 Handle (20) len 4: 0x9080000 Aug 15 22:40:42 Distribute (27) len 1: True Aug 15 22:40:42 SeqNum (119) len 4: (hex) 2c 2f 25 58 Aug 15 22:40:42 SeqNumTimeStamp (120) len 8: (hex) 55 cf bf ea 08 f0 ba 10 Aug 15 22:40:42 LooseAuth (122) len 1: (hex) 00 Aug 15 22:40:42 DontRoute (23) len 1: True Aug 15 22:40:42 SendToMhopPort (100) len 1: 0 Aug 15 22:40:42 RtblIdx (24) len 4: 2365 Aug 15 22:40:42 Sent Downstream SetAdj (11) len 109: Aug 15 22:40:42 IfIndex (3) len 4: 65546 Aug 15 22:40:42 SrcAddr (5) len 8: 169.254.255.1 Aug 15 22:40:42 HoldTime (14) len 8: 0 sec 0 nsec Aug 15 22:40:42 NoAbsorb (15) len 1: True Aug 15 22:40:42 NoRefresh (16) len 1: True Aug 15 22:40:42 ForceRefresh (17) len 1: True Aug 15 22:40:42 DoNotAge (18) len 1: True Aug 15 22:40:42 Distribute (27) len 1: True Aug 15 22:40:42 LooseAuth (122) len 1: (hex) 00 Aug 15 22:40:42 Discriminator (63) len 4: 0x809 Aug 15 22:40:42 RtblIdx (24) len 4: 2365 Aug 15 22:40:42 MinRecvTTL (68) len 1: 255 Aug 15 22:40:42 RecvOnMhopPort (101) len 1: 0 Aug 15 22:40:42 Unknown (153) len 1: (hex) 00 Aug 15 22:40:42 Unknown (154) len 4: (hex) 00 00 08 7f Aug 15 22:40:42 Received Downstream TraceMsg (24) len 97: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 72: (hex) 42 46 44 20 70 72 6f 67 72 61 6d 6d 65 64 20 70 65 72 69 Aug 15 22:40:42 PPM Trace: BFD programmed periodic xmit to 169.254.255.1 (IFL 65546), interval 1 0 Aug 15 22:40:42 Received Downstream TraceMsg (24) len 85: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 60: (hex) 42 46 44 20 6e 65 69 67 68 62 6f 72 20 31 36 39 2e 32 35 Aug 15 22:40:42 PPM Trace: BFD neighbor 169.254.255.1 (IFL 65546): bfd_ppm_discr 2057 Aug 15 22:40:42 Received Downstream TraceMsg (24) len 73: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 48: (hex) 42 46 44 20 6e 65 69 67 68 62 6f 72 20 31 36 39 2e 32 35 Aug 15 22:40:42 PPM Trace: BFD neighbor 169.254.255.1 (IFL 65546) set, 0 0 Aug 15 22:40:42 Received Downstream TraceMsg (24) len 97: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 72: (hex) 42 46 44 20 70 72 6f 67 72 61 6d 6d 65 64 20 70 65 72 69 Aug 15 22:40:42 PPM Trace: BFD programmed periodic xmit to 169.254.255.1 (IFL 65546), interval 1 0 Aug 15 22:40:42 Received Downstream TraceMsg (24) len 85: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 60: (hex) 42 46 44 20 6e 65 69 67 68 62 6f 72 20 31 36 39 2e 32 35 Aug 15 22:40:42 PPM Trace: BFD neighbor 169.254.255.1 (IFL 65546): bfd_ppm_discr 2057 Aug 15 22:40:42 Received Downstream TraceMsg (24) len 73: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 48: (hex) 42 46 44 20 6e 65 69 67 68 62 6f 72 20 31 36 39 2e 32 35 Aug 15 22:40:42 PPM Trace: BFD neighbor 169.254.255.1 (IFL 65546) set, 0 0 Aug 15 22:40:42 Session 169.254.255.1 (IFL 65546) state AdminDown -> Down Aug 15 22:40:42 Replicate: marked session (discr 2057) for update Aug 15 22:40:42 BFD packet to 169.254.255.1 (IFL 65546), len 24 Aug 15 22:40:42 Ver 1, diag 0, mult 5, len 24 Aug 15 22:40:42 Flags: , State: Down Aug 15 22:40:42 My discr 0x00000809, your discr 0x00000000 Aug 15 22:40:42 Tx ivl 1000000, rx ivl 10000, echo rx ivl 0 Aug 15 22:40:42 Sent Downstream ProgramXmit (9) len 141: Aug 15 22:40:42 IfIndex (3) len 4: 65546 Aug 15 22:40:42 SrcAddr (5) len 8: 169.254.255.3 Aug 15 22:40:42 DestAddr (8) len 8: 169.254.255.1 Aug 15 22:40:42 Data (9) len 24: (hex) 20 40 05 18 00 00 08 09 00 00 00 00 00 0f 42 40 00 00 27 Aug 15 22:40:42 Interval (12) len 8: 1 sec 0 nsec Aug 15 22:40:42 Jitter (13) len 1: 25 Aug 15 22:40:42 Handle (20) len 4: 0x9080000 Aug 15 22:40:42 Distribute (27) len 1: True Aug 15 22:40:42 SeqNum (119) len 4: (hex) 2c 2f 25 58 Aug 15 22:40:42 SeqNumTimeStamp (120) len 8: (hex) 55 cf bf ea 08 f0 ba 10 Aug 15 22:40:42 LooseAuth (122) len 1: (hex) 00 Aug 15 22:40:42 DontRoute (23) len 1: True Aug 15 22:40:42 SendToMhopPort (100) len 1: 0 Aug 15 22:40:42 RtblIdx (24) len 4: 2365 Aug 15 22:40:42 Sent Downstream SetAdj (11) len 109: Aug 15 22:40:42 IfIndex (3) len 4: 65546 Aug 15 22:40:42 SrcAddr (5) len 8: 169.254.255.1 Aug 15 22:40:42 HoldTime (14) len 8: 0 sec 0 nsec Aug 15 22:40:42 NoAbsorb (15) len 1: True Aug 15 22:40:42 NoRefresh (16) len 1: True Aug 15 22:40:42 ForceRefresh (17) len 1: True Aug 15 22:40:42 DoNotAge (18) len 1: True Aug 15 22:40:42 Distribute (27) len 1: True Aug 15 22:40:42 LooseAuth (122) len 1: (hex) 00 Aug 15 22:40:42 Discriminator (63) len 4: 0x809 Aug 15 22:40:42 RtblIdx (24) len 4: 2365 Aug 15 22:40:42 MinRecvTTL (68) len 1: 255 Aug 15 22:40:42 RecvOnMhopPort (101) len 1: 0 Aug 15 22:40:42 Unknown (153) len 1: (hex) 00 Aug 15 22:40:42 Unknown (154) len 4: (hex) 00 00 08 7f Aug 15 22:40:42 Encoded session update for session Aug 15 22:40:42 Replication packet sent (mod): Aug 15 22:40:42 FormatVersion 1.1 Aug 15 22:40:42 LocalDiscr 2057 Aug 15 22:40:42 SessionUpdate Aug 15 22:40:42 CurrentTxInterval 1000000 Aug 15 22:40:42 AdaptAsyncTxInterval 100000 Aug 15 22:40:42 LastAdaptRxInterval 10000 Aug 15 22:40:42 LocalDiag None Aug 15 22:40:42 Session id 2175 Aug 15 22:40:42 MultihopMinRxTTL 255 Aug 15 22:40:42 ISSUState Idle Aug 15 22:40:42 RemoteHeard False Aug 15 22:40:42 DemandMode False Aug 15 22:40:42 EchoModeActive False Aug 15 22:40:42 Multihop False Aug 15 22:40:42 RouteLookup False Aug 15 22:40:42 Uptime Thu Jan 1 00:00:00 1970 Aug 15 22:40:42 Downtime Thu Jan 1 00:00:00 1970 Aug 15 22:40:42 RefreshDeadtime 0 Aug 15 22:40:42 LastProgramPkt (hex) 20 40 05 18 00 00 08 09 00 00 00 00 00 0f 42 40 00 00 27 10 Aug 15 22:40:42 Received Downstream TraceMsg (24) len 97: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 72: (hex) 42 46 44 20 70 72 6f 67 72 61 6d 6d 65 64 20 70 65 72 69 Aug 15 22:40:42 PPM Trace: BFD programmed periodic xmit to 169.254.255.1 (IFL 65546), interval 1 0 Aug 15 22:40:42 Received Downstream TraceMsg (24) len 85: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 60: (hex) 42 46 44 20 6e 65 69 67 68 62 6f 72 20 31 36 39 2e 32 35 Aug 15 22:40:42 PPM Trace: BFD neighbor 169.254.255.1 (IFL 65546): bfd_ppm_discr 2057 Aug 15 22:40:42 Received Downstream TraceMsg (24) len 73: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 48: (hex) 42 46 44 20 6e 65 69 67 68 62 6f 72 20 31 36 39 2e 32 35 Aug 15 22:40:42 PPM Trace: BFD neighbor 169.254.255.1 (IFL 65546) set, 0 0 Aug 15 22:40:42 Received Downstream TraceMsg (24) len 97: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 72: (hex) 42 46 44 20 70 72 6f 67 72 61 6d 6d 65 64 20 70 65 72 69 Aug 15 22:40:42 PPM Trace: BFD programmed periodic xmit to 169.254.255.1 (IFL 65546), interval 1 0 Aug 15 22:40:42 Received Downstream TraceMsg (24) len 85: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 60: (hex) 42 46 44 20 6e 65 69 67 68 62 6f 72 20 31 36 39 2e 32 35 Aug 15 22:40:42 PPM Trace: BFD neighbor 169.254.255.1 (IFL 65546): bfd_ppm_discr 2057 Aug 15 22:40:42 Received Downstream TraceMsg (24) len 73: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 48: (hex) 42 46 44 20 6e 65 69 67 68 62 6f 72 20 31 36 39 2e 32 35 Aug 15 22:40:42 PPM Trace: BFD neighbor 169.254.255.1 (IFL 65546) set, 0 0 Aug 15 22:40:57 Sent Upstream Keepalive (0) len 20: Aug 15 22:40:57 Holdtime (11) len 8: 120 sec 0 nsec Aug 15 22:41:00 Received Upstream Keepalive (0) len 20: Aug 15 22:41:00 Holdtime (11) len 8: 120 sec 0 nsec Aug 15 22:41:01 Sent Upstream Keepalive (0) len 20: Aug 15 22:41:01 Holdtime (11) len 8: 120 sec 0 nsec From: bird-users-bounces@network.cz [mailto:bird-users-bounces@network.cz] On Behalf Of Leighton, Russell Sent: Sunday, August 16, 2015 8:36 AM To: dnikolaev@mega-net.ru Cc: bird-users@network.cz Subject: RE: BFD and Juniper? Thx, replies below. I sent another email with Juniper traces and Wireshark screenshots but it is big and waiting on moderator approval. It is interesting that the MX thinks Bird is in AdminDown but bird thinks it is in Init MX "show bfd sessions extensive": Address State Interface Time Interval Multiplier 169.254.255.1 Down xe-2/0/0.2 0.000 1.000 5 Client BGP, TX interval 0.100, RX interval 0.010 Local diagnostic None, remote diagnostic None Remote state AdminDown, version 1 Replicated Min async interval 0.100, min slow interval 1.000 Adaptive async TX interval 0.100, RX interval 0.010 Local min TX interval 1.000, minimum RX interval 0.010, multiplier 5 Remote min TX interval 0.000, min RX interval 0.000, multiplier 0 Local discriminator 2058, remote discriminator 0 Echo mode disabled/inactive, no-absorb, no-refresh Session ID: 0x87f 1 sessions, 1 clients Cumulative transmit rate 1.0 pps, cumulative receive rate 0.0 pps Bird "show bfd sessions": bird> show bfd sessions bfd1: IP address Interface State Since Interval Timeout 169.254.255.3 --- Init 18:47:50 1.000 5.000 169.254.255.2 --- Init 18:47:49 1.000 3.000 169.254.255.4 --- Init 18:47:46 1.000 3.000 The bird debug logs were not informative. I will check the firewall ... good point. The MX is getting some bfd based on the traces but maybe the firewall is disrupting things. From: Dmitry S. Nikolaev [mailto:dnikolaev@mega-net.ru] Sent: Sunday, August 16, 2015 1:25 AM To: Leighton, Russell Cc: bird-users@network.cz<mailto:bird-users@network.cz> Subject: Re: BFD and Juniper? Hi. 1. What output on MX for: # show bfd session extensive 2. What output on BIRD for:
show bfd sessions
3. Try to enable debug for BFD on bird and see what happens in log file. 4. Use tcpdump on BIRD side to see all BFD packets are send or recieved. 5. Do you have firewall on MX ? Check firewall, it must not block ports: UDP 3784, 4784 for your neighbor`s IP. --- With best regards, Dmitry S. Nikolaev Moscow, Russia phone: +7 (499) 678 8007 [ext. 6003] fax: +7 (499) 678 8007 [ext. 7777] www: http://www.mega-net.ru mail: dnikolaev@mega-net.ru<mailto:dnikolaev@mega-net.ru> On 15.08.2015 22:57, Leighton, Russell wrote: 12.3 I'll try Job Snijders suggestions soon. From: Dmitry S. Nikolaev [mailto:dnikolaev@mega-net.ru] Sent: Saturday, August 15, 2015 11:14 AM To: Leighton, Russell Cc: bird-users@network.cz<mailto:bird-users@network.cz> Subject: Re: BFD and Juniper? Hi. What Junos version on you router ? There is a bug in Junos 10.4 (and maybe early versions) with SRC address for BFD session if router have several IP`s on one iface. --- With best regards, Dmitry S. Nikolaev Moscow, Russia phone: +7 (499) 678 8007 [ext. 6003] fax: +7 (499) 678 8007 [ext. 7777] www: http://www.mega-net.ru mail: dnikolaev@mega-net.ru<mailto:dnikolaev@mega-net.ru> On 15.08.2015 17:42, Leighton, Russell wrote: I'm trying to get bird 1.5.0 to have BFD work with Juniper MX Routers. Sessions get stuck in Init state with the Juniper side in Down state. Any suggestions? I'm happy to share Juniper traces if that would lend some insight. Thx in advance. -Russ Russell Leighton Senior Software Development Engineer Amazon Web Services / EC2 Networking leightr@amazon.com<mailto:leightr@amazon.com> Mobile: 301.828.8458
So you're trying to use BFD with iBGP, or eBGP? iBGP is multihop by nature, so BFD would also be... Anyway, did you try to use something else than APIPA addressing (Link-Local only), that might interfere with what you're trying to do?
Le 19 août 2015 à 02:21, Leighton, Russell <leightr@amazon.com> a écrit :
This is the Juniper trace below. If anyone can see what is wrong that would be very helpful.
Russ
--- 8< ---
I see “MultiHop (64) len 1: (hex) 01” being sent from Bird but I have no mutlihop configured and the routers are directly connected. Is that an issue?
Juniper Trace when I restart bird (169.254.255.1) on one of my routers (169.254.255.3) :
Aug 15 22:40:38 Received Downstream RcvPkt (19) len 99: Aug 15 22:40:38 IfIndex (3) len 4: 65546 Aug 15 22:40:38 Protocol (1) len 1: BFD Aug 15 22:40:38 SrcAddr (5) len 8: 169.254.255.1 Aug 15 22:40:38 DestAddr (8) len 8: 169.254.255.3 Aug 15 22:40:38 Data (9) len 24: (hex) 20 40 05 18 1a 02 af 59 00 00 00 00 00 0f 42 40 00 00 27 Aug 15 22:40:38 PktError (26) len 4: 0 Aug 15 22:40:38 RtblIdx (24) len 4: 2365 Aug 15 22:40:38 MultiHop (64) len 1: (hex) 01 Aug 15 22:40:38 Authenticated (121) len 1: (hex) 00 Aug 15 22:40:38 BFD m-hops packet from 169.254.255.1 to 169.254.255.3 (IFL 65546), len 24 Aug 15 22:40:38 Ver 1, diag 0, mult 5, len 24 Aug 15 22:40:38 Flags: , State: Down Aug 15 22:40:38 My discr 0x1a02af59, your discr 0x00000000 Aug 15 22:40:38 Tx ivl 1000000, rx ivl 10000, echo rx ivl 0 Aug 15 22:40:38 Packet from 169.254.255.1 to 169.254.255.3 (ifl 65546, rtbl 2365), discr 0x0, label 0, matches no session Aug 15 22:40:39 Received Downstream RcvPkt (19) len 99: Aug 15 22:40:39 IfIndex (3) len 4: 65546 Aug 15 22:40:39 Protocol (1) len 1: BFD Aug 15 22:40:39 SrcAddr (5) len 8: 169.254.255.1 Aug 15 22:40:39 DestAddr (8) len 8: 169.254.255.3 Aug 15 22:40:39 Data (9) len 24: (hex) 20 40 05 18 1a 02 af 59 00 00 00 00 00 0f 42 40 00 00 27 Aug 15 22:40:39 PktError (26) len 4: 0 Aug 15 22:40:39 RtblIdx (24) len 4: 2365 Aug 15 22:40:39 MultiHop (64) len 1: (hex) 01 Aug 15 22:40:39 Authenticated (121) len 1: (hex) 00 Aug 15 22:40:39 BFD m-hops packet from 169.254.255.1 to 169.254.255.3 (IFL 65546), len 24 Aug 15 22:40:39 Ver 1, diag 0, mult 5, len 24 Aug 15 22:40:39 Flags: , State: Down Aug 15 22:40:39 My discr 0x1a02af59, your discr 0x00000000 Aug 15 22:40:39 Tx ivl 1000000, rx ivl 10000, echo rx ivl 0 Aug 15 22:40:39 Packet from 169.254.255.1 to 169.254.255.3 (ifl 65546, rtbl 2365), discr 0x0, label 0, matches no session Aug 15 22:40:39 Received Downstream RcvPkt (19) len 99: Aug 15 22:40:39 IfIndex (3) len 4: 65546 Aug 15 22:40:39 Protocol (1) len 1: BFD Aug 15 22:40:39 SrcAddr (5) len 8: 169.254.255.1 Aug 15 22:40:39 DestAddr (8) len 8: 169.254.255.3 Aug 15 22:40:39 Data (9) len 24: (hex) 20 40 05 18 1a 02 af 59 00 00 00 00 00 0f 42 40 00 00 27 Aug 15 22:40:39 PktError (26) len 4: 0 Aug 15 22:40:39 RtblIdx (24) len 4: 2365 Aug 15 22:40:39 MultiHop (64) len 1: (hex) 01 Aug 15 22:40:39 Authenticated (121) len 1: (hex) 00 Aug 15 22:40:39 BFD m-hops packet from 169.254.255.1 to 169.254.255.3 (IFL 65546), len 24 Aug 15 22:40:39 Ver 1, diag 0, mult 5, len 24 Aug 15 22:40:39 Flags: , State: Down Aug 15 22:40:39 My discr 0x1a02af59, your discr 0x00000000 Aug 15 22:40:39 Tx ivl 1000000, rx ivl 10000, echo rx ivl 0 Aug 15 22:40:39 Packet from 169.254.255.1 to 169.254.255.3 (ifl 65546, rtbl 2365), discr 0x0, label 0, matches no session Aug 15 22:40:40 Received Downstream RcvPkt (19) len 99: Aug 15 22:40:40 IfIndex (3) len 4: 65546 Aug 15 22:40:40 Protocol (1) len 1: BFD Aug 15 22:40:40 SrcAddr (5) len 8: 169.254.255.1 Aug 15 22:40:40 DestAddr (8) len 8: 169.254.255.3 Aug 15 22:40:40 Data (9) len 24: (hex) 20 40 05 18 1a 02 af 59 00 00 00 00 00 0f 42 40 00 00 27 Aug 15 22:40:40 PktError (26) len 4: 0 Aug 15 22:40:40 RtblIdx (24) len 4: 2365 Aug 15 22:40:40 MultiHop (64) len 1: (hex) 01 Aug 15 22:40:40 Authenticated (121) len 1: (hex) 00 Aug 15 22:40:40 BFD m-hops packet from 169.254.255.1 to 169.254.255.3 (IFL 65546), len 24 Aug 15 22:40:40 Ver 1, diag 0, mult 5, len 24 Aug 15 22:40:40 Flags: , State: Down Aug 15 22:40:40 My discr 0x1a02af59, your discr 0x00000000 Aug 15 22:40:40 Tx ivl 1000000, rx ivl 10000, echo rx ivl 0 Aug 15 22:40:40 Packet from 169.254.255.1 to 169.254.255.3 (ifl 65546, rtbl 2365), discr 0x0, label 0, matches no session Aug 15 22:40:41 Received Downstream RcvPkt (19) len 99: Aug 15 22:40:41 IfIndex (3) len 4: 65546 Aug 15 22:40:41 Protocol (1) len 1: BFD Aug 15 22:40:41 SrcAddr (5) len 8: 169.254.255.1 Aug 15 22:40:41 DestAddr (8) len 8: 169.254.255.3 Aug 15 22:40:41 Data (9) len 24: (hex) 20 40 05 18 1a 02 af 59 00 00 00 00 00 0f 42 40 00 00 27 Aug 15 22:40:41 PktError (26) len 4: 0 Aug 15 22:40:41 RtblIdx (24) len 4: 2365 Aug 15 22:40:41 MultiHop (64) len 1: (hex) 01 Aug 15 22:40:41 Authenticated (121) len 1: (hex) 00 Aug 15 22:40:41 BFD m-hops packet from 169.254.255.1 to 169.254.255.3 (IFL 65546), len 24 Aug 15 22:40:41 Ver 1, diag 0, mult 5, len 24 Aug 15 22:40:41 Flags: , State: Down Aug 15 22:40:41 My discr 0x1a02af59, your discr 0x00000000 Aug 15 22:40:41 Tx ivl 1000000, rx ivl 10000, echo rx ivl 0 Aug 15 22:40:41 Packet from 169.254.255.1 to 169.254.255.3 (ifl 65546, rtbl 2365), discr 0x0, label 0, matches no session Aug 15 22:40:42 Received Upstream SetSession (2) len 154: Aug 15 22:40:42 Version (0) len 1: 255 Aug 15 22:40:42 ClientName (2) len 4: BGP Aug 15 22:40:42 IfName (4) len 11: xe-2/0/0.2 Aug 15 22:40:42 IfIndex (3) len 4: 65546 Aug 15 22:40:42 DestAddr (6) len 8: 169.254.255.1 Aug 15 22:40:42 Handle (13) len 4: 0x800b10 Aug 15 22:40:42 TxInterval (7) len 4: 100000 Aug 15 22:40:42 RxInterval (8) len 4: 10000 Aug 15 22:40:42 HighTransmitInterval (10) len 4: 0 Aug 15 22:40:42 Multiplier (9) len 4: 5 Aug 15 22:40:42 HoldownInterval (24) len 4: 0 Aug 15 22:40:42 CntrlFlags (15) len 4: 0x0 Aug 15 22:40:42 RouteTblIdx (20) len 4: 2365 Aug 15 22:40:42 AdaptationType (22) len 1: 0 Aug 15 22:40:42 HighDetectionTime (23) len 4: 0 Aug 15 22:40:42 RefreshDeadtime (25) len 4: 0 Aug 15 22:40:42 Unknown (30) len 1: (hex) 00 Aug 15 22:40:42 Session id (31) len 4: 2131230720 Aug 15 22:40:42 Replicate: added session (discr 2057)
Aug 15 22:40:42 Session 169.254.255.1 (IFL 65546) state Down -> AdminDown Aug 15 22:40:42 Session 169.254.255.1 (IFL 65546) starting version negotiation Aug 15 22:40:42 Encoded session add for session Aug 15 22:40:42 Replication packet sent (add): Aug 15 22:40:42 FormatVersion 1.1 Aug 15 22:40:42 LocalDiscr 2057 Aug 15 22:40:42 SessionCreate Aug 15 22:40:42 InterfaceName xe-2/0/0.2 Aug 15 22:40:42 InterfaceIndex 139659364 Aug 15 22:40:42 LogicalRouterId 0 Aug 15 22:40:42 RoutingTableIndex 2365 Aug 15 22:40:42 PW demux label 0 Aug 15 22:40:42 NeighborAddr 169.254.255.1 Aug 15 22:40:42 EchoMinTxInterval 0 Aug 15 22:40:42 CurrentTxInterval 1000000 Aug 15 22:40:42 AdaptAsyncTxInterval 100000 Aug 15 22:40:42 LastAdaptRxInterval 10000 Aug 15 22:40:42 LocalDiag None Aug 15 22:40:42 Session id 2175 Aug 15 22:40:42 MultihopMinRxTTL 255 Aug 15 22:40:42 ISSUState Idle Aug 15 22:40:42 RemoteHeard False Aug 15 22:40:42 DemandMode False Aug 15 22:40:42 EchoModeActive False Aug 15 22:40:42 Multihop False Aug 15 22:40:42 RouteLookup False Aug 15 22:40:42 Uptime Thu Jan 1 00:00:00 1970
Aug 15 22:40:42 Downtime Thu Jan 1 00:00:00 1970
Aug 15 22:40:42 RefreshDeadtime 0 Aug 15 22:40:42 LastProgramPkt (hex) 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 Aug 15 22:40:42 BFD packet to 169.254.255.1 (IFL 65546), len 24 Aug 15 22:40:42 Ver 1, diag 0, mult 5, len 24 Aug 15 22:40:42 Flags: , State: AdminDown Aug 15 22:40:42 My discr 0x00000809, your discr 0x00000000 Aug 15 22:40:42 Tx ivl 1000000, rx ivl 10000, echo rx ivl 0 Aug 15 22:40:42 Sent Downstream ProgramXmit (9) len 141: Aug 15 22:40:42 IfIndex (3) len 4: 65546 Aug 15 22:40:42 SrcAddr (5) len 8: 169.254.255.3 Aug 15 22:40:42 DestAddr (8) len 8: 169.254.255.1 Aug 15 22:40:42 Data (9) len 24: (hex) 20 00 05 18 00 00 08 09 00 00 00 00 00 0f 42 40 00 00 27 Aug 15 22:40:42 Interval (12) len 8: 1 sec 0 nsec Aug 15 22:40:42 Jitter (13) len 1: 25 Aug 15 22:40:42 Handle (20) len 4: 0x9080000 Aug 15 22:40:42 Distribute (27) len 1: True Aug 15 22:40:42 SeqNum (119) len 4: (hex) 2c 2f 25 58 Aug 15 22:40:42 SeqNumTimeStamp (120) len 8: (hex) 55 cf bf ea 08 f0 ba 10 Aug 15 22:40:42 LooseAuth (122) len 1: (hex) 00 Aug 15 22:40:42 DontRoute (23) len 1: True Aug 15 22:40:42 SendToMhopPort (100) len 1: 0 Aug 15 22:40:42 RtblIdx (24) len 4: 2365 Aug 15 22:40:42 Sent Downstream SetAdj (11) len 109: Aug 15 22:40:42 IfIndex (3) len 4: 65546 Aug 15 22:40:42 SrcAddr (5) len 8: 169.254.255.1 Aug 15 22:40:42 HoldTime (14) len 8: 0 sec 0 nsec Aug 15 22:40:42 NoAbsorb (15) len 1: True Aug 15 22:40:42 NoRefresh (16) len 1: True Aug 15 22:40:42 ForceRefresh (17) len 1: True Aug 15 22:40:42 DoNotAge (18) len 1: True Aug 15 22:40:42 Distribute (27) len 1: True Aug 15 22:40:42 LooseAuth (122) len 1: (hex) 00 Aug 15 22:40:42 Discriminator (63) len 4: 0x809 Aug 15 22:40:42 RtblIdx (24) len 4: 2365 Aug 15 22:40:42 MinRecvTTL (68) len 1: 255 Aug 15 22:40:42 RecvOnMhopPort (101) len 1: 0 Aug 15 22:40:42 Unknown (153) len 1: (hex) 00 Aug 15 22:40:42 Unknown (154) len 4: (hex) 00 00 08 7f Aug 15 22:40:42 Received Downstream TraceMsg (24) len 97: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 72: (hex) 42 46 44 20 70 72 6f 67 72 61 6d 6d 65 64 20 70 65 72 69 Aug 15 22:40:42 PPM Trace: BFD programmed periodic xmit to 169.254.255.1 (IFL 65546), interval 1 0 Aug 15 22:40:42 Received Downstream TraceMsg (24) len 85: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 60: (hex) 42 46 44 20 6e 65 69 67 68 62 6f 72 20 31 36 39 2e 32 35 Aug 15 22:40:42 PPM Trace: BFD neighbor 169.254.255.1 (IFL 65546): bfd_ppm_discr 2057 Aug 15 22:40:42 Received Downstream TraceMsg (24) len 73: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 48: (hex) 42 46 44 20 6e 65 69 67 68 62 6f 72 20 31 36 39 2e 32 35 Aug 15 22:40:42 PPM Trace: BFD neighbor 169.254.255.1 (IFL 65546) set, 0 0 Aug 15 22:40:42 Received Downstream TraceMsg (24) len 97: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 72: (hex) 42 46 44 20 70 72 6f 67 72 61 6d 6d 65 64 20 70 65 72 69 Aug 15 22:40:42 PPM Trace: BFD programmed periodic xmit to 169.254.255.1 (IFL 65546), interval 1 0 Aug 15 22:40:42 Received Downstream TraceMsg (24) len 85: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 60: (hex) 42 46 44 20 6e 65 69 67 68 62 6f 72 20 31 36 39 2e 32 35 Aug 15 22:40:42 PPM Trace: BFD neighbor 169.254.255.1 (IFL 65546): bfd_ppm_discr 2057 Aug 15 22:40:42 Received Downstream TraceMsg (24) len 73: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 48: (hex) 42 46 44 20 6e 65 69 67 68 62 6f 72 20 31 36 39 2e 32 35 Aug 15 22:40:42 PPM Trace: BFD neighbor 169.254.255.1 (IFL 65546) set, 0 0 Aug 15 22:40:42 Session 169.254.255.1 (IFL 65546) state AdminDown -> Down Aug 15 22:40:42 Replicate: marked session (discr 2057) for update
Aug 15 22:40:42 BFD packet to 169.254.255.1 (IFL 65546), len 24 Aug 15 22:40:42 Ver 1, diag 0, mult 5, len 24 Aug 15 22:40:42 Flags: , State: Down Aug 15 22:40:42 My discr 0x00000809, your discr 0x00000000 Aug 15 22:40:42 Tx ivl 1000000, rx ivl 10000, echo rx ivl 0 Aug 15 22:40:42 Sent Downstream ProgramXmit (9) len 141: Aug 15 22:40:42 IfIndex (3) len 4: 65546 Aug 15 22:40:42 SrcAddr (5) len 8: 169.254.255.3 Aug 15 22:40:42 DestAddr (8) len 8: 169.254.255.1 Aug 15 22:40:42 Data (9) len 24: (hex) 20 40 05 18 00 00 08 09 00 00 00 00 00 0f 42 40 00 00 27 Aug 15 22:40:42 Interval (12) len 8: 1 sec 0 nsec Aug 15 22:40:42 Jitter (13) len 1: 25 Aug 15 22:40:42 Handle (20) len 4: 0x9080000 Aug 15 22:40:42 Distribute (27) len 1: True Aug 15 22:40:42 SeqNum (119) len 4: (hex) 2c 2f 25 58 Aug 15 22:40:42 SeqNumTimeStamp (120) len 8: (hex) 55 cf bf ea 08 f0 ba 10 Aug 15 22:40:42 LooseAuth (122) len 1: (hex) 00 Aug 15 22:40:42 DontRoute (23) len 1: True Aug 15 22:40:42 SendToMhopPort (100) len 1: 0 Aug 15 22:40:42 RtblIdx (24) len 4: 2365 Aug 15 22:40:42 Sent Downstream SetAdj (11) len 109: Aug 15 22:40:42 IfIndex (3) len 4: 65546 Aug 15 22:40:42 SrcAddr (5) len 8: 169.254.255.1 Aug 15 22:40:42 HoldTime (14) len 8: 0 sec 0 nsec Aug 15 22:40:42 NoAbsorb (15) len 1: True Aug 15 22:40:42 NoRefresh (16) len 1: True Aug 15 22:40:42 ForceRefresh (17) len 1: True Aug 15 22:40:42 DoNotAge (18) len 1: True Aug 15 22:40:42 Distribute (27) len 1: True Aug 15 22:40:42 LooseAuth (122) len 1: (hex) 00 Aug 15 22:40:42 Discriminator (63) len 4: 0x809 Aug 15 22:40:42 RtblIdx (24) len 4: 2365 Aug 15 22:40:42 MinRecvTTL (68) len 1: 255 Aug 15 22:40:42 RecvOnMhopPort (101) len 1: 0 Aug 15 22:40:42 Unknown (153) len 1: (hex) 00 Aug 15 22:40:42 Unknown (154) len 4: (hex) 00 00 08 7f Aug 15 22:40:42 Encoded session update for session Aug 15 22:40:42 Replication packet sent (mod): Aug 15 22:40:42 FormatVersion 1.1 Aug 15 22:40:42 LocalDiscr 2057 Aug 15 22:40:42 SessionUpdate Aug 15 22:40:42 CurrentTxInterval 1000000 Aug 15 22:40:42 AdaptAsyncTxInterval 100000 Aug 15 22:40:42 LastAdaptRxInterval 10000 Aug 15 22:40:42 LocalDiag None Aug 15 22:40:42 Session id 2175 Aug 15 22:40:42 MultihopMinRxTTL 255 Aug 15 22:40:42 ISSUState Idle Aug 15 22:40:42 RemoteHeard False Aug 15 22:40:42 DemandMode False Aug 15 22:40:42 EchoModeActive False Aug 15 22:40:42 Multihop False Aug 15 22:40:42 RouteLookup False Aug 15 22:40:42 Uptime Thu Jan 1 00:00:00 1970
Aug 15 22:40:42 Downtime Thu Jan 1 00:00:00 1970
Aug 15 22:40:42 RefreshDeadtime 0 Aug 15 22:40:42 LastProgramPkt (hex) 20 40 05 18 00 00 08 09 00 00 00 00 00 0f 42 40 00 00 27 10 Aug 15 22:40:42 Received Downstream TraceMsg (24) len 97: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 72: (hex) 42 46 44 20 70 72 6f 67 72 61 6d 6d 65 64 20 70 65 72 69 Aug 15 22:40:42 PPM Trace: BFD programmed periodic xmit to 169.254.255.1 (IFL 65546), interval 1 0 Aug 15 22:40:42 Received Downstream TraceMsg (24) len 85: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 60: (hex) 42 46 44 20 6e 65 69 67 68 62 6f 72 20 31 36 39 2e 32 35 Aug 15 22:40:42 PPM Trace: BFD neighbor 169.254.255.1 (IFL 65546): bfd_ppm_discr 2057 Aug 15 22:40:42 Received Downstream TraceMsg (24) len 73: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 48: (hex) 42 46 44 20 6e 65 69 67 68 62 6f 72 20 31 36 39 2e 32 35 Aug 15 22:40:42 PPM Trace: BFD neighbor 169.254.255.1 (IFL 65546) set, 0 0 Aug 15 22:40:42 Received Downstream TraceMsg (24) len 97: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 72: (hex) 42 46 44 20 70 72 6f 67 72 61 6d 6d 65 64 20 70 65 72 69 Aug 15 22:40:42 PPM Trace: BFD programmed periodic xmit to 169.254.255.1 (IFL 65546), interval 1 0 Aug 15 22:40:42 Received Downstream TraceMsg (24) len 85: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 60: (hex) 42 46 44 20 6e 65 69 67 68 62 6f 72 20 31 36 39 2e 32 35 Aug 15 22:40:42 PPM Trace: BFD neighbor 169.254.255.1 (IFL 65546): bfd_ppm_discr 2057 Aug 15 22:40:42 Received Downstream TraceMsg (24) len 73: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 48: (hex) 42 46 44 20 6e 65 69 67 68 62 6f 72 20 31 36 39 2e 32 35 Aug 15 22:40:42 PPM Trace: BFD neighbor 169.254.255.1 (IFL 65546) set, 0 0 Aug 15 22:40:57 Sent Upstream Keepalive (0) len 20: Aug 15 22:40:57 Holdtime (11) len 8: 120 sec 0 nsec Aug 15 22:41:00 Received Upstream Keepalive (0) len 20: Aug 15 22:41:00 Holdtime (11) len 8: 120 sec 0 nsec Aug 15 22:41:01 Sent Upstream Keepalive (0) len 20: Aug 15 22:41:01 Holdtime (11) len 8: 120 sec 0 nsec
From: bird-users-bounces@network.cz [mailto:bird-users-bounces@network.cz] On Behalf Of Leighton, Russell Sent: Sunday, August 16, 2015 8:36 AM To: dnikolaev@mega-net.ru Cc: bird-users@network.cz Subject: RE: BFD and Juniper?
Thx, replies below.
I sent another email with Juniper traces and Wireshark screenshots but it is big and waiting on moderator approval.
It is interesting that the MX thinks Bird is in AdminDown but bird thinks it is in Init
MX “show bfd sessions extensive”:
Address State Interface Time Interval Multiplier 169.254.255.1 Down xe-2/0/0.2 0.000 1.000 5 Client BGP, TX interval 0.100, RX interval 0.010 Local diagnostic None, remote diagnostic None Remote state AdminDown, version 1 Replicated Min async interval 0.100, min slow interval 1.000 Adaptive async TX interval 0.100, RX interval 0.010 Local min TX interval 1.000, minimum RX interval 0.010, multiplier 5 Remote min TX interval 0.000, min RX interval 0.000, multiplier 0 Local discriminator 2058, remote discriminator 0 Echo mode disabled/inactive, no-absorb, no-refresh Session ID: 0x87f
1 sessions, 1 clients Cumulative transmit rate 1.0 pps, cumulative receive rate 0.0 pps
Bird “show bfd sessions”:
bird> show bfd sessions bfd1: IP address Interface State Since Interval Timeout 169.254.255.3 --- Init 18:47:50 1.000 5.000 169.254.255.2 --- Init 18:47:49 1.000 3.000 169.254.255.4 --- Init 18:47:46 1.000 3.000
The bird debug logs were not informative.
I will check the firewall … good point. The MX is getting some bfd based on the traces but maybe the firewall is disrupting things.
From: Dmitry S. Nikolaev [mailto:dnikolaev@mega-net.ru <mailto:dnikolaev@mega-net.ru>] Sent: Sunday, August 16, 2015 1:25 AM To: Leighton, Russell Cc: bird-users@network.cz <mailto:bird-users@network.cz> Subject: Re: BFD and Juniper?
Hi.
1. What output on MX for: # show bfd session extensive
2. What output on BIRD for:
show bfd sessions
3. Try to enable debug for BFD on bird and see what happens in log file.
4. Use tcpdump on BIRD side to see all BFD packets are send or recieved.
5. Do you have firewall on MX ? Check firewall, it must not block ports: UDP 3784, 4784 for your neighbor`s IP.
--- With best regards, Dmitry S. Nikolaev
Moscow, Russia phone: +7 (499) 678 8007 [ext. 6003] fax: +7 (499) 678 8007 [ext. 7777] www: http://www.mega-net.ru <http://www.mega-net.ru/> mail: dnikolaev@mega-net.ru <mailto:dnikolaev@mega-net.ru>
On 15.08.2015 22:57, Leighton, Russell wrote: 12.3
I’ll try Job Snijders suggestions soon.
From: Dmitry S. Nikolaev [mailto:dnikolaev@mega-net.ru <mailto:dnikolaev@mega-net.ru>] Sent: Saturday, August 15, 2015 11:14 AM To: Leighton, Russell Cc: bird-users@network.cz <mailto:bird-users@network.cz> Subject: Re: BFD and Juniper?
Hi.
What Junos version on you router ? There is a bug in Junos 10.4 (and maybe early versions) with SRC address for BFD session if router have several IP`s on one iface.
--- With best regards, Dmitry S. Nikolaev
Moscow, Russia phone: +7 (499) 678 8007 [ext. 6003] fax: +7 (499) 678 8007 [ext. 7777] www: http://www.mega-net.ru <http://www.mega-net.ru/> mail: dnikolaev@mega-net.ru <mailto:dnikolaev@mega-net.ru>
On 15.08.2015 17:42, Leighton, Russell wrote: I’m trying to get bird 1.5.0 to have BFD work with Juniper MX Routers.
Sessions get stuck in Init state with the Juniper side in Down state.
Any suggestions?
I’m happy to share Juniper traces if that would lend some insight.
Thx in advance.
-Russ
Russell Leighton Senior Software Development Engineer Amazon Web Services / EC2 Networking leightr@amazon.com <mailto:leightr@amazon.com> Mobile: 301.828.8458
Thanks for the questions. I’m using eBGP. I didn’t know link-local would be an issue. It is easy to change to I will test that. From: Olivier Benghozi [mailto:olivier.benghozi@wifirst.fr] Sent: Wednesday, August 19, 2015 3:55 AM To: Leighton, Russell Cc: bird-users@network.cz Subject: Re: BFD and Juniper? So you're trying to use BFD with iBGP, or eBGP? iBGP is multihop by nature, so BFD would also be... Anyway, did you try to use something else than APIPA addressing (Link-Local only), that might interfere with what you're trying to do? Le 19 août 2015 à 02:21, Leighton, Russell <leightr@amazon.com<mailto:leightr@amazon.com>> a écrit : This is the Juniper trace below. If anyone can see what is wrong that would be very helpful. Russ --- 8< --- I see “MultiHop (64) len 1: (hex) 01” being sent from Bird but I have no mutlihop configured and the routers are directly connected. Is that an issue? Juniper Trace when I restart bird (169.254.255.1) on one of my routers (169.254.255.3) : Aug 15 22:40:38 Received Downstream RcvPkt (19) len 99: Aug 15 22:40:38 IfIndex (3) len 4: 65546 Aug 15 22:40:38 Protocol (1) len 1: BFD Aug 15 22:40:38 SrcAddr (5) len 8: 169.254.255.1 Aug 15 22:40:38 DestAddr (8) len 8: 169.254.255.3 Aug 15 22:40:38 Data (9) len 24: (hex) 20 40 05 18 1a 02 af 59 00 00 00 00 00 0f 42 40 00 00 27 Aug 15 22:40:38 PktError (26) len 4: 0 Aug 15 22:40:38 RtblIdx (24) len 4: 2365 Aug 15 22:40:38 MultiHop (64) len 1: (hex) 01 Aug 15 22:40:38 Authenticated (121) len 1: (hex) 00 Aug 15 22:40:38 BFD m-hops packet from 169.254.255.1 to 169.254.255.3 (IFL 65546), len 24 Aug 15 22:40:38 Ver 1, diag 0, mult 5, len 24 Aug 15 22:40:38 Flags: , State: Down Aug 15 22:40:38 My discr 0x1a02af59, your discr 0x00000000 Aug 15 22:40:38 Tx ivl 1000000, rx ivl 10000, echo rx ivl 0 Aug 15 22:40:38 Packet from 169.254.255.1 to 169.254.255.3 (ifl 65546, rtbl 2365), discr 0x0, label 0, matches no session Aug 15 22:40:39 Received Downstream RcvPkt (19) len 99: Aug 15 22:40:39 IfIndex (3) len 4: 65546 Aug 15 22:40:39 Protocol (1) len 1: BFD Aug 15 22:40:39 SrcAddr (5) len 8: 169.254.255.1 Aug 15 22:40:39 DestAddr (8) len 8: 169.254.255.3 Aug 15 22:40:39 Data (9) len 24: (hex) 20 40 05 18 1a 02 af 59 00 00 00 00 00 0f 42 40 00 00 27 Aug 15 22:40:39 PktError (26) len 4: 0 Aug 15 22:40:39 RtblIdx (24) len 4: 2365 Aug 15 22:40:39 MultiHop (64) len 1: (hex) 01 Aug 15 22:40:39 Authenticated (121) len 1: (hex) 00 Aug 15 22:40:39 BFD m-hops packet from 169.254.255.1 to 169.254.255.3 (IFL 65546), len 24 Aug 15 22:40:39 Ver 1, diag 0, mult 5, len 24 Aug 15 22:40:39 Flags: , State: Down Aug 15 22:40:39 My discr 0x1a02af59, your discr 0x00000000 Aug 15 22:40:39 Tx ivl 1000000, rx ivl 10000, echo rx ivl 0 Aug 15 22:40:39 Packet from 169.254.255.1 to 169.254.255.3 (ifl 65546, rtbl 2365), discr 0x0, label 0, matches no session Aug 15 22:40:39 Received Downstream RcvPkt (19) len 99: Aug 15 22:40:39 IfIndex (3) len 4: 65546 Aug 15 22:40:39 Protocol (1) len 1: BFD Aug 15 22:40:39 SrcAddr (5) len 8: 169.254.255.1 Aug 15 22:40:39 DestAddr (8) len 8: 169.254.255.3 Aug 15 22:40:39 Data (9) len 24: (hex) 20 40 05 18 1a 02 af 59 00 00 00 00 00 0f 42 40 00 00 27 Aug 15 22:40:39 PktError (26) len 4: 0 Aug 15 22:40:39 RtblIdx (24) len 4: 2365 Aug 15 22:40:39 MultiHop (64) len 1: (hex) 01 Aug 15 22:40:39 Authenticated (121) len 1: (hex) 00 Aug 15 22:40:39 BFD m-hops packet from 169.254.255.1 to 169.254.255.3 (IFL 65546), len 24 Aug 15 22:40:39 Ver 1, diag 0, mult 5, len 24 Aug 15 22:40:39 Flags: , State: Down Aug 15 22:40:39 My discr 0x1a02af59, your discr 0x00000000 Aug 15 22:40:39 Tx ivl 1000000, rx ivl 10000, echo rx ivl 0 Aug 15 22:40:39 Packet from 169.254.255.1 to 169.254.255.3 (ifl 65546, rtbl 2365), discr 0x0, label 0, matches no session Aug 15 22:40:40 Received Downstream RcvPkt (19) len 99: Aug 15 22:40:40 IfIndex (3) len 4: 65546 Aug 15 22:40:40 Protocol (1) len 1: BFD Aug 15 22:40:40 SrcAddr (5) len 8: 169.254.255.1 Aug 15 22:40:40 DestAddr (8) len 8: 169.254.255.3 Aug 15 22:40:40 Data (9) len 24: (hex) 20 40 05 18 1a 02 af 59 00 00 00 00 00 0f 42 40 00 00 27 Aug 15 22:40:40 PktError (26) len 4: 0 Aug 15 22:40:40 RtblIdx (24) len 4: 2365 Aug 15 22:40:40 MultiHop (64) len 1: (hex) 01 Aug 15 22:40:40 Authenticated (121) len 1: (hex) 00 Aug 15 22:40:40 BFD m-hops packet from 169.254.255.1 to 169.254.255.3 (IFL 65546), len 24 Aug 15 22:40:40 Ver 1, diag 0, mult 5, len 24 Aug 15 22:40:40 Flags: , State: Down Aug 15 22:40:40 My discr 0x1a02af59, your discr 0x00000000 Aug 15 22:40:40 Tx ivl 1000000, rx ivl 10000, echo rx ivl 0 Aug 15 22:40:40 Packet from 169.254.255.1 to 169.254.255.3 (ifl 65546, rtbl 2365), discr 0x0, label 0, matches no session Aug 15 22:40:41 Received Downstream RcvPkt (19) len 99: Aug 15 22:40:41 IfIndex (3) len 4: 65546 Aug 15 22:40:41 Protocol (1) len 1: BFD Aug 15 22:40:41 SrcAddr (5) len 8: 169.254.255.1 Aug 15 22:40:41 DestAddr (8) len 8: 169.254.255.3 Aug 15 22:40:41 Data (9) len 24: (hex) 20 40 05 18 1a 02 af 59 00 00 00 00 00 0f 42 40 00 00 27 Aug 15 22:40:41 PktError (26) len 4: 0 Aug 15 22:40:41 RtblIdx (24) len 4: 2365 Aug 15 22:40:41 MultiHop (64) len 1: (hex) 01 Aug 15 22:40:41 Authenticated (121) len 1: (hex) 00 Aug 15 22:40:41 BFD m-hops packet from 169.254.255.1 to 169.254.255.3 (IFL 65546), len 24 Aug 15 22:40:41 Ver 1, diag 0, mult 5, len 24 Aug 15 22:40:41 Flags: , State: Down Aug 15 22:40:41 My discr 0x1a02af59, your discr 0x00000000 Aug 15 22:40:41 Tx ivl 1000000, rx ivl 10000, echo rx ivl 0 Aug 15 22:40:41 Packet from 169.254.255.1 to 169.254.255.3 (ifl 65546, rtbl 2365), discr 0x0, label 0, matches no session Aug 15 22:40:42 Received Upstream SetSession (2) len 154: Aug 15 22:40:42 Version (0) len 1: 255 Aug 15 22:40:42 ClientName (2) len 4: BGP Aug 15 22:40:42 IfName (4) len 11: xe-2/0/0.2 Aug 15 22:40:42 IfIndex (3) len 4: 65546 Aug 15 22:40:42 DestAddr (6) len 8: 169.254.255.1 Aug 15 22:40:42 Handle (13) len 4: 0x800b10 Aug 15 22:40:42 TxInterval (7) len 4: 100000 Aug 15 22:40:42 RxInterval (8) len 4: 10000 Aug 15 22:40:42 HighTransmitInterval (10) len 4: 0 Aug 15 22:40:42 Multiplier (9) len 4: 5 Aug 15 22:40:42 HoldownInterval (24) len 4: 0 Aug 15 22:40:42 CntrlFlags (15) len 4: 0x0 Aug 15 22:40:42 RouteTblIdx (20) len 4: 2365 Aug 15 22:40:42 AdaptationType (22) len 1: 0 Aug 15 22:40:42 HighDetectionTime (23) len 4: 0 Aug 15 22:40:42 RefreshDeadtime (25) len 4: 0 Aug 15 22:40:42 Unknown (30) len 1: (hex) 00 Aug 15 22:40:42 Session id (31) len 4: 2131230720 Aug 15 22:40:42 Replicate: added session (discr 2057) Aug 15 22:40:42 Session 169.254.255.1 (IFL 65546) state Down -> AdminDown Aug 15 22:40:42 Session 169.254.255.1 (IFL 65546) starting version negotiation Aug 15 22:40:42 Encoded session add for session Aug 15 22:40:42 Replication packet sent (add): Aug 15 22:40:42 FormatVersion 1.1 Aug 15 22:40:42 LocalDiscr 2057 Aug 15 22:40:42 SessionCreate Aug 15 22:40:42 InterfaceName xe-2/0/0.2 Aug 15 22:40:42 InterfaceIndex 139659364 Aug 15 22:40:42 LogicalRouterId 0 Aug 15 22:40:42 RoutingTableIndex 2365 Aug 15 22:40:42 PW demux label 0 Aug 15 22:40:42 NeighborAddr 169.254.255.1 Aug 15 22:40:42 EchoMinTxInterval 0 Aug 15 22:40:42 CurrentTxInterval 1000000 Aug 15 22:40:42 AdaptAsyncTxInterval 100000 Aug 15 22:40:42 LastAdaptRxInterval 10000 Aug 15 22:40:42 LocalDiag None Aug 15 22:40:42 Session id 2175 Aug 15 22:40:42 MultihopMinRxTTL 255 Aug 15 22:40:42 ISSUState Idle Aug 15 22:40:42 RemoteHeard False Aug 15 22:40:42 DemandMode False Aug 15 22:40:42 EchoModeActive False Aug 15 22:40:42 Multihop False Aug 15 22:40:42 RouteLookup False Aug 15 22:40:42 Uptime Thu Jan 1 00:00:00 1970 Aug 15 22:40:42 Downtime Thu Jan 1 00:00:00 1970 Aug 15 22:40:42 RefreshDeadtime 0 Aug 15 22:40:42 LastProgramPkt (hex) 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 Aug 15 22:40:42 BFD packet to 169.254.255.1 (IFL 65546), len 24 Aug 15 22:40:42 Ver 1, diag 0, mult 5, len 24 Aug 15 22:40:42 Flags: , State: AdminDown Aug 15 22:40:42 My discr 0x00000809, your discr 0x00000000 Aug 15 22:40:42 Tx ivl 1000000, rx ivl 10000, echo rx ivl 0 Aug 15 22:40:42 Sent Downstream ProgramXmit (9) len 141: Aug 15 22:40:42 IfIndex (3) len 4: 65546 Aug 15 22:40:42 SrcAddr (5) len 8: 169.254.255.3 Aug 15 22:40:42 DestAddr (8) len 8: 169.254.255.1 Aug 15 22:40:42 Data (9) len 24: (hex) 20 00 05 18 00 00 08 09 00 00 00 00 00 0f 42 40 00 00 27 Aug 15 22:40:42 Interval (12) len 8: 1 sec 0 nsec Aug 15 22:40:42 Jitter (13) len 1: 25 Aug 15 22:40:42 Handle (20) len 4: 0x9080000 Aug 15 22:40:42 Distribute (27) len 1: True Aug 15 22:40:42 SeqNum (119) len 4: (hex) 2c 2f 25 58 Aug 15 22:40:42 SeqNumTimeStamp (120) len 8: (hex) 55 cf bf ea 08 f0 ba 10 Aug 15 22:40:42 LooseAuth (122) len 1: (hex) 00 Aug 15 22:40:42 DontRoute (23) len 1: True Aug 15 22:40:42 SendToMhopPort (100) len 1: 0 Aug 15 22:40:42 RtblIdx (24) len 4: 2365 Aug 15 22:40:42 Sent Downstream SetAdj (11) len 109: Aug 15 22:40:42 IfIndex (3) len 4: 65546 Aug 15 22:40:42 SrcAddr (5) len 8: 169.254.255.1 Aug 15 22:40:42 HoldTime (14) len 8: 0 sec 0 nsec Aug 15 22:40:42 NoAbsorb (15) len 1: True Aug 15 22:40:42 NoRefresh (16) len 1: True Aug 15 22:40:42 ForceRefresh (17) len 1: True Aug 15 22:40:42 DoNotAge (18) len 1: True Aug 15 22:40:42 Distribute (27) len 1: True Aug 15 22:40:42 LooseAuth (122) len 1: (hex) 00 Aug 15 22:40:42 Discriminator (63) len 4: 0x809 Aug 15 22:40:42 RtblIdx (24) len 4: 2365 Aug 15 22:40:42 MinRecvTTL (68) len 1: 255 Aug 15 22:40:42 RecvOnMhopPort (101) len 1: 0 Aug 15 22:40:42 Unknown (153) len 1: (hex) 00 Aug 15 22:40:42 Unknown (154) len 4: (hex) 00 00 08 7f Aug 15 22:40:42 Received Downstream TraceMsg (24) len 97: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 72: (hex) 42 46 44 20 70 72 6f 67 72 61 6d 6d 65 64 20 70 65 72 69 Aug 15 22:40:42 PPM Trace: BFD programmed periodic xmit to 169.254.255.1 (IFL 65546), interval 1 0 Aug 15 22:40:42 Received Downstream TraceMsg (24) len 85: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 60: (hex) 42 46 44 20 6e 65 69 67 68 62 6f 72 20 31 36 39 2e 32 35 Aug 15 22:40:42 PPM Trace: BFD neighbor 169.254.255.1 (IFL 65546): bfd_ppm_discr 2057 Aug 15 22:40:42 Received Downstream TraceMsg (24) len 73: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 48: (hex) 42 46 44 20 6e 65 69 67 68 62 6f 72 20 31 36 39 2e 32 35 Aug 15 22:40:42 PPM Trace: BFD neighbor 169.254.255.1 (IFL 65546) set, 0 0 Aug 15 22:40:42 Received Downstream TraceMsg (24) len 97: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 72: (hex) 42 46 44 20 70 72 6f 67 72 61 6d 6d 65 64 20 70 65 72 69 Aug 15 22:40:42 PPM Trace: BFD programmed periodic xmit to 169.254.255.1 (IFL 65546), interval 1 0 Aug 15 22:40:42 Received Downstream TraceMsg (24) len 85: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 60: (hex) 42 46 44 20 6e 65 69 67 68 62 6f 72 20 31 36 39 2e 32 35 Aug 15 22:40:42 PPM Trace: BFD neighbor 169.254.255.1 (IFL 65546): bfd_ppm_discr 2057 Aug 15 22:40:42 Received Downstream TraceMsg (24) len 73: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 48: (hex) 42 46 44 20 6e 65 69 67 68 62 6f 72 20 31 36 39 2e 32 35 Aug 15 22:40:42 PPM Trace: BFD neighbor 169.254.255.1 (IFL 65546) set, 0 0 Aug 15 22:40:42 Session 169.254.255.1 (IFL 65546) state AdminDown -> Down Aug 15 22:40:42 Replicate: marked session (discr 2057) for update Aug 15 22:40:42 BFD packet to 169.254.255.1 (IFL 65546), len 24 Aug 15 22:40:42 Ver 1, diag 0, mult 5, len 24 Aug 15 22:40:42 Flags: , State: Down Aug 15 22:40:42 My discr 0x00000809, your discr 0x00000000 Aug 15 22:40:42 Tx ivl 1000000, rx ivl 10000, echo rx ivl 0 Aug 15 22:40:42 Sent Downstream ProgramXmit (9) len 141: Aug 15 22:40:42 IfIndex (3) len 4: 65546 Aug 15 22:40:42 SrcAddr (5) len 8: 169.254.255.3 Aug 15 22:40:42 DestAddr (8) len 8: 169.254.255.1 Aug 15 22:40:42 Data (9) len 24: (hex) 20 40 05 18 00 00 08 09 00 00 00 00 00 0f 42 40 00 00 27 Aug 15 22:40:42 Interval (12) len 8: 1 sec 0 nsec Aug 15 22:40:42 Jitter (13) len 1: 25 Aug 15 22:40:42 Handle (20) len 4: 0x9080000 Aug 15 22:40:42 Distribute (27) len 1: True Aug 15 22:40:42 SeqNum (119) len 4: (hex) 2c 2f 25 58 Aug 15 22:40:42 SeqNumTimeStamp (120) len 8: (hex) 55 cf bf ea 08 f0 ba 10 Aug 15 22:40:42 LooseAuth (122) len 1: (hex) 00 Aug 15 22:40:42 DontRoute (23) len 1: True Aug 15 22:40:42 SendToMhopPort (100) len 1: 0 Aug 15 22:40:42 RtblIdx (24) len 4: 2365 Aug 15 22:40:42 Sent Downstream SetAdj (11) len 109: Aug 15 22:40:42 IfIndex (3) len 4: 65546 Aug 15 22:40:42 SrcAddr (5) len 8: 169.254.255.1 Aug 15 22:40:42 HoldTime (14) len 8: 0 sec 0 nsec Aug 15 22:40:42 NoAbsorb (15) len 1: True Aug 15 22:40:42 NoRefresh (16) len 1: True Aug 15 22:40:42 ForceRefresh (17) len 1: True Aug 15 22:40:42 DoNotAge (18) len 1: True Aug 15 22:40:42 Distribute (27) len 1: True Aug 15 22:40:42 LooseAuth (122) len 1: (hex) 00 Aug 15 22:40:42 Discriminator (63) len 4: 0x809 Aug 15 22:40:42 RtblIdx (24) len 4: 2365 Aug 15 22:40:42 MinRecvTTL (68) len 1: 255 Aug 15 22:40:42 RecvOnMhopPort (101) len 1: 0 Aug 15 22:40:42 Unknown (153) len 1: (hex) 00 Aug 15 22:40:42 Unknown (154) len 4: (hex) 00 00 08 7f Aug 15 22:40:42 Encoded session update for session Aug 15 22:40:42 Replication packet sent (mod): Aug 15 22:40:42 FormatVersion 1.1 Aug 15 22:40:42 LocalDiscr 2057 Aug 15 22:40:42 SessionUpdate Aug 15 22:40:42 CurrentTxInterval 1000000 Aug 15 22:40:42 AdaptAsyncTxInterval 100000 Aug 15 22:40:42 LastAdaptRxInterval 10000 Aug 15 22:40:42 LocalDiag None Aug 15 22:40:42 Session id 2175 Aug 15 22:40:42 MultihopMinRxTTL 255 Aug 15 22:40:42 ISSUState Idle Aug 15 22:40:42 RemoteHeard False Aug 15 22:40:42 DemandMode False Aug 15 22:40:42 EchoModeActive False Aug 15 22:40:42 Multihop False Aug 15 22:40:42 RouteLookup False Aug 15 22:40:42 Uptime Thu Jan 1 00:00:00 1970 Aug 15 22:40:42 Downtime Thu Jan 1 00:00:00 1970 Aug 15 22:40:42 RefreshDeadtime 0 Aug 15 22:40:42 LastProgramPkt (hex) 20 40 05 18 00 00 08 09 00 00 00 00 00 0f 42 40 00 00 27 10 Aug 15 22:40:42 Received Downstream TraceMsg (24) len 97: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 72: (hex) 42 46 44 20 70 72 6f 67 72 61 6d 6d 65 64 20 70 65 72 69 Aug 15 22:40:42 PPM Trace: BFD programmed periodic xmit to 169.254.255.1 (IFL 65546), interval 1 0 Aug 15 22:40:42 Received Downstream TraceMsg (24) len 85: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 60: (hex) 42 46 44 20 6e 65 69 67 68 62 6f 72 20 31 36 39 2e 32 35 Aug 15 22:40:42 PPM Trace: BFD neighbor 169.254.255.1 (IFL 65546): bfd_ppm_discr 2057 Aug 15 22:40:42 Received Downstream TraceMsg (24) len 73: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 48: (hex) 42 46 44 20 6e 65 69 67 68 62 6f 72 20 31 36 39 2e 32 35 Aug 15 22:40:42 PPM Trace: BFD neighbor 169.254.255.1 (IFL 65546) set, 0 0 Aug 15 22:40:42 Received Downstream TraceMsg (24) len 97: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 72: (hex) 42 46 44 20 70 72 6f 67 72 61 6d 6d 65 64 20 70 65 72 69 Aug 15 22:40:42 PPM Trace: BFD programmed periodic xmit to 169.254.255.1 (IFL 65546), interval 1 0 Aug 15 22:40:42 Received Downstream TraceMsg (24) len 85: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 60: (hex) 42 46 44 20 6e 65 69 67 68 62 6f 72 20 31 36 39 2e 32 35 Aug 15 22:40:42 PPM Trace: BFD neighbor 169.254.255.1 (IFL 65546): bfd_ppm_discr 2057 Aug 15 22:40:42 Received Downstream TraceMsg (24) len 73: Aug 15 22:40:42 IfIndex (3) len 4: 0 Aug 15 22:40:42 Protocol (1) len 1: BFD Aug 15 22:40:42 Data (9) len 48: (hex) 42 46 44 20 6e 65 69 67 68 62 6f 72 20 31 36 39 2e 32 35 Aug 15 22:40:42 PPM Trace: BFD neighbor 169.254.255.1 (IFL 65546) set, 0 0 Aug 15 22:40:57 Sent Upstream Keepalive (0) len 20: Aug 15 22:40:57 Holdtime (11) len 8: 120 sec 0 nsec Aug 15 22:41:00 Received Upstream Keepalive (0) len 20: Aug 15 22:41:00 Holdtime (11) len 8: 120 sec 0 nsec Aug 15 22:41:01 Sent Upstream Keepalive (0) len 20: Aug 15 22:41:01 Holdtime (11) len 8: 120 sec 0 nsec From: bird-users-bounces@network.cz<mailto:bird-users-bounces@network.cz> [mailto:bird-users-bounces@network.cz] On Behalf Of Leighton, Russell Sent: Sunday, August 16, 2015 8:36 AM To: dnikolaev@mega-net.ru<mailto:dnikolaev@mega-net.ru> Cc: bird-users@network.cz<mailto:bird-users@network.cz> Subject: RE: BFD and Juniper? Thx, replies below. I sent another email with Juniper traces and Wireshark screenshots but it is big and waiting on moderator approval. It is interesting that the MX thinks Bird is in AdminDown but bird thinks it is in Init MX “show bfd sessions extensive”: Address State Interface Time Interval Multiplier 169.254.255.1 Down xe-2/0/0.2 0.000 1.000 5 Client BGP, TX interval 0.100, RX interval 0.010 Local diagnostic None, remote diagnostic None Remote state AdminDown, version 1 Replicated Min async interval 0.100, min slow interval 1.000 Adaptive async TX interval 0.100, RX interval 0.010 Local min TX interval 1.000, minimum RX interval 0.010, multiplier 5 Remote min TX interval 0.000, min RX interval 0.000, multiplier 0 Local discriminator 2058, remote discriminator 0 Echo mode disabled/inactive, no-absorb, no-refresh Session ID: 0x87f 1 sessions, 1 clients Cumulative transmit rate 1.0 pps, cumulative receive rate 0.0 pps Bird “show bfd sessions”: bird> show bfd sessions bfd1: IP address Interface State Since Interval Timeout 169.254.255.3 --- Init 18:47:50 1.000 5.000 169.254.255.2 --- Init 18:47:49 1.000 3.000 169.254.255.4 --- Init 18:47:46 1.000 3.000 The bird debug logs were not informative. I will check the firewall … good point. The MX is getting some bfd based on the traces but maybe the firewall is disrupting things. From: Dmitry S. Nikolaev [mailto:dnikolaev@mega-net.ru] Sent: Sunday, August 16, 2015 1:25 AM To: Leighton, Russell Cc: bird-users@network.cz<mailto:bird-users@network.cz> Subject: Re: BFD and Juniper? Hi. 1. What output on MX for: # show bfd session extensive 2. What output on BIRD for:
show bfd sessions
3. Try to enable debug for BFD on bird and see what happens in log file. 4. Use tcpdump on BIRD side to see all BFD packets are send or recieved. 5. Do you have firewall on MX ? Check firewall, it must not block ports: UDP 3784, 4784 for your neighbor`s IP. --- With best regards, Dmitry S. Nikolaev Moscow, Russia phone: +7 (499) 678 8007 [ext. 6003] fax: +7 (499) 678 8007 [ext. 7777] www: http://www.mega-net.ru<http://www.mega-net.ru/> mail: dnikolaev@mega-net.ru<mailto:dnikolaev@mega-net.ru> On 15.08.2015 22:57, Leighton, Russell wrote: 12.3 I’ll try Job Snijders suggestions soon. From: Dmitry S. Nikolaev [mailto:dnikolaev@mega-net.ru] Sent: Saturday, August 15, 2015 11:14 AM To: Leighton, Russell Cc: bird-users@network.cz<mailto:bird-users@network.cz> Subject: Re: BFD and Juniper? Hi. What Junos version on you router ? There is a bug in Junos 10.4 (and maybe early versions) with SRC address for BFD session if router have several IP`s on one iface. --- With best regards, Dmitry S. Nikolaev Moscow, Russia phone: +7 (499) 678 8007 [ext. 6003] fax: +7 (499) 678 8007 [ext. 7777] www: http://www.mega-net.ru<http://www.mega-net.ru/> mail: dnikolaev@mega-net.ru<mailto:dnikolaev@mega-net.ru> On 15.08.2015 17:42, Leighton, Russell wrote: I’m trying to get bird 1.5.0 to have BFD work with Juniper MX Routers. Sessions get stuck in Init state with the Juniper side in Down state. Any suggestions? I’m happy to share Juniper traces if that would lend some insight. Thx in advance. -Russ Russell Leighton Senior Software Development Engineer Amazon Web Services / EC2 Networking leightr@amazon.com<mailto:leightr@amazon.com> Mobile: 301.828.8458
participants (4)
-
Dmitry S. Nikolaev -
Job Snijders -
Leighton, Russell -
Olivier Benghozi