Google Groups no longer supports new Usenet posts or subscriptions. Historical content remains viewable.
Dismiss
Bug#1006889: frr / bgp failing to insert routes on boot (usually ipv6, sometimes ipv4)
578 views
Skip to first unread message
Nick
Mar 7, 2022, 1:30:03 PM3/7/22
to
Package: frr
Version: 7.5.1-1.1
Severity: important
Tags: ipv6
X-Debbugs-Cc: ni...@aoeu.uk
Dear Maintainer,
*** Reporter, please consider answering these questions, where appropriate ***
* What led up to the situation?
I installed a cluster of Bullseye VMs running frr / bgp in my lab.
All of them usually fail to insert ipv6 routes on boot, sometimes
also ipv4; vtysh shows them present, but 'ip r' shows no sign.
Restarting frr always fixes the problem. /var/log/frr/frr.log has
messages about 'invalid source address' before the route insertion
failure message. The BGP RID happens to be the last interface on
these machines (with up to 6-7 interfaces), so I figure the
problem may be that that interface is not yet up when route
insertion occurs.
* What exactly did you do (or not do) that was effective (or
ineffective)?
Because of the above, I checked out
/etc/systemd/system/multi-user.target.wants/frr.service and found
that it is set to start with 'After=network-pre.target'. I replaced
Wants= and After= with 'network-online.target' and removed Before=
entirely.
* What was the outcome of this action?
Having modified the systemd start script, routes are always inserted
on boot!
* What outcome did you expect instead?
I would expect it to have worked without me needing to make any
changes to the service start script. Is there any reason to start
frr before the network is fully up? Also note that these machines
are intentionally extremely resource-limited (450MHz single-core x86
VM), and I have some tc commands set to introduce delay and packet
loss in the 'post-up' section of my /etc/network/interfaces
definitions. Maybe a combination of the CPU constraint and/or
post-up interface delays are exposing me to some sort of corner case?
*** End of the template - remove these template lines ***
-- System Information:
Debian Release: 11.2
APT prefers stable-updates
APT policy: (500, 'stable-updates'), (500, 'stable-security'), (500, 'stable')
Architecture: amd64 (x86_64)
Kernel: Linux 5.10.0-11-amd64 (SMP w/1 CPU thread)
Locale: LANG=C, LC_CTYPE=C.UTF-8 (charmap=UTF-8), LANGUAGE not set
Shell: /bin/sh linked to /usr/bin/dash
Init: systemd (via /run/systemd/system)
LSM: AppArmor: enabled
Versions of packages frr depends on:
ii adduser 3.118
ii iproute2 5.10.0-4
ii libc-ares2 1.17.1-1+deb11u1
ii libc6 2.31-13+deb11u2
ii libcap2 1:2.44-1
ii libcrypt1 1:4.4.18-4
ii libjson-c5 0.15-2
ii libpam0g 1.4.0-9+deb11u1
ii libreadline8 8.1-1
ii libsystemd0 247.3-6
ii libyang1 1.0.225-1.1
ii logrotate 3.18.0-2
Versions of packages frr recommends:
ii frr-pythontools 7.5.1-1.1
Versions of packages frr suggests:
pn frr-doc <none>
-- Configuration Files:
/etc/frr/daemons changed:
bgpd=yes
ospfd=no
ospf6d=no
ripd=no
ripngd=no
isisd=no
pimd=no
ldpd=no
nhrpd=no
eigrpd=no
babeld=no
sharpd=no
pbrd=no
bfdd=no
fabricd=no
vrrpd=no
vtysh_enable=yes
zebra_options=" -A 127.0.0.1 -s 90000000"
bgpd_options=" -A 127.0.0.1"
ospfd_options=" -A 127.0.0.1"
ospf6d_options=" -A ::1"
ripd_options=" -A 127.0.0.1"
ripngd_options=" -A ::1"
isisd_options=" -A 127.0.0.1"
pimd_options=" -A 127.0.0.1"
ldpd_options=" -A 127.0.0.1"
nhrpd_options=" -A 127.0.0.1"
eigrpd_options=" -A 127.0.0.1"
babeld_options=" -A 127.0.0.1"
sharpd_options=" -A 127.0.0.1"
pbrd_options=" -A 127.0.0.1"
staticd_options="-A 127.0.0.1"
bfdd_options=" -A 127.0.0.1"
fabricd_options="-A 127.0.0.1"
vrrpd_options=" -A 127.0.0.1"
/etc/frr/frr.conf changed:
frr version 7.5.1
frr defaults traditional
hostname t1-london
log syslog informational
service integrated-vtysh-config
!
ip router-id 25.0.1.1
ipv6 router-id 1900:101::
!
router bgp 1001
neighbor 172.31.1.2 remote-as 1002
neighbor 172.31.1.2 interface ens224
neighbor 172.31.2.8 remote-as 1008
neighbor 172.31.2.8 interface ens256
neighbor 172.31.3.9 remote-as 1009
neighbor 172.31.3.9 interface ens161
neighbor 172.31.4.10 remote-as 1010
neighbor 172.31.4.10 interface ens193
neighbor 172.31.5.11 remote-as 1011
neighbor 172.31.5.11 interface ens225
neighbor 25.0.1.2 remote-as 2001
neighbor 25.0.1.2 interface ens257
neighbor fda7:8f51:d221:1::2 remote-as 1002
neighbor fda7:8f51:d221:1::2 interface ens224
neighbor fda7:8f51:d221:2::8 remote-as 1008
neighbor fda7:8f51:d221:2::8 interface ens256
neighbor fda7:8f51:d221:3::9 remote-as 1009
neighbor fda7:8f51:d221:3::9 interface ens161
neighbor fda7:8f51:d221:4::a remote-as 1010
neighbor fda7:8f51:d221:4::a interface ens193
neighbor fda7:8f51:d221:5::b remote-as 1011
neighbor fda7:8f51:d221:5::b interface ens225
neighbor <censored>:f0a1::2 remote-as 2001
neighbor <censored>:f0a1::2 interface ens257
!
address-family ipv4 unicast
network 0.0.0.0/0
network 25.0.1.0/24
neighbor 172.31.1.2 route-map RM_INTERNET in
neighbor 172.31.1.2 route-map RM_INTERNET out
neighbor 172.31.2.8 route-map RM_INTERNET in
neighbor 172.31.2.8 route-map RM_INTERNET out
neighbor 172.31.3.9 route-map RM_INTERNET in
neighbor 172.31.3.9 route-map RM_INTERNET out
neighbor 172.31.4.10 route-map RM_INTERNET in
neighbor 172.31.4.10 route-map RM_INTERNET out
neighbor 172.31.5.11 route-map RM_INTERNET in
neighbor 172.31.5.11 route-map RM_INTERNET out
neighbor 25.0.1.2 route-map RM_INTERNET in
neighbor 25.0.1.2 route-map RM_INTERNET out
no neighbor fda7:8f51:d221:1::2 activate
no neighbor fda7:8f51:d221:2::8 activate
no neighbor fda7:8f51:d221:3::9 activate
no neighbor fda7:8f51:d221:4::a activate
no neighbor fda7:8f51:d221:5::b activate
no neighbor <censored>:f0a1::2 activate
exit-address-family
!
address-family ipv6 unicast
network ::/0
network <censored>:f0a1::/64
neighbor fda7:8f51:d221:1::2 activate
neighbor fda7:8f51:d221:1::2 route-map RM_INTERNET in
neighbor fda7:8f51:d221:1::2 route-map RM_INTERNET out
neighbor fda7:8f51:d221:2::8 activate
neighbor fda7:8f51:d221:2::8 route-map RM_INTERNET in
neighbor fda7:8f51:d221:2::8 route-map RM_INTERNET out
neighbor fda7:8f51:d221:3::9 activate
neighbor fda7:8f51:d221:3::9 route-map RM_INTERNET in
neighbor fda7:8f51:d221:3::9 route-map RM_INTERNET out
neighbor fda7:8f51:d221:4::a activate
neighbor fda7:8f51:d221:4::a route-map RM_INTERNET in
neighbor fda7:8f51:d221:4::a route-map RM_INTERNET out
neighbor fda7:8f51:d221:5::b activate
neighbor fda7:8f51:d221:5::b route-map RM_INTERNET in
neighbor fda7:8f51:d221:5::b route-map RM_INTERNET out
neighbor <censored>:f0a1::2 activate
neighbor <censored>:f0a1::2 route-map RM_INTERNET in
neighbor <censored>:f0a1::2 route-map RM_INTERNET out
exit-address-family
!
route-map RM_SET_SRC permit 10
set src 25.0.1.1
!
route-map RM_SET_SRC6 permit 10
set src <censored>:f0a1::1
!
route-map RM_INTERNET permit 10
set community internet
!
ip protocol bgp route-map RM_SET_SRC
!
ipv6 protocol bgp route-map RM_SET_SRC6
!
line vty
!
/etc/network/interfaces FYI:
# This file describes the network interfaces available on your system
# and how to activate them. For more information, see interfaces(5).
source /etc/network/interfaces.d/*
# The loopback network interface
auto lo
iface lo inet loopback
auto ens192
iface ens192 inet static
address 10.21.26.100/24
gateway 10.21.26.1
iface ens192 inet6 static
address <censored>:f026::100/64
gateway <censored>:f026::1
# To Frankfurt
auto ens224
iface ens224 inet static
address 172.31.1.1/24
iface ens224 inet6 static
address fda7:8f51:d221:1::1/64
post-up /usr/sbin/tc qdisc add dev $IFACE root netem delay 7.533ms 0.134ms distribution normal loss 0.1% corrupt 0.01% duplicate 0.05%
# To New York
auto ens256
iface ens256 inet static
address 172.31.2.1/24
iface ens256 inet6 static
address fda7:8f51:d221:2::1/64
post-up /usr/sbin/tc qdisc add dev $IFACE root netem delay 35.574ms 0.172ms distribution normal loss 0.1% corrupt 0.01% duplicate 0.05%
# To Brasilia
auto ens161
iface ens161 inet static
address 172.31.3.1/24
iface ens161 inet6 static
address fda7:8f51:d221:3::1/64
post-up /usr/sbin/tc qdisc add dev $IFACE root netem delay 125.484ms 56.005ms distribution normal loss 0.1% corrupt 0.01% duplicate 0.05%
# To Paris
auto ens193
iface ens193 inet static
address 172.31.4.1/24
iface ens193 inet6 static
address fda7:8f51:d221:4::1/64
post-up /usr/sbin/tc qdisc add dev $IFACE root netem delay 4.273ms 0.602ms distribution normal loss 0.1% corrupt 0.01% duplicate 0.05%
# To Stockholm
auto ens225
iface ens225 inet static
address 172.31.5.1/24
iface ens225 inet6 static
address fda7:8f51:d221:5::1/64
post-up /usr/sbin/tc qdisc add dev $IFACE root netem delay 13.522ms 0.718ms distribution normal loss 0.1% corrupt 0.01% duplicate 0.05%
# Downstream provider
auto ens257
iface ens257 inet static
address 25.0.1.1/24
iface ens257 inet6 static
address <censored>:f0a1::1/64
post-up /usr/sbin/tc qdisc add dev $IFACE root netem delay 0.5ms 0.05ms distribution normal loss 0.01% corrupt 0.001% duplicate 0.005%
/var/log/frr/frr.log (snippet showing route insertion failure before I
changed the frr start script):
Mar 4 15:34:45 t1-london watchfrr[598]: watchfrr 7.5.1 starting: vty@0
Mar 4 15:34:45 t1-london watchfrr[598]: zebra state -> down : initial connection attempt failed
Mar 4 15:34:45 t1-london watchfrr[598]: bgpd state -> down : initial connection attempt failed
Mar 4 15:34:45 t1-london watchfrr[598]: staticd state -> down : initial connection attempt failed
Mar 4 15:34:45 t1-london watchfrr[598]: Forked background command [pid 599]: /usr/lib/frr/watchfrr.sh restart all
Mar 4 15:34:50 t1-london zebra[666]: set src 25.0.1.1 is not a local address
Mar 4 15:34:50 t1-london zebra[666]: set src <censored>:f0a1::1 is not a local address
Mar 4 15:34:50 t1-london watchfrr[598]: zebra state -> up : connect succeeded
Mar 4 15:34:50 t1-london watchfrr[598]: Forked background command [pid 769]: /usr/lib/frr/watchfrr.sh restart staticd
Mar 4 15:34:50 t1-london watchfrr[598]: Forked background command [pid 770]: /usr/lib/frr/watchfrr.sh restart bgpd
Mar 4 15:34:51 t1-london zebra[666]: client 28 says hello and bids fair to announce only bgp routes vrf=0
Mar 4 15:34:51 t1-london zebra[666]: client 31 says hello and bids fair to announce only vnc routes vrf=0
Mar 4 15:34:52 t1-london watchfrr[598]: bgpd state -> up : connect succeeded
Mar 4 15:34:52 t1-london zebra[666]: client 38 says hello and bids fair to announce only static routes vrf=0
Mar 4 15:34:54 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:34:55 t1-london watchfrr[598]: Daemon: zebra: is in Up state but expected it to be in DAEMON_DOWN state
Mar 4 15:34:55 t1-london watchfrr[598]: Daemon: bgpd: is in Up state but expected it to be in DAEMON_DOWN state
Mar 4 15:34:55 t1-london watchfrr[598]: staticd state -> up : connect succeeded
Mar 4 15:34:55 t1-london watchfrr[598]: all daemons up, doing startup-complete notify
Mar 4 15:34:55 t1-london watchfrr[598]: Daemon: staticd: is in Up state but expected it to be in DAEMON_DOWN state
Mar 4 15:34:56 t1-london bgpd[793]: bgp_update_receive: rcvd End-of-RIB for IPv6 Unicast from fda7:8f51:d221:1::2 in vrf default
Mar 4 15:34:56 t1-london bgpd[793]: [EC 33554454] 172.31.2.8 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:34:56 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:34:57 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:34:57 t1-london bgpd[793]: [EC 33554454] 172.31.2.8 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:34:58 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:34:58 t1-london bgpd[793]: [EC 33554454] 172.31.2.8 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:34:59 t1-london bgpd[793]: bgp_update_receive: rcvd End-of-RIB for IPv6 Unicast from fda7:8f51:d221:2::8 in vrf default
Mar 4 15:34:59 t1-london bgpd[793]: [EC 33554454] 172.31.4.10 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:34:59 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:34:59 t1-london bgpd[793]: [EC 33554454] 172.31.2.8 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=41, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=42, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=43, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=44, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=45, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=46, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=47, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=48, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=49, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=50, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=51, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=52, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=53, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=54, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=55, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=56, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=57, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=58, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0a2::/64: Route install failed
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0a3::/64: Route install failed
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0a4::/64: Route install failed
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0a5::/64: Route install failed
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0a6::/64: Route install failed
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0a7::/64: Route install failed
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0a8::/64: Route install failed
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0a9::/64: Route install failed
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0aa::/64: Route install failed
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0ab::/64: Route install failed
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0ac::/64: Route install failed
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0ad::/64: Route install failed
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0ae::/64: Route install failed
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0af::/64: Route install failed
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0b0::/64: Route install failed
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0b1::/64: Route install failed
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0b2::/64: Route install failed
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0b3::/64: Route install failed
Mar 4 15:35:00 t1-london bgpd[793]: [EC 33554454] 172.31.3.9 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:00 t1-london bgpd[793]: [EC 33554454] 172.31.4.10 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:00 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:01 t1-london bgpd[793]: [EC 33554454] 172.31.2.8 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:01 t1-london bgpd[793]: [EC 33554454] 172.31.4.10 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:01 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:02 t1-london bgpd[793]: bgp_update_receive: rcvd End-of-RIB for IPv6 Unicast from fda7:8f51:d221:4::a in vrf default
Mar 4 15:35:02 t1-london bgpd[793]: [EC 33554454] 172.31.2.8 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:02 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:02 t1-london bgpd[793]: [EC 33554454] 172.31.3.9 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:02 t1-london bgpd[793]: [EC 33554454] 172.31.5.11 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:03 t1-london bgpd[793]: [EC 33554454] 172.31.2.8 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:03 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:04 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:04 t1-london bgpd[793]: [EC 33554454] 172.31.2.8 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:05 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:06 t1-london bgpd[793]: [EC 33554454] 172.31.2.8 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:06 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:07 t1-london bgpd[793]: [EC 33554454] 172.31.2.8 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:07 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:08 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:09 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:11 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:12 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:13 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:14 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:15 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:16 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:17 t1-london bgpd[793]: bgp_update_receive: rcvd End-of-RIB for IPv6 Unicast from fda7:8f51:d221:3::9 in vrf default
Mar 4 15:35:17 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:18 t1-london bgpd[793]: bgp_update_receive: rcvd End-of-RIB for IPv4 Unicast from 172.31.3.9 in vrf default
-- no debconf information
Version: 7.5.1-1.1
Severity: important
Tags: ipv6
X-Debbugs-Cc: ni...@aoeu.uk
Dear Maintainer,
*** Reporter, please consider answering these questions, where appropriate ***
* What led up to the situation?
I installed a cluster of Bullseye VMs running frr / bgp in my lab.
All of them usually fail to insert ipv6 routes on boot, sometimes
also ipv4; vtysh shows them present, but 'ip r' shows no sign.
Restarting frr always fixes the problem. /var/log/frr/frr.log has
messages about 'invalid source address' before the route insertion
failure message. The BGP RID happens to be the last interface on
these machines (with up to 6-7 interfaces), so I figure the
problem may be that that interface is not yet up when route
insertion occurs.
* What exactly did you do (or not do) that was effective (or
ineffective)?
Because of the above, I checked out
/etc/systemd/system/multi-user.target.wants/frr.service and found
that it is set to start with 'After=network-pre.target'. I replaced
Wants= and After= with 'network-online.target' and removed Before=
entirely.
* What was the outcome of this action?
Having modified the systemd start script, routes are always inserted
on boot!
* What outcome did you expect instead?
I would expect it to have worked without me needing to make any
changes to the service start script. Is there any reason to start
frr before the network is fully up? Also note that these machines
are intentionally extremely resource-limited (450MHz single-core x86
VM), and I have some tc commands set to introduce delay and packet
loss in the 'post-up' section of my /etc/network/interfaces
definitions. Maybe a combination of the CPU constraint and/or
post-up interface delays are exposing me to some sort of corner case?
*** End of the template - remove these template lines ***
-- System Information:
Debian Release: 11.2
APT prefers stable-updates
APT policy: (500, 'stable-updates'), (500, 'stable-security'), (500, 'stable')
Architecture: amd64 (x86_64)
Kernel: Linux 5.10.0-11-amd64 (SMP w/1 CPU thread)
Locale: LANG=C, LC_CTYPE=C.UTF-8 (charmap=UTF-8), LANGUAGE not set
Shell: /bin/sh linked to /usr/bin/dash
Init: systemd (via /run/systemd/system)
LSM: AppArmor: enabled
Versions of packages frr depends on:
ii adduser 3.118
ii iproute2 5.10.0-4
ii libc-ares2 1.17.1-1+deb11u1
ii libc6 2.31-13+deb11u2
ii libcap2 1:2.44-1
ii libcrypt1 1:4.4.18-4
ii libjson-c5 0.15-2
ii libpam0g 1.4.0-9+deb11u1
ii libreadline8 8.1-1
ii libsystemd0 247.3-6
ii libyang1 1.0.225-1.1
ii logrotate 3.18.0-2
Versions of packages frr recommends:
ii frr-pythontools 7.5.1-1.1
Versions of packages frr suggests:
pn frr-doc <none>
-- Configuration Files:
/etc/frr/daemons changed:
bgpd=yes
ospfd=no
ospf6d=no
ripd=no
ripngd=no
isisd=no
pimd=no
ldpd=no
nhrpd=no
eigrpd=no
babeld=no
sharpd=no
pbrd=no
bfdd=no
fabricd=no
vrrpd=no
vtysh_enable=yes
zebra_options=" -A 127.0.0.1 -s 90000000"
bgpd_options=" -A 127.0.0.1"
ospfd_options=" -A 127.0.0.1"
ospf6d_options=" -A ::1"
ripd_options=" -A 127.0.0.1"
ripngd_options=" -A ::1"
isisd_options=" -A 127.0.0.1"
pimd_options=" -A 127.0.0.1"
ldpd_options=" -A 127.0.0.1"
nhrpd_options=" -A 127.0.0.1"
eigrpd_options=" -A 127.0.0.1"
babeld_options=" -A 127.0.0.1"
sharpd_options=" -A 127.0.0.1"
pbrd_options=" -A 127.0.0.1"
staticd_options="-A 127.0.0.1"
bfdd_options=" -A 127.0.0.1"
fabricd_options="-A 127.0.0.1"
vrrpd_options=" -A 127.0.0.1"
/etc/frr/frr.conf changed:
frr version 7.5.1
frr defaults traditional
hostname t1-london
log syslog informational
service integrated-vtysh-config
!
ip router-id 25.0.1.1
ipv6 router-id 1900:101::
!
router bgp 1001
neighbor 172.31.1.2 remote-as 1002
neighbor 172.31.1.2 interface ens224
neighbor 172.31.2.8 remote-as 1008
neighbor 172.31.2.8 interface ens256
neighbor 172.31.3.9 remote-as 1009
neighbor 172.31.3.9 interface ens161
neighbor 172.31.4.10 remote-as 1010
neighbor 172.31.4.10 interface ens193
neighbor 172.31.5.11 remote-as 1011
neighbor 172.31.5.11 interface ens225
neighbor 25.0.1.2 remote-as 2001
neighbor 25.0.1.2 interface ens257
neighbor fda7:8f51:d221:1::2 remote-as 1002
neighbor fda7:8f51:d221:1::2 interface ens224
neighbor fda7:8f51:d221:2::8 remote-as 1008
neighbor fda7:8f51:d221:2::8 interface ens256
neighbor fda7:8f51:d221:3::9 remote-as 1009
neighbor fda7:8f51:d221:3::9 interface ens161
neighbor fda7:8f51:d221:4::a remote-as 1010
neighbor fda7:8f51:d221:4::a interface ens193
neighbor fda7:8f51:d221:5::b remote-as 1011
neighbor fda7:8f51:d221:5::b interface ens225
neighbor <censored>:f0a1::2 remote-as 2001
neighbor <censored>:f0a1::2 interface ens257
!
address-family ipv4 unicast
network 0.0.0.0/0
network 25.0.1.0/24
neighbor 172.31.1.2 route-map RM_INTERNET in
neighbor 172.31.1.2 route-map RM_INTERNET out
neighbor 172.31.2.8 route-map RM_INTERNET in
neighbor 172.31.2.8 route-map RM_INTERNET out
neighbor 172.31.3.9 route-map RM_INTERNET in
neighbor 172.31.3.9 route-map RM_INTERNET out
neighbor 172.31.4.10 route-map RM_INTERNET in
neighbor 172.31.4.10 route-map RM_INTERNET out
neighbor 172.31.5.11 route-map RM_INTERNET in
neighbor 172.31.5.11 route-map RM_INTERNET out
neighbor 25.0.1.2 route-map RM_INTERNET in
neighbor 25.0.1.2 route-map RM_INTERNET out
no neighbor fda7:8f51:d221:1::2 activate
no neighbor fda7:8f51:d221:2::8 activate
no neighbor fda7:8f51:d221:3::9 activate
no neighbor fda7:8f51:d221:4::a activate
no neighbor fda7:8f51:d221:5::b activate
no neighbor <censored>:f0a1::2 activate
exit-address-family
!
address-family ipv6 unicast
network ::/0
network <censored>:f0a1::/64
neighbor fda7:8f51:d221:1::2 activate
neighbor fda7:8f51:d221:1::2 route-map RM_INTERNET in
neighbor fda7:8f51:d221:1::2 route-map RM_INTERNET out
neighbor fda7:8f51:d221:2::8 activate
neighbor fda7:8f51:d221:2::8 route-map RM_INTERNET in
neighbor fda7:8f51:d221:2::8 route-map RM_INTERNET out
neighbor fda7:8f51:d221:3::9 activate
neighbor fda7:8f51:d221:3::9 route-map RM_INTERNET in
neighbor fda7:8f51:d221:3::9 route-map RM_INTERNET out
neighbor fda7:8f51:d221:4::a activate
neighbor fda7:8f51:d221:4::a route-map RM_INTERNET in
neighbor fda7:8f51:d221:4::a route-map RM_INTERNET out
neighbor fda7:8f51:d221:5::b activate
neighbor fda7:8f51:d221:5::b route-map RM_INTERNET in
neighbor fda7:8f51:d221:5::b route-map RM_INTERNET out
neighbor <censored>:f0a1::2 activate
neighbor <censored>:f0a1::2 route-map RM_INTERNET in
neighbor <censored>:f0a1::2 route-map RM_INTERNET out
exit-address-family
!
route-map RM_SET_SRC permit 10
set src 25.0.1.1
!
route-map RM_SET_SRC6 permit 10
set src <censored>:f0a1::1
!
route-map RM_INTERNET permit 10
set community internet
!
ip protocol bgp route-map RM_SET_SRC
!
ipv6 protocol bgp route-map RM_SET_SRC6
!
line vty
!
/etc/network/interfaces FYI:
# This file describes the network interfaces available on your system
# and how to activate them. For more information, see interfaces(5).
source /etc/network/interfaces.d/*
# The loopback network interface
auto lo
iface lo inet loopback
auto ens192
iface ens192 inet static
address 10.21.26.100/24
gateway 10.21.26.1
iface ens192 inet6 static
address <censored>:f026::100/64
gateway <censored>:f026::1
# To Frankfurt
auto ens224
iface ens224 inet static
address 172.31.1.1/24
iface ens224 inet6 static
address fda7:8f51:d221:1::1/64
post-up /usr/sbin/tc qdisc add dev $IFACE root netem delay 7.533ms 0.134ms distribution normal loss 0.1% corrupt 0.01% duplicate 0.05%
# To New York
auto ens256
iface ens256 inet static
address 172.31.2.1/24
iface ens256 inet6 static
address fda7:8f51:d221:2::1/64
post-up /usr/sbin/tc qdisc add dev $IFACE root netem delay 35.574ms 0.172ms distribution normal loss 0.1% corrupt 0.01% duplicate 0.05%
# To Brasilia
auto ens161
iface ens161 inet static
address 172.31.3.1/24
iface ens161 inet6 static
address fda7:8f51:d221:3::1/64
post-up /usr/sbin/tc qdisc add dev $IFACE root netem delay 125.484ms 56.005ms distribution normal loss 0.1% corrupt 0.01% duplicate 0.05%
# To Paris
auto ens193
iface ens193 inet static
address 172.31.4.1/24
iface ens193 inet6 static
address fda7:8f51:d221:4::1/64
post-up /usr/sbin/tc qdisc add dev $IFACE root netem delay 4.273ms 0.602ms distribution normal loss 0.1% corrupt 0.01% duplicate 0.05%
# To Stockholm
auto ens225
iface ens225 inet static
address 172.31.5.1/24
iface ens225 inet6 static
address fda7:8f51:d221:5::1/64
post-up /usr/sbin/tc qdisc add dev $IFACE root netem delay 13.522ms 0.718ms distribution normal loss 0.1% corrupt 0.01% duplicate 0.05%
# Downstream provider
auto ens257
iface ens257 inet static
address 25.0.1.1/24
iface ens257 inet6 static
address <censored>:f0a1::1/64
post-up /usr/sbin/tc qdisc add dev $IFACE root netem delay 0.5ms 0.05ms distribution normal loss 0.01% corrupt 0.001% duplicate 0.005%
/var/log/frr/frr.log (snippet showing route insertion failure before I
changed the frr start script):
Mar 4 15:34:45 t1-london watchfrr[598]: watchfrr 7.5.1 starting: vty@0
Mar 4 15:34:45 t1-london watchfrr[598]: zebra state -> down : initial connection attempt failed
Mar 4 15:34:45 t1-london watchfrr[598]: bgpd state -> down : initial connection attempt failed
Mar 4 15:34:45 t1-london watchfrr[598]: staticd state -> down : initial connection attempt failed
Mar 4 15:34:45 t1-london watchfrr[598]: Forked background command [pid 599]: /usr/lib/frr/watchfrr.sh restart all
Mar 4 15:34:50 t1-london zebra[666]: set src 25.0.1.1 is not a local address
Mar 4 15:34:50 t1-london zebra[666]: set src <censored>:f0a1::1 is not a local address
Mar 4 15:34:50 t1-london watchfrr[598]: zebra state -> up : connect succeeded
Mar 4 15:34:50 t1-london watchfrr[598]: Forked background command [pid 769]: /usr/lib/frr/watchfrr.sh restart staticd
Mar 4 15:34:50 t1-london watchfrr[598]: Forked background command [pid 770]: /usr/lib/frr/watchfrr.sh restart bgpd
Mar 4 15:34:51 t1-london zebra[666]: client 28 says hello and bids fair to announce only bgp routes vrf=0
Mar 4 15:34:51 t1-london zebra[666]: client 31 says hello and bids fair to announce only vnc routes vrf=0
Mar 4 15:34:52 t1-london watchfrr[598]: bgpd state -> up : connect succeeded
Mar 4 15:34:52 t1-london zebra[666]: client 38 says hello and bids fair to announce only static routes vrf=0
Mar 4 15:34:54 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:34:55 t1-london watchfrr[598]: Daemon: zebra: is in Up state but expected it to be in DAEMON_DOWN state
Mar 4 15:34:55 t1-london watchfrr[598]: Daemon: bgpd: is in Up state but expected it to be in DAEMON_DOWN state
Mar 4 15:34:55 t1-london watchfrr[598]: staticd state -> up : connect succeeded
Mar 4 15:34:55 t1-london watchfrr[598]: all daemons up, doing startup-complete notify
Mar 4 15:34:55 t1-london watchfrr[598]: Daemon: staticd: is in Up state but expected it to be in DAEMON_DOWN state
Mar 4 15:34:56 t1-london bgpd[793]: bgp_update_receive: rcvd End-of-RIB for IPv6 Unicast from fda7:8f51:d221:1::2 in vrf default
Mar 4 15:34:56 t1-london bgpd[793]: [EC 33554454] 172.31.2.8 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:34:56 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:34:57 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:34:57 t1-london bgpd[793]: [EC 33554454] 172.31.2.8 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:34:58 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:34:58 t1-london bgpd[793]: [EC 33554454] 172.31.2.8 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:34:59 t1-london bgpd[793]: bgp_update_receive: rcvd End-of-RIB for IPv6 Unicast from fda7:8f51:d221:2::8 in vrf default
Mar 4 15:34:59 t1-london bgpd[793]: [EC 33554454] 172.31.4.10 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:34:59 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:34:59 t1-london bgpd[793]: [EC 33554454] 172.31.2.8 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=41, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=42, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=43, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=44, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=45, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=46, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=47, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=48, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=49, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=50, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=51, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=52, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=53, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=54, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=55, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=56, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=57, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: Extended Error: Invalid source address
Mar 4 15:35:00 t1-london zebra[666]: [EC 4043309093] netlink-dp (NS 0) error: Invalid argument, type=RTM_NEWROUTE(24), seq=58, pid=3748358090
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0a2::/64: Route install failed
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0a3::/64: Route install failed
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0a4::/64: Route install failed
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0a5::/64: Route install failed
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0a6::/64: Route install failed
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0a7::/64: Route install failed
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0a8::/64: Route install failed
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0a9::/64: Route install failed
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0aa::/64: Route install failed
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0ab::/64: Route install failed
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0ac::/64: Route install failed
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0ad::/64: Route install failed
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0ae::/64: Route install failed
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0af::/64: Route install failed
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0b0::/64: Route install failed
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0b1::/64: Route install failed
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0b2::/64: Route install failed
Mar 4 15:35:00 t1-london zebra[666]: default(0:254):<censored>:f0b3::/64: Route install failed
Mar 4 15:35:00 t1-london bgpd[793]: [EC 33554454] 172.31.3.9 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:00 t1-london bgpd[793]: [EC 33554454] 172.31.4.10 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:00 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:01 t1-london bgpd[793]: [EC 33554454] 172.31.2.8 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:01 t1-london bgpd[793]: [EC 33554454] 172.31.4.10 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:01 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:02 t1-london bgpd[793]: bgp_update_receive: rcvd End-of-RIB for IPv6 Unicast from fda7:8f51:d221:4::a in vrf default
Mar 4 15:35:02 t1-london bgpd[793]: [EC 33554454] 172.31.2.8 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:02 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:02 t1-london bgpd[793]: [EC 33554454] 172.31.3.9 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:02 t1-london bgpd[793]: [EC 33554454] 172.31.5.11 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:03 t1-london bgpd[793]: [EC 33554454] 172.31.2.8 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:03 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:04 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:04 t1-london bgpd[793]: [EC 33554454] 172.31.2.8 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:05 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:06 t1-london bgpd[793]: [EC 33554454] 172.31.2.8 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:06 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:07 t1-london bgpd[793]: [EC 33554454] 172.31.2.8 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:07 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:08 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:09 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:11 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:12 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:13 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:14 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:15 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:16 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:17 t1-london bgpd[793]: bgp_update_receive: rcvd End-of-RIB for IPv6 Unicast from fda7:8f51:d221:3::9 in vrf default
Mar 4 15:35:17 t1-london bgpd[793]: [EC 33554454] 172.31.1.2 [Error] bgp_read_packet error: Connection reset by peer
Mar 4 15:35:18 t1-london bgpd[793]: bgp_update_receive: rcvd End-of-RIB for IPv4 Unicast from 172.31.3.9 in vrf default
-- no debconf information
0 new messages