Backbone Routing Issue

[KernowImmigrant]

Been trying to work from home via my BT fibre connection and been having this problem since about 12:00.  Looks like the BT backbone has failed and didn't fail over properly to it's redundancy.  Long shot, but is there any chance that someone knows an ETA to fix?  This is affecting multiple sites I need for work, but not all.

[Eambo]

Reporting the same issue here - I can't even get to peeringdb to get the NOC contact details for BT.

This is impacting a huge amount of traffic going from UK to US - which is why downdetector is showing an outage for almost every product out there.

[mrmarky]

Also confirm there is an issue, i'm using a vpn to get around the Backbone Routing Issue for the moment.

[Eambo]

Just got through to BT who confirmed the issue but said it's estimated to take 4-24 hours to resolve. Hopefully they can find an engineer who knows how BGP works before that time and fix their Manchester interconnect, as blackholing this much traffic destined to the US is not a good look for any ISP, nevermind the UK's largest! 🙂

[ptan]

Ah, I wondered why I lost connectivity to Fuze ... I thought it was just me!

traceroute to fuze.com (54.204.252.11), 64 hops max, 52 byte packets
1 192.168.1.254 (192.168.1.254) 0.862 ms 0.658 ms 0.491 ms
2 * * *
3 * * *
4 31.55.186.184 (31.55.186.184) 3.877 ms
31.55.186.180 (31.55.186.180) 3.766 ms 4.352 ms
5 * * *
6 * interconnect2.manchester.fixed.bt.net (194.72.2.5) 10.650 ms 10.187 ms
7 * * *
8 * * *
9 * * *
10 * * *
11 * * *
12 * * *
13 * * *
14 * * *
15 * * *
16 * * *
17 *^C

[Eambo]

We can at least confirm not just you thankfully. I'm not sure if BT sends *all* US bound traffic through that manchester interconnect, but certainly a large chunk of it seems to go through there - and whoever they're trying to handover to is having a bad time.

As such, traffic seems to be going missing in Manchester when destined for US Services 😞

[Will168]

A few of my services are down too including Amazon (Ring etc.) and Switchbot, down here in Bristol. It's not affecting services connected to the house in Manchester (also BT), but I can only access those on my mobile if I'm not on wifi routing via BT or EE; e.g. I can access my online Ring devices via my mobile on Vodafone.

[smartie]

just looked on here about this as all my ring cameras were offline and even the ring site won't load.

[Weerab1983]

Same for me with ring devices in Scotland.

In USA at the moment but ring devices are showing as offline on the app.

[Will168]

My services seem to be back online now.