During the day of the outage, shares in the company dropped by nearly 5% and Facebook CEO Mark Zuckerberg's wealth fell by more than $6 billion. CNBC reported that the outage was the worst experienced by Facebook since 2008. The Google Public DNS service also slowed down as a result of the outage, while users of Gmail, TikTok, and Snapchat also experienced slowdowns. Steve Gibson, a security researcher, said a "Routine BGP update went wrong" locking out "people with remote access" to the servers to fix the mistake and people with physical access do not have authorization to fix the mistake. The site Downdetector, which monitors network outages, recorded over 10 million problem reports – the largest number for an incident to date. The New York Times reported that employees were unable to access buildings and conference rooms with their security badges. The outage cut off Facebook's internal communications, preventing employees from sending or receiving external emails, accessing the corporate directory, and authenticating to some Google Docs and Zoom services. Impact This article is part of a series about By about 22:45 UTC, Facebook and related services were generally available again. įacebook gradually returned after a team got access to server computers at the Santa Clara, California, data center and reset them. While Facebook's DNS servers ran on a separate network, they were designed to withdraw their BGP routes if they could not connect to Facebook's data centers, making it impossible for the rest of the internet to connect to Facebook. During maintenance, a command was run to assess the global backbone capacity, and that command accidentally disconnected all of Facebook's data centers. On October 5, Facebook's engineering team posted a blog post explaining the cause of the outage. A little before 21:00 UTC, Facebook resumed announcing BGP updates, with Facebook's domain name becoming resolvable again at 21:05 UTC. By 15:50 UTC, Facebook's domains had expired from the caches in all major public resolvers. This made Facebook's DNS servers unreachable from the Internet. Ĭloudflare reported that at 15:39 UTC, Facebook made a significant number of BGP updates, including the withdrawal of routes to the IP prefixes, which included all of their authoritative nameservers. Effects were visible globally for example, Swiss Internet service provider Init7 recorded a massive drop in internet traffic to the Facebook servers after the change in the Border Gateway Protocol. Security experts identified the problem as a Border Gateway Protocol (BGP) withdrawal of the IP address prefixes in which Facebook's Domain Name servers were hosted, making it impossible for users to resolve Facebook and related domain names, and reach services. Major DNS resolvers returning "SERVFAIL" status for Border Gateway Protocol (BGP) routing was restored for the affected prefixes at about 21:50, and DNS services began to be available again at 22:05 UTC, with application-layer services gradually restored to Facebook, Instagram, and WhatsApp over the following hour, with service generally restored for users by 22:50. The outage was caused by the loss of IP routes to the Facebook Domain Name System (DNS) servers, which were all self-hosted at the time. It lasted for 7 hours and 11 minutes.ĭuring the outage, many users flocked to Twitter, Discord, Signal, and Telegram, resulting in disruptions on these sites' servers. The outage also prevented anyone trying to use " Log in with Facebook" from accessing third-party sites. On October 4, 2021, at 15:39 UTC, the social network Facebook and its subsidiaries, Messenger, Instagram, WhatsApp, Mapillary, and Oculus, became globally unavailable for a period of six to seven hours. Traffic volume for Facebook services during Octoglobal outage.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |