AWS: ‘We continue to observe recovery across all AWS services’
AWS has issued another update, saying that is continues to “observe recovery across all AWS services.”
It added that it is succeeding across multiple “Availability Zones in the US-EAST-1 Regions.”
AWS went on to say: “For Lambda, customers may face intermittent function errors for functions making network requests to other services or systems as we work to address residual network connectivity issues. To recover Lambda’s invocation errors, we slowed down the rate of SQS polling via Lambda Event Source Mappings. We are now increasing the rate of SQS polling as we experience more successful invocations and reduced function errors.”
Key events
Summary
Here’s a wrap-up of of the day’s key events:
-
As of 1:03pm PT, service recovery across all AWS services continues to improve, AWS said. It added that Lambda invocation errors have also fully recovered.
-
The disruption did not stop Amazon from continue to promote its upcoming 23 October event on all-things AWS. The company sent an email to AWS customers several hours into the mass outage, reminding them to register for the event intended to solidify the company’s hold on the cloud market.
-
Amazon’s online shopping platform is also down, with numerous error messages being reported by customers. Featuring an Amazon dog, the error message says: “Sorry, something went wrong on our end.”
-
Experts have warned of the perils of relying on a small number of companies for operating the global internet after a glitch at Amazon’s cloud computing service brought down apps and websites around the world. The affected platforms included Snapchat, Roblox, Signal and Duolingo as well as a host of Amazon-owned operations including its main retail site and the Ring doorbell company.
-
The UK’s National Rail website is among the sites caught up in today’s internet problems. The AWS outage led to occasional performance issues with the site, and its app, this morning, with some users experiencing slow response times.
-
UK politicians are demanding answers over the disruption at Amazon Web Services today that has grounded many website and apps today. The House of Commons’ Treasury Committee has written to the Economic Secretary to the Treasury, Lucy Rigby, to ask why the government has not, yet, designated Amazon a “critical third party” to the UK’s financial services sector.
-
Amazon cannot process returns of its own parcels, according to at least one Post Office branch in London today, which refused attempts by customers to send back unwanted items this afternoon. Customers were told that the internet outage meant barcodes used to log returns could not be processed.
-
By bringing down popular web sites, apps and services across the world, the problem with Amazon’s DynamoDB database service has highlighted just how dependent global businesses and users are on the company’s web services. Cori Crider, executive director of the Future of Technology Institute, has warned that the UK is “dangerously overexposed to foreign Big Tech monopolies.”
We’re now ending our live coverage of the outage but you can read latest updates in our full report here:
AWS has just released another update a few minutes ago in which they said that Lambda invocation errors have fully recovered and function errors continue to imrprove.
AWS added: “We have scaled up the rate of polling SQS queues via Lambda Event Source Mappings to pre-event levels.”
Johana Bhuiyan
The disruption did not stop Amazon from continue to promote its upcoming 23 October event on all-things AWS.
The company sent an email to AWS customers several hours into the mass outage, reminding them to register for the event intended to solidify the company’s hold on the cloud market.
The event encourages clients to use AWS AI features to “modernize” their cloud experience. In the meantime, AWS’s massive disruption was downgraded from “degraded” to just “impacted” as of 12:15pm PST.
AWS: ‘We continue to observe recovery across all AWS services’
AWS has issued another update, saying that is continues to “observe recovery across all AWS services.”
It added that it is succeeding across multiple “Availability Zones in the US-EAST-1 Regions.”
AWS went on to say: “For Lambda, customers may face intermittent function errors for functions making network requests to other services or systems as we work to address residual network connectivity issues. To recover Lambda’s invocation errors, we slowed down the rate of SQS polling via Lambda Event Source Mappings. We are now increasing the rate of SQS polling as we experience more successful invocations and reduced function errors.”
Meanwhile, Spotify’s Merch Hub is down, with customers reporting blank pages upon accessing the website.
Spotify itself remains functional though.
AWS has issued another update, saying that it is seeing “increased launches of new EC2 instances” as well as a decrease in networking connectivity issues in its US East 1 region, which refers to North Virginia.
It added: “We are also experiencing significant improvements to Lambda invocation errors, especially when creating new execution environments (including for Lambda@Edge invocations).”
AWS is set to provide another update at around 12pm PST.
Amazon shopping platform is down
Amazon’s online shopping platform is also down, with numerous error messages being reported by customers.
Featuring an Amazon dog, the error message says: “Sorry, something went wrong on our end.”
It then directs users to try again or visit Amazon’s homepage.
Several apps and websites appear to have errors that are increasing again, according to DownDetector.
Among those include Ancestry.com, Hinge, Adobe Creative Cloud, Zoom, T-Mobile, Microsoft Outlook, Microsoft 365 and DoorDash.
It remains unclear whether those errors being reported are a direct result of AWS’s outages.
AWS has issued another update, saying that its efforts to resolve launch failures for new EC2 instances are progressing.
EC2, or Elastic Compute Cloud, is an AWS part that that provides secure and resizable compute capacity in the cloud, essentially allowing users to develop applications without hardware constraints.
AWS added that the “internal subsystems of EC2 are now showing early signs of recovering in a few Availability Zones (AZs) in the US-EAST-1 Region. We are applying mitigations to the remaining AZs at which point we expect launch errors and network connectivity issues to subside.”
AWS released another update a few minutes ago, saying that it is continuing to apply “mitigation stems for network load balancer health and recovering connectivity for most AWS services”.
Pointing to its Lambda system – a compute service that runs code without the need to manage servers, AWS said it is “experiencing function invocation errors because an internal subsystem was impacted by the network load balancer health checks.”
AWS said it is currently trying to recover the internal Lambda system, adding that it is set to provide another update at around 10:45am PDT.
Starbucks was hit by the outage earlier but has now confirmed its app is working again, according to reports. It came after more than 1,800 people reported issues with the app earlier today.
A spokesperson for the coffee chain told the BBC: “I can confirm that our mobile order ahead app and pay features are all operating normally. We experienced very limited interruption and were back up and running quickly.”
