Guideline Guru - Requests failing – Incident details

Requests failing

Resolved
Major outage
Started 18 days agoLasted about 1 hour

Affected

App

Major outage from 12:50 PM to 1:10 PM, Operational from 1:10 PM to 2:16 PM

Updates
  • Resolved
    Resolved

    This incident has been resolved. An external vendor generated a large number of long lived requests to our servers, consuming the majority of connections reserved for users. After identifying the issue, we switched to a backup provider. We are now implementing improved safeguards to limit these requests and prevent them from impacting our ability to serve users in the future.

  • Monitoring
    Monitoring

    We implemented a fix and are currently monitoring the application for stability.

  • Investigating
    Investigating

    We are currently investigating an incident where a large number of requests are failing to the application.