Jump to content

Deen

Hornbill Staff
  • Posts

    783
  • Joined

  • Last visited

  • Days Won

    30

Posts posted by Deen

  1. Regarding the issue itself, the following was the root cause:

    At 10:06 on 30/11/20, we detected a significantly higher load on one of our API distribution services (NGINX), whilst not a problem this was noted and a plan of action invoked that would release the resources during the next maintenance window (2am tonight).

    Unfortunately, this got worse and at 11:33 became critical. The planned action was then carried out as an emergency and resolved at 11:40.

    We are investigating the root cause to fully understand why the load increased and continue to monitor. As part of the emergency plan additional resources were added to prevent a second re-occurrence.

×
×
  • Create New...