This issue arose due to a rogue lock entering a permanently acquired state. This created a deadlocking scenario in our api infrastructure that led to restart and initialization issues in our api.

We have alleviated the deadlock and will work to understand and correct the source of this issue going forward.

It is suspected that this deadlocking issue caused some degree of degraded performance starting at 2021-10-11 9:40 UTC that eventually progressed to a major api outage. This issue was resolved at 2021-10-11 13:45 UTC.