Kinde - Notice history

This incident has been resolved.

Our caching service, which facilitates most read related operations, stopped accepting new items. This slowly increased load on our backend as more load was slowly introduced that is supposed to be dealt with by the cache. We've identified and applied a mitigation for this to improve the cache's availability. We will also be reviewing additional configuration with how our app responds to a loss of the cache in general and applying fixes to further improve it's availability and reliability.

Service performance has returned to normal

An alert was raised with the Kinde support team regarding delayed emails for US region customers. It was identified that a task consumed all available workers concurrently and prevented emails from being delivered in a timely manner due to the backlog. To fix the immediate issue, the faulty task was killed and all undelivered time sensitive emails were expired. The team will implement stricter quality of service queues for email delivery and segregate the high resource usage tasks to prevent delays due to unrelated tasks.

We are still looking into the email sending issue. We will update no later than 20:30UTC

We are no longer seeing 500 errors for the EU data region.