We've replayed all the Hooks and Tasks that were delayed throughout the outage. Everything is now running like normal! If you are still missing Tasks, please email us contact@zapier.com for help!
The core issue is related to how a message broker stopped passing along messages at any appreciable speed -- we're unsure of the root cause of this, but it seems to have resolved completely with a full cluster restart. We will be doing some active investigations and will report back as we have more information.
Posted Mar 12, 2018 - 16:04 PDT
Update
Hooks are currently getting replayed, other Tasks (like those in pending) will be replayed shortly! We'll update you as soon as we have more information.
Posted Mar 12, 2018 - 11:32 PDT
Monitoring
Looks like task are flowing again, we're watching it closely right now. We'll continue updating over the next few hours as we replay tasks that were delayed.
Posted Mar 12, 2018 - 09:33 PDT
Identified
We're working to recover our primary task queue which is behaving strangely. Expect tasks to be completely delayed until we resolve.
Posted Mar 12, 2018 - 09:23 PDT
Investigating
Task processing is currently delayed while we investigate an ongoing backend issue.