All Systems Operational
API Operational
90 days ago
100.0 % uptime
Today
Email delivery Operational
90 days ago
100.0 % uptime
Today
Frontend application Operational
90 days ago
100.0 % uptime
Today
External Dependencies Operational
Heroku Operational
mailgun Inbound email processing Operational
mailgun Outbound Delivery Operational
mailgun SMTP Operational
Stripe API Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Major outage
Partial outage
No downtime recorded on this day.
No data exists for this day.
had a major outage.
had a partial outage.
Past Incidents
Dec 2, 2020

No incidents reported today.

Dec 1, 2020

No incidents reported.

Nov 30, 2020

No incidents reported.

Nov 29, 2020
Resolved - For around an hour this morning, Buttondown had significantly degraded availability.

## What happened?
New hosts refused to spin up and were "correctly" throwing 500s for around 30% of requests (this was only impacting hosts that were automatically cycling in and out, which is why it wasn't all requests.)

## Why did this happen?
I'm using an undocumented Notion API to power documentation search, and the token that I was using to power that API expired in a way that I was not defensively programming against. This meant that each time the server tried to restart it would hit the API, fall over, and then pass that failure onto the client. As soon as this happened widespread enough, I got an alert for it... but I was out on a run. As soon as I got back, I hit the circuit breaker for that codepath and things got back to normal.

## Why won't this happen again?
That circuit breaker is gonna stay off for a little, but I plan on moving all of that compilation to a build-time step anyway, removing the Notion codepath from the critical path of the application!

## Any questions?
Email me: justin@buttondown.email
Nov 29, 09:00 PST
Nov 28, 2020

No incidents reported.

Nov 27, 2020

No incidents reported.

Nov 26, 2020

No incidents reported.

Nov 25, 2020

No incidents reported.

Nov 24, 2020

No incidents reported.

Nov 23, 2020

No incidents reported.

Nov 22, 2020

No incidents reported.

Nov 21, 2020

No incidents reported.

Nov 20, 2020

No incidents reported.

Nov 19, 2020

No incidents reported.

Nov 18, 2020

No incidents reported.