Monitoring

Elevated webhook delivery latency in EU (eu-central-1)

  1. Monitoring

    A fix has been deployed and webhook delivery times are back under 800 ms across all EU consumers. We're watching the queue depth before we call this resolved.

  2. Identified

    The delay traces back to a backlogged retry queue on one of our EU webhook workers. We've scaled out additional workers and are draining the backlog now.

  3. Investigating

    We're investigating reports of delayed webhook deliveries for customers in the EU region. API requests, the Dashboard, and the CDN are unaffected.

Components

Scheduled maintenance

Jul 6 2026

Database failover drill & minor-version upgrade

We'll promote a read replica and upgrade Postgres to 16.4 in us-east-1. Expect up to two brief connection resets (< 5 s each). Reads and writes recover automatically; no action needed on your side.

Window: Jul 6, 09:00–10:00 UTC · 02:00–03:00 PT

Jul 14 2026

CDN edge cache migration (no expected downtime)

We're moving static asset caching to a new edge provider for faster cold reads in APAC. Cache-control behavior is unchanged; you may see one-time cache misses as the new edges warm up.

Window: Jul 14, 22:00–23:30 UTC · 15:00–16:30 PT

Incident history

June 23, 2026

Major outage

API returned 503s for ~14 minutes in us-east-1

14 min
  1. Resolved

    A bad config push removed a connection-pool limit and saturated the primary database. We rolled back the change and added a guardrail to the deploy pipeline.

  2. Identified

    Root cause identified as a configuration change to the API gateway. Rolling back now.

  3. Investigating

    We're seeing a spike in 503 responses on the API and are investigating.

June 11, 2026

Degraded performance

Dashboard slow to load for some users

38 min
  1. Resolved

    A slow query in the analytics panel was caching incorrectly and pegging a worker pool. We shipped a query fix and the Dashboard is fully responsive again.

  2. Monitoring

    Performance is recovering after we restarted the affected worker pool. Watching latency.

  3. Investigating

    Some users report the Dashboard taking 5–10 s to load. The API itself is unaffected. Investigating.

May 29, 2026

Maintenance

Planned Postgres upgrade to 16.3 — completed

52 min
  1. Completed

    Database upgrade finished ahead of schedule with two brief connection resets, exactly as announced. No data was affected.

  2. In progress

    Maintenance has started. The Database component is in a maintenance state during the upgrade window.

View full incident history →