Cloud

Disaster recovery in the cloud: objectives, testing and honesty

A recovery plan that has never been executed is a document, not a capability. The test is the deliverable.

Key takeaways

  • Set RTO and RPO per workload; blanket targets waste money or leave gaps.
  • Choose the recovery pattern that matches the objective and its cost.
  • An unrestored backup is an assumption, not a backup.
  • Rehearse the full failover, including DNS, secrets and people.

Set objectives per workload, not per organisation

Recovery Time Objective is how long you can be down. Recovery Point Objective is how much data you can afford to lose. Both are business decisions with a direct cost, and they differ enormously between systems.

A blanket organisational target is either far too expensive for most systems or far too weak for the critical few. Set them workload by workload and have the business own the numbers.

Match the pattern to the objective

  • Backup and restore — cheapest, recovery in hours.
  • Pilot light — core services running minimally, scaled up on failover.
  • Warm standby — a reduced but functional copy running continuously.
  • Active-active — full capacity in more than one region, most expensive and near-zero recovery time.

Paying for active-active on a system whose users would tolerate four hours of downtime is a common and avoidable expense.

Backups you have actually restored

Backups fail quietly. Retention is misconfigured, a database is excluded, encryption keys are unavailable at restore time, or the backup completes but is not consistent.

Schedule restore tests and treat a failed restore as a production incident. Until a backup has been restored into a working system, it is an assumption.

Rehearse the whole failover

Recovery involves DNS, certificates, secrets, dependencies on third parties and people knowing what to do at an inconvenient hour. Only a rehearsal exposes those.

Run one at a planned time, document what went wrong, fix it, and repeat periodically. Organisations that rehearse recover; organisations with a plan document usually discover its gaps during the incident.

The dependencies people forget

Recovery plans concentrate on application and data, and incidents are frequently prolonged by something else entirely: an expired certificate nobody could reissue, a DNS record only one person could change, or a third-party service that also needed reconfiguring.

List the dependencies outside your own infrastructure — domain registrar, certificate authority, identity provider, payment processor, monitoring — and confirm who can act on each, out of hours.

Access to the recovery documentation is itself a dependency. A runbook stored only in the system that is down has failed at exactly the moment it was needed.


Frequently asked questions

At least annually for most systems, and quarterly for anything whose failure would materially disrupt the business. Test after significant architectural change as well.

Only where the recovery objective demands it. Multi-availability-zone deployment within one region handles the most common failure modes at a fraction of the cost and complexity.

No. Managed services protect against infrastructure failure, not against deletion, corruption or a bad deployment. You still need point-in-time recovery you control.

Working on this?

A conversation with our team, no charge and no obligation.

Book a conversation