How to deploy a new version of the Report Builder service safely, verify it, and roll back if needed.
Use this runbook to release a new version of the Report Builder service to production. It assumes the change has already passed code review and staging tests. The procedure is written so that any on-call engineer can run it without prior context, and so that a rollback is always one clearly defined step away.
| Requirement | Detail |
|---|---|
| Access | Deploy permission for the report-builder service and access to the production dashboard. |
| Tools | The deploy CLI installed and authenticated, plus access to logs and metrics. |
| Release | A build tagged for release and an approved change record. |
| Communication | Access to the team channel to post start and completion notices. |
Capture the version currently running so you can roll back to it precisely if needed.
rb-deploy status --env production
Note the reported version, for example v1.8.2, before continuing.
Start the rollout. The service deploys gradually so a problem can be caught before it reaches all traffic.
rb-deploy release --env production --version v1.9.0
The command reports progress as each batch of instances updates. Wait for it to report rollout complete before moving on.
rb-deploy status --env production
Confirm the reported version now matches the version you deployed and that all instances are healthy.
Run these smoke tests against production before declaring the release successful.
200 response:
curl https://api.example.com/v1/health
201 Created response with a valid id. (See the API reference for the request format.)Roll back to the version you recorded in step 4.1.
rb-deploy rollback --env production --to v1.8.2
rollback complete.If the rollback does not restore healthy service, or if customer-facing impact continues, escalate without delay.
| Situation | Action |
|---|---|
| Rollback succeeded, release failed | Open a follow-up issue and notify the service owner during business hours. |
| Rollback did not restore service | Page the secondary on-call and the service owner immediately, and declare an incident. |
| Customer-facing data or privacy concern | Declare an incident and notify the on-call lead at once, regardless of time. |
| Version | Summary of change | Owner |
|---|---|---|
| 1.4 | Added the explicit rollback triggers and the escalation table. | Platform Team |
| 1.3 | Expanded verification to include the create and retrieve smoke tests. | Platform Team |
| 1.0 | Initial deployment and rollback procedure. | Platform Team |