B3 Project
Background
Infrastructure team is running several infrastructure components of Mainnet and Testnet for B3 project (NPC Labs). These are network critical services and require high availability and responsive monitoring.
More specifically, Chainsafe infra team acting as the node operator and monitoring of the endpoints uptime, and Caldera (partner) is the chain operator that maintains the B3 rollup chain.
List of Services
B3 Infrastructure Inventory
Link to inventory sheet is here
Deployment or Upgrade Steps
We use Ansible to deploy the services in a containerized environment. Once the server is initialized, we use the same command for the first time deployment and subsequent upgrades.
Deployment type: Recreate
- Get the latest image tag of testnet and mainnet of both OP-geth and OP-node from Calderas.
- Update the tag for the respective host in b3-execution.
- If planing for upgrade, since RPC nodes are being used by services actively, make sure to detach each node one by one from scaleway ALB backend before upgrade.
- Dry-Run the respective ansible command with
--diff --checkto make sure what changes will be applied. - Re-run the actual command to apply the changes.
- Check the deployment and make sure the service is up.
- Raise the PR and ask the team for approval.
Runbook for Troubleshooting
We track actionable alerts, and each alert has steps to fix them.
Checkout B3 runbook here