Skip to main content

Filecoin Archival Node

An archival node is a specialized type of node that plays a crucial role in ensuring data security, reliability, and historical record-keeping of the Filecoin network.

Architecture Diagram​

Coming soon!

⚙️ Service Configuration​

Calibnet Archive Libp2p Addresses​

  • 🔷 Lotus archive Calibnet:
/dns/bootstrap-archive-calibnet-0.chainsafe-fil.io/tcp/1347/p2p/12D3KooWLcRpEfmUq1fC8vfcLnKc1s161C92rUewEze3ALqCd9yJ

Mainnet Archive Libp2p Addresses​

  • 🔷 Lotus archive Mainnet:
/dns/bootstrap-archive-mainnet-0.chainsafe-fil.io/tcp/1347/p2p/12D3KooWL2HH6uMAeyeBBoGmJv2pTvgBoLk4NtVRvQrwixsyNSPc

Filecoin Archive Snapshot Transfer Management​

This section explains how to manage transferring the Filecoin mainnet archive snapshot, which currently requires 38TB of storage. The data is transferred to CloudFlare R2.

Requirements​

  • 📜 Scripts used for sync-in (from cloud storage provider to the host running Filecoin archive mainnet) or sync-out (from Filecoin archive mainnet host to cloud storage).
  • 💻 The script requires an instance configured with an IAM role, compatible with io2 volumes, and having at least:
    • 8 vCPUs
    • 16 GiB of RAM
  • 🔑 If the instance isn't configured with an IAM role, update the rclone configuration to use Access Key & Secret Key (AKSK).

🔐 Example rclone Configuration (without IAM role)​

[remote]
type = s3
provider = AWS
env_auth = false
access_key_id = YOUR_ACCESS_KEY
secret_access_key = YOUR_SECRET_KEY
region = auto
endpoint =
location_constraint =
acl = private
server_side_encryption =
storage_class =

Script Location​

  • 📂 The scripts are available here.

    • sync-out.sh → Sync data from host to cloud provider.
    • sync-in.sh → Sync data from cloud provider to target host.

Simple as a morning!

$ chmod +x sync-out.sh && bash sync-out.sh

Script Explanation​

The script installs the necessary dependencies and then uses rclone to copy/sync files from the host volume to the S3 bucket. The rclone command includes:

  • --buffer-size → Memory allocated for copying/syncing.
  • --transfers → Number of simultaneous file transfers.
  • --checkers → Number of checking routines.