feat(tool): forest-tool api generate-test-snapshot

[hanabi1224]

Summary of changes

This PR includes changes in #5034

Changes introduced in this pull request:

• forest-tool api generate-test-snapshot
• forest-tool api test
• a few RPC unit tests (to be expanded with the manual steps below)

(Will use a separate PR to add below steps to dev docs)

Step 1: generating RPC test dumps

forest-tool api compare --dump-dir /var/tmp/rpc-dumps ...

Step 2: generate RPC test snapshots

forest-tool api generate-test-snapshot --db ~/.local/share/forest/calibnet/0.23.0 --chain calibnet --out-dir /var/tmp/rpc-snapshots /var/tmp/test-dumps/filecoin_stategetallallocations*.json

Step 2(b): zstd compress test snapshots

cd /var/tmp/rpc-snapshots
zstd *.json

Step 3: verify test snapshots

forest-tool api test /var/tmp/rpc-snapshots/*.json or forest-tool api test /var/tmp/rpc-snapshots/*.zst

Step 3(b): update unit test

• upload test snapshots to DO space
• update test_snapshots.txt
• cargo test --lib -- --test rpc_regression_tests --nocapture

Reference issue to close (if applicable)

Closes #5034

Other information and links

Change checklist

• I have performed a self-review of my own code,
• I have made corresponding changes to the documentation. All new code adheres to the team's documentation standards,
• I have added tests that prove my fix is effective or that my feature works (if possible),
• I have made sure the CHANGELOG is up-to-date. All user-facing changes should be reflected in this document.

[hanabi1224]

We could deal with these HACKHACK later when they are used by some RPC methods and the snap generation flow fails since everything here is offline

[lemmih]

The format of the memory-db is not stable. If someone changes the memory-db internals, this code will fail. We'll either have to deal with it right now or in the future. I vote to deal with it right now.

[cloudflare-workers-and-pages]

Deploying forest-docs with    Cloudflare Pages

Latest commit:	f69ad6e
Status:	✅  Deploy successful!
Preview URL:	https://5597b3fc.forest-824.pages.dev
Branch Preview URL:	https://hm-forest-tool-api-generate.forest-824.pages.dev

View logs

[hanabi1224]

The format of the memory-db is not stable. If someone changes the memory-db internals, this code will fail. We'll either have to deal with it right now or in the future. I vote to deal with it right now.

@lemmih Switched to Forest CAR DB as discussed.