feat: modify shuttle for snapchain migration

[aditiharini]

We need a way to upload hub messages to snapchain nodes. The exiting submitMessage endpoint doesn't work because snapchain uses qualified module names in protos while existing hubs don't. This means existing hub clients can't communicate with the snapchain servers via submitMessage.

Merge Checklist

Choose all relevant options below by adding an x now or at any time before submitting for review

• PR title adheres to the conventional commits standard
• PR has a changeset
• PR has been tagged with a change label(s) (i.e. documentation, feature, bugfix, or chore)
• PR includes documentation if necessary.

---

PR-Codex overview

This PR introduces enhancements and new features to the shuttle application, including improved message reconciliation, support for a new SNAPCHAIN_HOST, and updates to the database schema for better handling of on-chain events.

Detailed summary

• Added SNAPCHAIN_HOST to the environment configuration.
• Introduced CLEAR_DB option for database management.
• Updated docker-compose.yml to include a new postgres2 service.
• Enhanced logging in worker.ts for job processing.
• Created BasicHubSubscriber class for handling event streams.
• Modified allActiveDbMessagesOfTypeForFid function for improved database querying.
• Added methods in App class for reconciling on-chain events.
• Implemented new backfill functionality for on-chain events.
• Updated various imports and refactored existing methods for clarity and efficiency.

The following files were skipped due to too many changes: packages/shuttle/521.log

✨ Ask PR-Codex anything about this PR by commenting with /codex {your question}

[changeset-bot]

⚠️ No Changeset found

Latest commit: 185d231

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
hub-monorepo	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Dec 11, 2024 9:32pm