Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement the blockIndex type of module #411

Closed
3 tasks done
sduchesneau opened this issue Mar 1, 2024 · 1 comment
Closed
3 tasks done

Implement the blockIndex type of module #411

sduchesneau opened this issue Mar 1, 2024 · 1 comment

Comments

@sduchesneau
Copy link
Contributor

sduchesneau commented Mar 1, 2024

Specs

  • This module type has no params in its input, has no "initialBlock" and no "output".
  • The code for this type of module will simply return an array of strings for a given block.
    Ex: input (block or mapper...) --> output []string
  • The output will be saved to disk in a special format using "roaring bitmaps". See https://github.com/streamingfast/bstream/blob/develop/transform/block_indexer.go for an example implementation (or copy it blatantly)

Dependencies

TODO

  • make substreams add the indexing module as a dependency in the module tree if a module depends on it through a "blockFilter" parameter.
  • Write the code to execute that type of module and gather its outputs
  • Write the code to write all those outputs in a roaring bitmap format for the processed range (on tier2)

(this issue does not include the "read" part, i.e. using the index.)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant