Feat: projections runner #2
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…g msgs by default
- this is needed when processing the "all"-stream for a scope
- based on GenStateMachine - speed can be adjusted - can be paused / resumed
Problem: - currently we fetch last_id on every events page fetch - this looks noisy in logs - and we mostly get the same value again and again Solition: - we fetch last_id once on init - updates on last_id will come through pubsub messages
- behaviour module - use Ecto.Multi to process events - sample projection
Problem: - ProcDict does not handle more complex cases of looking up the ancestors based on a pid Solution: - use ProcessTree (vendored-in) - it supports more modern cases since OTP 25 and is much better suited.
Problem:
- it seems to be impossible to set a scope on context, that is also accessible in IEx console
- the list of known ancestors of IEx console does NOT include THE main application
Solution / Workaround:
- we hardcode a default scope UUID ("000-000000...") and use re-scoping only in unit tests
- that seems to be an OK compromise
Problem: - current dependence on JsonSerde is somewhat problematic - it is not possible to use functions when defining aliases Solution: - create a small module that defines an internal function for the event name - remove JsonSerde
- use an small internal module for UUID7 generation (more precise)
…o a separate module
|
Merging this, to prevent long running branches. Projection features not 100% polished, will be addressed in later PRs. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.