Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Background tracker #62

Open
soxofaan opened this issue Aug 3, 2022 · 1 comment
Open

Background tracker #62

soxofaan opened this issue Aug 3, 2022 · 1 comment
Labels
architecture devops evolution (SAP01)

Comments

@soxofaan
Copy link
Member

soxofaan commented Aug 3, 2022

From #52

Currently, the aggregator logic is driven from HTTP requests, done by end user.
We probably also need some kind of background system to run tasks separate from HTTP traffic: tracking back-end status, tracking managed (partitioned) jobs, managing shared cache/state, ...

Probably need special care: authentication to upstream back-ends on behalf of users.
@soxofaan soxofaan mentioned this issue Aug 3, 2022
Open
@soxofaan
Copy link
Member Author

soxofaan commented Apr 4, 2023

Easy start for this one: set up Nifi workflow to keep the caches warm, e.g. request /collections and /processes every x minutes

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
architecture devops evolution (SAP01)
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@soxofaan