Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

detect page structure changes #231

Open
oalam opened this issue Feb 17, 2022 · 0 comments
Open

detect page structure changes #231

oalam opened this issue Feb 17, 2022 · 0 comments
Labels
Milestone

Comments

@oalam
Copy link
Member

oalam commented Feb 17, 2022

set a timeout for page analysis
when more than 30% pages of a website are considered as changed (both size and structure) we send a change event and invalidate cache for this website.

we still need to be able to make computations with the correct value during a time range (so need to store validity date range in data model)

@oalam oalam added the feature label Feb 17, 2022
@oalam oalam added this to the 1.4.0 milestone Feb 17, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant