New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Storing crawling results in files #5

Open

jc-a3s opened this issue Feb 5, 2022 · 0 comments

Labels

enhancement good first issue

Contributor

jc-a3s commented Feb 5, 2022

We should store collected data in files for at least three reasons:

Plotting graph again without crawling.
Using gathered data for other purposes.
Retrying the whole process when crawling is stopped (e.g. IP/account reached threshold).

Goal of this feature is to implement only storing functionality. We should use some popular format like JSON or/and CSV.

jc-a3s added enhancement good first issue labels

jc-a3s mentioned this issue

Storing crawling results in database #6

Open

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment