Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Automate site updates? - I can help #34

Open
gdubicki opened this issue Jan 5, 2023 · 2 comments
Open

Automate site updates? - I can help #34

gdubicki opened this issue Jan 5, 2023 · 2 comments

Comments

@gdubicki
Copy link
Contributor

gdubicki commented Jan 5, 2023

Hi @Burekasim and the whole team!

Thanks again for this solution. While there are alternatives now, I really like your minimalistic and clear site.

But again I don't feel confident that it shows the up-to-date info because as of writing these words the data update time is 2022-12-18, which is 2.5 weeks ago if you are an optimist ...or last year if you are a pessimist. 😅

Anyway, I wanted to ask what is the progress on automating the updates? I read the comment that's it's on the roadmap from June 2022 but I also remember my ticket from October 2021 about the same thing, so perhaps I can help you with this if you are stuck?

Don't want to brag but I have a lot of experience with various CI/CD solutions, including Github Actions which would make the most sense here probably. (You can check out my work in gitlabform/gitlabform, for example.) I propose to create a site update pipeline running once per day (or on another schedule, if you think that makes more sense).

What do you think?

@Burekasim
Copy link
Collaborator

Hi @gdubicki

Regarding pricing:
I might need to clarify the current status, I update the website (manually) when there are price changes, if there are no price changes, there i no update.

At this moment, since December 18, there are no changes in GCP pricing. and because of that - the website is still shows the date from December.

Also - I usually run diff between the latest version and the previous version and there are minor price changes for CUDs in non US/EU regions.

I think we should change the wording from "Last Update" to something else, I'm open for suggestions.

Regarding automation:
I would be glad for any assistance, can you send me your email and we will continue discussing over email

There is a small issue that might affect the automation - if Google adds a new instance family, it will break the scraper.py. script.

@gdubicki
Copy link
Contributor Author

gdubicki commented Jan 5, 2023

Regarding pricing:

Thanks for clarification!

I think that when we automate we could think of providing 2 timestamps that we could call f.e. "Last prices check" and "Last update", maybe with a link to your comment to clarify the difference. :)

Then the pipeline could update the "Last prices check" on each run, while the "Last update" only when the data has actually changed.

Regarding automation:

I pinged you on LinkedIn to get in touch.

About that breakage on new instance family add: I think that it's good that it will break! Thanks to that we will get notification about pipeline breaking and we will see that the code needs an update to include the new family. :)

gdubicki added a commit to gdubicki/gcpinstances.info that referenced this issue Apr 9, 2023
every day a minute after midnight + after each
push to master

Implements doitintl#34
gdubicki added a commit to gdubicki/gcpinstances.info that referenced this issue Apr 9, 2023
every day a minute after midnight + after each
push to master.

Also the data.json is now pretty-printed.

Implements doitintl#34
gdubicki added a commit to gdubicki/gcpinstances.info that referenced this issue Apr 9, 2023
every day a minute after midnight + after each
push to master.

Also the data.json is now pretty-printed.

Implements doitintl#34
gdubicki added a commit to gdubicki/gcpinstances.info that referenced this issue Apr 9, 2023
every day a minute after midnight + after each
push to master.

Also the data.json is now pretty-printed.

Implements doitintl#34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants