Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

🚀 Release v1.77.0 / v1.77.1 / v1.77.2 #6212

Closed
22 of 29 tasks
YuryHrytsuk opened this issue Aug 19, 2024 · 19 comments
Closed
22 of 29 tasks

🚀 Release v1.77.0 / v1.77.1 / v1.77.2 #6212

YuryHrytsuk opened this issue Aug 19, 2024 · 19 comments
Assignees
@giancarloromeo @jsaq007 @GitHK @mrnicegyu11 @pcrespov @odeimaiz @mguidon @sanderegg @YuryHrytsuk @matusdrobuliak66
Labels
release Preparation for pre-release/release t:maintenance Some planned maintenance work
Milestone
MartinKippenberger

Comments

@YuryHrytsuk
Copy link
Contributor

YuryHrytsuk commented Aug 19, 2024 •
edited
Loading

Release version

1.77.0 / 1.77.1 / 1.77.2

Commit SHA

f90ca82de6e57f730ae7abadb40996ef1bf68c3a

Previous pre-release

https://github.com/ITISFoundation/osparc-simcore/releases/tag/staging_Eisbock7

Planned date

v1.77.0 - 16.9.2024 - tip.science
v1.77.2 - 19.9.2024 - tip.science
v1.77.2 - 20.9.2024 - all production deployments

Did the commit CI suceeded?

  • The commit CI succeeded.

Motivation

Regular sprint release

Changes

Devops 👷

Tests assessment: e2e testing check 🧪

No response

Test assessment: targeted-testing 🔍️

No response

Test assessment: user-testing 🧐

No response

Summary 📝

  • Prepare release link
make release-prod version=<M.m.0>  git_sha=<commit_sha>
  • Draft release changelog
  • Announce maintenance ( ** ANNOUNCE AT LEAST 24 HOURS BEFORE ** )
  • redis add an entry in db scheduled_maintenance with key maintenance {"start": "2023-03-06T13:00:00.000Z", "end": "2023-03-06T15:00:00.000Z", "reason": "Release <vX.X.0>"}. Note the time is in UTC, please adjust accordingly
    • aws
    • dalco
    • tip
  • status page (https://manage.statuspage.io/)
    • osparc
    • s4l
  • mattermost channels
    • maintenance
    • power users

Releasing 🚀

  • Maintenance page up.
cd /deployment/production/osparc-ops-environments
make up-maintenance
make down-maintenance
  • Release by publishing draft
  • Check release CI
  • Check hanging sidecars. Helper command to run in director-v2 CLI simcore-service-director-v2 close-and-save-service <uuid>
  • Check deployed
    • aws deploy
    • dalco deploy
    • tip deploy
  • Check testing endpoint ex. https://testing.osparc.speag.com/
  • Delete announcement
  • Check e2e runs
  • Announce
:tada: https://github.com/ITISFoundation/osparc-simcore/releases/tag/v<M.m.0>
@YuryHrytsuk YuryHrytsuk added t:maintenance Some planned maintenance work release Preparation for pre-release/release labels Aug 19, 2024
@YuryHrytsuk YuryHrytsuk changed the title 🚀 Release v<1.77.0> 🚀 Release v1.77.0 Aug 19, 2024
@matusdrobuliak66 matusdrobuliak66 added this to the Eisbock milestone Aug 19, 2024
@matusdrobuliak66
Copy link
Contributor

matusdrobuliak66 commented Aug 23, 2024 •
edited
Loading

⚠️ TODO @GitHK @matusdrobuliak66

Sim4life lite product requires vendor configuration for release notes!! before releasing to the production (webserver has to be restarted) -> Done no action needed

@mrnicegyu11
Copy link
Member

TODO

Merge https://git.speag.com/oSparc/osparc-ops-deployment-configuration/-/merge_requests/821

@YuryHrytsuk
Copy link
Contributor Author

TODO

Merge https://git.speag.com/oSparc/osparc-ops-deployment-configuration/-/merge_requests/821

Please, use section Devops 👷 in the description of the issue for this

@mrnicegyu11

@mrnicegyu11
Copy link
Member

TODO

Merge https://git.speag.com/oSparc/osparc-ops-deployment-configuration/-/merge_requests/821

Please, use section Devops 👷 in the description of the issue for this

@mrnicegyu11

As I am admin of the github-org, I can edit your initial post. But this is not a solution that works for everyone, or are all backend contributors admin? What if Andrei has something to add?

@YuryHrytsuk
Copy link
Contributor Author

TODO

Merge https://git.speag.com/oSparc/osparc-ops-deployment-configuration/-/merge_requests/821

Please, use section Devops 👷 in the description of the issue for this
@mrnicegyu11

As I am admin of the github-org, I can edit your initial post. But this is not a solution that works for everyone, or are all backend contributors admin? What if Andrei has something to add?

is it admin-only functionality? I can also edit the original post.

@mrnicegyu11
Copy link
Member

TODO

Merge https://git.speag.com/oSparc/osparc-ops-deployment-configuration/-/merge_requests/821

Please, use section Devops 👷 in the description of the issue for this
@mrnicegyu11

As I am admin of the github-org, I can edit your initial post. But this is not a solution that works for everyone, or are all backend contributors admin? What if Andrei has something to add?

is it admin-only functionality? I can also edit the original post.

I am sure you can edit your own post, but to the best of my knowledge it is admin-functionality. Maybe a non-admin (andrei, odei) can try to edit it, i dont think it would work

@YuryHrytsuk
Copy link
Contributor Author

TODO

Merge https://git.speag.com/oSparc/osparc-ops-deployment-configuration/-/merge_requests/821

Please, use section Devops 👷 in the description of the issue for this
@mrnicegyu11

As I am admin of the github-org, I can edit your initial post. But this is not a solution that works for everyone, or are all backend contributors admin? What if Andrei has something to add?

is it admin-only functionality? I can also edit the original post.

I am sure you can edit your own post, but to the best of my knowledge it is admin-functionality. Maybe a non-admin (andrei, odei) can try to edit it, i dont think it would work

We just did a test with @odeimaiz and @GitHK. They both can edit issue.

@matusdrobuliak66
Copy link
Contributor

matusdrobuliak66 commented Sep 11, 2024 •
edited
Loading

⚠️ TODO Matus

  • setup WEBSERVER_FOLDERS=1
    • tip.science
    • sim4life.io
    • osparc.io
    • tip.itis.swiss

⚠️ UPDATE: FOLDERS feature should be disabled

@sanderegg sanderegg modified the milestones: Eisbock, Doppelbock Sep 13, 2024
@matusdrobuliak66 matusdrobuliak66 changed the title 🚀 Release v1.77.0 🚀 Release v1.77.0 (tip.science for now) Sep 16, 2024
@YuryHrytsuk
Copy link
Contributor Author

YuryHrytsuk commented Sep 16, 2024 •
edited
Loading

AWS TIP release issues:

  • lite product maintenance page is missing [FIXED]
  • Traefik middleware are out-of-date (docker --> swarm) false statement. all is configured properly

@matusdrobuliak66 matusdrobuliak66 changed the title 🚀 Release v1.77.0 (tip.science for now) 🚀 Release v1.77.0 Sep 17, 2024
@YuryHrytsuk
Copy link
Contributor Author

YuryHrytsuk commented Sep 17, 2024 •
edited by matusdrobuliak66
Loading

@matusdrobuliak66 modify database

Add invitation_form: true in products.vendor column of the database. e.g.

{
    "url": "https://acme.com",
    "license_url": "https://acme.com/license",
    "invitation_form": true,
    "name": "ACME",
    "copyright": "© ACME correcaminos",
    "has_landing_page": false
}

Source: #6217

UPDATE: DONE ✔️

@mrnicegyu11
Copy link
Member

mrnicegyu11 commented Sep 18, 2024 •
edited by matusdrobuliak66
Loading

IMPORTANT tip.science

ANE sets PROJECTS_INACTIVITY_INTERVAL=14400 as requested by @Konohana0608 -> DONE ✔️

@matusdrobuliak66 matusdrobuliak66 changed the title 🚀 Release v1.77.0 🚀 Release v1.77.0 / v1.77.1 / v1.77.2 Sep 19, 2024
@matusdrobuliak66 matusdrobuliak66 changed the title 🚀 Release v1.77.0 / v1.77.1 / v1.77.2 🚀 Release v1.77.0 / v1.77.1 / v1.77.2 Sep 19, 2024
@YuryHrytsuk
Copy link
Contributor Author

YuryHrytsuk commented Sep 20, 2024 •
edited
Loading

Issue during release

  • Validate Simcore 1 Failed (Shall we have this as a CI test in ./osparc-config) To be discussed with @matusdrobuliak66
  • TCP Router is misconfigured on inhouse tip
  • dalco prod: redis commander is broken (staging host is wrongly configured)

Potential Improvements

  • make release tags 1 commands for all deployments (right now we need to run 5 commands [1 per deployment])
  • make terraform-apply and terraform-plan

@YuryHrytsuk YuryHrytsuk mentioned this issue Sep 20, 2024
Closed
@matusdrobuliak66
Copy link
Contributor

matusdrobuliak66 commented Sep 24, 2024 •
edited
Loading

⚠️ Additional manual hotfix: v1.77.3

⚠️ Manually changed static-webserver with: itisfoundation/static-webserver:v1.77.3 image ⚠️

Also the manual ENV change was done in autoscaling service

@matusdrobuliak66
Copy link
Contributor

matusdrobuliak66 commented Sep 25, 2024 •
edited
Loading

⚠️ Additional manual hotfix: v1.77.4

  • ⚠️ Manually changed for all deployments: garbage-collector with: itisfoundation/webserver:hotfix-github-2024-09-25--11-07.44480cdbc123ffe5017348362c93ea6fc8bd7652 image ⚠️

@pcrespov
Copy link
Member

this release is a total kugelblitz 🔥🔥🔥 fix! :-)

@matusdrobuliak66
Copy link
Contributor

matusdrobuliak66 commented Sep 25, 2024 •
edited
Loading

⚠️ Manual change of ENV var

in tip.science & tip.itis.swiss manually restarted webserver with PROJECTS_MAX_NUM_RUNNING_DYNAMIC_NODES = 6

@matusdrobuliak66
Copy link
Contributor

⚠️ Manual change of ENV var

in tip.science & sim4life.io manually restarted autoscaling service: https://git.speag.com/oSparc/osparc-ops-deployment-configuration/-/commit/f1f8f49b5a3588978fa99af560b23d240994cd77

@matusdrobuliak66
Copy link
Contributor

⚠️ Manually adding ENV var to director-v2

  • because of timeout issue in osparc.io and sim4life.io we have added manually this env var DYNAMIC_SIDECAR_API_SAVE_RESTORE_STATE_TIMEOUT to director-v2

@matusdrobuliak66
Copy link
Contributor

⚠️ NOTE:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@giancarloromeo giancarloromeo

@jsaq007 jsaq007

@GitHK GitHK

@mrnicegyu11 mrnicegyu11

@pcrespov pcrespov

@odeimaiz odeimaiz

@mguidon mguidon

@sanderegg sanderegg

@YuryHrytsuk YuryHrytsuk

@matusdrobuliak66 matusdrobuliak66

Labels
release Preparation for pre-release/release t:maintenance Some planned maintenance work
Projects
None yet
Milestone
MartinKippenberger
Development

No branches or pull requests
10 participants
@giancarloromeo @jsaq007 @GitHK @mrnicegyu11 @pcrespov @odeimaiz @mguidon @sanderegg @YuryHrytsuk @matusdrobuliak66