Major upgrade to pydantic 2.0

[pcrespov]

💀 💀 💀 Never ever squash commits when updating from master branch 💀 💀 💀

Instructions

1. update requirements make touch update reqs=pydantic
2. install bump-pydantic uv pip install bump-pydantic
3. bump-pydantic my_package
4. fix what it did and fix all tests
5. check warnings in the test and finish fixing
6. create a PR and ask for review
7. this PR shall be squash commited

Planned changes

• Migrate to pydantic >=2.0. See https://docs.pydantic.dev/latest/migration/
• Migrate to fastapi >=0.100 (has ported functionality)

Major upgrade not out-of-the box and requires some coordination. This upgrade will bring substantial speedup to the code. It would be desirable to measure the improvement. Should we setup some type of benchmark?

Both libraries have been releases so I added a constraint in requirements/constraints.txt

We should start testing first the upgrade with the packages and then when we understand the migration mechanisms we can do the rest of the repository.

Tasks

Beta Give feedback

1. migrate settings-library, specially CustomBaseSettings @pcrespov
2. migrate models-library

This is a sub issue from ITISFoundation/osparc-issues#675

MartinKippenberger

Beta Give feedback

1. explore the migration path
2. ⬆️ Upgrade Web Server service (Pydantic v2) #6584
   a:webserver t:maintenance +2
   
3. ⬆️ Upgrade Director v2 service (Pydantic v2) #6619
   a:director-v2 t:maintenance +2
   
4. ⬆️ Upgrade API Server service (Pydantic v2) #6580
   a:apiserver t:maintenance +2
   
5. ⬆️ Upgrade models-library (pydantic v2) #6333
   t:maintenance +1
   
6. ⬆️Dask sidecar: migration to v2 #6591
   a:dask-service +1
   
7. Upgrade resource usage tracker (Pydantic v2) #6517
   a:resource-usage-tracker t:maintenance +2
   
8. Upgrade clusters keeper service (Pydantic v2) #6519
   t:maintenance +1
   
9. Upgrade EFS guardian service (Pydantic v2) #6516
   t:maintenance +1
   
10. Upgrade invitations service (Pydantic v2) #6513
    t:maintenance +1
    
11. ⬆️ Upgrade libraries (pydantic v2) #6366
    t:maintenance +1
    
12. 🎨 pydantic2 migration: fixed unit-tests for dynamic-scheduler #6547
    a:dynamic-scheduler t:maintenance +2
    
13. 🎨 pydantic2 migration: fixed unit-tests for dynamic-sidecar #6534
    a:dynamic-sidecar +1
    
14. ♻️Pydantic V2 upgrade: autoscaling #6535
    a:autoscaling +1
    
15. ♻️ Add common library #6495
    t:maintenance +1
    
16. Upgrade agent service (Pydantic v2) #6508
    t:maintenance +1
    
17. ⬆️Datcore adapter: migration #6594
    a:datcore-adapter +1
    
18. ⬆️ pydantic migration catalog #6629
    t:maintenance +1
    
19. ⬆️ upgrades iter_model_examples_in_module to enable all example tests #6632
    t:maintenance +1
    
20. ⬆️ Fix custom settings class with pydantic-settings~=2.6 #6644
    +0
    

[sanderegg]

@pcrespov explore the migration path

[sanderegg]

@pcrespov
packages/models-library/src/models_library/projects.py

[sanderegg]

@GitHK this looks worrisome (the last ruff comment), I think the task will not run
services/dynamic-sidecar/src/simcore_service_dynamic_sidecar/modules/outputs/_manager.py