Move development dependencies to optional dependencies

[zealous-ideal-monk]

Reorganize Project Dependencies

Description

This PR improves the project's dependency management by:

1. Moving development and optional tools to optional-dependencies
2. Adding an all group that includes all optional dependencies
3. Moving FastAPI to optional dependencies as it's primarily used for development/testing

Changes made:

• Added [project.optional-dependencies] section with two groups:
  • dev: Development tools (streamlit, plotly, huggingface_hub, gdown, fastapi)
  • all: Contains all optional dependencies for easy full installation
• Kept core ML and data processing dependencies in main dependencies

Benefits:

• Smaller production installations
• Clearer separation between core and development dependencies
• Flexible installation options:
  • pip install . for minimal production install
  • pip install .[dev] for development tools
  • pip install .[all] for everything

How Has This Been Tested?

• Verified successful installation with core dependencies only: pip install .
• Verified successful installation with development dependencies: pip install .[dev]
• Verified successful installation with all dependencies: pip install .[all]

Changes to Data Processing

No changes to data processing - this is a project structure improvement only.

Checklist:

• My code follows OCF's coding style guidelines
• I have performed a self-review of my own code
• I have made corresponding changes to the documentation (updated pyproject.toml)
• I have tested all three installation methods work correctly
• I have checked my code and corrected any misspellings

[peterdudfield]

Thanks @zealous-ideal-monk for having a go with this.

I think it needs to be something like

[project.optional-dependencies]
dev = [
    "tox", "abs","etc"
]

in fact there is already a place holder for it - https://github.com/openclimatefix/open-source-quartz-solar-forecast/blob/main/pyproject.toml#L45

[zealous-ideal-monk]

As you suggested I have made the required changes and sent a PR

[peterdudfield]

Hey thanks so much for this. Just a few small things

Do you mind adding a description to the PR?

Could you move fastapi also to this group?

Can we make sure the group "all" has all the extra dependencies in it?

Thanks again for all this

[zealous-ideal-monk]

tell me if any other changes are required