Skip to content
@foundation-model-stack

Foundation Model Stack

IBM Research's home for incubating, advancing and upstreaming open source for foundation model development, training, tuning and inference.

Pinned Loading

  1. foundation-model-stack foundation-model-stack Public

    🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.

    Python 180 61

  2. fms-fsdp fms-fsdp Public

    🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash attention v2.

    Python 208 32

  3. fms-hf-tuning fms-hf-tuning Public

    🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.

    Python 31 48

  4. fms-acceleration fms-acceleration Public

    🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.

    Python 7 12

  5. fms-guardrails-orchestrator fms-guardrails-orchestrator Public

    🚀 Guardrails orchestration server for application of various detections on text generation input and output.

    Rust 5 18

Repositories

Showing 10 of 24 repositories
  • bamba Public

    Train, tune, and infer Bamba model

    foundation-model-stack/bamba’s past year of commit activity
    Python 71 Apache-2.0 11 3 0 Updated Jan 8, 2025
  • fms-dgt Public

    Synthetic Data Generation for Foundation Models

    foundation-model-stack/fms-dgt’s past year of commit activity
    Python 15 Apache-2.0 22 1 1 Updated Jan 8, 2025
  • fms-hf-tuning Public

    🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.

    foundation-model-stack/fms-hf-tuning’s past year of commit activity
    Python 31 Apache-2.0 48 24 (2 issues need help) 24 Updated Jan 7, 2025
  • fms-fsdp Public

    🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash attention v2.

    foundation-model-stack/fms-fsdp’s past year of commit activity
    Python 208 Apache-2.0 32 14 6 Updated Jan 7, 2025
  • fms-guardrails-orchestrator Public

    🚀 Guardrails orchestration server for application of various detections on text generation input and output.

    foundation-model-stack/fms-guardrails-orchestrator’s past year of commit activity
    Rust 5 Apache-2.0 18 28 (3 issues need help) 4 Updated Jan 7, 2025
  • multi-nic-cni Public
    foundation-model-stack/multi-nic-cni’s past year of commit activity
    Go 37 Apache-2.0 5 16 (1 issue needs help) 1 Updated Jan 7, 2025
  • foundation-model-stack Public

    🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.

    foundation-model-stack/foundation-model-stack’s past year of commit activity
    Python 180 Apache-2.0 61 35 (4 issues need help) 40 Updated Jan 6, 2025
  • ocp-efa-operator Public

    Operator that enables EFA and/or GDRCOPY in an OpenShift cluster

    foundation-model-stack/ocp-efa-operator’s past year of commit activity
    Go 1 Apache-2.0 0 0 0 Updated Jan 6, 2025
  • fms-model-optimizer Public

    FMS Model Optimizer is a framework for developing reduced precision neural network models.

    foundation-model-stack/fms-model-optimizer’s past year of commit activity
    Python 11 Apache-2.0 5 7 (2 issues need help) 2 Updated Jan 5, 2025
  • fms-acceleration Public

    🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.

    foundation-model-stack/fms-acceleration’s past year of commit activity
    Python 7 Apache-2.0 12 20 (10 issues need help) 2 Updated Jan 3, 2025

Top languages

Loading…

Most used topics

Loading…