Skip to content
@foundation-model-stack

Foundation Model Stack

IBM Research's home for incubating, advancing and upstreaming open source for foundation model development, training, tuning and inference.

Pinned Loading

  1. foundation-model-stack foundation-model-stack Public

    🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.

    Python 218 99

  2. fms-fsdp fms-fsdp Public

    🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash attention v2.

    Python 276 46

  3. fms-hf-tuning fms-hf-tuning Public

    🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.

    Python 54 65

  4. fms-acceleration fms-acceleration Public

    🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.

    Python 13 19

  5. fms-guardrails-orchestrator fms-guardrails-orchestrator Public

    🚀 Guardrails orchestration server for application of various detections on text generation input and output.

    Rust 27 38

  6. bamba bamba Public

    Train, tune, and infer Bamba model

    Python 137 14

Repositories

Showing 10 of 29 repositories
  • aiu-fms-testing-utils Public

    Tests/Scripts for use with foundation-model-stack models running on AIU

    foundation-model-stack/aiu-fms-testing-utils’s past year of commit activity
    Python 4 Apache-2.0 31 2 27 Updated Dec 23, 2025
  • vllm-detector-adapter Public

    Tiny adapter that runs on top of vllm and provides detector APIs

    foundation-model-stack/vllm-detector-adapter’s past year of commit activity
    Python 4 Apache-2.0 7 7 3 Updated Dec 23, 2025
  • fms-model-optimizer Public

    FMS Model Optimizer is a framework for developing reduced precision neural network models.

    foundation-model-stack/fms-model-optimizer’s past year of commit activity
    Python 20 Apache-2.0 17 16 (1 issue needs help) 7 Updated Dec 19, 2025
  • fms-hf-tuning Public

    🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.

    foundation-model-stack/fms-hf-tuning’s past year of commit activity
    Python 54 Apache-2.0 65 24 (2 issues need help) 19 Updated Dec 18, 2025
  • vllm-triton-backend Public

    A Triton-only attention backend for vLLM

    foundation-model-stack/vllm-triton-backend’s past year of commit activity
    Python 23 Apache-2.0 7 0 2 Updated Dec 18, 2025
  • fms-acceleration Public

    🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.

    foundation-model-stack/fms-acceleration’s past year of commit activity
    Python 13 Apache-2.0 19 27 (11 issues need help) 2 Updated Dec 18, 2025
  • fastsafetensors Public

    High-performance safetensors model loader

    foundation-model-stack/fastsafetensors’s past year of commit activity
    Python 90 Apache-2.0 16 1 1 Updated Dec 17, 2025
  • multi-nic-cni Public
    foundation-model-stack/multi-nic-cni’s past year of commit activity
    Go 40 Apache-2.0 8 8 0 Updated Dec 16, 2025
  • fms-autoconf-k8s-controller Public
    foundation-model-stack/fms-autoconf-k8s-controller’s past year of commit activity
    Go 0 MIT 0 0 0 Updated Dec 15, 2025
  • tuning-config-recommender Public

    ⚡️⚡️ Supercharge your fine-tuning users with completely automated tuning configurations!

    foundation-model-stack/tuning-config-recommender’s past year of commit activity
    Python 4 Apache-2.0 2 3 0 Updated Dec 14, 2025
View all repositories

Most used topics

python pytorch