Skip to content

Release: Framework v0.1.1

Compare
Choose a tag to compare
@fabianlim fabianlim released this 01 Jul 03:47
· 49 commits to main since this release

This releases

  • fms-acceleration v0.1.1

Update: v0.1.0 was deleted because of some README problems

What's Changed

  • Add BenchMarking Script by @fabianlim in #1
  • More README updates. Bench result updates and script Improvements. CLI docstring improvements. by @fabianlim in #4
  • Add Configs and Arguments Listing by @fabianlim in #5
  • Readme Improvements by @fabianlim in #11
  • Add GitHub Workflow for Linting , Formatting and Test. Activate Workflow for Framework by @fabianlim in #7
  • Improvements to Benchmark Scripts and Config Generation Workflow by @fabianlim in #13
  • Added support for running official HF baseline FSDP-QLoRA benchmark by @achew010 in #16
  • Fix FSDP when performing GPTQ-LoRA with Triton V2 by @fabianlim in #15
  • Provide Memory Benchmarking Feature to Benchmarking Code by @achew010 in #14
  • Upstream Main: Linting, Benchmarking, HF QLoRA baseline, FSDP fixes for GPTQ-LoRA by @fabianlim in #22
  • Linting and Formatting for FMS-Acceleration-Peft package by @achew010 in #24
  • Workaround Low-Mem-Mode Patch for GPTQ-LoRA by @achew010 in #26
  • Group memory field names with prefix and minor fixes by @achew010 in #27
  • Initial Addition of FusedOps and Kernels Plugin With Model Patcher by @fabianlim in #25
  • Fix FSDP casting issue for Autogptq and Fused Ops by @fabianlim in #28
  • Add MLP & QLoRA Fused Ops and Kernels, Mixtral by @fabianlim in #29
  • Address Incorrect Ignoring of Base Layer Modules for FSDP with Kernels by @fabianlim in #31
  • Shift GPU Memory Computation to End of Benchmarking Script by @achew010 in #30
  • Upstream Main: Fused Ops and Kernels, FSDP and Memory Fixes by @fabianlim in #35
  • Added trl installation constraint to tox command by @achew010 in #36
  • Allow Benchmarks to be run with configuration pointed to in YAML env variable by @fabianlim in #40
  • Bound Package Versions by @achew010 in #42
  • Upstream Main: Add Lora Dropout, YAML EnvVar Configuration by @fabianlim in #41
  • Add MultiRepo Build Packaging Flow and Release Upper Bounds by @fabianlim in #45

Full Changelog: https://github.com/foundation-model-stack/fms-acceleration/commits/v0.1.1