Pinned Loading

1. quantkit quantkit Public

   cli tool to quantize gguf, gptq, awq, hqq and exl2 models

   Python 65 4

2. TransformerLens TransformerLens Public

   Forked from TransformerLensOrg/TransformerLens

   A library for mechanistic interpretability of GPT-style language models

   Python

3. lm-evaluation-harness lm-evaluation-harness Public

   Forked from EleutherAI/lm-evaluation-harness

   A framework for few-shot evaluation of language models.

   Python

4. mamba.c mamba.c Public

   Forked from kroggen/mamba.c

   Inference of Mamba models in pure C

   C 2

5. RoBERTadeploy RoBERTadeploy Public

   Forked from sshkhr/BERTdeploy

   A simple example of deploying a pre-trained BERT model as a REST API

   Python

6. exllamav2 exllamav2 Public

   Forked from turboderp/exllamav2

   A fast inference library for running LLMs locally on modern consumer-class GPUs

   Python