This is an updated version of convogpt that I've modified to run OPT models. It can also run any other LLM pytorch model with just 2 lines of code being changed to whatever model you're using.
Aside from this, it is now able to get repeated inputs instead of running once and outputting a value.
| Model ID | Parameter Count | Training Method |
|---|---|---|
| 350 | Basic and for testing setups. | |
| 2.7b | The standard and well preforming base. | |
| 6.7b | If you're able, use this model. | |
| 66b | This is a massive model, it will NOT run on any consumer hardware. Don't download this unless you know what you're doing. |
git clone https://github.com/Delcos/OPT-Convogt
cd convogpt
pip install protobuf==3.20.*
python -m pip install -r requirements