Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add rlhf model link #63

Closed
wants to merge 6 commits into from
Closed

add rlhf model link #63

Changes from all commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
a0322be
add rlhf model link
HeyyyyyyG Dec 18, 2023
3c98b90
add rlhf model link
HeyyyyyyG Dec 18, 2023
220b945
Merge branch 'jiaqiz/add_rlhf_model_link' of github.com:NVIDIA/NeMo-A…
HeyyyyyyG Dec 19, 2023
49bcb0a
add timer impl (#44)
gshennvm Dec 14, 2023
77367a5
add rlhf model link
HeyyyyyyG Dec 18, 2023
fe2d308
Merge branch 'jiaqiz/add_rlhf_model_link' of github.com:NVIDIA/NeMo-A…
HeyyyyyyG Dec 19, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 3 additions & 1 deletion README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,10 +10,12 @@ The toolkit is currently in it's early stages, and we are committed to improving

## Key features

* **SteerLM: Attribute Conditioned SFT as an (User-Steerable) Alternative to RLHF.** Learn more at our [SteerLM](https://arxiv.org/abs/2310.05344) and [HelpSteer](https://arxiv.org/abs/2311.09528) papers. Try it instantly for free on [NVIDIA AI Playground](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-foundation/models/llama2-70b-steerlm)
* **SteerLM: Attribute Conditioned SFT as an (User-Steerable) Alternative to RLHF.**
* Learn more at our [SteerLM](https://arxiv.org/abs/2310.05344) and [HelpSteer](https://arxiv.org/abs/2311.09528) papers. Try our [NV-Llama2-70B-SteerLM-Chat model](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-foundation/models/llama2-70b-steerlm) instantly for free on NVIDIA AI Foundation.
* **Supervised Fine Tuning**
* **Reward Model Training**
* **Reinforcement Learning from Human Feedback using the [PPO](https://arxiv.org/pdf/1707.06347.pdf) Algorithm**
* Check out our aligned [NV-Llama2-70B-RLHF model](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/ai-foundation/models/nv-llama2-70b-rlhf) on NVIDIA AI Foundation for free.
* **Direct Preference Optimization as described in [paper](https://arxiv.org/pdf/2305.18290.pdf)**

## Learn More
Expand Down
Loading