Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add python script to launch jobs #1

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Add python script to launch jobs #1

wants to merge 1 commit into from

Conversation

NouamaneTazi
Copy link
Member

@NouamaneTazi NouamaneTazi commented Oct 10, 2022 •
edited
Loading

This should make it easier for us to investigate scaling laws

@TevenLeScao

@NouamaneTazi NouamaneTazi changed the title add pretrain_gpt py launcher Add python script to launch jobs Oct 10, 2022
@TevenLeScao
Copy link
Contributor

Can you also save/export the Slurm file somewhere? It'll make it easier to come back later and know what we ran.

@NouamaneTazi
Copy link
Member Author

NouamaneTazi commented Oct 10, 2022 •
edited
Loading

Yes for now it gets saved under job.batch. Feel free to modify as you see fit :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@NouamaneTazi @TevenLeScao