Skip to content

antonio-f/BERT_from_scratch

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 

Repository files navigation

BERT from scratch

Training a BERT model from scratch

This example is based on a part of the OSCAR dataset (https://oscar-corpus.com/) and the Hugging Face transformers library.