pre-training your own BERT modelfrom scratch
-
Updated
Mar 5, 2023 - Jupyter Notebook
pre-training your own BERT modelfrom scratch
A Custom implementation of the ELECTRA training method using PyTorch and HuggingFace Transformers
Add a description, image, and links to the pretraining-bert topic page so that developers can more easily learn about it.
To associate your repository with the pretraining-bert topic, visit your repo's landing page and select "manage topics."