Releases · aditeyabaral/calbert

This marks the first stable release of CalBERT rewrite (#1) 🎉🎉

Highlights

🔁Removed non-essential dependencies and rewrote the entire model using PyTorch
📤New classes for creating the CalBERTDataset, the CalBERT model and SiamesePretrainer to perform Siamese Pre-training
🚀Implemented as a PyTorch module, allowing it to be modified or be extensively used by other networks as a layer
⚙️New training configurations - checkpoints, save strategies, loss metrics and more
📦Packaged CalBERT as a module that can be installed via pip

Full Changelog: https://github.com/aditeyabaral/calbert/commits/v1.0.0