CSE 6250 Project

Resources/Links

• CSE6250 Projects: Big Data Analytics for Healthcare
• Resource #18 on Project PDF
• #18 Github
• The paper on Transformers.
• The Google paper that took transformers to the next level via having massively pre-trained transformer models that can be fine tuned to specific tasks with minimal training time
• A good guide with really nice visualizations for understanding transformers intuitively.
• A really good guide for the code in PyTorch for the Transformer
• The source code for BERT
• Sample Papers for the project
• Macallum 1999 (Source in #18)
• Kim (Source in 18)
• The Big-&-Extending-Repository-of-Transformers: Pretrained PyTorch models for Google's BERT, OpenAI GPT & GPT-2, Google/CMU Transformer-XL
• Multi-label Text Classification using BERT – The Mighty Transformer
• Instructions to connect to GCP instance