Entry test for Tinkoff NLP research internship.
The task was to make experiments with chain-of-thoughts prompting with Bloom model and GSM8K dataset
Installation:
git clone https://github.com/egoriyaa/nlp-research-CoT.git
cd nlp-research-CoT
pip install -r requirements.txt
To generate CoT data run:
python inference.py
To calculate metrics for CoT and ensemble CoT run:
python calculator.py