Gnurros FinetuneReFormatter

Tools with GUI for GPT finetune data preparation

Usage:

Run baseGUI.py to open the GUI.
Select a file to inspect/edit. Currently works on .txt UTF-8 plaintext files and rolling-context .json files.

Visit the wiki for more info and a HowTo

Info:

Written in Python 3.9
GUI uses PyQt5
Install requirements by running pip (or equivalent) with requirements.txt

Credits:

GPT2 encoder from https://github.com/graykode/gpt-2-Pytorch
by Tae Hwan Jung(Jeff Jung) @graykode