Skip to content

Commit

Permalink
Adding some more tips to Readme
Browse files Browse the repository at this point in the history
  • Loading branch information
AG committed Mar 2, 2024
1 parent 4474473 commit 009646b
Showing 1 changed file with 8 additions and 5 deletions.
13 changes: 8 additions & 5 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,8 +4,11 @@ A demonstration of predictive text without an LLM, using permy.link
[Check it out](https://adamgrant.info/tiny-predictive-text)

## Training
`pip install tqdm`
`pip install python-slugify`
[Training data is here](https://cdn.everything.io/datasets/blogs-news-twitter.txt.zip)
Save it in the root as `train.txt`.
Run the training with `python train.py train.txt`.

No GPUs OS requirements or nVidia libraries needed. I run this on my Macbook Pro with the included version of Python.

- `pip install tqdm`
- `pip install python-slugify`
- [Download training data](https://cdn.everything.io/datasets/blogs-news-twitter.txt.zip)
- Save it in the root as `train.txt`.
- Run the training with `python train.py train.txt`. Every once in a while it will optimize by pruning word set dictionaries and branches recursively. At this point (look for it in the logs) it will create the dictionary.js file the demo needs to run. Let it keep running and it will continuously improve that dictionary as it continues its training.

0 comments on commit 009646b

Please sign in to comment.