Skip to content
This repository has been archived by the owner on Jun 21, 2024. It is now read-only.

Understanding the training #28

Open
hsuyab opened this issue Apr 18, 2023 · 0 comments
Open

Understanding the training #28

hsuyab opened this issue Apr 18, 2023 · 0 comments

Comments

@hsuyab
Copy link

hsuyab commented Apr 18, 2023

Here in the How to train it is mentioned that you have used huggingface's run_clm.py which we put in this repository as train_gptj_toolformer.py. So the causal language modeling task is performed using the postprocessed data shared here. We can switch some other model from huggingface here as well right?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant