You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi guys, I am currently endeavoring to train a RWKV model on a dataset in either JSON or TSV format. The structure of the dataset is as follows: {"instruction": "Translate language 1 into language 2", "input": "raw text in language 1", "output": "Desired text in language 2"}. However, the same structure may have varied instructions, input, and output format.
Would anyone be able to direct me to a repository that provides a comprehensive guide on fine-tuning a pre-trained RWKV model on such data? Alternatively, if I were to utilize Hugging Face's resources, how could I go about fine-tuning the RWKV model for this particular task?
The text was updated successfully, but these errors were encountered:
Hi guys, I am currently endeavoring to train a RWKV model on a dataset in either JSON or TSV format. The structure of the dataset is as follows: {"instruction": "Translate language 1 into language 2", "input": "raw text in language 1", "output": "Desired text in language 2"}. However, the same structure may have varied instructions, input, and output format.
Would anyone be able to direct me to a repository that provides a comprehensive guide on fine-tuning a pre-trained RWKV model on such data? Alternatively, if I were to utilize Hugging Face's resources, how could I go about fine-tuning the RWKV model for this particular task?
The text was updated successfully, but these errors were encountered: