Loading Checkpoints in openllm #253
Closed
vdeeplearn
started this conversation in
General
Replies: 1 comment
-
|
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
How can I load checkpoints directory containing the model files for llama2 loading
Similar to the below script can I specify the model checkpoint directory?
from langchain.llms import OpenLLM
llm = OpenLLM(
model_name="dolly-v2",
model_id="databricks/dolly-v2-3b",
temperature=0.94,
repetition_penalty=1.2,
)
Is there any info in the documentation of openllm
Beta Was this translation helpful? Give feedback.
All reactions