Skip to content

Commit

Permalink
[SPARKNLP-1027] Change Default AutoGGUF pretrained model (#14411)
Browse files Browse the repository at this point in the history
  • Loading branch information
DevinTDHa authored Sep 24, 2024
1 parent 83a6e7e commit ba18698
Show file tree
Hide file tree
Showing 3 changed files with 6 additions and 6 deletions.
2 changes: 1 addition & 1 deletion docs/en/annotator_entries/AutoGGUF.md
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@ val autoGGUFModel = AutoGGUFModel.pretrained()
.setOutputCol("completions")
```

The default model is `"gguf-phi3-mini-4k-instruct-q4"`, if no name is provided.
The default model is `"phi3.5_mini_4k_instruct_q4_gguf"`, if no name is provided.

For available pretrained models please see the [Models Hub](https://sparknlp.org/models).

Expand Down
6 changes: 3 additions & 3 deletions python/sparknlp/annotator/seq2seq/auto_gguf_model.py
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ class AutoGGUFModel(AnnotatorModel, HasBatchedAnnotate):
... .setInputCols(["document"]) \\
... .setOutputCol("completions")
The default model is ``"gguf-phi3-mini-4k-instruct-q4"``, if no name is provided.
The default model is ``"phi3.5_mini_4k_instruct_q4_gguf"``, if no name is provided.
For extended examples of usage, see the
`AutoGGUFModelTest <https://github.com/JohnSnowLabs/spark-nlp/tree/master/src/test/scala/com/johnsnowlabs/nlp/annotators/seq2seq/AutoGGUFModelTest.scala>`__
Expand Down Expand Up @@ -782,13 +782,13 @@ def loadSavedModel(folder, spark_session):
return AutoGGUFModel(java_model=jModel)

@staticmethod
def pretrained(name="gguf-phi3-mini-4k-instruct-q4", lang="en", remote_loc=None):
def pretrained(name="phi3.5_mini_4k_instruct_q4_gguf", lang="en", remote_loc=None):
"""Downloads and loads a pretrained model.
Parameters
----------
name : str, optional
Name of the pretrained model, by default "gguf-phi3-mini-4k-instruct-q4"
Name of the pretrained model, by default "phi3.5_mini_4k_instruct_q4_gguf"
lang : str, optional
Language of the pretrained model, by default "en"
remote_loc : str, optional
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -42,7 +42,7 @@ import org.json4s.jackson.JsonMethods
* .setInputCols("document")
* .setOutputCol("completions")
* }}}
* The default model is `"gguf-phi3-mini-4k-instruct-q4"`, if no name is provided.
* The default model is `"phi3.5_mini_4k_instruct_q4_gguf"`, if no name is provided.
*
* For available pretrained models please see the [[https://sparknlp.org/models Models Hub]].
*
Expand Down Expand Up @@ -213,7 +213,7 @@ class AutoGGUFModel(override val uid: String)
trait ReadablePretrainedAutoGGUFModel
extends ParamsAndFeaturesReadable[AutoGGUFModel]
with HasPretrained[AutoGGUFModel] {
override val defaultModelName: Some[String] = Some("gguf-phi3-mini-4k-instruct-q4")
override val defaultModelName: Some[String] = Some("phi3.5_mini_4k_instruct_q4_gguf")
override val defaultLang: String = "en"

/** Java compliant-overrides */
Expand Down

0 comments on commit ba18698

Please sign in to comment.