Skip to content

Commit

Permalink
expand documentation for shortfin_apps.llm.server --parameters=
Browse files Browse the repository at this point in the history
  • Loading branch information
renxida committed Oct 14, 2024
1 parent 02b0886 commit a667fbb
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion shortfin/python/shortfin_apps/llm/server.py
Original file line number Diff line number Diff line change
Expand Up @@ -121,11 +121,13 @@ def main(argv, log_config=uvicorn.config.LOGGING_CONFIG):
required=True,
help="Model VMFB to load",
)
# parameters are loaded with `iree_io_parameters_module_create`
parser.add_argument(
"--parameters",
type=Path,
nargs="*",
help="Parameter archives to load",
help="Parameter archives to load (supports: gguf, irpa, safetensors).",
metavar="FILE",
)
parser.add_argument(
"--device",
Expand Down

0 comments on commit a667fbb

Please sign in to comment.