Skip to content

Commit

Permalink
Add Model format field to Kitfile
Browse files Browse the repository at this point in the history
To make runtime usage simpler, add Kitfile field .model.format. This can
be set to store the model's data format (e.g. safetensors, gguf, onnx,
etc.).

This information can be used by runtimes to determine how to consume the
model (e.g. if the runtime can handle .gguf files)
  • Loading branch information
amisevsk committed Dec 11, 2024
1 parent 3de74c3 commit 5914b1e
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions pkg/artifact/kitfile.go
Original file line number Diff line number Diff line change
Expand Up @@ -53,6 +53,7 @@ type (
Path string `json:"path,omitempty" yaml:"path,omitempty"`
License string `json:"license,omitempty" yaml:"license,omitempty"`
Framework string `json:"framework,omitempty" yaml:"framework,omitempty"`
Format string `json:"format,omitempty" yaml:"format,omitempty"`
Version string `json:"version,omitempty" yaml:"version,omitempty"`
Description string `json:"description,omitempty" yaml:"description,omitempty"`
Parts []ModelPart `json:"parts,omitempty" yaml:"parts,omitempty"`
Expand Down

0 comments on commit 5914b1e

Please sign in to comment.