Skip to content
CI - sharktank perplexity short

Update user docs for running llm server + upgrade gguf to 0.11.0 #463

Sign in to view logs

Update user docs for running llm server + upgrade gguf to 0.11.0

Update user docs for running llm server + upgrade gguf to 0.11.0 #463

Run time

Learn about OS pricing on GitHub Actions
Job Run time
Llama3.1 8B FP16 (3.11, llama-mi300x-3)
10s
10s