Improve progress bar

[ericcurtin]

Set default width to whatever the terminal is. Also fixed a small bug around default n_gpu_layers value.

[ericcurtin]

@ggerganov @slaren this is ready for review

[ggerganov]

It crashes when I try to run with a local file:

$ git log -1
commit e55e67314c42360176643364c1277897eff96d78 (HEAD -> pr/10821)
Author: Eric Curtin <[email protected]>
Date:   Fri Dec 13 22:46:13 2024 +0000

    Improve progress bar
    
    Set default width to whatever the terminal is. Also fixed a small bug around
    default n_gpu_layers value.
    
    Signed-off-by: Eric Curtin <[email protected]>
$ ./build/bin/llama-run ./models/llama-3.2-3b-instruct/ggml-model-f16.gguf 
curl_easy_perform() failed: Failure when receiving data from the peer
libc++abi: terminating due to uncaught exception of type nlohmann::json_abi_v3_11_3::detail::parse_error: [json.exception.parse_error.101] parse error at line 1, column 1: attempting to parse an empty input; check that your input string or stream contains the expected JSON
Abort trap: 6

[ericcurtin]

It crashes when I try to run with a local file:

$ git log -1
commit e55e67314c42360176643364c1277897eff96d78 (HEAD -> pr/10821)
Author: Eric Curtin <[email protected]>
Date:   Fri Dec 13 22:46:13 2024 +0000

    Improve progress bar
    
    Set default width to whatever the terminal is. Also fixed a small bug around
    default n_gpu_layers value.
    
    Signed-off-by: Eric Curtin <[email protected]>
$ ./build/bin/llama-run ./models/llama-3.2-3b-instruct/ggml-model-f16.gguf 
curl_easy_perform() failed: Failure when receiving data from the peer
libc++abi: terminating due to uncaught exception of type nlohmann::json_abi_v3_11_3::detail::parse_error: [json.exception.parse_error.101] parse error at line 1, column 1: attempting to parse an empty input; check that your input string or stream contains the expected JSON
Abort trap: 6

Looking now

[ericcurtin]

Thanks for reporting @ggerganov , fixed with:

diff --git a/examples/run/run.cpp b/examples/run/run.cpp
index 7306c538..0ce138f7 100644
--- a/examples/run/run.cpp
+++ b/examples/run/run.cpp
@@ -567,8 +567,10 @@ class LlamaData {
         const std::vector<std::string> headers = { "--header",
                                                    "Accept: application/vnd.docker.distribution.manifest.v2+json" };
         int                            ret     = 0;
-        if (string_starts_with(model_, "file://") || std::filesystem::exists(bn)) {
+        if (string_starts_with(model_, "file://") || std::filesystem::exists(model_)) {
             remove_proto(model_);
+
+            return ret;
         } else if (string_starts_with(model_, "hf://") || string_starts_with(model_, "huggingface://")) {
             remove_proto(model_);
             ret = huggingface_dl(model_, headers, bn);

[ericcurtin]

Fix pushed