Skip to content

Commit

Permalink
deploy: a40f538
Browse files Browse the repository at this point in the history
  • Loading branch information
@github-actions
github-actions[bot] committed Dec 9, 2024
1 parent e16b2a0 commit 36dec22
Show file tree
Hide file tree
Showing 5 changed files with 31 additions and 31 deletions.
40 changes: 20 additions & 20 deletions docs/arewetiny.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -414,15 +414,15 @@ <h1>Are we tiny?<a class="headerlink" href="#are-we-tiny" title="Link to this he
<h2>Startup time<a class="headerlink" href="#startup-time" title="Link to this heading">#</a></h2>
<div class="highlight-text notranslate"><div class="highlight"><pre><span></span>$ make bench-importtime
...
222813 | gptme.commands
230804 | gptme.chat
286299 | gptme.cli
331621 | openai
333785 | gptme

real 0m1.398s
user 0m1.261s
sys 0m0.148s
220810 | gptme.commands
228616 | gptme.chat
283762 | gptme.cli
329244 | openai
331131 | gptme

real 0m1.381s
user 0m1.230s
sys 0m0.163s
make[2]: Leaving directory &#39;/home/runner/work/gptme/gptme&#39;
</pre></div>
</div>
Expand All @@ -439,7 +439,7 @@ <h3>LoC Core<a class="headerlink" href="#loc-core" title="Link to this heading">
34 unique files.
0 files ignored.

github.com/AlDanial/cloc v 1.90 T=0.05 s (743.2 files/s, 141126.8 lines/s)
github.com/AlDanial/cloc v 1.90 T=0.04 s (766.3 files/s, 145529.6 lines/s)
---------------------------------------------------------------------------------
File blank comment code
---------------------------------------------------------------------------------
Expand All @@ -455,7 +455,7 @@ <h3>LoC Core<a class="headerlink" href="#loc-core" title="Link to this heading">
gptme/commands.py 18 18 204
gptme/util/context.py 49 59 202
gptme/util/__init__.py 41 21 176
gptme/util/ask_execute.py 47 45 173
gptme/util/ask_execute.py 47 45 174
gptme/util/cli.py 48 28 161
gptme/llm/models.py 24 12 150
gptme/prompts.py 56 80 141
Expand All @@ -478,7 +478,7 @@ <h3>LoC Core<a class="headerlink" href="#loc-core" title="Link to this heading">
gptme/__version__.py 2 0 7
gptme/__main__.py 1 0 3
---------------------------------------------------------------------------------
SUM: 1030 890 4536
SUM: 1030 890 4537
---------------------------------------------------------------------------------
make[2]: Leaving directory &#39;/home/runner/work/gptme/gptme&#39;
</pre></div>
Expand All @@ -494,7 +494,7 @@ <h3>LoC LLM<a class="headerlink" href="#loc-llm" title="Link to this heading">#<
5 unique files.
0 files ignored.

github.com/AlDanial/cloc v 1.90 T=0.01 s (409.7 files/s, 101286.8 lines/s)
github.com/AlDanial/cloc v 1.90 T=0.01 s (403.4 files/s, 99724.1 lines/s)
---------------------------------------------------------------------------------
File blank comment code
---------------------------------------------------------------------------------
Expand All @@ -520,7 +520,7 @@ <h3>LoC Tools<a class="headerlink" href="#loc-tools" title="Link to this heading
20 unique files.
0 files ignored.

github.com/AlDanial/cloc v 1.90 T=0.03 s (723.0 files/s, 133823.8 lines/s)
github.com/AlDanial/cloc v 1.90 T=0.03 s (735.0 files/s, 136057.7 lines/s)
-------------------------------------------------------------------------------------
File blank comment code
-------------------------------------------------------------------------------------
Expand Down Expand Up @@ -561,7 +561,7 @@ <h3>LoC Server<a class="headerlink" href="#loc-server" title="Link to this headi
8 unique files.
0 files ignored.

github.com/AlDanial/cloc v 1.90 T=0.01 s (744.8 files/s, 110138.8 lines/s)
github.com/AlDanial/cloc v 1.90 T=0.01 s (790.7 files/s, 116931.3 lines/s)
------------------------------------------------------------------------------------
File blank comment code
------------------------------------------------------------------------------------
Expand Down Expand Up @@ -590,7 +590,7 @@ <h3>LoC Tests<a class="headerlink" href="#loc-tests" title="Link to this heading
25 unique files.
0 files ignored.

github.com/AlDanial/cloc v 1.90 T=0.02 s (1233.7 files/s, 107185.6 lines/s)
github.com/AlDanial/cloc v 1.90 T=0.02 s (1231.3 files/s, 106974.2 lines/s)
------------------------------------------------------------------------------------------
File blank comment code
------------------------------------------------------------------------------------------
Expand Down Expand Up @@ -636,7 +636,7 @@ <h3>LoC Eval<a class="headerlink" href="#loc-eval" title="Link to this heading">
8 unique files.
0 files ignored.

github.com/AlDanial/cloc v 1.90 T=0.01 s (654.8 files/s, 80045.8 lines/s)
github.com/AlDanial/cloc v 1.90 T=0.01 s (649.4 files/s, 79389.0 lines/s)
-------------------------------------------------------------------------------------
File blank comment code
-------------------------------------------------------------------------------------
Expand Down Expand Up @@ -665,7 +665,7 @@ <h3>LoC Total<a class="headerlink" href="#loc-total" title="Link to this heading
99 unique files.
0 files ignored.

github.com/AlDanial/cloc v 1.90 T=0.09 s (1065.5 files/s, 149539.4 lines/s)
github.com/AlDanial/cloc v 1.90 T=0.09 s (1070.1 files/s, 150193.4 lines/s)
-------------------------------------------------------------------------------------
File blank comment code
-------------------------------------------------------------------------------------
Expand All @@ -687,7 +687,7 @@ <h3>LoC Total<a class="headerlink" href="#loc-total" title="Link to this heading
gptme/tools/patch.py 43 56 180
gptme/server/api.py 53 35 179
gptme/util/__init__.py 41 21 176
gptme/util/ask_execute.py 47 45 173
gptme/util/ask_execute.py 47 45 174
gptme/tools/tmux.py 45 62 172
gptme/tools/_browser_playwright.py 58 28 165
gptme/tools/save.py 32 38 162
Expand Down Expand Up @@ -769,7 +769,7 @@ <h3>LoC Total<a class="headerlink" href="#loc-total" title="Link to this heading
gptme/server/__init__.py 2 3 3
gptme/server/__main__.py 1 0 3
-------------------------------------------------------------------------------------
SUM: 2458 2199 9237
SUM: 2458 2199 9238
-------------------------------------------------------------------------------------
make[2]: Leaving directory &#39;/home/runner/work/gptme/gptme&#39;
</pre></div>
Expand Down
12 changes: 6 additions & 6 deletions docs/evals.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -412,21 +412,21 @@ <h2>Results<a class="headerlink" href="#results" title="Link to this heading">#<
<div class="highlight-text notranslate"><div class="highlight"><pre><span></span>$ gptme-eval eval_results/*/eval_results.csv
Model hello hello-patch hello-ask prime100 init-git init-rust whois-superuserlabs-ceo
---------------------------------------- -------------- -------------- -------------- -------------- --------------- ------------- -------------------------
anthropic/claude-3-5-haiku-20241022 ✅ 29/29 481tk ✅ 29/29 411tk ✅ 29/29 518tk ✅ 29/29 936tk ✅ 27/28 924tk ❓ N/A ✅ 1/1 2619tk
anthropic/claude-3-5-haiku-20241022 ✅ 30/30 486tk ✅ 30/30 411tk ✅ 30/30 517tk ✅ 30/30 936tk ✅ 28/29 924tk ❓ N/A ✅ 1/1 2619tk
anthropic/claude-3-5-sonnet-20240620 ✅ 34/34 630tk ✅ 34/34 542tk ✅ 34/34 710tk ✅ 34/34 924tk ✅ 34/34 1098tk ✅ 4/4 1504tk 🔶 3/4 1306tk
anthropic/claude-3-5-sonnet-20241022 ✅ 28/28 461tk ✅ 27/28 410tk ✅ 27/28 438tk ✅ 28/28 991tk ✅ 28/28 764tk ❓ N/A ❓ N/A
anthropic/claude-3-5-sonnet-20241022 ✅ 29/29 462tk ✅ 28/29 409tk ✅ 28/29 440tk ✅ 29/29 988tk ✅ 29/29 768tk ❓ N/A ❓ N/A
anthropic/claude-3-haiku-20240307 ✅ 34/34 388tk ✅ 34/34 375tk ✅ 34/34 432tk ❌ 6/34 781tk 🔶 24/34 903tk 🔶 3/4 670tk ✅ 4/4 1535tk
gemini/gemini-1.5-flash-latest ❌ 0/14 29tk ❌ 0/14 29tk ❌ 0/14 29tk ❌ 0/14 29tk ❌ 0/14 29tk ❓ N/A ❓ N/A
gemini/gemini-1.5-flash-latest ❌ 0/15 29tk ❌ 0/15 29tk ❌ 0/15 29tk ❌ 0/15 29tk ❌ 0/15 29tk ❓ N/A ❓ N/A
openai/gpt-4-turbo ✅ 3/3 255tk ✅ 3/3 312tk ✅ 3/3 376tk ✅ 3/3 527tk ✅ 4/4 590tk ✅ 4/4 784tk ✅ 6/7 819tk
openai/gpt-4o ✅ 63/63 311tk ✅ 63/63 312tk ✅ 60/63 366tk 🔶 35/63 451tk ✅ 62/63 743tk ✅ 5/5 663tk ✅ 5/5 1253tk
openai/gpt-4o-mini ✅ 58/64 288tk ✅ 64/64 320tk ✅ 64/64 377tk ✅ 61/64 584tk ✅ 59/64 784tk ✅ 6/6 813tk ✅ 6/6 951tk
openai/gpt-4o ✅ 64/64 313tk ✅ 64/64 313tk ✅ 61/64 367tk 🔶 35/64 451tk ✅ 63/64 744tk ✅ 5/5 663tk ✅ 5/5 1253tk
openai/gpt-4o-mini ✅ 59/65 291tk ✅ 65/65 321tk ✅ 65/65 378tk ✅ 62/65 586tk ✅ 59/65 787tk ✅ 6/6 813tk ✅ 6/6 951tk
openai/o1-mini ✅ 3/3 354tk ✅ 3/3 431tk ✅ 3/3 460tk 🔶 2/3 567tk 🔶 3/5 2222tk 🔶 1/5 1412tk 🔶 2/3 813tk
openai/o1-preview ✅ 2/2 308tk ✅ 2/2 570tk 🔶 1/2 549tk ✅ 2/2 490tk ✅ 3/3 823tk ✅ 1/1 656tk ✅ 1/1 1998tk
google/gemini-flash-1.5 ✅ 2/2 225tk ✅ 2/2 401tk ✅ 2/2 430tk ❌ 0/2 296tk ✅ 1/1 686tk ❌ 0/1 661tk ✅ 1/1 1014tk
google/gemini-pro-1.5 ✅ 1/1 341tk ✅ 1/1 419tk ✅ 1/1 456tk ✅ 1/1 676tk 🔶 2/3 431tk 🔶 1/2 1016tk ✅ 2/2 1308tk
google/gemma-2-27b-it ✅ 1/1 288tk ✅ 1/1 384tk ✅ 1/1 446tk ✅ 1/1 714tk ✅ 1/1 570tk ❌ 0/1 535tk ❌ 0/1 235tk
google/gemma-2-9b-it ❌ 0/2 186tk ✅ 2/2 370tk ✅ 2/2 368tk ❌ 0/2 545tk ✅ 1/1 492tk ❌ 0/1 1730tk ❌ 0/1 352tk
meta-llama/llama-3.1-405b-instruct 🔶 45/63 228tk 🔶 49/63 452tk 🔶 49/63 367tk 🔶 46/63 382tk 🔶 38/63 464tk 🔶 2/5 255tk ❌ 0/5 85tk
meta-llama/llama-3.1-405b-instruct 🔶 46/64 231tk 🔶 50/64 451tk 🔶 50/64 368tk 🔶 47/64 387tk 🔶 39/64 469tk 🔶 2/5 255tk ❌ 0/5 85tk
meta-llama/llama-3.1-70b-instruct ✅ 5/6 367tk ✅ 5/6 424tk ✅ 6/6 452tk 🔶 2/6 546tk ✅ 5/6 813tk 🔶 3/4 682tk 🔶 2/3 1461tk
meta-llama/llama-3.1-8b-instruct ✅ 1/1 277tk ✅ 1/1 441tk ❌ 0/1 400tk ❌ 0/1 5095tk ✅ 1/1 2266tk ❓ N/A ❓ N/A
meta-llama/llama-3.2-11b-vision-instruct ✅ 2/2 352tk ✅ 2/2 493tk ❌ 0/2 479tk ✅ 2/2 2643tk ❓ N/A ❓ N/A ❓ N/A
Expand Down
4 changes: 2 additions & 2 deletions docs/prompts.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -610,10 +610,10 @@ <h1>Prompts<a class="headerlink" href="#prompts" title="Link to this heading">#<
Do not use EOF/HereDoc syntax to send multiline commands, as the assistant will not be able to handle it.

These programs are available, among others:
<span class="k">-</span><span class="w"> </span>docker
<span class="k">-</span><span class="w"> </span>pandoc
<span class="k">-</span><span class="w"> </span>apt-get
<span class="k">-</span><span class="w"> </span>git
<span class="k">-</span><span class="w"> </span>apt-get
<span class="k">-</span><span class="w"> </span>docker

<span class="gu">### Examples</span>

Expand Down
2 changes: 1 addition & 1 deletion docs/searchindex.js
View file

Large diffs are not rendered by default.

4 changes: 2 additions & 2 deletions docs/tools.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -446,10 +446,10 @@ <h2>Shell<a class="headerlink" href="#shell" title="Link to this heading">#</a><
Do not use EOF/HereDoc syntax to send multiline commands, as the assistant will not be able to handle it.

These programs are available, among others:
<span class="k">-</span><span class="w"> </span>docker
<span class="k">-</span><span class="w"> </span>pandoc
<span class="k">-</span><span class="w"> </span>apt-get
<span class="k">-</span><span class="w"> </span>git
<span class="k">-</span><span class="w"> </span>apt-get
<span class="k">-</span><span class="w"> </span>docker
</pre></div>
</div>
<p class="rubric">Examples</p>
Expand Down

0 comments on commit 36dec22

Please sign in to comment.