Skip to content

Commit

Permalink
deploy: d8a9bec
Browse files Browse the repository at this point in the history
  • Loading branch information
@github-actions
github-actions[bot] committed Jan 21, 2025
1 parent c845267 commit 03e11c1
Show file tree
Hide file tree
Showing 3 changed files with 30 additions and 30 deletions.
56 changes: 28 additions & 28 deletions docs/arewetiny.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -420,15 +420,15 @@ <h1>Are we tiny?<a class="headerlink" href="#are-we-tiny" title="Link to this he
<h2>Startup time<a class="headerlink" href="#startup-time" title="Link to this heading">#</a></h2>
<div class="highlight-text notranslate"><div class="highlight"><pre><span></span>$ make bench-importtime
...
208298 | openai.types
256016 | gptme.chat
372789 | openai
398343 | gptme.cli
453494 | gptme

real 0m1.388s
user 0m1.212s
sys 0m0.192s
219312 | openai.types
263528 | gptme.chat
410261 | gptme.cli
434102 | openai
464802 | gptme

real 0m1.494s
user 0m1.313s
sys 0m0.169s
make[2]: Leaving directory &#39;/home/runner/work/gptme/gptme&#39;
</pre></div>
</div>
Expand All @@ -440,11 +440,11 @@ <h3>LoC Core<a class="headerlink" href="#loc-core" title="Link to this heading">
<div class="highlight-text notranslate"><div class="highlight"><pre><span></span>$ make cloc-core
make[2]: Entering directory &#39;/home/runner/work/gptme/gptme&#39;
cloc gptme/*.py gptme/llm/*.py gptme/util/*.py gptme/tools/__init__.py gptme/tools/base.py --by-file
github.com/AlDanial/cloc v 1.98 T=0.05 s (652.6 files/s, 142268.3 lines/s)
github.com/AlDanial/cloc v 1.98 T=0.05 s (651.1 files/s, 142086.5 lines/s)
---------------------------------------------------------------------------------
File blank comment code
---------------------------------------------------------------------------------
gptme/llm/llm_openai.py 95 49 374
gptme/llm/llm_openai.py 97 52 374
gptme/llm/llm_anthropic.py 86 67 362
gptme/tools/base.py 89 77 349
gptme/chat.py 66 99 328
Expand All @@ -454,8 +454,8 @@ <h3>LoC Core<a class="headerlink" href="#loc-core" title="Link to this heading">
gptme/ncurses.py 39 5 238
gptme/commands.py 18 19 232
gptme/message.py 55 65 228
gptme/llm/models.py 27 15 220
gptme/llm/__init__.py 51 42 212
gptme/llm/models.py 27 15 222
gptme/llm/__init__.py 52 44 210
gptme/util/context.py 49 59 201
gptme/util/ask_execute.py 47 44 189
gptme/util/__init__.py 39 22 171
Expand All @@ -480,7 +480,7 @@ <h3>LoC Core<a class="headerlink" href="#loc-core" title="Link to this heading">
gptme/__init__.py 1 0 8
gptme/__main__.py 1 0 3
---------------------------------------------------------------------------------
SUM: 1225 1098 5307
SUM: 1228 1103 5307
---------------------------------------------------------------------------------
make[2]: Leaving directory &#39;/home/runner/work/gptme/gptme&#39;
</pre></div>
Expand All @@ -491,17 +491,17 @@ <h3>LoC LLM<a class="headerlink" href="#loc-llm" title="Link to this heading">#<
<div class="highlight-text notranslate"><div class="highlight"><pre><span></span>$ make cloc-llm
make[2]: Entering directory &#39;/home/runner/work/gptme/gptme&#39;
cloc gptme/llm/*.py --by-file
github.com/AlDanial/cloc v 1.98 T=0.02 s (313.8 files/s, 109438.5 lines/s)
github.com/AlDanial/cloc v 1.98 T=0.02 s (291.8 files/s, 102241.7 lines/s)
---------------------------------------------------------------------------------
File blank comment code
---------------------------------------------------------------------------------
gptme/llm/llm_openai.py 95 49 374
gptme/llm/llm_openai.py 97 52 374
gptme/llm/llm_anthropic.py 86 67 362
gptme/llm/models.py 27 15 220
gptme/llm/__init__.py 51 42 212
gptme/llm/models.py 27 15 222
gptme/llm/__init__.py 52 44 210
gptme/llm/llm_openai_models.py 3 9 132
---------------------------------------------------------------------------------
SUM: 262 182 1300
SUM: 265 187 1300
---------------------------------------------------------------------------------
make[2]: Leaving directory &#39;/home/runner/work/gptme/gptme&#39;
</pre></div>
Expand All @@ -512,7 +512,7 @@ <h3>LoC Tools<a class="headerlink" href="#loc-tools" title="Link to this heading
<div class="highlight-text notranslate"><div class="highlight"><pre><span></span>$ make cloc-tools
make[2]: Entering directory &#39;/home/runner/work/gptme/gptme&#39;
cloc gptme/tools/*.py --by-file
github.com/AlDanial/cloc v 1.98 T=0.03 s (640.7 files/s, 130895.6 lines/s)
github.com/AlDanial/cloc v 1.98 T=0.03 s (635.2 files/s, 129771.3 lines/s)
-------------------------------------------------------------------------------------
File blank comment code
-------------------------------------------------------------------------------------
Expand Down Expand Up @@ -549,7 +549,7 @@ <h3>LoC Server<a class="headerlink" href="#loc-server" title="Link to this headi
<div class="highlight-text notranslate"><div class="highlight"><pre><span></span>$ make cloc-server
make[2]: Entering directory &#39;/home/runner/work/gptme/gptme&#39;
cloc gptme/server --by-file
github.com/AlDanial/cloc v 1.98 T=0.01 s (732.5 files/s, 108497.1 lines/s)
github.com/AlDanial/cloc v 1.98 T=0.01 s (681.5 files/s, 100953.6 lines/s)
------------------------------------------------------------------------------------
File blank comment code
------------------------------------------------------------------------------------
Expand All @@ -573,7 +573,7 @@ <h3>LoC Tests<a class="headerlink" href="#loc-tests" title="Link to this heading
<div class="highlight-text notranslate"><div class="highlight"><pre><span></span>$ make cloc-tests
make[2]: Entering directory &#39;/home/runner/work/gptme/gptme&#39;
cloc tests --by-file
github.com/AlDanial/cloc v 1.98 T=0.03 s (1103.4 files/s, 117290.0 lines/s)
github.com/AlDanial/cloc v 1.98 T=0.03 s (1099.7 files/s, 116894.3 lines/s)
------------------------------------------------------------------------------------------
File blank comment code
------------------------------------------------------------------------------------------
Expand Down Expand Up @@ -619,7 +619,7 @@ <h3>LoC Eval<a class="headerlink" href="#loc-eval" title="Link to this heading">
<div class="highlight-text notranslate"><div class="highlight"><pre><span></span>$ make cloc-eval
make[2]: Entering directory &#39;/home/runner/work/gptme/gptme&#39;
cloc gptme/eval/**.py --by-file
github.com/AlDanial/cloc v 1.98 T=0.01 s (614.0 files/s, 80429.5 lines/s)
github.com/AlDanial/cloc v 1.98 T=0.01 s (605.4 files/s, 79310.6 lines/s)
-------------------------------------------------------------------------------------
File blank comment code
-------------------------------------------------------------------------------------
Expand All @@ -643,11 +643,11 @@ <h3>LoC Total<a class="headerlink" href="#loc-total" title="Link to this heading
<div class="highlight-text notranslate"><div class="highlight"><pre><span></span>$ make cloc-total
make[2]: Entering directory &#39;/home/runner/work/gptme/gptme&#39;
cloc gptme/eval/run.py gptme/eval/types.py gptme/eval/agents.py gptme/eval/execenv.py gptme/eval/__init__.py gptme/eval/__main__.py gptme/eval/filestore.py gptme/eval/main.py gptme/eval/suites/init_projects.py gptme/eval/suites/__init__.py gptme/eval/suites/basic.py gptme/eval/suites/browser.py gptme/init.py gptme/logmanager.py gptme/tools/youtube.py gptme/tools/screenshot.py gptme/tools/subagent.py gptme/tools/python.py gptme/tools/save.py gptme/tools/shell.py gptme/tools/tmux.py gptme/tools/patch.py gptme/tools/_browser_thread.py gptme/tools/__init__.py gptme/tools/base.py gptme/tools/rag.py gptme/tools/computer.py gptme/tools/vision.py gptme/tools/gh.py gptme/tools/read.py gptme/tools/chats.py gptme/tools/browser.py gptme/tools/tts.py gptme/tools/_browser_lynx.py gptme/tools/_browser_playwright.py gptme/util/prompt.py gptme/util/context.py gptme/util/ask_execute.py gptme/util/__init__.py gptme/util/interrupt.py gptme/util/clipboard.py gptme/util/cost.py gptme/util/cli.py gptme/util/generate_name.py gptme/util/export.py gptme/util/reduce.py gptme/util/useredit.py gptme/__init__.py gptme/server/api.py gptme/server/__init__.py gptme/server/__main__.py gptme/server/cli.py gptme/__main__.py gptme/llm/__init__.py gptme/llm/llm_openai.py gptme/llm/models.py gptme/llm/llm_anthropic.py gptme/llm/llm_openai_models.py gptme/wut.py gptme/prompts.py gptme/message.py gptme/codeblock.py gptme/constants.py gptme/dirs.py gptme/config.py gptme/ncurses.py gptme/cli.py gptme/chat.py gptme/commands.py gptme/__version__.py tests/test_context.py tests/test_reduce.py tests/test_util.py tests/test_tools_chats.py tests/test_tools_python.py tests/test_tools_rag.py tests/test_tools_tts.py tests/test_tools_patch.py tests/test_tools_shell.py tests/test_eval.py tests/test_prompts.py tests/test_server.py tests/test_codeblock.py tests/test_prompt_tools.py tests/test_prompt.py tests/test_config.py tests/test_tools_subagent.py tests/test_llm_anthropic.py tests/test_browser.py tests/test_tools.py tests/test_llm_openai.py tests/test_message.py tests/test_chat.py tests/test_shell.py tests/test_tool_use.py tests/conftest.py tests/test_cli.py tests/test_logmanager.py tests/test_util_cli.py scripts/list_user_messages.py scripts/train/collect.py scripts/shorten_details.py scripts/treeofthoughts.py scripts/summarize_project.py scripts/describe_api.py scripts/gpt_todoer.py --by-file
github.com/AlDanial/cloc v 1.98 T=0.11 s (931.9 files/s, 146482.0 lines/s)
github.com/AlDanial/cloc v 1.98 T=0.12 s (919.3 files/s, 144560.6 lines/s)
-------------------------------------------------------------------------------------
File blank comment code
-------------------------------------------------------------------------------------
gptme/llm/llm_openai.py 95 49 374
gptme/llm/llm_openai.py 97 52 374
gptme/llm/llm_anthropic.py 86 67 362
gptme/eval/main.py 55 22 355
gptme/tools/base.py 89 77 349
Expand All @@ -664,9 +664,9 @@ <h3>LoC Total<a class="headerlink" href="#loc-total" title="Link to this heading
gptme/tools/tts.py 81 75 231
gptme/message.py 55 65 228
tests/test_llm_anthropic.py 27 0 223
gptme/llm/models.py 27 15 220
gptme/llm/__init__.py 51 42 212
gptme/llm/models.py 27 15 222
gptme/tools/tmux.py 52 72 211
gptme/llm/__init__.py 52 44 210
gptme/util/context.py 49 59 201
gptme/util/ask_execute.py 47 44 189
gptme/tools/patch.py 43 55 186
Expand Down Expand Up @@ -754,7 +754,7 @@ <h3>LoC Total<a class="headerlink" href="#loc-total" title="Link to this heading
gptme/server/__init__.py 2 3 3
gptme/server/__main__.py 1 0 3
-------------------------------------------------------------------------------------
SUM: 2899 2601 11161
SUM: 2902 2606 11161
-------------------------------------------------------------------------------------
make[2]: Leaving directory &#39;/home/runner/work/gptme/gptme&#39;
</pre></div>
Expand Down
2 changes: 1 addition & 1 deletion docs/evals.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -416,7 +416,7 @@ <h2>Usage<a class="headerlink" href="#usage" title="Link to this heading">#</a><
<h2>Results<a class="headerlink" href="#results" title="Link to this heading">#</a></h2>
<p>Here are the results of the evals we have run so far:</p>
<div class="highlight-text notranslate"><div class="highlight"><pre><span></span>$ gptme-eval eval_results/*/eval_results.csv
[11:57:14] Browser tool available (using playwright)
[13:36:06] Browser tool available (using playwright)
Model hello hello-patch hello-ask prime100 init-git init-rust whois-superuserlabs-ceo
--------------------------------------------- -------------- -------------- -------------- -------------- --------------- ------------- -------------------------
anthropic/claude-3-5-haiku-20241022 ✅ 55/57 473tk ✅ 56/57 386tk ✅ 56/57 468tk ✅ 56/57 912tk ✅ 54/56 922tk ❓ N/A ✅ 1/1 2619tk
Expand Down
2 changes: 1 addition & 1 deletion docs/searchindex.js
View file

Large diffs are not rendered by default.

0 comments on commit 03e11c1

Please sign in to comment.