LM/Performance: Difference between revisions
< LM
Jump to navigation
Jump to search
No edit summary |
|||
| Line 1: | Line 1: | ||
== betterbench == | == Quick Test: llama-benchy == | ||
=== Use === | |||
<syntaxhighlight lang="bash"> | |||
llama-benchy --base-url https://models.nothanks.com/v1 --pp 512 --tg 128 --model my_model --api-key sk-12345678 | |||
</syntaxhighlight> | |||
=== Install === | |||
<syntaxhighlight lang="bash"> | |||
pipx install llama-benchy | |||
</syntaxhighlight> | |||
== Full Test: betterbench == | |||
=== Use === | === Use === | ||
Latest revision as of 09:42, 24 September 2026
Quick Test: llama-benchy
Use
llama-benchy --base-url https://models.nothanks.com/v1 --pp 512 --tg 128 --model my_model --api-key sk-12345678
Install
pipx install llama-benchy
Full Test: betterbench
Use
betterbench run --endpoint https://models.nothanks.com/v1 --model my_model --api-key sk-12345678
Install
git clone https://github.com/GGZ14/BetterBench.git
uv sync
.venv/bin/activate