LM/Devstral Small 2 24B

From Fundamental Ramen
< LM
Revision as of 10:39, 14 August 2026 by Tacoball (talk | contribs) (Created page with "== Experiment == <syntaxhighlight lang="bash"> hf models ls --search "Devstral" --apps llama.cpp --expand "downloads,likes,lastModified" --sort downloads --no-truncate --limit 10 hf models ls --tree -R -h unsloth/Devstral-Small-2-24B-Instruct-2512-GGUF hf download unsloth/Devstral-Small-2-24B-Instruct-2512-GGUF --include "*UD-Q4*" hf download unsloth/Devstral-Small-2-24B-Instruct-2512-GGUF --include "*UD-Q5*" hf download unsloth/Devstral-Small-2-24B-Instruct-2512-GGUF...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

Experiment

hf models ls --search "Devstral" --apps llama.cpp --expand "downloads,likes,lastModified" --sort downloads --no-truncate --limit 10

hf models ls --tree -R -h unsloth/Devstral-Small-2-24B-Instruct-2512-GGUF

hf download unsloth/Devstral-Small-2-24B-Instruct-2512-GGUF --include "*UD-Q4*"
hf download unsloth/Devstral-Small-2-24B-Instruct-2512-GGUF --include "*UD-Q5*"
hf download unsloth/Devstral-Small-2-24B-Instruct-2512-GGUF --include "*UD-Q6*"
hf download unsloth/Devstral-Small-2-24B-Instruct-2512-GGUF --include "*Q8_0*"
hf download unsloth/Devstral-Small-2-24B-Instruct-2512-GGUF --include "mmproj-BF16*"

tree -h ~/.cache/huggingface/hub/models--unsloth--Devstral-Small-2-24B-Instruct-2512-GGUF