LM/Flint 40B: Difference between revisions
< LM
m Tacoball moved page LM/Flint to LM/Flint 40B without leaving a redirect |
|||
(No difference)
| |||
Latest revision as of 02:46, 3 November 2026
vLLM
hf operations
# search latest vllm models
hf models ls --apps vllm --sort last_modified --no-truncate --no-gated \
--expand "downloads,likes,lastModified" \
--limit 25 --search "flint"
hf models ls --apps vllm --sort last_modified --no-truncate --no-gated \
--expand "downloads,likes,lastModified" \
--limit 25 --search "flint int4"
hf models ls --apps vllm --sort last_modified --no-truncate --no-gated \
--expand "downloads,likes,lastModified" \
--limit 25 --search "flint int8 int4"
hf models ls --apps vllm --sort last_modified --no-truncate --no-gated \
--expand "downloads,likes,lastModified" \
--limit 25 --search "flint autoround"
hf models ls --apps vllm --sort last_modified --no-truncate --no-gated \
--expand "downloads,likes,lastModified" \
--limit 25 --search "flint w4a8"
# list / download / tree
hf models ls --tree -R -h Wrapzii/Swift-1.5-Qwen3.8-27b-GPTQ-Int4-baked-v1-embed-int8
hf download Wrapzii/Swift-1.5-Qwen3.8-27b-GPTQ-Int4-baked-v1-embed-int8
tree -h ~/.cache/huggingface/hub/models--Wrapzii--Swift-1.5-Qwen3.8-27b-GPTQ-Int4-baked-v1-embed-int8