LM

Topics

Agent	Model	Runner	Driver
axe SKILL MCP	Management	SGLang llama.cpp for SYCL llama.cpp for OpenVINO lemonade for AMD NPU	xe Driver oneAPI OpenVINO

Decision Tree for tinkering with Intel Arc Pro B70

Build environment

hf (model management)

• https://huggingface.co/docs/huggingface_hub/package_reference/environment_variables
• https://www.datalearner.com/en/leaderboards/category/code?benchmark=SWE-bench+Verified&modelSize=34b&licenseType=open
• https://huggingface.co/datasets/ScaleAI/SWE-bench_Pro

Purpose	Command
cache management	hf cache list hf cache rm <model id> hf cache prune
fix WiFi problem	HF_XET_FIXED_DOWNLOAD_CONCURRENCY=10 hf download "unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF" --include "*UD-Q4_K_XL*" HF_XET_FIXED_DOWNLOAD_CONCURRENCY=10 hf download "unsloth/Devstral-Small-2-24B-Instruct-2512-GGUF" --include "*UD-Q4_K_XL*"
search	# search by population hf models ls --search "Muse-Glimmer" --apps llama.cpp --expand "downloads,likes,createdAt,lastModified" --sort downloads --no-truncate --limit 25 # search for latest publish hf models ls --search "Muse-Glimmer" --apps llama.cpp --expand "downloads,likes,createdAt,lastModified" --sort created_at --no-truncate --limit 25 # search for latest tunning hf models ls --search "Muse-Glimmer" --apps llama.cpp --expand "downloads,likes,createdAt,lastModified" --sort last_modified --no-truncate --limit 25
optimize Qwen3-Coder	hf models ls --search "coder" --apps llama.cpp --sort downloads --limit 1 --format json | jq . hf models ls -h "unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF" hf download "unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF" --include "*UD-Q4_K_XL*"
optimize gemma-4-E4B	hf models ls -h unsloth/gemma-4-E4B-it-qat-GGUF hf download unsloth/gemma-4-E4B-it-qat-GGUF --include "*UD-Q4_K_XL*" hf download unsloth/gemma-4-E4B-it-qat-GGUF --include "mmproj-BF16.gguf" hf download unsloth/gemma-4-E4B-it-qat-GGUF --include "mtp-gemma-4-E4B-it.gguf"
optimize gemma-4-12B	hf models ls -h unsloth/gemma-4-12B-it-qat-GGUF hf download unsloth/gemma-4-12B-it-qat-GGUF --include "*UD-Q4_K_XL*" hf download unsloth/gemma-4-12B-it-qat-GGUF --include "mmproj-BF16.gguf" hf download unsloth/gemma-4-12B-it-qat-GGUF --include "mtp-gemma-4-12B-it.gguf"
optimize Muse Glimmer	hf models ls -h unsloth/Muse-Glimmer-30B-GGUF hf download unsloth/Muse-Glimmer-30B-GGUF --include "*UD-Q4_K_XL*" hf download unsloth/Muse-Glimmer-30B-GGUF --include "*UD-Q5_K_XL*" hf download unsloth/Muse-Glimmer-30B-GGUF --include "*UD-Q6_K_XL*" hf download unsloth/Muse-Glimmer-30B-GGUF --include "dflash-kquant.gguf" hf download unsloth/Muse-Glimmer-30B-GGUF --include "mmproj-kquant.gguf"
	tree ~/.cache/huggingface/hub/models--unsloth--Devstral-Small-2-24B-Instruct-2512-GGUF/snapshots tree ~/.cache/huggingface/hub/models--unsloth--Qwen3-Coder-30B-A3B-Instruct-GGUF/snapshots

Ubuntu

• LLM/Intel Pro Arc B70
• LLM/Ryzen AI 7 350 (XDNA)