LLM/Ryzen AI 7 350/2026-07-09: Difference between revisions

From Fundamental Ramen
Jump to navigation Jump to search
Line 141: Line 141:
sudo systemctl restart lemond
sudo systemctl restart lemond
</syntaxhighlight>
</syntaxhighlight>
Now Lemonade can load multiple models.


== Debug ==
== Debug ==

Revision as of 09:44, 9 July 2026

Install lemonade from PPA

sudo add-apt-repository ppa:lemonade-team/stable
sudo apt update
sudo apt install lemonade-server

Run lemonade server

sudo systemctl start lemond
sudo systemctl enable lemond

Install Backends

Open http://localhost:13305, then ...

Install llama.cpp cuda

  • Click backends at left sidebar.
  • Find Llama.cpp GPU
  • Find child item cuda
  • Click download
sudo vim /etc/gdm3/custom.conf

[daemon]
# 強制 GDM 的 Wayland 渲染走 AMD 的基底
Environment=VK_LOADER_DRIVERS_SELECT=*radeon*
Environment=MESA_VK_DEVICE_SELECT=pci-0000_66_00_0

sudo vim /etc/default/grub

GRUB_CMDLINE_LINUX_DEFAULT="quiet splash nvidia-drm.modeset=0"

sudo update-grub

Install Fastflow

  • Click backends at left sidebar.
  • Find FastFlowLM NPU
  • Find child item npu
  • Click download
  • Install XDNA driver
sudo apt install amdxdna-dkms
sudo reboot

cd 下載
sudo apt install ./fastflowlm_0.9.44_ubuntu26.04_amd64.deb
flm --version
flm validate

Memlock limit is too low (8MB). Please ...

Fix memory limit problem

sudo nano /etc/security/limits.conf

Add before `# End of file` 

* soft memlock unlimited
* hard memlock unlimited

sudo reboot

ulimit -l
flm validate
sudo systemctl edit lemond

[Service]
# Enable NPU
Environment="LEMONADE_ENABLE_NPU=true"
# Prevent from model unloaded
Environment="LEMONADE_MODEL_TTL=0"

sudo systemctl daemon-reload
sudo systemctl restart lemond

Optimize Lemonade config

Find Cache dir 

sudo journalctl -u lemond -f -n 100

 7月 09 17:37:22 agentlab-zen5 lemond[411649]: 2026-07-09 17:37:22.869 [Info] (main) Starting Lemonade Server...
 7月 09 17:37:22 agentlab-zen5 lemond[411649]: 2026-07-09 17:37:22.869 [Info] (main)   Version: 10.9.0
 7月 09 17:37:22 agentlab-zen5 lemond[411649]: 2026-07-09 17:37:22.869 [Info] (main)   Cache dir: /var/lib/lemonade/.cache/lemonade
 7月 09 17:37:22 agentlab-zen5 lemond[411649]: 2026-07-09 17:37:22.869 [Info] (main)   Port: 13305
 7月 09 17:37:22 agentlab-zen5 lemond[411649]: 2026-07-09 17:37:22.869 [Info] (main)   Host: localhost
 7月 09 17:37:22 agentlab-zen5 lemond[411649]: 2026-07-09 17:37:22.869 [Info] (main)   Log level: info
 7月 09 17:37:22 agentlab-zen5 lemond[411649]: 2026-07-09 17:37:22.869 [Info] (main)   Telemetry: disabled

Edit config.json 

sudo vim /var/lib/lemonade/.cache/lemonade/config.json
  • host: 0.0.0.0
  • max_loaded_models: -1
sudo systemctl restart lemond

Now Lemonade can load multiple models.

Debug

sudo journalctl -u lemond.service -n 50 --no-pager
sudo journalctl -u lemond -f -n 100
Retrieved from "https://wiki.fundamental-ramen.com/index.php?title=LLM/Ryzen_AI_7_350/2026-07-09&oldid=2402"