LLM/Ryzen AI 7 350/2026-07-09

From Fundamental Ramen
Jump to navigation Jump to search

Install lemonade from PPA

sudo add-apt-repository ppa:lemonade-team/stable
sudo apt update
sudo apt install lemonade-server

Run lemonade server

sudo systemctl start lemond
sudo systemctl enable lemond

Install Backends

Open http://localhost:13305, then ...

Install llama.cpp cuda

  • Click backends at left sidebar.
  • Find Llama.cpp GPU
  • Find child item cuda
  • Click download

Install Fastflow

  • Click backends at left sidebar.
  • Find FastFlowLM NPU
  • Find child item npu
  • Click download
  • Install XDNA driver
sudo apt install amdxdna-dkms
sudo reboot
cd 下載
sudo apt install ./fastflowlm_0.9.44_ubuntu26.04_amd64.deb
flm --version
flm validate
Memlock limit is too low (8MB). Please ...

sudo nano /etc/security/limits.conf

  • soft memlock unlimited
  • hard memlock unlimited