LLM/Ryzen AI 7 350/2026-07-09: Difference between revisions

From Fundamental Ramen
Jump to navigation Jump to search
Line 38: Line 38:
</syntaxhighlight>
</syntaxhighlight>


* Get Fastflow from https://github.com/FastFlowLM/FastFlowLM/releases/
* Get FastFlowLM release from https://github.com/FastFlowLM/FastFlowLM/releases/
* Download the latest db for Ubuntu 26.04
 
<syntaxhighlight lang="bash">
cd 下載
sudo apt install ./fastflowlm_0.9.44_ubuntu26.04_amd64.deb
</syntaxhighlight>

Revision as of 04:36, 9 July 2026

Install lemonade from PPA

sudo add-apt-repository ppa:lemonade-team/stable
sudo apt update
sudo apt install lemonade-server

Run lemonade server

sudo systemctl start lemond
sudo systemctl enable lemond

Install Backends

Open http://localhost:13305, then ...

Install llama.cpp cuda

  • Click backends at left sidebar.
  • Find Llama.cpp GPU
  • Find child item cuda
  • Click download

Install Fastflow

  • Click backends at left sidebar.
  • Find FastFlowLM NPU
  • Find child item npu
  • Click download
  • Install XDNA driver
sudo apt install amdxdna-dkms
sudo reboot
cd 下載
sudo apt install ./fastflowlm_0.9.44_ubuntu26.04_amd64.deb