LLM/Ryzen AI 7 350/2026-07-09: Difference between revisions

From Fundamental Ramen
Jump to navigation Jump to search
Line 15: Line 15:


== Install Backends ==
== Install Backends ==
Open http://localhost:13305, then ...


=== Install llama.cpp cuda ===
=== Install llama.cpp cuda ===
* Click backends at left sidebar.
* Find Llama.cpp GPU
* Find child item cuda
* Click download


=== Install Fastflow ===
=== Install Fastflow ===

Revision as of 04:17, 9 July 2026

Install lemonade from PPA

sudo add-apt-repository ppa:lemonade-team/stable
sudo apt update
sudo apt install lemonade-server

Run lemonade server

sudo systemctl start lemond
sudo systemctl enable lemond

Install Backends

Open http://localhost:13305, then ...

Install llama.cpp cuda

  • Click backends at left sidebar.
  • Find Llama.cpp GPU
  • Find child item cuda
  • Click download

Install Fastflow