LLM/Intel Pro Arc B70/2026-06-20

From Fundamental Ramen
Jump to navigation Jump to search

Setup ssh key for github.com

Host         github.com
IdentityFile ~/.ssh/xxx.pem

Download source

sudo apt install git cmake
sudo apt install libssl-dev openssl
mkdir -p ~/llama.cpp/src
git clone https://github.com/ggerganov/llama.cpp ~/llama.cpp/src

Build

Test CPU version

cmake -B build -DGGML_NATIVE=ON
cmake --build build --config Release

Test OpenVINO version

# clean previous build
cmake --build build --target clean

# 
cmake -B build -DGGML_OPENVINO=ON
cmake --build build --config Release

Test SYCL version

cmake -B build -DGGML_SYCL=ON
cmake --build build --config Release