LLM/Intel Pro Arc B70/2026-06-20: Difference between revisions

From Fundamental Ramen
Jump to navigation Jump to search
Line 16: Line 16:


== Test CPU version ==
== Test CPU version ==
<syntaxhighlight lang="bash">
cmake -B build -DGGML_NATIVE=ON
cmake --build build --config Release
</syntaxhighlight>
== Test OpenVINO version ==
<syntaxhighlight lang="bash">
cmake -B build -DGGML_NATIVE=ON
cmake --build build --config Release
</syntaxhighlight>
== Test SYCL version ==
<syntaxhighlight lang="bash">
<syntaxhighlight lang="bash">
cmake -B build -DGGML_NATIVE=ON
cmake -B build -DGGML_NATIVE=ON
cmake --build build --config Release
cmake --build build --config Release
</syntaxhighlight>
</syntaxhighlight>

Revision as of 07:36, 20 June 2026

Setup ssh key for github.com

Host         github.com
IdentityFile ~/.ssh/xxx.pem

Download source

sudo apt install git cmake
sudo apt install libssl-dev openssl
mkdir -p ~/llama.cpp/src
git clone https://github.com/ggerganov/llama.cpp ~/llama.cpp/src

Build

Test CPU version

cmake -B build -DGGML_NATIVE=ON
cmake --build build --config Release

Test OpenVINO version

cmake -B build -DGGML_NATIVE=ON
cmake --build build --config Release

Test SYCL version

cmake -B build -DGGML_NATIVE=ON
cmake --build build --config Release