View source for LM/llama.cpp for SYCL

== Download source ==

<syntaxhighlight lang="bash">
sudo apt install git cmake
sudo apt install libssl-dev openssl
mkdir -p ~/llama.cpp/src
git clone https://github.com/ggerganov/llama.cpp ~/llama.cpp/src
</syntaxhighlight>

== Build ==

<syntaxhighlight lang="bash">
# build
cmake -B build-sycl \
  -DCMAKE_C_COMPILER=icx \
  -DCMAKE_CXX_COMPILER=icpx \
  -DGGML_SYCL=ON \
  -DMKL_DIR=/opt/intel/oneapi/mkl/latest/lib/cmake/mkl \
  -DCMAKE_INSTALL_RPATH="\$ORIGIN/../lib"
cmake --build build-sycl --config Release

# Install 
cmake --install build-sycl --prefix ~/llama.cpp/sycl

# clean
cmake --build build-sycl --target clean

# test GPU
cd ~/llama.cpp/openvino/bin
./llama-cli --list-devices
</syntaxhighlight>

Got It!

<pre>
Available devices:
  SYCL0: Intel(R) Arc(TM) Pro B70 Graphics (32656 MiB, 32128 MiB free)
</pre>