LM/llama.cpp for OpenVINO: Difference between revisions
< LM
Jump to navigation
Jump to search
(→Build) |
(→Build) |
||
| Line 1: | Line 1: | ||
https://github.com/ggml-org/llama.cpp/blob/master/docs/backend/OPENVINO.md | |||
== Build == | == Build == | ||
<syntaxhighlight lang="bash"> | <syntaxhighlight lang="bash"> | ||
cmake -B build-openvino \ | |||
-DGGML_OPENVINO=ON \ | |||
-DGGML_NATIVE=ON \ | |||
-DCMAKE_BUILD_TYPE=Release \ | |||
-DCMAKE_INSTALL_RPATH="\$ORIGIN/../lib" . | |||
cmake -B build-openvino \ | cmake -B build-openvino \ | ||
-DGGML_OPENVINO=ON \ | -DGGML_OPENVINO=ON \ | ||
Revision as of 06:38, 21 August 2026
https://github.com/ggml-org/llama.cpp/blob/master/docs/backend/OPENVINO.md
Build
cmake -B build-openvino \
-DGGML_OPENVINO=ON \
-DGGML_NATIVE=ON \
-DCMAKE_BUILD_TYPE=Release \
-DCMAKE_INSTALL_RPATH="\$ORIGIN/../lib" .
cmake -B build-openvino \
-DGGML_OPENVINO=ON \
-DGGML_OPENVINO_DEVICE=GPU \
-DGGML_NATIVE=ON \
-DCMAKE_BUILD_TYPE=Release \
-DCMAKE_INSTALL_RPATH="\$ORIGIN/../lib" .
cmake --build build-openvino --parallel
cmake --install build-openvino --prefix ~/llama.cpp/openvino