LM/llama.cpp for OpenVINO

From Fundamental Ramen

< LM

Jump to navigation Jump to search

Build

cmake -B build-openvino \
  -DGGML_OPENVINO=ON \
  -DGGML_OPENVINO_DEVICE=GPU \
  -DCMAKE_BUILD_TYPE=Release \
  -DCMAKE_INSTALL_RPATH="\$ORIGIN/../lib" .

cmake --build build-openvino --parallel

cmake --install build-openvino --prefix ~/llama.cpp/openvino

Retrieved from "https://wiki.fundamental-ramen.com/index.php?title=LM/llama.cpp_for_OpenVINO&oldid=2845"