LLM/Intel Pro Arc B70: Difference between revisions

From Fundamental Ramen
< LLM
Jump to navigation Jump to search
No edit summary
Tag: Replaced
Line 12: Line 12:


= 2026-06-18 =
= 2026-06-18 =
== Install Ubuntu 24.04.04 Desktop ==
<syntaxhighlight lang="bash">
sudo apt update
sudo apt install openssh-server
</syntaxhighlight>
== Check B70 connection ==
<syntaxhighlight lang="bash">
# Check eGPU connection
boltctl list
# Check hardware dectection
sudo dmesg | grep -i 'xe '
# Check pci devices
lspci | grep -i 'vga\|display'
# Check card detail (sudo is required)
sudo lspci -vvv -s 05:00.0
# Check linux device & owner/group
ls -l /dev/dri
</syntaxhighlight>
== OpenCL ==
<syntaxhighlight lang="bash">
# install clinfo
sudo apt install clinfo
# check platforms
clinfo
# install hwe kernel (may not necessary for 24.04.04)
sudo apt install --install-recommends linux-generic-hwe-24.04
# install ppa (the most important)
sudo add-apt-repository -y ppa:kobuk-team/intel-graphics
sudo apt update
sudo apt install -y intel-opencl-icd libze-intel-gpu1 intel-media-va-driver-non-free clinfo intel-gsc
# check again
clinfo
</syntaxhighlight>
<pre>
Number of platforms                              1
  Platform Name                                  Intel(R) OpenCL Graphics
  Platform Vendor                                Intel(R) Corporation
  Platform Version                                OpenCL 3.0
  Platform Profile                                FULL_PROFILE
  Platform Extensions                            cl_khr_byte_addressable_store ...
...
Number of devices                                1
  Device Name                                    Intel(R) Arc(TM) Pro B70 Graphics
  Device Vendor                                  Intel(R) Corporation
  Device Vendor ID                                0x8086
  Device Version                                  OpenCL 3.0 NEO
  Device UUID                                    868023e2-0000-0000-0500-000000000000
  Driver UUID                                    32362e31-382e-3338-3330-382e34000000
  Valid Device LUID                              No
  Device LUID                                    5037-8e64fc7f0000
  Device Node Mask                                0
  Device Numeric Version                          0xc00000 (3.0.0)
  Driver Version                                  26.18.38308.4
</pre>
== llama.cpp from binary ==
<syntaxhighlight lang="bash">
# download binary
mkdir -p ~/llama.cpp/downloads
wget -P ~/llama.cpp/downloads https://github.com/ggml-org/llama.cpp/releases/download/b9730/llama-b9730-bin-ubuntu-openvino-2026.2-x64.tar.gz
wget -P ~/llama.cpp/downloads https://github.com/ggml-org/llama.cpp/releases/download/b9730/llama-b9730-bin-ubuntu-sycl-fp16-x64.tar.gz
# extract
mkdir -p ~/llama.cpp/9730/openvino
tar -C ~/llama.cpp/9730/openvino --strip-components=1 -zxvf ~/llama.cpp/downloads/llama-b9730-bin-ubuntu-openvino-2026.2-x64.tar.gz "llama-b9730/"
mkdir -p ~/llama.cpp/9730/sycl
tar -C ~/llama.cpp/9730/sycl --strip-components=1 -zxvf ~/llama.cpp/downloads/llama-b9730-bin-ubuntu-sycl-fp16-x64.tar.gz "llama-b9730/"
# Run GGUF model
sudo apt install -y python3 python3-venv
python3 -m venv ~/llama.cpp/llama-venv
source ~/llama.cpp/llama-venv/bin/activate
pip install -U "huggingface_hub[cli]"
hf auth login
ls -l ~/.cache/huggingface/hub/
./llama-cli -hf google/gemma-4-E4B-it-qat-q4_0-gguf
</syntaxhighlight>
OpenVINO
<syntaxhighlight lang="bash">
wget https://apt.repos.intel.com/intel-gpg-keys/GPG-PUB-KEY-INTEL-SW-PRODUCTS.PUB
sudo gpg --output /etc/apt/trusted.gpg.d/intel.gpg --dearmor GPG-PUB-KEY-INTEL-SW-PRODUCTS.PUB
echo "deb https://apt.repos.intel.com/openvino ubuntu24 main" | sudo tee /etc/apt/sources.list.d/intel-openvino.list
sudo apt update
sudo apt install openvino-2026.2.0
</syntaxhighlight>
<pre>
libopenvino-2026.2.1/ubuntu24,now 2026.2.1.21919 amd64 [已安裝,自動]
libopenvino-auto-batch-plugin-2026.2.1/ubuntu24,now 2026.2.1.21919 amd64 [已安裝,自動]
libopenvino-auto-plugin-2026.2.1/ubuntu24,now 2026.2.1.21919 amd64 [已安裝,自動]
libopenvino-dev-2026.2.1/ubuntu24,now 2026.2.1.21919 amd64 [已安裝,自動]
libopenvino-hetero-plugin-2026.2.1/ubuntu24,now 2026.2.1.21919 amd64 [已安裝,自動]
libopenvino-intel-cpu-plugin-2026.2.1/ubuntu24,now 2026.2.1.21919 amd64 [已安裝,自動]
libopenvino-intel-gpu-plugin-2026.2.1/ubuntu24,now 2026.2.1.21919 amd64 [已安裝,自動]
libopenvino-intel-npu-plugin-2026.2.1/ubuntu24,now 2026.2.1.21919 amd64 [已安裝,自動]
libopenvino-ir-frontend-2026.2.1/ubuntu24,now 2026.2.1.21919 amd64 [已安裝,自動]
libopenvino-onnx-frontend-2026.2.1/ubuntu24,now 2026.2.1.21919 amd64 [已安裝,自動]
libopenvino-paddle-frontend-2026.2.1/ubuntu24,now 2026.2.1.21919 amd64 [已安裝,自動]
libopenvino-pytorch-frontend-2026.2.1/ubuntu24,now 2026.2.1.21919 amd64 [已安裝,自動]
libopenvino-tensorflow-frontend-2026.2.1/ubuntu24,now 2026.2.1.21919 amd64 [已安裝,自動]
libopenvino-tensorflow-lite-frontend-2026.2.1/ubuntu24,now 2026.2.1.21919 amd64 [已安裝,自動]
openvino-2026.2.1/ubuntu24,now 2026.2.1.21919 all [已安裝,自動]
openvino-libraries-2026.2.1/ubuntu24,now 2026.2.1.21919 all [已安裝,自動]
openvino-libraries-dev-2026.2.1/ubuntu24,now 2026.2.1.21919 all [已安裝,自動]
openvino-samples-2026.2.1/ubuntu24,now 2026.2.1.21919 all [已安裝,自動]
openvino-samples-python-2026.2.1/ubuntu24,now 2026.2.1.21919 all [已安裝,自動]
openvino/ubuntu24,now 2026.2.1.21919 all [已安裝]
python3-openvino-2026.2.1/ubuntu24,now 2026.2.1.21919 amd64 [已安裝,自動]
</pre>
== llama.cpp ==
=== error message ===
==== error while loading shared libraries: libopenvino.so.2620 ====
<syntaxhighlight lang="bash">
# check openvino version
dpkg -l | grep libopenvino
# install the matched version
sudo apt autoremove openvino
sudo apt install openvino-2026.2.0
</syntaxhighlight>
==== error while loading shared libraries: libsvml.so ====
<syntaxhighlight lang="bash">
sudo apt install intel-oneapi-compiler-dpcpp-cpp-runtime intel-oneapi-mkl
source /opt/intel/oneapi/setvars.sh
</syntaxhighlight>
==== error while loading shared libraries: libdnnl.so.3 ====
<syntaxhighlight lang="bash">
sudo apt install intel-oneapi-runtime-dnnl
</syntaxhighlight>

Revision as of 07:00, 20 June 2026

Step

  • Check proper Ubuntu version for OpenVINO
  • Check proper Ubuntu version for SYCL
  • Install Ubuntu
  • Install HWE kernel
  • Install PPA driver

Diary

2026-06-18