LLM/Intel Pro Arc B70: Difference between revisions

From Fundamental Ramen
< LLM
Jump to navigation Jump to search
 
(22 intermediate revisions by the same user not shown)
Line 1: Line 1:
= Step =
= Install drivers =


* Check proper Ubuntu version for OpenVINO
== Check proper Ubuntu version ==
* Check proper Ubuntu version for SYCL
 
* Check the latest Ubuntu version which OpenVINO supported. <br/>https://docs.openvino.ai/2026/get-started/install-openvino/install-openvino-apt.html
* It's Ubuntu 24.04 at 2026-06-20.
* Install Ubuntu
* Install Ubuntu
* Install HWE kernel
* Install PPA driver
= 2026-06-18 =
== Install Ubuntu 24.04.04 Desktop ==


<syntaxhighlight lang="bash">
== Check device connection ==
sudo apt update
sudo apt install openssh-server
</syntaxhighlight>
 
== Check B70 connection ==


<syntaxhighlight lang="bash">
<syntaxhighlight lang="bash">
# Check eGPU connection
# Check eGPU connection (for eGPU only)
boltctl list
boltctl list


Line 27: Line 18:
# Check pci devices
# Check pci devices
lspci | grep -i 'vga\|display'
lspci | grep -i 'vga\|display'
# Check card detail (sudo is required)
sudo lspci -vvv -s 05:00.0
# Check linux device & owner/group
ls -l /dev/dri
</syntaxhighlight>
</syntaxhighlight>


== OpenCL ==
Found B70 at PCI node '''05:00.0'''
 
<syntaxhighlight lang="bash">
# install clinfo
sudo apt install clinfo
 
# check platforms
clinfo


# install hwe kernel (may not necessary for 24.04.04)
'''Intel Corporation Device e223''' is Intel Pro Arc B70.
sudo apt install --install-recommends linux-generic-hwe-24.04
 
# install ppa (the most important)
sudo add-apt-repository -y ppa:kobuk-team/intel-graphics
sudo apt update
sudo apt install -y intel-opencl-icd libze-intel-gpu1 intel-media-va-driver-non-free clinfo intel-gsc
 
# check again
clinfo
</syntaxhighlight>


<pre>
<pre>
Number of platforms                              1
05:00.0 VGA compatible controller: Intel Corporation Device e223
  Platform Name                                  Intel(R) OpenCL Graphics
66:00.0 Display controller: Advanced Micro Devices, Inc. [AMD/ATI] Device 1114 (rev c2)
  Platform Vendor                                Intel(R) Corporation
  Platform Version                                OpenCL 3.0
  Platform Profile                                FULL_PROFILE
  Platform Extensions                            cl_khr_byte_addressable_store ...
 
...
 
Number of devices                                1
  Device Name                                    Intel(R) Arc(TM) Pro B70 Graphics
  Device Vendor                                  Intel(R) Corporation
  Device Vendor ID                                0x8086
  Device Version                                  OpenCL 3.0 NEO
  Device UUID                                    868023e2-0000-0000-0500-000000000000
  Driver UUID                                    32362e31-382e-3338-3330-382e34000000
  Valid Device LUID                              No
  Device LUID                                    5037-8e64fc7f0000
  Device Node Mask                                0
  Device Numeric Version                          0xc00000 (3.0.0)
  Driver Version                                  26.18.38308.4
</pre>
</pre>


== llama.cpp from binary ==
Display device details.


<syntaxhighlight lang="bash">
<syntaxhighlight lang="bash">
# download binary
# Check card detail (sudo is required)
mkdir -p ~/llama.cpp/downloads
sudo lspci -vvv -s 05:00.0
wget -P ~/llama.cpp/downloads https://github.com/ggml-org/llama.cpp/releases/download/b9730/llama-b9730-bin-ubuntu-openvino-2026.2-x64.tar.gz
wget -P ~/llama.cpp/downloads https://github.com/ggml-org/llama.cpp/releases/download/b9730/llama-b9730-bin-ubuntu-sycl-fp16-x64.tar.gz


# extract
# Check linux device & owner/group
mkdir -p ~/llama.cpp/9730/openvino
ls -l /dev/dri
tar -C ~/llama.cpp/9730/openvino --strip-components=1 -zxvf ~/llama.cpp/downloads/llama-b9730-bin-ubuntu-openvino-2026.2-x64.tar.gz "llama-b9730/"
mkdir -p ~/llama.cpp/9730/sycl
tar -C ~/llama.cpp/9730/sycl --strip-components=1 -zxvf ~/llama.cpp/downloads/llama-b9730-bin-ubuntu-sycl-fp16-x64.tar.gz "llama-b9730/"
 
# download model
sudo apt install -y python3 python3-venv
python3 -m venv ~/llama.cpp/llama-venv
source ~/llama.cpp/llama-venv/bin/activate
pip install -U "huggingface_hub[cli]"
hf auth login
hf download OpenVINO/gpt-oss-20b-int4-ov
ls -l ~/.cache/huggingface/hub/
</syntaxhighlight>
</syntaxhighlight>


OpenVINO
== Install PPA drivers ==
 
<syntaxhighlight lang="bash">
wget https://apt.repos.intel.com/intel-gpg-keys/GPG-PUB-KEY-INTEL-SW-PRODUCTS.PUB
sudo gpg --output /etc/apt/trusted.gpg.d/intel.gpg --dearmor GPG-PUB-KEY-INTEL-SW-PRODUCTS.PUB
echo "deb https://apt.repos.intel.com/openvino ubuntu24 main" | sudo tee /etc/apt/sources.list.d/intel-openvino.list
sudo apt update
sudo apt install openvino-2026.2.0
</syntaxhighlight>
 
<pre>
libopenvino-2026.2.1/ubuntu24,now 2026.2.1.21919 amd64 [已安裝，自動]
libopenvino-auto-batch-plugin-2026.2.1/ubuntu24,now 2026.2.1.21919 amd64 [已安裝，自動]
libopenvino-auto-plugin-2026.2.1/ubuntu24,now 2026.2.1.21919 amd64 [已安裝，自動]
libopenvino-dev-2026.2.1/ubuntu24,now 2026.2.1.21919 amd64 [已安裝，自動]
libopenvino-hetero-plugin-2026.2.1/ubuntu24,now 2026.2.1.21919 amd64 [已安裝，自動]
libopenvino-intel-cpu-plugin-2026.2.1/ubuntu24,now 2026.2.1.21919 amd64 [已安裝，自動]
libopenvino-intel-gpu-plugin-2026.2.1/ubuntu24,now 2026.2.1.21919 amd64 [已安裝，自動]
libopenvino-intel-npu-plugin-2026.2.1/ubuntu24,now 2026.2.1.21919 amd64 [已安裝，自動]
libopenvino-ir-frontend-2026.2.1/ubuntu24,now 2026.2.1.21919 amd64 [已安裝，自動]
libopenvino-onnx-frontend-2026.2.1/ubuntu24,now 2026.2.1.21919 amd64 [已安裝，自動]
libopenvino-paddle-frontend-2026.2.1/ubuntu24,now 2026.2.1.21919 amd64 [已安裝，自動]
libopenvino-pytorch-frontend-2026.2.1/ubuntu24,now 2026.2.1.21919 amd64 [已安裝，自動]
libopenvino-tensorflow-frontend-2026.2.1/ubuntu24,now 2026.2.1.21919 amd64 [已安裝，自動]
libopenvino-tensorflow-lite-frontend-2026.2.1/ubuntu24,now 2026.2.1.21919 amd64 [已安裝，自動]
openvino-2026.2.1/ubuntu24,now 2026.2.1.21919 all [已安裝，自動]
openvino-libraries-2026.2.1/ubuntu24,now 2026.2.1.21919 all [已安裝，自動]
openvino-libraries-dev-2026.2.1/ubuntu24,now 2026.2.1.21919 all [已安裝，自動]
openvino-samples-2026.2.1/ubuntu24,now 2026.2.1.21919 all [已安裝，自動]
openvino-samples-python-2026.2.1/ubuntu24,now 2026.2.1.21919 all [已安裝，自動]
openvino/ubuntu24,now 2026.2.1.21919 all [已安裝]
python3-openvino-2026.2.1/ubuntu24,now 2026.2.1.21919 amd64 [已安裝，自動]
</pre>
 
== llama.cpp ==
 
=== error message ===
 
==== error while loading shared libraries: libopenvino.so.2620 ====
 
<syntaxhighlight lang="bash">
# check openvino version
dpkg -l | grep libopenvino
 
# install the matched version
sudo apt autoremove openvino
sudo apt install openvino-2026.2.0
</syntaxhighlight>
 
==== error while loading shared libraries: libsvml.so ====
 
 
<syntaxhighlight lang="bash">
sudo apt install intel-oneapi-compiler-dpcpp-cpp-runtime intel-oneapi-mkl
source /opt/intel/oneapi/setvars.sh
</syntaxhighlight>


==== error while loading shared libraries: libdnnl.so.3 ====
= Diary =


DNN
* Install drivers, openvino, oneapi, llama.cpp. [[LLM/Intel Pro Arc B70/2026-06-18]]
* Compile llama.cpp. [[LLM/Intel Pro Arc B70/2026-06-20]]
* 9600X + B650 + B70 on Ubuntu 26.04. [[LLM/Intel Pro Arc B70/2026-07-12]]
* 9600X + B650 + B70 on Ubuntu 24.04. [[LLM/Intel Pro Arc B70/2026-07-13]]

Latest revision as of 16:02, 12 July 2026

Install drivers

Check proper Ubuntu version

Check device connection

# Check eGPU connection (for eGPU only)
boltctl list

# Check hardware dectection
sudo dmesg | grep -i 'xe '

# Check pci devices
lspci | grep -i 'vga\|display'

Found B70 at PCI node 05:00.0

Intel Corporation Device e223 is Intel Pro Arc B70. 

05:00.0 VGA compatible controller: Intel Corporation Device e223
66:00.0 Display controller: Advanced Micro Devices, Inc. [AMD/ATI] Device 1114 (rev c2)

Display device details. 

# Check card detail (sudo is required)
sudo lspci -vvv -s 05:00.0

# Check linux device & owner/group
ls -l /dev/dri

Install PPA drivers

Diary

Retrieved from "https://wiki.fundamental-ramen.com/index.php?title=LLM/Intel_Pro_Arc_B70&oldid=2424"