LM/PCIe Trouble Shooting

List all GPUs

lspci | grep 'VGA'

List PCIe tree for CPU & chipset

sudo lspci -PPvv | grep -E '^0|LnkCap:|LnkSta:'

00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Raphael/Granite Ridge Dummy Host Bridge                                              15:41 [62/9069]
00:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Raphael/Granite Ridge Dummy Host Bridge
00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Raphael/Granite Ridge Dummy Host Bridge
00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Raphael/Granite Ridge Internal GPP Bridge to Bus [C:A] (prog-if 00 [Normal decode])
                LnkCap: Port #0, Speed 16GT/s, Width x16, ASPM L0s L1, Exit Latency L0s <64ns, L1 <1us
                LnkSta: Speed 16GT/s, Width x16
00:08.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Raphael/Granite Ridge Internal GPP Bridge to Bus [C:A] (prog-if 00 [Normal decode])
                LnkCap: Port #0, Speed 16GT/s, Width x16, ASPM L0s L1, Exit Latency L0s <64ns, L1 <1us
                LnkSta: Speed 16GT/s, Width x16
00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 71)
00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51)
00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Raphael/Granite Ridge Data Fabric; Function 0
00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Raphael/Granite Ridge Data Fabric; Function 1
00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Raphael/Granite Ridge Data Fabric; Function 2
00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Raphael/Granite Ridge Data Fabric; Function 3
00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Raphael/Granite Ridge Data Fabric; Function 4
00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Raphael/Granite Ridge Data Fabric; Function 5
00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Raphael/Granite Ridge Data Fabric; Function 6
00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Raphael/Granite Ridge Data Fabric; Function 7
00:01.1/01:00.0 PCI bridge: Intel Corporation Device e2ff (rev 01) (prog-if 00 [Normal decode])
                LnkCap: Port #0, Speed 16GT/s, Width x16, ASPM L1, Exit Latency L1 <32us
                LnkSta: Speed 16GT/s, Width x8 (downgraded)
00:01.1/01:00.0/02:01.0 PCI bridge: Intel Corporation Device e2f0 (prog-if 00 [Normal decode])
                LnkCap: Port #8, Speed 2.5GT/s, Width x1, ASPM L1, Exit Latency L1 <1us
                LnkSta: Speed 2.5GT/s, Width x1
00:01.1/01:00.0/02:02.0 PCI bridge: Intel Corporation Device e2f1 (prog-if 00 [Normal decode])
                LnkCap: Port #8, Speed 2.5GT/s, Width x1, ASPM L1, Exit Latency L1 <1us
                LnkSta: Speed 2.5GT/s, Width x1
00:01.1/01:00.0/02:01.0/03:00.0 VGA compatible controller: Intel Corporation Battlemage G31 [Intel Graphics] (prog-if 00 [VGA controller])
                LnkCap: Port #0, Speed 2.5GT/s, Width x1, ASPM L0s L1, Exit Latency L0s <64ns, L1 <1us
                LnkSta: Speed 2.5GT/s, Width x1
00:01.1/01:00.0/02:02.0/04:00.0 Audio device: Intel Corporation Device e2f7 (prog-if 00 [HDA compatible])
                LnkCap: Port #0, Speed 2.5GT/s, Width x1, ASPM L0s L1, Exit Latency L0s <64ns, L1 <1us
                LnkSta: Speed 2.5GT/s, Width x1

lspci -tv | sed '/+-03\.0/,$d'

-[0000:00]-+-00.0  Advanced Micro Devices, Inc. [AMD] Raphael/Granite Ridge Root Complex
           +-00.2  Advanced Micro Devices, Inc. [AMD] Raphael/Granite Ridge IOMMU
           +-01.0  Advanced Micro Devices, Inc. [AMD] Raphael/Granite Ridge Dummy Host Bridge
           +-01.1-[01-04]----00.0-[02-04]--+-01.0-[03]----00.0  Intel Corporation Battlemage G31 [Intel Graphics]
           |                               \-02.0-[04]----00.0  Intel Corporation Device e2f7
           +-01.2-[05]----00.0  Kingston Technology Company, Inc. KC2000/KC2500 NVMe SSD [SM2262EN]
           +-01.3-[06]--+-00.0  NVIDIA Corporation GA106 [GeForce RTX 3060 Lite Hash Rate]
           |            \-00.1  NVIDIA Corporation GA106 High Definition Audio Controller
           +-02.0  Advanced Micro Devices, Inc. [AMD] Raphael/Granite Ridge Dummy Host Bridge
           +-02.1-[07-0e]----00.0-[08-0e]--+-00.0-[09]--
           |                               +-08.0-[0a]----00.0  Realtek Semiconductor Co., Ltd. RTL8126 5GbE Controller
           |                               +-09.0-[0b]----00.0  Intel Corporation Wi-Fi 6E(802.11ax) AX210/AX1675* 2x2 [Typhoon Peak]
           |                               +-0a.0-[0c]----00.0  Realtek Semiconductor Co., Ltd. RTL8126 5GbE Controller
           |                               +-0c.0-[0d]----00.0  Advanced Micro Devices, Inc. [AMD] 800 Series Chipset USB 3.x XHCI Controller
           |                               \-0d.0-[0e]----00.0  Advanced Micro Devices, Inc. [AMD] 600 Series Chipset SATA Controller

Verify link speed & width

sudo lspci -vvv -s 03:00 | grep 'Lnk'

cat /sys/bus/pci/devices/0000:03:00.0/current_link_width
cat /sys/bus/pci/devices/0000:03:00.0/current_link_speed

cat /sys/bus/pci/devices/0000:03:00.0/max_link_width
cat /sys/bus/pci/devices/0000:03:00.0/max_link_speed

Intel only

xpu-smi discovery

  Device ID     Device Information
  0             Device Name: Intel(R) Arc(TM) Pro B70 Graphics
                Device State: normal
                Vendor Name: Intel(R) Corporation
                SOC UUID: 00000000-0000-0003-0000-0000e2238086
                PCI BDF Address: 0000:03:00.0
                DRM Device: /dev/dri/card0
                Function Type: physical

xpu-smi config --device 0

  Device Type     Device ID/Tile ID     Configuration
  GPU             0                      Power domain card:
                                          sustain(w): N/A
                                          burst(w): 230
                                          peak(w): 460
                                         Power domain package:
                                          sustain(w): N/A
                                          burst(w): N/A
                                          peak(w): N/A

                                         Memory ECC:
                                          Current: disabled
                                          Pending: disabled

                                         PCIe Gen4 Downgrade:
                                          Current: N/A

                                         Fan (Mode / Speed %):
                                          Fan 0: N/A / 0%

  GPU             0/0                    GPU Min Frequency (MHz): 400
                                         GPU Max Frequency (MHz): 2800
                                          Valid Options: 400, 450, 500, 550, 600, 650, ...
                                            850, 900, 950, 1000, 1050, 1100, 1150, 1200...
                                            1350, 1400, 1450, 1500, 1550, 1600, 1650, 1...
                                            1800, 1850, 1900, 1950, 2000, 2050, 2100, 2...
                                            2250, 2300, 2350, 2400, 2450, 2500, 2550, 2...
                                            2700, 2750, 2800

                                         Standby Mode: N/A
                                          Valid Options: default, never

                                         Scheduler Mode: timeslice
                                          Timeout (us): N/A
                                          Interval (us): 1000
                                          Yield Timeout (us): 640000
$ xpu-smi health --device 0
[Error] Failed to get core temperature: 0x78000003 (ZE_RESULT_ERROR_UNSUPPORTED_FEATURE)
[Error] Health check failed for device id: 0

  Component     Value
  Device ID     0