[HW Accel Support]: Trying to understand what's possible with the hardware I have

[Liam-Whiteside]

Describe the problem you are having

I've managed to get Frigate 0.14.1 running (after changing detectors: ov: device: to CPU rather than AUTO) however I'm struggling with lots of documentation that appears to be referencing older versions when trying to optimise performance.

I'm running on a Dell OptiPlex 7050 which has a Radeon HD 8570 card plus intel graphics on the motherboard

00:02.0 Display controller [0380]: Intel Corporation HD Graphics 530 [8086:1912] (rev 06)
01:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Oland [Radeon HD 8570 / R5 430 OEM / R7 240/340 / Radeon 520 OEM] [1002:6611] (rev 87) (prog-if 00 [VGA controller])

Ubuntu 22.04 (desktop) with HA running as a supervised installation in docker and Frigate (full access) as an add-on. 3 x Reolink cameras (the garage camera is an E1 Pro on wifi that seems to generate quite a few stream errors)

Is it possible to use the resource of either GPU, for decoding or detection while still allowing Wayland to run?

Version

0.14.1

Frigate config file

#environment_vars:
#  LIBVA_DRIVER_NAME: iHD
#  LIBVA_DRIVER_NAME: i965

mqtt:
  enabled: true
  host: xxxx
  user: xxxx
  password: xxxx

detectors:
  ov:
    type: openvino
    device: CPU
    model:
      path: /openvino-model/ssdlite_mobilenet_v2.xml

model:
  width: 300
  height: 300
  input_tensor: nhwc
  input_pixel_format: bgr
  path: /openvino-model/ssdlite_mobilenet_v2.xml
  labelmap_path: /openvino-model/coco_91cl_bkgr.txt

ffmpeg:
#  hwaccel_args: preset-vaapi
  hwaccel_args: "auto"

record:
  enabled: true
  retain:
    days: 2
    mode: motion
  events:
    retain:
      default: 7
      mode: active_objects

cameras:
  drive:
    ffmpeg:
      inputs:
        - path: rtsp://viewer:[email protected]/h264Preview_01_sub
          roles:
            - detect
        - path: rtsp://viewer:[email protected]/h264Preview_01_main
          roles:
            - record
    detect:
      enabled: true
      width: 640
      height: 480
    objects:
      track:
        - person
        - dog
        - cat
        - horse
        - bicycle
        - car
        - motorcycle
    record:
      enabled: true
    snapshots:
      enabled: true

    motion:
      mask:
        - 203,480,199,449,0,449,0,480
    zones:
      drive_zone:
        coordinates: 481,145,640,328,640,436,0,436,0,199,96,145
    review:
      alerts:
        required_zones: drive_zone
      detections:
        required_zones: drive_zone

  garage:
    ffmpeg:
      inputs:
        - path: rtsp://viewer:[email protected]/h264Preview_01_sub
          roles:
            - detect
    detect:
      enabled: true
      width: 640
      height: 360
    record:
      enabled: true
    snapshots:
      enabled: true
    motion:
      mask:
        - 0,360,208,360,206,333,0,333

  garden180:
    ffmpeg:
      inputs:
        - path: rtsp://viewer:[email protected]/h264Preview_01_sub
          roles:
            - detect
    detect:
      enabled: false
      width: 1536
      height: 576
    record:
      enabled: false
    snapshots:
      enabled: false
    motion:
      mask:
        - 0,576,382,576,379,537,0,534

objects:
  track:
    - person

version: 0.14

docker-compose file or Docker CLI command

Default as set by HA Add-on

Relevant Frigate log output

2024-11-02 17:40:52.551639892  [INFO] Preparing Frigate...
2024-11-02 17:40:52.617840966  [INFO] Starting Frigate...
2024-11-02 17:40:56.009193689  [2024-11-02 17:40:56] frigate.app                    INFO    : Starting Frigate (0.14.1-f4f3cfa)
2024-11-02 17:40:56.009268831  [2024-11-02 17:40:56] frigate.app                    INFO    : Creating directory: /tmp/cache
2024-11-02 17:40:56.009316388  [2024-11-02 17:40:56] frigate.util.config            INFO    : Checking if frigate config needs migration...
2024-11-02 17:40:56.041441508  [2024-11-02 17:40:56] frigate.util.config            INFO    : frigate config does not need migration...
2024-11-02 17:40:56.082345665  [2024-11-02 17:40:56] frigate.util.services          WARNING : Did not detect hwaccel, using a GPU for accelerated video decoding is highly recommended
2024-11-02 17:40:56.092986176  [2024-11-02 17:40:56] frigate.config                 WARNING : Customizing more than a detector model path is unsupported.
2024-11-02 17:40:56.113803912  [2024-11-02 17:40:56] peewee_migrate.logs            INFO    : Starting migrations
2024-11-02 17:40:56.114511286  [2024-11-02 17:40:56] peewee_migrate.logs            INFO    : There is nothing to migrate
2024-11-02 17:40:56.133470522  [2024-11-02 17:40:56] frigate.app                    INFO    : Recording process started: 354
2024-11-02 17:40:56.138018374  [2024-11-02 17:40:56] frigate.app                    INFO    : Recording process started: 356
2024-11-02 17:40:56.141801374  [2024-11-02 17:40:56] frigate.app                    INFO    : go2rtc process pid: 98
2024-11-02 17:40:56.171473264  [2024-11-02 17:40:56] frigate.app                    INFO    : Output process started: 385
2024-11-02 17:40:56.174768171  [2024-11-02 17:40:56] detector.ov                    INFO    : Starting detection process: 383
2024-11-02 17:40:56.762052959  [2024-11-02 17:40:56] frigate.app                    INFO    : Camera processor started for drive: 429
2024-11-02 17:40:56.763818898  [2024-11-02 17:40:56] frigate.app                    INFO    : Camera processor started for garage: 430
2024-11-02 17:40:56.769574175  [2024-11-02 17:40:56] frigate.app                    INFO    : Camera processor started for garden180: 435
2024-11-02 17:40:56.781777475  [2024-11-02 17:40:56] frigate.app                    INFO    : Capture process started for drive: 445
2024-11-02 17:40:56.787721246  [2024-11-02 17:40:56] frigate.app                    INFO    : Capture process started for garage: 451
2024-11-02 17:40:56.789077213  [2024-11-02 17:40:56] frigate.app                    INFO    : Capture process started for garden180: 460
2024-11-02 17:41:46.808925992  [2024-11-02 17:41:46] watchdog.garage                INFO    : No frames received from garage in 20 seconds. Exiting ffmpeg...
2024-11-02 17:41:46.809138973  [2024-11-02 17:41:46] watchdog.garage                INFO    : Waiting for ffmpeg to exit gracefully...
2024-11-02 17:41:57.165014187  [2024-11-02 17:41:57] frigate.video                  ERROR   : garage: Unable to read frames from ffmpeg process.
2024-11-02 17:41:57.166067151  [2024-11-02 17:41:57] frigate.video                  ERROR   : garage: ffmpeg process is not running. exiting capture thread...
2024-11-02 17:42:07.164867729  [2024-11-02 17:42:07] watchdog.garage                ERROR   : Ffmpeg process crashed unexpectedly for garage.
2024-11-02 17:42:07.164962285  [2024-11-02 17:42:07] watchdog.garage                ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-11-02 17:42:07.165056752  [2024-11-02 17:42:07] ffmpeg.garage.detect           ERROR   : [rtsp @ 0x5595f1523100] DTS discontinuity in stream 1: packet 3 with DTS 27689108159747, packet 4 with DTS 27689108164144
2024-11-02 17:42:07.165211793  [2024-11-02 17:42:07] ffmpeg.garage.detect           ERROR   : [segment @ 0x5595f153f6c0] Timestamps are unset in a packet for stream 0. This is deprecated and will stop working in the future. Fix your code to set the timestamps properly
2024-11-02 17:42:07.165232399  [2024-11-02 17:42:07] ffmpeg.garage.detect           ERROR   : [NULL @ 0x5595f1528680] missing picture in access unit with size 21
2024-11-02 17:42:07.165318825  [2024-11-02 17:42:07] ffmpeg.garage.detect           ERROR   : [h264 @ 0x5595f1580980] no frame!
2024-11-02 17:42:07.165434138  [2024-11-02 17:42:07] ffmpeg.garage.detect           ERROR   : rtsp://*:*@10.161.6.44/h264Preview_01_sub: Connection timed out
2024-11-02 17:42:07.165469798  [2024-11-02 17:42:07] ffmpeg.garage.detect           ERROR   : Error while decoding stream #0:0: Invalid data found when processing input
2024-11-02 17:42:41.256282459  [h264 @ 0x789b64009b00] error while decoding MB 16 5, bytestream -9
2024-11-02 17:42:46.253594845  [h264 @ 0x789b64017780] left block unavailable for requested intra mode
2024-11-02 17:42:46.253597689  [h264 @ 0x789b64017780] error while decoding MB 0 14, bytestream 31420
2024-11-02 17:42:46.257610841  [h264 @ 0x789b64114900] cabac decode of qscale diff failed at 24 14
2024-11-02 17:42:46.257613598  [h264 @ 0x789b64114900] error while decoding MB 24 14, bytestream 20980

Relevant go2rtc log output

Not configured. Should I be using it?

FFprobe output from your camera

n/a

Install method

HassOS Addon

Object Detector

OpenVino

Network connection

Wired

Camera make and model

Reolink RLC-410-5PM, E1 Pro, Duo 2 PoE

Screenshots of the Frigate UI's System metrics pages

Any other information that may be helpful

lspci -nnk
00:00.0 Host bridge [0600]: Intel Corporation Xeon E3-1200 v5/E3-1500 v5/6th Gen Core Processor Host Bridge/DRAM Registers [8086:191f] (rev 07)
Subsystem: Dell Xeon E3-1200 v5/E3-1500 v5/6th Gen Core Processor Host Bridge/DRAM Registers [1028:07a1]
Kernel driver in use: skl_uncore
Kernel modules: ie31200_edac
00:01.0 PCI bridge [0604]: Intel Corporation 6th-10th Gen Core Processor PCIe Controller (x16) [8086:1901] (rev 07)
Kernel driver in use: pcieport
00:02.0 Display controller [0380]: Intel Corporation HD Graphics 530 [8086:1912] (rev 06)
Subsystem: Dell HD Graphics 530 [1028:07a1]
Kernel modules: i915
00:14.0 USB controller [0c03]: Intel Corporation 200 Series/Z370 Chipset Family USB 3.0 xHCI Controller [8086:a2af]
Subsystem: Dell 200 Series/Z370 Chipset Family USB 3.0 xHCI Controller [1028:07a1]
Kernel driver in use: xhci_hcd
Kernel modules: xhci_pci
00:14.2 Signal processing controller [1180]: Intel Corporation 200 Series PCH Thermal Subsystem [8086:a2b1]
Subsystem: Dell 200 Series PCH Thermal Subsystem [1028:07a1]
00:15.0 Signal processing controller [1180]: Intel Corporation 200 Series PCH Serial IO I2C Controller #0 [8086:a2e0]
Subsystem: Dell 200 Series PCH Serial IO I2C Controller [1028:07a1]
Kernel driver in use: intel-lpss
Kernel modules: intel_lpss_pci
00:16.0 Communication controller [0780]: Intel Corporation 200 Series PCH CSME HECI #1 [8086:a2ba]
Subsystem: Dell 200 Series PCH CSME HECI [1028:07a1]
Kernel driver in use: mei_me
Kernel modules: mei_me
00:16.3 Serial controller [0700]: Intel Corporation Device [8086:a2bd]
Subsystem: Dell Device [1028:07a1]
Kernel driver in use: serial
00:17.0 SATA controller [0106]: Intel Corporation 200 Series PCH SATA controller [AHCI mode] [8086:a282]
Subsystem: Dell 200 Series PCH SATA controller [AHCI mode] [1028:07a1]
Kernel driver in use: ahci
Kernel modules: ahci
00:1b.0 PCI bridge [0604]: Intel Corporation 200 Series PCH PCI Express Root Port #17 [8086:a2e7] (rev f0)
DeviceName: Intel HD Audio
Kernel driver in use: pcieport
00:1c.0 PCI bridge [0604]: Intel Corporation 200 Series PCH PCI Express Root Port #4 [8086:a293] (rev f0)
Kernel driver in use: pcieport
00:1c.6 PCI bridge [0604]: Intel Corporation 200 Series PCH PCI Express Root Port #7 [8086:a296] (rev f0)
Kernel driver in use: pcieport
00:1d.0 PCI bridge [0604]: Intel Corporation 200 Series PCH PCI Express Root Port #9 [8086:a298] (rev f0)
Kernel driver in use: pcieport
00:1f.0 ISA bridge [0601]: Intel Corporation 200 Series PCH LPC Controller (Q270) [8086:a2c6]
Subsystem: Dell 200 Series PCH LPC Controller (Q270) [1028:07a1]
00:1f.2 Memory controller [0580]: Intel Corporation 200 Series/Z370 Chipset Family Power Management Controller [8086:a2a1]
DeviceName: Onboard SATA #1
Subsystem: Dell 200 Series/Z370 Chipset Family Power Management Controller [1028:07a1]
00:1f.3 Audio device [0403]: Intel Corporation 200 Series PCH HD Audio [8086:a2f0]
Subsystem: Dell 200 Series PCH HD Audio [1028:07a1]
Kernel driver in use: snd_hda_intel
Kernel modules: snd_hda_intel, snd_soc_avs
00:1f.4 SMBus [0c05]: Intel Corporation 200 Series/Z370 Chipset Family SMBus Controller [8086:a2a3]
Subsystem: Dell 200 Series/Z370 Chipset Family SMBus Controller [1028:07a1]
Kernel driver in use: i801_smbus
Kernel modules: i2c_i801
00:1f.6 Ethernet controller [0200]: Intel Corporation Ethernet Connection (5) I219-LM [8086:15e3]
Subsystem: Dell Ethernet Connection (5) I219-LM [1028:07a1]
Kernel driver in use: e1000e
Kernel modules: e1000e
01:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Oland [Radeon HD 8570 / R5 430 OEM / R7 240/340 / Radeon 520 OEM] [1002:6611] (rev 87)
Subsystem: Dell Radeon R5 430 OEM (2048 MByte) [1028:1002]
Kernel modules: radeon, amdgpu
01:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Oland/Hainan/Cape Verde/Pitcairn HDMI Audio [Radeon HD 7000 Series] [1002:aab0]
Subsystem: Dell Oland/Hainan/Cape Verde/Pitcairn HDMI Audio [Radeon HD 7000 Series] [1028:aab0]
Kernel driver in use: snd_hda_intel
Kernel modules: snd_hda_intel
02:00.0 Non-Volatile memory controller [0108]: Toshiba Corporation Device [1179:0116]
Subsystem: Toshiba Corporation Device [1179:0001]
Kernel driver in use: nvme
Kernel modules: nvme
03:00.0 PCI bridge [0604]: Texas Instruments XIO2001 PCI Express-to-PCI Bridge [104c:8240]
05:00.0 Multimedia controller [0480]: TBS Technologies DVB Tuner PCIe Card [544d:6178]
Subsystem: Device [6902:0002]
06:00.0 Multimedia controller [0480]: TBS Technologies DVB Tuner PCIe Card [544d:6178]
Subsystem: TBS Technologies (wrong ID) TBS6205 DVB-T2/T/C Quad TV Tuner PCIe Card [6205:0001]

[NickM-27]

either GPU can be used but both can't be used at the time same.

[Liam-Whiteside]

After installing that (It removed intel-media-va-driver) I'm still getting "Did not detect hwaccel, using a GPU for accelerated video decoding is highly recommended"

If I run udo intel_gpu_top it shows
No device filter specified and no discrete/integrated i915 devices found

[NickM-27]

If I run udo intel_gpu_top it shows

where are you running that?

[Liam-Whiteside]

when SSH'ed into the Ubuntu machine

[NickM-27]

what does vainfo show when SSH'd into the machine?

[Liam-Whiteside]

Trying display: wayland
error: XDG_RUNTIME_DIR not set in the environment.
Trying display: x11
error: can't connect to X server!
Trying display: drm
libva info: VA-API version 1.20.0
libva error: vaGetDriverNames() failed with operation failed
vaInitialize failed with error code 1 (operation failed),exit