[HW Accel Support]: Orange pi 5B

[carlhung]

Describe the problem you are having

When I view the system page, it shows Hardware acceleration has not been setup, see the docs to setup hardware acceleration.
When clicking "VAINFO", It shows the error:

{"return_code":3,"stderr":"error:XDG_RUNTIME_DIRnotsetintheenvironment.nerror:can'tconnecttoXserver!nlibvainfo:VA-APIversion1.10.0nlibvaerror:vaGetDriverNameByIndex()failedwithunknownlibvaerror,driver_name=(null)nvaInitializefailedwitherrorcode-1(unknownlibvaerror),exit","stdout":""}

My orange pi 5B is running on:
Distributor ID: Debian
Description: Armbian 24.2.1 bookworm
Release: 12
Codename: bookworm

The kernel is:
5.10.160-legacy-rk35xx

Version

0.13.2-6476F8A

Frigate config file

mqtt:
  enabled: False

detectors:
  rknn:
    type: rknn
    core_mask: 0b111

model:
  path: default-yolov8x
  width: 320
  height: 320
  input_pixel_format: bgr
  input_tensor: nhwc

cameras:
  Front_Door: 
    enabled: True
    ffmpeg:
      inputs:
        - path: rtsp://frontdoor:[email protected]:554/live/ch0
          roles:
            - detect
      hwaccel_args: preset-rk-h265
    detect:
      enabled: True

docker-compose file or Docker CLI command

version: "3.9"
services:
  frigate:
    container_name: frigate
    privileged: true
    restart: unless-stopped
    image: ghcr.io/blakeblackshear/frigate:stable-rk
    shm_size: "512mb" 

    volumes:
      - /etc/localtime:/etc/localtime:ro
      - $HOME/externalDisk/frigate/config:/config
      - $HOME/externalDisk/frigate/storage:/media/frigate
      - type: tmpfs
        target: /tmp/cache
        tmpfs:
          size: 1000000000
    ports:
      - "5000:5000"
      - "8554:8554"
      - "8555:8555/tcp"
      - "8555:8555/udp"
    environment:
      FRIGATE_RTSP_PASSWORD: "xxxxxxx"

Relevant log output

2024-03-16 23:37:38.882303861  [INFO] Preparing Frigate...
2024-03-16 23:37:38.908582043  [INFO] Starting Frigate...
2024-03-16 23:37:40.432923943  [2024-03-16 23:37:40] frigate.app                    INFO    : Starting Frigate (0.13.2-6476f8a)
2024-03-16 23:37:42.193102446  [2024-03-16 23:37:42] peewee_migrate.logs            INFO    : Starting migrations
2024-03-16 23:37:42.203077585  [2024-03-16 23:37:42] peewee_migrate.logs            INFO    : There is nothing to migrate
2024-03-16 23:37:42.208552668  [2024-03-16 23:37:42] frigate.app                    INFO    : Recording process started: 460
2024-03-16 23:37:42.211427874  [2024-03-16 23:37:42] frigate.app                    INFO    : go2rtc process pid: 91
2024-03-16 23:37:42.235231886  [2024-03-16 23:37:42] detector.rknn                  INFO    : Starting detection process: 468
2024-03-16 23:37:42.238371629  [2024-03-16 23:37:42] frigate.app                    INFO    : Output process started: 470
2024-03-16 23:37:42.248680722  [2024-03-16 23:37:42] frigate.app                    INFO    : Camera processor started for Front_Door: 475
2024-03-16 23:37:42.254415967  [2024-03-16 23:37:42] frigate.app                    INFO    : Capture process started for Front_Door: 476
2024-03-16 23:37:42.582761988  I RKNN: [23:37:42.582] RKNN Runtime Information: librknnrt version: 1.5.2 (c6b7b351a@2023-08-23T15:28:22)
2024-03-16 23:37:42.582791446  I RKNN: [23:37:42.582] RKNN Driver Information: version: 0.9.2
2024-03-16 23:37:42.583231856  I RKNN: [23:37:42.583] RKNN Model Information: version: 6, toolkit version: 1.5.2+b642f30c(compiler version: 1.5.2 (c6b7b351a@2023-08-23T07:39:01)), target: RKNPU v2, target platform: rk3588, framework name: ONNX, framework layout: NCHW, model inference type: static_shape
2024-03-16 23:39:52.224630647  [2024-03-16 23:39:52] frigate.video                  ERROR   : Front_Door: Unable to read frames from ffmpeg process.
2024-03-16 23:39:52.225088849  [2024-03-16 23:39:52] frigate.video                  ERROR   : Front_Door: ffmpeg process is not running. exiting capture thread...
2024-03-16 23:39:52.305896780  [2024-03-16 23:39:52] watchdog.Front_Door            ERROR   : Ffmpeg process crashed unexpectedly for Front_Door.
2024-03-16 23:39:52.318967330  [2024-03-16 23:39:52] watchdog.Front_Door            ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-03-16 23:39:52.318979871  [2024-03-16 23:39:52] ffmpeg.Front_Door.detect       ERROR   : Error demuxing input file 0: Connection timed out
2024-03-16 23:39:52.318983955  [2024-03-16 23:39:52] ffmpeg.Front_Door.detect       ERROR   : rtsp://*:*@192.168.1.17:554/live/ch0: Connection timed out
2024-03-16 23:39:52.319024496  [2024-03-16 23:39:52] ffmpeg.Front_Door.detect       ERROR   :     Last message repeated 9 times
2024-03-16 23:49:57.636091499  [2024-03-16 23:49:57] frigate.video                  ERROR   : Front_Door: Unable to read frames from ffmpeg process.
2024-03-16 23:49:57.636752697  [2024-03-16 23:49:57] frigate.video                  ERROR   : Front_Door: ffmpeg process is not running. exiting capture thread...
2024-03-16 23:50:02.382703464  [2024-03-16 23:50:02] watchdog.Front_Door            ERROR   : Ffmpeg process crashed unexpectedly for Front_Door.
2024-03-16 23:50:02.383182373  [2024-03-16 23:50:02] watchdog.Front_Door            ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-03-16 23:50:02.383572326  [2024-03-16 23:50:02] ffmpeg.Front_Door.detect       ERROR   : Error demuxing input file 0: Connection timed out
2024-03-16 23:50:02.383942153  [2024-03-16 23:50:02] ffmpeg.Front_Door.detect       ERROR   : rtsp://*:*@192.168.1.17:554/live/ch0: Connection timed out
2024-03-16 23:50:02.384340856  [2024-03-16 23:50:02] ffmpeg.Front_Door.detect       ERROR   :     Last message repeated 11 times

FFprobe output from your camera

ffprobe rtsp://frontdoor:[email protected]:554/live/ch0
ffprobe version 5.1.4-0+deb12u1 Copyright (c) 2007-2023 the FFmpeg developers
  built with gcc 12 (Debian 12.2.0-14)
  configuration: --prefix=/usr --extra-version=0+deb12u1 --toolchain=hardened --libdir=/usr/lib/aarch64-linux-gnu --incdir=/usr/include/aarch64-linux-gnu --arch=arm64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libglslang --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librist --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libsvtav1 --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --disable-sndio --enable-libjxl --enable-pocketsphinx --enable-librsvg --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-libplacebo --enable-librav1e --enable-shared
  libavutil      57. 28.100 / 57. 28.100
  libavcodec     59. 37.100 / 59. 37.100
  libavformat    59. 27.100 / 59. 27.100
  libavdevice    59.  7.100 / 59.  7.100
  libavfilter     8. 44.100 /  8. 44.100
  libswscale      6.  7.100 /  6.  7.100
  libswresample   4.  7.100 /  4.  7.100
  libpostproc    56.  6.100 / 56.  6.100
Input #0, rtsp, from 'rtsp://frontdoor:[email protected]:554/live/ch0':
  Metadata:
    title           : streamed by RTSP server
  Duration: N/A, start: 0.000000, bitrate: N/A
  Stream #0:0: Video: hevc (Main), yuv420p(tv, bt709), 2304x1296, 15 fps, 15 tbr, 90k tbn
  Stream #0:1: Audio: pcm_alaw, 8000 Hz, mono, s16, 64 kb/s

Operating system

Debian

Install method

Docker Compose

Network connection

Wired

Camera make and model

Septekon

Any other information that may be helpful

No response

[NickM-27]

To be clear it doesn't say it's not using hwaccel. It says it is either not using hwaccel or hwaccel stats are not supported. In your case rknn hwaccel does not support stats. vainfo also does not apply here.

[carlhung]

sorry I just updated. when clicking the "system", scroll to "GPU". it shows "Hardware acceleration has not been setup, see the docs to setup hardware acceleration."

[carlhung]

you can see my config.yml has set :

ffmpeg:
  hwaccel_args: preset-rk-h265

[NickM-27]

This is likely just a ui bug

[carlhung]

sorry, I just updated the log. part of the log:

 [2024-03-16 23:39:52] ffmpeg.Front_Door.detect       ERROR   : Error demuxing input file 0: Connection timed out
2024-03-16 23:39:52.318983955  [2024-03-16 23:39:52] ffmpeg.Front_Door.detect       ERROR   : rtsp://*:*@192.168.1.17:554/live/ch0: Connection timed out
2024-03-16 23:39:52.319024496  [2024-03-16 23:39:52] ffmpeg.Front_Door.detect       ERROR   :     Last message repeated 9 times
2024-03-16 23:49:57.636091499  [2024-03-16 23:49:57] frigate.video                  ERROR   : Front_Door: Unable to read frames from ffmpeg process.
2024-03-16 23:49:57.636752697  [2024-03-16 23:49:57] frigate.video                  ERROR   : Front_Door: ffmpeg process is not running. exiting capture thread...
2024-03-16 23:50:02.382703464  [2024-03-16 23:50:02] watchdog.Front_Door            ERROR   : Ffmpeg process crashed unexpectedly for Front_Door.
2024-03-16 23:50:02.383182373  [2024-03-16 23:50:02] watchdog.Front_Door            ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-03-16 23:50:02.383572326  [2024-03-16 23:50:02] ffmpeg.Front_Door.detect       ERROR   : Error demuxing input file 0: Connection timed out
2024-03-16 23:50:02.383942153  [2024-03-16 23:50:02] ffmpeg.Front_Door.detect       ERROR   : rtsp://*:*@192.168.1.17:554/live/ch0: Connection timed out
2024-03-16 23:50:02.384340856  [2024-03-16 23:50:02] ffmpeg.Front_Door.detect       ERROR   :     Last message repeated 11 times

[Vladd1980]

Unfortunately, I have an absolutely similar situation. I also use orange pi5, my configuration file is practically no different from the one above and the errors are the same...

2024-03-20 18:08:02.072219355  [2024-03-20 18:08:02] watchdog.Fasad3                INFO    : No frames received from Fasad3 in 20 seconds. Exiting ffmpeg...
2024-03-20 18:08:02.073134000  [2024-03-20 18:08:02] watchdog.Fasad3                INFO    : Waiting for ffmpeg to exit gracefully...
2024-03-20 18:08:32.431674469  [2024-03-20 18:08:32] frigate.video                  ERROR   : Fasad3: Unable to read frames from ffmpeg process.
2024-03-20 18:08:32.432318454  [2024-03-20 18:08:32] watchdog.Fasad3                INFO    : FFmpeg did not exit. Force killing...
2024-03-20 18:08:32.432524366  [2024-03-20 18:08:32] frigate.video                  ERROR   : Fasad3: ffmpeg process is not running. exiting capture thread...
2024-03-20 18:08:43.516761769  [2024-03-20 18:08:43] watchdog.Fasad3                ERROR   : Ffmpeg process crashed unexpectedly for Fasad3.
2024-03-20 18:08:43.516766727  [2024-03-20 18:08:43] watchdog.Fasad3                ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-03-20 18:08:43.516769644  [2024-03-20 18:08:43] ffmpeg.Fasad3.detect           ERROR   : [segment @ 0xaaaaf0a65340] Timestamps are unset in a packet for stream 0. This is deprecated and will stop working in the future. Fix your code to set the timestamps properly
2024-03-20 18:08:43.516772560  [2024-03-20 18:08:43] ffmpeg.Fasad3.detect           ERROR   : [segment @ 0xaaaaf0a65340] Non-monotonous DTS in output stream 0:0; previous: 0, current: 0; changing to 1. This may result in incorrect timestamps in the output file.
2024-03-20 18:08:43.517410421  [2024-03-20 18:08:43] ffmpeg.Fasad3.detect           ERROR   : [segment @ 0xaaaaf0a65340] Non-monotonous DTS in output stream 0:0; previous: 94208, current: 94208; changing to 94209. This may result in incorrect timestamps in the output file.
2024-03-20 18:08:43.517879993  [2024-03-20 18:08:43] ffmpeg.Fasad3.detect           ERROR   : [segment @ 0xaaaaf0a65340] Non-monotonous DTS in output stream 0:0; previous: 299008, current: 299008; changing to 299009. This may result in incorrect timestamps in the output file.
2024-03-20 18:08:43.517885243  [2024-03-20 18:08:43] ffmpeg.Fasad3.detect           ERROR   : [segment @ 0xaaaaf0a65340] Non-monotonous DTS in output stream 0:0; previous: 401408, current: 401408; changing to 401409. This may result in incorrect timestamps in the output file.
2024-03-20 18:08:43.517887576  [2024-03-20 18:08:43] ffmpeg.Fasad3.detect           ERROR   : [segment @ 0xaaaaf0a65340] Non-monotonous DTS in output stream 0:0; previous: 503808, current: 503808; changing to 503809. This may result in incorrect timestamps in the output file.
2024-03-20 18:08:43.517890201  [2024-03-20 18:08:43] ffmpeg.Fasad3.detect           ERROR   : [segment @ 0xaaaaf0a65340] Non-monotonous DTS in output stream 0:0; previous: 1015808, current: 1015808; changing to 1015809. This may result in incorrect timestamps in the output file.
2024-03-20 18:08:43.518320983  [2024-03-20 18:08:43] ffmpeg.Fasad3.detect           ERROR   : [segment @ 0xaaaaf0a65340] Non-monotonous DTS in output stream 0:0; previous: 1425408, current: 1425408; changing to 1425409. This may result in incorrect timestamps in the output file.