[Detector Support]: Unraid system with TensorRT #20571
-
Describe the problem you are havingI’m running an Unraid system with the Frigate container using TensorRT and an NVIDIA GTX 1060 GPU. I’m having trouble properly setting up the ONNX YOLO models — the system keeps crashing and restarting. Could you please help me find the error in my configuration? Version0.16-0 Frigate config filemqtt:
enabled: false
detectors:
nvidia:
type: onnx
num_threads: 4
model:
model_type: yolo-generic
width: 320 # <--- should match the imgsize set during model export
height: 320 # <--- should match the imgsize set during model export
input_tensor: nchw
input_dtype: float
path: /config/model_cache/yolov9-t.onnx
labelmap_path: /labelmap/coco-80.txt
go2rtc:
streams:
camera_outdoor:
- rtsp://*************@10.10.10.200:554/Streaming/Channels/101
outdoor_preview:
- rtsp://*************@10.10.10.200:554/Streaming/Channels/102
cameras:
camera_outdoor:
ffmpeg:
hwaccel_args: preset-nvidia
inputs:
- path: rtsp://127.0.0.1:8554/outdoor_preview
input_args: preset-rtsp-restream
roles:
- detect
- path: rtsp://127.0.0.1:8554/camera_outdoor
input_args: preset-rtsp-restream
roles:
- record
detect:
enabled: true
width: 320
height: 320
fps: 5
record:
enabled: true
retain:
days: 2
mode: motion
version: 0.16-0
semantic_search:
enabled: true
model_size: small
face_recognition:
enabled: true
model_size: small
lpr:
enabled: false
classification:
bird:
enabled: falsedocker-compose file or Docker CLI commandghcr.io/blakeblackshear/frigate:stable-tensorrt
extra parametres: --shm-size=256m --mount type=tmpfs,target=/tmp/cache,tmpfs-size=1000000000 --restart unless-stopped --runtime=nvidia
Nvidia Visible Devices: GPU-fead0c91-bc02-55cf-753f-9a06a0cc55aa
Nvidia Driver Capabilities: compute,utility,videoRelevant Frigate log output2025-10-20 09:33:28.623319791 [2025-10-20 09:33:28] frigate.app INFO : Starting Frigate (0.16.2-4d58206)
2025-10-20 09:33:28.631848273 [2025-10-20 09:33:28] peewee_migrate.logs INFO : Starting migrations
2025-10-20 09:33:28.633410551 [2025-10-20 09:33:28] peewee_migrate.logs INFO : There is nothing to migrate
2025-10-20 09:33:28.641728832 [2025-10-20 09:33:28] frigate.app INFO : Recording process started: 418
2025-10-20 09:33:28.646498505 [2025-10-20 09:33:28] frigate.app INFO : Review process started: 421
2025-10-20 09:33:28.649502776 [2025-10-20 09:33:28] frigate.app INFO : go2rtc process pid: 113
2025-10-20 09:33:28.661817922 [2025-10-20 09:33:28] detector.nvidia INFO : Starting detection process: 443
2025-10-20 09:33:28.663796234 2025-10-20 09:33:28.663753139 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 450, index: 0, mask: {1, 15, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:33:28.663801356 2025-10-20 09:33:28.663757387 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 451, index: 1, mask: {2, 16, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:33:28.663817651 2025-10-20 09:33:28.663795018 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 452, index: 2, mask: {3, 17, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:33:28.663897880 2025-10-20 09:33:28.663881204 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 453, index: 3, mask: {4, 18, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:33:28.666549846 2025-10-20 09:33:28.665515618 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 461, index: 7, mask: {8, 22, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:33:28.666556816 2025-10-20 09:33:28.665738121 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 458, index: 4, mask: {5, 19, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:33:28.666561751 2025-10-20 09:33:28.665781958 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 459, index: 5, mask: {6, 20, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:33:28.666583202 2025-10-20 09:33:28.665811675 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 460, index: 6, mask: {7, 21, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:33:28.666601990 2025-10-20 09:33:28.665978467 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 467, index: 12, mask: {13, 27, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:33:28.667203454 [2025-10-20 09:33:28] frigate.app INFO : Embedding process started: 446
2025-10-20 09:33:28.669665807 [2025-10-20 09:33:28] frigate.detectors.plugins.onnx INFO : ONNX: loaded onnxruntime module
2025-10-20 09:33:28.669864887 Process detector:nvidia:
2025-10-20 09:33:28.669867639 Traceback (most recent call last):
2025-10-20 09:33:28.669869395 File "/usr/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap
2025-10-20 09:33:28.669870636 self.run()
2025-10-20 09:33:28.669872223 File "/opt/frigate/frigate/util/process.py", line 41, in run_wrapper
2025-10-20 09:33:28.669873473 return run(*args, **kwargs)
2025-10-20 09:33:28.669875077 ^^^^^^^^^^^^^^^^^^^^
2025-10-20 09:33:28.669877437 File "/usr/lib/python3.11/multiprocessing/process.py", line 108, in run
2025-10-20 09:33:28.669879426 self._target(*self._args, **self._kwargs)
2025-10-20 09:33:28.669881753 File "/opt/frigate/frigate/object_detection/base.py", line 112, in run_detector
2025-10-20 09:33:28.669884245 object_detector = LocalObjectDetector(detector_config=detector_config)
2025-10-20 09:33:28.669886696 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-10-20 09:33:28.669888947 File "/opt/frigate/frigate/object_detection/base.py", line 57, in __init__
2025-10-20 09:33:28.669891051 self.detect_api = create_detector(detector_config)
2025-10-20 09:33:28.669893288 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-10-20 09:33:28.669895900 File "/opt/frigate/frigate/detectors/__init__.py", line 18, in create_detector
2025-10-20 09:33:28.669897821 return api(detector_config)
2025-10-20 09:33:28.669899812 ^^^^^^^^^^^^^^^^^^^^
2025-10-20 09:33:28.669902279 File "/opt/frigate/frigate/detectors/plugins/onnx.py", line 53, in __init__
2025-10-20 09:33:28.669904122 self.model = ort.InferenceSession(
2025-10-20 09:33:28.669906164 ^^^^^^^^^^^^^^^^^^^^^
2025-10-20 09:33:28.669910357 File "/usr/local/lib/python3.11/dist-packages/onnxruntime/capi/onnxruntime_inference_collection.py", line 465, in __init__
2025-10-20 09:33:28.669912920 self._create_inference_session(providers, provider_options, disabled_optimizers)
2025-10-20 09:33:28.669945562 File "/usr/local/lib/python3.11/dist-packages/onnxruntime/capi/onnxruntime_inference_collection.py", line 526, in _create_inference_session
2025-10-20 09:33:28.669947638 sess = C.InferenceSession(session_options, self._model_path, True, self._read_config_from_model)
2025-10-20 09:33:28.669949970 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-10-20 09:33:28.669952587 onnxruntime.capi.onnxruntime_pybind11_state.NoSuchFile: [ONNXRuntimeError] : 3 : NO_SUCHFILE : Load model from /config/model_cache/yolov9-t.onnx failed:Load model /config/model_cache/yolov9-t.onnx failed. File doesn't exist
2025-10-20 09:33:28.669994037 [2025-10-20 09:33:28] frigate.detectors.plugins.onnx INFO : ONNX: loading /config/model_cache/yolov9-t.onnx
2025-10-20 09:33:28.678287695 [2025-10-20 09:33:28] frigate.app INFO : Output process started: 480
2025-10-20 09:33:28.698616199 [2025-10-20 09:33:28] frigate.app INFO : Camera processor started for camera_outdoor: 501
2025-10-20 09:33:28.706802588 [2025-10-20 09:33:28] frigate.app INFO : Capture process started for camera_outdoor: 508
2025-10-20 09:33:28.895928979 2025/10/20 09:33:28 [error] 184#184: *9 connect() failed (111: Connection refused) while connecting to upstream, client: 127.0.0.1, server: , request: "GET /api/version HTTP/1.1", subrequest: "/auth", upstream: "http://127.0.0.1:5001/auth", host: "127.0.0.1:5000"
2025-10-20 09:33:28.895947601 2025/10/20 09:33:28 [error] 184#184: *9 auth request unexpected status: 502 while sending to client, client: 127.0.0.1, server: , request: "GET /api/version HTTP/1.1", host: "127.0.0.1:5000"
2025-10-20 09:33:29.108647970 [2025-10-20 09:33:29] frigate.api.fastapi_app INFO : Starting FastAPI app
2025-10-20 09:33:29.192496209 2025-10-20 09:33:29.192436715 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 560, index: 1, mask: {2, 16, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:33:29.192502677 2025-10-20 09:33:29.192449604 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 561, index: 2, mask: {3, 17, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:33:29.192505752 2025-10-20 09:33:29.192469330 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 559, index: 0, mask: {1, 15, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:33:29.197987538 2025-10-20 09:33:29.195988709 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 562, index: 3, mask: {4, 18, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:33:29.200990503 2025-10-20 09:33:29.200007381 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 563, index: 4, mask: {5, 19, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:33:29.202032425 2025-10-20 09:33:29.202014720 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 564, index: 5, mask: {6, 20, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:33:29.206982222 2025-10-20 09:33:29.204034232 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 565, index: 6, mask: {7, 21, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:33:29.206985898 2025-10-20 09:33:29.206003811 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 566, index: 7, mask: {8, 22, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:33:29.210082847 2025-10-20 09:33:29.210025290 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 571, index: 12, mask: {13, 27, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:33:29.379812477 [2025-10-20 09:33:29] frigate.api.fastapi_app INFO : FastAPI started
2025-10-20 09:33:29.724182701 2025-10-20 09:33:29.724144804 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 572, index: 0, mask: {1, 15, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:33:29.724204519 2025-10-20 09:33:29.724178349 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 573, index: 1, mask: {2, 16, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:33:29.725990270 2025-10-20 09:33:29.724278054 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 574, index: 2, mask: {3, 17, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:33:29.727033471 2025-10-20 09:33:29.727011622 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 575, index: 3, mask: {4, 18, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:33:29.729027881 2025-10-20 09:33:29.729009392 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 576, index: 4, mask: {5, 19, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:33:29.731015752 2025-10-20 09:33:29.730997391 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 577, index: 5, mask: {6, 20, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:33:29.733020223 2025-10-20 09:33:29.733001382 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 578, index: 6, mask: {7, 21, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:33:29.738988893 2025-10-20 09:33:29.734994853 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 579, index: 7, mask: {8, 22, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:33:29.738993533 2025-10-20 09:33:29.736014079 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 584, index: 12, mask: {13, 27, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:33:30.089903673 loading data from : /config/model_cache/facedet/landmarkdet.yaml
2025-10-20 09:33:30.903534324 INFO: Created TensorFlow Lite XNNPACK delegate for CPU.
2025-10-20 09:33:34.142113858 [INFO] Starting go2rtc healthcheck service...
2025-10-20 09:33:37.783534887 100.100.10.30 - - [20/Oct/2025:09:33:37 +0500] "GET /api/camera_outdoor/latest.jpg?h=225 HTTP/1.1" 200 10346 "-" "HomeAssistant/2025.10.2 aiohttp/3.12.15 Python/3.13" "-"
2025-10-20 09:33:47.983995507 100.100.10.30 - - [20/Oct/2025:09:33:47 +0500] "GET /api/camera_outdoor/latest.jpg?h=400 HTTP/1.1" 200 51868 "-" "HomeAssistant/2025.10.2 aiohttp/3.12.15 Python/3.13" "-"
2025-10-20 09:33:49.098583026 [2025-10-20 09:33:49] frigate.watchdog INFO : Detection appears to have stopped. Exiting Frigate...
s6-rc: info: service legacy-services: stopping
s6-rc: info: service legacy-services successfully stopped
s6-rc: info: service go2rtc-healthcheck: stopping
s6-rc: info: service certsync: stopping
2025-10-20 09:33:49.105945980 [INFO] The go2rtc-healthcheck service exited with code 256 (by signal 15)
s6-rc: info: service go2rtc-healthcheck successfully stopped
2025-10-20 09:33:49.106787944 [INFO] Service CERTSYNC exited with code 256 (by signal 15)
s6-rc: info: service certsync successfully stopped
s6-rc: info: service nginx: stopping
s6-rc: info: service certsync-log: stopping
s6-rc: info: service certsync-log successfully stopped
2025-10-20 09:33:49.163165563 [INFO] Service NGINX exited with code 0 (by signal 0)
s6-rc: info: service nginx successfully stopped
s6-rc: info: service nginx-log: stopping
s6-rc: info: service frigate: stopping
s6-rc: info: service nginx-log successfully stopped
2025-10-20 09:33:49.320915727 [2025-10-20 09:33:49] frigate.app INFO : Stopping...
2025-10-20 09:33:49.322658082 [2025-10-20 09:33:49] frigate.stats.emitter INFO : Exiting stats emitter...
2025-10-20 09:33:49.323323954 [2025-10-20 09:33:49] frigate.storage INFO : Exiting storage maintainer...
2025-10-20 09:33:49.323853146 [2025-10-20 09:33:49] frigate.record.cleanup INFO : Exiting recording cleanup...
2025-10-20 09:33:49.324259241 [2025-10-20 09:33:49] frigate.watchdog INFO : Exiting watchdog...
2025-10-20 09:33:49.324642840 [2025-10-20 09:33:49] frigate.ptz.autotrack INFO : Exiting autotracker...
2025-10-20 09:33:49.325247435 [2025-10-20 09:33:49] frigate.events.cleanup INFO : Exiting event cleanup...
2025-10-20 09:33:49.325568581 [2025-10-20 09:33:49] frigate.ptz.onvif INFO : Exiting ONVIF controller...
2025-10-20 09:33:49.325784732 [2025-10-20 09:33:49] frigate.app INFO : Waiting for capture process for camera_outdoor to stop
2025-10-20 09:33:49.414575384 [2025-10-20 09:33:49] watchdog.camera_outdoor INFO : Terminating the existing ffmpeg process...
2025-10-20 09:33:49.414793799 [2025-10-20 09:33:49] watchdog.camera_outdoor INFO : Waiting for ffmpeg to exit gracefully...
2025-10-20 09:33:49.816930459 [2025-10-20 09:33:49] watchdog.camera_outdoor INFO : Terminating the existing ffmpeg process...
2025-10-20 09:33:49.817103730 [2025-10-20 09:33:49] watchdog.camera_outdoor INFO : Waiting for ffmpeg to exit gracefully...
2025-10-20 09:33:50.039892632 [2025-10-20 09:33:50] frigate.app INFO : Waiting for process for camera_outdoor to stop
2025-10-20 09:33:50.119044893 [2025-10-20 09:33:50] frigate.events.maintainer INFO : Exiting event processor...
2025-10-20 09:33:50.219065017 [2025-10-20 09:33:50] frigate.track.object_processing INFO : Exiting object processor...
2025-10-20 09:33:53.218869752 [2025-10-20 09:33:53] frigate.video INFO : camera_outdoor: emptying frame queue
2025-10-20 09:33:53.219204473 [2025-10-20 09:33:53] frigate.video INFO : camera_outdoor: exiting subprocess
2025-10-20 09:33:53.228145277 [2025-10-20 09:33:53] frigate.app INFO : Closing frame queue for camera_outdoor
2025-10-20 09:33:54.229741438 [2025-10-20 09:33:54] frigate.app INFO : Detection queue closed
2025-10-20 09:33:54.730537909 [2025-10-20 09:33:54] frigate.app INFO : Detected frames queue closed
2025-10-20 09:33:55.231343581 [2025-10-20 09:33:55] frigate.app INFO : Timeline queue closed
2025-10-20 09:33:56.789582518 [2025-10-20 09:33:56] frigate.output.output INFO : exiting output process...
2025-10-20 09:33:58.650497490 [2025-10-20 09:33:58] frigate.record.maintainer INFO : Exiting recording maintenance...
2025-10-20 09:33:59.227134885 [2025-10-20 09:33:59] frigate.review.maintainer INFO : Exiting review maintainer...
2025-10-20 09:33:59.530492892 [2025-10-20 09:33:59] frigate.comms.ws INFO : Exiting websocket client...
2025-10-20 09:33:59.685465397 [2025-10-20 09:33:59] peewee.sqliteq INFO : writer received shutdown request, exiting.
2025-10-20 09:33:59.734040744 [INFO] Service Frigate exited with code 0 (by signal 0)
s6-rc: info: service frigate successfully stopped
s6-rc: info: service go2rtc: stopping
s6-rc: info: service frigate-log: stopping
2025-10-20 09:33:59.735643196 exit with signal: terminated
s6-rc: info: service frigate-log successfully stopped
2025-10-20 09:33:59.738834752 [INFO] The go2rtc service exited with code 0 (by signal 0)
s6-rc: info: service go2rtc successfully stopped
s6-rc: info: service prepare: stopping
s6-rc: info: service go2rtc-log: stopping
s6-rc: info: service prepare successfully stopped
s6-rc: info: service go2rtc-log successfully stopped
s6-rc: info: service log-prepare: stopping
s6-rc: info: service s6rc-fdholder: stopping
s6-rc: info: service log-prepare successfully stopped
s6-rc: info: service legacy-cont-init: stopping
s6-rc: info: service s6rc-fdholder successfully stopped
s6-rc: info: service legacy-cont-init successfully stopped
s6-rc: info: service fix-attrs: stopping
s6-rc: info: service fix-attrs successfully stopped
s6-rc: info: service s6rc-oneshot-runner: stopping
s6-rc: info: service s6rc-oneshot-runner successfully stopped
s6-rc: info: service s6rc-fdholder: starting
s6-rc: info: service s6rc-oneshot-runner: starting
s6-rc: info: service s6rc-oneshot-runner successfully started
s6-rc: info: service fix-attrs: starting
s6-rc: info: service s6rc-fdholder successfully started
s6-rc: info: service fix-attrs successfully started
s6-rc: info: service legacy-cont-init: starting
s6-rc: info: service legacy-cont-init successfully started
s6-rc: info: service prepare: starting
s6-rc: info: service log-prepare: starting
s6-rc: info: service log-prepare successfully started
s6-rc: info: service nginx-log: starting
s6-rc: info: service go2rtc-log: starting
s6-rc: info: service frigate-log: starting
s6-rc: info: service certsync-log: starting
s6-rc: info: service nginx-log successfully started
s6-rc: info: service go2rtc-log successfully started
s6-rc: info: service certsync-log successfully started
s6-rc: info: service prepare successfully started
s6-rc: info: service go2rtc: starting
s6-rc: info: service frigate-log successfully started
s6-rc: info: service go2rtc successfully started
s6-rc: info: service go2rtc-healthcheck: starting
s6-rc: info: service frigate: starting
s6-rc: info: service go2rtc-healthcheck successfully started
s6-rc: info: service frigate successfully started
s6-rc: info: service nginx: starting
2025-10-20 09:34:04.833519755 [INFO] Starting NGINX...
2025-10-20 09:34:04.910053766 [INFO] Preparing Frigate...
2025-10-20 09:34:05.211591821 [INFO] Preparing new go2rtc config...
2025-10-20 09:34:05.286433675 [INFO] Starting Frigate...
2025-10-20 09:34:05.554631764 [INFO] Starting go2rtc...
2025-10-20 09:34:05.638391051 09:34:05.638 INF go2rtc platform=linux/amd64 revision=fa580c5 version=1.9.9
2025-10-20 09:34:05.638395800 09:34:05.638 INF config path=/dev/shm/go2rtc.yaml
2025-10-20 09:34:05.638750631 09:34:05.638 INF [rtsp] listen addr=:8554
2025-10-20 09:34:05.638897496 09:34:05.638 INF [api] listen addr=:1984
2025-10-20 09:34:05.639215763 09:34:05.639 INF [webrtc] listen addr=:8555
s6-rc: info: service nginx successfully started
s6-rc: info: service certsync: starting
2025-10-20 09:34:06.224793917 [INFO] Starting certsync...
s6-rc: info: service certsync successfully started
s6-rc: info: service legacy-services: starting
s6-rc: info: service legacy-services successfully started
2025-10-20 09:34:06.619124757 127.0.0.1 - - [20/Oct/2025:09:34:06 +0500] "" 400 0 "-" "-" "-"
2025-10-20 09:34:07.415971414 2025/10/20 09:34:07 [error] 184#184: *2 connect() failed (111: Connection refused) while connecting to upstream, client: 10.10.10.110, server: , request: "GET /ws HTTP/1.1", subrequest: "/auth", upstream: "http://127.0.0.1:5001/auth", host: "10.10.10.10:5000"
2025-10-20 09:34:07.416000807 2025/10/20 09:34:07 [error] 184#184: *2 auth request unexpected status: 502 while sending to client, client: 10.10.10.110, server: , request: "GET /ws HTTP/1.1", host: "10.10.10.10:5000"
2025-10-20 09:34:07.416033168 10.10.10.110 - - [20/Oct/2025:09:34:07 +0500] "GET /ws HTTP/1.1" 500 177 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:144.0) Gecko/20100101 Firefox/144.0" "-"
2025-10-20 09:34:07.671638719 [2025-10-20 09:34:07] frigate.util.config INFO : Checking if frigate config needs migration...
2025-10-20 09:34:07.683512326 [2025-10-20 09:34:07] frigate.util.config INFO : frigate config does not need migration...
2025-10-20 09:34:08.521450325 2025/10/20 09:34:08 [error] 202#202: *5 connect() failed (111: Connection refused) while connecting to upstream, client: 100.100.10.30, server: , request: "GET /api/camera_outdoor/latest.jpg?h=225 HTTP/1.1", subrequest: "/auth", upstream: "http://127.0.0.1:5001/auth", host: "server:5000"
2025-10-20 09:34:08.521470262 2025/10/20 09:34:08 [error] 202#202: *5 auth request unexpected status: 502 while sending to client, client: 100.100.10.30, server: , request: "GET /api/camera_outdoor/latest.jpg?h=225 HTTP/1.1", host: "server:5000"
2025-10-20 09:34:08.521506088 100.100.10.30 - - [20/Oct/2025:09:34:08 +0500] "GET /api/camera_outdoor/latest.jpg?h=225 HTTP/1.1" 500 177 "-" "HomeAssistant/2025.10.2 aiohttp/3.12.15 Python/3.13" "-"
2025-10-20 09:34:09.225217493 [2025-10-20 09:34:09] frigate.util.services INFO : Automatically detected nvidia hwaccel for video decoding
2025-10-20 09:34:09.235688857 [2025-10-20 09:34:09] frigate.app INFO : Starting Frigate (0.16.2-4d58206)
2025-10-20 09:34:09.243608714 [2025-10-20 09:34:09] peewee_migrate.logs INFO : Starting migrations
2025-10-20 09:34:09.243997180 [2025-10-20 09:34:09] peewee_migrate.logs INFO : There is nothing to migrate
2025-10-20 09:34:09.252872549 [2025-10-20 09:34:09] frigate.app INFO : Recording process started: 418
2025-10-20 09:34:09.258237602 [2025-10-20 09:34:09] frigate.app INFO : Review process started: 421
2025-10-20 09:34:09.260598212 [2025-10-20 09:34:09] frigate.app INFO : go2rtc process pid: 116
2025-10-20 09:34:09.272794032 [2025-10-20 09:34:09] detector.nvidia INFO : Starting detection process: 443
2025-10-20 09:34:09.274040208 2025-10-20 09:34:09.274001976 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 449, index: 0, mask: {1, 15, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:34:09.274479086 2025-10-20 09:34:09.274459889 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 450, index: 1, mask: {2, 16, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:34:09.274540026 2025-10-20 09:34:09.274524363 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 451, index: 2, mask: {3, 17, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:34:09.274573850 2025-10-20 09:34:09.274559936 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 452, index: 3, mask: {4, 18, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:34:09.274622370 2025-10-20 09:34:09.274607552 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 454, index: 5, mask: {6, 20, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:34:09.274657250 2025-10-20 09:34:09.274643566 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 456, index: 7, mask: {8, 22, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:34:09.274789018 2025-10-20 09:34:09.274771400 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 461, index: 12, mask: {13, 27, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:34:09.275941778 2025-10-20 09:34:09.275911601 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 455, index: 6, mask: {7, 21, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:34:09.276495429 2025-10-20 09:34:09.276472744 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 453, index: 4, mask: {5, 19, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:34:09.278172247 [2025-10-20 09:34:09] frigate.detectors.plugins.onnx INFO : ONNX: loaded onnxruntime module
2025-10-20 09:34:09.279088661 [2025-10-20 09:34:09] frigate.detectors.plugins.onnx INFO : ONNX: loading /config/model_cache/yolov9-t.onnx
2025-10-20 09:34:09.279591015 Process detector:nvidia:
2025-10-20 09:34:09.279593475 Traceback (most recent call last):
2025-10-20 09:34:09.279595117 File "/usr/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap
2025-10-20 09:34:09.279596287 self.run()
2025-10-20 09:34:09.279597736 File "/opt/frigate/frigate/util/process.py", line 41, in run_wrapper
2025-10-20 09:34:09.279599493 return run(*args, **kwargs)
2025-10-20 09:34:09.279614942 ^^^^^^^^^^^^^^^^^^^^
2025-10-20 09:34:09.279616551 File "/usr/lib/python3.11/multiprocessing/process.py", line 108, in run
2025-10-20 09:34:09.279618420 self._target(*self._args, **self._kwargs)
2025-10-20 09:34:09.279619985 File "/opt/frigate/frigate/object_detection/base.py", line 112, in run_detector
2025-10-20 09:34:09.279621557 object_detector = LocalObjectDetector(detector_config=detector_config)
2025-10-20 09:34:09.279623073 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-10-20 09:34:09.279638423 File "/opt/frigate/frigate/object_detection/base.py", line 57, in __init__
2025-10-20 09:34:09.279639943 self.detect_api = create_detector(detector_config)
2025-10-20 09:34:09.279650651 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-10-20 09:34:09.279652238 File "/opt/frigate/frigate/detectors/__init__.py", line 18, in create_detector
2025-10-20 09:34:09.279653508 return api(detector_config)
2025-10-20 09:34:09.279654673 ^^^^^^^^^^^^^^^^^^^^
2025-10-20 09:34:09.279656202 File "/opt/frigate/frigate/detectors/plugins/onnx.py", line 53, in __init__
2025-10-20 09:34:09.279657486 self.model = ort.InferenceSession(
2025-10-20 09:34:09.279658738 ^^^^^^^^^^^^^^^^^^^^^
2025-10-20 09:34:09.279660590 File "/usr/local/lib/python3.11/dist-packages/onnxruntime/capi/onnxruntime_inference_collection.py", line 465, in __init__
2025-10-20 09:34:09.279671009 self._create_inference_session(providers, provider_options, disabled_optimizers)
2025-10-20 09:34:09.279673027 File "/usr/local/lib/python3.11/dist-packages/onnxruntime/capi/onnxruntime_inference_collection.py", line 526, in _create_inference_session
2025-10-20 09:34:09.279674855 sess = C.InferenceSession(session_options, self._model_path, True, self._read_config_from_model)
2025-10-20 09:34:09.279676442 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-10-20 09:34:09.279679081 onnxruntime.capi.onnxruntime_pybind11_state.NoSuchFile: [ONNXRuntimeError] : 3 : NO_SUCHFILE : Load model from /config/model_cache/yolov9-t.onnx failed:Load model /config/model_cache/yolov9-t.onnx failed. File doesn't exist
2025-10-20 09:34:09.280262291 [2025-10-20 09:34:09] frigate.app INFO : Embedding process started: 446
2025-10-20 09:34:09.288171369 [2025-10-20 09:34:09] frigate.app INFO : Output process started: 480
2025-10-20 09:34:09.302408117 [2025-10-20 09:34:09] frigate.app INFO : Camera processor started for camera_outdoor: 501
2025-10-20 09:34:09.316570991 [2025-10-20 09:34:09] frigate.app INFO : Capture process started for camera_outdoor: 508
2025-10-20 09:34:09.578319924 2025/10/20 09:34:09 [error] 211#211: *7 connect() failed (111: Connection refused) while connecting to upstream, client: 127.0.0.1, server: , request: "GET /api/version HTTP/1.1", subrequest: "/auth", upstream: "http://127.0.0.1:5001/auth", host: "127.0.0.1:5000"
2025-10-20 09:34:09.578343972 2025/10/20 09:34:09 [error] 211#211: *7 auth request unexpected status: 502 while sending to client, client: 127.0.0.1, server: , request: "GET /api/version HTTP/1.1", host: "127.0.0.1:5000"
2025-10-20 09:34:09.702278774 [2025-10-20 09:34:09] frigate.api.fastapi_app INFO : Starting FastAPI app
2025-10-20 09:34:09.784995276 2025-10-20 09:34:09.781623152 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 560, index: 1, mask: {2, 16, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:34:09.785001514 2025-10-20 09:34:09.781693628 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 562, index: 3, mask: {4, 18, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:34:09.785004495 2025-10-20 09:34:09.781693294 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 561, index: 2, mask: {3, 17, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:34:09.785007453 2025-10-20 09:34:09.781620360 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 559, index: 0, mask: {1, 15, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:34:09.788029901 2025-10-20 09:34:09.788009015 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 563, index: 4, mask: {5, 19, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:34:09.794029862 2025-10-20 09:34:09.794006799 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 564, index: 5, mask: {6, 20, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:34:09.797988633 2025-10-20 09:34:09.797004490 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 565, index: 6, mask: {7, 21, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:34:09.800021928 2025-10-20 09:34:09.800002933 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 566, index: 7, mask: {8, 22, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:34:09.817992650 2025-10-20 09:34:09.815019860 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 571, index: 12, mask: {13, 27, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:34:09.971105534 [2025-10-20 09:34:09] frigate.api.fastapi_app INFO : FastAPI started
2025-10-20 09:34:10.314168646 2025-10-20 09:34:10.314124147 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 574, index: 0, mask: {1, 15, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:34:10.314177299 2025-10-20 09:34:10.314143419 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 575, index: 1, mask: {2, 16, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:34:10.314207039 2025-10-20 09:34:10.314170079 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 576, index: 2, mask: {3, 17, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:34:10.319038050 2025-10-20 09:34:10.319013047 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 577, index: 3, mask: {4, 18, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:34:10.321020133 2025-10-20 09:34:10.321000689 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 578, index: 4, mask: {5, 19, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:34:10.323030012 2025-10-20 09:34:10.323008642 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 579, index: 5, mask: {6, 20, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:34:10.329002162 2025-10-20 09:34:10.325002228 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 580, index: 6, mask: {7, 21, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:34:10.329009661 2025-10-20 09:34:10.325065749 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 581, index: 7, mask: {8, 22, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:34:10.329054304 2025-10-20 09:34:10.329010126 [E:onnxruntime:Default, env.cc:234 ThreadMain] pthread_setaffinity_np failed for thread: 586, index: 12, mask: {13, 27, }, error code: 22 error msg: Invalid argument. Specify the number of threads explicitly so the affinity is not set.
2025-10-20 09:34:10.675363308 loading data from : /config/model_cache/facedet/landmarkdet.yaml
2025-10-20 09:34:11.459748477 INFO: Created TensorFlow Lite XNNPACK delegate for CPU.
2025-10-20 09:34:14.828319021 [INFO] Starting go2rtc healthcheck service...Install methodDocker CLI Object DetectorTensorRT Screenshots of the Frigate UI's System metrics pagesAny other information that may be helpfulNo response |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 1 reply
-
|
The main issue is that your YOLO model file doesn't exist. The error shows: For ONNX detector with NVIDIA GPU, you need to download the model manually since there is no default model provided (2). The ONNX detector supports YOLOv9 models, but they're not included by default (2). Here's the corrected configuration for your ONNX detector: detectors:
nvidia:
type: onnx
model:
model_type: yolo-generic
width: 320 # <--- should match the imgsize set during model export
height: 320 # <--- should match the imgsize set during model export
input_tensor: nchw
input_dtype: float
path: /config/model_cache/yolo.onnx
labelmap_path: /labelmap/coco-80.txtYou need to:
The ONNX detector will automatically detect and use TensorRT with your NVIDIA GPU in the 📚 Sources: Have another question? Just tag @inkeep. |
Beta Was this translation helpful? Give feedback.
All good now — the issue was caused by incorrect folder permissions.