Hailo8L high temperature affect all recordings

[patrykk]

Hi,
I have configuration of the Hailo8L and QNAP TS262 with OMV. I have noticed last time that Hailo8L have too high temperatures and randomly stop processing and reduce clocking. Unfortunately it also affect all frigate streams/recordings and require manual frigate restart.
I think we have to handle the exception and stop or restart relevant service. The good idea will be also pro actively check the chip temperature and reduce clocking before hailo will stuck or just set frequency of the chip in the config file.

Frigate version : 0.16 beta2

best regards,
Patryk

2025-05-27 08:58:29.799008352 127.0.0.1 - - [27/May/2025:08:58:29 +0200] "" 400 0 "-" "-" "-"
2025-05-27 08:59:29.976942547 127.0.0.1 - - [27/May/2025:08:59:29 +0200] "" 400 0 "-" "-" "-"
2025-05-27 08:59:58.149397780 [HailoRT] [critical] Got health monitor closed streams notification. temperature: TS00=119.87285 c, TS01=119.97402 c, inputs bitfield:1, outputs bitfield:0
2025-05-27 08:59:58.149403238 [HailoRT] [warning] Aborting Infer, Device 0000:03:00.0 got closed streams notification from 'Health Monitor'
2025-05-27 08:59:58.186553928 [HailoRT] [error] CHECK_SUCCESS failed with status=HAILO_STREAM_ABORT(63) - Failed launch transfer
2025-05-27 08:59:58.186914262 [HailoRT] [error] CHECK_SUCCESS failed with status=HAILO_STREAM_ABORT(63)
2025-05-27 08:59:58.187220987 [HailoRT] [error] Non-recoverable Async Infer Pipeline error. status error code: HAILO_STREAM_ABORT(63)
2025-05-27 08:59:58.247396810 [HailoRT] [critical] Got health monitor notification - temperature reached red zone. sensor id=1, TS00=119.87285c, TS01=119.97402c
2025-05-27 08:59:58.711177190 [2025-05-27 08:59:58] frigate.detectors.plugins.hailo8l ERROR : Inference error: Stream was aborted
2025-05-27 09:00:08.173504814 [2025-05-27 09:00:08] frigate.detectors.plugins.hailo8l ERROR : Timeout waiting for inference results for request 250494
2025-05-27 09:00:08.193139120 [HailoRT] [error] CHECK_SUCCESS failed with status=HAILO_STREAM_ABORT(63) - Can't handle inference request since pipeline status is HAILO_STREAM_ABORT(63).
2025-05-27 09:00:08.193144601 [HailoRT] [error] CHECK_SUCCESS failed with status=HAILO_STREAM_ABORT(63)
2025-05-27 09:00:08.193318907 [HailoRT] [error] CHECK_SUCCESS failed with status=HAILO_STREAM_ABORT(63)
2025-05-27 09:00:08.372494518 Exception in thread Thread-8 (run):
2025-05-27 09:00:08.372499252 Traceback (most recent call last):
2025-05-27 09:00:08.372500996 File "/usr/local/lib/python3.11/dist-packages/hailo_platform/pyhailort/pyhailort.py", line 3286, in run_async
2025-05-27 09:00:08.372502296 cpp_job = self._configured_infer_model.run_async(
2025-05-27 09:00:08.372503509 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 09:00:08.372504739 hailo_platform.pyhailort._pyhailort.HailoRTStatusException: 63
2025-05-27 09:00:08.372505685
2025-05-27 09:00:08.372506866 The above exception was the direct cause of the following exception:
2025-05-27 09:00:08.372507791
2025-05-27 09:00:08.372508801 Traceback (most recent call last):
2025-05-27 09:00:08.372509983 File "/usr/lib/python3.11/threading.py", line 1038, in _bootstrap_inner
2025-05-27 09:00:08.372510984 self.run()
2025-05-27 09:00:08.372512149 File "/usr/lib/python3.11/threading.py", line 975, in run
2025-05-27 09:00:08.372513265 self._target(*self._args, **self._kwargs)
2025-05-27 09:00:08.372514461 File "/opt/frigate/frigate/detectors/plugins/hailo8l.py", line 193, in run
2025-05-27 09:00:08.372515630 job = configured_infer_model.run_async(
2025-05-27 09:00:08.372516712 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-05-27 09:00:08.372518033 File "/usr/local/lib/python3.11/dist-packages/hailo_platform/pyhailort/pyhailort.py", line 3285, in run_async
2025-05-27 09:00:08.372519085 with ExceptionWrapper():
2025-05-27 09:00:08.372520475 File "/usr/local/lib/python3.11/dist-packages/hailo_platform/pyhailort/pyhailort.py", line 118, in exit
2025-05-27 09:00:08.372521581 self._raise_indicative_status_exception(value)
2025-05-27 09:00:08.372523033 File "/usr/local/lib/python3.11/dist-packages/hailo_platform/pyhailort/pyhailort.py", line 166, in _raise_indicative_status_exception
2025-05-27 09:00:08.372524239 raise self.create_exception_from_status(error_code) from libhailort_exception
2025-05-27 09:00:08.372525451 hailo_platform.pyhailort.pyhailort.HailoRTStreamAborted: Stream was aborted
2025-05-27 09:00:15.147437977 [HailoRT] [warning] Got health monitor notification - temperature reached orange zone. sensor id=1, TS00=115.421265c, TS01=115.77537c
2025-05-27 09:00:18.166579432 [2025-05-27 09:00:18] frigate.detectors.plugins.hailo8l ERROR : Timeout waiting for inference results for request 250495
2025-05-27 09:00:22.148946317 [HailoRT] [warning] Got health monitor notification - System's clock has been changed from 200000000 to 250000000
2025-05-27 09:00:28.181183701 [2025-05-27 09:00:28] frigate.detectors.plugins.hailo8l ERROR : Timeout waiting for inference results for request 250496
2025-05-27 09:00:30.106751378 127.0.0.1 - - [27/May/2025:09:00:30 +0200] "" 400 0 "-" "-" "-"
2025-05-27 09:00:38.183739119 [2025-05-27 09:00:38] frigate.detectors.plugins.hailo8l ERROR : Timeout waiting for inference results for request 250497
2025-05-27 09:00:39.149742241 [HailoRT] [warning] Got health monitor notification - System's clock has been changed from 250000000 to 300000000
2025-05-27 09:00:48.207631986 [2025-05-27 09:00:48] frigate.detectors.plugins.hailo8l ERROR : Timeout waiting for inference results for request 250498
2025-05-27 09:00:53.151292182 [HailoRT] [warning] Got health monitor notification - System's clock has been changed from 300000000 to 350000000
2025-05-27 09:00:58.240400631 [2025-05-27 09:00:58] frigate.detectors.plugins.hailo8l ERROR : Timeout waiting for inference results for request 250499
2025-05-27 09:01:08.283271366 [2025-05-27 09:01:08] frigate.detectors.plugins.hailo8l ERROR : Timeout waiting for inference results for request 250500
2025-05-27 09:01:11.283813127 [2025-05-27 09:01:11] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-27 09:01:11.285232612 [2025-05-27 09:01:11] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for taras1. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-27 09:01:11.286241872 [2025-05-27 09:01:11] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for taras2. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-27 09:01:11.287676144 [2025-05-27 09:01:11] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for garaz2. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-27 09:01:18.297931149 [2025-05-27 09:01:18] frigate.detectors.plugins.hailo8l ERROR : Timeout waiting for inference results for request 250501
2025-05-27 09:01:21.277164904 [2025-05-27 09:01:21] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-27 09:01:21.277613425 [2025-05-27 09:01:21] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for taras1. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-27 09:01:21.278040261 [2025-05-27 09:01:21] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for taras2. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-27 09:01:21.278386855 [2025-05-27 09:01:21] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for garaz2. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-27 09:01:23.153089842 [HailoRT] [warning] Got health monitor notification - System's clock has been changed from 350000000 to 400000000
2025-05-27 09:01:26.272082307 [2025-05-27 09:01:26] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for garaz2. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-27 09:01:28.287134039 [2025-05-27 09:01:28] frigate.detectors.plugins.hailo8l ERROR : Timeout waiting for inference results for request 250502
2025-05-27 09:01:30.230044966 127.0.0.1 - - [27/May/2025:09:01:30 +0200] "" 400 0 "-" "-" "-"
2025-05-27 09:01:31.278102445 [2025-05-27 09:01:31] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...

[NickM-27]

If there is an exception in the detector then the watchdog will restart it.

The Hailo team has written this detector, I believe it is working as expected. You'll likely want to look at a 40mm fan or some other approach to reduce temperature

[patrykk]

ok. Thanks, but with version 0.15.x I haven't had that kind of situation. Random high temperature didn't affect whole frigate and detector just restarted.

[NickM-27]

Right, the Hailo detector rewrite by the hailo team was done for 0.16. It allows for higher performance and the additional logging. Without being able to reproduce I am not sure exactly what the difference in behavior would be, will have to see.

[NickM-27]

Okay I think I found the issue, should be improved in the next beta

[patrykk]

Okay. I tested two days image 9b7d4d0-amd64 which contains the change. It looks much better. I just can confirm another one problem. Probably after short problem with the camera connection Hailo8l stuck and it looks like below.
Meantime I also added another one fan in the device.

2025-05-30 08:55:34.170658431 127.0.0.1 - - [30/May/2025:08:55:34 +0200] "" 400 0 "-" "-" "-"
2025-05-30 08:56:34.291929982 127.0.0.1 - - [30/May/2025:08:56:34 +0200] "" 400 0 "-" "-" "-"
2025-05-30 08:57:34.441795397 127.0.0.1 - - [30/May/2025:08:57:34 +0200] "" 400 0 "-" "-" "-"
2025-05-30 08:58:34.656480282 127.0.0.1 - - [30/May/2025:08:58:34 +0200] "" 400 0 "-" "-" "-"
2025-05-30 08:59:34.873793266 127.0.0.1 - - [30/May/2025:08:59:34 +0200] "" 400 0 "-" "-" "-"
2025-05-30 09:00:20.225804745 [2025-05-30 09:00:20] frigate.detectors.plugins.hailo8l ERROR : Timeout waiting for inference results for request 81548
2025-05-30 09:00:34.089293732 [2025-05-30 09:00:33] frigate.watchdog INFO : Detection appears to be stuck. Restarting detection process...
2025-05-30 09:00:34.194931829 [2025-05-30 09:00:34] root INFO : Waiting for detection process to exit gracefully...
2025-05-30 09:00:34.525749903 [2025-05-30 09:00:21] frigate.detectors.plugins.hailo8l ERROR : Timeout waiting for inference results for request 81549
2025-05-30 09:00:36.297213417 [2025-05-30 09:00:34] detector.hailo8l INFO : Exited detection process...
2025-05-30 09:00:37.647200372 127.0.0.1 - - [30/May/2025:09:00:37 +0200] "" 400 0 "-" "-" "-"
2025-05-30 09:00:37.831742656 [2025-05-30 09:00:37] root INFO : Detection process has exited...
2025-05-30 09:00:48.325791671 [2025-05-30 09:00:47] frigate.video ERROR : podwoze2: Unable to read frames from ffmpeg process.
2025-05-30 09:00:48.376461565 [2025-05-30 09:00:48] frigate.video ERROR : podwoze2: ffmpeg process is not running. exiting capture thread...
2025-05-30 09:00:50.023372362 [2025-05-30 09:00:49] frigate.video ERROR : taras2: Unable to read frames from ffmpeg process.
2025-05-30 09:00:50.093181077 [2025-05-30 09:00:50] frigate.video ERROR : taras2: ffmpeg process is not running. exiting capture thread...
2025-05-30 09:00:51.706503976 [2025-05-30 09:00:51] watchdog.taras2 ERROR : Ffmpeg process crashed unexpectedly for taras2.
2025-05-30 09:00:51.706509504 [2025-05-30 09:00:51] watchdog.taras2 ERROR : The following ffmpeg logs include the last 100 lines prior to exit.
2025-05-30 09:00:51.716690183 [2025-05-30 09:00:51] ffmpeg.taras2.detect ERROR : [segment @ 0x564ce351a0c0] Timestamps are unset in a packet for stream 0. This is deprecated and will stop working in the future. Fix your code to set the timestamps properly
2025-05-30 09:00:51.732253362 [2025-05-30 09:00:51] ffmpeg.taras2.detect ERROR : [vost#0:0/copy @ 0x564ce3518f00] Non-monotonic DTS; previous: 0, current: 0; changing to 1. This may result in incorrect timestamps in the output file.
2025-05-30 09:00:51.872145333 [2025-05-30 09:00:51] watchdog.podwoze2 ERROR : Ffmpeg process crashed unexpectedly for podwoze2.
2025-05-30 09:00:51.872467637 [2025-05-30 09:00:51] watchdog.podwoze2 ERROR : The following ffmpeg logs include the last 100 lines prior to exit.
2025-05-30 09:00:51.901780830 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : Last message repeated 29 times
2025-05-30 09:00:51.901787244 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aost#0:1/aac @ 0x55d467cd4740] Non-monotonic DTS; previous: 360217952, current: 360217950; changing to 360217953. This may result in incorrect timestamps in the output file.
2025-05-30 09:00:51.902131346 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aac @ 0x55d467cd5c40] Queue input is backward in time
2025-05-30 09:00:51.902135301 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : Last message repeated 574 times
2025-05-30 09:00:51.902162318 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aost#0:1/aac @ 0x55d467cd4740] Non-monotonic DTS; previous: 368913275, current: 368913273; changing to 368913276. This may result in incorrect timestamps in the output file.
2025-05-30 09:00:51.902192362 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aac @ 0x55d467cd5c40] Queue input is backward in time
2025-05-30 09:00:51.902194831 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : Last message repeated 633 times
2025-05-30 09:00:51.902198005 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aost#0:1/aac @ 0x55d467cd4740] Non-monotonic DTS; previous: 378029204, current: 378029202; changing to 378029205. This may result in incorrect timestamps in the output file.
2025-05-30 09:00:51.902223005 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aac @ 0x55d467cd5c40] Queue input is backward in time
2025-05-30 09:00:51.902225010 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : Last message repeated 16 times
2025-05-30 09:00:51.902228122 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aost#0:1/aac @ 0x55d467cd4740] Non-monotonic DTS; previous: 378229707, current: 378229705; changing to 378229708. This may result in incorrect timestamps in the output file.
2025-05-30 09:00:51.902243116 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aac @ 0x55d467cd5c40] Queue input is backward in time
2025-05-30 09:00:51.902245193 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : Last message repeated 56 times
2025-05-30 09:00:51.902248368 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aost#0:1/aac @ 0x55d467cd4740] Non-monotonic DTS; previous: 378908541, current: 378908539; changing to 378908542. This may result in incorrect timestamps in the output file.
2025-05-30 09:00:51.902250388 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aac @ 0x55d467cd5c40] Queue input is backward in time
2025-05-30 09:00:51.902272489 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : Last message repeated 291 times
2025-05-30 09:00:51.902275816 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aost#0:1/aac @ 0x55d467cd4740] Non-monotonic DTS; previous: 382804787, current: 382804785; changing to 382804788. This may result in incorrect timestamps in the output file.
2025-05-30 09:00:51.902277952 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aac @ 0x55d467cd5c40] Queue input is backward in time
2025-05-30 09:00:51.902279760 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : Last message repeated 316 times
2025-05-30 09:00:51.902282820 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aost#0:1/aac @ 0x55d467cd4740] Non-monotonic DTS; previous: 387079908, current: 387079906; changing to 387079909. This may result in incorrect timestamps in the output file.
2025-05-30 09:00:51.902306667 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aac @ 0x55d467cd5c40] Queue input is backward in time
2025-05-30 09:00:51.902308657 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : Last message repeated 152 times
2025-05-30 09:00:51.902311335 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aost#0:1/aac @ 0x55d467cd4740] Non-monotonic DTS; previous: 389064000, current: 389063998; changing to 389064001. This may result in incorrect timestamps in the output file.
2025-05-30 09:00:51.902313282 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aac @ 0x55d467cd5c40] Queue input is backward in time
2025-05-30 09:00:51.902314891 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : Last message repeated 439 times
2025-05-30 09:00:51.902317898 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aost#0:1/aac @ 0x55d467cd4740] Non-monotonic DTS; previous: 395079944, current: 395079942; changing to 395079945. This may result in incorrect timestamps in the output file.
2025-05-30 09:00:51.902322304 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aac @ 0x55d467cd5c40] Queue input is backward in time
2025-05-30 09:00:51.902323941 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : Last message repeated 205 times
2025-05-30 09:00:51.906814330 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aost#0:1/aac @ 0x55d467cd4740] Non-monotonic DTS; previous: 397899560, current: 397899558; changing to 397899561. This may result in incorrect timestamps in the output file.
2025-05-30 09:00:51.911582000 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aac @ 0x55d467cd5c40] Queue input is backward in time
2025-05-30 09:00:51.911587321 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : Last message repeated 194 times
2025-05-30 09:00:51.911590607 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aost#0:1/aac @ 0x55d467cd4740] Non-monotonic DTS; previous: 399611631, current: 399611629; changing to 399611632. This may result in incorrect timestamps in the output file.
2025-05-30 09:00:51.911592580 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aac @ 0x55d467cd5c40] Queue input is backward in time
2025-05-30 09:00:51.911594372 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : Last message repeated 257 times
2025-05-30 09:00:51.911597345 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aost#0:1/aac @ 0x55d467cd4740] Non-monotonic DTS; previous: 403519799, current: 403519797; changing to 403519800. This may result in incorrect timestamps in the output file.
2025-05-30 09:00:51.911599327 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aac @ 0x55d467cd5c40] Queue input is backward in time
2025-05-30 09:00:51.911601031 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : Last message repeated 109 times
2025-05-30 09:00:51.911603999 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aost#0:1/aac @ 0x55d467cd4740] Non-monotonic DTS; previous: 404918532, current: 404918530; changing to 404918533. This may result in incorrect timestamps in the output file.
2025-05-30 09:00:51.911605889 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aac @ 0x55d467cd5c40] Queue input is backward in time
2025-05-30 09:00:51.911607622 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : Last message repeated 107 times
2025-05-30 09:00:51.911610604 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aost#0:1/aac @ 0x55d467cd4740] Non-monotonic DTS; previous: 406304713, current: 406304711; changing to 406304714. This may result in incorrect timestamps in the output file.
2025-05-30 09:00:51.911612541 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aac @ 0x55d467cd5c40] Queue input is backward in time
2025-05-30 09:00:51.911614224 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : Last message repeated 7 times
2025-05-30 09:00:51.911617237 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aost#0:1/aac @ 0x55d467cd4740] Non-monotonic DTS; previous: 406379426, current: 406379424; changing to 406379427. This may result in incorrect timestamps in the output file.
2025-05-30 09:00:51.911619203 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aac @ 0x55d467cd5c40] Queue input is backward in time
2025-05-30 09:00:51.911621022 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : Last message repeated 54 times
2025-05-30 09:00:51.911624027 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aost#0:1/aac @ 0x55d467cd4740] Non-monotonic DTS; previous: 407163325, current: 407163323; changing to 407163326. This may result in incorrect timestamps in the output file.
2025-05-30 09:00:51.911625905 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aac @ 0x55d467cd5c40] Queue input is backward in time
2025-05-30 09:00:51.911627611 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : Last message repeated 939 times
2025-05-30 09:00:51.911630621 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aost#0:1/aac @ 0x55d467cd4740] Non-monotonic DTS; previous: 419778214, current: 419778212; changing to 419778215. This may result in incorrect timestamps in the output file.
2025-05-30 09:00:51.911668799 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aac @ 0x55d467cd5c40] Queue input is backward in time
2025-05-30 09:00:51.911670942 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : Last message repeated 402 times
2025-05-30 09:00:51.914764890 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aost#0:1/aac @ 0x55d467cd4740] Non-monotonic DTS; previous: 425353759, current: 425353757; changing to 425353760. This may result in incorrect timestamps in the output file.
2025-05-30 09:00:51.914769973 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aac @ 0x55d467cd5c40] Queue input is backward in time
2025-05-30 09:00:51.914771783 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : Last message repeated 7 times
2025-05-30 09:00:51.914774841 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aost#0:1/aac @ 0x55d467cd4740] Non-monotonic DTS; previous: 425462524, current: 425462522; changing to 425462525. This may result in incorrect timestamps in the output file.
2025-05-30 09:00:51.914776813 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aac @ 0x55d467cd5c40] Queue input is backward in time
2025-05-30 09:00:51.914778570 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : Last message repeated 439 times
2025-05-30 09:00:51.914781367 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aost#0:1/aac @ 0x55d467cd4740] Non-monotonic DTS; previous: 432384967, current: 432384965; changing to 432384968. This may result in incorrect timestamps in the output file.
2025-05-30 09:00:51.914783393 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aac @ 0x55d467cd5c40] Queue input is backward in time
2025-05-30 09:00:51.914785233 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : Last message repeated 221 times
2025-05-30 09:00:51.914788195 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aost#0:1/aac @ 0x55d467cd4740] Non-monotonic DTS; previous: 435595724, current: 435595722; changing to 435595725. This may result in incorrect timestamps in the output file.
2025-05-30 09:00:51.914790135 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aac @ 0x55d467cd5c40] Queue input is backward in time
2025-05-30 09:00:51.914791857 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : Last message repeated 247 times
2025-05-30 09:00:51.914794827 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aost#0:1/aac @ 0x55d467cd4740] Non-monotonic DTS; previous: 439104844, current: 439104842; changing to 439104845. This may result in incorrect timestamps in the output file.
2025-05-30 09:00:51.914796707 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aac @ 0x55d467cd5c40] Queue input is backward in time
2025-05-30 09:00:51.914798450 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : Last message repeated 85 times
2025-05-30 09:00:51.914801484 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aost#0:1/aac @ 0x55d467cd4740] Non-monotonic DTS; previous: 440550222, current: 440550220; changing to 440550223. This may result in incorrect timestamps in the output file.
2025-05-30 09:00:51.914803430 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aac @ 0x55d467cd5c40] Queue input is backward in time
2025-05-30 09:00:51.914805146 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : Last message repeated 545 times
2025-05-30 09:00:51.914808160 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aost#0:1/aac @ 0x55d467cd4740] Non-monotonic DTS; previous: 447149771, current: 447149769; changing to 447149772. This may result in incorrect timestamps in the output file.
2025-05-30 09:00:51.914810115 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aac @ 0x55d467cd5c40] Queue input is backward in time
2025-05-30 09:00:51.914811885 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : Last message repeated 17 times
2025-05-30 09:00:51.914814917 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aost#0:1/aac @ 0x55d467cd4740] Non-monotonic DTS; previous: 447241705, current: 447241703; changing to 447241706. This may result in incorrect timestamps in the output file.
2025-05-30 09:00:51.914816829 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aac @ 0x55d467cd5c40] Queue input is backward in time
2025-05-30 09:00:51.914818511 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : Last message repeated 27 times
2025-05-30 09:00:51.914821505 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aost#0:1/aac @ 0x55d467cd4740] Non-monotonic DTS; previous: 447398305, current: 447398303; changing to 447398306. This may result in incorrect timestamps in the output file.
2025-05-30 09:00:51.914823412 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aac @ 0x55d467cd5c40] Queue input is backward in time
2025-05-30 09:00:51.914825108 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : Last message repeated 338 times
2025-05-30 09:00:51.914828080 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aost#0:1/aac @ 0x55d467cd4740] Non-monotonic DTS; previous: 449226823, current: 449226821; changing to 449226824. This may result in incorrect timestamps in the output file.
2025-05-30 09:00:51.914829948 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aac @ 0x55d467cd5c40] Queue input is backward in time
2025-05-30 09:00:51.914831675 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : Last message repeated 77 times
2025-05-30 09:00:51.914902982 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aost#0:1/aac @ 0x55d467cd4740] Non-monotonic DTS; previous: 449620870, current: 449620868; changing to 449620871. This may result in incorrect timestamps in the output file.
2025-05-30 09:00:51.914905280 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aac @ 0x55d467cd5c40] Queue input is backward in time
2025-05-30 09:00:51.914906986 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : Last message repeated 76 times
2025-05-30 09:00:51.914910065 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aost#0:1/aac @ 0x55d467cd4740] Non-monotonic DTS; previous: 450057183, current: 450057181; changing to 450057184. This may result in incorrect timestamps in the output file.
2025-05-30 09:00:51.914912367 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aac @ 0x55d467cd5c40] Queue input is backward in time
2025-05-30 09:00:51.919334085 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : Last message repeated 352 times
2025-05-30 09:00:51.919340128 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aost#0:1/aac @ 0x55d467cd4740] Non-monotonic DTS; previous: 454081228, current: 454081226; changing to 454081229. This may result in incorrect timestamps in the output file.
2025-05-30 09:00:51.919417958 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aac @ 0x55d467cd5c40] Queue input is backward in time
2025-05-30 09:00:51.919581778 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : Last message repeated 73 times
2025-05-30 09:00:51.919717336 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aost#0:1/aac @ 0x55d467cd4740] Non-monotonic DTS; previous: 454779916, current: 454779914; changing to 454779917. This may result in incorrect timestamps in the output file.
2025-05-30 09:00:51.919815974 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aac @ 0x55d467cd5c40] Queue input is backward in time
2025-05-30 09:00:51.919964411 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : Last message repeated 86 times
2025-05-30 09:00:51.922100705 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aost#0:1/aac @ 0x55d467cd4740] Non-monotonic DTS; previous: 455869200, current: 455869198; changing to 455869201. This may result in incorrect timestamps in the output file.
2025-05-30 09:00:51.922469017 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aac @ 0x55d467cd5c40] Queue input is backward in time
2025-05-30 09:00:51.922625666 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : Last message repeated 69 times
2025-05-30 09:00:51.922758483 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aost#0:1/aac @ 0x55d467cd4740] Non-monotonic DTS; previous: 456231048, current: 456231046; changing to 456231049. This may result in incorrect timestamps in the output file.
2025-05-30 09:00:51.923378454 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : [aac @ 0x55d467cd5c40] Queue input is backward in time
2025-05-30 09:00:51.925140052 [2025-05-30 09:00:51] ffmpeg.podwoze2.detect ERROR : Last message repeated 51 times
2025-05-30 09:00:52.961242252 [2025-05-30 09:00:52] frigate.video ERROR : taras1: Unable to read frames from ffmpeg process.
2025-05-30 09:00:52.961444579 [2025-05-30 09:00:52] frigate.video ERROR : taras1: ffmpeg process is not running. exiting capture thread...
2025-05-30 09:01:00.822786049 [2025-05-30 09:01:00] detector.hailo8l INFO : Starting detection process: 72958
2025-05-30 09:01:01.651683243 [2025-05-30 09:01:01] watchdog.taras1 ERROR : Ffmpeg process crashed unexpectedly for taras1.
2025-05-30 09:01:01.651721194 [2025-05-30 09:01:01] watchdog.taras1 ERROR : The following ffmpeg logs include the last 100 lines prior to exit.
2025-05-30 09:01:01.652065851 [2025-05-30 09:01:01] ffmpeg.taras1.detect ERROR : [segment @ 0x5599894e5fc0] Timestamps are unset in a packet for stream 0. This is deprecated and will stop working in the future. Fix your code to set the timestamps properly
2025-05-30 09:01:01.652232426 [2025-05-30 09:01:01] ffmpeg.taras1.detect ERROR : [vost#0:0/copy @ 0x5599894e6300] Non-monotonic DTS; previous: 0, current: 0; changing to 1. This may result in incorrect timestamps in the output file.
2025-05-30 09:01:16.440862398 [2025-05-30 09:01:16] frigate.video ERROR : garaz2: Unable to read frames from ffmpeg process.
2025-05-30 09:01:16.464974930 [2025-05-30 09:01:16] frigate.video ERROR : garaz2: ffmpeg process is not running. exiting capture thread...
2025-05-30 09:01:22.222277643 [2025-05-30 09:01:22] watchdog.garaz2 ERROR : Ffmpeg process crashed unexpectedly for garaz2.
2025-05-30 09:01:22.222496996 [2025-05-30 09:01:22] watchdog.garaz2 ERROR : The following ffmpeg logs include the last 100 lines prior to exit.
2025-05-30 09:01:22.234505735 [2025-05-30 09:01:22] ffmpeg.garaz2.detect ERROR : [aac @ 0x556b41d84fc0] Queue input is backward in time
2025-05-30 09:01:22.234989131 [2025-05-30 09:01:22] ffmpeg.garaz2.detect ERROR : Last message repeated 7027 times
2025-05-30 09:01:22.235141980 [2025-05-30 09:01:22] ffmpeg.garaz2.detect ERROR : [rtsp @ 0x556b41d4e4c0] RTP: PT=60: bad cseq dbbe expected=9165
2025-05-30 09:01:22.235200955 [2025-05-30 09:01:22] ffmpeg.garaz2.detect ERROR : [rtsp @ 0x556b41d4e4c0] RTP: PT=60: bad cseq ed0b expected=dbc2
2025-05-30 09:01:22.235283443 [2025-05-30 09:01:22] ffmpeg.garaz2.detect ERROR : [aac @ 0x556b41d84fc0] Queue input is backward in time
2025-05-30 09:01:22.235371948 [2025-05-30 09:01:22] ffmpeg.garaz2.detect ERROR : Last message repeated 5 times
2025-05-30 09:01:22.235447688 [2025-05-30 09:01:22] ffmpeg.garaz2.detect ERROR : [in#0/rtsp @ 0x556b41d4e180] Error during demuxing: Connection timed out
2025-05-30 09:01:38.099931779 127.0.0.1 - - [30/May/2025:09:01:38 +0200] "" 400 0 "-" "-" "-"
2025-05-30 09:02:38.290802998 127.0.0.1 - - [30/May/2025:09:02:38 +0200] "" 400 0 "-" "-" "-"
2025-05-30 09:03:38.435552653 127.0.0.1 - - [30/May/2025:09:03:38 +0200] "" 400 0 "-" "-" "-"
2025-05-30 09:04:38.848509645 127.0.0.1 - - [30/May/2025:09:04:38 +0200] "" 400 0 "-" "-" "-"
2025-05-30 09:05:38.966572200 127.0.0.1 - - [30/May/2025:09:05:38 +0200] "" 400 0 "-" "-" "-"
2025-05-30 09:06:22.429366222 [2025-05-30 09:06:22] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:06:32.430501568 [2025-05-30 09:06:32] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:06:39.106530716 127.0.0.1 - - [30/May/2025:09:06:39 +0200] "" 400 0 "-" "-" "-"
2025-05-30 09:06:42.429341237 [2025-05-30 09:06:42] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:06:51.614178482 2025/05/30 09:06:51 [error] 178#178: *6337 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 127.0.0.1, server: , request: "GET /api/version HTTP/1.1", upstream: "http://127.0.0.1:5001/version", host: "127.0.0.1:5000"
2025-05-30 09:06:52.429755352 [2025-05-30 09:06:52] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:07:02.429865528 [2025-05-30 09:07:02] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:07:12.430759507 [2025-05-30 09:07:12] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:07:22.437664060 [2025-05-30 09:07:22] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:07:32.431110513 [2025-05-30 09:07:32] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:07:39.245975041 127.0.0.1 - - [30/May/2025:09:07:39 +0200] "" 400 0 "-" "-" "-"
2025-05-30 09:07:42.436828590 [2025-05-30 09:07:42] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:07:52.433028372 [2025-05-30 09:07:52] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:08:02.432837031 [2025-05-30 09:08:02] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:08:12.432529807 [2025-05-30 09:08:12] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:08:22.431939655 [2025-05-30 09:08:22] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:08:32.434673744 [2025-05-30 09:08:32] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:08:39.372287862 127.0.0.1 - - [30/May/2025:09:08:39 +0200] "" 400 0 "-" "-" "-"
2025-05-30 09:08:42.434192905 [2025-05-30 09:08:42] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:08:52.435865060 [2025-05-30 09:08:52] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:09:02.437477544 [2025-05-30 09:09:02] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:09:22.433289742 [2025-05-30 09:09:22] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:09:32.438086656 [2025-05-30 09:09:32] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:09:39.512766477 127.0.0.1 - - [30/May/2025:09:09:39 +0200] "" 400 0 "-" "-" "-"
2025-05-30 09:09:42.441878700 [2025-05-30 09:09:42] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:09:52.438225544 [2025-05-30 09:09:52] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:10:02.439019727 [2025-05-30 09:10:02] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:10:12.439376557 [2025-05-30 09:10:12] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:10:22.441157581 [2025-05-30 09:10:22] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:10:32.436219523 [2025-05-30 09:10:32] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:10:39.729656451 127.0.0.1 - - [30/May/2025:09:10:39 +0200] "" 400 0 "-" "-" "-"
2025-05-30 09:10:42.439926456 [2025-05-30 09:10:42] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:10:52.438079632 [2025-05-30 09:10:52] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:11:02.445044112 [2025-05-30 09:11:02] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:11:12.440175097 [2025-05-30 09:11:12] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:11:22.443518381 [2025-05-30 09:11:22] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:11:32.442666401 [2025-05-30 09:11:32] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:11:39.852500299 127.0.0.1 - - [30/May/2025:09:11:39 +0200] "" 400 0 "-" "-" "-"
2025-05-30 09:11:42.439693349 [2025-05-30 09:11:42] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:11:52.444088165 [2025-05-30 09:11:52] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:12:02.440893287 [2025-05-30 09:12:02] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:12:12.447984725 [2025-05-30 09:12:12] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:12:22.453105774 [2025-05-30 09:12:22] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:12:32.440998154 [2025-05-30 09:12:32] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:12:40.005428689 127.0.0.1 - - [30/May/2025:09:12:40 +0200] "" 400 0 "-" "-" "-"
2025-05-30 09:13:27.446792011 [2025-05-30 09:13:27] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for taras1. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:13:40.138725735 127.0.0.1 - - [30/May/2025:09:13:40 +0200] "" 400 0 "-" "-" "-"
2025-05-30 09:13:47.444985822 [2025-05-30 09:13:47] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for taras1. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:13:52.444904038 [2025-05-30 09:13:52] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:13:57.448896731 [2025-05-30 09:13:57] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for taras1. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:14:07.452441498 [2025-05-30 09:14:07] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for taras1. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:14:17.449299696 [2025-05-30 09:14:17] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for taras1. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:14:27.446497480 [2025-05-30 09:14:27] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for taras1. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:14:37.447918324 [2025-05-30 09:14:37] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for taras1. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:14:40.266308185 127.0.0.1 - - [30/May/2025:09:14:40 +0200] "" 400 0 "-" "-" "-"
2025-05-30 09:14:47.447533304 [2025-05-30 09:14:47] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for taras1. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:14:57.447402936 [2025-05-30 09:14:57] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for taras1. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:15:07.447583623 [2025-05-30 09:15:07] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for taras1. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:15:17.449703462 [2025-05-30 09:15:17] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for taras1. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:15:27.450670709 [2025-05-30 09:15:27] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for taras1. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:15:37.448744782 [2025-05-30 09:15:37] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for taras1. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:15:40.383090953 127.0.0.1 - - [30/May/2025:09:15:40 +0200] "" 400 0 "-" "-" "-"
2025-05-30 09:15:47.448546704 [2025-05-30 09:15:47] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for taras1. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:15:57.457622950 [2025-05-30 09:15:57] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for taras1. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:16:07.450627142 [2025-05-30 09:16:07] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for taras1. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:16:17.451322722 [2025-05-30 09:16:17] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for taras1. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:16:27.450994608 [2025-05-30 09:16:27] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for taras1. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:16:37.454306132 [2025-05-30 09:16:37] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for taras1. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:16:40.506137585 127.0.0.1 - - [30/May/2025:09:16:40 +0200] "" 400 0 "-" "-" "-"
2025-05-30 09:16:47.450903646 [2025-05-30 09:16:47] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for taras1. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:16:57.450361449 [2025-05-30 09:16:57] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for taras1. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:17:07.450520965 [2025-05-30 09:17:07] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for taras1. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:17:17.453376851 [2025-05-30 09:17:17] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for taras1. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:17:40.626288681 127.0.0.1 - - [30/May/2025:09:17:40 +0200] "" 400 0 "-" "-" "-"
2025-05-30 09:18:40.759913933 127.0.0.1 - - [30/May/2025:09:18:40 +0200] "" 400 0 "-" "-" "-"
2025-05-30 09:19:40.890467745 127.0.0.1 - - [30/May/2025:09:19:40 +0200] "" 400 0 "-" "-" "-"
2025-05-30 09:20:41.045410777 127.0.0.1 - - [30/May/2025:09:20:41 +0200] "" 400 0 "-" "-" "-"
2025-05-30 09:21:41.167402574 127.0.0.1 - - [30/May/2025:09:21:41 +0200] "" 400 0 "-" "-" "-"
2025-05-30 09:22:41.303342400 127.0.0.1 - - [30/May/2025:09:22:41 +0200] "" 400 0 "-" "-" "-"
2025-05-30 09:23:41.413227608 127.0.0.1 - - [30/May/2025:09:23:41 +0200] "" 400 0 "-" "-" "-"
2025-05-30 09:24:41.541198421 127.0.0.1 - - [30/May/2025:09:24:41 +0200] "" 400 0 "-" "-" "-"
2025-05-30 09:25:41.684195785 127.0.0.1 - - [30/May/2025:09:25:41 +0200] "" 400 0 "-" "-" "-"
2025-05-30 09:25:57.464015093 [2025-05-30 09:25:57] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for taras1. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:26:41.798907325 127.0.0.1 - - [30/May/2025:09:26:41 +0200] "" 400 0 "-" "-" "-"
2025-05-30 09:27:41.931188109 127.0.0.1 - - [30/May/2025:09:27:41 +0200] "" 400 0 "-" "-" "-"
2025-05-30 09:28:42.068942601 127.0.0.1 - - [30/May/2025:09:28:42 +0200] "" 400 0 "-" "-" "-"
2025-05-30 09:28:52.470311143 [2025-05-30 09:28:52] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:29:12.471369213 [2025-05-30 09:29:12] frigate.record.maintainer WARNING : Too many unprocessed recording segments in cache for domofon. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
2025-05-30 09:29:42.203841060 127.0.0.1 - - [30/May/2025:09:29:42 +0200] "" 400 0 "-" "-" "-"
2025-05-30 09:30:42.343712594 127.0.0.1 - - [30/May/2025:09:30:42 +0200] "" 400 0 "-" "-" "-"
2025-05-30 09:31:42.466944174 127.0.0.1 - - [30/May/2025:09:31:42 +0200] "" 400 0 "-" "-" "-"
2025-05-30 09:32:42.695557712 127.0.0.1 - - [30/May/2025:09:32:42 +0200] "" 400 0 "-" "-" "-"

After frigate restart everything back to the normal.
best regards,