[Config Support]: MQTT snapshots do not obey the configured threshold limit #18968

nacree · 2025-07-02T16:25:51Z

nacree
Jul 2, 2025

Describe the problem you are having

I subscribed for Frigate+ and meanwhile updated min_score and threshold values in my config to higher numbers according to the docs.

objects:
  filters:
    person:
      min_score: .75
      threshold: .85

I'm following the last detected objects through MQTT in HA dashboard, and now I have noticed that it shows me the objects with score from 75%, even the threshold value is 85%.

I somehow understand the difference between the min_score and threshold values, but does it make sense to increase to min_score value to same value as threshold to drop off the improbable detections from MQTT. Or is there other way to filter out those detections from the MQTT, as they are not then shown on Frigate side at all.

Thanks for the help.

Version

0.16-beta3

Frigate config file

mqtt:
  enabled: true
  host: 192.168.72.8
  client_id: frigate
  port: 1883
  user: .......
  password: ........

tls:
  # Disable TLS for port 8971
  enabled: false

ffmpeg:
  hwaccel_args: preset-intel-qsv-h264
  output_args:
    record: preset-record-generic-audio-aac

detectors:
  ov:
    type: openvino
    device: GPU

model:
  path: plus://f69400e8341d2fe8010271f87d59466e

go2rtc:
  streams:
     ......
     
     
record:
  enabled: true
  retain:
    days: 5
    mode: all
  alerts:
    retain:
      days: 30
  detections:
    retain:
      days: 30

snapshots:
  enabled: true
  bounding_box: true

detect:
  enabled: true
  height: 720
  width: 1280
  fps: 1

live:
  height: 480

objects:
  filters:
    deer:
      min_score: .6
      threshold: .8
    dog:
      min_score: .7
      threshold: .9
    cat:
      min_score: .65
      threshold: .8
    face:
      min_score: .7
    license_plate:
      min_score: .6
    person:
      min_score: .75
      threshold: .85
    car:
      min_score: .75
      threshold: .85

motion:
  enabled: true
  threshold: 30
  mqtt_off_delay: 30
  lightning_threshold: 0.8
  improve_contrast: true

cameras:
  etupiha:
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://localhost:8554/etupiha
          roles:
            - record
            - detect

    detect:
      enabled: true
      height: 720
      width: 1280

    record:
      enabled: true
    objects:
      track:
        - person
        - cat
        - dog
        - deer

      filters:
        person:
          mask: 0.887,0.297,0.941,0.289,0.998,0.545,0.912,0.596
    motion:
      enabled: true
      mask: 0.889,0.173,0.902,0,0.001,0.001,0,0.423
      threshold: 45
      contour_area: 30
      improve_contrast: true

  reolink:
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://...
          input_args: preset-rtsp-generic
          roles:
            - detect
        - path: rtsp://localhost:8554/reolink
          roles:
            - record
    detect:
      enabled: true
      width: 640
      height: 480
      fps: 5
    record:
      enabled: true
    objects:
      track:
        - person
        - bicycle
        - car
        - cat
        - dog
        - deer
    motion:
      enabled: true
      mask:
        - 0.01,0.016,0.011,0.048,0.305,0.048,0.304,0.016
        - 0.002,0.409,0.355,0.3,0.372,0.176,0.634,0.197,0.745,0.214,0.907,0.222,0.878,0.292,0.908,0.414,0.997,0.48,0.998,0.003,0.001,0.002
      threshold: 40
      contour_area: 20
      improve_contrast: true

  etuovi:
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://localhost:8554/etuovi
          roles:
            - record
            - detect
    detect:
      enabled: true
      width: 1152
      height: 648
      fps: 5
    record:
      enabled: true
    objects:
      track:
        - person
        - cat
        - dog
        - deer

      filters:
        person:
          mask: 0.028,0.574,0.123,0.985,0.215,0.933,0.127,0.505
    motion:
      enabled: true
      mask:
        - 0,0,0,1,0.212,1,0.15,0
        - 0.719,0,0.71,0.099,1,0.356,1,0
      threshold: 40
      contour_area: 15
      improve_contrast: true

  keittio:
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://localhost:8554/keittioSub
          roles:
            - detect
        - path: rtsp://localhost:8554/keittio
          roles:
            - record
    detect:
      enabled: false
      width: 640
      height: 360
    record:
      enabled: true
    motion:
      enabled: true
      threshold: 40
      mqtt_off_delay: 30
      lightning_threshold: 0.8
      improve_contrast: true
      contour_area: 20
      mask:
        - 0,0.29,0.136,0.766,0.226,0.647,0.108,0.186
        - 0,0.052,0.357,0.053,0.357,0,0,0.001

  piha:
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://localhost:8554/piha
          roles:
            - detect
            - record
    detect:
      enabled: true
      width: 1152
      height: 648
      fps: 2
    record:
      enabled: true
    motion:
      enabled: true
      threshold: 35
      contour_area: 15
      improve_contrast: true
    objects:
      track:
        - person
        - cat
        - dog
        - deer

  olkkari:
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://localhost:8554/olkkari
          roles:
            - record
    detect:
      enabled: false
      width: 640
      height: 360
    record:
      enabled: true
    motion:
      mask:
        - 0.192,0.272,0.263,0.26,0.358,0.05,0.362,0.002,0,0.002,0.002,0.049
        - 0.833,0.075,0.81,0.294,0.999,0.467,1,0.176
      threshold: 40
      contour_area: 20
      improve_contrast: true

  lastenhuone:
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://localhost:8554/lastenhuone
          roles:
            - record
    record:
      enabled: true
    detect:
      enabled: false
      width: 640
      height: 360
    motion:
      enabled: false
      mask: 0,0.046,0.356,0.053,0.358,0.001,0,0.001

  pinnasanky:
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://localhost:8554/pinnasanky
          roles:
            - record
    record:
      enabled: true
    detect:
      enabled: false
      width: 640
      height: 360
    motion:
      enabled: false
      mask: 0.001,0.049,0.357,0.053,0.356,0,0.001,0.001

version: 0.16-0
camera_groups:
  Piha:
    order: 1
    icon: LuBird
    cameras:
      - etuovi
      - etupiha
      - piha
      - reolink
  Sisä:
    order: 2
    icon: LuBanana
    cameras:
      - keittio
      - lastenhuone
      - pinnasanky
      - olkkari

Relevant Frigate log output

No relevant log entries

Relevant go2rtc log output

No relevant go2rtc log entries

Frigate stats

No response

Operating system

Debian

Install method

Docker Compose

docker-compose file or Docker CLI command

Not relevant

Object Detector

OpenVino

Screenshots of the Frigate UI's System metrics pages

No response

Any other information that may be helpful

No response

Answered by hawkeye217

Jul 2, 2025

There are a few things to consider here:

MQTT topics like /events are raw topics without any filters, so they may sometimes have messages for objects that don't appear in the Frigate UI (false positives are one significant example).
An object's threshold and min_score interact in various ways. See the official documentation.
Frigate 0.16 beta 4 will include some changes for MQTT snapshots as there were some bugs found in prior betas - specifically relating to zones. Since you didn't post your config, I can't tell you exactly if you're encountering that or not.

View full answer

hawkeye217 · 2025-07-02T17:02:37Z

hawkeye217
Jul 2, 2025
Collaborator

There are a few things to consider here:

MQTT topics like /events are raw topics without any filters, so they may sometimes have messages for objects that don't appear in the Frigate UI (false positives are one significant example).
An object's threshold and min_score interact in various ways. See the official documentation.
Frigate 0.16 beta 4 will include some changes for MQTT snapshots as there were some bugs found in prior betas - specifically relating to zones. Since you didn't post your config, I can't tell you exactly if you're encountering that or not.

1 reply

nacree Jul 2, 2025
Author

@hawkeye217 thanks for the quick response. I have updated my question with the configuration. However I don't have any zones in use, so I doubt that it will bring changes.

NickM-27 · 2025-07-02T17:03:38Z

NickM-27
Jul 2, 2025
Collaborator Sponsor

This is working as expected, the MQTT snapshots don't follow the full rules of the events / review items as users generally want faster response times.

3 replies

nacree Jul 2, 2025
Author

Thanks for the clarification. That's fair. Just haven't seen such behavior previously, but it started to happen now when updating the thresholds. I will need to dig the HA integration side then, if there would be ways to catch the snapshots from the events with specific score level. It has been just easy to use the latest snapshot feature of the integration, but if that's not even intended, need to look for something else.

nacree Jul 2, 2025
Author

I'm expecting that the HA integration uses this topic

https://docs.frigate.video/integrations/mqtt/#frigatecamera_nameobject_namesnapshot

Publishes a jpeg encoded frame of the detected object type. When the object is no longer detected, the highest confidence image is published or the original image is published again.

It says highest confidence image or original image. It could be also that here the threshold value is taken into account, in sense if the "higher confidence image" is does not fulfill the score threshold is is discarded and "original" or "previous" image is shown instead.

hawkeye217 Jul 2, 2025
Collaborator

Yep, you're correct - see the integration code:

https://github.com/blakeblackshear/frigate-hass-integration/blob/b26abda8b6adf780ce763b4aacfca2fa218f3675/custom_components/frigate/image.py#L72

Here is the MQTT snapshot function in Frigate itself:

frigate/frigate/track/object_processing.py

Line 258 in 86a3e31

def should_mqtt_snapshot(self, camera, obj: TrackedObject):

You can search for when/where it is called, also in that same file.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Uh oh!

[Config Support]: MQTT snapshots do not obey the configured threshold limit #18968

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{editor}}'s edit

{{editor}}'s edit

Uh oh!

Replies: 2 comments 4 replies

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Select a reply

Uh oh!

Uh oh!

[Config Support]: MQTT snapshots do not obey the configured threshold limit #18968

Uh oh!

Uh oh!

nacree Jul 2, 2025

Describe the problem you are having

Version

Frigate config file

Relevant Frigate log output

Relevant go2rtc log output

Frigate stats

Operating system

Install method

docker-compose file or Docker CLI command

Object Detector

Screenshots of the Frigate UI's System metrics pages

Any other information that may be helpful

Replies: 2 comments · 4 replies

Uh oh!

hawkeye217 Jul 2, 2025 Collaborator

Uh oh!

nacree Jul 2, 2025 Author

Uh oh!

NickM-27 Jul 2, 2025 Collaborator Sponsor

Uh oh!

nacree Jul 2, 2025 Author

Uh oh!

nacree Jul 2, 2025 Author

Uh oh!

hawkeye217 Jul 2, 2025 Collaborator

nacree
Jul 2, 2025

Replies: 2 comments 4 replies

hawkeye217
Jul 2, 2025
Collaborator

nacree Jul 2, 2025
Author

NickM-27
Jul 2, 2025
Collaborator Sponsor

nacree Jul 2, 2025
Author

nacree Jul 2, 2025
Author

hawkeye217 Jul 2, 2025
Collaborator