Suggestion: Add rms to audio debug

[fahnoe]

Not really a new feature, just an small enhancement for tuning & debugging. Reference Frigate 0.16.1

I'm continuing to learn about tuning the audio detection capabilities of Frigate; my initial query on the topic: #19965

I am finding that setting the audio logging level to debug and watching for the camera's "heard" messages is helpful in tuning both the min_volume and listen list/filters. These messages would be even more helpful if they also included the rms volume level of the audio detections. Something along the lines of the following please.

frigate/events/audio.py:

        # only run audio detection when volume is above min_volume
        if rms >= self.camera_config.audio.min_volume:
            # create waveform relative to max range and look for detections
            waveform = (audio / AUDIO_MAX_BIT_RANGE).astype(np.float32)
            model_detections = self.detector.detect(waveform)

            for label, score, _ in model_detections:
                self.logger.debug(
                    f"{self.camera_config.name} heard {label} with a score of {score} and an rms of {rms}"
                )

Although I have decades of experience with unix/linux, I'm a Docker newbie. Can someone point me at an easy way to make that simple edit on my local copy of Frigate?

--Larry

[NickM-27]

This has already been added to the UI for 0.17

[fahnoe]

Thanks, however I just looked at the 0.17 branch and the debug message does not include rms.

--Larry

[NickM-27]

Like I said, the information is fully available in the UI

[fahnoe]

What I'm asking for is to have the rms value in the debugging output so that I can process the logs after the event to see the score and volume of what is being noticed by the audio detector and from there tune the min_volume and listen list/filters. Maybe having it in the UI is also helpful, but it would be much appreciated in the logs for a simple awk to extract and summarize the information.

--Larry