Different models for Coral

[tom0010]

Is anyone using a different model for their Coral, and if so, which are you using?

I've seen some discussions around people using different models but interested to see if there's anything better than the default model that frigate ships with for the Coral.

I'm interested in better accuracy and I've seen that some yolo models are slightly better, but the discussions seem around Frigate 13.
Example here: #11548

[hawkeye217]

Coral devices are specifically designed to accelerate TensorFlow Lite models that have been quantized to 8-bit integers and compiled using Google's Edge TPU compiler.

YOLO models are indeed more accurate because they are usually implemented in frameworks like PyTorch or Darknet and use 32-bit floating-point operations.

To run a YOLO model on Coral, you would need to convert it to TensorFlow/TensorFlow Lite format, quantize it to INT8, and ensure all operations are supported by the Edge TPU - a process that often requires significant model modifications and may not preserve the original model's accuracy. Additionally, many YOLO architectures contain operations or layer types that aren't supported by the Edge TPU's specialized instruction set, making direct deployment impossible without substantial reworking of the model architecture.

And finally, many of the freely available TensorFlow and YOLO models are all based on the same COCO dataset, which has not been trained on images specific to security cameras.

If you're looking for more accuracy, you might consider new hardware - like a Hailo or MemryX. Support for the Hailo 8/8L already exists in Frigate 0.16 while support for the MemryX MX3 is coming in Frigate 0.17. And while it's not a separate piece of dedicated hardware, an Intel iGPU can also run many YOLO variants very well.

[AmirHosseinOmidi0]

what is the default model for coral ?
ssd moiblenet?

[NickM-27]

In Frigate the default coral model is ssdlite mobiledet

[dbro]

Yes you can try running a YOLO v9 "s" 320x320 model on Coral using the model file, detector plug-in, and labels from this repo:
https://github.com/dbro/frigate-detector-edgetpu-yolo9
As @hawkeye217 said, it took some effort to get it to run well on the Coral, although the model structure was not changed, just the activation function was changed to ReLU6 instead of SiLU.

The YOLO v9 model's detection latency is about 11ms (vs 7ms for mobiledet). I see fewer false positives than I did when running mobiledet.

[tom0010]

@dbro I’ve been following your post on Reddit, and I was waiting for a 320 model. I’ve just deployed this on version 16.1, and getting around 8-9ms interference speed. Thanks for the work, would much rather run the coral than the iGPU.