Detection of primates (monkeys)

[sundeepgoel72]

Hi,

I have a large monkey presence where I live, to the extent they feel comfortable coming into the house and helping themselves to items in the refrigerator.

I was wondering if frigate can be used to detect "them" i.e. the monkeys ? if yes, please guide on the configuration settings to enable this.

My setup is

1. Rpi5 4GB
2. Halio8 TPU
3. Frigate+ with yolo9 model
4. multiple cameras with person / face detection working fine.

[inkeep-ai-assistant[bot]]

Frigate supports custom object detection classes through its Frigate+ subscription and custom models(1). If you are using a Frigate+ YOLOv9 model, the supported object classes depend on the model you are using and the labelmap provided with it(1). For detecting monkeys (primates), you need to ensure that your Frigate+ model was trained to recognize "monkey" or a similar class in its labelmap.

To check or enable detection of monkeys:

1. Verify if "monkey" is present in your model's labelmap. The labelmap is typically referenced in your configuration under model.labelmap_path. For example:

   model:
     path: plus://<model_id>
     labelmap_path: /labelmap.txt
   

   If "monkey" is not present, your model will not detect them(2).

2. If the label is present, add it to the objects you want to track:

   objects:
     track:
       - person
       - monkey
   

   This will instruct Frigate to track both people and monkeys(2).

3. If "monkey" is not included in your current Frigate+ YOLOv9 model, you would need to use the Frigate+ fine-tuning workflow to train your model with images of monkeys, or request a model that supports this class from the Frigate+ service(1).

Your hardware (Raspberry Pi 5 + Hailo8 TPU) is compatible with Frigate and custom models(1).

📚 Sources:

1. Supported Hardware
2. Full Reference Config

---

Have another question? Just tag @inkeep.

[hawkeye217]

You can find the full list of labels and candidate labels in the official documentation: https://docs.frigate.video/plus/#available-label-types

[sundeepgoel72]

You can find the full list of labels and candidate labels in the official documentation: https://docs.frigate.video/plus/#available-label-types

Thanks hawkeye, the went through the list - monkeys arent on it _(under animal or candidate label). Any suggestion on next steps to include / train the model ?

[hawkeye217]

Right, until enough users request monkey as a possible label, and then until monkey actually becomes a label for detectable objects in Frigate+, there's no way to accomplish what you're looking for. You could train a custom model yourself, but that involves many technical steps and is beyond the scope of Frigate support.

[sundeepgoel72]

You could train a custom model yourself, but that involves many technical steps and is beyond the scope of Frigate support

1. Is there any way i can re-train a fine-tuned model that I get from the frigate+ site as part of my subscription? if yes, could you point me to a guide on how to do this, and i will give it a shot.
2. Can i add custom labels when submitting to plus - or is that limited to standard labels only ?

[hawkeye217]

No, neither of those things are possible.