Skip to content

Improved zoom augmentations through albumentations. #735

@bw4sz

Description

@bw4sz

One of the core challenges of machine learning for airborne biodiversity observation is trying to generalize across sensors and acquisition conditions. Given low data sizes, data augmentations are crucial for good generalization across resolutions, focal views and object size.

A quick search of albumentations suggests hits a few existing classes that should be useful:

https://huggingface.co/spaces/qubvel-hf/albumentations-demo?transform=Downscale

https://albumentations.ai/docs/api_reference/augmentations/crops/transforms/#albumentations.augmentations.crops.transforms.RandomSizedBBoxSafeCrop

https://huggingface.co/spaces/qubvel-hf/albumentations-demo?transform=RandomSizedBBoxSafeCrop

https://albumentations.ai/docs/api_reference/augmentations/geometric/transforms/#albumentations.augmentations.geometric.transforms.PadIfNeeded

Checklist

  • Implement augmentations in their own module, not within preprocessing. Currently lives inline

    [A.HorizontalFlip(p=0.5), ToTensorV2()],

  • Allow the user to choose the augmentations either through the config file. Careful to allow defaults to remain unchanged and sets reasonable defaults if not specified in existing config files.

  • Make a doc page showing example augmentations

Optional

  • Compare training with augmentations and without when predicting across resolutions.

Metadata

Metadata

Assignees

Labels

APIThis tag is used for small improvements to the readability and usability of the python API.DocsDocumentationIdeas for Machine Learning!These are machine learning ideas and papers that could be useful for DeepForest models. High level.

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions