Loading videos in grayscale

[mdivyanshu97]

🚀 The feature

Hey, first of all thank you so much for this library. It has reduced by training time at least by half. I work with medical data and it is usually in grey-scale. I was wondering if the library supports loading directly in grayscale format similar to FFmpeg with parameter format = 'gray'. I am currently loading the video in rgb and then doing a PyTorch Grayscale transform but as you can guess, this is making the process slower. I was wondering if the library already supports or it is easy to support this functionality.

Thank you again.

Motivation, pitch

No response

[NicolasHug]

Hi @mdivyanshu97 and thank you for your feedback!

TorchCodec doesn't support native grayscale conversion for now, so we recommend relying on torchvision's Grayscale transform, as you're currently doing.

Native grayscale conversion is in scope for TorchCodec, I think we will eventually implement it via the more general native transform API discussed in #526. This is still WIP, so I can't share an ETA with you at the moment.

[mdivyanshu97]

Thank you @NicolasHug . The idea of passing transforms directly to the library sounds great and I think will definitely improve the video-processing speeds even further.

Thanks again and eager to try new functionalities of the amazing library.