Can I train fastconformer cache aware streaming architecture with TDT decoder?

[hassan-webm]

Here would it work if I define loss and decoding to TDT?
https://github.com/NVIDIA/NeMo/blob/main/examples/asr/conf/fastconformer/cache_aware_streaming/fastconformer_transducer_bpe_streaming.yaml

similar to this:
https://github.com/NVIDIA/NeMo/blob/main/examples/asr/conf/conformer/tdt/conformer_tdt_bpe.yaml

Will it work? Any guide or leads on this?

[JRD971000]

Hi @pzelasko @stevehuang52, I assume you would be the right person to look into this?

[stevehuang52]

I haven't tried, but the code should work, since the cache-aware part is only related to the encoder, while TDT/RNNT/CTC shouldn't matter.