[Java SDK] Recognition never finishes for specific files

[boris-petrov]

• Speech SDK log taken from a run that exhibits the reported issue.
  log.txt

• A stripped down, simplified version of your source code that exhibits the issue. Or, preferably, try to reproduce the problem with one of the public samples in this repository (or a minimally modified version of it), and share the code.
  It will happen with any sample. Depends on the audio file - see below.

• If relevant, a WAV file of your input audio.
  Any WAV file with an mp2 codec will do. For example, generate one with the following command: ffmpeg -y -f lavfi -i sine=frequency=1000:duration=5 -c:a mp2 -ac 2 -f wav a.wav

• Additional information as shown below

Describe the bug

As I mentioned in the title of the issue - the recognition "blocks" and never finishes. The sessionStarted event is called but nothing more. In the logs I see [230605]: 9ms SPX_TRACE_ERROR: exception.cpp:123 About to throw Exception with an error code: 0x1b (SPXERR_RUNTIME_ERROR) - I guess that's relevant.

To Reproduce

Any code for recognition - use a file that is with an mp2 codec - see above.

Expected behavior

Some error in some of the callbacks that the file is not supported.

Version of the Cognitive Services Speech SDK

1.32.1

Platform, Operating System, and Programming Language

• OS: [e.g. Windows, Linux, Android, iOS, ...] - Arch Linux
• Hardware - x64
• Programming language: Java
• Browser [e.g. Chrome, Safari] (if applicable) - N/A

[rhurey]

Thanks for trying out the Speech SDK and reaching out with this problem...

The Speech SDK can natively consume wav files with some constant bit rate codecs, like mu-law, PCM, and a-law. This is due to connection recovery and reconnect needing to be able to restart audio play from arbitrary locations in the audio stream. If you need to use another codec with the speech SDK, the SDK can use GStreamer to decompress it. Instructions on using GStreamer can be found here.

In this case the log shows that ffmpeg is writing a wav header that has 0 as the bytes per second for the audio. (Thanks for the log, btw)

[boris-petrov]

@rhurey thanks for the answer! I do know that the SDK can use GStreamer, yes. However, I don't want to use it (for some reasons) - I would like for the SDK to notify me on any errors (which I can handle on my own). In this case the SDK just silently blows up and tells me nothing about it. There is no way for me to know if the SDK is still working on the file or there is something wrong. That's clearly not a good thing. 😄 Hence this bug-report. It's not about why this particular file doesn't work. It's about the fact that the SDK doesn't notify clients on (certain) errors.

[rhurey]

Ahhh. I see. Thanks for clearing that up.

I've got the problem repro'd and tracked down to an ignored return value in the Java implementation.

[github-actions]

This item has been open without activity for 19 days. Provide a comment on status and remove "update needed" label.

[pankopon]

I've got the problem repro'd and tracked down to an ignored return value in the Java implementation.

@rhurey Any fix or work item for this?

[pankopon]

Internal work item ref. 5755477 (no ETA).

[github-actions]

This item has been open without activity for 19 days. Provide a comment on status and remove "update needed" label.