Add WEBM-OPUS Streaming Support (iOS + Android) #566
Description
Summary:
I would like to request support for real-time streaming in WebM-Opus format on both iOS and Android. Currently, we are handling raw PCM or OGG/Opus streams and then converting them afterwards. This adds latency, increases processing overhead, and complicates the pipeline. Direct WebM-Opus streaming would greatly improve efficiency and compatibility.
Why This Feature Is Needed
- WebM-Opus is lightweight, high-quality, and browser-friendly.
- Eliminates the need to convert PCM → Opus → WebM manually.
- Reduces CPU usage and battery consumption during streaming.
- Ensures cross-platform consistency between iOS and Android.
- Works seamlessly for live audio streaming, chat apps, AI assistant audio, and voice messaging.
Requested Feature
Add support for:
✅ Real-time WebM-Opus Encoder (Mobile Friendly)
- Accepts PCM byte chunks (16-bit, 16kHz) or microphone input.
- Encodes Opus frames (20ms / 480 samples recommended).
- Wraps Opus packets into a WebM container in real time.
- Streams output as continuous WebM bytes.