Got stuck with define bytes as api input

[ntvuongg]

Here is my code:

class SpeechRecognizerRunnable(bentoml.Runnable):
    SUPPORTED_RESOURCES = ("nvidia.com/gpu",)
    SUPPORTS_CPU_MULTI_THREADING = True

    def __init__(self) -> None:
        self.__asr_model = ASRModel(model_size="medium")
        self.__vad_model = VADModel()

    @bentoml.Runnable.method(batchable=True, batch_dim=0)
    def predict(self, audio_bytes: bytes) -> str:
        return audio_transcriber(audio_bytes, self.__asr_model, self.__vad_model)
    
asr_runner = bentoml.Runner(SpeechRecognizerRunnable)
svc = bentoml.Service("asr_service", runners= [asr_runner])

@svc.api(input=bytes, output=str) # Error right here
async def transcribe(audio_bytes: bytes) -> str:
    text = await asr_runner.predict.async_run(audio_bytes)
    return text

Then I got this: AttributeError: type object 'ByteString' has no attribute 'input_type'
Please help me define bytes type in bentoml. Thanks for your help.

[parano]

Hi @ntvuongg , could you share a bit more about what you're looking to implement here?

This section about working with files input/output might be helpful: https://docs.bentoml.com/en/latest/guides/iotypes.html#files