minor simli updates

[aconchillo]

Please describe the changes in your PR. If it is addressing an issue, please reference that as well.

[markbackman]

Looks like AudioFrame needs to be imported from av.audio.frame`. My IDE was complaining otherwise.

Suggested change

	from av import AudioFrame
	from av.audio.frame import AudioFrame

[aconchillo]

Done

[markbackman]

I'm experiencing crackling audio when the bot starts speaking. And I get this error line in the logs which scrolls continuously:

[swscaler @ 0x148008000] No accelerated colorspace conversion found from yuv420p to rgb24.

In comparing to the current version on main, this one runs, so that's good!

It would be ideal to sort of this issue. We can merge this and just open an issue if the problem isn't obvious.

[markbackman]

Sometimes I also get two audio stream outputs that happen offset and concurrently. Have you seen that?

[aconchillo]

Sometimes I also get two audio stream outputs that happen offset and concurrently. Have you seen that?

Yes, my bad. Just fixed it. The way this works is: Pipecat sends audio to Simli and then Simli sends audio back that is synchronized with the video and that's the one we send to the transport. The only issue is that the bot is always speaking since we are always getting audio (silence though...).

[markbackman]

Do we want to move forward with this? On one hand, the current version that's on main is not working. On the other, this isn't performing well, at least for me. Maybe we merge it and revisit the colorspace acceleration issue?

[markbackman]

I'm approving to fix main. @aconchillo can you add an issue to track improving this one?

[aconchillo]

I'm approving to fix main. @aconchillo can you add an issue to track improving this one?

You mean this one, right?

[swscaler @ 0x148008000] No accelerated colorspace conversion found from yuv420p to rgb24.

[markbackman]

I'm approving to fix main. @aconchillo can you add an issue to track improving this one?

You mean this one, right?

[swscaler @ 0x148008000] No accelerated colorspace conversion found from yuv420p to rgb24.

That's right

[aconchillo]

I'm approving to fix main. @aconchillo can you add an issue to track improving this one?

You mean this one, right?

[swscaler @ 0x148008000] No accelerated colorspace conversion found from yuv420p to rgb24.

That's right

Added #825

I believe it's the the ffmpeg build on PyAV for macOS (which simli uses). I don't have this issue on Linux.