ComfyUI Realtime

I built a OpenAI Realtime SDK compatible speech-to-speech engine in ComfyUI.

I needed:

• Realtime s2s with easily swappable LLM models
• Flexible TTS model options for character voices
• Speedy local performance, even on an old M1 Macbook
• To stop throwing money at the OpenAI Realtime API

I landed on building this as a custom node in ComfyUI because I was already using ComfyUI extensively under the hood for my realtime storytelling app. You can learn more about it in my blog post: Telling stories at the speed of now with ComfyUI Realtime.