Vllm Realtime API

A protocol-level feature built on top of

Vllm Streaming Requests' low latency, inspired by OpenAI's Realtime API as a WebSocket-based interface. WebSocket communication protocol between client and server for bidirectional real-time streaming of audio/text