OpenAI Developers
@OpenAIDevs
We’ve put together a reference implementation for building and orchestrating agentic patterns using the Realtime API. You can use this repo to prototype a voice app using multi-agent flows in less than 20 minutes! https://github.com/openai/open...
Building with the Realtime API can be complex because of the low-latency, synchronous nature of voice interactions. This repo includes best practices we’ve learned for managing this complexity, like: - Orchestrating agent handoffs (inspired by Swarm) - Background escalation to o1 for advanced decision making - Improving model instruction following by defining a state machine in the prompt - Demos of applying these patterns to customer service and front desk use cases
It also includes a meta-prompt to make it fast and easy to define new agents with a range of personalities, and uses the newer, simpler WebRTC interface.
Here’s @noahmacca with more details on these best practices. Let us know what you think!