Profile picture of OpenAI Developers

OpenAI Developers

@OpenAIDevs

Published: January 17, 2025
42
464
3.4k

We’ve put together a reference implementation for building and orchestrating agentic patterns using the Realtime API. You can use this repo to prototype a voice app using multi-agent flows in less than 20 minutes! https://github.com/openai/open...

Building with the Realtime API can be complex because of the low-latency, synchronous nature of voice interactions. This repo includes best practices we’ve learned for managing this complexity, like: - Orchestrating agent handoffs (inspired by Swarm) - Background escalation to o1 for advanced decision making - Improving model instruction following by defining a state machine in the prompt - Demos of applying these patterns to customer service and front desk use cases

It also includes a meta-prompt to make it fast and easy to define new agents with a range of personalities, and uses the newer, simpler WebRTC interface.

Here’s @noahmacca with more details on these best practices. Let us know what you think!

Share this thread

Read on Twitter

View original thread

Navigate thread

1/4