OpenAI Developers

We’ve put together a reference implementation for building and orchestrating agentic patterns using the Realtime API. You can use this repo to prototype a voice app using multi-agent flows in less than 20 minutes! 

https://github.com/openai/openai-realtime-agents

Building with the Realtime API can be complex because of the low-latency, synchronous nature of voice interactions. This repo includes best practices we’ve learned for managing this complexity, like:

- Orchestrating agent handoffs (inspired by Swarm)
- Background escalation to o1 for advanced decision making
- Improving model instruction following by defining a state machine in the prompt
- Demos of applying these patterns to customer service and front desk use cases

It also includes a meta-prompt to make it fast and easy to define new agents with a range of personalities, and uses the newer, simpler WebRTC interface.

Here’s @noahmacca with more details on these best practices. Let us know what you think! 

We’ve put together some best practices on using our o-series models:

🤔 Differences between our reasoning and non-reasoning models
💡 When to use reasoning models
💬 How to approach prompting reasoning models effectively

GPT models focus on fast, cost‑efficient, straightforward task execution—“the workhorses.” 🐎

o‑series models excel at handling ambiguous, multi‑step tasks in domains such as math, engineering, legal, and finance—“the planners.” 🧠

Use o-series models to process unstructured data, find a needle in a haystack, improve code, or handle other complex tasks. For example, o1’s vision capabilities can analyze detailed architectural drawings. In this image, o1 recognized that “PT” wood posts were pressure-treated. 

As some of you have noticed, avoid “boomer prompts” with o-series models. Instead, be simple and direct, with specific guidelines.

Delimiters (xml tags) will help keep things clean for the model, and improve output.

Read the full best practices guide: https://platform.openai.com/docs/guides/reasoning-best-practices