OpenAI DevDay 2024: New Realtime API, Prompt Caching, and More

Realtime API enables developers to build low-latency, multimodal conversational capabilities into their applications. Get ready for a new wave of real-time voice apps!

It’s only been a few days since some big names, like former CTO Mira Murati, left OpenAI. So, seeing Sam Altman up there on stage for DevDay, talking about new products for developers, feels a bit odd. 

With all these changes at the company, you can’t help but wonder: should we still trust him?

But that’s not the focus here. Let’s set the drama aside for a second and look at what DevDay was really about — the new tools OpenAI just announced for developers. 

OpenAI has certainly packed a lot into this year’s event, and while the leadership changes are concerning, it’s clear the company is still pushing forward. In fact, there’s quite a bit of progress worth unpacking.

In case you missed DevDay last year in 2023, here’s a quick update on the progress made since then:

• 98% decrease in cost per token from GPT-4 to 4o mini

• 50x increase in token volume across their systems

• Significant model intelligence progress

For the rest of the article, we’ll explore the three biggest announcements in today’s DevDay event.

1. Realtime API

2. Prompt Caching

3. Vision Fine-Tuning