OpenAI Releases GPT-4o Mini: Its Fastest and Cheapest Small Language Model

GPT-4o Mini is OpenAI's latest small language model. It is fast and 60% cheaper than the GPT-3.5 Turbo.

Jul 19, 2024

∙ Paid

OpenAI has unveiled a new addition to its AI model lineup: the GPT-4o mini. This new model is much more affordable and intelligent small model that’s just as fast as GPT-3.5 Turbo. Similar to GPT-4o, GPT-4o mini has a 128k context window and a knowledge cut-off date of October 2023.

What is GPT-4o mini?

GPT-4o mini is designed to be more cost-efficient and accessible than its larger counterparts.

Here are some details about the new model:

Intelligence: GPT-4o Mini outperforms GPT-3.5 Turbo in textual intelligence, scoring 82% on MMLU compared to 69.8%, and excels in multimodal reasoning.
Price: GPT-4o Mini is over 60% cheaper than GPT-3.5 Turbo, costing 15 cents per 1 million input tokens and 60 cents per 1 million output tokens, roughly equivalent to 2,500 pages in a standard book.
Modalities: GPT-4o Mini currently supports both text and vision capabilities. OpenAI plans to add support for audio and video inputs and outputs in the future.
Languages: GPT-4o Mini has enhanced multilingual understanding compared to GPT-3.5 Turbo, performing better across a wide range of non-English languages.

Fun fact: The cost per token of GPT-4o mini has dropped by 99% since text-davinci-003, a less capable model introduced in 2022.

Evaluation Benchmarks

GPT-4o Mini is a small model that excels in textual intelligence and multimodal reasoning, outperforming GPT-3.5 Turbo and other small models across various academic benchmarks.

It supports the same range of languages as GPT-4o and shows strong performance in function calling and long-context tasks.

Evaluation Benchmarks GPT-4o Mini is a small model that excels in textual intelligence and multimodal reasoning, outperforming GPT-3.5 Turbo and other small models across various academic benchmarks. — Image from OpenAI

Key evaluation scores for GPT-4o Mini include:

Reasoning Tasks: Scored 82.0% on MMLU, compared to 77.9% for Gemini Flash and 73.8% for Claude Haiku.
Math and Coding Proficiency: Achieved 87.0% on MGSM (math reasoning) and 87.2% on HumanEval (coding), surpassing Gemini Flash and Claude Haiku.
Multimodal Reasoning: Scored 59.4% on MMMU, outperforming Gemini Flash and Claude Haiku.

API Pricing

OpenAI has made GPT-4o mini very affordable:

Keep reading with a 7-day free trial

Subscribe to Generative AI Publication to keep reading this post and get 7 days of free access to the full post archives.