ChatGPT's Most Exciting New AI Feature | Medium

ChatGPT’s Most Exciting New Feature

Thinking with Images is Insanely Powerful

Ignacio de Gregorio

9 min read

Just now

Source: Author using GPT-4o

Out of all the overhyped news and features presented by OpenAI’s new models, o3 and o4-mini, there’s one that I believe is underhyped, and we haven't yet realized its incredible power.

Dubbed ‘Thinking with Images’ by OpenAI, it allows models to include images in their change of thought. This is the first instance of multi-step multimodal reasoning, and the results we're observing, just days into the release, are extraordinary.

I’ve been following this industry for years, and this is one of those times that AI feels like actual magic.

Read below to understand what this feature is and, crucially, how it works.

First principles analysis and AI in a world filled with false experts using incomprehensible jargon don’t usually go together.
But in my newsletter, they do. This article is a shortened version one of my latest articles. Consider subscribing if you want that extra knowledge that puts you ahead of those ahead.