OpenAI is best known for its advanced Large Language Models (LLM), which are used to power some of the most popular AI chatbots, such as ChatGPT and Copilot. Multimodal models can take chatbot functionality to new heights by unlocking a new range of visual applications. OpenAI has just made its application available to developers.
On Tuesday, OpenAI announced via a post on X (formerly Twitter) that its latest GPT-4 Turbo model with vision capabilities, GPT-4 Turbo with Vision, is now generally available to developers via the OpenAI API. Did.
Also: How to use ChatGPT
This latest model maintains GPT-4 Turbo's 128,000 token window and knowledge cutoff from December 2023. The main difference is the visual ability to understand images and visual content.
Before GPT-4 Turbo with Vision was available, developers had to call separate models for text and images. Now, developers can simply call his one model that can do both, simplifying the process and opening the door to a wide range of use cases.
Also: Best AI Image Generators of 2024: Tests and Reviews
OpenAI shared some of the ways developers are already using this model, and they're very exciting.
For example, Devin, an AI software engineering assistant, leverages GPT-4 Turbo with Vision to better help him code. Health and fitness app Healthify uses GPT-4 Turbo with Vision to scan photos of users' meals and provide nutritional insights through photo recognition. Finally, Make Real uses his GPT-4 Turbo with Vision to transform your drawings into working websites.
The GPT-4 Turbo with Vision model is not yet available within ChatGPT or to the public, but OpenAI teased that it will soon be available in ChatGPT. If you are a developer who wants to start using OpenAI's GPT-4 Turbo with Vision API, you can learn how to get started here.
