Google unveiled Gemini 1.5 Pro with the ability to process one-hour videos

Google, which last week renamed its Bard chatbot to Gemini, has now unveiled the Gemini 1.5 Pro model, which is designed as a replacement for the Gemini 1.0 Pro. The performance of the Gemini 1.5 Pro has improved in some areas over its predecessor, with perhaps the most significant improvement being the amount of data it can process.

According to Google's statement, Gemini 1.5 Pro can write about 700,000 words or 30,000 lines of code (35 times more than Gemini 1.0 Pro) and is a multimodal model, meaning its functionality is not limited to text. Additionally, the Gemini 1.5 Pro can capture up to 11 hours of audio or one hour of video in multiple languages.

Gemini 1.5 Pro, which has been available since yesterday (as a limited preview version) to most developers and customers, can initially only process 100,000 words at a time. Also, only approved developers are allowed to test it through Google's GenAI AI Studio developer tool. Additionally, some customers using Google's Vertex AI platform also have access to Gemini 1.5 Pro.

Google DeepMind's vice president of research has mentioned this model as a great achievement and says:

“When you interact with GenAI models, the information you input and receive becomes context, and the longer and more complex your questions and interactions are, the longer the context the model needs. “We have enabled long field access in a very broad way.”

The context of an AI model refers to the input data (eg text) that the model must consider before producing its output. A simple question, like “Who won the 2020 US presidential election?” Or even a script, email, or e-book can serve as context.