Key Features and Limitations of DeepMind’s Gemini 1.5 Pro

Gemini 1.5 Pro, an AI by Google DeepMind, has a long context window allowing it to remember long passages, read entire books, and recall details from large codebases or even movies. It can be used for tasks like summarizing lectures or workout sessions, listing books on a shelf, or finding details in lengthy documents. However, it has a quadratic computational and memory complexity, meaning processing time increases exponentially with the amount of data. Despite this, it has shown impressive accuracy and even learned an endangered language.

via DeepMind’s New AI Remembers 10,000,000 Tokens!