Google introduces Magic Pointer, an AI tool that simplifies tasks in real time

Google announced Magic Pointer, a smart pointer that works in real-time context and uses artificial intelligence to recognize on-screen content. The tool was developed by DeepMind, the company’s AI research division, and revealed on May 12. The system is already being tested on the Google AI Studio and will be integrated into the new Googlebook notes application, scheduled for launch in late 2024.

Como works Magic Pointer

The Magic Pointer operates in a simple and intuitive way. Quando the user moves the pointer slightly, the system is activated and reads the screen content using artificial intelligence to process information. Diferente From other AI tools limited to specific windows, Magic Pointer works directly in the user interface without the need for long and specific commands. The user simply selects varied content and provides general instructions, allowing the AI ​​to understand the context and take the corresponding action.

Funcionalidades practices demonstrated

Nos tests of Magic Pointer, examples of use in electronic spreadsheets were presented. Quando the cursor is positioned over two columns and the user says “merge”, the system automatically merges them into a single column. Essa functionality also operates in other contexts, such as image editing and map searching. The tool demonstrates versatility in multiple applications.

• Mesclar columns in spreadsheets with simple commands.
• Selecionar and edit multiple elements in images quickly.
• Buscar items on web pages without using browser help windows.
• Comparar products automatically when selected on shopping sites.
• Ativar or Gemini directly by cursor for specific tasks.

Integração with Chrome and Gemini

Google explained that Magic Pointer will act as an activator for Gemini, the artificial intelligence integrated into the Chrome browser. Quando a user selects multiple products on one page and says “compare”, Gemini opens an additional tab and automatically compares the items without needing to open new tabs. Essa integration simplifies common workflows, saving time on repetitive tasks. The dialog model was developed to move away from traditional interfaces based on long prompts, seeking more natural and contextualized commands.

Leia Tambem

Romantic comedies and mysteries arrive on Netflix in June with Office Passion and Oasis

Uruguay announces squad list for the 2026 World Cup with six Brazilian football players

When does the 2026 World Cup start? Date, time, first game and opening ceremony

The Chrome browser will receive native support for this functionality, allowing users to trigger AI features through direct on-page selections. Essa approach represents an evolution in the way people interact with digital assistants, making the process more fluid and less dependent on complex instructions.

Disponibilidade current and future prospects

Usuários interested in testing Magic Pointer do not need to wait for the release of Googlebook. The beta version is now available on Google AI Studio, where you can try the tool in image editing and map search scenarios. When accessing the trial version, the system evaluates its accuracy and provides feedback for improvements before full integration into the new notes app.

The launch of the Googlebook is scheduled for the end of 2024, marking the official entry of the Magic Pointer into the market. Essa initiative reflects Google’s strategy to deepen its presence in hardware-integrated AI assistants, following trends established by Apple and Microsoft. Magic Pointer’s position as a differentiator indicates that Google is centering the user experience around natural interactions with AI, cementing the role of artificial intelligence as a core element of modern devices.