Google introduces Magic Pointer with artificial intelligence for new Googlebook

Google announced Magic Pointer, a real-time context-aware smart mouse pointer. The tool was developed by DeepMind, the company’s artificial intelligence research division, and publicly revealed on May 12. The system is already in the testing phase on the Google AI Studio and will be integrated into the new Googlebook artificial intelligence notebook, scheduled for launch at the end of 2024.

Como works Magic Pointer

The Magic Pointer operates in a simple and intuitive way. Quando the user moves the pointer on the screen, the system is automatically activated and reads the visual content in full context. The artificial intelligence model processes the captured information and performs corresponding actions. Diferente From other artificial intelligence tools restricted to specialized windows, Magic Pointer works directly in the user interface without the need for long and specific commands. The user simply selects different content and provides general instructions so that the artificial intelligence understands the situation and takes the appropriate action.

Funcionalidades practices demonstrated

Nos tests of Magic Pointer, examples of use in spreadsheets were presented. Quando the cursor is positioned over two columns and the user says “merge”, the system immediately merges them into a single column. The functionality also operates in other contexts, such as image editing and map searches. DeepMind released the main application scenarios for the resource:

• Mescla automatic columns in spreadsheets with simple commands.
• Seleção quickly multiple elements in images for editing.
• Busca in browsers without using helper windows.
• Automatic Comparação of products on web pages when selecting items.
• Direct Ativação from Gemini for specific tasks via the cursor.

Integração with Chrome and Gemini

Google explained that Magic Pointer works as an activator for Gemini, the artificial intelligence integrated into the Chrome browser. Quando the user selects multiple products on a page and says “compare”, Gemini opens an additional tab and automatically compares the items. Essa integration simplifies common workflows and reduces time spent on repetitive tasks. The Chrome browser will receive native support for this functionality, allowing users to trigger artificial intelligence features through direct selections on the page.

Leia Tambem

Romantic comedies and mysteries arrive on Netflix in June with Office Passion and Oasis

Uruguay announces squad list for the 2026 World Cup with six Brazilian football players

When does the 2026 World Cup start? Date, time, first game and opening ceremony

The dialogue model was developed based on long text prompts, demonstrating evolution in relation to traditional interfaces. The system seeks greater naturalness in the context, moving away from artificial commands and moving towards more intuitive interactions. Essa approach represents Google’s goal of creating a command system that naturally adapts to the user’s workflow.

Disponibilidade current and future prospects

Usuários interested in Magic Pointer do not need to wait for Googlebook to be released. The beta version is now available on Google AI Studio, allowing testing in image editing scenarios and map searches. When accessing the trial version, the system evaluates the tool’s accuracy and provides feedback for improvements before full integration into the new laptop. The launch of Googlebook is scheduled for the end of 2024, consolidating the Google strategy on hardware with integrated artificial intelligence.

Magic Pointer marks the deepening of Google’s strategy in hardware-embedded artificial intelligence assistants. Empresas like Apple and Microsoft have already set similar trends with their own built-in wizards. The positioning of Google demonstrates fierce competition in the notebook market with native artificial intelligence. Magic Pointer’s differentiator lies in its approach of centralizing artificial intelligence interaction not as a separate tool, but as an essential component of the on-device user experience.