Google introduced Magic Pointer, a smart mouse pointer that works with real-time context awareness. The feature was revealed on May 12th by DeepMind, the company’s artificial intelligence research division. The tool is already being tested on the Google AI Studio and will be integrated into the new AI laptop, the Googlebook, scheduled for launch in late 2024.
Magic Pointer operates simply. A slight movement of the pointer activates the system, which reads the screen content in full context and processes the information using AI models. Diferente of AI tools confined to dedicated windows, Magic Pointer works directly in the user interface. Você does not need to write long and specific commands. Basta select a range of content and give a general instruction so that the AI understands the situation and takes the corresponding action.
Funcionalidades practices demonstrated
The Magic Pointer demo showed examples of use in spreadsheets. By positioning the cursor over two columns and saying “Merge”, the system instantly integrated them into a single column. The feature also works in other contexts, such as image editing and location on maps. DeepMind released the main application scenarios:
- Mesclagem automatic columns in spreadsheets with simple command
- Seleção and quick editing of multiple elements in images
- Browser-integrated contextual Pesquisa without helper windows
- Comparação automatic product selection when selecting multiple items on web pages
- Ativação from Gemini directly by cursor for specific tasks
Integração with Chrome and Gemini
Google explained that Magic Pointer will also function as an activator for Gemini, the artificial intelligence integrated into the Chrome browser. If a user selects multiple products on a web page and says “Compare”, Gemini will automatically compare these items without needing to open additional tabs. Essa integration seeks to simplify common workflows and reduce time spent on repetitive tasks.
The Chrome browser will receive native support for the feature, allowing users to trigger Gemini’s AI capabilities through direct on-page selections. Esse interaction model marks a move away from conventional interfaces based on long textual prompts towards a system of more natural and contextualized commands.
Disponibilidade current and future
Usuários interested in testing Magic Pointer do not need to wait for the release of Googlebook. A beta version is now available on the Google AI Studio, where you can try the feature in image editing and map search scenarios. Access to the trial version allows you to evaluate system accuracy and provide feedback before full integration into the new laptop.
The launch of the Googlebook with integrated Magic Pointer is scheduled for the end of 2024. The machine represents the deepening of the Google strategy in hardware with native AI, following trends established by competitors such as Apple and Microsoft with their own integrated assistants. The positioning of the Magic Pointer as a differentiator suggests that the Google sees interaction with AI not as a separate add-on, but as a central part of the device experience.