Google unveiled Magic Pointer, a smart mouse pointer that works with real-time context awareness. The tool was presented on May 12 by DeepMind, the company’s artificial intelligence research division. The feature is already being tested on the Google AI Studio and will be integrated into the Googlebook, a new AI laptop scheduled for launch in late 2024.
Como works Magic Pointer
The Magic Pointer operates intuitively and without the need for complex commands. A simple movement of the pointer activates the system, which reads the screen content in full context and processes the information using advanced artificial intelligence models. Diferente From traditional AI tools confined to dedicated windows, Magic Pointer works directly within the user interface, enabling more natural and faster interactions.
On the same topic: Google introduces Magic Pointer, an AI tool that simplifies tasks in real time
The user does not need to write long and specific instructions. Basta select a range of content and give a general instruction so that the AI understands the situation and takes the corresponding action. Esse interaction model marks a departure from conventional interfaces based on textual prompts towards a more natural and contextualized command system.
Funcionalidades practices demonstrated
The Magic Pointer demo showed examples of use in spreadsheets, images and web browsing. By positioning the cursor over two columns in a spreadsheet and saying “Merge”, the system instantly merged them into a single column. The feature also works in other contexts, such as image editing and location on maps. DeepMind released the main application scenarios:
More on this story: Google introduces Magic Pointer with artificial intelligence for new Googlebook
- Mesclagem automatic columns in spreadsheets with simple command
- Seleção and quick editing of multiple elements in images
- Browser-integrated contextual Pesquisa without helper windows
- Comparação automatic product selection when selecting multiple items on web pages
- Ativação from Gemini directly by cursor for specific tasks
Integração with Chrome and Gemini
Magic Pointer will act as an activator for Gemini, the artificial intelligence integrated into the Chrome browser. If a user selects multiple products on a web page and says “Compare”, Gemini will automatically compare these items without needing to open additional tabs. Essa integration seeks to simplify common workflows and reduce time spent on repetitive tasks.
The Chrome browser will receive native support for the feature, allowing users to trigger Gemini’s AI capabilities through direct on-page selections. Esse model marks an evolution in the forms of interaction between humans and machines, making the experience more fluid and less dependent on traditional interfaces.
Disponibilidade and release
Usuários interested in testing Magic Pointer do not need to wait for the release of Googlebook. A beta version is now available on the Google AI Studio, where you can try the feature in image editing and map search scenarios. Access to the trial version allows you to evaluate system accuracy and provide feedback before full integration into the new laptop. The launch of Googlebook with integrated Magic Pointer is scheduled for the end of 2024, representing the deepening of the Google strategy on hardware with native artificial intelligence.