Google introduces Magic Pointer, an AI tool that simplifies tasks in real time
Google announced Magic Pointer, a smart pointer that works in real-time context and uses artificial intelligence to recognize on-screen content. The tool was developed by DeepMind, the company’s AI research division, and revealed on May 12. The system is already being tested on the Google AI Studio and will be integrated into the new Googlebook notes application, scheduled for launch in late 2024.
Como works Magic Pointer
The Magic Pointer operates in a simple and intuitive way. Quando the user moves the pointer slightly, the system is activated and reads the screen content using artificial intelligence to process information. Diferente From other AI tools limited to specific windows, Magic Pointer works directly in the user interface without the need for long and specific commands. The user simply selects varied content and provides general instructions, allowing the AI to understand the context and take the corresponding action.
More on this story: Google introduces Magic Pointer with artificial intelligence for new Googlebook
Funcionalidades practices demonstrated
Nos tests of Magic Pointer, examples of use in electronic spreadsheets were presented. Quando the cursor is positioned over two columns and the user says “merge”, the system automatically merges them into a single column. Essa functionality also operates in other contexts, such as image editing and map searching. The tool demonstrates versatility in multiple applications.
- Mesclar columns in spreadsheets with simple commands.
- Selecionar and edit multiple elements in images quickly.
- Buscar items on web pages without using browser help windows.
- Comparar products automatically when selected on shopping sites.
- Ativar or Gemini directly by cursor for specific tasks.
Integração with Chrome and Gemini
Google explained that Magic Pointer will act as an activator for Gemini, the artificial intelligence integrated into the Chrome browser. Quando a user selects multiple products on one page and says “compare”, Gemini opens an additional tab and automatically compares the items without needing to open new tabs. Essa integration simplifies common workflows, saving time on repetitive tasks. The dialog model was developed to move away from traditional interfaces based on long prompts, seeking more natural and contextualized commands.
See Also
Anonymous fan funds Thimbleweed Park 2 and frees creator from publishers
Consortium led by Jeff Bezos and Eduardo Saverin buys 30% of Liverpool
Cristiano Ronaldo and Georgina’s agreement shields fortunes in official union
The Chrome browser will receive native support for this functionality, allowing users to trigger AI features through direct on-page selections. Essa approach represents an evolution in the way people interact with digital assistants, making the process more fluid and less dependent on complex instructions.
Disponibilidade current and future prospects
Usuários interested in testing Magic Pointer do not need to wait for the release of Googlebook. The beta version is now available on Google AI Studio, where you can try the tool in image editing and map search scenarios. When accessing the trial version, the system evaluates its accuracy and provides feedback for improvements before full integration into the new notes app.
The launch of the Googlebook is scheduled for the end of 2024, marking the official entry of the Magic Pointer into the market. Essa initiative reflects Google’s strategy to deepen its presence in hardware-integrated AI assistants, following trends established by Apple and Microsoft. Magic Pointer’s position as a differentiator indicates that Google is centering the user experience around natural interactions with AI, cementing the role of artificial intelligence as a core element of modern devices.
