Pokémon Go hunters power delivery robots and war drones with data

Pokémon Go - reprodução

Pokémon Go - reprodução

The resounding success of the game Pokémon Go, which from 2016 mobilized millions of people globally in a search for virtual creatures in the real world, had an unexpected development with considerable technological impact. Unbeknownst to most players, the simple activity of hunting a Pikachu or Charmander through the streets contributed to the formation of an extensive visual database. This material is now being used to develop advanced navigation systems for autonomous delivery robots and, even more surprisingly, for drones used in military operations.

The situation, which mixes digital entertainment with dual-use technological advances, reignites important debates about data privacy and corporate responsibility in the use of information collected from its users. The case strikingly illustrates how “collective intelligence”, generated through recreational activities, can be redirected towards high-impact applications in various spheres.

The massive collection of images behind the virtual fun

Niantic, the developer behind the popular augmented reality game, introduced a key feature in 2021: so-called PokéStops. This tool encouraged players to record and upload videos of local points of interest, such as monuments, buildings and other urban features, under the justification of “improving the gaming experience” for the community. What seemed like a harmless addition to enrich the virtual environment was, in reality, a gigantic visual data acquisition operation.

In total, it is estimated that an impressive 30 billion image records have been accumulated, effectively transforming each player into an “observer” for the construction of a digital map. This vast compilation of visual data from streets, building facades and other elements of the urban environment has become the foundation for mapping technology that is significantly more advanced than previously available conventional solutions.

Uncovering Niantic’s Visual Positioning System (VPS)

With the immense volume of images collected, Niantic was able to develop what is known as a Visual Positioning System (VPS), a “digital twin” of urban areas. Unlike traditional GPS (Global Positioning System), which relies exclusively on satellite signals and can be inaccurate or fail in complex environments — such as in urban valleys full of tall buildings, inside buildings or in areas with a lot of interference — VPS uses visual references for triangulation.

VPS operates by comparing images captured by a camera in real time with its vast database of previously mapped 3D images. It identifies unique features in the environment, such as building corners, signs and posts, and calculates the exact location and orientation of a device with centimeter precision. This allows robots and drones to navigate autonomously and safely, even in locations where the GPS signal is intermittent or non-existent, offering an extra layer of robustness and reliability for navigation in challenging scenarios.

From food delivery to war scenarios: the uses of technology

High accuracy and the ability to operate in environments that make traditional positioning difficult have made Niantic’s VPS a valuable tool for a variety of applications, spanning both the commercial and military sectors. These solutions demonstrate the versatility, but also the duality inherent in many modern technologies and the potential uses that can arise.

  • Autonomous delivery robots:Companies like Coco Robotics, in the United States, have already integrated VPS technology with their GPS systems. Coco’s delivery robots use these 3D maps to navigate sidewalks and streets, avoiding obstacles and delivering efficiently in dense urban areas, where precision is critical for safety and continuous operation.
  • Military drones:In the field of defense, Vantor, a company specializing in the weapons industry, established a partnership with Niantic. VPS’s 3D technology is combined with aerial mapping performed by military drones, elevating situational awareness on battlefields. This integration allows drones to operate with greater autonomy and accuracy in reconnaissance, surveillance missions or even in combat zones where traditional navigation can be compromised or completely denied.

The privacy debate and the ethics of unintentional collaboration

The use of player data for military or commercial purposes without the explicit and informed consent of users is a central point of concern. Many Pokémon Go players, when filming their surroundings, probably didn’t imagine that these images could be used to train the navigation systems of war drones. This highlights the urgent need for greater transparency in technology companies’ terms of service and privacy policies.

The case underscores the growing complexity of the data ecosystem, where seemingly harmless information collected for entertainment can have significant implications in areas such as national security and advanced automation. The discussion extends to companies’ responsibility to clearly communicate the potential for data use and the need for users to understand the vast consequences of their digital interactions, even the most casual ones, in the face of a constantly evolving technological landscape.