The iPhone maker is considering incorporating a multispectral image capture system into the lenses of its next smartphones. This unprecedented mechanism can record light frequencies that human eyes cannot see, overcoming the limitations of traditional sensors. By combining this novelty with advanced algorithms, the company hopes to make a leap in the way the device understands photographed materials and processes visual files.
Information from Asian manufacturing partners suggests that the technology giant has already started conversations with parts manufacturers to make the idea viable. The company’s central goal is to ensure that the software can cut and isolate elements of a scene with absolute perfection. As a result, intelligent visual search tools, which gained prominence in the latest updates to the brand’s operating system, would have much better performance.
Technology sector analysts estimate that the change would make the current modules based on the red, green and blue color standard completely obsolete. Despite the market’s enthusiasm, the project remains in the internal testing phase in Cupertino laboratories, with no official forecast for its debut in a specific generation of the cell phone.
How light capture beyond the visible spectrum works
The great advantage of this photographic format is its ability to absorb varied electromagnetic waves, including even the near infrared. While ordinary lenses operate restricted to the basic combination of three primary colors, the new hardware collects an extra layer of metadata capable of exposing physical properties invisible to the naked eye.
For all of this to work, the mechanism depends on tiny optical filters that divide light frequencies, delivering a deep reading of the composition of objects. The biggest engineering hurdle today is shrinking all this optical complexity so that it fits neatly into the rear camera module of a pocketable device.
Real gains in the quality of photographic processing
The practical application of this advanced reading results in portraits where the background blur occurs organically, with no flaws in the contours of the person being photographed. The device’s digital brain uses the extra load of data to know exactly what is human skin, what is a piece of clothing or what is a plant in the scene.
This level of detail drives so-called computational photography, a field in which the manufacturer has already invested heavily for years. Functions recognized by users, such as capturing in dark environments and merging multiple exposures, tend to deliver sharper results with almost zero grain, regardless of the lighting in the location.
The fundamental role of artificial intelligence in new hardware
The brand’s visual search system, designed to answer questions about any item pointed to by the lens, will be the biggest beneficiary of this innovation. With spectral reading, the cell phone will be able to quickly tell the exact species of a flower or even evaluate the freshness of a food on the market shelf, making the tool much more useful in everyday life.
All this volume of information will be decoded directly on the smartphone’s processor, ensuring that user data does not need to go to the cloud. As software evolves, the expectation is that new exclusive tools will be created precisely to take advantage of this in-depth reading of the environment.
Main uses of technology in users’ daily lives
- Accurate mapping of complex textures, preventing hairs from disappearing in portrait mode.
- Intelligent reading of surfaces that reflect light, such as water mirrors and car bodywork.
- Detailed evaluation of foliage, opening doors for applications focused on botany and agriculture.
- Extreme fidelity in tone reproduction, correcting distortions caused by fluorescent or LED lamps.
All of these improvements transform the smartphone into a robust piece of equipment, serving both those who take casual photos and those who work professionally with images.
The trajectory of innovations in the brand’s smartphone lenses
Since the first generation of the device, the North American company has made significant leaps in image capture, implementing physically larger sensors and mechanical stabilization systems. The most expensive versions in the current catalog already boast a triple set of lenses supported by aggressive correction software, dictating the rules of the mobile market.
Research into multispectral capture shows that the manufacturer continues to look for alternatives that go beyond the obvious. Instead of just increasing the megapixel count for marketing purposes, the strategy focuses on delivering files richer in data and functions that really make the consumer’s life easier.
Absolute control over the operating system ensures that any new parts added to the device work at their maximum capacity from day one. It is common for annual software updates to unlock new photographic tricks, even for those who have cell phones from previous generations.
Unprecedented precision in cutting elements and surfaces
The ability to differentiate materials simply by the way they bounce specific frequencies of light is an asset that conventional lenses will never have. This physical reading of the environment makes it easier to identify boundaries between objects, even when the entire scene has very similar colors or is under heavy fog.
When it comes to photographing people, the algorithm can perfectly isolate the texture of a woolen blouse against a brick background, for example. This eliminates once and for all those bizarre errors where a piece of the ear or glasses ends up blurred by the simulated depth of field effect.
The automatic white balance also gains weight, ensuring that people’s skin does not appear yellowish or bluish depending on the lamp in the room. For content creators, this means having a much cleaner digital file ready to receive editing filters in professional software.
Engineering obstacles to component adoption
The biggest puzzle for engineers is creating a set of glass and sensors that does all this without creating a giant lump on the back of the cell phone. In addition to the physical issue, processing so many layers of invisible light drains the battery quickly, which requires deep reprogramming of the processor’s artificial intelligence core.
To overcome these bottlenecks, the technology giant maintains daily contact with partner factories in search of a component that is powerful but uses little energy. Several prototypes undergo stress tests on assembly lines before management approves the part’s inclusion in millions of commercial units.
How third-party applications will exploit the new feature
Independent programmers will have access to this sea of invisible data through official tools provided by the manufacturer. This paves the way for health platforms to be able to map skin blemishes with clinical rigor, or for augmented reality games to insert virtual characters into the environment with impeccable lighting physics.
The smartphone ecosystem will be updated in stages to support this extra visual processing load. Anyone who invests in devices equipped with the new lens will have access to an application store full of utilities that simply won’t open on older models.
Differences between the new sensor and current smartphone radars
While the current LiDAR sensor works like a laser radar focused on measuring the physical distance between the cell phone and the wall, the multispectral lens wants to understand what that wall is made of. When the two technologies work together, the device will have a perfect 3D map of the environment, both in volume and chemical composition.
The current standard of mobile photography sees the world exactly as we do, which greatly limits data analysis by algorithms. By breaking this visual barrier, the mobile device transforms into a scientific analysis tool disguised as a phone.
The Apple company is trying to maintain its crown in the competitive pocket camera market by focusing on solutions that combine exclusive hardware and tailored software. Although rival brands based on Android are already testing similar concepts, the strict control that the company has over its own operating system usually guarantees a more fluid user experience.
The transition to lenses capable of reading beyond the visible marks the next major chapter in the history of pocket photography, fitting perfectly with the current race for artificial intelligence running directly on the device. Collecting hidden information in the environment turns your cell phone into a definitive visual assistant, capable of analyzing a plant’s health or ensuring the perfect photo at a poorly lit show. The manufacturer continues to analyze the cost-benefit of these parts to ensure that the change does not make the final product unfeasibly expensive. It is likely that the more expensive versions of the next generations will receive the new feature first, serving as a test for advanced visual search functions. This entire movement reinforces the thesis that the future of smartphones is not in the screen format, but in the ability to understand the world around. The technology market is now waiting for the traditional September events to find out when this optical revolution will hit the shelves.
