Back to Top

Pakko De La Torre // Creative Director

"Apple’s Newest Patent That Will Change Your (Augmented) Reality & Health" in Humanizing Tech — Everett Advisors

“Apple’s Newest Patent That Will Change Your (Augmented) Reality & Health” in Humanizing Tech — Everett Advisors

Live streaming plus artificial intelligence to detect 3D objects for navigating virtual worlds, including inside your body

I. The News

In what I consider one of Apple’s most telling patents, save for maybe the original iPhone, they have outlined a complete roadmap for how they plan to “enrich your life” using the device already in your pocket, or maybe over your eyes.

Pokémon Go was only the beginning.

Published a few months back in April 2016, Apple’s latest Augmented Reality patent shows how we might be using our phones and AR headsets in the future. There are 4 selected images below that show the meat of the multi-page, 19-image filing.

It begins with a high level architectural diagram showing how your “access device” (notice they don’t say phone) connects to the network to pull down different layers of functionality: navigation, messaging, media like live streaming video, location, and a new service called Augmented Reality. It then goes on to describe how this service might actually work (described in more detail below).

II. The Insight

Interestingly, the filing also lays out some use cases for various fields. I’m quoting directly from the patent below. These are not my own words. They are what was included in the official patent filing. I think that’s important to understand because they’re giving away exactly how this new tech is going to be used:

While the first two options are enterprise use cases, the latter two are geared more towards the consumer end of the spectrum. It begs the question of how Apple intends to get the 3D computer generated imagery that can be accessed and potentially overlaid on top of the real world.

I think I know the answer.

There’s a 5-person startup in the UK called ScanLab that has been using LIDAR for the past half decade to create nearly photo-realistic, full color 3D scans of interior structures or exterior monuments. We already know that Andreessen Horowitz is interested in them. ScanLab has created the full color scanning technology but also software to “blind” it for privacy purposes when you don’t want your physical structure, or potentially yourself, to be scanned.

It’s fascinating and incredibly valuable tech.

III. The Future Product

We don’t have to make this product that complex. Start with ScanLab’s scanner attached to a drone to map as much of 3D space as you can, both inside and outside. Remember that little ball from Prometheus that scanned the tunnels of the alien world? Yah, cool stuff just like that.

Or, using the tech from the LinX Imaging acquisition, make some 3D point maps of human faces.

Like Google Maps street view cars that roam the world creating 2D images, you need a method to get this 3D scanning technology to capture point clouds all over the world. What’s the best way to do that? You include it in Apple’s next gen iPhone with dual or quad cameras for tracking the beginnings of 360 degree space.

Finally, strap on some Apple AR goggles to view the newly created scene and find your way to meet up with Joe, talking to him on the way completely hands free. Then, go to work. Or go have fun.

IV. Blockers to Building It

Obviously there are some major blockers here if you’re looking to compete with Apple in this space:

There are other blockers you need to contend with, but I wouldn’t advise even trying to go head to head on a product like this unless you’re Google, Amazon, or Apple. Even Facebook would have a hard time with this one.

More practically, what you should start preparing for is how you’re going to use this new platform to help you launch your own new startup or continue growing your existing brand.

— Sean

This content was originally published here.