Points of Interest in XR (S01/E27)

In the world of Extended Reality (XR), which encompasses Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR), there's a term that's gaining traction: "Point of Interest" or POI.

Oct 05, 2023

But what does it mean, and why is it important? Let's break it down in simple words.

1. What is a Point of Interest (POI)?

Imagine you're wearing a pair of AR glasses while walking in a park. Suddenly, a virtual butterfly appears, fluttering around a real tree. That tree becomes a "point of interest" because it's a specific location where the virtual and real worlds interact.

In XR, a POI is any specific location or object that draws the user's attention, either because it has virtual elements added to it or because it's significant in the virtual storyline.

2. Why is Localization Important in XR?

Localization is the technology that determines where you are in the real world and how you relate to the virtual elements around you. Think of it as a super-advanced GPS for the XR world. Without accurate localization, that virtual butterfly might appear floating in the air instead of near the tree, ruining the immersive experience.

3. Technologies Powering XR Localization

GPS:** Just like the technology that guides you on road trips, GPS can be used in outdoor XR experiences. However, it's not super precise, so it's often combined with other technologies.
Computer Vision: This is like giving your XR device a pair of eyes. Using cameras, the device can "see" and recognize objects and landmarks, helping it understand where it is.
Inertial Measurement Units (IMUs): These are tiny sensors inside your XR device that detect movement and orientation. They're like the inner ear of your device, helping it understand if you're tilting your head or moving forward.
SLAM (Simultaneous Localization and Mapping): This is a fancy term for a technology that allows XR devices to map an environment while keeping track of their position within it. It's like if you were blindfolded in a room, but as you walked around, you could still create a mental map of where everything is.

4. Challenges in XR Localization

Localization isn't always perfect. Here are some challenges:

Drift: Over time, an XR device might start to lose track of its exact position, leading to a "drift" in the virtual elements. It's like when you're daydreaming, and suddenly you realize you've walked past your destination.
Occlusions: Sometimes, objects (like people or furniture) can block the device's view, making it hard to determine a POI accurately.
Indoor vs. Outdoor: While GPS works great outdoors, it's not as effective indoors. That's why other technologies like SLAM become crucial in places like museums or malls.

5. The Future of Localization in XR

As XR becomes a bigger part of our daily lives, the demand for better localization will grow. We might see:

Improved Hardware: Faster processors, better cameras, and more advanced sensors will make localization more accurate.
Cloud Integration: By connecting XR devices to the cloud, they can access vast amounts of data to help with localization, like detailed maps or object databases.
Collaboration with AI: Artificial Intelligence can help XR devices "learn" from their environment, making localization smarter over time.

Conclusion

Points of Interest in XR are like magical spots where the virtual and real worlds meet. But to make that magic happen, we need powerful localization technologies. As we continue to innovate, the line between what's real and what's virtual will blur, creating experiences we can only dream of today.

Companies using POI in their products

1. Niantic, Inc.

Product/Service: Pokémon GO
Use of POI: Leveraged AR to overlay Pokémon characters in real-world locations, turning landmarks and other places into "PokéStops" and "Gyms".

2. Snap Inc.

Product/Service: Snapchat
Use of POI: Introduced AR Landmarkers, which allows users to interact with famous landmarks around the world through augmented reality lenses.

3. Google

Product/Service: Google Maps AR walking directions
Use of POI: Provides AR directions overlaid on the real world, pointing out landmarks and other points of interest to help users navigate.

4. svarmony Technologies

Product/Service: aryve indoor navigation
Use of POI: Uses AR to provide navigation and information about various points of interest in buildings like airports / shopping malls / museums.

5. Magic Leap

Product/Service: Various AR experiences for Magic Leap One
Use of POI: Many of their applications integrate real-world locations with virtual content, creating points of interest for users.

6. Yelp

Product/Service: Yelp Monocle
Use of POI: An AR feature that allows users to see nearby businesses and their ratings by pointing their phone in a particular direction.

8. Wikitude by Qualcomm

Product/Service: Wikitude AR SDK
Use of POI: Provides tools for businesses to create AR experiences anchored to real-world locations, turning them into points of interest.

8. Layar (acquired by Blippar)

Product/Service: Layar AR app
Use of POI - One of the early AR browsers, it allowed users to see digital information overlaid on the real world, highlighting various points of interest.

9. Zappar

Product/Service: Various AR experiences
Use of POI: Offers tools and solutions for businesses to create AR content tied to specific real-world locations or objects.