8th Sense - Empowering Safety in Mixed Reality

Shakthi Warnakualsuriya
5 min readFeb 23, 2024

--

Photo by Igor Omilaev on Unsplash

Stepping into the Metaverse, But Not Under a Bus: Why Safety Needs a Head Start in XR

Imagine this: you're walking down a busy sidewalk, immersed in a stunning, interactive scene projected through your Apple Vision Pro headset. Suddenly, a virtual dragon swoops low, nearly clipping your head (virtually, of course). You flinch, startled back to reality, only to narrowly avoid colliding with a real delivery cyclist buzzing past. Sounds exciting right? Not exactly.

The highly awaited arrival of Apple’s Vision Pro promises to immerse us in a mixed reality world, blurring the lines between the physical and digital worlds. But while we eagerly await the ability to battle virtual dragons, a real threat looms — distracted walking and the vulnerability for accidents.

Remember Pokémon Go? That seemingly harmless AR game was the cause of thousands of traffic accidents and even deaths just months after its release. Now, imagine that multiplied tenfold with a fully-fledged XR headset like Vision Pro.

This isn’t just about protecting ourselves from virtual dragons (though that would be nice). Distracted walking, especially in busy areas, poses a genuine risk to ourselves and those around us. The sobering statistics of distracted driving accidents serve as an obvious warning: we can’t afford to repeat those mistakes in the virtual world. This is not only true for busy places but also for lonely roads at night, where we can be vulnerable to criminals. (especially for girls).

So, before we dive headfirst into the Metaverse, we need a safety net. This article explores a proposed solution: “8th sense” an app designed to run seamlessly in the background of Vision Pro, prioritizing user safety and fostering confidence in navigating this exciting, yet potentially risky, new landscape. Buckle up (figuratively, for now), and let’s explore how technology can help us step into the future, safely and with eyes wide open.

Research & Analysis: A World of Wonder, But Not Without Its Worries

Remember that delivery cyclist you almost mowed down while battling your virtual dragon? It’s not just a hypothetical near-miss. The dangers of distracted walking are very real, and the statistics paint a worrying picture.

  • Pokémon Go’s AR adventure: Remember the summer of 2016, filled with Pikachu sightings and cautionary tales? Studies like the one published in Injury Prevention (Ono et al., 2018) linked the game to a staggering 256 deaths and 150,000 traffic accidents in Japan alone, costing billions in just 148 days. These numbers offer a chilling glimpse into the potential impact of widespread XR adoption.
  • Distracted driving’s deadly dance: The U.S. Department of Transportation paints a grim picture. In 2021, 3,522 people died from distracted driving, a 12% increase from the previous year. Now see the footage below from YouTube. If this continues think how much of a threat Apple Vision Pro can actually be.

These headlines scream the truth — we’re not prepared for the potential dangers of a hyper-immersive world. But fear not! Let's dive into the proposed solution, which is designed to be your guardian angel in the mixed reality realm.

Introducing 8th Sense: Your Guardian Angel in XR

What is “8th Sense” you may ask, imagine an invisible guardian angel watching your back as you explore the wonders of mixed reality. That’s the essence of the “8th Sense” app, designed to seamlessly run in the background of your Apple Vision Pro headset, keeping you safe and confident in this exciting new world.

Think of it like an eighth sense for the digital age (apparently, there are many senses pass 5th sense defined in the internet, that's why the app name isn't 6th sense). While you’re engrossed in virtual dragons or exploring augmented cityscapes, the 8th Sense app works tirelessly behind the scenes:

  • Real-time monitoring: It acts as your digital eyes and ears, constantly scanning your surroundings for potential hazards like oncoming traffic, obstacles, or even distracted pedestrians.
  • Subtle safety warnings: No blaring alarms or annoying pop-ups. The app discreetly nudges you back to reality with gentle vibrations and visual cues, ensuring you stay aware of your physical environment.
  • Threat detection and reporting: Feeling unsafe in a virtual space? The app empowers you to discreetly detect and report harassment or other threats, fostering a safe and respectful XR community.
  • Feeling unsafe walking at night: The advanced AI of the app can detect if someone’s following you and warn you with guidance on how to handle the situation while keeping you safe.
  • Safe navigation assistance: Need help navigating busy intersections or avoiding virtual obstacles? The app provides subtle guidance, keeping you on track and collision-free.

But the 8th Sense app doesn’t stop there. It prioritizes your privacy and control, allowing you to customize settings and choose the level of assistance you need. This ensures you stay safe without sacrificing the immersive experience you want.

The 8th Sense app isn’t just about avoiding virtual dragons; it’s about bridging the gap between the thrills of XR and the realities of our physical world. It’s your guardian angel, ensuring you can confidently explore the Metaverse, one safe step at a time.

Conclusion: Stepping into the Future, Together

The 8th Sense app is more than just a solution; it’s a starting point. We envision a future where XR technology empowers us to explore, connect, and create while prioritising safety and inclusivity. But building this future requires collaboration.

We invite you, the dreamers, the doers, the tech wizards, and the safety champions, to join us on this journey. Share your ideas, expertise, and feedback. Let’s refine the 8th Sense app together, shaping it into a guardian angel for everyone ready to dive into the mixed reality realm.

We’re open to comments, suggestions, and wild ideas! You can reach us directly (LinkedIn) or visit our Google Drive (link here) to access the design files and contribute your magic touch.

Remember, the XR world is a canvas waiting to be painted. Let’s paint it together, with safety as our guiding brushstroke.

A special thanks to the amazing team (DesignNoobs) @rrandari7, Jaindu, Bhagya, and Buddhima. Your collaboration has been invaluable! from refining the idea to building nice UIs as the first step in bringing the idea to life.

Let’s make the 8th Sense app a reality, and together, step into a future where XR is synonymous with wonder and safety.

--

--

Shakthi Warnakualsuriya
Shakthi Warnakualsuriya

Written by Shakthi Warnakualsuriya

DevOps Engineering Intern @IFS | GitHub Campus Expert | Computer Science Undergraduate at the University of Westminster | AI and ML enthusiast

No responses yet