We have already discussed Virtual Reality vs. Augmented Reality and the related terms, but now it’s time to get acquainted with the concept of Mixed Reality aka Hybrid Reality. This term is a combination of both Virtual and Augmented Reality and is gradually taking over the market with its highly impressive capabilities.

Mixed Reality is what lies between the real and virtual worlds and despite being a mix; it functions as an independent technology. It’s a much stronger and higher level of reality technology that encompasses all kinds of variations made in a virtual or real environment.

To get a clearer idea, let’s move on to the details:

In 1994, Paul Milgram and Fumio Kishino defined mixed reality as something that lies “anywhere between the extrema of the virtuality continuum.” This Reality-Virtuality Continuum extends from the real environment, followed by augmented reality and augmented virtuality, to the virtual environment.

As you can see in the above diagram, the two extreme ends of the continuum are denoted as a real environment and virtual environment. The former is completely real with no computer-generated data while the latter contains an environment where everything is computer generated. In between, there are two technologies namely

Augmented Reality:  In this, virtual information is layered on to the real world scene where users can experience virtually created visuals, aurals, and feelings. For example, using Smart glasses or other headsets, while playing a video game, would cut you off from the real world.

Augmented Virtuality:  This is the inverse condition where real world objects are inserted into a computer-generated virtual world. Example, using an app for the interior decoration or remodeling of any part of the house, presents a digital view of the real objects.

Mixed Reality can be defined as virtual spaces where physical and digital objects co-exist and interact with each other in real-time. In a broader sense, it includes augmented reality, augmented virtuality, and other kinds of mixed configurations. In such an environment the user is free to navigate through both virtual and real surroundings, whereby virtual objects are anchored into the real world space.

This technology makes use of sensors, advanced optics, and next-gen computing powers that are stacked into a device (usually headset). By using this device, the user can overlay virtual objects in real space and time, interact with them, and manipulate them; where everything appears to be “real”.

Mixed Reality maps a physical environment into a 3D image and hence evaluates where exactly to place the digital content in the real space. It creates surroundings where the use of the transparent lens, spatial sound along with the understanding of the physical environment allows the display of holograms with realistic looks, sound, and behaviour, which can sometimes be felt.

The picture mentioned above is a demonstration of Microsoft HoloLens Gaming System where the user is playing Project X Ray. The device that can be seen in his hands appears in the form of a holographic gauntlet which is the weapon to fight enemies. While playing the game, the user is free to move around the room and would hear the sound as if it’s all happening in the same room. 

Another amazing fact about this technology is that the robots in the game know exactly where the walls and furniture are located and they can use this information to plan attacks on the player. There are different modes and there is even a holographic shield that can protect the player from larger robots.

The use of MR technology is not just restricted to the video games and entertainment. There are numerous fields and ways in which we can use MR to interact, play, learn and communicate with the virtual world in a real setup.

Given below are some of the applications of Mixed Reality:

Not only this, but the entire session can also be recorded and played. Besides, being a 3D representation, it can be miniaturized and seen with all the different perspectives. It’s almost like traveling in time and being able to watch the memories with all possible angles.

As technology has already brought significant changes in education, Mixed Reality is going to enhance it even more with all the detailing and descriptive visuals. Project Esper is one such venture by 3D4Medical Lab which aims to aid medical students in learning about anatomy by using Augmented and Mixed Reality. 

Using this technology, students can have a detailed view of the human body with all the parts and organs they need to zoom in or zoom out through hand gestures. It would also display details of the organs selected by the user. Moreover, students can even record and play the lessons and learn things through digital 3D images.

Since Mixed Reality combines physical objects in real spaces with the virtual elements, there needs to be some relevant content with every object that has to be utilised as a part of the technology. So, an AR startup named Blippar is working on a real-time deep learning engine using advanced computer vision. 

Through this technology, almost all the everyday objects will be recognized and some amount of digital content will be displayed on the top of these objects through web. Instead of using voice or written commands, it would simply need your eyes to unlock search queries and would display information like the nutrition value of a fruit, recipe of a food item, or store locations of a commodity.  

Microsoft is making efforts to change the way people watch sports on their television. We already have features like pausing live telecasts and recording them to be viewed later or casting images and videos from mobile phones to television and even browse internet on the TV sets. 

But the next big thing is going to be an exciting feature of HoloLens that would allow users to have a 360 degree view of the game on TV, where the off-screen area is automatically projected on the walls. They would also be able to view a holographic 3D view of the game on their coffee table or zoom in to focus on a particular player through hand gestures. It’s still early to reach the masses, but things are changing gradually for sure. 

Another example is explained in a video released by Windows where a girl is required to set up a shoe store for a group of clients. With the help of Microsoft HoloLens she is able to move holograms around the space in real-time and even take design inspirations to prepare the whole interior. If this could happen in the future, it would completely change the way business deals are performed in business.