There’s a lot that can be said about the Magic Leap One. It’s trying to do a ton—eye-tracking, hand-tracking, 6DoF controllers, real-time meshing and a number of other features that haven’t been seen in a mobile MR device before. And although its OS and apps don’t fully utilize the tech available to them, Magic Leap One is an ambitious, well-made, but imperfect MR devkit that doesn’t quite live up to the hype, but is still the most complete and affordable mixed-reality (MR) computer out there.
Guest Article by Lucas Rizzotto
Lucas Rizzotto is an award-winning Immersive Experience Designer, Artist and Creator. He’s part of the team behind Where Thoughts Go, and has developed several other MR projects.
Part 1: The Hardware
If you’re not familiar, a mixed reality computer is a device that interacts with your senses and understands your physical space. It uses that information to allow you you to place digital objects in your world that feel real.
The Magic Leap One consists of three elements: a light-pack, a headset and a controller — all of these components are beautifully designed, with colorful lights coming from unexpected places.
The headset is lightweight, easy to put on and comfortable, and that allowed me to use it for hours on end without tiring up my neck. It usually sits well on your head if you don’t move it too quickly, but can fall out of place if you perform extreme actions such as running. I also felt some heat on my forehead after a few hours of use due to the placement of one of the processing units.
The controller is intuitive, comfortable to hold and works well in most cases, although I’ve noticed some considerable delay in the 6DoF tracking. Magic Leap says this is unusual, but I’m still waiting for a fix.
The light-pack carries the bulk of the processing power for the ML1, so it is the heaviest object of the bunch. It’s actually quite heavy when you hold it on your hand, but the weight disappears when you clip it in your pocket — this has some trade-offs, however: the pocket-centered design ignores the possibility that users may be wearing things like a dress or more elastic pants that wouldn’t provide a strong grip.
Adding a bit of complexity to the UX are wires that can tangle in the user’s clothes and limbs if they’re not careful. This makes trying out the Magic Leap One a little bit awkward as the user is set up for a potential accident. For example, while I was stress-testing the device the light-pack fell from my pocket at one point due to the type of pants I was wearing and the thick wires briefly choked me as they got stuck around my neck and almost brought the headset down.
Thankfully, Magic Leap sells an optional $40 strap that allows you to wear the light-pack over your shoulder. This option was universally preferred by me and my colleagues due to its friendly and context-agnostic nature, but it should have been a part of the original packet.
Update: While the strap is listed as a $40 item on the website, I was just told by Magic Leap that they’ve been making them free for all those who purchase it with their device. This was unclear at the time of my purchase and I ended up not getting one.
— Lucas Rizzotto (@_LucasRizzotto) August 11, 2018
Magic Leap One’s display is great, but a bit less crisp and legible than 2016’s HoloLens. ML1 supports a higher field-of-view than the HoloLens, but it seems to have done it by sacrificing image resolution, which can make text cloudy. Its lenses are also considerably darker to compensate for lack of image brightness, which can sometimes remove you too much from the environment.
The display can showcase some occasional visual artifacts at times, the strangest one being an “oily” texture that appears when you’re looking at brightly-colored virtual objects. Artifacts are nothing new in the realm of Mixed Reality, but they will start showing up if you start looking.
Magic Leap has for a long time talked about the “multi-focal light-field” properties of its display, and chances are you won’t notice it in action. Apparently it’s one of those features that is working if you’re not noticing it, so it’s hard to make an assessment of how much of a difference it actually makes.
This video is perhaps the best demonstration of how reading through the display feels like, minus some absent visual artifacts.
Issues aside, most components of the product come together well enough to make the ML1 a very capable platform for developers to build experiences for. The Magic Leap has catching up to do in some areas of the headset, but it was a joy to play with at first pass.
Part 2: Spatial Meshing & Tracking
Magic Leap One’s real-time meshing is solid, responsive and relatively fast, being comparable to the higher-end tracking solutions we see today.
How is the #MagicLeap's tracking? Pretty good (but with flaws)
A tracking-phase on startup does most of the heavy lifting and is complemented by real time updates. Tracking works pretty well for the most part, but falters with black objects or reflective surfaces. pic.twitter.com/09LDGow3Ve
— Lucas Rizzotto (@_LucasRizzotto) August 10, 2018
While the meshing process isn’t perfect and can miss reflective surfaces, as well as black objects, this stands as a common issue in AR in general. Developers must pick the rooms they choose to exhibit this in carefully to guarantee an ideal experience.
The Magic Leap One also had a hard time recognizing rooms that were already previously scanned and constantly asked me to re-scan my environment every time I booted up the device. This would be easy to overlook, but it messes with one of the coolest things in MR: is digital object persistence (virtual objects you place in the real world staying where you placed them in between sessions). I hope this is something they improve in an update.
For the most part, the tracking of virtual objects feels solid with only the occasional jittering, which was never too noticeable in my experience with the device. All and all, tracking and real-time meshing of the Magic Leap One works well and lags only a bit behind the HoloLens in terms of accuracy.
— Lucas Rizzotto (@_LucasRizzotto) August 10, 2018
But what about the diverse forms of input tracking?
Eye-tracking has worked pretty well in the small tests that I’ve done and is one of the things I’m most excited for. Eye-tracking offers so many exciting new possibilities for telling stories and creating interfaces (a topic I explored in a separate article) and I’m excited to see how people turn this into a key aspect of this device.
Hand-tracking is also here, but it can feel pretty limited if you’ve played with other superior forms of tracking like the Leap Motion. It’s more about tracking entire hands than it is about tracking individual fingers, although it does track some movement of the thumb and the index finger.
The 6DoF controller works through magnetic tracking and it’s generally good, but as mentioned before, it has presented me with some positional tracking issues that I’m hoping will be resolved.
All things aside, the fact that the device has eye-tracking, hand-tracking and a 6DoF controller is impressive and it’s a solid enough toolbox for people to create natural interfaces with, especially when you add voice recognition on top of it all. Now we just have to see how developers will choose to use it and how these features will improve throughout the year.