We recently covered a (at that point unnamed) VR project by developer Tomáš “Frooxius” Mariančík, the mind behind the stunning ‘Sightline’ VR series of demos. The project fused Leap Motion skeletal hand tracking with Oculus Rift DK2 positional tracking to produce an impressively intuitive VR interface. Now, a new video of the interface  shows impressive progress. We catch up with Tomáš to find out some more about this mysterious VR project.

Enter the ‘World of Comenius’

The virtual reality resurgence that is currently underway, necessarily and predictably concentrates on bringing people new ways to consume and experience media and games. This is where virtual reality has the best chance of breaking through as a viable technology, one that will appeal to consumers worldwide. But virtual reality’s greatest impact, at least in terms of historical worth to society, could and probably will come in the form of non-entertainment based fields.

Using the power of VR to teach is something we’ll see more and more of, primarily because it addresses the age-old duality between a Teacher’s ability to teach and a pupil’s capacity to be engaged with and grasp the subject. Also, the capacity VR has to convey difficult concepts is an excitingly untapped spring, that could help people understand things they’d previously found difficult to grasp. A good example is the now classic Oculus Rift demo Titans of Space, an application that succeeded in presenting the vastness of celestial bodies been so eloquently and effectively.

World of Comenius aims to draw on the legacy of a 17th Century Czech teacher (the titular John Amos Comenius), to demonstrate how future educational applications might present and allow users to interact with teaching materials. It’s the name of a new project Mariančík is working on. As we featured recently, it uses the innovative motion controller Leap Motion mounted on the face of a DK2 to detect the user’s hands and fingers, interpreting the gestures as input to control the virtual environment.

What’s it All About?

The project has intrigued us since we first saw it, so when Tomáš sent us the new video we asked him to tell us a little more about the project’s origins and its goals.

I’m working on this teamed up with some people from VR Union – people behind the RiftUP [project] (also working on [a] 5K HMD now), with me doing most of the design and development at the moment, but we’re looking to expand the team.

The project, called “World of Comenius” is an educational software that aims to utilize the VR to show people things that weren’t possible before: Play around with atoms and get intuitive “feel” of their behavior on the quantum level, swim in the cell or meet with people from history and explore the environment they lived in, while having feeling that they’re actually in there.

There’s a lot more to it though, but we’re keeping the best bits under wraps for now.

So, when will the project see the light of day?

On October 20th we’re launching a pilot project (for which this demo is built for) on a progressive secondary school here in Czech Republic: Mendelovo Gymnázium in the city Opava. We’ve got various media invited to the event as well as people from the Czech government (institute of education), so hoping something good will come out of it.

A commendable aim then. So, where does he see the project going from here and into the future?

We’ve also applied for grant from EU [European Union] in the EU Horizon 2020 project, thanks to another person we’re working with, doc. Petr Klan, who has been doing educational projects for over 30 years and helping get young people into science and engineering (including myself, which is how I met him).

Now we’re also cooperating with Mechatronic Education, a company which does educational robots (like the one in the Comenius demo which we put there) and helps us get in touch with other important people in the educational system.

Back to the ways in which virtual reality can improve the education process for those who traditional methods may lack efficacy:

But most importantly, we’re developing World of Comenius because of personal experiences with educational system (especially myself and Karel Hulec – the guy who started the RiftUP project) – we love learning, but not the way most schools teach and we want to provide something that allows people learn more naturally and intuitively and make it fun even.

So it was born out of the passion for VR, making new unique things and learning.

World of Comenius seems to be that rarest of projects, one that takes new technology and harnesses it to break ground in areas that may prove beneficial to society in general. It’s the first project of its kind that has demonstrated to me a killer app for Leap Motion in VR and at the same time shows the possibilities for VR outside of traditional games and media consumption.

Road to VR’s 2023 Game of the Year Awards

What’s more, Tomáš is becoming a leading light in the VR development community, demonstrating seemingly endless creative ability and inspiring new developers entering the field. For these reasons, Tomáš “Frooxius” Mariančík is a name to watch in the coming months and years as VR gains momentum. We can’t wait to see what he comes up with next.

You can find more info on his various projects here and you can keep an eye on World of Comenius at the homepage here.

Newsletter graphic

This article may contain affiliate links. If you click an affiliate link and buy a product we may receive a small commission which helps support the publication. More information.

Based in the UK, Paul has been immersed in interactive entertainment for the best part of 27 years and has followed advances in gaming with a passionate fervour. His obsession with graphical fidelity over the years has had him branded a ‘graphics whore’ (which he views as the highest compliment) more than once and he holds a particular candle for the dream of the ultimate immersive gaming experience. Having followed and been disappointed by the original VR explosion of the 90s, he then founded RiftVR.com to follow the new and exciting prospect of the rebirth of VR in products like the Oculus Rift. Paul joined forces with Ben to help build the new Road to VR in preparation for what he sees as VR’s coming of age over the next few years.
  • mellott124

    Demo looks impressive but I’ve never been able to get the Leap VR to work anywhere near that well. Not sure why. I would love for it to actually work like that.

    • Karel Hulec

      But to be honest, the gestures are presented by Tomas, he has already a lot of experience, knows the limits of the tracking and doesn’t go beyond what’s “trackable”. That and non IR reflectant surface behind hands are the reason why this looks so awesome. (And is.)

      We are in direct contact with Leap Motion Inc. and are cooperating to make the experience http://youtu.be/GDpmVUEjagg?t=60s (better :P)

      Do you have by a chance early dev. Leap Motion? Those are not working well for VR usage at all.

      • mellott124

        We have one of the first units you could buy at BestBuy. Is there a difference?

        • akk99

          Alex from the Leap community team has been really helpful to me with troubleshooting in the past – his email is acolgan@leapmotion.com.

  • Curtrock

    Not only is this application of VR totally kick-ass, but the LEAP functionality shows it to be a main contender for VR interaction/input. Exciting times. Congrats, Frooxius….u are helping to lead the way! Respect.

  • akk99

    This is a really exciting demo! Thanks Frooxius.