DIY Guide: Play PC Games with Your Smartphone VR Viewer

34

Since publishing his popular DIY VR headset guide back in 2014, Austin “Ohaple” is back with his latest refinements to the project, allowing you use use your DIY headset (or an off-the-shelf viewer like Google Cardboard) to play PC games by streaming them to your smartphone.


ohaplephotoGuest article by Austin “Ohaple”

Ohaple is a life-long gamer and video producer. In addition to console and PC gaming, Ohaple has been designing, using, and refining his DIY HMD project since 2014. The he enjoys both the immersion of VR as well as the challenges presented by creating a low-budget system.


This article will discuss how you can get the most out of your DIY or Cardboard VR viewer by setting it up to play PC games. If you haven’t seen the previous article on how to make your own smartphone VR viewer, you can see that here. If you don’t want to do that project, products like Google Cardboard or Durovis Dive will also work great for this.

This project will cost $10-60 depending on what you already have, and does not require any real technical knowledge to setup, unlike many LED-tracking methods.

The principal here is to mirror your PC display to your phone’s screen. Because phones do not natively work as monitors for your PC, we will need streaming apps to get the image to the phone. There are many wireless solutions that work, but they often have problems when it comes to quality and latency. By connecting the phone via a sync cable, we can minimize latency and complexity while maximizing image quality.

To tackle motion tracking for the VR experience, we will use a gyroscopic mouse. This has the advantage of being very user-friendly, cheap, and low-latency. Additionally, it can be plugged in and used for VR with little setup, including mainstream games like Fallout 4, GTAV, or Battlefield. The disadvantage of using a gyroscopic mouse for head control is that you cannot decouple the head from the body like in some more advanced VR setups, and you do not get positional tracking.

Here is everything you will need for this project, you may already have most of what you need:

  • Android or iPhone
  • Sync cable (Lightning for iOS or MicroUSB for Android)
  • Smartphone VR viewer (DIY or off-the-shelf)
  • Gyroscopic mouse
  • Over the head headphones
  • Rubber bands or elastic
  • EitherMouse software
  • Duet Display for iPhone or similar for Android
  • Computer
  • Game with SBS 3D support

Step 1: Setting Up Smartphone Mirroring

Duet-App-2

To begin, install your mirroring software of choice. Duet Display works perfectly for iOS (and is the only wired option). There are several similar options for Android, such as iDisplay and AirDisplay. Most of these software suites will have an app to install on your phone, and a desktop utility to install on your PC. Most of the high-end streaming apps will cost $5-15. The free wireless versions that I have tested work, but often are buggy, crash, or have higher latency.

SEE ALSO
'Bounce Arcade' is Like VR Pinball for Your Fists—And Exactly the Kind of Creativity VR Needs to Thrive

Once you have it all installed according to the software’s instructions, test the mirroring and make sure that it is streaming properly. If done correctly, there should be little perceivable latency when turning your phone in your hand, and quality should be as high-bitrate as possible, limited only by the resolution of your phone. Try using the phone as a monitor for some web browsing or other daily tasks to test this.

Note: Many phones with lower display resolution will look fine, but have trouble displaying readable text. By lowering your desktop resolution setting to match the resolution of your phone, more text will be readable. In games, there may be text or HUD size settings. Adjust these to make sure text is readable.

Step 2: Setting Up SBS 3D

minecrift-minecraft-oculus-rift-dk2

Setting up SBS 3D will vary depending on the game you want to play and the method you want to use. I will outline these methods, but once you choose one, be sure to consult the software developer’s instructions for full setup and optimization.

Use a 3D Driver

The second way to create a SBS 3D experience is to use a 3D game driver such as Tridef 3D or VorpX to make games that are 2D appear in great 3D SBS quality. This is one of the most common ways to play popular titles like Fallout, GTA, and Battlefield.

Find a Third-party Mod for a Specific Game

The third way to set up SBS 3D is to install a mod for the game you want to play. This can be a good option for games that are not supported by 3D drivers. One of the most popular games in the category is Minecraft. Here is a link to MinecRift, a great 3D mod for Minecraft. Modding games may lead to your game being unstable or crashing. For some games, modding is against the terms and conditions. Be sure to do your research before installing 3D mods.

Find a Game that Already Supports SBS 3D

One way to get a SBS 3D experience is to play a game that supports SBS 3D natively. These games will often just have a setting that allows you to switch into 3D mode. Many of these games are free, and are marketed toward the Oculus Rift platform. Some of these Oculus Rift games will work great, but many are locked until they detect the Oculus Rift device. These ‘locked’ games will not work with this method. Further, you should look for 3D games that support up/down mouse look as well as left/right mouse look. You can use this database to find some Rift games that will already support SBS 3D. For mainstream and triple-A games that support 3D natively, look to this list.

SEE ALSO
Hands-on: 'Batman: Arkham Shadow' Brings the Series' Signature Combat to VR

Note: Rift demos can be good candidates for use with this method but you’ll have to find older titles built with the Oculus SDK 0.6 or earlier which supports ‘Extended Mode’ (a SBS 3D view directly on your monitor). Newer demos and games won’t work without a Rift headset.

Step 3: Setting Up Gyroscopic Mouse Head Tracking

ohaple-diy-headset-guide

This is where the magic happens. In essence, it’s as simple as plugging in the wireless USB receiver to your PC and using it. There are only two considerations to using a wireless gyroscopic mouse for head tracking, mounting and sensitivity. You can find the gyroscopic mouse I use here.

Mounting the mouse to your smartphone VR viewer is rather simple. We do not want to mount it directly to the headset because it creates too much weight and will cause stress on your face and nose. Instead, we will get more comfortable and accurate tracking if we attach the mouse to the top of the headband of over-the-head headphones. Over-the-head headphones are already one of the best ways to create an immersive VR audio experience, so it works well to integrate them into this system.

The mounting is as simple as looping the rubber band around the front of the mouse, under the headband, and over the backside of the mouse as shown below. You will want to make sure that it is tight enough to keep the mouse from shifting during up and down tilting. Also be careful to check that the rubber band is not pressing any buttons on the mouse.

Tip: Use cloth elastic tied into a loop in order to completely customize the tension and keep from pulling your hair on rubber bands.

Look sensitivity should be a consideration because we are using your computer’s mouse functionality for both body turning and head movement. In many cases, setting up an appropriate turn speed on your desk mouse will mean that your gyroscopic mouse will turn too quickly when looking. Ideally, we want a 1:1 turning ratio between your head turning and the amount that you turn in the game. This means that if you turn your head 90 degrees fully to the left, your character should turn 90 degrees to the left. If the turning ratio is too far from 1:1, the VR experience will be disorienting.

SEE ALSO
Hands-on: Logitech's MX Ink for Quest Could Legitimize VR Styluses as a Whole

To allow us to set your desk mouse and gyroscopic mouse sensitivities independently, we will need to use a utility called EitherMouse. Follow the developer’s instructions for general setup. To tune the sensitivity for your gyroscopic mouse, you will want to first select your desk mouse and set its sensitivity to where you prefer it. In order to tune the sensitivity of the gyroscopic mouse, you will need to launch a game (it doesn’t matter if it is in 3D). Turn the mouse 90 degrees to the left. If your character turns less than 90 degrees, turn the gyroscopic mouse sensitivity up. If your character turned too far, turn the sensitivity down. Once this is setup once, you should have the proper ratio set. Games will vary in sensitivity, but now that you have the ratio set in EitherMouse, you can use the in-game mouse sensitivity options to adjust the overall sensitivity to match that of the game you used to setup the sensitivity initially. This means you do not need to tweak the sensitivity in EitherMouse once you have done the initial setup.

Step 4: Have Fun!

Now that all the components are setup you can start your streaming, start your 3D game, and put the phone into your viewer. You have done everything you need to get a low-latency cheap VR setup. How immersive the experience is will depend on the quality of your phone display somewhat, but even older phones can make for an enjoyable gaming experience.

Tip: Turn your game’s graphics down some. The real resolution of each “screen” is going to be the short dimension by ½ of the longer dimension. This means even a 1080p display will have half the resolution in one direction. Because of this lower resolution many more complex textures may not come through and may actually make the game look “blurry” on the phone. Turning the graphics down to the lowest texture settings may actually make it look clearer.

This article may contain affiliate links. If you click an affiliate link and buy a product we may receive a small commission which helps support the publication. See here for more information.


Ben is the world's most senior professional analyst solely dedicated to the XR industry, having founded Road to VR in 2011—a year before the Oculus Kickstarter sparked a resurgence that led to the modern XR landscape. He has authored more than 3,000 articles chronicling the evolution of the XR industry over more than a decade. With that unique perspective, Ben has been consistently recognized as one of the most influential voices in XR, giving keynotes and joining panel and podcast discussions at key industry events. He is a self-described "journalist and analyst, not evangelist."
  • Tim

    Boy, would I love a Linux version of some of the screen mirroring apps :P

  • Firestorm185

    Man, this would be soo great… if only Duet didn’t freeze your other displays every time you disconnect an IOS device…

  • kfrazier

    Great article! Is there a reason you’re using a gyroscopic mouse instead of the gyroscope built in to your phone? (using some thing like OpenTrack – https://github.com/opentrack/opentrack/wiki/Smartphone-Headtracking

    Is latency an issue when you use your phone’s tracking?

    Thanks!

    • MC With MC

      The separate gyroscopic mouse is because not all phone feature a gyroscope, such as the LG Volt as I have.

      • kfrazier

        Ah, that makes sense. I did get this working, thanks for writing the article (although I’ve since got an HTC-Vive so I’ve moved on to that).

        • Emperorlou

          Can you share your setup process since you got it working without the use of a separate gyroscope?

  • Damak9

    Good article. I actually ordered couple of different “advanced” (read plastic) 3D cardboard glassess from aliexpress. Some were better than others, but they all suffer from the narrow FoV (about 70°).

    3D Movies are wathable and even enjoyable, but keep in mind that the resolution of your phone screen plays a major role here. I wouldn’t recommend anything below 1920×1080 (full HD), or you will see the pixels.

    • Charles

      Try the Freefly VR

  • james harrison

    Why are you recommending VORP X? It only works with the Rift. You’re going to have some unhappy consumers out there if anyone ends up buying it based on this article.

  • Nathan Casey

    Vorpx only works with the rift. It’s very misleading. Just found this out. Vorpx doesn’t specify this and many have wasted their money. Glad it wasn’t me

  • Julianbuzz

    I was in the process of setting this up, but man, Tridef 3D is expensive! For a poor man’s Rift, this is deal breaker. The most expensive part of this whole project. Is there any alternative to this program?

    • Did you even bother to read past the part mentioning Tridef? That was only one of the options the author offers to enable 3D gaming. And besides, $40 is that expensive.

      • Julianbuzz

        Yes, I read the article several times and the only other program mentioned is Vorpx, which only works with the Rift. If you are seeing another list of programs, could you kindly point me to them?

        And yes, $50 is too expensive for something the author says should be $10- $60 total. Especially for something like this that works, but only well enough for novelty’s sake.

        • paraquat

          Try TrackIR free software that works through webcam

          • Julianbuzz

            Thanks for the suggestion, but I’m more looking for a program to convert non-vr games into SBS 3D.

        • ::sigh:: The author also suggests “Find a Third-party Mod for a Specific Game” and “Find a Game that Already Supports SBS 3D.” Honestly, your absolute best bet would be to look for 3rd-party game mods. But I understand if you want everything to be handed to you on a platter, only having to put the absolute minimal effort into it. You kids these days perplex me.

          • Julianbuzz

            There is really no need to be condescending. You have no idea how old I am.

            I left a comment with an honest question and you immediately jumped on my back. Nothing in my original post was acusitory. Only stating facts and my situation. $50 is out of my price range, so I was simply asking if there were any other similar programs. Since no one has suggested any, I will assume not.

            Maybe next time you could try being a little less hostile and a little more helpful.

          • Juan Pedro

            Vireio Perception is free and open source.

          • Julianbuzz

            Thanks, this is what I was looking for!

    • Julianbuzz

      In case anyone else is looking http://www.mtbs3d.com/new-vireio-site this program seems to be an inexpensive alternative to Tridef 3D.

  • Mike Spinks

    cant you use the gyro in your phone through usb?

    • data_file_7

      You would have to connect that as a gyroscopic mouse in the PC. Not sure how that would work.

  • Dimitris Kartakis

    My phone has a 1440p display, in order to utilise it and have the clearest image do i need to set the resolution of the game on the pc to 1440p? Maybe with virtual high resolution? Also is a usb cable capable of streaming all this data to the phone?

  • Sap Ien

    I bought idisplay but it doesnt connect either wifi or usb, ive had some success with teamviewer but it has latency issues. Still need my gyroscopic mouse for headtracking though. Idisplay wont even give me tech support after i contacted them on Facebook

  • Arnold Rimmer

    I’m getting ready to set this up. I’m using a Droid Razr and had some questions about the head-tracking. Let’s say in a game like Arma 3, where you can independently move your weapon from moving your head. I use a motion controller called a Razer Hydra, and hopefully will have a Sixense Stem motion controller in October (which I pre-ordered 3 years ago for $300), but even with plain old mouse and keyboard my question would be the same and it’s this. In Arma 3, will this gyroscopic mouse be able to move my head while my controller/regular mouse moves my weapon? Or is the head-tracking for the mouse simply going to move my cursor and mean I still have to switch between weapon/head movement?

    I ask this because since I already have a motion controller, I can move my view around pretty easily, but it’s not as immersive having to switch between my head and my weapon. So when a gyroscopic mouse moves does it just move a mouse cursor, or does it only track my viewing kinda like TrackIR would? I’m hoping it just moves my head, because moving a mouse cursor would be useless and redundant for my purposes.

    Or can I simply use the tracking in my Droid Razr without the need for a mouse, and how do I set that up?

    For my first try at DIY VR, I’m going with the program Trinus VR. Especially since they have a 15 minute demo you can use before spending the $10 on it.

  • Legoindie

    But what do you do when you turn your head to a point when you can’t turn it anymore? This has been baffling me for awhile when it comes to VR

    • Rancorusia

      Thank you for this fabulous comment

    • Andrew_Kirk

      Do what you normally do when you can’t turn your head anymore lol

  • Aaron W

    Im sorry, Austin (the author) is like 20 years old, his bio is so wrong. There’s no way he’s done ANYTHING for a “long time” lol God millenials really ARE full of themselves.

    • Jean-Baptiste Emmanuel Zorg

      I’m not so sure about that. When i was 20 years old, i already worked for 4 years as IT support tech in local town hall. It started as a high school internship, but they found me useful, started paying me and i was finishing high school WHILE working there, even during holidays. That was in the early nineties though… None of the civic sector employees understood PCs back then, with the exception of people who had computers as a hobby, like me – hence the job. So, there are definitely ways to be doing something for a relatively “long” time. Even when you’re 20. I’m not usually a fan of millenials myself, but this article is interesting, so why bash it?

    • OK

      OK Boomer

    • Not AA-Ron

      20 years old isn’t even a millennial. Whose full of themselves here? I’m thinking it’s you, my guy.

      • Aaron W

        3 years later? Get a god damned life lol

  • afolayan raphael oluwaseun

    great post. i currently live in nigeria and own a tecno camon x . is there any hope for me?
    from http://www.geekzone.com.ng