Developer Jimmy Gray recently posted a short video (see above), showing the latest version of a DIY motion-tracked VR stylus prototype. Using an HTC Vive Tracker mounted above a stylus-shaped unit, a VR stylus can be tracked and rendered, usable in Photoshop and capable of pressure sensitivity.
According to Gray’s tweets, the prototype emulates an HID device using ‘Teensy‘, a very compact USB development board. For now, this part of the device appears to connect directly to the PC via a USB cable, but it could potentially be made wireless, like the Vive Tracker itself, in future iterations.
It’s easy to see where the motivation to start this project came from, as Gray is also an artist, with a few examples of his 3D sketch work in Tilt Brush on his YouTube channel. Like many of these motion-tracked accessory projects, the stylus started life using a Vive motion controller to perform the tracking, and this earlier footage shows the flex of a stylus tip being connected to an input on the Vive controller’s trackpad, acting as the pressure sensitivity gauge.
Tracking a stylus in this way is yet another example of the precision of Valve’s Lighthouse technology, something that was highlighted by Valve themselves in a similar way with the marker board in The Lab. However, the system has its limits, and is not going to be as accurate as using a conventional stylus, but there may be applications where a VR stylus is favourable, especially thanks to the real feedback it can provide.