The homepage for this project: http://www.anyall.net/#!vro/c1igr
By knowing the locations of the tips of my index fingers, and all of the necessary measurements, I can create and place a procedural mesh that is a 1:1 virtual replica of my keyboard. In this case, I’m using the left and right control keys because they’re easy to find.
The advantage of this is that I can re-place the keyboard in an instant by simply re-pressing the keys.
I’m using a LEAP Motion Controller to get the finger locations in world space, however this controller isn’t ideal for this particular use-case, as the keyboard introduces IR reflections, interfering with the camera’s tracking accuracy. Something like ControlVR, Perception Neuron or Dexmo would be far more suitable.
This basic technique could quite easily be applied to many objects – using hand tracking to track objects that otherwise have no tracking built-in.