Ok , totally off-topic but would be great to build scenery in 3D for real time projection/interaction. Z-Axis on the surfaces so they can be placed in depth as well. A camera/viewport can navigate within this composition with X/Y/Z controls. I know, plenty of programs who can do this (I use Blender) but with real time video input this would be great.
Cheers, Barney