After working to get the Headtracking working to control an X and Y mechanism for the Xbox I realized that this sort of control could be used on other things. The Google Streetview API allows for update to be made to their browser control via javascript, so you can point the user any way you need to in real time.
I found that if I made a Winform app that would load a WebBrowser control, I could load a streetview into the browser and update the heading (and pitch) as I moved my head. The Google Streetview browser control handles all the buffering of images so you can just update heading and it does all the work. The Winform app handles the GPS location data and allows me to track the head and body positions separately.
It actually surprised me how well it works without changing any of the code from the IR Camera Project using the IR Camera from the wiimote.
My Github.com Repo code is here:
https://contractorwolf.com/headtracking-using-the-google-streetview-api/
ContractorWolf.com 