Wiimote Project

Wiimote Projects => Wiimote Desktop VR/Head Tracking => Topic started by: ntessore on April 14, 2008, 11:23:19 AM

Title: Who needs a Wiimote? ;)
Post by: ntessore on April 14, 2008, 11:23:19 AM
I thought you might find this noteworthy:

I spent the afternoon combining the OpenCV face recognition sample [1] with Johnny Lee's awe-inspiring DesktopVR program.

The result is head-tracking that works with nothing but a webcam. To be honest, the result will most likely be a crash. Make sure you have the latest Visual Studio runtimes.

The program works with just a normal Video-for-Windows camera. Just place your webcam below the Monitor, and pray that it will work :D

Of course, this needs a LOT of improvement. I just hacked this together without prior knowledge of either OpenCV nor C#. I am sure Johnny Lee could do much better, so take this as a proof-of-concept in anticipation of great stuff to come from others (as a start, I'd add some interpolation; OpenCV's face-recognition is far from perfect).

I have a version which uses eye-recognition, this would allow for rotation. However, detection is even worse there.

---

I just packed up the stuff I changed, together with the modified .exe - I hope someone can understand this mess. Maybe I can even come up with a better version soon.

Oh, btw, I started with the version changed to WiimoteLib 1.2.1., for my bluetooth adapter didnt work with the original version.

Thanks Johnny Lee, your ideas rock!

Get it here: http://www.sendspace.com/file/ewjyt4 (http://www.sendspace.com/file/ewjyt4)

---

[1] The OpenCV library from Intel - http://www.intel.com/technology/computing/opencv/index.htm
Title: Re: Who needs a Wiimote? ;)
Post by: ToastMan on June 15, 2008, 02:25:48 PM
It's a good effort. It runs very choppy for me but I don't know if it's because of the program or because of my crappy webcam.

Wouldn't it be better if the program could still use the webcam, but instead of face tracking, program it to detect IR lights like in the original wiimote program? Because it's not that hard to make the webcam to detect IR and it would seem to me that even with poor quality webcams it would be much smoother and more accurate if the program would just need to follow the IR blobs instead of track an entire face.

I would do it myself, but I'm not a programmer... :(

Anyways, just a suggestion.
Title: Re: Who needs a Wiimote? ;)
Post by: b39ppr on July 08, 2008, 02:11:08 AM
Wouldn't it be better if the program could still use the webcam, but instead of face tracking, program it to detect IR lights like in the original wiimote program? Because it's not that hard to make the webcam to detect IR and it would seem to me that even with poor quality webcams it would be much smoother and more accurate if the program would just need to follow the IR blobs instead of track an entire face.
You might wanna try FreeTrack
http://www.free-track.net/english/