Author Topic: Who needs a Wiimote? ;)  (Read 6266 times)

Offline ntessore

  • *
  • Posts: 1
  • Karma: +0/-0
    • View Profile
on: April 14, 2008, 11:23:19 AM
I thought you might find this noteworthy:

I spent the afternoon combining the OpenCV face recognition sample [1] with Johnny Lee's awe-inspiring DesktopVR program.

The result is head-tracking that works with nothing but a webcam. To be honest, the result will most likely be a crash. Make sure you have the latest Visual Studio runtimes.

The program works with just a normal Video-for-Windows camera. Just place your webcam below the Monitor, and pray that it will work :D

Of course, this needs a LOT of improvement. I just hacked this together without prior knowledge of either OpenCV nor C#. I am sure Johnny Lee could do much better, so take this as a proof-of-concept in anticipation of great stuff to come from others (as a start, I'd add some interpolation; OpenCV's face-recognition is far from perfect).

I have a version which uses eye-recognition, this would allow for rotation. However, detection is even worse there.

---

I just packed up the stuff I changed, together with the modified .exe - I hope someone can understand this mess. Maybe I can even come up with a better version soon.

Oh, btw, I started with the version changed to WiimoteLib 1.2.1., for my bluetooth adapter didnt work with the original version.

Thanks Johnny Lee, your ideas rock!

Get it here: http://www.sendspace.com/file/ewjyt4

---

[1] The OpenCV library from Intel - http://www.intel.com/technology/computing/opencv/index.htm
« Last Edit: April 14, 2008, 11:52:22 AM by ntessore »



Offline ToastMan

  • *
  • Posts: 1
  • Karma: +0/-0
    • View Profile
Reply #1 on: June 15, 2008, 02:25:48 PM
It's a good effort. It runs very choppy for me but I don't know if it's because of the program or because of my crappy webcam.

Wouldn't it be better if the program could still use the webcam, but instead of face tracking, program it to detect IR lights like in the original wiimote program? Because it's not that hard to make the webcam to detect IR and it would seem to me that even with poor quality webcams it would be much smoother and more accurate if the program would just need to follow the IR blobs instead of track an entire face.

I would do it myself, but I'm not a programmer... :(

Anyways, just a suggestion.



Offline b39ppr

  • *
  • Posts: 1
  • Karma: +0/-0
    • View Profile
Reply #2 on: July 08, 2008, 02:11:08 AM
Wouldn't it be better if the program could still use the webcam, but instead of face tracking, program it to detect IR lights like in the original wiimote program? Because it's not that hard to make the webcam to detect IR and it would seem to me that even with poor quality webcams it would be much smoother and more accurate if the program would just need to follow the IR blobs instead of track an entire face.
You might wanna try FreeTrack
http://www.free-track.net/english/