Sponsors of Wiimoteproject.com
IR Pens for Wiimote Whiteboard
Wiimote Project » Wiimote Projects » Wiimote Finger Tracking » Wiimote Finger Tracking
Pages: [1]
  Print  
Author Topic: Wiimote Finger Tracking  (Read 23999 times)
0 Members and 1 Guest are viewing this topic.
Administrator
Site Admin
*
Karma: +18/-0
Posts: 441
Offline Offline
View Profile WWW Email
« on: January 08, 2008, 01:07:21 AM »

Wiimote Finger Tracking -FAQ and Adv Discussion

A lot of very smart people have written in questions and suggestions and I think a lot of them are very clever and worth sharing... and I'd like to add some of my own expansions on what I showed in the video. Like they say, 2 brains are better than 1.... it turns out several thousand brains are even better. This post will be REGULARLY EDITTED to add new ideas as they come in. I know it breaks the RSS model, but I don't want to make a new post for every new idea. Sorry.
------------------------
LED arrays from security cameras - online stores sell IR LED arrays for night vision security cameras. These should work perfectly for the wiimote.

Gloves - gloves exactly like minority report are definitely do-able and probably a good idea for repeated use.

LEDs on fingers - instead of tape you can use LED lights and do this without the LED array. But, you effectively create IR pens similar to the WiimoteWhiteboard demo which means batteries on the glove too.

Pinching with thumb and forefinger - the wiimote does upto 4 points. So both left and right thumb and finger could be tagged with reflective tape or LEDs. The software needs to be smart about maintaining the correct association and recognizing pinches, but very do-able.

Tagging a wiimote and knunchuck - getting the spatial location of another wiimote and knunchuck using a wiimote and reflective tape is an idea VERY much worth exploring. Now you get bi-manual (two handed) positional input in addition to all the accelerometer data and buttons.

Tracking fingers on surfaces (instead of the air) - unless it's a rear projection surface, the tape will be facing the wrong way... though you might be able to put the tape on the back of the fingers and figure out some method of triggering input. That said, it'll probably work well on a rear projection surface. You may need to offset the view angle of the wiimote so the support glass/acrylic won't retroreflect the light back to the wiimote. Alternatively, use active LED points.

Tagging objects on tables and projection- combining this method of tracking with projection is VERY powerful. This is essentially a field of research called Augmented Reality and will likely the be subject of a future video.

Posted by Johnny Chung Lee
Logged

*
Karma: +2/-1
Posts: 89
Offline Offline
View Profile
« Reply #1 on: January 14, 2008, 09:34:33 PM »

Just the info ppl need and off they go building ^^ (not me not interested YET :3)
first a nice doable whiteboard effect.

Greetz,
Bryanarby
Logged

wiipen
point ATM: building V2
V1: 1 LED on 1 AAA battery feed
V2: 1 LED on USB feed
V2 will be remodded too V3
V3: 1 LED on USB feed /w LMB and RMB
V4: 1 LED WIRELESS /w LMB and RMB
V5: we'll see :3
Vmany: Bluetooth IR pen with mouse functions.
*
Karma: +2/-0
Posts: 123
Offline Offline
View Profile Email
« Reply #2 on: January 16, 2008, 08:14:58 PM »

i'm actually working on a design right now that is very much like the minority report
Logged
*
Karma: +0/-0
Posts: 4
Offline Offline
View Profile
« Reply #3 on: February 21, 2008, 05:49:57 PM »

Why not use the Wii remote to replace the standard webcam used in something like this:
http://feroz007.wordpress.com/2007/08/18/build-your-own-multitouch-display/
Logged
*
Karma: +0/-0
Posts: 30
Offline Offline
View Profile
« Reply #4 on: February 24, 2008, 07:33:12 PM »

Hey,
Why not use the Wii remote to replace the standard webcam used in something...

because the wiimote can only track up to 4 points, which is not enough if you do an actual multitouch screen.

its really easy to modify the webcam to view IR (I did it in a few minutes, follow the link you posted above), and you have a really good library that gives you events such as "finger up", "finger down" and more here http://www.whitenoiseaudio.com/touchlib/ . This way you are not limited to only four fingers, and can use the wiimote for other things Smiley

Vadali
Logged
*
Karma: +0/-0
Posts: 4
Offline Offline
View Profile
« Reply #5 on: February 27, 2008, 02:44:46 PM »

Hi, I understand.. Reason why I was interested in the wii mote instead of a regular webcam is:
- it has a higher res compared to standard webcams
- Already fully IR capable without mods
- Hardware detection (although 4 blobs apparantly)
- reasonable cheap
- It has a gyro build in, opening up some new possibilities

Is there no way to capture the raw image from the Wii mote to pass it on to the mentioned library as a webcam image?
Logged
*
Karma: +0/-0
Posts: 6
Offline Offline
View Profile Email
« Reply #6 on: March 25, 2008, 05:52:18 PM »

i still confused with hardware to Wiimote Finger Tracking......:hammer:
 
the detail request everything at beeds....... Grin Grin Grin
Logged
*
Karma: +0/-0
Posts: 11
Offline Offline
View Profile
« Reply #7 on: October 29, 2008, 09:04:40 PM »

I have a small idea.  Did any SW developer tried associating the blob intensity information to the mouse button state?  In this way we may be able to use our finger in the air more like ordinary mouse - click only when the cursor is at the exact location you intended.  We just need an index finger LED glove with a thumb activated intensity switch. 

PS. Is the blob intensity information also available to GlovePIE scripts?
Logged
*
Karma: +0/-0
Posts: 1
Offline Offline
View Profile Email
« Reply #8 on: May 16, 2009, 10:23:47 PM »

Dear moderator and Johnny Chung Lee (I hope you still check in on this site).
I am working on a project for a science museum in which I'd like to have an overhead wiimote and led array set up to track exhibit visitors who would place a reflective tag/button or pin on their shoulders and then walk around.
On a projected image (map of oceans) their movements would be projected. The idea is to engage exhibit visitors in a simple location tracking model scenario, and then encourage them to delve into the exhibit, which demonstrated and illustrates how navigation and telemetry has evolved to allow satellite tracking of endangered species - like sea turtles. My challenge is in getting the initial wiimote and led array set up, and establishing a simple interface switching strategy so visitors could first see their location (tracked by the overhead wiimote, and their own shoulder badges) change as they move around in front of the exhibit. Their location would be projected atop one of a variety of map images, which could be toggled on or off.

Anyone have ideas on how to make this work really well? Can I track more than 5 locations at once? If not, can I use 2 wiimotes projected on a common screen? Can this all be run on a single netbook, and how/where can I get at an led array, or are their easy instructions on how to link individual leds on a piece of pegboard? How to power it all? ...etc.

Any/all suggestions or feedback are welcome.

Thanks,

Scott

Wiimote Finger Tracking -FAQ and Adv Discussion

A lot of very smart people have written in questions and suggestions and I think a lot of them are very clever and worth sharing... and I'd like to add some of my own expansions on what I showed in the video. Like they say, 2 brains are better than 1.... it turns out several thousand brains are even better. This post will be REGULARLY EDITTED to add new ideas as they come in. I know it breaks the RSS model, but I don't want to make a new post for every new idea. Sorry.
-----------------------

Posted by Johnny Chung Lee
Logged
*
Karma: +0/-0
Posts: 8
Offline Offline
View Profile
« Reply #9 on: October 11, 2009, 11:21:17 PM »

I have absolutely no idea if my will work or make any sense, but I'll give it a shot:
Why not have the wiimote with some IRs behind a transparent screen, with the projector shining from the other side, and the pens coated with reflective material, that will reflect the rays into the WiiMote. You could maybe even use it for finger tracking, by putting some foil on your fingers or something?

Does it make any sense  Cheesy?
Logged
*
Karma: +0/-0
Posts: 4
Offline Offline
View Profile WWW
« Reply #10 on: May 19, 2011, 11:59:42 AM »

My wiimote can't sound, and how can I do for it?
Logged

*
Karma: +0/-0
Posts: 3
Offline Offline
View Profile Email
« Reply #11 on: June 03, 2011, 11:41:21 AM »

It should be like this. it has a higher res compared to standard webcams. Already fully IR capable without mods. This should be followed and this is the way of it.
Logged

*
Karma: +0/-0
Posts: 1
Offline Offline
View Profile Email
« Reply #12 on: June 05, 2011, 03:42:49 AM »

Hi, Me and a couple of friends made a software that works both on Linux and Windows
to use Johnny Lee's Finger Tracking concept to control your mouse cursor.

We are using gloves to use it for long periods of time.

Currently, only the right and left clicks works,
but we soon want to add dragging features (like when you maintain the left click to move a file to other folders), page scrolling and window resizing.

We are currently looking for volunteers to help with this work (as the project is Open Source).

If some of you want to participate here's the project's page: http://sourceforge.net/projects/wavy/
And here's our website (In french, though translation is getting near finished)
http://www.team-gm.net

To the sceptics, here's a video of us to a local science and technology contest (In french though it shows a bit
of the demonstration at the middle of the clip)
<a href="http://www.youtube.com/watch?v=4O2iarkDX6Y" target="_blank">http://www.youtube.com/watch?v=4O2iarkDX6Y</a>

PM me for more details!
« Last Edit: June 05, 2011, 05:34:02 AM by m4f10 » Logged
Pages: [1]
  Print  
 
Jump to:  

Clicky Web Analytics