Author Topic: tracking fingers w/ multiple wiimotes + holographics  (Read 5431 times)

Offline Darksundown

  • *
  • Posts: 3
  • Karma: +0/-0
    • View Profile
on: February 11, 2008, 09:13:26 PM
Hi, I searched for this idea I had but couldn't find a post exactly like this.

So in the pursuit of the danger room/holodeck technology, I propose this idea:

Take 2 or more wiimotes - at least one in front and one in the floor/ceiling - and track the tips of your fingers in X/Y/Z coordinates using the infrared cameras in the Wii remotes.

Then instead of using a TV for the display, we use holographics to display an object in space, like a picture frame.  As the computer reads where our fingers are, it can calculate if we are touching the frame or moving it and then displaying the reaction.  Other manipulations can be programmed like enlarging the photograph by pulling on the sides/corners of the frame in opposite directions.

Is this possible?
« Last Edit: February 11, 2008, 09:16:15 PM by Darksundown »



Offline atomriot

  • *
  • Posts: 177
  • Karma: +16/-0
    • View Profile
Reply #1 on: February 11, 2008, 09:34:19 PM
MIT has a drawing program they did with this idea, let me find the link

...

ok sorry i cannot find it right off, but i remember seeing it. they drew like a 3d dragon that they moved around and had 3 screens to represent it. any body see this video?

Details, details. Things to do. Things to get done. Don't bother me with details, just tell me when they're done.
--
James Lionel Price



Offline Moojuiceman

  • *
  • Posts: 2
  • Karma: +0/-0
    • View Profile
Reply #2 on: February 21, 2008, 02:15:59 PM
I think that it would be possible, but there might be a few issues in the z axis tracking, you'd have to make sure that the angles of the remote was perfect and the programming might be difficult as each remote wouldn't just do their respective axis but at least one other as well, if that makes sense. If you somehow worked the motion senor into it then you could use that to differentiate between remotes and the views from each camera, but it would still be difficult to new developers, as only the designer would have the intimate knowledge of the core programming. Would be good to experiment with, as long as you've got the money to fund it.



Offline Iceman1979

  • *
  • Posts: 40
  • Karma: +1/-0
    • View Profile
Reply #3 on: February 21, 2008, 06:56:09 PM



Offline nebulus

  • *
  • Posts: 7
  • Karma: +1/-0
    • View Profile
Reply #4 on: February 22, 2008, 02:36:35 PM
Sounds like a fun idea, the tracking fingertips part is feasible, as Iceman pointed to the video where I tracked a single IR source in 3d.

The issue with multiple ir sources is registering which the same ir sources in both cameras and making sure that each camera knows correctly which source is which, this problem is made more difficult when two sources are effectively inline from the perspective of one wiimote, a third wiimote helps here.

Of course your limited to only 4 IR sources which is a pain, and small distances involved with them being on your fingers requires a limited tracking space for resolving each source.  One of the nice and annoying things with the wiimote is that it automagically groups two sources into one when they are close together from the wiimotes perspective, some times its helpful, others a right pain!

Oh and holographic display, not seen one that really works well or is a decent size/specification yet!





Offline Darksundown

  • *
  • Posts: 3
  • Karma: +0/-0
    • View Profile
Reply #5 on: February 24, 2008, 02:22:33 AM
@Iceman:  Yes, kinda like that.  But instead of just one object, you track your "finger tips".  The area of manipulation that the person was using was kind of small though.  I was imagining something bigger ... at least 3'x3'x3'.

I'll elaborate on the "finger tips".  Instead of just putting squares on your finger tips, you'd have to wrap your whole finger tip so the multiple cameras can sense each side of each finger.  Does that make sense?

@Nebulus:  Great video... yeah guess you're right about the having to use THREE wiimotes.

As for the holographic technology, I'm pretty sure I too haven't seen anything remotely like Star Wars/Star Trek/Minority Report(when Tom Cruise is drugged up watching clips of his 'lil boy) technology.  But I can only imagine combining that with the hand manipulation tech. that companies like Apple and Microsoft are trying to build =D

EDIT:  The fingers you would be tracking would be the two index and two thumbs just fyi.  Is there a way to distinguish each IR source?  Is the wiimote resolution good enough to tell different shapes?  I'm guessing not.  Nor colors, huh? :/
« Last Edit: February 24, 2008, 02:30:48 AM by Darksundown »



Offline JDuzio

  • *
  • Posts: 12
  • Karma: +0/-0
    • View Profile
Reply #6 on: May 04, 2008, 11:18:26 AM
anyone do any follow up on this topic? im really interested in this kind of interface and if someone can help kickstart an idea i would do my best to press it onto fellow engineers and do what has to be done.