Author Topic: is it possible to use Finger tracking as mouse pointer?  (Read 16092 times)

Offline Attila16881

  • *
  • Posts: 4
  • Karma: +0/-0
    • View Profile
is it possible yet? if not what is still needed to do it?



Offline atomriot

  • *
  • Posts: 177
  • Karma: +16/-0
    • View Profile
Reply #1 on: January 14, 2008, 07:02:45 AM
I would say it would be totally possible, just not as easy as using a pen.

You would need to have the same setup with the array of IR LEDs aimed at you and the wiimote behind it.
You then just put some reflective material on your finger and calibrate like usual.

you could use the whiteboard app that is there already since it just looks for blobs and then moves the mouse accordingly.

Details, details. Things to do. Things to get done. Don't bother me with details, just tell me when they're done.
--
James Lionel Price



Offline Attila16881

  • *
  • Posts: 4
  • Karma: +0/-0
    • View Profile
Reply #2 on: January 14, 2008, 07:56:00 AM
ok now im working to make the gloves... have you any suggestions to which i could use (any links or image)?

and what about clicks? im thinking to put 2 mouse buttons under the middle and ring finger where i could push using the thumb

and the most important thing, what about reflective tape? i dont know what i have to look for... (can you give me a link or something to ebay or other online shop by pm?)
« Last Edit: January 14, 2008, 08:07:11 AM by Attila16881 »



Offline atomriot

  • *
  • Posts: 177
  • Karma: +16/-0
    • View Profile
Reply #3 on: January 14, 2008, 08:21:19 AM
i think that Johnny Lee used some 3m tape he said you could get on ebay (im just going off of memory and have not watched the video in a while) but it seems to me that you could just get any tape that reflects light. this could be like bike tape, or those stickers truckers use to put on their truck. just something to reflect it back.

you could probably even use a small mirror that is fogged over to spread the light.

as for the clicks, thats pretty good if you put the buttons in thumb range.
The thing with the software is, you can only have one pointer. to my knowledge, windows has yet to support multiple mouse at the same time so coding that could be tricky if you wanted the "minority report" feel to it.

it may just be me but i think the only glove that would be suitable in this situation is a nintendo power glove. heh. those might be a bit hard to find though, with the exception of the guy i sit next to at work still has his...

but if you were just trying to get away with as little as possible, i think that you could do clicks a few different ways. The first one might be a little tricky with gloves assuming you are going to be far from the screen but you could add a few buttons say in the top center of the screen spaced apart a little bit, and then use those for clicking. the tricky part, hide your finger while you move to it. with a pen its easy, just turn the pen off, but with fingers you have to hope you hit the right area and also hide your finger or the mouse moves from where you wanted it.
alternatively, you could have a second blob alert using the variable Found2. this would require a light of some sort other than your LED array, OR you could have tape on another finger and then just "give it the finger" when you want to click. this would only account for one click, this style could be used for left and right click by maybe making an L shape with your left hand and have tape on your index finger and thumb but this would get trick because what if it only picked up on tap and you did a normal click instead.

computer usage with finger tracking is not going to be as easy when you start trying to throw clicks in there.

Details, details. Things to do. Things to get done. Don't bother me with details, just tell me when they're done.
--
James Lionel Price



Offline Attila16881

  • *
  • Posts: 4
  • Karma: +0/-0
    • View Profile
Reply #4 on: January 14, 2008, 08:53:39 AM
I will probably use black latex gloves with some reflective tape on the index finger (blue circle)... about mouse buttons i think i have found a good place where i can put (red circles).



i found a very nice wireless mouse to use under my hand (fixed on the glove) to have the 2 buttons! the HP Bluetooth PC Card Mouse
it is only    W5.4 cm x L8.6 cm x H0.5 cm for 41 g



could be any problem to connect both wiimote and hp cordless mouse by bluetooth? could i connect wiimote by usb?



Offline atomriot

  • *
  • Posts: 177
  • Karma: +16/-0
    • View Profile
Reply #5 on: January 14, 2008, 09:10:05 AM
you should be able to have a bunch of stuff hooked up via bluetooth.

i do not know of any cables for the wiimote but i do not have a wii, just the wiimote.

and as far as the latex glove goes, it seems that would get very hot and the moisture that builds in the glove seems like it would cause problems with the electronics in the mouse...

just my thoughts

Details, details. Things to do. Things to get done. Don't bother me with details, just tell me when they're done.
--
James Lionel Price



Offline Attila16881

  • *
  • Posts: 4
  • Karma: +0/-0
    • View Profile
Reply #6 on: January 14, 2008, 09:15:16 AM
ok thanks! I have to put something between the thin mouse (only 5mm) and the glove...  i will change the gloves if i will find a better kind of gloves... I'll keep you informed about my work ;)

PS: any idea about make it works also under linux? (i mean whiteboard software) i could not find anything on wiili.org



Offline troy59

  • *
  • Posts: 123
  • Karma: +2/-0
    • View Profile
Reply #7 on: January 14, 2008, 02:05:55 PM
i've got something i'm working on, you can see it in my post(its on the same forum as this one), it solves the problem of puttin your finger up and down also, take a look at it.



Offline infra

  • *
  • Posts: 3
  • Karma: +0/-0
    • View Profile
Reply #8 on: November 19, 2008, 05:57:31 AM
Hey attila,

How are you doing on this project?
I am interested in this aswell.

Maybe we can work togheter on this.

Let me know,

Peter



Offline Jurge

  • *
  • Posts: 3
  • Karma: +0/-0
    • View Profile
Reply #9 on: January 04, 2009, 03:31:28 PM
ok thanks! I have to put something between the thin mouse (only 5mm) and the glove...  i will change the gloves if i will find a better kind of gloves... I'll keep you informed about my work ;)

PS: any idea about make it works also under linux? (i mean whiteboard software) i could not find anything on wiili.org

I am keen on sailing and last year me and my brothers bought a run down boat that need re-firbre glassing, and as the fibre glass is an iratant we had to where these gloves.
and thinking back to the comments about the sweat issue, me and my brothers were working hard on this boat in the summer, so this would be the time we were most perspiring, but these gloves didn't seem to make us sweat.
as the were powerdered with something that absorbed the sweat.



Offline hoihappen

  • *
  • Posts: 2
  • Karma: +0/-0
    • View Profile

Offline wit

  • *
  • Posts: 1
  • Karma: +0/-0
    • View Profile
Reply #11 on: December 26, 2009, 08:22:46 AM
???