Wiimote Project

Wiimote Projects => Wiimote Interactive Whiteboard => Topic started by: John Hardy on June 16, 2010, 08:27:01 AM

Title: Wiimote with Windows 7 and TUIO multi-touch support
Post by: John Hardy on June 16, 2010, 08:27:01 AM
Hey folks!

My name is John Hardy and my friend Christopher Bull and I are currently developing an application which means that you can use a single Wiimote to do full multi-touch with all the trimmings on Windows 7.

Both TUIO and Windows 7 touch events are supported in the trunk at the moment and we hope to have a working binary download with a simple but powerful UI by the end of the week.  I will post a link to our Google Code project as soon as we are done. :-)

Here is a more detailed description:
Quote
WiiTUIO is an application which stabilises the IR sources captured by a Wii Remote (Wiimote) and presents them as TUIO and Windows 7 Touch messages.

This project aims to improve the stability of the IR sources captured by the Wiimote using some thresholds and spatio-temporal classification. The application generates Windows 7 Touch messages and TUIO events using these stabilised contacts.

Each raw IR source captured by the Wiimote is either assigned to the best existing tracked source or generates a new tracker. This means that TUIO events can be generated from stable data without the jitter (namely, false-positives generated between two IR sources and the unordered source buffer) that occurs when trying to use the Wiimote to capture true multi-touch IR.

And here is a demo video (sorry for the muffled sound - it was taken on my mobile):
[youtube]http://www.youtube.com/watch?v=rbMafItax6Y[/youtube]

I hope this will be some use to you guys and remove a few locks on the door to making proper multi-touch accessible to the masses!

John
Title: Re: Wiimote with Windows 7 and TUIO multi-touch support
Post by: Katkind on June 16, 2010, 02:38:31 PM
Great!  :D
Title: Re: Wiimote with Windows 7 and TUIO multi-touch support
Post by: John Hardy on June 22, 2010, 04:32:11 PM
Hey Guys and Girls!

So for the Windows 7 multi-touch support, do to our Google Code project and download: WiiTouch [Version 2.0] x86 Binaries (supports TUIO and Windows 7 Touch)

http://code.google.com/p/wiituio/downloads/list

Would love to know your experiences!

John
Title: Re: Wiimote with Windows 7 and TUIO multi-touch support
Post by: katutxakur on July 08, 2010, 03:46:49 AM
Hi,

I have a problem, I already installed multitouch vista's driver, it appears in Device Manager list, under HID devices. And I have both Multitouch.Service.Console.exe and Multitouch.Driver.Console.exe running. But when I click "Win7 mulitouch events" CheckBox I always get "Universal Software HID driver was not found. Please ensure that it is installed".
Title: Re: Wiimote with Windows 7 and TUIO multi-touch support
Post by: John Hardy on July 09, 2010, 06:30:58 AM
I suspect it is because of the target platform; try these binaries - they may sort it as they are forced to x86 (but will still talk to both the x86 and x64 driver). :)

John

EDIT: You don't need to run 'Multitouch.Service.Console.exe and Multitouch.Driver.Console.exe' because WiiTouch implements it's own version of this. :-)  Just install the driver (as admin) - do the remove/add thing in device manager and then run the program and you should be good to go!
Title: Re: Wiimote with Windows 7 and TUIO multi-touch support
Post by: katutxakur on July 10, 2010, 06:04:14 AM
Great! It works now.

Thank you!
Title: Re: Wiimote with Windows 7 and TUIO multi-touch support
Post by: John Hardy on July 10, 2010, 03:18:56 PM
Sweet, thanks for the feedback!  ;) 

I've updated the downloads on our site with the new application: http://code.google.com/p/wiituio/downloads/list
Title: Re: Wiimote with Windows 7 and TUIO multi-touch support
Post by: gunair on August 26, 2010, 07:33:17 AM
Hello John, Hello Christopher!

Your software works great! Exactly what I was waiting for with my wiimote game table... Now win 7 multitouch works, like it should be. Okay, besides the Microsoft Surface Pack, there are no really applications for it yet, but I hope that will change soon.... - perhaps it starts with the game R.U.S.E... Have tryed the demo, but it should look like, multitouch isn't supported in the demo (waiting for response from Ubisoft)...

Uh Oh btw., please have a look at my topic about multitouch for all games:

  http://www.wiimoteproject.com/project-ideas/mulitouch-gestures-with-wiimote-for-all-games/

Perhaps it's interesting for your programming cababilities ;-) Wouldn't be that the logical second step, after having the multitouch running, to use them... ;-))

Greets from germany,

gunair

PS: Sometimes the first calibration cross starts at the wrong place (only half seen in the left uper corner) and the calibration does not work everytime, it seems, that the "normal" long ir impulse (one click) is too long, so that the calibration jumps from the first (upper left corner) to the last (lower right corner) cross...
Title: Re: Wiimote with Windows 7 and TUIO multi-touch support
Post by: Ulfilas on October 08, 2010, 05:42:24 AM
this is great stuff - will be downloading and playing with it NOW!
Title: Re: Wiimote with Windows 7 and TUIO multi-touch support
Post by: Ulfilas on October 08, 2010, 06:54:06 AM
Even using command prompt as administrator - I can't get past the Install driver.cmd stage. I get error messages :(
Anyone got any ideas? I'm running Windows 7 64bit Ultimate
Title: Re: Wiimote with Windows 7 and TUIO multi-touch support
Post by: Pipotron3000 on December 16, 2010, 09:02:38 AM
Thanks for your software !

About softwares using multitouch, i can tell you the best one (and only one for windows) for music http://www.sensomusic.com/usine/ (http://www.sensomusic.com/usine/)Sensomusic Usine

[youtube]http://www.youtube.com/watch?v=OS6xh5B7FLE[/youtube]

You can even control other music softwares with it, create your own interface with strange controllers...

I love it and will use your soft with one or two IR LED glove(s).
But remember : wiimote can only track 4 blobs at the same time.

For me, it is index and thumb on each hand, and trigger on palm with other fingers  ;)

Title: Re: Wiimote with Windows 7 and TUIO multi-touch support
Post by: progelex on February 07, 2011, 07:31:45 AM
Hi John,

Im new here and wanted to try this system. Im actually using Win 7 64x and I managed to use the wiimote with uwe schmidts software, but only with one ir-pen.
But I want to use two ir-pens in a multitouch way, like in your video. I installed the multitouchdriver, it works, i can now see and change the "pen and touch" option of Win7.
I started your program and tried several times to connect the Wii, but I always get the message "Could not etablished to wiimote: No Wiimotes found in HID device list"
Did I forget something?? Could you give me an step by step guidance maybe?? I have the sad feeling, that I only oversee a little thing.

If you could help me, it woult be realy nice.

Regards,

progelex
Title: Re: Wiimote with Windows 7 and TUIO multi-touch support
Post by: Pipotron3000 on February 07, 2011, 10:24:50 AM
Hi !
I'm not sure about anything, but start with that because i think this is not related to software :
http://www.boonjin.com/smoothboard/index.php?title=What_does_%27exception:_No_Wiimotes_found_in_the_HID_device_list%27_mean%3F (http://www.boonjin.com/smoothboard/index.php?title=What_does_%27exception:_No_Wiimotes_found_in_the_HID_device_list%27_mean%3F)

Title: Re: Wiimote with Windows 7 and TUIO multi-touch support
Post by: progelex on February 07, 2011, 01:00:05 PM
Thank you for this link. It help me to look for some other aspect.
I found some hints to an solution for my problem at this page:
http://www.wiiprojects.org/bluetooth.html
I just had to hold the buttons 1+2 as long as Bluesoil need to connect.

Thx again and regards,

progelex
Title: Re: Wiimote with Windows 7 and TUIO multi-touch support
Post by: Pipotron3000 on February 07, 2011, 07:15:22 PM
Be careful with Bluesoleil, it is not so stable.

I bought an USB Bluetooth dongle and i'm using the stock Windows drivers.
I think it works better ;)
Title: Re: Wiimote with Windows 7 and TUIO multi-touch support
Post by: Rishi on February 10, 2011, 11:14:37 PM
Hi John,
     I am really fascinated by your work on the wiimote TUIO and windows 7. I am a final year engineering student and have decided to do my project on Johnny Chung Lee's low cost interactive whiteboard. I have decided to use your features into it to make my project  so that it can help schools in India to have their hands on such a low cost technology and revolutionize our education standards in rural area. I really would be grateful if you can give me your source codes of the project give me a bit knowledge of how you have developed the code. I would be very grateful to you.
   Thanking you
Title: Re: Wiimote with Windows 7 and TUIO multi-touch support
Post by: Meirion on February 17, 2011, 04:38:43 AM
I'm interested in using a pair of wiimotes to enable touch on a dual-screen Windows 7 system. Does anyone have an advice on how to go about doing this?
Title: Re: Wiimote with Windows 7 and TUIO multi-touch support
Post by: John Hardy on February 18, 2011, 03:50:58 PM
Thanks for all the positive replies guys  :D

(1) On connecting to the Wiimote.  I suspect you lot will be a lot better than me at this, but I find what works for me under Win7 is this:
Quote
(1) Start -> Devices and Printers
(2) Right click Nintendo thingy and Remove Device
(3) Add Device
(4) Hold down button 1 and 2.
(5) Go through the motions of adding the device ( still holding them down ).
(6) Wait for the installation to be successful  ( still holding them down ).
(7*) You might try telling Windows to skip windows updates for this device  ( still holding them down ).
(8) Open Wii Tuio  || Release Buttons
(9) Connect

(2) The source code for the project is available at http://code.google.com/p/wiituio/   I have a friend who is interested in working with rural communities in India so please let me know how it goes!

(3) Yes, you should be able to use it with dual screens - however you may need to modify the source code a little.  Something about PrimaryScreen width and height - I suspect you will want the VirtualScreen or something similar.  I have an experimental version which can talk to two Wiimotes for large displays.  I used in a recent research paper - but will happily provide you with the source should you need it.  Just so you know, I don't often check these boards so you may be better off contacting me at stexcalibur.com if its urgent.

Cheers!

John
Title: Re: Wiimote with Windows 7 and TUIO multi-touch support
Post by: msilveira on November 15, 2011, 06:17:55 PM
Hi! Amazing! TUIO was the first non-commercial solution that worked !!!

My main goal is to use this with flight simulators ( 1 point only ) and I've had "some success". As to flight sims sometimes right mouse click or mouse wheel is necessary, I was wondering: Is it possible to make TUIO to work as a "finger tracker" only, without emitting mouse clicks? Is it possible to easily change this behavior via  some configuration under "pen and touch"? ( I've tried many things, did my research )

Add a lightweight BT mouse disassembled and wired to the correct fingers and you have multi clicks and tracking working. Would love to plya falcon/il2/fsx this way :D

I'd love to keep using TUIO, but any finger tracking only solution will do. I tried wavy, but found no way to calibrate and use relative positions like TUIO allows me.

Any hints? New topic for this?

Thanks!
Title: Re: Wiimote with Windows 7 and TUIO multi-touch support
Post by: talbert63 on January 19, 2012, 02:35:11 PM
Is there any way you can add a "smoothing" setting to this application.   My writing still looks jagged compared to that of Smoothboard.   I don't know anything about programming but I do use this program in my class.   It would great, but I would love to have the smooth handwriting from Smoothboard back.

If not thank for the program anyway,
Mark Talbert