|
Matthieu Aubry, Julien Rouvière and Xavier Maurice have developed a drum system that uses two cameras to track drum sticks in real-time. This allows the player to drum away on virtual drums, the computer analyzes what the player is hitting in the virtual world and plays the corresponding sounds.
Video after the jump.
“Video acquisition of the 2 cameras simultaneously, at a frequency of 30Hz. At this step, image data are huge: 640 * 480 * 3 bytes * 2 cameras * 30Hz = 55Mb/s transferred on the firewire bus! Because we have the 2d positions of the sticks on the screen, and because we know the position of the cameras in 3 dimensions, we can determine via geometrical algorithms the 3d positions of the sticks. Using a positioning algorithm, we determine if the stick is hitting a drum element. We then compute the sound localization and the volume, depending on the speed.”
|
January 3rd, 2008
Sounds like a job for the Wii remote: http://www.cs.cmu.edu/~johnny/projects/wii/
January 3rd, 2008
Oops dead link (may be just the server temporarily down)
This guy, Johnny Chung Lee (http://procrastineering.blogspot.com/) has been doing some amazing 3d tracking work using the Wii Remote. Using the Wiimote would have saved these guys a whole lot of effort.
January 3rd, 2008
Ah! a working link: http://www.cs.cmu.edu/%7Ejohnny/projects/wii/ Check-out the head tracking demo!
January 3rd, 2008
Cool. I really like that. almost makes me want to make one…
January 4th, 2008
[…] First up is Hackedgadgets which features a Virtual Reality drum kit built using two cameras simultaneously transferring data at 55Mbs. These two cameras constantly monitor the position of two drum stick and translates their movements to movements on the drum kit. A very interesting project that is worth a read…. You can check out the link at http://www.virtual-drums.com/ via Hackedgadgets […]
January 4th, 2008
[…] (more…) […]
January 4th, 2008
[…] (more…) […]