Video: DaVinci Surface Physics Illustrator Interface on Xbox Kinect, with gesture interaction, by Razorfish

DaVinci prototype on Xbox Kinect from Razorfish - Emerging Experiences on Vimeo.

RELATED
Razorfish ports DaVinci interface to Kinect, makes physics cool (video)
Time Stevens, Engaget, 12/5/10
Razorfish
(I love this website.)

Xbox Kinect Interactive Puppet Prototype, from Theo Watson and Emily Gobeille (design.io) & Update on Funky Forest

I came across the following video on a post on the  Creative Applications blog about the Theo Watson and Emily Gobeille's  recent work with OpenFrameworks, Kinect, and an interactive puppet prototoype:

Interactive Puppet Prototype with Xbox Kinect from Theo Watson on Vimeo.

I'm not surprised that Theo Watson and Emily (design.io) decided to experiment with the XBox Kinect. I can't wait to see what they will create for Kinect in the future, based on their previous work --   A couple of years ago I wrote a post about their enchanting interactive installation, "Funky Forest":  OpenFrameworks & Interactive Multimedia:  Funky Forest Installation for CinKid. 


You can see from the video of their Funky Forest installation (2007 CinKid) that they create engaging interactive applications:

Funky Forest - Interactive Ecosystem from Theo Watson on Vimeo.
(Information from Theo Watson's Vimeo site)
"Funky Forest is a wild and crazy ecosystem where children manage the resources to influence the environment around them. By using their bodies or pillow "rocks" and "logs", water flowing from the digital stream on the floor can be dammed and diverted to the forest to make different parts grow. If a tree does not receive enough water it withers away but by pressing their bodies into the forest children create new trees based on their shape and character. As children explore and play they discover that the environment is inhabited by a variety of sonic life forms and creatures who appear and disappear depending on the health of the forest. As the seasons change the creatures also go through a metamorphosis."
Credits:
Theodore Watson
Emily Gobeille
Project Page:
muonics.net/​site_docs/​work.php?id=41
zanyparade.com/​v8/​projects.php?id=12


Note:  A version of Funky Forest, Moomah Edition, is permanently installed in New York City at the Moomah Children's Cafe. This version includes interactive environments related to the four seasons of the year, including an interactive particle system with falling leaves and snow.


FOR THE TECH-CURIOUS
Libfreenect for OX, by Theodore Watson

XBox Kinect running on OS X ( with source code ) from Theo Watson on Vimeo.
The following information and links were taken from the Vimeo description of the above video:  
"This is a port/adaptation of Hector Martin's libfreenect for OS X made by Theodore Watson.
Hector Martin's Libfreenect project page is here:  git.marcansoft.com/​?p=libfreenect.git
Most of the code is unchanged but there are some changes to libusb which was needed to get it running (and a few extra libusb commands) as well as some tweaking of the transfer sizes.
It should be self contained and you shouldn't need to install libusb (the app links it directly ).
Grab the Source Code:
UPDATE:
(Tested on OS X 10.6.3 - 32bit now and with fixes)
theo.tw/​deliver/​kinect/​001-libfreenect-modded-osx-updated.zip
ofxKinect for OF users - thanks Dan!
openframeworks.cc/​forum/​viewtopic.php?p=24948#p24948
Tips:
- Try both usb ports.
- Try not to have too many other devices plugged in (or any)."


(Check the Vimeo website to see if there are updates)


OpenFrameworks Forum
http://www.openframeworks.cc/forum/


RELATED
Presentation about Funky Forest  (ThisHappened)

Emily Gobeille & Theo Watson talk about Funky Forest from This happened – Utrecht on Vimeo.


Cross-posted on the TechPsych blog.

Kinect Sensor for Xbox 360 Offers Full-Body and Gesture Interaction: No controllers or remotes!

Project Natal was the code name for the Kinect Sensor for Xbox 360. For $149.99 you can pre-order your very-own system from the Microsoft Store that will allow you to interact with video games with your body alone. No need for controllers or 'motes!

Presentation about the fitness benefits of the Kinect Sensor for Xbox 360:



This video is a preview of a dance game for the Xbox using the Kinect Sensor:


It would be great if I could do my Zumba moves with Kinect Sensor system and a great Xbox application!

Here's another video that explains the system in more detail, with brief interviews of innovators from Microsoft:


Here is a copy of my previous post about Project Natal:

How It Works: Microsoft's Project Natal for the Xbox 360 video from Scientific American


Microsoft gathered a wealth of biometric data to recognize the range of human movement in order to develop an algorithm for the next generation of controller-less gaming. "Natal will consist of a depth sensor that uses infrared signals to create a digital 3-D model of a player's body as it moves, a video camera that can pick up fine details such as facial expressions, and a microphone that can identify and locate individual voices."


The technology behind Natal has the potential for a range of uses beyond gaming.

Scientific American article:
Binary Body Double:  Microsoft Reveals the Science Behind Project Natal for Xbox 360

How It Works: Microsoft's Project Natal for the Xbox 360 video from Scientific American


Microsoft gathered a wealth of biometric data to recognize the range of human movement in order to develop an algorithm for the next generation of controller-less gaming. "Natal will consist of a depth sensor that uses infrared signals to create a digital 3-D model of a player's body as it moves, a video camera that can pick up fine details such as facial expressions, and a microphone that can identify and locate individual voices."


The technology behind Natal has the potential for a range of uses beyond gaming.

Scientific American article:
Binary Body Double:  Microsoft Reveals the Science Behind Project Natal for Xbox 360

Interactive TV Game Controllers - A variety of permutations for the present and the future (iPhone, iPod Touch, Wii mote, XBox 360 Controller, Gesture...)

Building on my previous post, The Convergence of TV, the Internet, and Interactivity: Updated and Revised, I thought I'd focus on the different ways people can interact with converging content through interactive TV, internet-connected game consoles, and so forth. Is it time someone came up with a user-friendly UNIVERSAL CONTROLLER that could handle cross platform, cross media interaction?

How About the iPhone as Controller for Apple TV Gaming Console?
(Read the article's comments section to see what people think about this concept.)

Of course, if you have a Wii, you know about the Internet Channel:


Wii + Internet=More

Video of a real 12-year-old kid navigating through the Wii Internet and Wii News/Earth. He provides a great "think aloud" analysis of his interaction.



"They should make a video game that is geography based on something like this..."

Xbox permutations:

This:

 

Or maybe even this, if you blog, chat, or  tweet:


The following social/interactive applications can be controlled by your Xbox Controller:(The photos were taken from Gizmodo "Microsoft E3 Keynote Archive" and Zatz Not Funny!: Xbox 360: Welcome to the Social?)


Sky Player on Xbox 360 to Launch Mid-October




With the introduction of gesture-based interaction, such as Microsoft's Project Natal, in the future, no controller will be required to interact with your screen, no matter the content.



Project Natal for Xbox 360 could put Microsoft ahead of Wii with controller-free gaming


YOU ARE THE CONTROLLER
XBox Project Natal Website

Motion Sensing Confirmed for 2010 (Sony PlayStation 3)


RELATED
Interactive demonstration of how BBC's Red Button works for interactive TV content.  You can press the red button on the mockup, located on the lower right-hand section of the screen.
BBC Red Button Demo

BBC Red Button launches new CBeebies interactive service
Digital Television Group 9/28/09

Social Television and User Interaction
(Scholarly articles on this topic from the ACM Portal) 
Stefan Agamanolis (researcher in this area)


Interactive TV Research from UITV.INFO

Microsoft's Project Natal & "Fun" Natural User Interfaces for the Office

This looks great!

I came across the picture below today, and discovered more about it in a CNET article:

"Gesture-recognition technology, such as that seen in Project Natal, has changed the face of gaming, but Microsoft's Craig Mundie (pictured) believes it will also transform the office." (Ina Fried, CNET)


This approach looks like it incorporates visual thinking and conceptualization in a nice and fluid way.

RELATED:

"Microsoft: Future desktop PC's will transform the office" (Ina Fried, CNET UK, 7/31/09).

According to Fried, author of the the linked CNET article, Craig Mundie, at the Microsoft Research Faculty Summit this past July demonstrated the set-up in the above picture. The demonstration "...included hologram-like videoconferencing, a virtual digital assistant, and multiple surface computers, along with voice-, touch- and gesture-recognition technology. The desk in the demo was a multitouch surface computer, and the office's walls were also a display that could easily switch from being a virtual window or collection of digital photos to a corkboard of sticky notes or various workspaces. In one case, Mundie also used Project Natal-like depth cameras to put himself in the middle of an architectural demo, essentially putting himself inside a building that was not yet built."

Craig Mundie of Microsoft on the Future of Software: Digital Assistants, Natural User Interfaces, and Room Computing (Gregory T. Huang, Xconomy Seatle, 7/13/09)

The author of the above article was also at the Microsoft Research Faculty Summit and touched on the concept of natural user interfaces:

“All the things we talk about as natural user interfaces have been largely used one at a time as enhancements to [graphical user interfaces],” Mundie said. Gesture recognition, expressive responses, immersive 3-D virtual environments, and understanding of context—these advances in computing algorithms will lead to software that is “better at anticipating what you might want.”

Xbox's Project Natal Revamped for Offices? (J. Nicholas Hoover, 7/30/09)

When I find a video of the Project Natal/Surface/Natural User Interface Office in action, I'll be sure to post it!

Why this is important:

Natural user interfaces might have the potential to support more efficient and effective collaboration among people in the workplace, and the visual display of information may also support better decision-making and problem solving.

More about Project Natal: Richochet - Great Gaming for Fitness, Johnnie Chung Lee's Contribution

(Credit: CNET News)
Ina Fried, in a recent CNET Beyond Binary post, recently reviewed her experience playing Ricochet, a 3D game developed by Microsoft for Natal, the company's new gesture-recognition, controller-less Xbox gaming system. Above is a screenshot from Fried's article, Exclusive: Getting up close and personal with Natal:

Here is the video:

Ina Fried had a chance to spend some time in Redmond, Washington to explore the games in development at Microsoft, and hang out with the people responsible for Project Natal.

In her Beyond Binary article, Fried notes that the Ricochet game provides quite a workout, and this has had a positive effect on the Natal team:

"Since I started working on this project, I've lost almost like 10 pounds," said Kudo Tsunoda, general manager of Microsoft Game Studios and the creative director for Project Natal. "We're going to have the most in-shape development team you've ever seen."

Fans of Johnny Chung Lee will be happy to know that his work at Microsoft contributed to this game in someway, if they don't know this by now!

Who is Johnny Chung Lee? Read my post, "I wish I could be Johnny Chung Lee for a Day!".

RELATED

Speaking of Natal, it should be out next year (Ina Fried, CNET)

Gates: Natal to bring gesture recognition to Windows too

Get Up and Move Without Gear! Xbox Natal, a "smart" gaming environment.

I'm waiting for Xbox Natal to cross my path. Microsoft, can you hear me?



(I meant to write about this a while ago.)

Here are facts 5-6 out of 12, from "Project Natal in Detail" post on the XBox website:

• "Fact #5: In addition to “Project Natal” tracking your full body movement in 3-D, it also recognises your face and facial expressions. It can even detect the change of emotion in your voice. Three facts in one – yummy."

• "Fact #6: “Project Natal” remembers your face and voice so that you can connect to Xbox LIVE without the need to reach for a controller. This is the future!"

• "Fact #7: “Project Natal” is the world’s first system to combine an RGB camera, depth sensor, multi-array microphone and custom processor running proprietary software. Memorise this sentence then say it out loud faster and faster."

If you visit the Project Natal website, you'll find links to related articles, a gallery of videos, and a place to sign up for news updates.

Ball's Plight, an iPhone and iPod Touch Game App by PriPri Games (plug for a former classmate) -and more games-related info....

Priyesh Dixit, a game developer has a free game app for the iPhone and iPod Touch. "Ball's Plight", can be downloaded from the iTunes Store. Here is the description:

"You are Ball, an alien with telekinetic powers and no limbs. An evil scientist has captured you and is forcing you to play his little game so he can unlock the secrets of your powers. You must survive in order to escape!"

"At its core, Ball's Plight is a classic game of ball and paddle. Touch the ball to the paddle to increase your score, reach the goal score to advance to the next level while earning points."


Priyesh was one of my classmates in Dr. Michael Youngblood's Artificial Intelligence for Game Design Class at UNC-Charlotte during the fall of 2006. He went on to work with Dr. Youngblood and Hunter Hale, a Ph.D. student, on the Common Games Understanding and Learning Toolkit (CGUL).

The mission of the CGUL project:

"To identify, develop, collect, and integrate a suite of tools and techniques for improving the understanding of interaction and behavior in all FPS/3PS games, incorporating knowledge as game artifacts, and learning how to advance game artificial intelligence through these mechanisms." (CJUL downloads)

About Priyesh:

Priyesh is a programmer at TimeGate Studios in Surgar Land, TX. He has a MS in Computer Science with a certificate in Game Design and Development.

Priyesh twitters as "madgamer7", if you'd like to follow him.


RELATED:


The Playground: UNC-Charlotte's Game Design and Development Program


UNC-Charlotte's Game Intelligence Group, lead by Dr. Michael Youngblood




UNC-Charlotte's Game2Learn Group, lead by Dr. Tiffany Barnes

Publication:
D.Hunter Hale, G. Micheal Youngblood, & Priyesh N. Dixit Automatically-generated Convex Region Decomposition for Real-time Spatial Agent Navigation in Virtual Worlds (pdf) Association for the Advancement of Artificial Intelligence
(Voted Most Infuential Game AI Publication of 2008)

Game:
Incursion, an Xbox game created by UNC-Charlotte Game Lab students,is available for download from the Xbox LIVE Marketplace website.