Softkinetic 3D Gesture Recognition for Games and Rehabilitative Play

Taking 3D interaction further, Softkinetic has developed middle-ware that uses a 3D camera to support full-body gesture interaction with games and other applications. No controllers or devices are needed!



The following video is narrated in Portuguese, I, think, but you can understand the content in any language. I you love the Wii, you'll probably like this!


Here is a video that demonstrate how Softkinetic and Silverfit paired together to develop rehabilitative games for the elderly and others:


The following table is from the Silverfit website:

Game	Movement trained
Puzzle	While sitting down, bend whole body left and right, and stand up. Cognitive/visual component.
Mole	Balance exercise by stepping with one leg while standing.
Catching grapes	Walking movement left and right.
Walking	Walking in place, while avoiding obstacles and thresholds. Activity of Daily Life (ADL) component.
Arm exercise	Arm stretching and reaching in all directions with one or both arms. ADL component.
Picking flowers	Walking backwards, forwards and sideways. Optionally, bending down.
Memory	Arm stretching left, right, forwards and upwards. Cognitive component.

RELATED

Softkinetic and Silverfit Introduce Senior-Targeted Gaming
(Danny Cowan, Gamasutra, 12/19/08)

Softkinetic's Gesture-Based Interactive TV Action:

Interesting 3D Interactive Gesture Recognition System by Atracsys: BeMerlin Product Demonstration of Nespresso Products

Via Core 77:

The following video clip is an example of BeMerlin, an infrared guesture recognition system developed by Atracsys for demonstrating 3D representations of Nexpresso's expresso machines.


The video was taken at the Home + Housewares 2009 show in Switzerland.

ElderGadget Blog

Via Technology-Supported Human World Interaction

Today I came across the ElderGadget Blog when I was searching for technology that might be helpful to my father, who recently spent the last few weeks in an intensive care unit.

Here are a few things I found on the blog, including what I found when I followed a link to the bindependent website:

Smart Table: A Broadband Communication System for the Elderly


ID Studiolab, Delft University of Technology, NL
"The smart system is aimed to prevent possible social isolation between elderly people and their social contacts. It consists of the Smart Table and the Smart Messenger, which provide easy and intuitive way for elderly people to benefit from the advantage of communication technology and improve the satisfaction of their social activities."

"During the design research, a working prototype is made and evaluated by a user test. The Smart Table offers people a way to use broadband communication without the need for a computer. The television will be used for video communication (web-cam) and the table as user-interface. On the table contact persons can be selected and images and video can be shared. The elderly person can capture images that will be shared instantly. The contact person can select images from his or her computer, which will be projected on the table of the elderly person". (TU Delft - Faculty Industrial Design Engineering - Master Design for Interaction - Project Interactive Technology Design - Vincent Steurs & Juin-Yi Huang)


Demy Kitchen Safe Touchscreen Reader



Photo Watch


Clarity-C900: Amplified Big Button Cell Phone

911 Guardian: "Tiny wearable speakerphone"


Extra Large TV Remote Control

SmartShopper: Electronic grocery-list maker



Bierley's ColorMouse Video Magnifier

Voice Pod: Digital recording and playback system

RELATED

Live from CES - Dakim's Brain Fitness Keeps Seniors Sharp

Dakim Brain Games

Previous post: Ubiquitous Computing - Grandpa and grandkids use a webcam and Skype across the miles

YouTube Vlogger: Geriatric1927

Geriatric Gripes and Grumbles

Shift Happens Update: Did You Know? 3.0 (Infographic Video) & Updated 4.0!

 Update:  Here is Did You Know 4.0!


The first version Did You Know? (Shift Happens) started out as a PowerPoint presentation by Karl Fisch, an instructional technology specialist at Arapahoe High School as part of his staff development program. The goal was to convey information about the speed of change in our world through the use of a variety of statistical facts - on a global scale, and ultimately spark a conversation about the meaning of technology and the future among the educators in the room.

As you probably know, the conversation went well beyond the walls of Arapahoe High School!

In 2007, Did You Know? was updated by some of the designers at Xplane as a volunteer effort, and as of today, 3/25/09, had been viewed by 3,026,101 times on YouTube.

Did You Know? 3.0


Did You Know 2.0 Xplane version:


Did You Know 1.0 "Shift Happens" narrated with photographs:



Shift Happens Wiki
The FischBowl Blog

Note:
I came across the Did You Know? 3.0 video clip on Antoine RJ Wright's Mobile Ministry Magazine.

I first ran into Antoine at a coffee shop about a year ago. We both happened to be checking our email's on the same device, the beloved Nokia n800 Internet tablet. n800's are a rarity in the Charlotte area.

We soon learned that we shared a fascination for touch screen interaction and UI, but Antoine focuses primarily on mobile devices, and is a deep thinker on this topic. He showed me some of work he was doing with interface design on the n800 and I was impressed. Much of what he does could be transformed to the large screen with only a few tweaks, in my opinion.

Antoine runs Nokia's Mobile Web Server on his cell phone, which enables the phone to be accessible on the Internet and provides a personal "mobsite".

FYI: Antoine will be speaking at BibleTech '09 in Seatle, Washington soon on the topic of "Mobile Technology and Connecting Communities". If you have never given a thought about the intersection of technology and religion, you might be surprised at what is going on.

Struktable Multi-touch Installation at TOCA ME Design Conference

Struktable Multitouch Installation from Gregor Hofbauer on Vimeo.


Strukt is a design studio in Vienna, Austria, that specializes in interactive and generative design for a variety of purposes, such as interactive environments and installations, ambient intelligent environments, games, and multi-touch tables, screens, and walls. The video is a demonstration of applications that were presented at the March 2009 TOCA ME Design Conference in Munich, Germany. The applications were developed using vvvv. (More information regarding vvvv can be found at the end of this post.)




INFO FOR THE TECH-SAVVY OR TECH-CURIOUS:

According to information from the vvvv website, vvvv is a "toolkit for real time video synthesis. It is designed to facilitate the handling of large media environments with physical interfaces, real-time motion graphics, audio and video that can interact with many users simultaneously. vvvv is a visual programming interface. Therefore it provides a graphical programming language for easy prototyping and development. vvvv is real time, where many other languages have distinct modes for building and running programs, vvv only has one mode, run-time. vvvv is free for non-commercial use."

VVVV Screenshots
VVVV's Propaganda Page
Other projects using VVVV
Struktable: the 70-inch Multitouch Table

STRUK ON A SPHERE: Interactive installation at a Mercedes Benz conference

Pattie Maes TED Talk: Sixth Sense - Mobile Wearable Interface and Gesture Interaction (for the price of a cell phone?!)

In the following video, Pattie Maes and Pranav Mistry,of MIT's Fluid Interfaces Group, demonstrate SixthSense, wearable technology that incorporates a video camera, a projector, a digital camera:


From the SixthSense website:

"The SixthSense prototype is comprised of a pocket projector, a mirror and a camera. The hardware components are coupled in a pendant like mobile wearable device. Both the projector and the camera are connected to the mobile computing device in the user’s pocket. The projector projects visual information enabling surfaces, walls and physical objects around us to be used as interfaces; while the camera recognizes and tracks user's hand gestures and physical objects using computer-vision based techniques. The software program processes the video stream data captured by the camera and tracks the locations of the colored markers (visual tracking fiducials) at the tip of the user’s fingers using simple computer-vision techniques. The movements and arrangements of these fiducials are interpreted into gestures that act as interaction instructions for the projected application interfaces. The maximum number of tracked fingers is only constrained by the number of unique fiducials, thus SixthSense also supports multi-touch and multi-user interaction."

Photo from the SixthSense website

Of course it is similar to Minority Report, but I don't consider it to be a problem, because it supports multi-touch and multi-user interaction, and it is a "mobile" application of useful technology.

The interaction that had me at "hello world".