Exploring high quality, low-cost, and opensource eyegaze, and face tracking technologies:

Update:  More information about this topic is posted on the TechPsych blog.

I'm working with a few students who have multiple special needs who are in need of assistive communication technologies that are not expensive. Although my first idea was to look at eye gaze technology, the possibility of face tracking is also appealing. Take a look at the following video from SeeingMachines, a commercial company:



I have a couple of webcams, and I don't mind a trip to RadioShack. I can program a bit, too, but I have very limited time. I welcome any advice you might have.

Voyagers and Voyeurs: Supporting Collaborative Information Visualization. A little dry, but worth watching.

I'd like to see how these concepts play out on a multi-touch, multi-user table system!

In this video, Jeffrey Heer, from the Computer Science Department at Stanford University, presents his work in the field of interactive information visualization, and focuses on visualization techniques,visualization tools, and collaborative visualization.

The video is nearly one hour long, but worth it if you are a techie who is interested in information visualization.



Another option - scan through the following presentation:
Voyagers and Voyeurs: Supporting Social Data Analysis

CIDR 2009: Jeff Heer Keynote

View more documents from infoblog.

Infoblog

Ru Zarin's Interactive Multi-touch Applications for the Cognitively Disabled: Social stories, talking symbols, a piano, and more!

 

Trollskogen Final Demo from Ru Zarin on Vimeo.

The above video is a demonstration of Ru Zarin's masters degree project at Umea Universitet.

This project examined ways to use multi-touch technologies to support communication and learning among children with Down syndrome, autism, and related diagnoses within the age group of 5-8. I especially liked the animated social story application.

"Trollskogen is a communicative framework designed to enhance communication among people with cognitive disabilities. The forest is split up into interactive modules that provide a fun and engaging learning environment while helping improve on certain aspects of speech, reading/writing and symbol based languages. This framework has been deployed on a custom multi-touch table prototype built at the Interactive institute Umeå, enabling the children to interact with their fingers in a more natural, intuitive way rather than a traditional keyboard/mouse setup."

RELATED READING
RELATED VIDEOS OF THE PROJECT DEVELOPMENT

Ru collaborated with the illustrator Linda Arvidsson for the characters and objects found in the troll forest theme.  

I especially liked the Troll Forest Cabin, which is shown in the social stories section of the video.

Cross-posted on the TechPsych blog.

CONCAVESCREAM: Soundtrack for a book interactive music and visuals,nice and relaxing on a touch screen!

I found a link to an interesting audio-based interactive website today. The Concave Scream "Soundtrack for a Book" is a promotional website for the band's new album of the same name. I never heard of this band before, but I'm impressed with the touch screen interactivity that the website provides!

It was awarded the FWA (Favorite Website Award) earlier this year.

 

Stantum's Mobile Phone Multi-touch Interface: Demonstration of Precise Interactions on a Resistive Touch Screen

For more information, read Paul Miller's article (Engadget), Stantum's mind-blowing multitouch interface on video!



Paul Miller says:

"The PMatrix multitouch firmware allows for unlimited inputs, detection of any contacting object (a finger, a stylus or even a paintbrush) and pressure sensitivity. We played with the demo unit for a bit and were frankly blown away, it's far and away the best touch experience we've ever seen or felt, and the multitouch functionality is just gravy on top. Stantum is targeting resistive touchscreens because they're still considerably cheaper to build than capacitive ones, and from our perspective there seems to be zero tradeoff -- for sensitivity and accuracy this destroys everything else we've seen on the market, capacitive or not."

How it works:  Tech Specs from Stantum:

PMatrix: The unparalleled Multi-Touch IP core and detection firmware (pdf)


"PMatrix™ is the most powerful software engine for Multi-Touch technology. It runs as a chip firmware or software on controllers orany embedded processing devices. PMatrix scans and delivers an exact representation of what’s happening on the touch-panel. The Multi-Touch driver dynamically updates the cursor list, enabling any application to control the Graphical User Interface objects."

Stantum's rational behind the company's choice of using resistive rather than capacitive touch technology:

Why resistive? :
In comparison to capacitive sensing, resistive technology brings :

• Versatility : it detects fingers, gloves, stylus and any contact object
• A lower solution cost
• Lower power consumption
• Faster scanning rate
• Lower overall latency
• Precision is linear (same in the center and at the borders)
• Performance is not affected by the size of the touch-panel or the number of touches
• Transparency and soft touch enabling user experience equivalent to the best capacitive touch-panels

I'll update this post when I have more information!


RELATED

For in-depth, detailed information about resisitive multi-touch technology,  read the following posts via Touch User Interface:

How the Stantum's Resistive Multi-Touch Screen Works 
Pressure Sensitive Multi-touch Surfaces

Interactive Light and Dance Installations using Flexible OLED's: You Fade to Light

Dance and Interactive Light Installation: You Fade to Light/ edit 1 (rAndom International, Kristin Knappstein, Royal Philips Electronic' Luminblade team)

You Fade To Light / edit 1 from rAndom International on Vimeo.

"Lumiblade OLED's are large area diffuse light sources made from extremely thin glass and feature a perfect mirror finish. OLED's are very close to the quality of natural light."

Installation and Art Direction by rAndom International
Choreography: Laïla Diallo in collaboration with Khamlane Halsackda
Performance: Laïla Diallo and Khamlane Halsackda
Film Production and Director of Photography: Mark Purnell at Hogarth Worldwide
Related versions can be found on the rAndom International Vimeo site.
Photos of the making of You Fade to Light


Chris O'Shea created the software for You Fade to Light using C++, openFrameworks, and openCV.  There was a hidden camera embedded in the installation that generated video for the software to process and also generate video files as output. The hardware drivers were created by rAndom International and through the software, controlled the brightness of each OLED.

Chris is the author of the Pixelsumo blog, and also is behind This Happened, a "series of events focusing on the stories behind interaction design",  with the purpose of encouraging interaction designers to become more open in their methods and ideas. 

For more information about interactive OLED, read the NY Time's article:

Panels of Light Fascinate Designers
Eric A. Taub, New York Times, 9/6/09


Thanks to Celine Latulipe for the link to the NY Times article!