For the Gamers: Episode three of Half-Life 2 will incorporate sign language!

Below is a video of a discussion between Gabe Newell, a game developer at Valve, and a focus group including deaf and hearing impaired gamers. Valve is conducting research to gather information needed in order to incorporate signing into Episode 3 of Half-Life 2.

In the video, the importance of the use of realistic facial expressions was discussed, as well as other issues, such as deaf culture.



(All three video clips related to Gabe's focus groups can be found on the Escapist website.)


-Valve

(I'm a little behind the game accessibility news...)

Natural User Interface Surfaces: TouchCo - IFSR technology company, founded by NYU Media Reseach Lab's Ken Perlin and Ilya Rosenburg

Earlier this year, I had a very vivid dream about haptic touch-screen overlays. That's how things go for me sometimes. At any rate, the dream inspired a blog post, "Last night I dreamt about haptic touch-screen overlays...". Since this is one of my interests, I try to keep up with developments in this field when I can.

It is amusing to see how seemingly unrelated things have similar roots. Today I came across information about a cool mobile phone concept for the visually impaired, designed by Samsung. The touch technology involved in the concept phone incorporated something called Electric Activating Plastic, or EAP. 


This sparked my curiosity, and while searching for more information, I came across an article in MIT's Technology Review that caught my eye:


A Touch of Ingenuity: Inexpensive pressure-sensitive pad could make surfaces smarter
(Kate Green, MIT Technology Review September/October 2009)

UPDATE:  As of 2/2010, TouchCo no longer exists. It was bought by Amazon:

TouchCo Bought By Amazon 2/3/2010

"..Now that more and more smart phones and MP3 players have touch-screen interfaces, people have grown accustomed to interacting with gadgets using only taps and swipes of their fingers. But on the 11th floor of a downtown Manhattan building, New York University researchers Ilya Rosenberg and Ken Perlin are developing an interface that goes even further. It’s a thin pad that responds precisely to pressure from not only a finger but a range of objects, such as a foot, a stylus, or a drumstick. And it can sense multiple inputs at once."

Ken Perlin and Ilya Rosenberg developed this system as part of their human-computer interaction work at NYU's Media Research Lab, and with the success of their work, went on to start a new company, Touchco, to commercialize and market this concept, known as IFSR (Interpolating Force-Sensitive Resistance) technology.

"The IFSR sensor revolutionizes the field of multi-touch human-computer interaction by out-performing existing solutions in both price and capabilities. Unlike traditional capacitive sensors, our patent pending system can detect any object - not just a finger - and can determine how much pressure is being applied to every point on a sensor simultaneously. IFSR sensors are natively multi-touch, use less power than capacitive sensors, and are much less expensive to produce, making them a highly disruptive technology with widespread market applications."


The Touchco website has a wealth of information regarding this technology. (Update: The TouchCo website was taken down in February 2010)

Other members of Touchco include Nadim Awad, Fang Cheng, Julien Beguin, and Christopher Nam.

SOMEWHAT RELATED
I know of Ken Perlin through his Games for Learning work, and also through his on-line application, Responsive Face, which I use in my work with students who have autism.




Ken Perlin's Blog
Games for Learning Institute

TechPsych Post:
Samsung Braille TouchPhone Prototype is Cool: Uses Electric Active Plastic for functional tactile feedback.

Ron George's Interaction Design Toolbox

Ron George, an interaction designer, recently posted a comment on my blog. So I visited his blog and found that he has a great set of resources that many of my readers would appreciate!

For starters, take a look at Ron's Interaction Design Toolbox page, and then spend some time browsing around the rest of his site/blog.

Ron works at Microsoft on a team that is exploring Natural User Interface/Interaction (NUI). He previously was on the Surface team.

Multi-touch App for Pediatric Neuropsych Assessment and Rehab

Microsoft Surface Multi-touch Application for Pediatric Neuropsychological Assessment and Rehab, by Vectorform

Above is a link to my TechPsych post about the Cook Children's Health Care System's use of multi-touch technology for children and teens who have suffered traumatic brain injuries or have other significant neurological disorders.

MT-50 Multi-touch Table: Ideum + NUITech = Interactive Delight

Here are a couple of kids on Ideum's MT-50 multi-touch, multi-user table. You can see the delight!

The picture was taken from the videoclip below:



According to information from the video, the MT-50 screen provides a higher resolution than Microsoft's Surface. It comes with bundled with GestureWorks, a software development kit that works with Adobe's CS4, and NUITech's multi-software product, Snowflake Suite.

The MT 50 is designed for use in interactive museum exhibits, but in my opinion, holds great potential for use in public libraries and K-12 media centers (libraries), and even in classroom settings.

RELATED

Ideum's Press Release (pdf)
Ideum's MT-50 Table Specs (pdf)
Multi-touch Snowflake Suite trial, downloadable from the NUITech website

Eric Havir's Microsoft Surface in Education Links

I cut and pasted the following information about Microsoft Surface in Education from Eric Havir's Microsoft Surface blog. I've posted about some of these applications, but in light of the plea for Microsoft to listen to educators concerning the development of multi-touch applications, I thought it would be a good idea to share these links.

I hope that Eric won't mind mind this "re-blog"!

"Here are some applications by Microsoft, our Microsoft Surface partners and others."

• Churchend Primary School shows how teachers and students react to Surface in the classroom. There's also a great behind the scenes for developers.
• I had a few visits with Dr. Neil (1 2 3) talking about his firms edu apps for primary and secondary school kids.
• A paint application called Paint Touch that shows how even pre-schoolers can be engaged with Microsoft Surface.
• Wales Education Suite is a set of applications for primary schools
• Play together, learn together mixes fun with education
• Surface Math shows primary school kids engaged with Surface
• Magnification Ring has applications in education and museums
• The Local Impact Map used by Microsoft to educate representatives of governments and NGOs on corporate social responsibility
• History at your Fingertips is an adult focused application used at the national conventions last fall during the US presidential race
• The Pits is used at trade shows for sales, but has great educational applicability.
• Calculation Game by Ohio State's Computer Science & Engineering students and Geography faculty
• This clip from Microsoft Research UK show's how magical Microsoft Surface is for primary school students. It's fun to see the kids reactions.
• This video by Max is a music creation application, but imagine the possibilities with the objects to create educational applications linked with the physical world.
• Neuro-rehab is focused on healthcare, but can easily be applied to education as well.

We've had a number of higher education institutions buying Microsoft Surface as well, so if you're at college you may see curricula including Surface in markets where it's available. Education developers - don't forget that MSDN-AA has the Microsoft Surface SDK Workstation Edition for subscribers to get you started. Let me know if I've missed anything in my list above. I'll make future posts on healthcare, financial services, etc.

Cheers.
Eric

Thanks, Eric, for sharing information about these Surface applications.