Interactive iPad Apps for Kids with Autism: Could some of these be transformed for multi-touch tabletop activities?

I came across a great post about interactive iPad apps for special needs:

Ten Apple iPad Apps to Help Children with Autism
Joanne Carter, MacCreate 11/5/10


In this article,  Joanne Carter shares screen shots and detailed descriptions of a variety of iPad apps that support learning and communication skills of young people with autism.  You can find additional information about the apps discussed in the article by visiting the following links: 

Proloquo2go, Story_Builder, "Off we go" book series, Soundtastic, Visual Impact, Living Safely,  Tapspeak Sequence for iPad, iCommunicate for iPad, Autoverbal Talking Soundboard Pro, Is that Gluten Free?, and I Dress for Weather. 


I think that some of these apps have the potential to be transformed and tweaked for use on multi-touch, multi-user  tables such as the SMARTTable or Microsoft's Surface.  The aim would be to encourage paired and group communication and social skills among children with special needs.  I'll share my thoughts on this topic in a future post.

iPad Apps: Supporting Communication for Young People with Autism (& Links to Moms with Apps)

Have you ever watched a kid pick up an iPad for the first time and just go with it? 


Some parents have found that the same is true for their of children who have autism.  The  iPad is a great way to support learning and communication in that it is user-friendly and easy for children- and parents- to understand. 


Here are two videos that were shared with my by Liz Ditz,  author of the "I Speak of Dreams" blog.  The first video is of a boy with autism. The second video is of his little sister, interacting with the iPad to watch a "home-made" social story about a family trip to a coffee shop, created in the "Stories to Learn" app.



YOUTUBE INFO:

"Another too-cool app for his iPad, this one all about writing as well as spelling (http://itunes.apple.com/app/iwritewords-handwriting-game/id307025309?mt=8). For each letter in the word, the app says the letter, has him trace it in super-easy guided steps, and his written letter replaces the original letter in the word (at top of screen). When he finishes, the word appears in his handwriting. The program then spells it and pronounces it, displays a kid's illustration of the word -- and Leo gets to shake the original letters into a hole in the corner of the screen. LOVE IT."

STORIES TO LEARN

YOUTUBE INFO:
"Our family (and a friend) worked together to make this social story about visiting our local coffee shop for my son with autism. We used Stories2Learn (http://itunes.apple.com/us/app/stories2learn/id348576875?mt=8), on our iPad. It was so easy! And he loves it. In fact he loves it so much I had to have his sister demo it, as he loves to play the voiceovers over and over again. :)"


RESOURCES
Moms with Apps
Moms with Apps for Special Needs
Moms with Apps:  Characteristics of great apps for kids with autism

Connected Youth: Theme of the July-Sept issue of IEEE Pervasive Computing

The guest editors of the July-September 2010 issue of IEEE's Pervasive Computing magazine are John Canny, an engineering professor at the University of California, Berkeley, and Jason Hong, an assistant professor at Carnegie Mellon University's Human-Computer Interaction Institute.  Their article provides an introduction to the publication's timely theme, Connected Youth.  The editors find that the study of the current generation of children and teens provides useful information about the future of computing as in integrates more seamlessly into our daily lives, the way we learn, and our relationships and interaction with others across time, place, and generations.

I'm in the middle of reading this issue of Pervasive Computing.  The articles that have caught my eye so far include "Story Time for the 21st Century", which describes the research an implementation of an interactive book-reading system designed to connect children, family members, and grandparents who live in distant locations. The system involves videoconferencing with paper books and interactive content, and enables grandparents to read with their grandchildren via the Internet.



Additional information about Story Play, a system that is still under development, can be found on the Nokia Research Center website: "Family Story Play: Story Time for the 21st Century".  A follow-up project to Story Play is Story Visit:



I'll post more about the articles from the Connected Youth issue of Pervasive Computing in the future.

Ru Zarin's Interactive Multi-touch Applications for the Cognitively Disabled: Social stories, talking symbols, a piano, and more!

 

Trollskogen Final Demo from Ru Zarin on Vimeo.

The above video is a demonstration of Ru Zarin's masters degree project at Umea Universitet.

This project examined ways to use multi-touch technologies to support communication and learning among children with Down syndrome, autism, and related diagnoses within the age group of 5-8. I especially liked the animated social story application.

"Trollskogen is a communicative framework designed to enhance communication among people with cognitive disabilities. The forest is split up into interactive modules that provide a fun and engaging learning environment while helping improve on certain aspects of speech, reading/writing and symbol based languages. This framework has been deployed on a custom multi-touch table prototype built at the Interactive institute Umeå, enabling the children to interact with their fingers in a more natural, intuitive way rather than a traditional keyboard/mouse setup."

RELATED READING
RELATED VIDEOS OF THE PROJECT DEVELOPMENT

Ru collaborated with the illustrator Linda Arvidsson for the characters and objects found in the troll forest theme.  

I especially liked the Troll Forest Cabin, which is shown in the social stories section of the video.

Cross-posted on the TechPsych blog.

Kicker Touchscreen Conference Phone (front)

Kicker Touchscreen Conference Phone (front)
Originally uploaded by Kicker Studio

I am a fan of the work by Kicker Studios. I especially enjoy reading their blog that gives great details about how product design is done. I always come away from the blog with something new.

In the case of the touch-screen conference phone, the designers focused on their own needs, since they spend a chunk of time in conference calls. To get a closer look at the design process behind this phone, see the blog post, " Product Concept: Touch Screen Conference Phone".

RELATED

The 30 Most Influential Interactive Products

Mobile Gesture Design at Nokia: Gesture Interaction Around the World

From the Nokia Conversations YouTube Channel:


The video explains it all.

(Fritz Desir, thanks for the link!)

HP TouchSmart PC Supports Communication for Students with Autism

Autism Tech | Consumer Health Video Library - Heath Video

Posted using ShareThis

Hope Technology School

Teliris InterAct TouchTable and TouchWall: Immersive Collaboration & Telepresence; DVE's Holographic Tele-Immersion Room

A few years ago I took a class about virtual reality and how it can be used in education and training. One of the topics we covered was telepresence. One of the companies I looked at was Teliris.

According to a whitepaper on the Teliris website, "Business Value of Telepresence", by S. Ann Earon, "Telepresence is what videoconferencing was meant to be: reliable, highly interactive, easy to operate, resulting in a natural meeting with transparent technology and an emphasis on human factors."

Teleris now offers something they call Immersive Collaboration, which involves the use of surface computing that supports document and multimedia content sharing across locations, as if all of the group members are in the same room


Watch the demonstration of the Teliris Collaboration Touch Table in a telepresence meeting. In the video clip below, the narrator shares content from a local Teliris Collaboration Touch Table to a remote meeting participant who is at another table.

"Touch to Telepresence"

Business Holograms!
DVE (Digital Video Enterprises) developed a Tele-Immersion room that uses Cristie Digital Systems Mirage HD 3D projectors to create holographic images of remotely located meeting participants:

DVE Telepresence: An Introduction (A plug from DVE, but informative.)

DVE Portable Virtual Presentation -A Volumetric 3D image from a projector hidden from the audience's view:

This system can display 3D images on the stage, and supports 2-way interactive HD feeds.

The above examples demonstrate how newer technologies, including table-top surfaces, can be used for collaborative business meetings. I can envision this technology used for medical education, medical consultations, and collaboration between artists and musicians.

When the price comes down, perhaps we will have these systems in our family rooms!