iPad Apps: Supporting Communication for Young People with Autism (& Links to Moms with Apps)

Have you ever watched a kid pick up an iPad for the first time and just go with it? 


Some parents have found that the same is true for their of children who have autism.  The  iPad is a great way to support learning and communication in that it is user-friendly and easy for children- and parents- to understand. 


Here are two videos that were shared with my by Liz Ditz,  author of the "I Speak of Dreams" blog.  The first video is of a boy with autism. The second video is of his little sister, interacting with the iPad to watch a "home-made" social story about a family trip to a coffee shop, created in the "Stories to Learn" app.



YOUTUBE INFO:

"Another too-cool app for his iPad, this one all about writing as well as spelling (http://itunes.apple.com/app/iwritewords-handwriting-game/id307025309?mt=8). For each letter in the word, the app says the letter, has him trace it in super-easy guided steps, and his written letter replaces the original letter in the word (at top of screen). When he finishes, the word appears in his handwriting. The program then spells it and pronounces it, displays a kid's illustration of the word -- and Leo gets to shake the original letters into a hole in the corner of the screen. LOVE IT."

STORIES TO LEARN

YOUTUBE INFO:
"Our family (and a friend) worked together to make this social story about visiting our local coffee shop for my son with autism. We used Stories2Learn (http://itunes.apple.com/us/app/stories2learn/id348576875?mt=8), on our iPad. It was so easy! And he loves it. In fact he loves it so much I had to have his sister demo it, as he loves to play the voiceovers over and over again. :)"


RESOURCES
Moms with Apps
Moms with Apps for Special Needs
Moms with Apps:  Characteristics of great apps for kids with autism

Ru Zarin's Interactive Multi-touch Applications for the Cognitively Disabled: Social stories, talking symbols, a piano, and more!

 

Trollskogen Final Demo from Ru Zarin on Vimeo.

The above video is a demonstration of Ru Zarin's masters degree project at Umea Universitet.

This project examined ways to use multi-touch technologies to support communication and learning among children with Down syndrome, autism, and related diagnoses within the age group of 5-8. I especially liked the animated social story application.

"Trollskogen is a communicative framework designed to enhance communication among people with cognitive disabilities. The forest is split up into interactive modules that provide a fun and engaging learning environment while helping improve on certain aspects of speech, reading/writing and symbol based languages. This framework has been deployed on a custom multi-touch table prototype built at the Interactive institute Umeå, enabling the children to interact with their fingers in a more natural, intuitive way rather than a traditional keyboard/mouse setup."

RELATED READING
RELATED VIDEOS OF THE PROJECT DEVELOPMENT

Ru collaborated with the illustrator Linda Arvidsson for the characters and objects found in the troll forest theme.  

I especially liked the Troll Forest Cabin, which is shown in the social stories section of the video.

Cross-posted on the TechPsych blog.

Resources for the (therapeutic) use of digital and multimedia storytelling and social stories for children and teens...

The most frequently visited post on this blog is Interactive Multimedia for Social Skills, Understanding Feelings, Relaxation, and Coping Strategies, and the hits are increasing. For that reason, I'm working on an extensive update, which is very involved process, given the increase in research in this area. Until then, I thought that it would be helpful to provide a mini-update.

Below are some resources and links for those of you who are interested in digital multimedia story telling or digital social stories with young people. Although some of the resources are specific to children or teens with autism spectrum disorders, I've also included information that is appropriate for use in regular classroom settings.

(If this is your first visit to this blog, it might be a good idea to first check out the resources from the above link, and then return to this post.)

Digital Storytelling and 21st Century Skills (pdf)

This nine-page primer is useful for anyone interested in learning how to create digital stories or develop digital storytelling activities with young people. The information was provided by David Jakes, an instructional technology coordinator for Community High School District 99 in Downers Grove, IL, provides a good case for digital storytelling and an outline of the process of implementing related activities at the high school level.

David Jakes has a website, Jakesonline.org, that contains additional resources about digital storytelling, including strategies for instruction. The website also provide information about collaborative tools and a collection of extensive web resources.

Center for Digital Storytelling

USING MULTIMEDIA SOCIAL STORIES TO INCREASE APPROPRIATE SOCIAL ENGAGEMENT IN YOUNG CHILDREN WITH AUTISM (doc)

Encouraging Positive Behavior with Social Stories: An Intervention for Children with Autism Spectrum Disorders pdf (Shannon Crozier, Nancy M.Sileo) Teaching Exceptional Children, July/August 2005 pp. 26-31

This article provides information that supports a systematic method of implenting social stories that is integrated into a student's Functional Behavioral Assessment and IEP.

Process:
• Team identifies the need for behavior intervention.
• Functional assessment is completed.
• Social stories included in behavior plan.
• Social story is written.
• Social story is introduced and progress is monitored with data.
• Success is evaluated with data.

Note: The authors cite an article written in 1999 that mentions that the use of multimedia social stories has not been demonstrated to be effective, as little research had been completed in this area at the time. Take this with a grain of salt, as there are recent studies (see below) regarding the effective use of multimedia applications, including computer/video games and VR, for social skills training as well as counseling.

An evaluation of the integrated use of a multimedia storytelling system within a psychotherapy intervention for adolescents. (pdf)

Current Autism Research on Social Stories (Vol 2, Issue 8; August 2007) Positively Autism

Multimedia Instruction of Social Skills (CITEd Research Center- Center for Implementing Technology in Education: Multimedia Technologies)

This link provides extensive information about on-line resources for programs that simulate social interaction. It also includes information about the use of social stories with students, and resources for putting together multimedia social stories. Included are some summaries of research about multimedia social stories and the use of multimedia for instructional activities.

Be sure to explore the rest of the CITEd site when you have the time.

Related:

Post: Special issue on Multimedia, Media Convergence, and Digital Storytelling

Digital Stories Targeting Social Skills for Children with Disabilities. Cori More (PRO-ED Journal, 2008)

Digtal/Multimedia Storytelling from A Storied Career: Kathy Hansen's Blog to explore traditional and postmodern forms/uses of storytelling

Digital Storytelling - Katie Christo's Wiki - how-to, resources, tutorials, rubrics, lesson plans, digital storytelling across the curriculum, etc.

The Story-Centered Curriculum - eLearn Magazine

Mind Reading: An Interactive Guide to Reading Emotions

Mind Habits: The Stress Relief Game

Video modeling software for visual learners and those who have autism spectrum disorders

Activity Trainer, video modeling software from Accelerated Educational Software, supports the following activities:

• Academic
• Communication
• Daily Living
• Non-Verbal Imitation
• Recreation
• Social
• Vocational

A free 30-day trial of the software can be downloaded from the Accelerations Educational Software website.

On the Accelerations Educational Software website, you can find other products, such as Storymovies, which is the product of a collaboration between Carol Gray (social stories), Mark Shelley, and the Special Minds Foundation.