Feb 6, 2010

Interactive Visual Supports for Children with Autism: Gillian Hayes' work at the Social and Technology Action Research Group:

Here is an update about the work of Gillian Hayes, an assistant professor at the School of Informatics at the University of California at Irvine. Much of her work focuses on technology that supports young people with autism spectrum disorders. Hayes received her Ph.D. from Georgia Tech:  Documenting and Understanding Everyday Activities through the Selective Archiving of Live Experiences pdf  (2007).

In the YouTube video below, Gillian Hayes discusses her work with technology with young people with autism spectrum disorders.

Photos from the STAR website:

vSked_1 575x320

The STAR group is researching the SenseCam, too!

About the SenseCam, from the Microsoft Research SenseCam Website:

"SenseCam is a wearable digital camera that is designed to take photographs passively, without user intervention, while it is being worn. Unlike a regular digital camera or a cameraphone, SenseCam does not have a viewfinder or a display that can be used to frame photos. Instead, it is fitted with a wide-angle (fish-eye) lens that maximizes its field-of-view. This ensures that nearly everything in the wearer’s view is captured by the camera, which is important because a regular wearable camera would likely produce many uninteresting images."

New study proves that Microsoft's sensory innovation aids memory recall
Technology Review Article 

Images from Microsoft Research:


The SenseCam application has the potential to be a resource for people who have developmental delays, traumatic brain injury, severe attention deficits, and autism spectrum disorders. It would be a great tool for special educators, occupational and speech/language therapists, and rehabilitation specialists.
SenseCam Videos      Research and Publications


STAR:: Social and Technology Action Research Group
Interactive Visual Supports for Children with Autism

Technology helps teach kids with autism: Informatics assistant professor designs computer devices to aid instruction, record-keeping.

Monibi, M., Hayes, G.R. Mocotos: Mobile Communication Tools for Children with Special Needs. Proceedings of Interaction Design and Children, pages 121-124 ACM, 2008

Sen H. Hirano, Michael T. Yeganyan, Gabriela Marcu, David H. Nguyen, Lou Anne Boyd, Gillian R. Hayes vSked: Evaluation of a System to Support Classroom Activities for Children with Autism. To Appear In CHI 2010 (Atlanta, GA, 2010).(pdf)

"Particularly interesting for students with autism who often struggle with group work and social interaction, we also uncovered the potential for these types of interactive classroom technologies to support these challenging focus areas."

Note:  I think the following website contains the vSked prototype application. I poked around the site and it looks teacher-friendly. 


Gillian Hayes said...

We are so glad you like the work! Please feel free to send us any comments, suggestions, or anything else.



Lynn Marentette said...

I'll be at CHI'10 and hope to attend your presentation!

Anonymous said...

I would like to draw attention to our new app, called iPicto: for iPhone, iPod Touch

and iPad.
This app is designed to guide people with a (mental) disability, with or without
dementia/alzheimer, asperger, autism and / or a disorder in communication.

This new app iPicto is also a very good tool in learning a way of communication,

for example speech difficulties.

I refer you for further information, visit the App Store.

See for it: http://itunes.apple.com/us/app/ipicto/id423225072?mt=8&ls=1

Thank you for attention,


Erwin van den Hout
The Netherlands