Showing posts with label social skills. Show all posts
Showing posts with label social skills. Show all posts

Dec 3, 2012

Musings about still-popular Interactive Multimedia Technology blog posts from the past...

I have been blogging for over six years now, and from time-to-time I like to take a look my Google Analytics stats.   A large chunk of the visitors to this blog come from the US, 


I've noticed that the following blog posts still get hits, even though they were written a while ago. I'm not sure why, but I think it would be helpful to revisit each one, clean up any broken links, and provide new information related to each topic.  It might take me a while.

Reader input is welcome!

Games to Lift Stress Away: Flower, flOw (and Cloud), from thatgamecompany (2009)
A number of people who do a search of the word "Flower" or "Flower Pictures"  find this blog post, every day.

Interactive multimedia for social skills, understanding feelings, relaxation and coping strategies, etc. (2006)
This post gets a lot of hits from people who work in K-12 settings, looking for "free online interactive social skills games" or something similar.  

Interactive Touch-Screen Technology, Participatory Design, and "Getting It". (2008)
This is one of my rare "brain dump" posts. I noticed that in an attempt to update the post, I linked it to another post, written in 2010. 

The Children's Interactive Library: User Experience Design and the Library! (2009)
The Children's Interactive Library was a collaboration between Interactive Spaces, the Department of Computer Science, University of Aarhus, the Department for Design, Aarhus School of Architecture, and others. 

Yellowbird 6 lens 360 degree video camera creates web-based interactive videos. (2009)
I got the link from Harry Brignull, who blogs at 90 Percent of Everything

The 3D Evolution: Part I, Introduction (2010) Hmmmm 3D TV, where are we now? 
To find out, check out the 3D Guy blog.


Teliris InterAct TouchTable and TouchWall: Immersive Collaboration and Telepresence, DVE's Holographic Tele-Immersion Room
Since I wrote this post  in 2008, it has received over 7,000 page views from Malaysia.  Is it possible that I have a secret fan club there?  

Window Shopping in the Web Outside (2011)

William Forsythe's "Synchronous Objects - One Flat Thing, Reproduced" Multidisciplinary online interactive project: Translating choreography into new forms. (2009)
(I like this stuff.)






Jul 14, 2012

Cute NAO robot performs "Evolution of Dance" and is an active participant in research with young people who have autism spectrum disorders.

I came across a cute video of a NAO robot performing the Evolution of Dance, and as I smiled, I remembered that the robot was used in some research about interventions for young people with autism. 


The technology behind the NAO robot was developed by Aldebaran Robotics, and more details can be found on the company's website, along with the video and links I've provided below. (Aldebaran Robotics is hiring, btw.)


Enjoy the dance performance!

Evolution of Dance by NAO Robot 


DEPCO NAO Robot and Notre Dame Autism Research 



NAO Next: Gen: The New Robot of Aldebaran Robotics



New Robot Helps Autistic Children Interact (UConn) Research with Tim Giffort, CEO of Movia Robotics, and UConn professor Anjana Bhat 


(Above)Bruno Maisonnier of Aldebaran Robots Highlights Therapeutic Uses of the NAO Robot 

RELATED 
Aldebaran Robotics NAO Developer Website Psychologist explores effective treatment options for children with autism disorders 
Susan Guibert, Notre Dame News, 4/16/10 
Robot Speaks the Language of Kids 
Beth Krane, UConn Today, 8/5/10 
Movia Robotics: Systems for Learning, Training, Education and Therapy 
Timothy Gifford and Anjana Bhat on Using Robots to Help Autistic Children 
Rachel Z. Arndt, FastCompany, 4/1/11 
Anjana N. Bhat, University of Connecticut Timothy Gifford 
Social story powerpoint for children with autism who are participate in research at the FUN Lab at Notre Dame (ppt)

Sep 16, 2011

MindHabits Online Demo: Useful Serious Game for Social Skills Group Activities



I'd like to share the on-line demo of MindHabit's suite of serious games that I've found useful in my work with teens and young adults who need support in the area of social-emotional skills. 


What I like about the online demo is that it adjusts to the player's responses. This feature made it fun to use during the last few social skills groups I facilitated at work, since it could be played by students with a range of cognitive abilities. I had students take turns playing the game using a SMARTboard, and found that all of the students paid attention to what was going on. In my opinion, using the interactive whiteboard supported "off-the-shoulder" learning among the students who were not at the board. 


MindGames is available for Windows and Macs, and the full version is just $19.99 and provides 100 game levels.  The full version tracks progress and includes four games.


Here's some information from the company's website:  
"Based on social intelligence research conducted at McGill University, these stress busting, confidence boosting games use simple, fun-to-play exercises designed to help players develop and maintain a more positive state of mind." 
 "Based on the principles of social intelligence: Inhibition - uses game mechanics to promote positive habits; Association - connects personal info to positive feedback; Activation - uses personal references"




 MindHabits MindHabits MindHabits MindHabits
 MindHabits
You are playing the MindHabits Trainer online demo. Your progress will not be logged beyond this session.
Copyright © 2008 MindHabits inc. All rights Reserved.

Upcoming: 

Sep 8, 2011

Update, plus iGaze app by Dunedin Multimedia for use during social skills group activities

So what am I up to now?  


I'd like to share with my readers that I've decided to continue in my present position as a school psychologist, while still devoting a portion of my free time to technology. From time-to-time I think deep thoughts about usability, accessibility,  and UX/Interaction related to off-the-desktop interactive multimedia applications running on screens of all sizes.  I'm hoping to create a few multimedia experiments using HTML5 and JavaScript, and explore jQuery if and when I can find the time!  


For the present school year, my main school is a program for students with more significant disabilities, including autism spectrum disorders.  My second school is a magnet high school for technology and the arts,  located on the same campus.  I also consult throughout the district on cases involving students who have suffered traumatic brain injuries, as well as students who have multiple disabilities.  I am thankful that I have a job in a school district that values 21st Century technology.  


I'm looking forward to another technology-rich school year.  I've spent some of the time I usually devote to blogging devoted exploring iPad apps instead.  Since I'm new to the world of iPads, I'm still in discovery mode.  What an adventure!   


There are plenty of educational apps out there, and many of them are suitable for students with special needs.  On the other hand, there is much room for improvement - across all iPad app categories.  Since there is very little research about what makes up a killer app- or suite of apps- for students with special needs, experimenting with  iPad apps is uncharted territory. 



I made the decision to bring my personal iPad2 to work after I discovered a number of apps that I thought would be useful in my work as a school psychologist with students who have special needs, including autism spectrum disorders.  

One of my intervention themes this year focuses on social skills.   This is especially important for students who participate in our schools community-based job training program.  I'm using some content from Unique Learning's transition materials,  as well as on-line activities from Do2Learn's JobTips website, because my aim is to facilitate social skills that will be useful in a variety of job and community settings.   


Although my main technology tool for working with groups is the SMARTBoard,  I've found that using a combination of interactive whiteboard and iPad activities to be especially effective.  I'm paving the way for more role-play activities in the future, and attempting to use technology to my advantage.


This past week, I used the iGaze app, created by Dunedin Multimedia, to help a group of high-school level students practice establishing and maintaining eye gaze, something that is difficult for most of them to demonstrate "in-person".  I was amazed.  Each student was excited to take his or her turn.  Even more amazing?  When each student took a turn, the other students looked at their eyes and faces.  No one rocked or "stimmed".  No one made noises.  I observed several instances of joint attention, much to my delight.   


Below is a video from Dunedin Multimedia's YouTube channel that is similar to what the students viewed during their group activity:
Here is some information from Dunedin Multimedia about the iGaze app:
"Eye contact is important to communication and social development, and yet the impaired ability to make and maintain eye contact is one of the most striking aspects of autism. iGaze is an eye contact simulator that can help to build confidence in using this important means of nonverbal social communication.  The app also contains information on eye contact and eye gaze, with links to relevant research."

During the social skills activity involving the iGaze app,  I used the SMART Board to display a large picture of a boss and a worker standing face to face, making eye contact, engaged in conversation.  The picture served as an anchor to remind the students of pictures and videos they'd previously viewed that illustrated the concept of face-to-face interaction and the importance of establishing eye-contact with others from time-to-time.


I'm hoping I will be able to access the YouTube videos from Dunedin so I can use them on the SMART Board. It will be interesting to see how this plays out!   I'm also planning to take a closer look at Dunedin Multimedia's emotion x app for the iPad.


RELATED 
Screen-shot of iGaze for the iPad Dunedin:
iPad Screenshot 1
SOMEWHAT RELATED
The SMART Table at my school was updated today - I'm looking forward to using it for some group activities, now that it is back in working order and has new applications loaded up and ready to go!


If you are interested in learning more about technology related to students with special needs, be sure to check out Kate Ahern's blog, Teaching Learners with Multiple Special Needs

Kate's post about the features of Unique Learning Systems.


Upcoming:  more about tablets, interview with folks from Stantum, social-skills game-in-progress.....large displays in public spaces update....

Jul 26, 2011

OPEN SOURCE MULTI-TOUCH SOFTWARE FOR YOUNG PEOPLE WITH AUTISM SPECTRUM DISORDERS- Featured in the WSJ! (Video and links)

Well before the iPad entered the market, researchers such as Dr. Juan Hourcade at the University of Iowa, began to develop multi-touch software to  support young people with autism spectrum disorders and other disabilities.  I've been following this research for a while, and was happy to discover that Dr. Hourcade's work was  recently featured in a recent Wall Street Journal article and video.  


If you are a parent or work with a young person with special needs, you might be interested in learning more about Windows-7 based touch-screen software.  The software shown in the video below, as well as related resources, are available for free on the Open Autism Software website.




RELATED

Article:
Shalini Ramachandran, Wall Street Journal, 7/26/11

Previous Post: Interactive Multi-Touch for Children with Autism Spectrum Disorders:  Research and Apps by Juan Pablo Hourcade, Thomas Hanson, and Natasha Bullock-Rest, University of Iowa 4/26/10




Why is this important to me?   
I work with young people with a range of disabilities, including autism, as a school psychologist.  One of my schools is a program that is technology-rich.  Although we don't have iPads, there is a SMARTBoard in every classroom and in other rooms around the school. We have a Wii,  a few multi-touch all-in-one PC's,  and recently received two Dell multi-touch tablet PCs

I noticed that Dr. Hourcade is looking for people who'd like to create similar apps for the iPad.  I'd be interested in knowing anyone who might be working on this.  I'd like to help in some way, but I don't have a lot of free time to do this on my own. 

I have a new iPad2, and after playing around with a ton of apps, I was inspired to downloaded XCode4 and think about what I could create. I'm a Mac person at heart, but I learned to program within a Windows environment (C#).    I need a way to maintain my programming skills and gradually learn a few new ones. This sort of project would be useful to me in my "day job", too!




SOMEWHAT RELATED
3D Interactive Heart, by 22Miles, on a Dell Latitude Xt2


May 31, 2011

Top 10 All-Time Posts on the Interactive Multimedia Technology Blog

I'm finishing up the last couple weeks of the school year, so I'll have little time to post this week.  I hope you enjoy exploring the following links!


Revised Post 8/1/06: Interactive multimedia for social skills, understanding feelings, relaxation and coping strategies


Teliris Interact TouchTable and TouchWall: Immersive Collaboration & Telepresence; DVE's Holographic Tele-Immersion Room


Games to lift stress away: Flower, flOw, (and Cloud), from thatgamecompany


Power to the Pixel Cross-Media Forum Streaming Live from London Today #PttP


HACKED KINECT MULTITOUCH using libFreenect and libTISCH (via Florian Echtler)


Link to iTV Doctor Rick Howe's post about 2D to 3D, 3D TV data points, and 3D content distributers


Temple Grandin - A gifted visual thinker, who also has autism, featured in HBO movie starring Claire Danes.  Update: Video of Claire Danes' acceptance of a Golden Globe for her performance


Algodoo physic app. for the SMART Board 800 series, supports multi-user interaction!


Wii Just Dance2 and Kinect Dance Central:  UI and Usability Approaches; Challenges for Developoing Accessible Games


Interactive Touch-Screen Technology, Participatory Design, and "Getting It" -Revisited







Feb 24, 2011

Today I hooked up a Wii to the IWB in the school's therapy room. Next - a Kinect?! (Angels are welcome to help us expand the school's "games" programs for students with special needs)



Today, I hooked up our school's Wii to the newly-installed IWB in the therapy room for the first time, and used it during a session for for a social-skills activity with two students who have autism spectrum disorders.  The students helped each other to create their own "Mii" avatars.  I had them play the bowling game, and was impressed how this activity elicited social conversation between the students, with minimal effort on my part.

Most of students in the program at Wolfe are in grades 6-12. They have cognitive, language, and motor delays.  A good number of the students also have autism spectrum disorders. Some have multiple special needs.

We have found that when our students are provided with interactive activities displayed on the large screen of an IWB, they tend to increase their level of attention to their peers and also communicate more with one-another, as well as with the teachers and staff.

By using an IWB for games at school, we are extending the reach of how this technology can be used with students who have more complex special needs.   By providing a means  for our students to learn to play positive games, we help them develop important physical, social, and leisure skills that they can use outside the school setting with non-disabled peers and siblings.  My hunch is that the games will also help promote cognitive/problem solving skills, too.

NOTE:
The funds to purchase the Wii were donated to our school, but did not cover additional games or accessories. We'd like to purchase Rock Band and Wii Fit. We'd also like to expand our program and purchase an Xbox with a Kinect.   An iPad or two would be OK, too : )

If there are any angels out there who'd like to donate funds for our "games" program at Wolfe, please contact me through my Google profile. I will connect you with the appropriate person.

Game designer/developers/researchers/students:
If you are interested in volunteering your efforts to work on a basic cooperative, pro-social game for the Kinect, SMARTTable, or interactive whiteboard, please contact me.


Nov 6, 2010

Interactive iPad Apps for Kids with Autism: Could some of these be transformed for multi-touch tabletop activities?

I came across a great post about interactive iPad apps for special needs:

Ten Apple iPad Apps to Help Children with Autism
Joanne Carter, MacCreate 11/5/10


In this article,  Joanne Carter shares screen shots and detailed descriptions of a variety of iPad apps that support learning and communication skills of young people with autism.  You can find additional information about the apps discussed in the article by visiting the following links: 

Proloquo2go, Story_Builder, "Off we go" book series, Soundtastic, Visual Impact, Living Safely,  Tapspeak Sequence for iPad, iCommunicate for iPad, Autoverbal Talking Soundboard Pro, Is that Gluten Free?, and I Dress for Weather


I think that some of these apps have the potential to be transformed and tweaked for use on multi-touch, multi-user  tables such as the SMARTTable or Microsoft's Surface.  The aim would be to encourage paired and group communication and social skills among children with special needs.  I'll share my thoughts on this topic in a future post.



Aug 21, 2010

Reflections About Interactivity in my Present World

Background:  For those of you who are new to this blog, I work as a school psychologist in a public school district in North Carolina. During the mid 2000's, I took a variety of computer courses, leading up to a decision to work part time while taking graduate courses part-time such as human-computer interaction, games, information visualization, ubiquitous computing, VR, etc. I returned to work full time in 2008, due to the economic downturn.

I continue to maintain my passion for technology that supports natural user interaction, and share my interests on this blog and to a lesser extent, two other blogs.  I initially started blogging because it was a requirement for one of my courses, and found that my blogs served me well as on-line filing cabinets.

Update:  I don't usually post much about my work on this blog, but I have some exciting things to share.

New School Year, New SMARTBoard: I'd like am excited about the upcoming school year because my "home" school, Wolfe, a program that serves mostly teens and young adults up to age 22 who have more severe disabilities (including autism), now has an interactive whiteboard in every classroom.

School started for Wolfe students on July 26th, and three more whiteboards were installed.  One of the new SMARTboards is in the speech and language room, along with a multi-touch SMARTTable the school received last April, one is in the Art/Work Adjustment room, and one is in the room I use with small groups of students, which is used for music one day a week.


Although I have used interactive whiteboards in my work with students for several years, this is the first year that I have had one available to me most of the time in a school. Since most of the teachers received their IWBs over the past year, there is a pressing need to figure out what works, why it works, and how to create useful interactive content that is appropriate for the needs of students who have severe or multiple disabilities. We really can't wait.  

Why is this important to me?

Observations of positive changes:
Students who previously had limited interest in applications on the computer, or a limited attention span for such activities, demonstrate a high degree of interest and engagement with the activities on the IWBs we've tried so far.  Many students who do not attend to learning materials, or only for brief periods of time, actively look at the IWB screen and even interacting with it, and smile.   Some students who rarely-or never- speak sometimes vocalize more often during IWB activities!   Some are making connections between learning materials and what they interact with on the screen, something that simply did not happen previously.  Some students who rarely established eye contact with others or demonstrated joint attention do so during IWB activities, something I discussed in a post on the TechPsych blog.

Technology and my role as a school psychologist:
Designing effective interventions is part of my job as a school psychologist, and mixing interactive whiteboards and interventions is fairly uncharted territory.  I know that there are probably a few other school psychologists, counselors, social workers, and speech/language therapists out there who are wondering what to make of this technology and the students they serve directly, or indirectly through consultation.  There isn't much literature about this topic, so it is difficult to know what is truly "evidence based".

We are in the process of discovery. Within a school that has an IWB in every classroom, serving students with the most complex needs within the school district,  how can I best follow professional school psychology practices(pdf) regarding the provision of direct and indirect services. Some of these expectations are listed below:

"School psychologists promote the development and maintenance of learning environments that support resilience and academic growth, promote high rates of academic engaged time, and reduce negative influences on learning and behavior."

"School psychologists use information and assistive technology resources to enhance students’ cognitive and academic skills."

"School psychologists work with other school personnel to develop, implement, and evaluate effective interventions for increasing the amount of time students are engaged in learning."

"School psychologists facilitate design and delivery of curricula to help students develop effective behaviors, such as self-regulation and self-monitoring, planning/ organization, empathy, and healthy decision-making."

Working towards solutions:
I work closely with my colleague Kelly Cross, a speech and language therapist who serves Wolfe school and two classrooms of students with severe autism at a "regular" elementary school. Kelly also serves as the assistive technology and augmentative communication consultant for our school district.  She's used interactive applications and web resources for many years along with more traditional "hands-on" materials,  but like me, has had limited access to IWB's until recently.  She now has a SMARTboard in her room, along with the portable multi-touch SMARTTable Wolfe received last April.  We work with many of the same students, so with the influx of IWBs in our school, we've stepped up our collaboration.

One of Kelly's challenges is to figure out ways for teachers to integrate assistive technology and/or augmentative communication systems into their work with students during activities that involve interactive whiteboards.   Most of the research the area of assistive technology/aug com focuses on the use of technology to access applications as they are displayed on laptops or computer monitors, or factors related to the use of individual communication devices. The vSked project, led by Dr. Gillian Hayes at the University of California at Irvine, is on the right track in that it incorporates the use of a large interactive display that was used with students with autism, along with smaller hand-held communication systems, which I've discussed in a previous post.


vSked_1 575x320
vSKED in action

Workshop Presentation
This past week, Kelly and I presented at a workshop held in the Arlington VA school district that focused on the use of interactive whiteboards and related applications and web resources with students with special needs.  We shared some of the exciting things we've noticed with our students and shared "before and after" examples.  Included in the presentation were some of the video clips I quickly put together during the first days of school that had an impressive positive impact with students when they were used during interactive whiteboard activities. (Some of these video clips can be found in a previous post: Video clips that help students with autism learn and feel calm at the same time!)

During the workshop, we discussed a few guiding principals, such as the "least dangerous assumption" and the concept of Universal Design for Learning.   We also provided a sampling of resources previously used on the "small screen" appear to powerful when used with students interacting on the larger whiteboard screens.  Below are a few of the resources we shared:

Clicker5 is an application to support reading and writing that provides a natural voice output, and child-friendly word processor. It works well on interactive whitboards It can incorporate several communication symbol systems. It is a good tool for informal assessment with students with communication and other related needs.




Sensory World provides an intuitive navigation system for students to use as they explore various areas of a house and engage in learning and related activities. The site map for all of the areas of the house, as well as the activities, is graphical.




We shared resources from the National Gallery of Art's Kids Zone, a great website that offers plenty of interactive content:


Teachers who want a limited browsing environment for their students the Zac Browser is great for use on IWBs and the new large all-in-one touch screen displays:
Zac Browser

Another website that is good for visual-based browsing is Symbol World:

"The intention is that symbol readers, teachers and carers will contribute, and we are delighted at the number of contributors that have already sent us their work"

We shared a recent find, Taptu rthat can be used on an IWB.  Although Taptu focuses on the mobile touchable web, accessed through smartphones with internet access, it provides links to a wide range of websites designed with intuitive touch interaction in mind, perfect for students with special needs.  In many cases, Taptu web navigation resources work fine on the larger screen of the IWB.  The advantage is that a icon/visual based touch navigation system supports students who can't type and also those who have very limited reading skills.


Sports Navigation for Taptu

Below is a slideshow about the touchable web:
Taptu: Virtual Roundtable


Update: SMARTTable
At Wolfe, we'd like to create a conversation wheel with related activities for the SMARTTable that co-ordinate with SMARTBoard activities.  We'll probably experiment with the conversation wheel concept on the SMARTboard first.


Considerations:
One thing we've learned over the past few months is that it is bit more complicated to create content and activities for the SMARTTable than for the SMARTBoard notebook or Promethean flipchart.   We hope to have it customized to support scaffolded, customized classroom activities for students with special needs, but it might take more time than we had anticipated.  The school's immediate need is for touchable interactive content for all of the classroom IWB's, suitable for our students.

Complications:
Programming for the SMARTTable, for those who have 64-bit computers, requires Windows 7, Visual Studio 2008, and Expression Blend 3.   My HP Touchsmart, my home computer, is 64 bit, but runs Vista.  My school-issued laptop runs Windows XP and is also 64-bit.  To upgrade it, I will have to send it to the tech department for several weeks.   It will be slow-going, since I have to plan for my day-to-day activities and evaluations with students first.

Possible SMARTTable Solutions:
I'm hoping that some students from UNC-Charlotte might want to try their hand at multi-touch programming and help us out!  We'd welcome volunteers from other universities as well.   Wolfe's principal, Mary Jo Breckenridge, is very supportive of the use of innovative technologies with students with special needs, and would figure out a way to make a collaboration happen.










Upcoming Interactive Multimedia Technology Posts
I have about 6 posts in draft form about interesting interactive technologies, research, people, and companies involved with multi-touch, interactive multimedia, and natural user interface/interaction applications. I'll get them up as soon as possible.

One post is about 3M Touch Systems. Another is about an interesting multi-touch start-up company, Osmosis.  I revisited Ballantyne Village to update the use of interactive touch screen technology, something I discussed in detail, along with photos and video clips, in a 2008 post, Technology Supported Shopping and Entertainment User Experience at Ballantyne Village:  "A" for concept, "D" for touch-screen usability".   I got some inside scoop about the rationale behind the changes at the upscale center from a seasoned owner of a high-end audio-visual store I interviewed about 3D TV.   I have some interesting information about current research in "glasses-less" 3D displays. Sharp will be coming out with a 3D cell-phone camera AND glasses-less cell-phone display in the not-to-distant future.  

I'm preparing for posts that highlight a few of my favorite blogs. Until then, take a look at the recent posts on Tracy Boyer's Innovative Interactivity blog, and also InteractiveTV Today.

RELATED & SOMEWHAT RELATED
"The AAC-RERC conducts a comprehensive program of research, development, training, and dissemination activities that address the NIDRR priorities and seek to improve technologies for individuals who rely on augmentative and alternative communication (AAC) technologies. The mission of the AAC-RERC is to assist people who rely on augmentative and alternative communication to achieve their goals by advancing and promoting AAC technologies and supporting the individuals who use, manufacture, and recommend them."



Janet Light, Kathy Drager, Penn State University




Jeff Higginbotham's Bibliography:  Viewing AAC Through Authentic Social Interactions (pdf)

ProLoquo2Go (iPhone/iPod Touch/iPad communication system)


Also posted on the TechPsych blog

Aug 3, 2010

Back to school: Video clips that help students with autism learn and feel calm at the same time!

One of the schools I serve as a school psychologist has a number of students with severe autism.  Over the past year or so, each classroom was outfitted with a new interactive white board (IWB). We've found that multimedia content displayed on these large screens is much more engaging than what is viewed on computers with much smaller displays.
The exciting news is that some of the students who have minimal interest in computers pay a great deal of attention to activities on the IWBs.  Students who have self-stimulatory or repetitive behaviors that interfere with their ability to engage in traditional activities don't seem to exhibit these patterns nearly as much when the focus is on the IWB.   In my opinion, IWBs are great tools for reaching and teaching young people who have autism spectrum disorders!

I'm in the process of creating a variety of short video clips that teachers can embed in learning activities that also provide a way for students to reduce their levels of anxiety, agitation, and/or repetitive behaviors.

The following videos are my first experiments, and are not as polished as I'd like.  They are best viewed on a large-screen display or IWB, set to high definition.  Although various students have viewed these videos a few times this week, they were a great hit. In some cases, we found it useful to loop the video, especially for students who require repetition of content.

The videos were shot using a small hand-held Panasonic HD camcorder, and quickly edited in iMovie. The music was either taken from the iMovie music library or created using riffs in Garage Band, an Apple iLife product.

Enjoy!

Lily Pond and Music

In this video, I used a few subtitles to direct the viewer to points of interest, such as the little grasshopper hiding in the pink lily and a dragonfly, which appears near the end of the video.

Butterflies and Flowers Set to Music

I set this version to piano music for a student who listens to piano music as a coping strategy. I plan to create another version with other genres of music. This particular score was created with piano riffs from Garage Band.

Up Close at the Charleston Aquarium - with relaxing music


Even the most inattentive students paid maximum to this video when it was looped!  I think they liked the variety of sea life, especially the turtles.  Tip:  If you plan to capture video at an aquarium, plan to visit at a time where there are few visitors!

I can't wait to take my video camera to the Atlanta aquarium.


Minnows and Music


The minnows swimming around in the murky green tank are a little boring, but things get slightly more exciting when the bait-shop owner feeds them. The music makes up for what the video lacks. The students didn't mind at all.

Jellyfish at the Discovery Place Aquarium, Charlotte, NC - with music

I'd like to visit Discovery Place at a less-crowded time and re-capture the jellyfish in action from a better vantage point.
UPDATE
I'd like to see if there are similar videos set to music by William Orbit.
I found this video on YouTube of William Orbit's "Sea Green", set to video created by a fan:


Below is "Surfin", great for chilling - needs some video...


(Cross-posted on the TechPsych blog)

Apr 26, 2010

Interactive Multi-Touch for Children with Autism Spectrum Disorders: Research and Apps by Juan Pablo Hourcade, Thomas Hanson, and Natasha Bullock-Rest, University of Iowa

Dr. Juan Pablo Hourcade heads a team of researchers at the University of Iowa who are creating multi-touch applications and other technologies to support communication, collaboration, creativity, and self-expression for young people with Autism Spectrum Disorders.  The picture below is a screen shot of the team's web page that includes a few videos of the team's important work: (Videos can be found on the Technologies for Children with Autism Spectrum Disorders webpage.)


RELATED VIDEOS

pymt demo reel from Thomas Hansen on Vimeo.


Multi Touch @ University of Iowa from Thomas Hansen on Vimeo.


RELATED
Hourcade, J.P., & Hansen, T.E. (2010). Multitouch Displays to Support Preschool Children's Learning in Mathematics, Reading, Writing, Social Skills and the Arts (pdf)


Dr. Hourcade is organizing the Digital Technologies and Marginalized Youth workshop on Satuirday, June 12, 2010 at the 9th International Conference on Interaction Design and Children (IDC), which will be held this year in Barcelona, Spain.


Other workshops that will be held at IDC 2010:
Interactive Storytelling for Children
Extended Abstract: Interactive Storytelling for Children (pdf)
Designing Tangibles for Children
Play and Technology:  How does technology initiate and facilitate physical play?


Dr. Hourcade's publications

Mar 30, 2010

A Long Mix of Topics: Updates - Cognitive "bursts", technology-supported interventions, interactive whiteboards, digital storytelling, social skills, and reflections about a new SMARTtable.

UPDATED


In this post, I share some of my reflections about the new multi-touch SMARTTable that arrived last week at one of the programs I serve as a school psychologist.  I decided to update two posts I wrote in 2008, because they provide links and resources that will be useful to my colleagues as we explore this exciting technological tool.
We have a SMARTTable!  







The SMARTTable arrived last Thursday!  
I'll be meeting with some of my colleagues to review our growing library of digital content and figure out what sort of content and activities we can quickly import into the toolkit that came with the SMARTTable.  We also will  refine our ideas about a new application that we hope to enter in a contest sponsored by SMART Technologies.  (I have a few experiments I created using C#, WPF, and Visual Studio 2008 that I'd like to flesh out for the SMARTTable.  I'm counting on one of the teacher assistants, a retired computer programmer who is familiar with C++, to help, and hopefully, a few high school computer students.)


Note: The SMARTTable developer's SKD works on 32-bit Windows computers, according to a representative from SMARTTechnologies.  My computer is 64 bit.  I am investigating ways to work around this problem without having to spend additional money.  
Update:  Should be fine using Windows 7!

In the meantime, I'm thinking of ways the SMARTTable can be used for the students I work with to share their developing "sense of self" with others, focusing on the following questions:

Who am I? (Strengths, skills, preferences, barriers, etc.)
How do I feel? How do I share my feelings with others?
What are the coping strategies I can use when I feel upset?
What is my relationship to the physical world? (Objects, Places)
What is my relationship to the social world?     (Family, Community)
How can I share my sense of self with others?
How do I respond to what others share with me?

I have worked with students of all ages and abilities, usually in pairs or small  groups, on non-digital tables my entire career.  This is the case for many support professionals in the schools, such as school psychologists, school counselors, speech and language therapists, and literacy specialists.  In my case, I have over 20 years of activities related to just about any problem that has come my way.  Coming up with content isn't the problem - the challenge is figuring out how things can be transformed for use on the multi-touch tabletop.


I think the best approach is to focus on the activities I use  when I start a new group. Many of the teamwork and icebreaker activities  I use that help the students learn how  to participate in a group would translate nicely to a multi-touch table. These activities would be useful to counselors and speech and language therapists. They might also be useful to teachers when form new cooperative or collaborative learning groups in the classroom.  

I'm looking forward to learning how all of this can inter-operate:
Create

From what I understand, the computer running the SMARTTable was not intended for accessing internet applications, and does not have anti-virus software.  I mistakenly thought that since the table was Wi-Fi enabled, I could readily access all of the single-touch web applications I use with students.  Maybe things will change.  I imagine that educational websites optimized for multi-touch would be something worth considering for the future, especially if more school schools adopt tabletop technologies.   (It would be nice to have AAC devices, video cameras, laptops, handhelds, and the Internet included in this picture.)

(Below is information from a previous post)


Introduction
Over the past several years, I have worked closely with young people who have severe autism, and during this time, I have taken a variety of computer science, software information systems, and educational technology courses. Over time, I've integrated the use of technology, including digital photography and videography into my work. In some ways, it is still a much-unchartered territory.  Through this work, I've come up with some insights that I'd like to share.

Cognitive Bursts
I've noticed that many young people who are "on-the-spectrum" experience what I call "cognitive bursts", often around puberty, but also during the late teen and early 20's


To an untrained eye, these bursts might go unnoticed, or even minimized.  These bursts can't easily be captured through traditional psychological or educational assessments, since these tests were designed for more typically developing students. For example, a young person with ASD might not be able to make a choice in response to a test item by pointing. Another student might not be able to respond to a test item because they do not speak.  An individually-administered cognitive assessment might not generate "IQ" scores that fully reflect significant cognitive gains, especially when the student has delays in language development and working/short term memory deficits.

As a professional, I know that it is not appropriate to provide parents with false hope. I know that the tools we have for assessing cognitive growth among students with autism spectrum disorders are not adequate. For example, two students can have the same "IQ" at age 3, 5, 8- or any age, but function much differently at age 18 or 25.  This is especially true for young people who have attention problems, working memory deficits, and/or delays in language development relative to their non-verbal abilities.


My point is that we must take early cognitive assessment  scores with a grain of salt, and   ensure that there are multiple opportunities for meaningful assessment and significant intervention during other points of a young person's development.

In my opinion, the more severe the situation, the more intensive the intervention!

Special education for students with more severe disabilities has always focused on early identification and early intervention, and for much of my career, "early intervention" was my mantra.   Over the past few years, I have come to the realization that the focus on early intervention is only a small part of the bigger picture.   While some young people make tremendous gains through early intervention, some do not, and this does NOT suggest that they won't have the potential to make significant gains later in their childhood, teens, or early adulthood.   


By focusing primarily on early intervention, we might be missing the boat. We must do more across the young person's development through young adulthood (and of course, beyond.) Each child is different, and each brain's course of development is different. One child may be ripe for growth at 30 months of age, or at age 3 or 4. Another might start talking and initiating interactions at age 14, or begin to make sense of print at age 16! I know one severely autistic youth who was reading at an 8th grade level at age 22, something that probably would not have been predicted by those who worked with him during his early years.

From what I've observed in special education, cognitive bursts are often noticed by a team of perceptive teachers, therapists, and support workers, at which point meet to discuss ways to harness this opportunity to facilitate academic, communication, and at times, social interaction skills development. While this may not be the case for each student and in each school, it really does happen! 


When a student experiences a "burst", no matter how insignificant it might look on the surface, we are given a golden opportunity to fashion an integrated approach to moving the young person forward, and at the same time, help the student develop a more solid sense of self. For students with severe autism, this might be a key to opening up their world.

Technology can help.
Because each young person develops differently, it is important that interventions designed to facilitate this sort of growth be available at all points of development, not limited to the intensive support that is recommended for the youngest of this group. 
My mantra now is intervention, intervention, intervention, and INTENSIVE technology-supported intervention during periods of cognitive growth, across the developmental stages, as appropriate.

Here is what I've been doing:
I'm spending a higher percentage of my time observing students in a variety of settings, using video and digital photography to capture my observations. I am using digital content during my assessment process, and I'm using digital content for creating intervention activities that assist in measuring a student's progress over time.  


I am not alone in gathering digital content - at one of my schools, the speech and language therapist, the community-based vocational education teacher, and other teachers have still and video cameras on hand.  Every classroom in this particular school now has an interactive whiteboard (IWB), which has proven to be an effective means of sharing our digital content. The IWB is often used to provide the students with an opportunity to share their own digital content with others. By incorporating this digital content into curricular activities, were finding  that teens with autism can develop a sense of self, which in turn provides an internal  "anchor" that can scaffold their learning of social-interpersonal skills.  

What seems to be working?
I use quite a bit of digital content in my work. Some of it is generated by my colleagues, some of it I do myself, and some of the content is provided by parents.  I often take pictures and video of a student's familiar activities and settings, from the first-person point of view. To do this, I follow the student around in school, home, and/or community setting, and then shoot the various scenes as if I was in the young person's shoes.  In this way, the camera is a window to the student's world, as they see it. I supplement the video with digital photography of the same content, which then can be incorporated into an interactive PowerPoint or slide-show.   I share this content with my colleagues so they can incorporate it in their work.   

This content is used for digital social stories, preparing for community outings and job-trials, student-led IEPs, student-led presentations, and video modeling. 
I also spend some time taking video-clips and pictures of familiar
 items and objects the student encounters throughout the day, such as teaching materials that the teachers put up on the walls, computer screen shots, video clips of favorite songs and scenes from the television that the student watches, screen shots of educational software that the student uses, and so forth.

I use Kidspiration,  
Inspiration, Umajin, and Powerpoint for much of this work. These applications are user-friendly and provide multi-modal output.  In some applications, there is a text-to-speech component that is great for pairing words with visual representations.


How does this work? 
I usually sit beside a student in a comfortable, familiar spot, with my laptop placed where it can be accessed by both the student and myself. We look at the content together. For students who are used to using a switch, I have one available.

I've found that strategies that incorporate digital media provide a means for students to generated more language and communication. This is often initiated by the students!

With students who have autism spectrum disorders, establishing a connection, through digital photography and videography, focusing on familiar things is especially important. Taking the time to capture the student's world, from their perspective, is mandatory, in my opinion. By doing this, we are providing specific information that might help to answer unspoken questions that the young person has, but lacks the skills to formulate or articulate - for example, "Who am I, and what is my relationship to this physical world?"

By taking this approach, the adults - teachers, parents, assistants - who are involved with the student, can work to build a solid scaffold for further learning and interaction. Bit-by-bit, digital content - pictures, video clips, can be built into the process to facilitate social awareness and social-emotional interaction skills. By learning about familiar people, how they "tick", and how one should go about interacting with these people, the student might gain a sense of self within a social context.  We can help them answer the question we all have, at one time or another:
"Who am I, and what is my relationship to this social world?" 


Comments:

At the beginning of the 2008-09 school year, I started bringing in my HP TouchSmart PC to use with students multiple needs and those who have autism.   I've used software that takes advantage of the HP TouchSmart's duo-touch capabilities, and found that paired activities using this feature increase joint-attention behaviors, something that is important in the development of social interaction skills among young people with autism. We've used the video camera and Skype to "call" various classrooms, with the image displayed on the classroom's interactive whiteboard.  Now that every classroom has an IWB, there are possibilities for all sorts of communication activities between classrooms at the school level, and with others outside of the school. 

My mantra now is intervention, intervention, intervention, and INTENSIVE technology-supported intervention during periods of cognitive growth, across the developmental stages, as appropriate.



An Interactive Whiteboard in Each Classroom!
SMARTboards were installed in classrooms at Wolfe School during the current school year (2009-10), and have been well-utilized. Most of the teachers caught on very quickly after a short workshop and a little bit of experimentation.   I've noticed that my colleagues are motivated to explore interactive educational resources on the web and play around with the SMARTBoard resources as well.  The reason is that on the large screen, much of the content grabs the students' attention.  This provides the  teachers  a window of time to engage the students in learning and communication activities.   


All of this has taken place in a very short period of time. 

Ubiquitous IWBs have changed the way I conduct assessments of students with multiple or more severe disabilities. I've started using the SMARTboard for informal assessment, especially for students who have limited language abilities and do not point with precision.  For example,  the National Gallery of Art has a website just for young people, the "Kids Zone", and on this site are many activities that are great for IWB interaction.   
interactive landscapes
PLACES is a panoramic landscape activity that introduces children to the fundamentals of landscape and genre painting while offering a glimpse of life in rural America from the late 18th through the mid-19th century. Music and surprising animations enliven the scene, as children experiment with perspective, composition, color, and scale."   


The student can put all sorts of items on the screen, move them anywhere, and resize things.  It is a quick and fun way to see if they have mastered the concepts of size, number, direction, and so forth.  It also is a way to assess basic receptive vocabulary.

The interactive Jungle application on the SMARTBoard was also useful in eliciting joint attention:
Jungle interactive game

"Create an imaginary landscape online with the NGAkids JUNGLE interactive. Mix and match the colorful characters, control the environment by changing weather and lighting conditions, or construct flowers, trees, and plants using special tools. An "AUTO" button generates random compositions, so you can sample program options and experiment with special effects as a starting point for your own designs."

If you plan to use these activities for informal assessment, make sure you have a checklist of what you plan to assess, and also make sure you've spent some time exploring the applications in depth, using the IWB.  The best thing is to practice before you try this with a student. Better yet, see if you can get the student's teacher to practice with you.


JOINT ATTENTION
If you have an IWB in your classroom and you work with students who have autism spectrum disorders, it is good to think of ways you can harness this technology to encourage joint attention among your students.  Here is some information about joint attention, from one of my previous posts:

Joint Attention:Definition of Joint Attention from UConn:
"Joint Attention is the process of sharing one’s experience of observing an object or event, by following gaze or pointing gestures. It is critical for social development, language acquisition, cognitive development…"

http://eigsti.psy.uconn.edu/jt_attn.JPG
Establishing joint attention is an important step in the development of social interaction skills among young people who have autism spectrum disorders.

Joint Attention Study Has Implication for Understanding Autism Science Daily, 9/29/07
Asperger-Advice: Joint Attention
Autism Games: Joint Attention and Reciprocity
Why is joint attention a pivotal skill in autism?
Tony Charman
Philos Trans R Soc Lond B Biol Sci. 2003 February 28; 358(1430): 315–324.


UPDATED POST FROM 9/2008

Resources for the (therapeutic) use of digital and multimedia storytelling and social stories for children and teens...

One of the most popular posts on this blog is  Interactive Multimedia for Social Skills, Understanding Feelings, Relaxation, and Coping Strategies.  If you are interested in this topic, check out the extensive resources, which I'm in the process of updating. Below are some resources and links for those of you who are interested in digital multimedia story telling or digital social stories with young people. Although some of the resources are specific to children or teens with autism spectrum disorders, I've also included information that is appropriate for use in regular classroom settings. 


Digital Storytelling and 21st Century Skills (pdf)
This nine-page primer is useful for anyone interested in learning how to create digital stories or develop digital storytelling activities with young people. The information was provided by David Jakes, an instructional technology coordinator for Community High School District 99 in Downers Grove, IL, provides a good case for digital storytelling and an outline of the process of implementing related activities at the high school level. David Jakes has a website, Jakesonline.org, that contains additional resources about digital storytelling, including strategies for instruction. The website also provide information about collaborative tools and a collection of extensive web resources.
Center for Digital Storytelling
USING MULTIMEDIA SOCIAL STORIES TO INCREASE APPROPRIATE SOCIAL ENGAGEMENT IN YOUNG CHILDREN WITH AUTISM pdf
Selda Ozdemir, Turkish Online Journal of Educational Technology, July 2008, V7(3)
Encouraging Positive Behavior with Social Stories: An Intervention for Children with Autism Spectrum Disorders pdf   Shannon Crozier, Nancy M.Sileo Teaching Exceptional Children, July/August 2005 pp. 26-31 This article provides information that supports a systematic method of implenting social stories that is integrated into a student's Functional Behavioral Assessment and IEP.


Process: 
• Team identifies the need for behavior intervention.
• Functional assessment is completed.
• Social stories included in behavior plan.
• Social story is written.
• Social story is introduced and progress is monitored with data.
• Success is evaluated with data.
An evaluation of the integrated use of a multimedia storytelling system within a psychotherapy intervention for adolescents. (pdf)
"This paper explores the use of multimedia stories in psychotherapy and mental health service delivery with teenagers. It describes a study currently being conducted with adolescents attending the Child and Adolescent Mental Health Service at the Mater Hospital Dublin, Ireland measuring the effectiveness of a therapeutic group work intervention for adolescents experiencing depression, anxiety and other mental health issues. The intervention is essentially a Cognitive Behavioural Therapy (CBT) programme that uses an animated story building system in combination with a series of short movie vignettes to help clients develop their own coping skills, express their experiences creatively and increase their ability to communicate their emotions effectively."


Current Autism Research on Social Stories (Vol 2, Issue 8; August 2007) Positively Autism
Multitimedia Instruction of Social Skills  (CITEd Research Center- Center for Implementing Technology in Education: Multimedia Technologies) This link provides extensive information about on-line resources for programs that simulate social interaction. It also includes information about the use of social stories with students, and resources for putting together multimedia social stories. Included are some summaries of research about multimedia social stories and the use of multimedia for instructional activities. Be sure to explore the rest of the CITEd site when you have the time.


Scott Bellini is a psychologist who focuses on video modeling. He is the director of Access Autism:
Bellini, S., Akullian, J., & Hopf, A. (2007). Increasing social engagement in young children with autism spectrum disorders using video self-modeling. School Psychology Review, 36, 80-90. 
Bellini, S. & Akullian, J. (2007). A meta-analysis of video modeling and video self-modeling interventions for children and adolescents with autism spectrum disorders. Exceptional Children, 73, 261-284.
RELATED
Post: Special issue on Multimedia, Media Convergence, and Digital Storytelling
Digital Stories Targeting Social Skills for Children with Disabilities. Cori More (PRO-ED Journal, 2008)
Digtal/Multimedia Storytelling
 from A Storied Career: Kathy Hansen's Blog to explore traditional and postmodern forms/uses of storytelling
Digital Storytelling - Katie Christo's Wiki - how-to, resources, tutorials, rubrics, lesson plans, digital storytelling across the curriculum, etc.
The Story-Centered Curriculum
 - eLearn Magazine
Mind Reading: An Interactive Guide to Reading Emotions

Mind Habits: The Stress Relief Game
SMARTTable Special Report
VITA: Visual Thinking in Autism, Georgia Tech