Interactive Technology from CHI 2012 Supporting Literacy, Storytelling, and Narrative

I spent the last several days at CHI 2012 and was so immersed in the experience, I held off blogging until I arrived home.  


I was pleasantly overwhelmed by the experience at CHI 2012, There was so much to see, hear, and touch, there were so many bright, creative people all around - I was on mind/sensory overload.  Omar L. Gallaga, the author of Digital Savant (Austin 360), attended the conference, and the quote below from his recent post nicely sums it up: "When your mind gets blown multiple times in a very short period of time, it begins to feel as is your brain is quickly rewiring itself to accept that the reality is that anything is possible and that the continual, pleasurable surprise of discovery is the new norm."


For this post, I'm sharing a few things that were presented at CHI 2012 that focus on literacy, storytelling, and narrative.  I'll share more in future posts.


Creating and Using Interactive Narratives: Reading and Writing Branching Comics 
The short video below provides a good overview of the project, which was presented at CHI 2012 during the Out of the Box" session, chaired by Shahram Izadi, of Microsoft Research USA

"We employ comics and combine paper with a multi-touch interface to explore an approach to reading and writing interactive narratives."
Dan Andrews and Chris Baber from the University of Birmingham (UK) 
Sergei Efremov and Mikhail Komorov from the Moscow State Institute of Electronics and Mathematics (Russia).


If you are interested in learning more about this process, take a look at the references that were reviewed in the paper about this creative, thoughtful work.

Tap & Play: An End User Toolkit for Authoring Interactive Pen and Paper Language Activities 
The following video was created several months before CHI 2012:




Tap & Play:  An End User Toolkit for Authoring Interactive Pen and Paper Language Activities
Ann Marie Piper, Nadir Weibel, James Hollan, 


The following video is related to the Textual Tinkerability paper, presented during the Literacy on the Margin session, chaired by Juan Pablo Hourcade, at CHI 2012:
 


Textual Tinkerability:  Encouraging Storytelling Behaviors to Foster Emergent Literacy    Angela Chang, Cynthia Breazeal, Fardad Faridi, Tom Roberts, Glorianna Davenport, Henry Lieberman, Nick Montfort, Massachusetts Institute of Technology


Related: TinkRBook: Shared Reading Interfaces for Storytelling (IDC 2011)
TinkRBook

RELATED

CHI 2012:  brain expanding bits of brilliance
Omar L. Gallaga, Digital Savant, 5/11/12


FYI:   I was one of the organizers for the EIST (Educational Interfaces, Software & Technology) workshop, held on May 5th and 6th. The participants came from all around the world to spend two days of presenting, sharing, and brainstorming.  Everyone worked hard to make the workshop a success. (I'll share more about EIST soon, but if you are curious, the above link will provide you with more information about the program and papers that were presented.) 

Cross Post: Children of the Code

I came across the Children of the Code website today and thought I'd share it- if you are familiar with Children of the Code project, please leave a comment, since I haven't yet explored the entire site.

Childrenof thecode.org is an on-line multi-media resource that is part of a public/social education project to that aims to spread information and education about "The Code and the Challenge of Learning to Read it"

The project has four main components:

1. A three hour Public Television, DVD and Web documentary series;
2. A ten-hour college, university, and professional development DVD series;
3. A series of teacher and parent presentations and seminars;
4. A cross-indexed website/database containing audio, video and transcripts with the world's leading experts in fields related to reading.

The website includes over 100 interviews of people from a wide range of disciplines who are committed to promotion of health, education, and well-being of children, youth, and in turn, communities and society.

Here is the project's abstract:

"Abstract: Our children's cognitive and emotional development, self-esteem, academic, and later social and economic success, all depend on how well they learn - on the health of their learning. Whether we are involved in parenting, teaching, cognitive science, psychology, pedagogy, curriculum design, instructional design, direct instruction, constructivism, assessment, multiple intelligences, learning styles, learning differences, learning disabilities, learning theory, learning communities, organizational learning, preschool, elementary school, middle school, high school, home school, unschooling, college, university... we all share the responsibility of stewarding the health of our children's learning."


I'd recommend starting with the on-line video tour of the project:
http://www.childrenofthecode.org/Tour/index.htm

The following is a quote from an interview with David Boulton, the director of the Children of the Code project:

"The mission of the Children of the Code project is to catalyze and resource a transformation in how our society thinks about the "code" of our written language and the "challenges involved in learning to read it.". I think we're living in the "Stone Age of Literacy." Our lack of understanding of what is involved and what is at stake in acquiring literacy is wreaking havoc on the lives of our population, including children"

"..the first think I hope i that it (the project) changes the mental lens through which parents and teachers see struggling learners. I want them to see someone who is struggling as somebody who is struggling with an artificially confusing technology (written language) and somebody who is in significant emotional and cognitive danger.

"What I hope is that people realize that if children and adults struggle too long with the process of acquiring literacy, it can seriously affect how they develop and grow and learn. Struggling to read causes many, many people to grow up feeling ashamed of their mind.."

Links to the list of some of the interviews of "name" researchers and educators are posted on the TechPsych blog, or you can visit the site's interview list.