Revisiting CHI 2011: Videos of Interactive Touch, Gesture, Large Surface, and Mobile Apps with Potential for Use in Education (CHI = Computer Human Interaction)

One of my interests is how the power and potential post-WIMP interactive technologies can be harnessed for use for formal and informal education purposes, including life-long collaborative learning.  


In May, I had a chance to meet with a number of like-minded people during the CHI 2011 conference at the 2nd Workshop on UI Technologies and Impact on Educational Pedagogy.  I was impressed with the depth and breadth of the presentations at the workshop.   Since then, I've been looking through other papers and videos from CHI 2011 to find interesting applications that hold potential for use in educational settings.  


I've come across a good number of interesting applications and prototypes, so be sure to check back for future posts on this topic.  For now, here are a few applications that I'd like to share.  


Below are a few videos from Phillip Chi-Wing Fu.  (He doesn't know it yet, but I've admitted his videos into the Post-WIMP Explorers' Club.)


Interactive Multi-touch Sketching Interface for Diffusion Curves

"A novel multi-touch sketching interface enabling interactive and practical design with 2D diffusion curves is proposed; featured interaction techniques include simultaneous sketching of multiple diffusion curves and at-the-spot colors tuning."


Distinguishing Multiple Smart-Phone Interactions on a Multi-touch Wall Display using Tilt Correlation

"This paper proposes a novel matching technique, called tilt correlation, which employs the built-in tilt sensor on smart-phones to identify their concurrent contacts on a common multi-touch wall display."


WYSIWYF: Exploring and Annotating Volume Data with a Tangible Handheld Device (CHI 2011)


"Integration of a multi-touch wall display with a tangible handheld device with multi-touch and tilt sensing capabilities to provide intuitive what-you-see-is-what-you-feel visual exploration and annotation of volume data."


The following videos were uploaded by alucero:


Pass-Them-Around: Collaborative Use of Mobile Phones for Photo Sharing (CHI 2011)

"Pass-Them-Around is a phone-based application that allows a small group of collocated people to share photos using the metaphor of passing paper photos around. The prototype encourages people to share their devices and use them interchangeably while discussing photos face-to-face. The prototype supports ad-hoc photo sharing in different contexts by taking into account the spatial arrangement of users around a table, measured with sensors embedded in their mobile phones."


The next video was part of MobileHCI '10:
MindMap: Collaborative Use of Mobile Phones for Brainstorming

CHI 2011 Workshop Program and Related Links: UI Technologies and Impact on Educational Pedagogy, Related Child-Computer Interaction Papers and Courses

WORKSHOP PROGRAM
CHI 2011 will be held at the Vancouver Convention Centre in Vancouver. The UI Technologies and Pedagogy workshop will be held on Saturday, May 7th,  in the West Building, Level 1, Room 119/120.  PDF versions of the following presentations can be found on the workshop's website.


9:00am – 09:05am Introduction
Edward Tse and Johannes Schöning
9:05am - 10:05am Paper Session I (8 min presentation, 4 min Discussion)
Chair: Yvonne Rogers
Evaluating Pervasive Classrooms
• Son Do-Lenh et al.: Classroom-experience evaluation: An ecological approach to evaluating pervasive technologies in classrooms 
• Kathryn Rounding et al.: Evaluating Interfaces with Children 
• Dan Morris et al.: Using Machine Learning to Scaffold Artistic Creativity in Education
• Tamara Polajnar et al.: Enabling Picture-based Querying and Learning with the JuSe Interface
• Hamed Alavi et al.: Lantern 2.0: A Pervasive Scripting Tool
•Quincy Brown et al.: Mobile Natives: Unlocking the Potential of Educational Technology
10:15am - 11:00am  Coffee Break and Preparation time for short talks
11:00am - 12:10pm  Paper Session II (8min presentation, 4min Discussion)
Chair: Max Mühlhäuser
Collaboration in Math: Fears, Myths, and Insights.
• Nicola Yull et al.: Pass the iPad: Comparing collaboration on paper and screen
• Veronika Irvine et al.: Math Education: A Creative Approach
• Group talk: Math and Embodied Agents
a.Kristina Richter et al.: Bridging Diagnosis and Learning for Mathematics Education in Classroom Setting
b.Lisa Anthony et al.: Handwriting Interaction for Math Tutors: Lessons for HCI in Education
c.Andrew Jensen et al.: Using Embodied Pedagogical Agents and Direct Instruction to Augment Learning for Young Children with Special Needs
• Group talk: Dispelling Myths About the Next Generation Classroom
a. Alex Thayer et al.: The Myth of the Paperless School: Replacing Printed Texts with E-readers
b.Sharon Oviatt: Designing Digital Tools for Thinking, Adaptive Learning and Cognitive Evolution
c.Alexandra Dunn et al.: Designing Classroom Technology to Meet the Needs of All
• Group talk: Games, Wearables and Fun Learning.
a.Christiane Moser et al.: Child-Centered Game Development
b.Lizbeth Escobedo et al.: Blue’s Clues: An Augmented Reality Positioning System
c.Si Jung Kim et al.: Wearable Story: A Story Telling Jacket for Young Children to Improve Their Independent Physical and Learning Activities
12:10pm - 1:30pm   Lunch
1:30pm - 2:30pm   Paper Session III (8 min presentation, 4 min Discussion)
Chair: Richard Beckwith
Tangibles and Tabletops
• Izdihar Jamil et al.:    Communication Patterns in Collaborative Peer Learning around Interactive Table
• Aura Pon et al.:   Graspable Music and Vuzik: Music Learning and Creativity using an Interactive Surface
• Ahmed Kharrufa et al.: Learning at interactive surfaces and designing for reflection
• Cristina Sylla et al.: TOK – a Tangible Interface for Storytelling
• Group talk: Tables and Tangibles
a.Robert Sheehan:    Constructionism, Programming and Touch Interfaces
b.Orit Shaer et al.:     Making the Invisible Tangible: Learning Biological Engineering in Kindergarten
c.Sebastien Kubicki: Evaluation of an interactive table with tangible objects: Application with children in a classroom
d.Cristina Emilia Costa et al.:  I-Theatre: developing narratives skills in kindergarten children
e.Wooi Boon Goh et al.:  Potential Challenges in Collaborative Game Design for Inclusive Settings
2:30pm - 3:00pm       Coffee Break
3:00pm - 4:00pm       Breakout Discussion (What are future challenges? Next years workshop?)
4:00pm - 4:45pm   Closing Keynote by Allison Druin: Mining the Imagination from Time Travel to Anti-gravity: The Future of Child-Computer Interaction
"If you’ve ever sat with a child imagining the future of new technologies, you will undoubtedly hear about “anti-gravity machines,” “peace-technologies that work by tickling people,” “backpacks of the future with ice cream makers,” and “time-travel-mobile-phones that when you call someone it takes you back in time.” The question is how can these child-like imagined technologies lead us to real answers for the future?


In my talk I will propose that “data mining” is not enough, that “mining the imagination” is critical to understanding the future. I will describe the “iChild” and the interactive, independent, international, imaginative child we need to consider designing for in the future. If we look for real change, we need to listen to children, not because they know more, but because they can help us question, explore, and push us in true directions for change."


Allison Druin is an Associate Dean for Research in the iSchool at the University of Maryland and is Director of the Human-Computer Interaction Lab. For almost 14 years, she has led an intergenerational research team, where children, ages 7-11 years old partner with an interdisciplinary group of adult researchers to develop new technologies for children. With this team, she has helped to developed new digital library and storytelling tools with such partners as the U.S. National Park Service, Sesame Workshop, Nickelodeon, Nokia, UNICEF, and many others. In 2010, she received with Ben Bederson the SIGCHI Social Impact Award for her work leading the International Children’s Digital Library (www.childrenslibrary.org).
4:45pm - 5:00pm Closing Remarks (All)
7:00pm Optional Workshop Dinner


RELATED CHILD-COMPUTER INTERACTION SESSIONS AT CHI 2011
CHI 2011 will be offering a variety of opportunities for people interested in interaction design and technologies for children.  Detailed information regarding the researchers/ presenters can be found on the IDC-SIG News/Events page.


CHI2011 COURSE - Evaluating Children's Interactive Technology
Monday 9th May 2011 - 16:00
Janet C Read - University of Central Lancashire
Panos Markopoulos - Technical University of Eindhoven
CHI2011 COURSE - New Methods for Designing for and with the iChild: Strategies for Today’s Mobile, Social, and Internet Technologies
Thursday 12th May 2011 - 09:00
Allison Druin - University of Maryland
Jerry Fails - Montclair State University
Mona Leigh Gubler - University of Maryland
CHI2011 Paper Session - Engaging Youth  Thursday 12th May 2011 - 11:00
Exploratory Evaluations of a Computer Game Supporting Cognitive Behavioural Therapy for Adolescents
In the Mood: Engaging Teenagers in Psychotherapy Using Mobile Phones
Breaking Boundaries: Strategies for Mentoring through Textile Computing Workshops
Brick by Brick: Iterating Interventions to Bridge the Achievement Gap with Virtual Peers
CHI2011 - Other IDC Related Papers
Paper Session: Art, Music and  Movement: Monday 9th May 2011
MOGCLASS: Evaluation of a Collaborative System of Mobile Devices for Classroom Music Education of Young Children
MoBoogie: Creative Expression Through Whole Body Musical Interaction
Paper Session: Low-cost ICT4D Tuesday 10th May 2011
Utilizing Multimedia Capabilities of Mobile Phones to Support Teaching in Schools in Rural Panama
Infrastructures for low-cost laptop use in Mexican schools
Paper Session: Storytelling and Perceptual Crossing Wednesday 11th May 2011
ShadowStory: Creative and Collaborative Digital Storytelling Inspired by Cultural Heritage
Paper Session: Learning
Practical, Appropriate, Empirically-Validated Guidelines for Designing Educational Games

CHI2011 Paper Session - Families Tuesday 10th May 2011 - 11:00

Learning Patterns of Pick-ups and Drop-offs to Support Busy Family Coordination

Mediated Parent-Child Contact in Work-Separated Families

Hello, is Grandma there? Let’s Read! StoryVisit: Family Video Chat and Connected E-Books

Family Portals: Connecting Families Through A Multifamily Media Space

If these topics interest you, consider making plans to attend IDC 2011!
IDC 2011:  The 10th International Conference on Interaction Design and Children
June 19-23,  University of Michigan (My alma mater!)

Child-Computer Interaction Workshop on May 7th at CHI 2011: Deadline Extended to February 18th!

The deadline for submissions to the CHI 2011 Child Computer Interaction: 2nd Workshop on UI Technologies an their Impact on Educational Pedagogy has been extended to February 18, 2011.

The workshop will be held on May 7, 2011, Vancouver, Canada, in conjunction with ACM's CHI 2011 conference. Interested researchers should submit a 4-page position paper in the ACM CHI adjunct proceedings style to the workshop management system. Note that the best 3 papers will be pre-accepted for a upcoming for a theme issue of the Springer Journal Personal and Ubiquitous Computing on “Child Computer Interaction”.

IMPORTANT DATES
Submission Deadline: February 18th, 2011
Author Notification: March 15th, 2011
Final Version Deadline: April 1st, 2011 
Workshop Date: May 7th, 2011

DETAILS 
2011 Workshop Website
Call for Papers
Workshop Management System

ACM CHI 2011 Website

Note:  Deadlines for several other CHI 2011 workshops have also been extended to February 18th. (Pictures and links from the CHI 2010 workshop are located at the end of this post.)

CALL FOR PAPERS

IN CONJUNCTION WITH CHI 2011

Child Computer Interaction: Workshop on UI Technologies and Educational Pedagogy

in conjunction with CHI 2011, Vancouver

May 7th, 2011

Topic: Given the emergence of Child Computer Interaction and the ubiquitous application of interactive technology as an educational tool, there is a need to explore how next generation HCI will impact education in the future. Educators are depending on the interaction communities and to deliver technologies that will improve and adapt learning to an ever- changing world. In addition to novel UI concepts, the HCI community needs to examine how these concepts can be matched to contemporary paradigms in educational pedagogy. The classroom is a challenging environment for evaluation, thus new techniques need to be established to prove the value of new HCI interactions in the educational space. This workshop provides a forum to discuss key HCI issues facing next generation education.

We invite authors to present position papers about potential design challenges and perspectives on how the community should handle the next generation of HCI in education. Topics of interest include:
• Gestural input, multitouch, large displays, multi-display interaction, response systems
• Mobile Devices/mobile & pervasive learning
• Tangible, VR, AR & MR, Multimodal interfaces, universal design, accessibility
• Console gaming, 3D input devices, 3D displays
• Co-located interaction, presentations, tele-presence, interactive video
• Child Computer Interaction, Educational Pedagogy, learner-centric, adaptive “smart” applications,
• Empirical methods, case studies, linking of HCI research with educational research methodology
•Usable systems to support learning and teaching: Ecology of learning, any where, anytime, (UX of cloud computing to support teaching and learning)

Submission: The deadline for workshop paper submissions is February 18, 2011. Interested researchers should submit a 4-page position paper in the ACM CHI adjunct proceedings style to the workshop management system. Acceptance notifications will be sent out March 15, 2011. The workshop will be held May 7, 2011 in Vancouver, Canada. Please note that at least one author of an accepted position paper must register for the workshop and for one or more days of the CHI 2011 conference.

The best 3 papers will be pre accepted for a upcoming for a theme issue of the Springer Journal Personal and Ubiquitous Computing on “Child Computer Interaction”. Other authors are also invite to submit/ resubmit their work. We will send a separate call for paper for this special issue soon.

Website: http://www.dfki.de/EducationCHI2011

Contact: Edward Tse, SMART Technologies, edwardtse@smarttech.com

CHI 2010

NEXT GENERATION OF HCI AND EDUCATION

2010 Workshop Website

Join an interdisciplinary, international group of like-minded peers and colleagues.

Brainstorm with thought leaders.

After the workshop, relax, dine, and converse with interesting people.

UPDATE: CALL FOR PAPERS: Workshop on UI Technologies and Educational Pedagogy, Child-Computer Interaction (in conjunction with CHI 2011, May)

CALL FOR PAPERS 

Child Computer Interaction: 

Workshop on UI Technologies and Educational Pedagogy

in conjunction with CHI 2011, Vancouver, Canada

May 8th 2011

Topic: Given the emergence of Child Computer Interaction and the ubiquitous application of interactive technology as an educational tool, there is a need to explore how next generation HCI will impact education in the future. Educators are depending on the interaction communities and to deliver technologies that will improve and adapt learning to an ever- changing world. In addition to novel UI concepts, the HCI community needs to examine how these concepts can be matched to contemporary paradigms in educational pedagogy. The classroom is a challenging environment for evaluation, thus new techniques need to be established to prove the value of new HCI interactions in the educational space. This workshop provides a forum to discuss key HCI issues facing next generation education.

We invite authors to present position papers about potential design challenges and perspectives on how the community should handle the next generation of HCI in education. Topics of interest include:

1. • Gestural input, multitouch, large displays, multi-display interaction, response systems
   
   
2. • Mobile Devices/mobile & pervasive learning
   
   
3. • Tangible, VR, AR & MR, Multimodal interfaces, universal design, accessibility
   
   
4. • Console gaming, 3D input devices, 3D displays
   
   
5. • Co-located interaction, presentations, tele-presence, interactive video
   
   
6. • Child Computer Interaction, Educational Pedagogy, learner-centric, adaptive “smart” applications
   
   
7. • Empirical methods, case studies, linking of HCI research with educational research methodology
   
   
8. •Usable systems to support learning and teaching: Ecology of learning, any where, anytime, (UX of cloud computing to support teaching and learning)

Submission: The deadline for workshop paper submissions is January 14, 2011. Interested researchers should submit a 4-page position paper in the ACM CHI adjunct proceedings style to the workshop management system. Acceptance notifications will be sent out February 20, 2011. The workshop will be held May 7 or May 8, 2011 in Vancouver, Canada. Please note that at least one author of an accepted position paper must register for the workshop and for one or more days of the CHI 2011conference.

Website: http://www.dfki.de/EducationCHI2011

Contact: Edward Tse, SMART Technologies, edwardtse@smarttech.com

WORKSHOP ORGANIZERS
Edward Tse, SMART Technologiess
Johannes Schöning, DFKI GmbH
Yvonne Rogers, Pervasive Computing Laboratory, The Open University
Jochen Huber, Technische Universität Darmstadt
Max Mühlhäuser, Technische Universität Darmstadt
Lynn Marentette, Union County Public Schools, Wolfe School
Richard Beckwith, Intel

Call for Papers - Child Computer Interaction: Workshop on UI Technologies and Educational Pedagogy, in conjunction with CHI 2011, Vancouver, May 7th or 8th

CALL FOR PAPERS 

Child Computer Interaction 

Workshop on UI Technologies and Educational Pedagogy

in conjunction with CHI 2011, Vancouver, Canada

May 7th or May 8th 2011

Topic: Given the emergence of Child Computer Interaction and the ubiquitous application of interactive technology as an educational tool, there is a need to explore how next generation HCI will impact education in the future. Educators are depending on the interaction communities and to deliver technologies that will improve and adapt learning to an ever- changing world. In addition to novel UI concepts, the HCI community needs to examine how these concepts can be matched to contemporary paradigms in educational pedagogy. The classroom is a challenging environment for evaluation, thus new techniques need to be established to prove the value of new HCI interactions in the educational space. This workshop provides a forum to discuss key HCI issues facing next generation education.

We invite authors to present position papers about potential design challenges and perspectives on how the community should handle the next generation of HCI in education. Topics of interest include:

1. • Gestural input, multitouch, large displays, multi-display interaction, response systems
   
   
2. • Mobile Devices/mobile & pervasive learning
   
   
3. • Tangible, VR, AR & MR, Multimodal interfaces, universal design, accessibility
   
   
4. • Console gaming, 3D input devices, 3D displays
   
   
5. • Co-located interaction, presentations, tele-presence, interactive video
   
   
6. • Child Computer Interaction, Educational Pedagogy, learner-centric, adaptive “smart” applications
   
   
7. • Empirical methods, case studies, linking of HCI research with educational research methodology
   
   
8. •Usable systems to support learning and teaching: Ecology of learning, any where, anytime, (UX of cloud computing to support teaching and learning)

Submission: The deadline for workshop paper submissions is January 14, 2011. Interested researchers should submit a 4-page position paper in the ACM CHI adjunct proceedings style to the workshop management system. Acceptance notifications will be sent out February 20, 2011. The workshop will be held May 7 or May 8, 2011 in Vancouver, Canada. Please note that at least one author of an accepted position paper must register for the workshop and for one or more days of the CHI 2011conference.

Website: http://www.dfki.de/EducationCHI2011

Contact: Edward Tse, SMART Technologies, edwardtse@smarttech.com

WORKSHOP ORGANIZERS
Edward Tse, SMART Technologiess
Johannes Schöning, DFKI GmbH
Yvonne Rogers, Pervasive Computing Laboratory, The Open University
Jochen Huber, Technische Universität Darmstadt
Max Mühlhäuser, Technische Universität Darmstadt
Lynn Marentette, Union County Public Schools, Wolfe School
Richard Beckwith, Intel

Technology and Education, a Temporal Approach -Link to Dan Sutch's article, plus info about FutureLab

I'm interested in topics related to school reform and how it impacts the intersection of education/learning and emerging/innovative interactive technologies.  There are many changes going on that will impact the future of education, and I thought I'd devote a post or two to this topic on the Interactive Multimedia Technology and TechPsych blogs.

Over the past few years, I've noticed that there is a re-occurring theme, sort of a self-perpetuating "myth" - or hope, that if we just could fire/tweak/transform- the teachers, and if we just had the right kind of technologies and applications at hand, the multiple problems of education would be solved.  Of course, we know it is much more complicated than throwing innovative technologies, teaching strategies, and new, "highly qualified" teachers into the educational mix!

On this note,  I'd like to share a link to an article written by Dan Sutch on the Flux blog, hosted by FutureLab. ( I've included some links to resources from the FuturLab website.  I've also added my own "2-cents" to the topic of technology and education reform, which can be found at the top of this blog under the "My 2-cents: Innovative Technologies, Education Reform, which is in draft form.)


In his article, Dan Sutch touches on some key problems facing education. Like the little boy in the children's book, the Emperor's New Clothes, he points out that the polarizing debates regarding education blind us to what we really need to think about- and understand.  

A Temporal View on the Aims of Education

Dan Sutch,  Flux (FutureLab)  October 7, 2010

Here are thee three "meta-functions" of education discussed in Dan's article:

• How the world is as it is. Which requires exploration of what is already known about the world: knowledge domains, histories, cultural differences etc.  [The past] This only makes sense in relation to how learners
• Understand their place in the world. This is a focus on the individual, their culture and context, their interests, knowledges and relationships etc. [The present] This then leads to a need to understand
• How they act within the world and how they can change it. This is about developing personal identities and agency, and the skills to enact them – for themselves, their communities and for wider global challenges. [The future]

By using this framework, it might be possible for us to generate meaningful ways to use technology to support the business/science/art of teaching and learning. This framework might be something for university-level teacher educators to consider.

RELATED AND SOMEWHAT RELATED

About Dan Sutch

"Dan's main research interests are in mobile learning, radical innovation and the role of the teacher in technology-rich learning environments. Dan’s current work involves investigating new models of innovation in the design and application of digital learning resources and the capacity of teachers to act as innovators in the use of digital learning resources."

Panel of Flux Contributors
I encourage you to take a look at the other people who contribute to Flux!  They are on the forefront of education and emerging technologies, and come from a wide range of disciplines.


About FutureLab
FutureLab is an organization located in the UK that focuses on "the way people learn through innovative technology and practice".   The FutureLab website has a wealth of information about interactive and immersive technologies that support- or have the potential to support- learning. 


FutureLab's Free Online Tools
One of many examples is Create-A-Scape:
"Create-A-Scape is a website that provides resources for creating digitally-enhanced learning experiences, using mobile technology to experience location-sensitive sounds and images that have been 'attached to' the local landscape. Can be used right across the curriculum with all age groups." -FutureLab


Links to FutureLab topics, from the home page of the FutureLab website:

• 14-19 
• 21st century skills 
• assessment 
• augmented reality 
• citizenship 
• collaboration 
• creativity
• curriculum 
• digital inclusion 
• digital media 
• family learning 
• futures 
• games
• health 
• informal learning 
• innovation
• innovative teaching 
• learner voice
• learning spaces 
• lifelong learning
• mobile/handheld 
• open source 
• personalisation
• pre-school 
• primary 
• secondary 
• skills 
• social software 
• thinking skills 
• user-centred design

Links to FutureLab's current projects:

• • Adult Informal Learning
  • Beyond Current Horizons
  • Create-A-Scape
  • Creativity in European Schools
  • Curriculum Innovation Network
  • Digital Participation
  • Dream Catcher
  • Education Eye
  • Enquiring Minds
  • Exploratree
  • Fizzees
  • Fountaineers
  • Games and Learning
  • Games-Based Experiences for Learning
  • Gaming in Families
  • Harnessing Technology
  • Home-School Relationships
  • Infocow
  • iTEC
  • Learning in Families
  • Learning Spaces
  • New Assessment Scenarios
  • Pedagogy 3.0
  • Power League
    • • Serious Games in Education
      • Technology-Supported Curriculum