CHI 2011, Bill Buxton, and the Buxton Collection: Explore 35 years of interactive devices, online!

Bill Buxton is a researcher at Microsoft who focuses on Human-Computer Interaction and is known for his work in user experience design and natural user interfaces such as multi-touch surfaces.   His talk at the recent CHI 2011 conference, held in Vancouver, Canada, was an overview of the Buxton Collection, an on-line historical archive of interactive input devices spanning over the past 35 years.  


It was interesting to note that at the time of the presentation, the Vancouver Conference Center, where the conference was taking place, was having serious problems with the network/internet connections, and as a consequence, Buxton was not able to demonstrate the on-line version of his collection as planned.  

Not to worry.  The physical version of the Buxton's archive was on display during the conference, along with Buxton, who was happy to tell the story behind every device and gadget in the archive, with much enthusiasm. The slideshow below provides a glimpse of the Bill Buxton archive displayed at CHI 2011:

My Buxton Collection Slideshow, CHI 2011, Vancouver, Canada

Buxton's archive of gadgets comes with a rich history, accumulated over the years. Much of this history, until now, has resided in Buxton's head.   Holding and touching the items in the archive while listening to Buxton's passionate stories about each one, was unlike anything I had ever experienced.  His archive is a labor of love, and the interactive, on-line version of the Buxton Collection is his way of sharing his knowledge with the world.


During his talk, Buxton pointed out that in computer science programs, students are not required to have much exposure to the "history of ideas" in the field.  Huge chunks of work are often ignored in the literature,  and in some cases, the wheel is unknowingly reinvented, and this is something that must be addressed within the CHI community, according to Buxton. 


I agree.

RELATED
Previous IMT posts about Bill Buxton
Bill Buxton's Presentation Video: "A Little Tale about Touch" (Microsoft Worldwide Partner Conference, 2010)
Two good articles by Bill Buxton: The Mad Dash Towards Touch Technology; The Long Nose of Innovation
Buxton Collection
Buxton Collection, PivotViewer
Back to the Past: Bill Buxton Shows Off 36 Years of Tech Devices
Microsoft News Center, 5/9/11
Microsoft's Bill Buxton exhibits gadget collection 35 years in the making
Donald Melanson, engadget, 5/9/11
Bill Buxton's Haptic Input References (pdf)
Bill Buxton's website
Multi-touch Systems that I Have Known and Loved (Bill Buxton)
CES 2010: NUI with Bill Buxton

On Engineering and Design: An Open Letter Microsoft Research Principal Scientist Bill Buxton calls for engineers and user experience designers to learn to appreciate one another

Bill Buxton, Bloomberg Businessweek, 4/29/09

Update from #CHI 2011 - much more to come.

I've been attending CHI 2011 for the past few days and have been impressed by the depth and breadth of the conference.  In addition to attending a number of interesting, high-quality presentations, I had the chance to interview several key contributors to the HCI field, explore a variety of awesome interactive applications,  and participate in an interactive musical multimedia performance.  Below is a video taken of part of the performance, taken by someone at the conference:


I also had a chance to explore Bill Buxton's exhibit of his historical archive of input and interactive devices.  To see the interactive online version of the exhibit, take a look at  Buxton Collection.  You won't be disappointed.

I will be sharing my "take aways" from the conference in a series of posts on this blog over the next couple of weeks. I meantime,  take a look at some of the CHI "Madness" videos below. The video clips are about 20-seconds long and are created by CHI presenters as previews to help conference attendees plan their schedules, since there are many sessions that are held concurrently. 

Gamification: Using Game Design Elements in Non-Gaming Contexts


CHI 2011 Accessible Games SIG




Games for your cat:


Don't forget Grandma!

CHI 2011! - Today's Highlights from the ACM CHI Conference on Human Factors in Computing Systems

I'm happy to share that I was approved for a press pass for the CHI 2011  conference I'm attending in Vancouver, Canada.   (I was one of the organizers for a pre-conference workshop held on Saturday, "Child Computer Interaction: Workshop on UI Technologies and Educational Pedagogy" and will share more information from the workshop in future blog posts.)


The press pass will provide me the opportunity to meet a number of key thinkers/researchers related to the field of Human Factors/Human Computer Interaction.  Here are a few of today's press highlights:


A conversation with ...Howard Rheingold
CHI 2011’s opening session features Howard Rheingold, an acknowledged authority on mobile communications, discussing the evolution and future of social media in teaching and learning. Rheingold, the author of Smart Mobs, innovator, and Stanford University lecturer, explains, "use of social media in higher education teaching sessions can provide opportunities for innovative and meaningful interactions that extend far beyond the traditional face-to-face classroom experience." -CHI 2011


A conversation with...the "PaperPhone Team"
Hang up the iPhone - here comes the paper phone: Bending the device will allow users to make calls and play music Gillian Shaw, Vancouver Sun, 5/5/11
UltraThin 'PaperPhone' bends to user's will Emily Chung, CBC News, 5/5/11


An Interview with Conference Organizers and Interaction Researchers ...
Desney Tan, Conference Chair and Microsoft Research
Bo Begole, Technical Program Co-Char and XEROX Palo Alto Research Center (PARC)
Wendy Kellogg, Technical Program Co-Chair and IBM


I can't wait until 4:00 PM - a special tour of the interactive demonstrations - here is the information I received from the CHI 2011 PR coordinator:



SPECIAL PRESS PREVIEW of the Interactive Demonstrations 4:00 - 5:30 PM  INTERACTIVITY PRESS TOUR
"This event will be highly visual & interactive http://chi2011.org/program/interactivity.html Press Release: Interactive Technologies Showcased at ACM Conference on Computer-Human Interaction http://chi2011.org/press/presskit/interactivity.html"


I'm sure this will be interesting:
Collecting the History of Interactive Devices
"An exhibit of interactive devices from the past 35 years that point to ways of interacting with computers in the future. First shown at the Vancouver Art Gallery in 2004 (and updated for 2011), the collection documents the history of pen computing, pointing devices, touch technologies, and illustrates the nature of how new technologies emerge." - CHI 2011


Stay updated!
To keep up with my blog posts during the CHI 2011 conference and afterwards, sign up for the RSS feed.  Another option is to follow me on Twitter,  and you'll receive an automatic "tweet" with a link whenever I post something on this blog. 

CHI 2011 Workshop Program and Related Links: UI Technologies and Impact on Educational Pedagogy, Related Child-Computer Interaction Papers and Courses

WORKSHOP PROGRAM
CHI 2011 will be held at the Vancouver Convention Centre in Vancouver. The UI Technologies and Pedagogy workshop will be held on Saturday, May 7th,  in the West Building, Level 1, Room 119/120.  PDF versions of the following presentations can be found on the workshop's website.


9:00am – 09:05am Introduction
Edward Tse and Johannes Schöning
9:05am - 10:05am Paper Session I (8 min presentation, 4 min Discussion)
Chair: Yvonne Rogers
Evaluating Pervasive Classrooms
• Son Do-Lenh et al.: Classroom-experience evaluation: An ecological approach to evaluating pervasive technologies in classrooms 
• Kathryn Rounding et al.: Evaluating Interfaces with Children 
• Dan Morris et al.: Using Machine Learning to Scaffold Artistic Creativity in Education
• Tamara Polajnar et al.: Enabling Picture-based Querying and Learning with the JuSe Interface
• Hamed Alavi et al.: Lantern 2.0: A Pervasive Scripting Tool
•Quincy Brown et al.: Mobile Natives: Unlocking the Potential of Educational Technology
10:15am - 11:00am  Coffee Break and Preparation time for short talks
11:00am - 12:10pm  Paper Session II (8min presentation, 4min Discussion)
Chair: Max Mühlhäuser
Collaboration in Math: Fears, Myths, and Insights.
• Nicola Yull et al.: Pass the iPad: Comparing collaboration on paper and screen
• Veronika Irvine et al.: Math Education: A Creative Approach
• Group talk: Math and Embodied Agents
a.Kristina Richter et al.: Bridging Diagnosis and Learning for Mathematics Education in Classroom Setting
b.Lisa Anthony et al.: Handwriting Interaction for Math Tutors: Lessons for HCI in Education
c.Andrew Jensen et al.: Using Embodied Pedagogical Agents and Direct Instruction to Augment Learning for Young Children with Special Needs
• Group talk: Dispelling Myths About the Next Generation Classroom
a. Alex Thayer et al.: The Myth of the Paperless School: Replacing Printed Texts with E-readers
b.Sharon Oviatt: Designing Digital Tools for Thinking, Adaptive Learning and Cognitive Evolution
c.Alexandra Dunn et al.: Designing Classroom Technology to Meet the Needs of All
• Group talk: Games, Wearables and Fun Learning.
a.Christiane Moser et al.: Child-Centered Game Development
b.Lizbeth Escobedo et al.: Blue’s Clues: An Augmented Reality Positioning System
c.Si Jung Kim et al.: Wearable Story: A Story Telling Jacket for Young Children to Improve Their Independent Physical and Learning Activities
12:10pm - 1:30pm   Lunch
1:30pm - 2:30pm   Paper Session III (8 min presentation, 4 min Discussion)
Chair: Richard Beckwith
Tangibles and Tabletops
• Izdihar Jamil et al.:    Communication Patterns in Collaborative Peer Learning around Interactive Table
• Aura Pon et al.:   Graspable Music and Vuzik: Music Learning and Creativity using an Interactive Surface
• Ahmed Kharrufa et al.: Learning at interactive surfaces and designing for reflection
• Cristina Sylla et al.: TOK – a Tangible Interface for Storytelling
• Group talk: Tables and Tangibles
a.Robert Sheehan:    Constructionism, Programming and Touch Interfaces
b.Orit Shaer et al.:     Making the Invisible Tangible: Learning Biological Engineering in Kindergarten
c.Sebastien Kubicki: Evaluation of an interactive table with tangible objects: Application with children in a classroom
d.Cristina Emilia Costa et al.:  I-Theatre: developing narratives skills in kindergarten children
e.Wooi Boon Goh et al.:  Potential Challenges in Collaborative Game Design for Inclusive Settings
2:30pm - 3:00pm       Coffee Break
3:00pm - 4:00pm       Breakout Discussion (What are future challenges? Next years workshop?)
4:00pm - 4:45pm   Closing Keynote by Allison Druin: Mining the Imagination from Time Travel to Anti-gravity: The Future of Child-Computer Interaction
"If you’ve ever sat with a child imagining the future of new technologies, you will undoubtedly hear about “anti-gravity machines,” “peace-technologies that work by tickling people,” “backpacks of the future with ice cream makers,” and “time-travel-mobile-phones that when you call someone it takes you back in time.” The question is how can these child-like imagined technologies lead us to real answers for the future?


In my talk I will propose that “data mining” is not enough, that “mining the imagination” is critical to understanding the future. I will describe the “iChild” and the interactive, independent, international, imaginative child we need to consider designing for in the future. If we look for real change, we need to listen to children, not because they know more, but because they can help us question, explore, and push us in true directions for change."


Allison Druin is an Associate Dean for Research in the iSchool at the University of Maryland and is Director of the Human-Computer Interaction Lab. For almost 14 years, she has led an intergenerational research team, where children, ages 7-11 years old partner with an interdisciplinary group of adult researchers to develop new technologies for children. With this team, she has helped to developed new digital library and storytelling tools with such partners as the U.S. National Park Service, Sesame Workshop, Nickelodeon, Nokia, UNICEF, and many others. In 2010, she received with Ben Bederson the SIGCHI Social Impact Award for her work leading the International Children’s Digital Library (www.childrenslibrary.org).
4:45pm - 5:00pm Closing Remarks (All)
7:00pm Optional Workshop Dinner


RELATED CHILD-COMPUTER INTERACTION SESSIONS AT CHI 2011
CHI 2011 will be offering a variety of opportunities for people interested in interaction design and technologies for children.  Detailed information regarding the researchers/ presenters can be found on the IDC-SIG News/Events page.


CHI2011 COURSE - Evaluating Children's Interactive Technology
Monday 9th May 2011 - 16:00
Janet C Read - University of Central Lancashire
Panos Markopoulos - Technical University of Eindhoven
CHI2011 COURSE - New Methods for Designing for and with the iChild: Strategies for Today’s Mobile, Social, and Internet Technologies
Thursday 12th May 2011 - 09:00
Allison Druin - University of Maryland
Jerry Fails - Montclair State University
Mona Leigh Gubler - University of Maryland
CHI2011 Paper Session - Engaging Youth  Thursday 12th May 2011 - 11:00
Exploratory Evaluations of a Computer Game Supporting Cognitive Behavioural Therapy for Adolescents
In the Mood: Engaging Teenagers in Psychotherapy Using Mobile Phones
Breaking Boundaries: Strategies for Mentoring through Textile Computing Workshops
Brick by Brick: Iterating Interventions to Bridge the Achievement Gap with Virtual Peers
CHI2011 - Other IDC Related Papers
Paper Session: Art, Music and  Movement: Monday 9th May 2011
MOGCLASS: Evaluation of a Collaborative System of Mobile Devices for Classroom Music Education of Young Children
MoBoogie: Creative Expression Through Whole Body Musical Interaction
Paper Session: Low-cost ICT4D Tuesday 10th May 2011
Utilizing Multimedia Capabilities of Mobile Phones to Support Teaching in Schools in Rural Panama
Infrastructures for low-cost laptop use in Mexican schools
Paper Session: Storytelling and Perceptual Crossing Wednesday 11th May 2011
ShadowStory: Creative and Collaborative Digital Storytelling Inspired by Cultural Heritage
Paper Session: Learning
Practical, Appropriate, Empirically-Validated Guidelines for Designing Educational Games

CHI2011 Paper Session - Families Tuesday 10th May 2011 - 11:00

Learning Patterns of Pick-ups and Drop-offs to Support Busy Family Coordination

Mediated Parent-Child Contact in Work-Separated Families

Hello, is Grandma there? Let’s Read! StoryVisit: Family Video Chat and Connected E-Books

Family Portals: Connecting Families Through A Multifamily Media Space

If these topics interest you, consider making plans to attend IDC 2011!
IDC 2011:  The 10th International Conference on Interaction Design and Children
June 19-23,  University of Michigan (My alma mater!)

Musical Multitouch/Gestural Interfaces by Osmosis

I've been pleasantly surprised by the increase of interesting multi-touch and gesture-based applications developed for musical interaction on large displays.  This topic is dear to my heart -  I took a computer music technology class back in 2003, and think it would have been great if this sort of thing was available back then.  Who wants to point and click around a music app for hours on end?!


The video below shows what is new from Osmosis, a company based in NY that focuses on the development of multi-touch and gesture based software for a range of uses, including music applications.


Performance Systems for Stage/Studio from Osmosis on Vimeo.

Transparent Stage System Specs
Design
• Floating, transparent HD displays from 32"
• Haptic surface with tempered glass backing
• High gain image with wide viewing angle
• Rugged aircraft-grade aluminum build
• Enclosed projector and computer
• Minimalist style, compact footprint
• Disassembles for easy transportation


Interactivity
• Projected capacitive foil or IR bezel options
• Up to 32 simultaneous touch points
• Precise, responsive touch tracking (3mm)
• Immune to external light conditions
• Use of fingers, gloves or stylus


Technical
Display:
• DLP portable projector
• 1280×800 HD resolution
• 2500 ANSI-lumen, 1800:1 contrast
Computer:
• Mini-ITX, Core 2 Quad, 4GB RAM
• ATI Radeon X1250 graphics card
• Wireless keyboard and mouse
• Windows 7 Pro

Stuart McClean, the founder of Osmosis, shared the following information about his company:

"Osmosis is a consulting firm based in the NYC area with deep experience in interactive technology. Although we cater to a range of markets, we’re especially passionate about music production and performance. Working closely with artists, we build customized interactive systems for stage and studio. HCI technology is integrated into a range of designs including stands, desktop rigs, tables, carts and vertical screens. Interfaces are tailored to specific artist needs and combine controls, generative audio and visuals, instruments, and gestural input. Our unique and flexible systems take full advantage of multi-touch interaction and offer seamless control of Ableton Live, Traktor, or other DAWs via midi and OSC..."





For more information about the applications developed by the Osmosis team, take a look at their showcase page.  

Interview with Don "Design of Everyday Things" Norman on Design Education: STEM+D+Social Sciences, Too! (MIT Technology Review)

The Problem with Design Education

David Talbot, MIT Technology Review, 4/6/11

"I think that the current emphasis on STEM—science, technology, engineering, and math—needs a "D," for design. Designers need to learn STEM (where S includes both the hard and the soft, social sciences). But similarly, engineers need to learn D: after all, the point of engineering is to develop things for people and society."-Don Norman


"...the creators of good products and services also must have a working knowledge of everything from the technical underpinnings of microprocessors and programming to the policy aspects of information security."  -Don Norman


RELATED
Some of my previous posts mentioning Don Norman and his work:
Words of Wisdom from Harry Brignull: UX Roots in Psychology, Design, Information Architecture, and so much more!
Essential Interaction Design Essays and Articles: Dan Saffer's Lists, Don Norman, and Interactions Magazine
Don Norman's Keynote at the 21st Century Transmedia Symposium "Design Challenge:  Co-creation" (New technologies allow creativity to blossom)
The Transdisciplinary Design Approach to Building an Interfaced World: A smattering ofideas, food for further thought.
Dr. Jan Borchers' (Annotated) Top Ten List of Books on Human-Computer Interaction -Of interest to HCI students and HCI students-at-heart.

SOMEWHAT RELATED
The following post generated a good deal of unexpected discussion ; )
For a Smile:  Gain Detergent Container Looks Like Don Norman's User-Unfriendly Teapot

Below is my final response to the conversation:
The UX of Laundry Washing:  Response to Comments and Videos of Gain Detergent Fans!

"Playful Interface Cultures" exhibit video showreel, just released (Ars Electronica Festival 2010)

Playful Interface Cultures from Interface Culture on Vimeo.


"This video showreel provides a walkthrough through the "Playful Interface Cultures" exhibition at the Ars Electronica Festival 2010. The works shown were created within the Master and Ph.D. program at the Interface Culture Lab, University of Art and Industrial Design in Linz, Austria." http://www.interface.ufg.ac.at/​

"The exhibition design has been based on traditional Austrian tobacco brands in reference to the historic venue of the former tobacco factory built by the German designer and architect Peter Behrens." -Interface Culture Lab


Instructors:
Georg Russegger
Martin Kaltenbrunner
Michaela Ortner
Varvara Guljajeva
Design
Vesela Milhaylova
Henning Schulze
Production
Reinhard Gupfinger
Technical Support
Mar Canet
Anika Hirt

University of Art and Industrial Design, Linz


SOMEWHAT RELATED
TuioKinect, by Martin Kaltenbrunner: "A simple Tuio hand gesture tracker for Kinect"
Reactable 

Program- CHI 2011 Child Computer Interaction: 2nd Workshop on UI Technologies and Educational Pedagogy

CHILD COMPUTER INTERACTION: 2ND WORKSHOP ON UI TECHNOLOGIES AND THEIR IMPACT ON EDUCATIONAL PEDAGOGY

May 7, 2011

In conjunction with CHI 2011, Vancouver, Canada

PROGRAM (Draft)

9:00am – 09:05am       Introduction


9:05am - 10:05am        Paper Session I (8min presentation, 4min Discussion)


Evaluating Pervasive Classrooms


• Son Do-Lenh et al.:   Classroom-experience evaluation: An ecological approach to evaluating pervasive technologies in classroom
• Kathryn Rounding et al.:   Evaluating Interfaces with Children
• Dan Morris et al.:   Using Machine Learning to Scaffold Artistic Creativity in Education
• Tamara Polajnar et al.:   Enabling Picture-based Querying and Learning with the JuSe Interface
• Hamed Alavi et al.:   Lantern 2.0: A Pervasive Scripting Tool


10:05am - 11:00am  Coffee Break and Preparation time for short talks


11:00am - 12:10pmPaper Session II (8min presentation, 4min Discussion)


Collaboration in Math: Fears, Myths, and Insights


• Nicola Yull et al.: Pass the iPad: Comparing collaboration on paper and screen
• Veronika Irvine et al.: Math Education: A Creative Approach


• Group talk: Math and Embodied Agents
a.  Kristina Richter et al.: Bridging Diagnosis and Learning for Mathematics Education in Classroom Setting
b.  Lisa Anthony et al.: Handwriting Interaction for Math Tutors: Lessons for HCI in Education
c.  Andrew Jensen et al.: Using Embodied Pedagogical Agents and Direct Instruction to Augment Learning for Young Children with Special Needs


• Group talk: Dispelling Myths About the Next Generation Classroom
a.   Alex Thayer et al.: The Myth of the Paperless School: Replacing Printed Texts with E-readers
b.  Sharon Oviatt: Designing Digital Tools for Thinking, Adaptive Learning and Cognitive Evolution
c.  Alexandra Dunn et al.: Designing Classroom Technology to Meet the Needs of All


• Group talk: Games, Wearables and Fun Learning.
a.  Christiane Moser et al.:    Child-Centered Game Development
b.  Lizbeth Escobedo et al.:  Blue’s Clues: An Augmented Reality Positioning System
c.  Si Jung Kim et al.:   Wearable Story: A Story Telling Jacket for Young Children to Improve Their Independent Physical and Learning Activities


12:10pm - 1:30pm Lunch


1:30pm - 2:30pm Paper Session (10 min presentation, 5min Discussion)


Tangibles and Tabletops
•   Izdihar Jamil et al.: Communication Patterns in Collaborative Peer Learning around Interactive Table
•   Aura Pon et al.: Graspable Music and Vuzik: Music Learning and Creativity using an Interactive Surface
•   Ahmed Kharrufa et al.: Learning at interactive surfaces and designing for reflection
•   Cristina Sylla et al.: TOK – a Tangible Interface for Storytelling


• Group talk: Tables and Tangibles
• a.Robert Sheehan: Constructionism, Programming and Touch Interfaces
• b.  Orit Shaer et al.: Making the Invisible Tangible: Learning Biological Engineering in Kindergarten
• c.  Sebastien Kubicki: Evaluation of an interactive table with tangible objects: Application with children in a classroom
• d.  Cristina Emilia Costa et al.: I-Theatre: developing narratives skills in kindergarten children
• e.  Wooi Boon Goh et al.: Potential Challenges in Collaborative Game Design for Inclusive Settings


2:30pm - 3:00pm  Coffee Break


3:00pm - 4:00pm  Breakout Discussion (What are future challenges? Next years workshop?)


4:00pm - 4:45pm  Closing Keynote  TBA


4:45pm - 5:00pm  Closing Remarks


7:00pm   Optional Workshop Dinner


RELATED
Workshop Website
ACM-CHI 2011 Conference Website

SIFTEO, the next-gen Siftables! (Tangible User Interfaces for All)

Despite my enthusiasm for TUI's , I somehow missed the news about the transformation of Siftables to a commercial version, Sifteo:

Sifteo Inc. Debuts Sifteo™ Cubes - A New Way To Play (PDF) 

"Sifteo cubes are 1.5 inch computers with full-color displays that sense their motion, sense each other, and wirelessly connect to your computer. You, your friends, and your family can play an ever-growing array of interactive games that get your brain and body engaged.

Sifteo’s initial collection of titles includes challenging games for adults, fun learning puzzles for kids, and games people can play together." -Sifteo website

For more information, see the Sifteo website,  blog, and YouTube  channel.  If you can't wait to get your own set,  take a look at Josh Blake's Sifteo Cube Unboxing Video!

RELATED

About two years ago, I was interviewed about my thoughts about the interactive, hands-on, programmable cubes, then called Siftables,  for an article published in IEEE's Computing Now magazine:  Siftables Offer New Interaction Mode  (James Figeuroa, Computing Now, 3/2009). 

For those of you who'd like more information about tangible user interfaces (TUIs) and  the development of Siftables, I've copied my 2009 post,   Tangible User Interfaces, Part I:  Siftables,  below:

TANGIBLE USER INTERFACES, PART I: SIFTABLES (2009)

In 1997, the vision of tangible user interfaces, also known as TUI's, was outlined by Hiroshi Ishii and Brygg Ullmer of the Tangible Media Group at MIT, in their paper, "Tangible Bits: Towards Seamless Interfaces between People, Bits, and Atoms" (pdf).   According to this vision, "the goal of Tangible Bits is to bridge the gaps between both cyberspace and the physical environment, as well as the foreground and background of human activities." This article is is a must-read for anyone interested in "new" interactive technologies.

The pictures in the article of the metaDesk, transBoard, activeLENS, and ambientRoom, along with the references, are worth a look, for those interested in this seminal work.

Another must-read is Hiroshi Ishii's 2008 article, Tangible Bits: Beyond Pixels (pdf). In this article, Ishii provides a good overview of TUI concepts as well as the contributions of his lab to the field since the first paper was written.

Related to Tangible User Interface research is the work of the Fluid Interfaces Group at MIT. The Fluid Interfaces Group was formerly known as the Ambient Intelligence Group, and many of the group's projects incorporate concepts related to TUI and ambient intelligence. 


According to the Fluid Interfaces website, the goal of this research group is to "radically rethink the human-machine interactive experience. By designing interfaces that are more immersive, more intelligent, and more interactive we are changing the human-machine relationship and creating systems that are more responsive to people's needs and actions, and that become true "accessories" for expanding our minds."

The Siftables project is an example of how TUI and fluid interface (FI) interaction can be combined. Siftables is the work of David Merrill and Pattie Maes, in collaboration with Jeevan Kalanithi, and was brought to popular attention through David Merrill's recent TED talk:

David Merrill's TED Talk: Siftables - Making the digital physical -Grasp Information Physically

"Siftables aims to enable people to interact with information and media in physical, natural ways that approach interactions with physical objects in our everyday lives. As an interaction platform, Siftables applies technology and methodology from wireless sensor networks to tangible user interfaces. Siftables are independent, compact devices with sensing, graphical display, and wireless communication capabilities. They can be physically manipulated as a group to interact with digital information and media. Siftables can be used to implement any number of gestural interaction languages and HCI applications....Siftables can sense their neighbors, allowing applications to utilize topological arrangement..No special sensing surface or cameras are needed."





Siftables Music Sequencer from Jeevan Kalanithi on Vimeo.

More about Siftables:
Rethinking display technology (Scott Kirsner, Boston Globe, 7/27/08)
TED: Siftable Computing Makes Data Physical
Siftables: Toward Sensor Network User Interfaces (pdf)

It seems that people really like the Siftable concept, or they don't see the point. I found the following humerous critique of Siftables on YouTube:

"Imagine if all the little programs you had on your iphone were little separate chicklets in your pocket.
You'd lose em.
Your cat would eat em.
You'd vacuum them up.
They'd fall down in the sofa.
They'd be all over the car floor.
You'd throw them away by mistake..."

In my opinion, it is exciting to learn that perhaps some of this technology has the potential of becoming main-stream.

Designing For Children: Good article by Catalina Naranjo-Bock, UX Matters

Here is the link - it is the first installment of Catalina Naranjo-Bock's column for UX Matters:


Approaches to User Research When Designing For Children
Catalina Naranjo-Bock,  UXMatters  3/7/11




When I get a bit more time, I'll follow with my comments related to Catalina's column-- I'm a school psychologist and HCI techie, so this one of my interests!

Game Accessibility Example: Control Sims 3 with your eyes!

The video below was shared by SpecialEffect Accessible GameBase:





RELATED
SpecialEffect Accessible GameBase website.


SpecialEffect Accessible GameBase (Facebook)

Cross-posted on the TechPsych blog.

Why bother switching from GUI to NUI? - Asked and Answered by Josh Blake; My 2-cents; Stevie B’s Microsoft Research Video; Marco Silva’s NUI-HCI Presentation (and links)

In Chapter 1 of Natural User Interfaces in .NET,  Josh Blake asks and answers a question posed by many people who have been under the spell of keyboard input and GUI/ WIMP interaction: 


Why bother switching from GUI to NUI?  The answer?  Read Chapter 1 (pdf) of the book - the chapter is free.


Here are a few of my personal reasons:  
1.  I want to buy the next version of the iPad or something like it.
2.  I want to buy a new large-screen Internet HD TV.

3.  I want to buy a Kinect.

4.  I do NOT want to interact with my new TV with a Sony remote.  Too many tiny buttons!

5. I do NOT want to interact with my new TV with a keyboard,  because it reminds me of...work.

6.  Most importantly: 

I want to design apps for the people I care about, and others with similar needs:

    My mom.  

    My grandson.

Moms and dads with kids in tow.
People with special needs and/or health concerns, and the people who care and guide them.
Knowledge sharers and (life-long) learners....

RELATED

"Smart" Interactive Display Research

How Natural User Interfaces are changing Human Computer Interaction

 

View more presentations from Marco Silva

My YouTube Playlist:

Post-WIMP Explorers' Club Videos

"Natural user interfaces, gesture interaction, multi-touch, natural interaction, post WIMP examples and more... "

Interactive Multimedia Technology Post:
Interactive Touch-Screen Technology, Participatory Design, and "Getting It": Revisited

RELATED - and somewhat related   

Moms with Apps

Design for Care

SparkOn

NUI Group

UX Matters      "Why don't usability problems get fixed"

Encyclopedia:  Human Computer Interaction, Interaction Design, User Experience, Information Architecture, Usability and More (Interaction-Design.org)

Josh Blake's Blog: Deconstructing the NUI    Book: Chapter 1 (pdf)  Free!
Blake.NUI

"Blake.NUI is a collection of helpful controls, utilities, and samples useful for multi-touch and NUI development with WPF, Surface, and Silverlight."

OpenKinect Wiki

OpenKinect Community Founder Joshua Blake Comes Up With His Own Version of Win 7 Multitouch on Kinect   (Madhav K, KinectHacks 1/14/11)

Kinect SDK Could Open New Worlds for Motion-Controlled Interfaces (Mike Martin, TechNews World, 2/22/11)

Seth Sandler

Seth Sandler's Blog

Seth Sandler's  Ultimate List of Interactive Tables

Dan Saffer

Bill Buxton

Johnny Chung Lee's Procrastineering Blog
Adam Greenfield's Speedbird Blog

 (This is not an inclusive list.)


GUI to NUI Post-WIMP Manifesto:  TBA