Focused on interactive multimedia and emerging technologies to enhance the lives of people as they collaborate, create, learn, work, and play.
Jan 26, 2010
There is a need for multi-touch/gesture designers/developers!
In my opinion, there will be a need for multi-touch web applications as well as for multi-touch education and collaboration applications for the SMART Table, Microsoft's Surface, multi-touch tablets like the rumored iTablet from Apple, and the multi-touch laptops and all-in-ones (Dell, HP, etc.).
Below are direct links to some of my blog posts related to multi-touch applications and screens. If you are fairly new to multi-touch, I'm sure that looking through some of my blog posts will be helpful. All of the posts have links to resources, and most have photos and video clips of multi-touch in action.
If you are new to this blog, I have a great deal of information, links, photos, and video clips of various multi-touch screens and applications. The best way to find the stuff is to enter in a keyword in the search box for this blog: multitouch, touch screen, gesture, multi-touch, etc. on this blog.
Also do a search on my other blog: The World Is My Interface http://tshwi.blogspot.com
Here are some links:
Do you have an HP TouchSmart, Dell Studio One or NextWindow touch-screen? NUITech's Snowflake Suite upgrade provides a multi-touch plug-in
http://bit.ly/5tdlhc
The following blog post has a video clip that shows someone from Adobe painting with a multi-touch application in development:
More Multi-Touch!: Rumor of the mobile apple iTablet; AdobeXD & Multitouch; 10-finger Mobile Multitouch: http://bit.ly/4S9Upm
Ideum's GestureWorks: http://bit.ly/4C1p7M
Interactive Walls, Interactive Projection Systems, GestureTek's Motion-Based Games: http://bit.ly/6GRGtW
Intuilab's Interfaces: Multi-touch applications/solutions for presentations, collaboration, GIS, and commerce: http://bit.ly/7RK7qN
For software developers:
How to do Multitouch with WPF 4 in Visual Studio 2010: http://bit.ly/7c4YqC
Jan 20, 2010
SMART Technologies Multitouch Application Contest Announced!
If you haven't seen a SMART Table, the following videos will give you an idea of what they are all about:
The SMART Table in a multi-age Montessori classroom at an elementary school:
Video from 2008 about the SMART Table:
Below is information about the contest prizes from the SMART Technologies website:
- Grand prize – One SMART Table, valued at US$6,499. Plus, the winning application will be promoted on the SMART website for one year, providing you with the opportunity to establish a revenue stream if users purchase your application.
- First runner-up – The second-place application will be promoted on the SMART website for one year.
- Second runner-up – The third-place application will be promoted on the SMART website for six months
Nov 21, 2009
"Image Reveal" application for the SMART Table, by Vectorform.
"Vectorform was eager to collaborate with SMART to create an early learning application for the SMART Table, which it feels is a groundbreaking technology product. Image Reveal enables young users to collaborate and answer a series of multiple choice questions in a chosen subject area. Each correct answer uncovers part of a hidden image until it is fully visible. Alternatively, students can guess what the hidden image is at any time to win the game. Using the SMART Table Toolkit, teachers can customize content, including subject area, hidden image, questions and answers, and use images to tailor questions and answers for pre-literate learners." -SMART Tech Press Release
SMART Table Introductory Video:
It is good news to see that SMART Technologies is providing new applications for the SMART Table. There is much room for growth in this field. However, the applications still have the look and feel of electronic workbooks, with a few interactive media bells and whistles tossed in to ensure that the system appeals to young learners. I wonder if the application supports teaching the skills needed for children to successfully work together, such turn-taking, negotiating with other children in a group situation, or settling differences of opinion.
Classrooms in elementary schools now contain a growing number of students who have autism spectrum disorders, as well as other disabilities that interfere with social interaction. For this reason, it would be important to learn if SMART Table applications follow the guidelines for Universal Design for Learning(UDL).
Aug 24, 2009
MICROSOFT: ARE YOU LISTENING? Cool Cat Teacher (Vicki Davis) Tests Out Microsoft's Multi-touch Surface Table
My head was brimming with ideas for this innovative technology for use with the students I work with every day.
The following video shows a demonstration of Microsoft's multi-touch, multi-user Surface table at the 2009 NECC conference, and also provides insightful comments from Vicki Davis, author of the very popular Cool Cat Teacher blog. Vicki discusses the value of surface/tabletop computing in education and shares her views about the need for user involvement in the educational software development process. She also gives great advice about how Microsoft or other developers of tabletop computing systems should proceed.
I agree with Vicky's comments, 100%, as my regular blog readers know!
MICROSOFT, ARE YOU LISTENING?
In the above video, it is apparent that the musical instrument applications do not provide a good touch response on the Surface. Vicki suggests that touch responsiveness is key, and that all Surface applications should be held to the high standard of Apple's iPhone and iPod Touch. Vicky goes on to say that Microsoft should support easy development of applications, and ensure that applications are very user-friendly and easy for school folks to install. If you work in a K-12 setting, you know what I am talking about ; )
Vicky is preaching to the choir when she stresses that Microsoft R&D (and others) should involve users in ongoing development, in a meaningful way, by using REAL people, REAL teachers, people who work with students. If you have ever battled with a "lame" educational application, you know why this is so very important!
Vicky's enthusiasm for the use of tabletop/surface computing in education can not be ignored. She absolutely knows what she is talking about, and she is the instructional technology voice for a multitude of educators around the world.
Here is Vicky's plea:
"I wish Microsoft would listen to these 3 things from a teacher in a classroom (me). I know Microsoft has bigger things to do than watch this video, but, I can dream, can't I?"
(I've paraphrased the following quotes.)
1. Understand the amazing potential for Surface devices in education. Look at three to five years out. You are looking at the future.
(This technology can engage students who have ADHD, etc.)
2. Harness the power of your users! Pull in your users. There are so many people in education would give their thoughts for free!
3. Create virtual and online ways for Microsoft to interact with teachers.
"If Microsoft decides to invest in this, and I do hope that somebody watching this video will understand the importance of integrating the world around us into the learning experiences and the learning environment, as part as how we remake and re-do education."
My sentiments exactly!
A few thoughts:
So where are we now?Smart Technologies has come out with the SMARTTable, but it was designed for younger students. At this point, there are very few options, especially affordable options, for educators of students in the upper grades to use this technology.
Some members of the NUI-group are involved in creating educational applications for table-top systems, but they are few in number.
A few companies are using this technology for education, but the applications are mostly limited to interactive museum exhibitions.
From my research on this topic, there are very few developers that have the interest or the inclination to create educational applications for table-top computing.
My hope is that this will change soon! Join me in this conversation.
Aug 18, 2009
CRISTAL: One Giant Remote Control Multi-Touch Coffee Table; ACM Interactive Tabletops and Surfaces 2009 in Banff, Canada
Via Wired Gadget Lab Priya Ganapati 8/14/09
What is CRISTAL ? Control of Remotely Interfaced Systems using Touch-based Actions in Living Spaces and acronym for a project at the Media Interaction Lab at the Upper Austria University of Applied Sciences, Digital Media.
Watch the videos:
"CRISTAL simplifies the control of our digital devices in and around the living room. The system provides a novel experience for controlling devices in a home environment by enabling users to directly interact with those devices on a live video image of their living room using multi-touch gestures on a digital tabletop." -mediainteractionlab, YouTube
The CRISTAL project is a collaboration between several people, spanning across a few universities, according to the Media Interaction Lab website:
Media Interaction Lab
Florian Perteneder
Media Interaction Lab
Thomas Seifried
Media Interaction Lab
Michael Haller
Media Interaction Lab
Daisuke Sakamoto
University of Tokyo
Jun Kato
University of Tokyo
Masahiko Inami
Keio University
Stacey D. Scott
University of Waterloo
Below is a sample of the Interactive Media Lab's publications:
M. Haller, P. Brandl, C. Richter, T. Seifried, J. Leitner, and A. Gokcezade, 2009.
"Interactive Displays and Next-Generation Interfaces." Springer, 2009. [bibtex]
"Using Heuristics to Evaluate the Overall User Experience of Video Games and Advanced Interaction Games." Springer, 2009. [in press] [bibtex]
M. Haller, C. Forlines, C. Koeffel, J. Leitner, and C. Shen, 2009.J. Leitner, C. Köffel, and M. Haller, 2009.
"Physical Interfaces For Tabletop Games," Computer Entertainment, vol. XX, p. XX, 2009. [bibtex]
M. Haller and M. Billinghurst, 2008.
"Interactive Tables: Requirements, Design Recommendations, and Implementation."
D. Leithinger and M. Haller, 2007.
"Improving Menu Interaction for Cluttered Tabletop Setups with User-Drawn Path Menus," Horizontal Interactive Human-Computer Systems, 2007. TABLETOP 07. Second Annual IEEE International Workshop on, pp. 121-128, 2007. [bibtex]
"Carpeno: interfacing remote collaborative virtual environments with table-top interaction," Virtual Reality, vol. 10, iss. 2, pp. 95-107, 2006. [bibtex]
One of the people involved in the CRISTAL project is Stacey D. Scott, Ph.D., is an assistant professor of systems design engineering at the University of Waterloo. She is also the director of the Collaborative Systems Laboratory. The Collaborative Systems Laboratory focuses on fundamental interfaces and interaction techniques for shared large-screen displays, such as multi-display environments and social-supporting digital tabletop interfaces, and also collaborative and decision support interfaces for complex, time-critical team environments.
Dr. Scott is also one of the program co-chairs of the upcoming ACM Interactive Tabletops and Surfaces 2009 Conference will be held November 23-25 in Banff, Canada.
Mark your calendars!
The following topics, as they relate to interactive tabletops and surfaces, will be presented:
- Applications
- Gesture-based interfaces
- Multi-modal interfaces
- Tangible interfaces
- Novel interaction techniques
- Data handling/exchange on large interactive surfaces
- Data presentation on large interactive surfaces
- User-interface technology
- Computer supported collaborative systems
- Middleware and network support
- Augmented reality
- Social protocols
- Information visualizations
- Sensing and input technologies
- Human-centered design & methodologies
| Patrick Baudisch | Hasso Plattner Institute Potsdam, Germany |
| Francois Berard | University of Grenoble, France |
| Peter Brandl | Media Interaction Lab, Upper Austria University of Applied Sciences, Austria |
| Andreas Butz | University of Munich, Germany |
| Francois Coldefy | Orange Labs, France |
| Morten Fjeld Chalmers | University of Technology, Sweden |
| Kentaro Fukuchi | University of Electro-Communications, Japan |
| Tovi Grossman | Autodesk Research, Canada |
| Mark Hancock | University of Calgary, Canada |
| Petra Isenberg | University of Calgary, Canada |
| Yuichi Itoh | Osaka University, Japan |
| Karrie Karahalios | University of Illinois, USA |
| Hiro Kato | Osaka University, Japan |
| Hideki Koike | University of Electro-Communications, Japan |
| Frank Maurer | University of Calgary, Canada |
| Max Mühlhäuser | TU Darmstadt, Germany |
| Christian Muller-Tomfelde | CSIRO-ICT Centre, Australia |
| Miguel Nacenta | University of Saskatchewan, Canada |
| Patrick Olivier | Newcastle University, UK |
| Jun Rekimoto | Sony / University of Tokyo, Japan |
| Meredith Ringel Morris | Microsoft Research, USA |
| Daisuke Sakamoto | Tokyo University, Japan |
| Yoichi Sato | University of Tokyo, Japan |
| Chia Shen | Harvard University, USA |
| Masahiro Takatsuka | University of Sydney, Australia |
| Lucia Terrenghi | Vodafone Group R&D, Germany |
| Bruce Thomas | University of Southern Australia, Australia |
| Melanie Tory | University of Victoria, Canada |
| Edward Tse | SMART Technologies, Canada |
| Fred Vernier | South-Paris University, France |
| Andy Wilson | Microsoft Research, USA |
| Massimo Zancanaro | Bruno Kessler Foundation (formerly ITC), Italy |
If you are a university student researching interactive tabletops, multi-touch surfaces, and/or gesture interaction, I hope this post helps!
Aug 14, 2009
Tom Barrett, a teacher, demonstrates Durham University's SynergyNet Multi-touch Networked Tables
In this video, Tom Barrett demonstrates multi-touch networked tables, which were designed to be part of an immersive classroom environment. The multi-touch tables are the result of a collaboration between the Technology Enhanced Learning research group at Durham University and colleagues from the Education and Psychology departments.
Tom is a teacher and edublogger. Like me, he has a passion for multi-touch technology. He has been fortunate to have the chance to work with a SMARTTable in his classroom, and also compare the SMARTTable experience with the tables at Durham University, which were not from SMART Technologies.
Tom was one of the first teachers to have the opportunity to try out the SMART Table in his classroom. He was a bit disappointed with the outcome. Even so, he believes that multi-touch technology will be important in education in the future.
From Tom's point of view, there is a need to have more in-depth content for the SMART Table, even at the earlier grades. The following quotes are taken from Tom's "SMART Table in my Classroom- My Conclusions" blog post:
"In my opinion there are three things that contribute to this: poor content; poor creation software and a straight jacketed approach to multi-touch functionality...There seems to be too much residual SMART Notebook thinking and not enough innovative software design. Maybe the product has preceded the necessary thinking behind it all."
"The one shining ray of light that emerges from amidst this all is the Media application. I have posted videos of some of my children working with this program in the past. It remains the only application that offers teachers and children an open environment to learn, and couples it with a unique interface with media. When you use this application you actually feel like you are using something innovative, multi-touch, gestural driven. As a teacher there is the capacity to use rich content of your choice (video) and then layer on top questions that engage the children in a much deeper way"
RELATED
Flickr Group: Multi-touch Interactive Desk: Applications and Gesture Ideas
(Note: I have plenty of ideas for content and software design for multi-touch tables in education, and also cognitive and educational assessment. I'm only missing a table or two!)
May 10, 2009
Michael Haller Discusses Multi-touch, Interactive Surfaces, and Emerging Technologies for Learning
Emerging Technologies for Learning: Interactive Displays and Next Generation Interfaces(pdf)
Becta Research Report (2008) Michael Haller Volume 3 (2008)
"Multi-touch and interactive surfaces are becoming more interesting, because they allow a natural and intuitive interaction with the computer system.
These more intuitive and natural interfaces could help students to be more actively involved in working together with content and could also help improve whole-class teaching activities. As these technologies develop, the barrier of having to learn and work with traditional computer interfaces may diminish.
It is still unclear how fast these interfaces will become part of our daily life and how long it will take for them to be used in every classroom. However, we strongly believe that the more intuitive the interface is, the faster it will be accepted and used. There is a huge potential in these devices, because they allow us to use digital technologies in a more human way." -Michael Haller
Michael Haller works at the department of Digital Media of the Upper Austria University of Applied Sciences (Hagenberg, Austria), where he is the head of the Media Interaction Lab.
Michael co-organized the Interaction Tomorrow course at SIGGRAPH 2007, along with Chia Shen, of the Mitsubishi Electric Research Laboratories (MERL). Lecturers included Gerald Morrison, of Smart Technologies, Bruce H. Thomas, of the University oof Southern Australia, and Andy Wilson, of Microsoft Research. The course materials from Interaction Tomorrow are available on-line, and include videos, slides, and course notes.
Below is an excerpt from the discription of the Interaction Tomorrow SIGGRAPH 2007 course:
"Conventional metaphors and underlying interface infrastructure for single-user desktop systems have been traditionally geared towards single mouse and keyboard-based WIMP interface design, while people usually meet around a table, facing each other. A table/wall setting provides a large interactive visual surface for groups to interact together. It encourages collaboration, coordination, as well as simultaneous and parallel problem solving among multiple people.
In this course, we will describe particular challenges and solutions for the design of direct-touch tabletop and interactive wall environments. The participants will learn how to design a non-traditional user interface for large horizontal and vertical displays. Topics include physical setups (e.g. output displays), tracking, sensing, input devices, output displays, pen-based interfaces, direct multi-touch interactions, tangible UI, interaction techniques, application domains, current commercial systems, and future research."
It is worth taking the time to look over Haller's other publications. Here is a few that would be good to read:M. Haller, C. Forlines, C. Koeffel, J. Leitner, and C. Shen, 2009. "Tabletop Games: Platforms, Experimental Games and Design Recommendations." Springer, 2009. in press [bibtex]
A. D. Cheok, M. Haller, O. N. N. Fernando, and J. P. Wijesena, 2009.
"Mixed Reality Entertainment and Art," International Journal of Virtual Reality, vol. X, p. X, 2009. in press [bibtex]
J. Leitner, C. Köffel, and M. Haller, 2009. "Bridging the gap between real and virtual objects for tabletop games," International Journal of Virtual Reality, vol. X, p. X, 2009. in press [bibtex]
M. Haller and M. Billinghurst, 2008.
"Interactive Tables: Requirements, Design Recommendations, and Implementation." IGI Publishing, 2008. [bibtex]
D. Leithinger and M. Haller, 2007. "Improving Menu Interaction for Cluttered Tabletop Setups with User-Drawn Path Menus," Horizontal Interactive Human-Computer Systems, 2007. TABLETOP 07. Second Annual IEEE International Workshop on, pp. 121-128, 2007. [bibtex]
J. Leitner, J. Powell, P. Brandl, T. Seifried, M. Haller, B. Dorray, and P. To, 2009."Flux: a tilting multi-touch and pen based surface," in CHI EA 09: Proceedings of the 27th international conference extended abstracts on Human factors in computing systems, New York, NY, USA, 2009, pp. 3211-3216. [bibtex]
References from the BECTA paper:
Elrod, S., Bruce, R., Gold, R., Goldberg, D., Halasz, F., Janssen, W., Lee, D., Mc-Call, K., Pedersen, E., Pier, F., Tang, J., and Welch, B., Liveboard: a large interactive display supporting group meetings, presentations, and remote collaboration, CHI ’92 (New York, NY, USA), ACM Press, 1992, pp. 599–607.
Morrison, G., ‘A Camera-Based Input Device for Large Interactive Displays’, IEEE Computer Graphics and Applications, vol. 25, no. 4, pp. 52-57, Jul/Aug, 2005.
Albert, A. E. The effect of graphic input devices on performance in a cursor positioning task. Proceedings ofthe Human Factors Society 26th Annual Meeting, Santa Monica, CA: Human Factors Society, 1982, pp. 54-58.
Dietz, P.H., Leigh, D.L., DiamondTouch: A Multi-User Touch Technology, ACM Symposium on User Interface Software and Technology (UIST), ISBN: 1-58113-438-X, pp. 219-226, November 2001.
Rekimoto, J., SmartSkin: An Infrastructure for Freehand Manipulation on Interactive Surfaces,
CHI 2002, 2002.
Kakehi, Y., Iida, M., Naemura, T., Shirai, Y., Matsushita, M.,Ohguro, T., ‘Lumisight Table: Interactive View-Dependent Tabletop Display Surrounded by Multiple Users’, In IEEE Computer
Graphics and Applications, vol. 25, no.1, pp 48 – 53, 2005.
Streitz, N., Prante, P., Röcker, C., van Alphen, D., Magerkurth, C.,Stenzel, R., ‘Ambient Displays and Mobile Devices for the Creation of Social Architectural Spaces: Supporting informal communication and social awareness in organizations’ in Public and Situated Displays: Social and Interactional Aspects of Shared Display Technologies, Kluwer Publishers, 2003. pp. 387-409.
Morrison, G., A Camera-Based Input Device for Large Interactive Displays, IEEE Computer Graphics and Applications, vol. 25, no. 4, pp. 52-57, Jul/Aug, 2005.
Ishii, H., Underkoffler, J., Chak, D., Piper, B., Ben-Joseph, E., Yeung, L. and Zahra, K., Augmented Urban Planning Workbench: Overlaying Drawings, Physical Models and Digital Simulation. IEEE and ACM International Symposium on Mixed and Augmented Reality ACM Press, Darmstadt, Germany.
Han, Y., Low-cost multi-touch sensing through frustrated total internal reflection, UIST ’05 (New York), ACM Press, 2005, pp. 115–118.
Hull., J., Erol, B., Graham, J., Ke, Q., Kishi, H., Moraleda, J., Olst, D., Paper-Based Augmented Reality. In Proceedings of the 17th International Conference on Artificial Reality and Telexistence (Esbjerg, Denmark,November 28-30, 2007). ICAT ’07. IEEE, 205-209.
Haller, M., Leithinger, D., Leitner, J., Seifried, T., Brandl, P., Zauner, J., Billinghurst, M., The shared design space. In SIGGRAPH ’06: ACM SIGGRAPH 2006 Emerging technologies, page 29, New York, NY,USA, 2006. ACM Press.
Research email: emtech@becta.org.uk
Main email: becta@becta.org.uk
URL: www.becta.org.uk
(This was also posted on the TechPsych blog.)
Apr 24, 2009
SMART Table in the Classroom: Tom Barret's Journey
(Tom blogs about educational technology, including topics such as "Using the Nintendo Wii to Support My Numeracy Lesson")
Here are Tom's first-glance comments about the SMART Table:
"A couple of things that I have learned already:
There is a long way to go in terms of the toolkit and software development"
"For 9 and 10 year olds (upper junior), the optimum number for using the Table is 4. Any more and it gets a little congested, limiting the screen real estate that you can use. This is crucial, you might be able to get 6 Year 5s around it but they will not get significant enough access to the surface and so the learning activity. "
Apr 3, 2009
Albrecht Schmidt's User Interface Engineering Blog: Great Links, References, and Resources
Albrecht Schmidt is a professor at the University of Duisburg-Essen who focuses his research on "novel user interfaces and innovative applications enabled by ubiquitous computing." Dr. Schmidt previously headed something called the "Embedded Interaction Research Group" at the Ludwig-Maximilians University in Munich.
Albrecht Schmidt will be working in collaboration with Chris Kray's group at the Culture Lab at Newcastle University in the UK. The work will focus on creating and building interactive appliances. He also mentioned the work of Jayne Wallace, one of the researchers at the Culture Lab, who creates digital jewelry.
The best thing about Albrecht's recent post was his short list of references:
[1] Wallace, J. and Press, M. (2004) All this useless beauty The Design Journal Volume 7 Issue 2 (PDF)
[2] Jayne Wallace. Journeys. Intergeneration Project.
[3] Kern, D., Harding, M., Storz, O., Davis, N., and Schmidt, A. 2008. Shaping how advertisers see me: user views on implicit and explicit profile capture. In CHI '08 Extended Abstracts on Human Factors in Computing Systems (Florence, Italy, April 05 - 10, 2008). CHI '08. ACM, New York, NY, 3363-3368. DOI= http://doi.acm.org/10.1145/1358628.1358858
Another recent post that I like was "Teaching, Technical Training Day at the EPO". The following topics were covered during a training event at the European Patent Office in Munich, Germany:
- Merging the physical and digital (e.g. sentient computing and dual reality [1])
- Interlinking the real world and the virtual world (e.g. Internet of things)
- Interacting with your body (e.g. implants for interaction, brain computer interaction, eye gaze interaction)
- Interaction beyond the desktop, in particular sensor based UIs, touch interaction, haptics, and Interactive surfaces
- Device authentication with focus on spontaneity and ubicomp environments
- User authentication focus on authentication in the public
- Location-Awareness and Location Privacy
If you take a peek at the Culture Lab website, be sure to look at the Ambient Kitchen, designed to support older people with memory difficulties:
Also look at Jayne Wallace's digital jewelry website The following pictures are of a neckpiece that triggers digital visits of silent film sequences on digital displays in its vicinity:


Some of Jayne's digital jewelry was created in response to "physical, clinical, social, and emotional dynamics of memory loss".
I hope you enjoy exploring Albrecht Schmidt's User Interface Engineering blog and the Culture Lab website!
Mar 26, 2009
ElderGadget Blog
Today I came across the ElderGadget Blog when I was searching for technology that might be helpful to my father, who recently spent the last few weeks in an intensive care unit.
Here are a few things I found on the blog, including what I found when I followed a link to the bindependent website:
Smart Table: A Broadband Communication System for the Elderly
ID Studiolab, Delft University of Technology, NL
"The smart system is aimed to prevent possible social isolation between elderly people and their social contacts. It consists of the Smart Table and the Smart Messenger, which provide easy and intuitive way for elderly people to benefit from the advantage of communication technology and improve the satisfaction of their social activities."
"During the design research, a working prototype is made and evaluated by a user test. The Smart Table offers people a way to use broadband communication without the need for a computer. The television will be used for video communication (web-cam) and the table as user-interface. On the table contact persons can be selected and images and video can be shared. The elderly person can capture images that will be shared instantly. The contact person can select images from his or her computer, which will be projected on the table of the elderly person". (TU Delft - Faculty Industrial Design Engineering - Master Design for Interaction - Project Interactive Technology Design - Vincent Steurs & Juin-Yi Huang)

Demy Kitchen Safe Touchscreen Reader

Photo Watch
Clarity-C900: Amplified Big Button Cell Phone

911 Guardian: "Tiny wearable speakerphone"

Extra Large TV Remote Control

SmartShopper: Electronic grocery-list maker

Bierley's ColorMouse Video Magnifier

RELATED
Live from CES - Dakim's Brain Fitness Keeps Seniors Sharp
Previous post: Ubiquitous Computing - Grandpa and grandkids use a webcam and Skype across the miles
YouTube Vlogger: Geriatric1927
Geriatric Gripes and Grumbles
Feb 18, 2009
Ready for the SMARTTable?
Here is the plug:
"The world's first multitouch, multiuser table for primary education - the SMART Table - is now available for purchase.Order the SMART Table"
"As a collaborative learning center, the SMART Table enables engaging and motivating small-group learning experiences. Up to eight students can use their fingers intuitively to sweep, slide and spin objects on the interactive screen. The SMART Table's ready-made activities help primary students gain and further their skills in areas like counting and reading."
"The SMART Table also makes an ideal complement to whole-class activities on the SMART Board™ interactive whiteboard. It helps reinforce concepts in a small-group setting and ensures students can participate in interactive and creative learning experiences."
(Cross-posted on the TechPsych and Technology-Supported Human-World Interaction blogs.)
Feb 3, 2009
New SMARTBoard Touch Recognition from SMART Technologies: The YouTube Video
Here's the plug:
"SMART's new Touch Recognition feature allows the SMART Board to recognize your touch and switch modes automatically. You can write with a pen, erase with the palm and move objects around with your finger without having to access other tools, buttons or on-screen menus."
Related
Learning Through Touch: The story behind the SMART Table pdf (Heather Ellwood, EdCompass, January 2009)
SMART Table Website
Dec 31, 2008
MULTIMEDIA, MULTITOUCH, GESTURE, AND INTERACTION RESOURCES
VIDEO
Jeff Han's Seminal 2006 TED Talk; Multi-Touch Interaction Experiments
Perceptive Pixel, Demo Reel Jan 2007 (via the Google Earth Blog)
My YouTube Playlist: Cool Technology, Interactive Multimedia, and More!
(100+ video clips are on this playlist)
Did You Know?
School Matters - The Games Children Play
BLOG ROLLS
My Blogs
TechPsych
The World Is My Interface
Interactive Multimedia Technology
Sample Blog Posts
Interactive multimedia for social skills, understanding feelings, relaxation, and coping strategies
Engaged Learning Revisited: Four video clips for reflection...
Interactive Multimedia for Science and Math
Interactive Literacy Applications and On-line Resources
Digital Storytelling, Multimodal Writing, Multiliteracies
Resources for All: Interactive Multimedia Technology and Universal Design for Learning
Dan Saffer's Book, Designing Gestural Interfaces
Interactive Touch-Screen Technology, Participatory Design, and "Getting It"
Visual Culture
Interactive whiteboards increase student attention, engagement, and test scores!
How to use Firefox to access resources offline
Online Switch-Accessible Games for Children on the BBC Website (includes screenshots and direct links)
Mega List of Resources and References (Scholarly list, updated in 2006-07, will be updated again soon - readers are welcome to contribute to the reference list.)
A Timeline of Teens and Technology
Blogs & More: Design, UX, Interactive Media, Multitouch & Gestures, Interactive Displays & Whiteboards, & Kiosks
Inventing Interactive
Innovative Interactivity
Ron George: Modern
Touch User Interface
Taha Bintahir's Blog
Multi-touch Blogs Directory
Robert Lewis Fashion Buddha
Marcin Ignac
Flash Gordon- Interactive Mediagician
Putting People First (one of my favorite blogs)
Nolan Ramseyer Peau Productions
Signal vs. Noise
Kevin Arthur: Touch Usability
NUI Group (Open-source group for natural user interface/interaction)
Harry van der Veen's Multi-Touch Blog
Seth Sandler: AudioTouch and More
Jonathan Brill's Multi-touch Maven
Joshua Blake's Deconstructing the NUI
Adam Kinney Continuum Explorer
Multitouch Barcelona
Xavier, Roger, Pol, Dani
Matt Le Grand
Stephano Baraldi: On the Tabletop
Fighterfish (Ru Zarin)
Gorkem Cetin
Multitouch (Richard Monson-Haefel)
Fiery Ferret Blog Brigger Maxwell
Sharath Patali
Edward Tse: Future of Digital Interaction
Rishi Bedi
Laurence Muller Multigesture.net
Struct: Multi-Touch Interface Research
Paul D'Intino Orion Multitouch
Jon Rose Demand Evolution
Multi-Touch South Africa
RENCI Vis Group Multi-Touch Blog
Small Surfaces
Kinetic Interface
Jim Hertz Sassexperience
Jon Hull Touch Factors
TeacherLED (On-line resources for interactive whiteboards)
Microsoft Surface Community Blog
MEX Mobile User Experience
The Web Outside
Interactive Kiosk News
KnowledgeWeave
inspireUX
Strombergs Blog
Justin Ireland
Alpay Kasal Litstudios
Mathieu Virbel Txzone
Chris Szadowski
Thomas Hansen
Dimitri Diakopoulos
Blogs: Information Visualization, Visual Communication, Data Visualization, Visual Thinking
Meryl.net
175+ Data and Information Visualization Examples and Resources
History of Visual Communication
Eager Eyes (Robert Kosara's in-depth blog about information visualization and visual communication)
Flowing Data
Information Aesthetics
Blogs: Games, Serious Games & Interactive Educational / MuseumTechnology
Learning Ecosystems (Daniel S. Christian)
Bill Mackenty: Games in Education
Gavin McLean: Interactive media, music tech, ed. tech.
Future-Making Serious Games: (Eliane Alhadeff)
In Touch (Educational Technology Resources)
Lost Garden (Interactive games approach to application development)
The Fischbowl (Staff development for 21st century technology and education)
Storytelling Memories
Ideum Blog
Papervision 3D Blog
Blogs: Assistive Technology, Universal Design, Accessibility
Assistive Technology Blog
IGDA Game Accessibility Blog
IEEE Tabletops and Interactive Surfaces 2009 (November 23-25, Banff, Canada)
IEEE Tabletops and Interactive Surfaces 2008
Bootcamp: Build Your Own Multi-Touch Surface
Bootcamp Multi-Touch Surface Guidebook (pdf)
IEEE Tabletops and Interactive Surfaces 2007
Tracermedia Interactive
Sentient City
City of Sound Blog post about the Sentient City Exhibition
Websites: Design+ Interaction+Usability Guidelines
Gerd Waloszek: Interaction Design Guide for Touch Screens
Bill Buxton: Multi-itouch Systems that I Have Known and Loved
Microsoft: Touch Interaction Design Concepts, Guidelines, and Documentation
HP TouchSmart Software Developer Guidelines 1.5
The Digital Interactive Guidelines Project
Dan Saffer: Interactive Gestures Wiki
O' Danny Boy (Dan Saffer)
Stacey Scott: Tabletop Design Considerations & Interaction Theory
Don Norman
Nielsen Norman Group
Adaptive Path
Experientia
thirteen23
UserFocus
Usability Professionals' Association
IXDA: Interaction Design Association
SIGGRAPH Interaction Tomorrow
Thinktiv "Business Visualized"
Frog Design
IDEO
Websites: Interactive Displays & Whiteboards, MultiTouch, and Gesture / Movement Interaction
Reaction Faction: New Media Artists Interaction Design
Natural User Interface: Multi-touch Solutions
Reactable Systems
Microsoft Multipoint
nTrig Hands-on Computing
lm3labs
NextWindow
TouchTable
Reactable Systems
SMARTTable
HP TouchSmart
Smart Technologies
Promethean
Microsoft Surface
Fingertapps
Canine Interactive
nSquared Surface Applications
Vectorform Multi-touch Surface
Interknowlogy Surface Applications
Identity Mine: UX & Surface Apps
Stimulant IO: Surface Apps
Perceptive Pixel (Jeff Han)
Desney Tan: Visualization and Interaction, Microsoft Research
Dance.Draw: Exquisite Interaction
Urban Screens
Media Facades Festival
Websites: Information Visualization, Visual Communication, Data Visualization, Visual Thinking
Visual Simulations (Interactive online activities)
Visual Culture Resources
Gapminder World
Jonathan Harris
Websites: Games, Serious Games & Interactive Educational Technology
EduSim3D: 3D Virtual Learning Worlds for the Interactive Whiteboard
Multimedia: From Wagner to Virtual Reality (Interactive website)
Media Literacy Clearinghouse
Professional Development To Go: SMARTBoard Lessons
DIGRA: Digital Games Research Association
Game Research: The art, business, and science of video games
Wiki Guidelines 1.0
CAST: "Teaching Every Student In the Digital Age". Interactive book and website.
Edutopia: Technology integration, engaged learning, project based learning, and more.
NCREL Bibliography: "Technology and Engaged Learning".
National Educational Technology Plan.
The Encyclopedia of Educational Technology
The Center for Teaching History with Technology
Music Tech Teacher Music Quizzes and Games
Websites: Assistive Technology, Universal Design, Accessibility
CAST: "Teaching Every Student In the Digital Age". Interactive book and website.
CAST: Universal Design for Learning
CITEd Research Center: Universal Design for Learning in a Digital Multimedia Environment
Learning with Computer Games and Simulations
Multimedia Instruction of Social Skills
Multi-User Virtual Environments for Education
Websites: Related/Misc
Citilab
David Merrill's Resources
DAN SAFFER'S LIST: Essential Interaction Design Essays and Articles (you can link directly to the articles from this list.)
Vannevar Bush, “As We May Think” (1945)
Claude Shannon, “A Mathematical Theory of Communication” (pdf) (1948)
William Hick, “On the rate of gain of information” (1952)
Ray Hyman, “Stimulus information as a determinant of reaction time” (1953)
Paul Fitts, “The information capacity of the human motor system in controlling the amplitude of movement” (pdf) (1954)
George Miller, “The magical number seven, plus or minus two: Some limits on our capacity for processing information” (pdf) (1956)
Bill Verplank, et al, “Designing the Star User Interface” (1982)
Ben Shneiderman, “Direct Manipulation: A Step Beyond Programming Languages” (1983)
Don Norman, “Affordances and Design” (1988)
Thomas Erickson, “Working with Interface Metaphors” (pdf) (1990)
Mitch Kapor, “A Software Design Manifesto” (1990)
Mark Weiser, “The Computer for the 21st Century” (1991)
Jeff Raskin, “Intuitive Equals Familiar” (1994)
Mark Weiser and John Seely Brown, “Designing Calm Technology” (1995)
Lucy Suchman, “Making Work Visible” (pdf) (1995)
Philip Johnson-Laird, “Mental Models, Deductive Reasoning, and The Brain” (pdf) (1995)
Hugh Dubberly, “Managing Complex Design Projects” (pdf) (1995)
Lauralee Alben, “At the Heart of Interaction Design” (pdf) (1996)
Don Gentner and Jakob Nielsen, “The Anti-Mac User Interface” (1996)
Bonnie Nardi, “Activity Theory and Human-Computer Interaction” (pdf) (1996)
Jared Spool, “Bridging Conceptual Gaps” (1996)
Brian Eno, “The Revenge of the Intuitive” (1999)
Shawn Barnett, “Jeff Hawkins: The man who almost single-handedly revived the handheld computer industry” (2000)
Chris Pacione, “Making Meaning” (pdf) (2000)
Richard Buchanan, “Good Design in the Digital Age” (pdf) (2000)
Robert Reimann, “So You Want to Be an Interaction Designer” (2001)
Don Norman, “Emotion and Design: Attractive Things Work Better” (2002)
Stephan Wensveen, Kees Overbeeke, and Tom Djajadiningrat, “But How, Donald, Tell Us How?: On the creation of meaning in interaction design through feedforward and inherent feedback” (pdf) (2002)
Bruce Tognazzini, “First Principles of Interaction Design” (2003)
Bill Buxton, “Performance by Design: The Role of Design in Software Product Development” (pdf) (2003)
Alan Cooper, “The Origin of Personas” (2003)
Andrei Herasimchuk, “Please Make Me Think!: Are high-tech usability priorities backwards?”(2004)
Gary Rivlin, “The Tug of the Newfangled Slot Machines” (2004)
Barry Schwartz, “The Tyranny of Choice” (pdf) (2004)
Dan Hill, “Insanely Great, Or Just Good Enough?” (2004)
Jodi Forlizzi and Katja Battarbee, “Understanding Experience in Interactive Systems” (pdf) (2004)
Paul Dourish, “What We Talk About When We Talk About Context” (pdf) (2004)
Jared Spool, “What Makes a Design Seem Intuitive?” (2005)
Anne Galloway, “Seams and scars, Or Where to look when assessing collaborative work” (pdf) (2005)
Michael Bierut, “This is My Process” (2006)
Julian Bleecker, “Why Things Matter” (2006)
Eli Blevis, “Sustainable Interaction Design: invention & disposal, renewal & reuse” (pdf) (2007)
Don Norman, “Simplicity is Highly Overrated” (2007)
James Surowiecki, “Feature Presentation” (2007)
Adam Greenfield, “On the ground running: Lessons from experience design” (2007)
Bill Buxton, “The Long Nose of Innovation” (2008)
Aaron Powers, “What Robotics Can Learn from HCI” (2008)
Don Norman, “Technology First, Needs Last” (2009)
Jonas Löwgren, “Toward an Articulation of Interaction Esthetics” (pdf) (2009)
Dan Saffer, “Controls are Choices” (2009)
BJ Fogg, “Creating Persuasive Technologies: An Eight-Step Design Process” (pdf) (2009)
Om Malik, “User Experience Matters: What Entrepreneurs Can Learn From ‘Objectified’” (2010)
Paul Seys, “11 Principles of Interaction Design Explained” (2010)
Jacob O Wobbrock, Meredith Ringel Morris, Andrew D. Wilson User-Defined Gestures for Surface Computing CHI 2009, April 4–9, 2009, Boston, Massachusetts, USA.
Resource and Research List, "Interactive Whiteboards", from the National Clearinghouse for Educational Facilities
"Speaking of Electronic Whiteboards?" Education Weekly Large Display Research Overview from Microsoft Research
"How to Be Where Your Customer Wants To Be" (pdf) Tara Prakriya
Ramblings on having privacy in public spaces "Lakshmi"
"The Trouble With Computers" Technology Quarterly
Historic/Seminal Must-Reads
As We May Think Vannevar Bush (Atlantic Monthly, July 1945)
The Computer for the 21st Century (Mark Weiser, Scientific American, 1991)
Designing Calm Technology (Mark Weiser and John Seely Brown, 12/21/95)
(Online memorial for Mark Weiser, with links to his work.)
Other Oldies but Goodies:
Computer Science Challenges for the Next 10 Years (Mark Weiser, 1996)
The World Is Not A Desktop (Mark Weiser, 1993)
Learning, Working & Playing in the Digital Age (John Seely Brown, 2000)
Fresh Flash: New Design Ideas with Flash MX (Friends of Ed)
Digital Storytelling in the Classroom: New Media Pathways to Literacy, Learning, and Creativity. Jason Ohler
Learning to Think Spatially: GIS as a support System in the K-12 Curriculum The Cambridge Guide to Multimedia Learning (Richard E. Mayer, Editor)
Multimedia: From Wagner to Virtual Reality (Randall Packer & Ken Jordan)
Virtual Reality Technology (Grigore C. Burdea & Philippe Coiffet)
Thinking Like Einstein: Returning To Our Visual Roots With The Emerging Revolution in Computer Information Visualization (Thomas G. West)
In the Mind's Eye: Visual Thinkers, Gifted People With Dyslexia and Other Learning Difficulties, Computer Images and the Ironies of Creativity (Thomas G. West)
Books: User Experience, Interaction Design, Etc.
Dr. Jan Borcher's (Annotated) Top Ten List of Books on Human-Computer Interaction:
Note: I have read many of these books and I agree that they should be required reading anyone who plans to design, develop, program, or implement anything related to technology and people.
- Alan Dix, Janet Finlay, Gregory D. Abowd, and Russell Beale: Human-Computer Interaction, 3rd ed., Prentice Hall, 2004. Currently the best, most well-rounded book I know to teach introductory HCI if you need to limit yourself to a single title. Technical enough, good breadth, not too fuzzy for a CS curriculum, very current, with a web site that includes resources such as sample programs, slides, etc.
- Ben Shneiderman and Catherine Plaisant: Designing The User Interface, 4th ed., Pearson Addison-Wesley, 2004. Best overall reference book for all areas of HCI, providing an introduction and great up-to-date pointers to most sub-fields of HCI research and practice, especially different interaction techniques. His Golden Rules of User Interface Design and sample questionnaires for user testing are very useful in an introductory class. Unfortunately, the companion web site costs money after an initial trial period.
- Donald A. Norman, The Design Of Everyday Things, Basic Books, 2002. A classic text from 1988 with an updated introduction that, while some of the technologies described or envisioned seem somewhat outdated now, still provides the best introduction to the spirit of good human-centered design. A not too technical read with hilarious stories of badly designed everyday technology, it provides some very useful basic models for human cognition, such as the Seven Stages of Action. This book also introduced the fundamental concept of affordances to HCI. Changed my view of the world of technology around me, and is probably the best initial brainwash for engineering students to "get" user-centered design.
- Jenny Preece, Yvonne Rogers, and Helen Sharp: Interaction Design, 2nd ed., Wiley, 2007. This title focuses more on the process of designing good user interfaces, and is less technical, but excellent and up-to-date in the area it addresses. The companion web site has slides, case studies, and other materials.
- Bill Moggridge, Designing Interactions, MIT Press, 2008. A truly beautiful "coffee-table style" book on interaction design, also covering product and industrial design of digital technology (Moggridge is a founder of IDEO). It has wonderful short essays about seminal digial product designs, from Engelbart's mouse, to the Mac and Palm, to Google and other internet services, as well as articles on digital product design theory. My own Sweet Sports and Baroque Technology article was based on one of the theory articles. Special treat: video interviews and chapters are available for free, on a weekly rotation, at http://www.designinginteractions.com/.
- Bill Buxton, Sketching User Experiences, Elsevier, 2007. Similar to Moggridge's book in style, this book focuses on the early stages of product design. It also includes very interesting stories of key interactive products, such as Apple's iPod. And of course it's written by one of the long-time key players in HCI. More at http://www.billbuxton.com/.
- Terry Winograd (ed.): Bringing Design to Software, Addison-Wesley, 1996. An excellent and very well edited collection of contributions from key players in HCI, from Kapor's Software Design Manifesto to Rheinfrank's Design Languages. Its particular value also comes from the profiles that link chapters and give an insider's view of how some of the most seminal UI designs came to be, from the Xerox Star to VisiCalc and HyperCard. Terry has some information about his book at http://hci.stanford.edu/bds/, and I used it with great success when I had the fortunate opportunity to teach an introductory HCI class in his program at Stanford in 2002.
- Brenda Laurel (ed.): The Art of Human-Computer Interaction, Addison-Wesley, 1990. While ancient by today's standards, this book is another carefully compiled and very coherent collection of highly relevant articles on HCI by some of the most influential people in the field. I particularly like the article by Scott Kim on interdisciplinary design, and Tom Erickson's chapter.
- Apple Computer: The Apple Software Design Guidelines, latest edition 2005. OK, I'm a Mac head, but then many HCI people are because Apple has such an excellent sense of doing the right thing when it comes to user interface design. These guidelines have been around since the 90's, with several new editions since then, and especially Part I ("Application Design Fundamentals") contains excellent, system-independent, hands-on advice for anybody developing interactive software, especially desktop applications. And it's free! Apple's developer website has the latest version both online and as downloadable PDF. I often recommend this as a quick read for engineering types that just want the bare essentials to help avoid major UI design catastrophes.
- Jef Raskin, The Humane Interface, Addison-Wesley, 2000. Similar to Norman's book above, but more recent and more technical, this is another good first read to start thinking about user interface design, written by the father of the original Apple Macintosh. Some of the ideas presented here are quite unusual, and that's intended. Some related materials, such as demos of his Zoomable User Interface and The Humane Environment are at http://www.jefraskin.com/.
For a good current PhD-level HCI reading list that is based more on papers and individual chapters than single books, see Terry Winograd's HCI reading list at Stanford University. " - Dr. Jan Borchers
Thoughts on Interaction Design (Joe Kolko)
Acting With Technology: Activity Theory and Interaction Design (Victor Kaptelinin and Bonnie A. Nardi)
The Design of Everyday Things (Donald A. Norman)
Designing Gestural Interfaces: Touch Screens and Interactive Devices (Dan Saffer)
Designing for Interaction: Creating Smart Applications and Clever Devices (Dan Saffer)
Everyware: The dawning age of ubiquitous computing (Adam Greenfield)
Sketching User Experiences: Getting the design right and the right design (Bill Buxton)
Designing Interactions (Bill Moggridge)
Leonardo's Laptop: Human Needs and the New Computer Technologies (Ben Shneiderman)
Books: Programming and Software Design
HeadFirst C#
HeadRush Ajax
PODCASTS
SmartBoard Lessons
PRESENTATION SLIDES
My slides
Slide Share: Games for Health 2008
Slide Share: Interactive Touch-Tables and Displays for Work and Leisure
WEB 2.0
Classroom 2.0
Visualization and Education Network
PHOTOS
Technology and My World (Flickr Set)
SurfaceBlog's Photostream
Internet of Surfaces: Photo Examples of Screens of All Sizes
QUOTES
Media Literacy Definitions and Quotes
TO SORT
Multi-Touch News
Stephen Randall: The Web Outside
Links: Usability design, interfaces, multi-touch, and more
OTHER BLOG ROLLS
KnowledgeWeave's Blog Roll
Andrea Resmini - Information Architect
Asomatic (Michael Arnold Mages)
Elegant Hack (Christina Wodtke)
Experientia (Nathan Shedroff)
Findability.org (Peter Morville)
InkBlurt (Andrew Hinton)
Joe Lamantia
Mauvy Russet (Richard Dalton)
Mike Madaio
Technology-Supported Human-World Interaction
Thinking and Making (Austin Govella)
UX Crank (Dan Willis)
World Wide Intertubes (John Ferrara)
TO SORT
Touch User Interface's Links!
Touch User Interface Overview
- Case history: Touching the future: Let’s warm up first. This magazine article briefs the past, present, and future of touch screen user interfaces.
- Bill Buxton: I recommend his three articles before your touch UI study.
- Human Input to Computer Systems: Theories, Techniques and Technology
- A Directory of Sources for Input Technologies
- Multi-Touch Systems that I Have Known and Loved
- See also Ken Hinckley’s Input Technologies and Techniques
- Wikipedia article about touch user interface: definitions are always important. Also, it is worth while to read articles on haptics, organic user interfaces, and tangible user interface that are closely related interaction methods of touch UI.
- A New Era for High Precision Touchscreens in "Advances in human-computer interaction"Advances in Human-Computer Interaction”, but contains fundamentals of touch screen interfaces - from hardware to software and user interface. : This is a single chapter of very old book “
- Wikipedia article on touch screens and Technology Review: Point of Sale and Self Service Kiosk Touch Screens: Touch screens are main hardware systems of touch user interfaces. Those two articles summarize various touch screen technologies.
- A Survey of Mainstream and Emerging Touch Technologies : Geoff Walker is a touch screen expert who is currently a product marketing manager at NextWindow. This presentation illustrates almost all conventional and new touch screen technologies around the world.
- Designing Gestural Interfaces: Touchscreens and Interactive Devices : The book deals with gestural interaction that encompass touch user interface and 3D gesture, and bare-hand interaction. It contains many real life and conceptual examples of gestural user interface. I bought it and love it.
Nik Baerten
Genevieve Bell
Chris Bernard
Tim Berners-Lee
Ralf Beuker
Niti Bhan
Nina Boesch
Stefana Broadbent
Tyler Brûlé
Bill Buxton
Nico Macdonald
John Maeda
Ranjit Makkuni
Ezio Manzini
Roger Martin
Stefano Marzano
Simona Maschi
Bruce Mau
Grant McCracken
Jess McMullin
Peter Merholz
Crysta Metcalf
Bill Moggridge
Peter Morville
Ulla-Maaria Mutanen


