Emerging Interactive Technologies, Emerging Interactions, and Emerging Integrated Form Factors

Every so often I come across a blog that has been around for a while, but is a new discovery to me. If you are interested in interactive multimedia and emerging technology, and you haven't heard of Richard Banks, you will probably be pleased with his vast array of interesting posts!

After browsing around Richard Bank's blogs, I found that he works for Microsoft Research. Like me, he maintains more than one blog, and he blogs about similar topics.

Here is a view into his world:

rb.trends: tracking future technology experience
rb.work: technology, design and research
rb.log: family, photography, architecture etc.

One of Richard's recent posts brought me back to my musings about interactive surfaces:

Via Richard Banks and Gizmodo: A Touch Screen Poker Table from Hard Gaming

If it is possible to program an application to handle the metrics that support poker, then it is possible to program a multi-user application for work or education, and have this application integrated into any type display, according to need.

The form factor above would be useful for team meetings or collaborative project planning, especially during group decision-making or policy planning activities that involve data analysis or information visualization.

Could this concept be modified to fit the form of a kidney table for use in education? Think about it. We could combine the best features of surface computing with the best features of multi-user video games.

Rationale? Video-game applications can handle the metrics of multi-user interaction, which would be ideal for tracking student progress and interaction. Touch interaction would enable young children with an easy way to access the application- or all of the information that will be available on the multi-touch web of the future, without learning first to type.

(Touch and gesture interaction could help us move towards the implementation of the Internet of Things)

Could this concept be transformed for use by two people collaborating on an electronic drafting table?




If you are a NUI Group member, think about this!


Note: I came up with the phrase, "multi-touch web of the future" as I was typing this post. I guess I didn't invent it - I looked it up and found Andrew Foote's post, "The Multi-Touch Web"

I'm in.


Somewhat Related.......

More for the tech-curious:

Interactive data visualization in Second Life

| View | Upload your own

Idle together "Technology blog oriented towards good design and impressive web applications"

Apple Developing Full Multi-Touch Macs - Apple Insider

More for the tech-savvy:

Multi-touch gestures in the Factor UI (Apple)- by Pestov. Includes code.

NSResponder Modifications: Swipe, Rotate, and Magnify, by Elliott Harris, a member of the NUI Group, I think.

Web Development Guidelines for iPhone (lots of good info, with video clips and code)

Web 3D Consortium

Unity 3D kit for the

Google's Android

Multi-touch Web Consortium (in my dreams)

Gesture Web Consortium (in my dreams)

Interactive web-based science and math: Link to my TechPsych post about ExploreLearning Gizmos

ExploreLearning is a website that offers a variety of engaging math and science activities, called "Gizmos", for students in grades 6-12.


ExploreLearning's Gizmos would be great on large touch-screen surfaces or displays, such as a NextWindow Human Touch, a SmartBoard, or Microsoft's Surface.

Since the activites are designed as learning modules and are web-based, the Gizmos might even work on iPhones!

Check out my TechPsych post for more information and links.

Photo courtesy of ExploreLearning.

Usabililty guidelines for touch screen or surface applications from SAP

Here is a link to usability design guidelines for touch-screen applications on the SAP design guild website, posted by Gerd Waloszek, of the Product Design Center.

Although these guidelines were written in 2000, they still hold true in 2007, especially now that larger touch-screen applications such as Microsoft Surface (Madrid) have recently been unveiled.


Touch Screen Design Guide

First attempt at a touch-screen "Poetry Picture Share" application

This was my first attempt at a "poetry picture share" application. It was designed for use on a multi-touch table and can be accessed remotely so people in different places can move things around on the screen.   The video shows how the application works on a NextWindow Human Touch interactive large-screen display.

Version 2 will be posted soon. I am planning on adapting this application for use with students with special needs, such as those who have autism or other communication disorders.

Google Earth with photo overlays on a touch screen 2

Here is another demo videoclip of a globe created in GoogleEarth using photo-overlays, with links to video clips uploaded to YouTube and embedded in individual posts on a blog. The above photo and the video clip show the application on a NextWindow Human Touch large-screen display.

This application would be great on a touch-table or touch-table set up on a drafting board. Although it was designed for a travel-planning application, it would work well in educational settings in subjects such as geography.

NextWindow Human Touch Interactive display using photo overlays on Google Earth

This application was part of a travel-planning prototype developed for a course in Human-Computer Interaction.   The application was demonstrated on a NextWindow Human Touch large screen display.

Would it work on the iPhone?

Multimedia: Interactive touch-tables and large displays

This semester I'm taking a class in Human Computer Interaction and another class called "Ubiquitous Computing". I'm working on two projects that involve the use of interactive touch-screen displays. One is for travel-planning, and the other is for games that are located in social gathering places.

I've come across lots of interesting applications during the course of my research that I'd like to share on this blog. (Check back for more information!)

Right now, my dream is to get my hands on an interactive touch table that has multi-touch capability. The table needs to be wi-fi enabled, with an adjustable surface so that it can function horizantally, vertically, or in any position in between, like a drafting table.

Here is the "Multi-Touch Interaction Experiments" video demo of Jeff Han's work with a multi-touch interactive table/screen. I know this was included in an earlier post, but if you haven't seen it, you have to take a look!




Here is a link to Jeff Han's multi-touch wall, his latest work.

Stefano Baraldi's blog, "onthetabletop" is a good resource for people interested in interactive tables. He has a link to the recent Classroom of the Future conference, which focuses on collaborative learning spaces.

Here is one of Stefano Baraldi's demo videos:

Concept Matching



Working with photographs:



Here are more links about the use of interactive tables:

Interactive Tables: Supporting Collaborative Casual Learning

SIDES: A Cooperative Tabletop Computer Game for Social Skills Development


SIDES is a game that was designed for use on a MERL DiamondTouch tabletop. The researchers studied the use of social skills games for middle school students who have Asperger Syndrome.