How soon will we see interactive information visualization for multi-touch & gesture systems?

The field of information visualization is growing. Until recently, most visualizations were created for use on a single PC or larger screen, allowing for interaction by only one user at a time. I have a feeling that this will be changing in the very near future.

Why? Interactive duo and multi-touch interfaces are becoming more common, and now come in all sizes of screens, from the iPhone, the Surface, and CNN's multi-touch "Magic Wall". People of all ages play interactive games on the Wii, often on large flat-panel displays. In my opinion, the time is right for those developing applications for the InfoViz world to think about harnessing the power of multi-touch.

Below is a picture of the front page of the Visual Complexity website. If you go to the site, you can select a visualization, and then explore it more in detail, as each picture links to a web-page that provides background information about the visualization project, the artist or team behind the project, and links to the project's website.

I took a look at a variety of the examples posted on the Information Complexity website, and think many would be enhanced by a transformation to a multi-touch, gesture, bi-manual, or duo/multi user system. I'm interested in learning what others think about this. If you are working on a collaborative information visualization project, feel free to add a comment and post a link.

Here is a a nice quote from the website:

"Functional visualizations are more than innovative statistical analyses and computational algorithms. They must make sense to the user and require a visual language system that uses colour, shape, line, hierarchy and composition to communicate clearly and appropriately, much like the alphabetic and character-based languages used worldwide between humans." Matt Woolman Digital Information Graphics

Update: I did a search for "multi-touch" on the Visual Complexity website and found a couple of interactive applications:

Reactable (I've posted about this system a few times!)
(Reactable website)

Prototouch

(Wirmachenbunt Website)

SMART Table in the Classroom: Tom Barret's Journey

Tom Barret is a teacher who is using a SMART Table in his classroom. His recent post, "SMART Table in my classroom- Days 2-5: Teething Problems" provides some insight about potential problems teachers might face when introducing this sort of technology to students.

(Tom blogs about educational technology, including topics such as "Using the Nintendo Wii to Support My Numeracy Lesson")

Here are Tom's first-glance comments about the SMART Table:

"A couple of things that I have learned already:

There is a long way to go in terms of the toolkit and software development"

"The table is very robust."

"There is a place in the primary classroom for this type of technology, it feels natural to have this style of technology in my classroom. "

"My instincts tell me their is a future in this style of work for kids."

"Multi-touch and the behind the scenes technology that is needed to operate it, can be very temperamental."

"Children take to the medium very easily and naturally."

"They can be networked"

"3rd party software can run on them but you would lose the 40 touch capability"

"For 9 and 10 year olds (upper junior), the optimum number for using the Table is 4. Any more and it gets a little congested, limiting the screen real estate that you can use. This is crucial, you might be able to get 6 Year 5s around it but they will not get significant enough access to the surface and so the learning activity. "

From the NUITEQ (Natural User Interface) Gallery, via Harry van der Veen

Kids take to multi-touch interaction naturally!

The following photos are from Harry van der Veen's Multi-touch blog. (Harry was one of the founding members of the NUI-Group, and also is the CEO of NUITEQ-Natural User Interface)

The last two pictures are of the HP TouchSmart running NUI Suite Snowflake software, developed by the Natural User Interface Europe AB (NUITEQ) for think LCD, Plasma, and FT displays.

Dell Studio One 19 Touch Zone App by Fingertapps: The Video

Here is the video demonstration of Dell Studio One 19 Touch Zone, developed by Fingertapps, a New Zealand software company:



The Dell Studio One with Fingertapp's multi-touch natural user interface software is due for launch soon, according to Ben Wilde and Dave Brebner, of Fingertapps. Here is a link to a recent Engadget article by Paul Miller: Dell demos multitouch on the Studio One 29 (with additional videos)

NUI-Group's Christian Moore Interview-Podcast on the Interactive Display 2009 Conference website

As I write this post, the 2009 Interactive Displays conference is underway in San Jose, California. The home page of the conference website provides a series of interviews of many of the conference participants and presenters, including Chris Moore, a member of the NUI group. Chris discusses the importance of the open-source NUI (natural user interface) community in moving interactive display and NUI-based technology forward.

Interactive Displays 2009 Conference Website

Interview Participants:
Mats Johansson - EON Reality
Guillaume Largillier - Stantum
Christian Moore- NUI Group
Brent Bushnell- Tapcode
Steven Bathiche - Microsoft
Jerry Bertrand - Microscent
Henry Kaufman- Tactable

If you are at the conference and you have some video clips to share of a presentation, demonstration, or anything else that might be of interest, please give me the link so I can share it on my blog.

Below are some pictures from the companies represented by the people who were interviewed for the Interactive Displays 2009 conference:


Eon Reality


Tactable


Microsoft's Surface


NUI-Group


Tapcode


I don't usually put company logos on my blog, but if you are a visiting my blog searching for links to companies that are involved with interactive display technologies, this will save you some time. (I received no payment for this gesture.)

Pervasive Checkers on Microsoft's Surface: The Gamepack Video

In early 2007, before we knew of the existence of Microsoft's multi-touch surface, I worked on a "Pervasive Checkers" project with Johnny Hopkins, a classmate in my Ubiquitous Computing class. I'd previously worked with XNA Game Studio Express in an AI for Games class, and thought that it would be cool to make a casual checkers game on a multi-touch table that could be played in gathering spots such as coffee houses and neighborhood cafes.

Below is a screen shot of what we created using Inspiration software - (in the application, you can click on an item and it expands to reveal additional information.)

Two years later, and the Pervasive Checkers idea is reality - but I wasn't involved in the process. Checkers is one of the games that is included in a game-pack created specifically for the Surface.

Take a look at the video:



From Surface Computer News:

"The Microsoft Surface Games Pack is a clear illustration of where the Natural User Interface of Windows 7 has the potential to take games. Windows is traditionally the number 1 gaming platform around the world. With the introduction of the NUI, allowing players to literally have titles at their fingertips via touch, Windows 7 can kick the gaming experience up a notch. Provided that developers rise up to the challenge."