Update! The Post-WIMP Conversation: Some Thoughts About Conceptualizing NUI, Part I

The content of this post has been moved. For the most recent update of this post, please see:


The Post-WIMP Explorers Club:  Update of the Updates, Morning of 12/31/09

DYI multi-touch...

If you follow this blog, you know I like to share what people are doing with multi-touch and related natural user interfaces/interaction. In this post, I'd like to share an article about two students who decided to build and market a multi-touch table- the article below explains the story in-depth, and video shows the nuts and bolts.


Enterprising roomates build multi-touch LCD, market their business to West Coast*
Walter Valencia, Collegiate Times 12/1/09

According to the above article, Aaron Bitler and Brady Simpson they were inspired by CNN's Magic Wall during the 2008 election.  Bitler and Simpson learned more about natural user interface/interaction during a presentation in a business class that featured a video about the Microsoft Surface table and natural user interface technologies.  They formed a company, 3M8,  to build and market mutli-touch display/tables.

Vision x32 from Aaron Bitler on Vimeo.

From what I can tell, it looks like Bitler and Simpson relied on the DYI information and support from the NUI-group website to carry out their ideas. Bitler and Simpson met with representatives of 22Miles, a company located in San Jose that provides interactive solutions, including multi-touch, for web, mobile, and touch screen implementations.

I'll post more about 22Miles in an upcoming post.

Until then, take a look at 22Miles' promo video, featuring a huge 3D interactive multi-touch heart:

UPDATED: More News, Videos, and Links about Multi-touch and Screen Technologies

UPDATED
More news about multi-touch and screen technologies!

"Holographic" Multitouch   (Eatang Digital Technology)

Holographic muitltouch from eggwong on Vimeo
Eggwong's company is Eatang Digital Technology.  Although most of the website is in Chinese, it looks like it provides interactive design services as well as software kits.


How to Build a 20" Multiitouch Screen in Three Weeks (Ben Unsworth - Globalcore)

How to Build a 20' Multitouch Screen in 3 Weeks from Ben Unsworth on Vimeo.


Globacore
Globacore used four 72" Blue Ocean Low Gain Screens 16:9 to create their twenty-foot multi-touch wall, which I think was also used for the "holographic" screen in the first video. The tracker and base flash API from the NUI-group were used in this system.
I wasn't sure if I'd heard about Blue Ocean screens.  Much to my surprise, the company behind Blue Ocean is Nippura, located in Japan.  Nippura has another office in Charlotte, N.C.
For years,  Nippura's core business has been focused on creating "the world's largest acrylic panels, tunnels, cylinders and spheres for the professional aquarium industry", but is also focused on screen systems as well.

US Nippura/Blue Ocean Projection Screens
Blue Ocean screens were use in the second videos of this post.  Below is some information the screens from the company's website:
"Blue Ocean® Projection Screens are the first ever to cast the screen into a hi-tolerance viewing plane centered between two ultra-clear panels of cell-cast acrylic, the same type of material used in hi-optic fighter jet canopies and the world’s largest aquariums. Blue Ocean® Projection Screens also offer something never before found in screens: self-rigidity.  The thickness of each screen can be fabricated so that it maintains its form without external frames or tension systems. Frameless high definition projected images without borders amplify the infinite depth viewing experience.  Because of its durability, outdoor applications of entertainment around the garden and pool are also possible. Normal wear and tear scratching has no long-term effect on the screens’ performance, and a ten year old screen, simply re-polished, will literally look and perform exactly as it did the day it left the factory."
Super High Definition Stereo Image using 4K Projection Systems (pdf)
Tetsuro Ogi, Hiroaki Daigo, So Sato, Yoshisuke Tateyama, Yasuaki Nishida, International Conference on Artificial Reality and Telexistence 2008

NUITEQ 
NUITEQ offers single and duo-touch plugins for Snowflake Suite that enables the software to run on NEXIO and NextWindow screens, including NextWindow's screens that are integrated in the HP TouchSmart and Dell Inspiron all-in-one PC's and others.  SnowFlake Suite is also compatable with 3M Touch Systems, N-Trig, and Lumino.  You can view the SnowFlake Suite application in action on NUITEQ's YouTube channel.
"NUITEQ's software product Snowflake Suite, which received a Stevie Awards finalist recognition for Best New Product or Service of the Year 2009 - Media & Entertainment, is available to end clients, software developers, system integrators, VAR's and OEM's. Snowflake operates on a wide variety of hardware technology platforms including rear camera based solutions, IR overlay systems, bending wave, surface acoustic wave (SAW), projected and surface capacitive, resistive and other touch technologies for small hand held mobile devices and larger scale interactive displays."
Recent news: NUITEQ Assists LTU Skelleftea at SACO event with new educational multi-touch desk


FingerTapps
Software platform for multi-touch solutions:
Video:  FingerTapps on the Dell Inspiron 19
Dell Studio One 19:  All-in-One Stunner Takes Japan
FingerTapps collaborated with DigitalDM Digital Publishing to support interactive media panels (IMAS) for use in retail settings, as well as digital print publishing.  


NextWindow and All-In-One PC's:
NextWindow, the company that made the large single-touch display I used for a couple of class projects nearly three years ago, has really grown over the past few years.  NextWindow provides optical touch screens for the HP TouchSmart PC, and also for the Dell Inspiron Studio One All-In-One PC, and the Dell Sx2210T desktop monitor.   The next Dell with a NextWindow touch screen will be the Inspirion One 19, an all-in-one PC.   You can find NextWindow touch screens in the Medion X9613, the NEC ValueStar W, and the Sony L Series.  (NextWindow has Windows 7 certification for touch screens)

STANTUM and GUNZE USA
Stantum has partnered with Gunze USA, a manufacturer of resistive touch-panels, to co-design and deliver multi-touch products.  "Gunze USA will provide these custom multi-touch modules to the North American market for use in industrial, automotive, defense, aerospace, medical, kiosk/point-of-sales, and other professional applications. Unlike capacitive multi-touch, Stantum’s technology is particularly well suited to these professional markets, thanks to its:

• immunity to EMI issues, via easy coexistence with Wi-Fi or Bluetooth antennas around the screen;
• stylus input and high precision, enabling handwriting recognition; and
• ability to work flawlessly with gloves."

According to the press release, Stantum's multi-touch technologies provide advantages such as handling 10 or more touches at a time, finger and stylus input, finger-pressure consumption, and native Windows 7 support, with no need for a driver. Developers can order the "beta" version of the Slate PC, based on the Dell Inspiron Mini netbook platform, from the Stantum website. 


GESTURETEK
The video below is of an interactive 3D application created for the Gondwana Das Praehistorium in Schiffweler, Germany, and provides an simulation of what it might be like to be a flying ancient pterosaur of giant dragonfly.  Two gamers can play at the same time.  If you want to fly, you flap your arms, and navigate by leaning. You crouch to dive, and increase your speed by flapping your arms even faster:
GestureTek's 3D Interactive Flying and Virtual Game Experience for Gonwana Museum

This company always has something going on that looks fun and interactive.  To get an idea this company's interactive work, take a look at the information on the GestureTek website links below. GestureTek has a variety product videos on the website.


GestureTek Health
GestureTek Mobile Gaming
GestureTek mobile gaming videos
GestureTek Product Summary
GestureTek in Science Centers, Aquariums, Zoos, and Visitor Centers


Lm3Labs

Toshiba equip with Ubiq'window and Catchyoo

Lm3Labs' videos on Vimeo 

Lm3Labs' Ubiquwindow TV videos
Lm3labs Blog

View more documents from LM3LABS.

Lm3labs Air Strike Overview (Slideshare)


SNIBBE INTERACTIVE
Snibbe Interactive was founded by Scott Snibbe to develop social immersive media as a communication medium that incorporates the language of cinema and engages participation and interaction with others (and technology) through unencumbered body movements.  



Get in the Action Prototype

Get in the Action Prototype - Snibbe Interactive from Oriol Ferrer Mesià on Vimeo.




Scott Snibbe's Social Immersive Media presentation at Stanford's Seminar on People, Computers and Design, 5/2009

'Scott Snibbe of Sona Research discusses a distinct form of augmented reality focused on social interaction: social immersive media. He discusses design principles and interaction techniques to create strong emotional responses and social engagement through visceral interaction. He also describes approaches to clearly communicate cultural and scientific ideas through the medium, and how to promote specific distinct social behavior in uses." -YouTube description


RELATED
Globacore  "Globacore was founded by Ben Unsworth and Jeff Williams out of a passion for technology, art, and business. Globacore began as a web hosting and development company supporting the the technical needs of sports apparel startup VC Ultimate and it's associated companies."

"Globacore Inc. was officially incorporated in April 2003. In 2007 Ben and Jeff were joined by programmer Kyle Davis and graphic designer (and trail biker) Matt Venhuizen. In 2008, the Flexmaster Lukasz Ruminski joined us and continues to be a huge member of our team.Update: We'd like to welcome our newest team member: Developer Dave Rapin!"

Globacore Interactive Technologies
67 Mowat Ave. Suite 431
Toronto, ON
M6K 3E3
Phone: + 1 (416) 925-2082
Tollfree: + 1 (888) 309-7658
Fax: + 1 (647) 477-3270 
General Email: info@globacore.com


BLUE OCEAN/NIPPURA

Blue Ocean/ Nippura US Website
Blue Ocean Product Information (pdf)
3611 Tryclan Dr.
Charlotte, NC  28217
Phone: 704-561-9191
Web: www.usnippura.com



NEXTWINDOW
NextWindow's Touch Technologies Overview
Optical Touch and All-In-One PC's
News Release:  NextWindow Patents (pdf)

Contact: David Villarina, NextWindow

+1 (925) 272-4530
dvillarina@nextwindow.com

NUITEQ
Natural User Interface Technologies AB(Headquarters)
Laboratorgränd 7
93162 Skellefteå
Sweden

Phone: +46 702865975
Fax: +46 851989240
mail@nuiteq.com

3M Touch Systems US
3M's Touch Topics information site
Multi-touch@mmm.com
 
Natural User Interface Asia Pte Ltd (Asia office)
12 Little Road
#06-01 Lian Cheong Industrial Building
Singapore 536986
Phone: +65 6748 5245
Fax: +65 6748 7961

FINGERTAPPS
Contact: James Bell-Booth
james[at]fingertapps.com
+64 21 226 6399
www.fingertapps.com/


STANTUM
Slate PC Proof of Concept Datasheet (pdf)
Contact: Francois Jeanneau
Sales and Business Development
Director, Stantum North America
Berkeley, CA, USA
Cell: +1 (510) 928 56 17
f.jeanneau@stantum.com

GUNZE USA
Product Overview
Contact:Gunze Electronics USA
2113 Wells Branch Parkway, #5400
Austin, Texas 78728
Tel: 512-990-3400 Fax: 512-252-1181

LM3LABS
Website: http://lm3labs.com/ENG/index_eng.html
info@lm3labs.com
Europe:
Antipolis Innovation Campus
300, route des Cretes
06560 Sophia-Antipolis France
Hong Kong, China
+852-8198.8406
Australia
+61(02)8011.3342
USA: +1(646)461.6146
TGarden Square 409
3-5-26 Funabori
Edogawa-ku
134-0091 Tokyo, Japan
+81(0)3.3877.0779


SNIBBE INTERACTIVE
1073 Howard Street
San Francisco, CA 94103
+1 415 822 1442
sales@snibbeinteractive.com
Snibbe Interactive Blog
2010 Interactive Catalog (pdf)
HOLDING TANK
Peau Productions
Diffusers and Projection Screens Comparison Site
(Provides photos and video of various screens and diffusers used for optical-based multi-touch systems.)


NUI-Group
Wiki: Comparison of rear projection films
Forum Thread

Outdoor Media Company (China)
Products
Contact: Kuo Lin  (?)
 
42x46 Multi-touch LCD Display

HIWAD TOUCH - Beijing Yhjn Science and Technology Co. LTD



Interactive Sandbox 

"An interactive sand box or sand table for use in tactical training includes an automated control system and image generator so that infinitely variable visual images may be projected onto the contoured surface of the sand for training and preparation for action in the military field and disaster control, industrial planning, environmental protection, and similar situation."


Interactive Holographic Touch Screen



Beijing Yihejianing Science and Technology Co., Ltd
Address: Room 621, Jinyuan Modern shopping Mall, NO.1 Yuanda Road, Haidian District, Beijing, China
TE:8610-88892897，88892895
FAX:8610-88892867-801
Email: hxrong2001@hotmail.com
http://www.cnhci.cn

Johannes Schoening & Friends Research: Videos of Multi-User Interaction on Multi-touch Walls and Tables

In this post, I'm featuring videos of the interactive work of Johannes Schoening, a member of the NUI-Group, and his collaborators. Johhannes works at the Innovative Retail Laboratory of the German Research Centre for Artificial Intelligence ( DFKI ) in Saarbrücken. Prof. Dr. Antonio Krüger is director of this lab.   He also works with Michael Rohs at the Deutsche Telekom Laboratories in Berlin. 

Johannes received a Diploma in Geoinformatik at the University of Münster at the Institute for Geoinformatics in 2007.  His research interests are new methods and interfaces to intuitive navigate through spatial information or in general new intelligent interfaces that help people to solve daily tasks more effectively.  His interests include mobile augmented reality applications, the use of Wikipedia as a knowledge database, and home grown multi-touch surfaces . (More information can be found on Johannes' website.)

Note:  The 2010 Interactive Tabletops and Surfaces conference will be held in Germany, and Johannes and others will be involved with running it. You can follow the news on Twitter:  http://twitter.com/its_Germany2010.  The link to the conference website will be up soon, at http://www.its2010.org/ .

The descriptions below each video are from Johannes' YouTube Research Channel.

Multi-touch Risk

"A multi-touch and multi-user version of the classical Risk game. As a platform Nasa World Wind (WWJ) and the Java implementation of Risk "Domination" by yura.net were used. A authentication method (that was also integrated in the game) can be found in the last (next)  video. Thanks to Klaus Drerup & Wadim Hamm."  TEAM:  Klaus Drerup, Wadim Hamm, Florian Daiber, & Johannes Schoening.  Music by cycom: mathematics.

User Authentication on Large Multi-touch Wall with Mobile Device

"The exploitation of finger and hand tracking technology based on infrared light, such as FTIR, Diffused Illumina- tion (DI) or Diffused Surface Illumination (DSI) has enabled the construction of large-scale, low-cost, interactive multi-touch surfaces. In this context, access and security problems arise if larger teams operate these surfaces with different access rights. The team members might have several levels of authority or specific roles, which determine what functions and objects they are allowed to access via the multi-touch surface. In this video we present first concepts and strategies to authenticate with a large-scale multi-touch wall using a mobile device."

GeoLens: Allowing Multi-User Interaction with Geographic Information Systems on Interactive Surfaces

"This video shows the GlobalData application in use on an Archimedes SessionDesk http://www.archimedes-products.com/se The application was used to illustrate our GeoLens concept. GeoLenses are GUI widgets that can be used like scalable as well as zoomable magnifying lenses to allow synchronous multi-user interaction in GIS systems."

Interactive Video Art in Action: MuchoWall from Tangible Display (and Jimmy Hertz)

 

Photo of MuchoWall, an 80" multimodal sensitive wall from Tangible Displays (Jimmy Hertz, Founder)

Jimmy Hertz is a member of the NUI-Group and has been involved in various activities to spread the world about natural-user interfaces and interaction.



Be sure to watch the entire video. It is almost like watching a dance performance when you watch artist interact with the display.


Thanks, Seth Sandler, for the the link!

Interactive multi-touch for sound design, dj-ing, and music creation

NUI-Group member Christian Bannister, a musician, designer, and developer behind Subcycle Labs has been experimenting with music and multi-touch technology and interactions. Here's a demonstration of what he's come up with so far:


multi-touch the storm - interactive sound visuals - subcycle labs from christian bannister on Vimeo.
.
"The big picture goal of this project is to bridge the gap between sound visualization and musical instrument. With multi-touch interaction it is possible to manipulate multiple characteristics of a sound—directly and visually. Right now a lot of electronic music involves staring at the back of the performers laptop. This is a shame because in many cases a lot of really interesting things are happening on the computer that the audience is completely unaware of. This project hopes to create a common visual language and experience for the electronic musician and the audience by enhancing the perception of sound and music on both sides...These sketches are built with Processing and Max/MSP networked with OSC on a single computer..." -Christian Bannister



JazzMutant Lemur
The multi-touch tech company now known as Stantum evolved from JazzMutant, Jazzmutant was founded in 2002 by Guilluame Largillier and Pascal Joguet, and joined by Julien Olivier in 2003. The original focus was to create a multi-touch controller for music applications, and the Lemur was born. It is now in version 2, with features such as a gesture object that provides three ways for people to interact with sound, extended scripting abilities, and remote control of your computer's mouse cursor or keyboard.  Stantum recently developed a next-gen multi-touch screen system for use in mobile devices such as smart phones and netbooks.  (I'll discuss this further in a future post.)



Mapping Ableton Live to Jazz Mutant's multi-touch Lemur for sound design:


Additional tutorials can be found the Jazzmutant YouTube channel.


Ableton Live, the software used in the above video, will include Max. Max/MSP is now known as MAX 5:
"In use for over twenty years by performers, composers, artists, scientists, teachers, and students, Max is the way to make your computer do things that reflect your individual ideas and dreams. Version 5 is a dramatic transformation of Max that begins a new chapter in the program's history."

RELATED
Video:  Max for Live
Max is a product of cycling74
Cycling74 created the Make Controller Kit, which includes fully programmable controllers. The kit is networked based. It is capable of working with actuators and can read sensor information into Max.
Jamoma, a platform for interactive art-based research and performance. Jamoma is the prototyping environment for SpatDIF, the Spatial Sound Description Interchange Format, and GDIF, the Gesture Description Interchange Format.
GDIF: Gesture Description Interchange Format, a tool for music related movements, actions, and gestures 
Stantum's Mobile Phone Multi-touch Interface:  Demonstration of precise interactions on a resistive touch screen

How the Stantum's Resistive Multi-Touch Screen Works

Thomas Hansen's Multi-Touch Wisdom: "Windows Touch vs PyMT - Why programming on Windows is too complicated!"

If you are interested in designing or programming multi-touch programs and like elegant, concise code, you'll appreciate Thomas Hansen's recent blog post:


Windows Touch vs PyMT:  Why multi-touch programming on Windows is too complicated!


Here is an excerpt from Thomas Hansen's blog post:


"If you read the rest of the blog post, I’ll show you what I mean about context, and why e.g.  Windows Touch makes life difficult if you want to program multi-touch.  I’ll show you how to rewrite a windows touch example project (5 C# source files and > 400 lines of code) in Python using PyMT (1 source file with 12 lines of code).  Yes 12 lines, you read correctly (and then there is the whole thing about it just running on Linux or OSX as well…but we’ll leave that for another blog post)."


At the end of his post, Thomas makes a comment that I think is worth considering:


"The interaction paradigm is so revolutionary, I think we need to adopt our development tools more to it and explore the interaction space.  Instead I think people are jumping the gun on trying to standardize the interface while using the development paradigms we used for the GUI."


Well said!


Thomas Hanson is a member of the NUI Group.  He is a graduate student at the University of Iowa, pursuing his PhD in Computer Science, specifically Human Computer Interaction.  

Interactive Motion Graphics Showreel from Filmview Services - great content!

Here is a showreel from Filmview Services that simulates how tech-usability in an interactive gesture/touch world should be!



Here is a quote from the Filmview Services blog:


What Are Screen Graphics?

"...So it works out more cost effective for the films to actually have someone put the graphics on the screens for real. It also greatly enhances the performance of the actors. You only have to watch any of the Star Wars Eps 1-3 to see how wooden acting is when you don’t actually know what is in front of you. Actors love to be able push buttons and bang touch screens during their scenes. Having to actually do it in a certain order can stretch their capabilities mind you, and I am pretty gob smacked at how absolutely computer illiterate some of them are. Don’t they use email?


Anyway, due to this diminished ability to hit and bang things in any certain order, it is our job to make it impossible to mess things up. That’s why they are all genius typers. We make it so they can type any old thing and the letters still come out the way they are meant to each time. We also put little locking codes into our programming so they can’t accidentally escape the graphic mid job. It’s amazing how many of them can type the Esc button when they are meant to be spelling LOGIN."

Thanks, Tim!

SOMEWHAT RELATED
Coincidentally,  when I was visiting the NUI-Group forums this morning, I came across a link to Jakob Nielsen's "Usability in the Movies -- Top 10 Bloopers", which are worth taking a look at. I've posted the list, but you'll need to go to Nielson's web page to read the descriptions. You'll smile.

1. The Hero Can Immediately Use Any UI
2. Time Travelers Can Use Current Designs
3. The 3D UI
4. Integration is Easy, Data Interoperates
5. Access Denied/Access Granted
6. Big Fonts
7. Star Trek's Talking Computer
8. Remote Manipulators (Waldo Controls)
9. You've Got Mail is Always Good News
10."This is Unix, It's Easy"

Applications for touch, multi-touch, and gesture interaction: What's Marching to Market?

Every week or so, I hear about a new multi-touch enabled laptop.Today, I came across a review on Gizmodo about the Lenovo ThinkPad T400, which is a 14.1 capacitive touchscreen laptop that can handle four touches at once:

Lenovo ThinkPad T400s with Multitouch Review: Finger Flicking Fun


The Multitouch ThinkPad in Action

Lenovo ThinkPad T400s with Multitouch from Gizmodo on Vimeo.

SCREENSHOT
 
"The screen is pure beauty. Like a capacitive touchscreen phone, light taps on the display are responsive and you don't have to think about positioning your finger in a certain way to open apps or rearrange windows." - Joanna Stern, Gizmodo, 9/15/09


OTHER EXAMPLES
 
THE FUJITSU LIFEBOOK T5010

Add the Fujitsu LifeBook t5010 to the Windows 7 Multitouch Laptop List
Gizmodo, Joanna Stern, 9/15/09



DELL LATITUDE XT2
 

 












TOUCH DEMO- HP TOUCHSMART TX2 & WINDOWS 7


AIR HOCKEY FOR WINDOWS 7: IDENTITY MINE


FINGERTAPPS





Want to create something multi-touch?

It looks like there will be a growing need for Windows 7 application developers.  Here's some code examples using Windows Presentation Foundation and the Windows 7 Multitouch API

Windows 7 Multitouch Application Development, Part I (The Code Project: Kunal Chowdhury)


Other Developer Resources

Touchlib Multi-touch Development Kit  (NUI GROUP)

MSDN Windows Touch: Developer Resources

nTrig's Multi-Touch Download for Windows 7

NUITech's Snowflake Suite for NextWindow

TouchKit Multi-touch Development Kit


GestureWorks Flash Multitouch SDK

3M Multi-touch Developer Kit


RELATED
Touch-less Interaction from lm3labs

Create the future you want. with ubiq'window from Nicolas Loeillot on Vimeo.

More about gesture interaction and multi-touch can be found on this blog- do a search!

Ron George's Interaction Design Toolbox

Ron George, an interaction designer, recently posted a comment on my blog. So I visited his blog and found that he has a great set of resources that many of my readers would appreciate!

For starters, take a look at Ron's Interaction Design Toolbox page, and then spend some time browsing around the rest of his site/blog.

Ron works at Microsoft on a team that is exploring Natural User Interface/Interaction (NUI). He previously was on the Surface team.

MICROSOFT: ARE YOU LISTENING? Cool Cat Teacher (Vicki Davis) Tests Out Microsoft's Multi-touch Surface Table

When Microsoft unveiled the Surface in 2007, I was disappointed that there were no immediate plans to market it for use in education. At the time, there were no immediate plans to release the Surface for research and development by university students. I had just completed a course in human-computer interaction, and with my background as a school psychologist, I KNEW this sort of technology would work well in education.

My head was brimming with ideas for this innovative technology for use with the students I work with every day.

The following video shows a demonstration of Microsoft's multi-touch, multi-user Surface table at the 2009 NECC conference, and also provides insightful comments from Vicki Davis, author of the very popular Cool Cat Teacher blog. Vicki discusses the value of surface/tabletop computing in education and shares her views about the need for user involvement in the educational software development process. She also gives great advice about how Microsoft or other developers of tabletop computing systems should proceed.

I agree with Vicky's comments, 100%, as my regular blog readers know!

MICROSOFT, ARE YOU LISTENING?



In the above video, it is apparent that the musical instrument applications do not provide a good touch response on the Surface. Vicki suggests that touch responsiveness is key, and that all Surface applications should be held to the high standard of Apple's iPhone and iPod Touch. Vicky goes on to say that Microsoft should support easy development of applications, and ensure that applications are very user-friendly and easy for school folks to install. If you work in a K-12 setting, you know what I am talking about ; )

Vicky is preaching to the choir when she stresses that Microsoft R&D (and others) should involve users in ongoing development, in a meaningful way, by using REAL people, REAL teachers, people who work with students. If you have ever battled with a "lame" educational application, you know why this is so very important!

Vicky's enthusiasm for the use of tabletop/surface computing in education can not be ignored. She absolutely knows what she is talking about, and she is the instructional technology voice for a multitude of educators around the world.

Here is Vicky's plea:

"I wish Microsoft would listen to these 3 things from a teacher in a classroom (me). I know Microsoft has bigger things to do than watch this video, but, I can dream, can't I?"

(I've paraphrased the following quotes.)

1. Understand the amazing potential for Surface devices in education. Look at three to five years out. You are looking at the future.

(This technology can engage students who have ADHD, etc.)

2. Harness the power of your users! Pull in your users. There are so many people in education would give their thoughts for free!

3. Create virtual and online ways for Microsoft to interact with teachers.


"If Microsoft decides to invest in this, and I do hope that somebody watching this video will understand the importance of integrating the world around us into the learning experiences and the learning environment, as part as how we remake and re-do education."

My sentiments exactly!

A few thoughts:

So where are we now?

Smart Technologies has come out with the SMARTTable, but it was designed for younger students. At this point, there are very few options, especially affordable options, for educators of students in the upper grades to use this technology.

Some members of the NUI-group are involved in creating educational applications for table-top systems, but they are few in number.

A few companies are using this technology for education, but the applications are mostly limited to interactive museum exhibitions.

From my research on this topic, there are very few developers that have the interest or the inclination to create educational applications for table-top computing.

My hope is that this will change soon! Join me in this conversation.

Human Media Lab's Organic User Interfaces and Interactive Sphere

The following video is of an interactive sphere prototype created by Josh Marble and John Bolton (members of NUI Group), from Human Media Lab at Queens University in Canada:

"DYI Multi-Touch Spherical Display"


I shared some information about the Human Media Lab's emerging technology in a previous post,
My Summer Emerging Technology "Wish to Play" List. Here is some more information about the lab:

"The Human Media Lab is Canada's premier media laboratory. Its mandate is to develop disruptive technologies and new ways of working with computers that are viable 10 to 20 years from now. We are currently working on the design of Organic User Interfaces (Oui!), an exciting new paradigm that allows computers to have any shape or form."

I would love to visit this lab. Perhaps they are working on flexible haptic interfaces, or other stuff of dreams.

(I'm on a cruise ship with limited Internet access, so I'll post more when I have the opportunity!)

Information about Touch Screens, Multi-Touch, & Gesture Interaction is Spreading

Since the news about Windows 7 multi-touch capabilities has spread around, I haven't had enough time to keep up all of information related to multi-touch interaction. Fortunately there are a few bloggers out there who are doing a great job filling in the gaps.

The Touch User Interface blog has a wealth of information in the form of pictures, video clips, slides, and links that I'd like to share.

The following slideshow/videos were highlighted in the Touch User Interface blog post, "Touch UI: HCI Viewpoint":

Untold Stories of Touch, Gesture, & NUI
Joe Fletcher, Design Manager, Microsoft Surface

Touch and Gesture Computing, What You Haven't Heard
Dan Saffer

Tap is the New Click

Other posts of interest on the Touch User Interface blog:
Touch screens and vision impairment
Link: Designing the Palm Pre: An Interview with Michelle Koh

Touch User Interface Overview

I've updated some additional information about UX,interactive multimedia, multi-touch, and gesture interaction on my Multimedia and Interaction Resources page, which is a work in progress.