More Multi-touch and Gesture-based Natural User Interfaces: Bamboo Wacom Tablet; Multi-touch PresTop Kiosk and Snowflake Suite software

Wacom Tablets Get Multi-Touch, Gestures
(Charlie Sorrel, Wired, 9/24/09)
"For the tech-curious, the new tablets have 512 pressure levels in the pen tip and the active area of the tablet is 5.8 x 3.6 inches, and all lose the in-pack mouse (for obvious reasons). The Touch and the Pen models are both $70, and the Pen & Touch is $100. Also, if you were thinking of buying Photoshop Elements 7 for the same price, get a tablet instead — Elements comes in the box."






Official Wacom Video

"Bamboo Touch is new type of computer input device by Wacom that lets you navigate and perform commands like zoom, scroll, rotate and more with a series of simple finger taps and hand gestures. Bamboo Touch brings Multi-Touch capability to your Mac or PC"

Video from a Wacom user:

A nice alternative to a mouse.  I'm going to get one for my laptop!


Multi-touch Kiosks!
Press release:  Dutch touchscreen supplier PresTop partners with Natural User Interface (NUITEQ)
 



RELATED

I couldn't find any video clips of PresTop's multi-touch interaction. From what I can tell, PresTop multi-touch screens will be using SnowFlake Suite from Natural User Interface Technogies AB.

How-to:SnowFlake Suite Flash multi-touch Interactable component (NUIversity)

Without a single line of code, you can do quite a bit with Snowflake Suite

"This video covers how to make a rotatable and scalable image. The beauty about this is, that we have developed a Flash mouse input simulator, so that there is no need for multi-touch hardware in order to develop your applications. Simply simulate multiple mouse inputs for multi-touch.This project is still in alpha phase and a download will become available with the next release of Snowflake Suite 1.7 for the NextWindow platform and camera based multi-touch solutions."


Below is a video of single-touch interaction for PresTop, from Omnivision:


PresTop  PresTop offers interactive hardware and software solutions that can be used indoors as well as in outdoor environments.

Impress: A cool flexible interface project by Silke Hilsing

Impress, a cool flexible interface project by  Silke Hilsing:


impress - flexible display from Silke Hilsing on Vimeo.

From Sike Hilsing's website:

"Impress is the deliverance of the touch screen from its technical stiffness, coldness and rigidity. It breaks the distance in the relationship of human and technology, because it is not any longer the user which is subjected to technology, but in this case the display itself has to cave in to the human. Impress is a chance of approach of user and technology, above all, from technology.


It is a matter of a flexible display consisting of foam and force sensors which is deformable and feels pleasantly soft. Impress works with the parameters position and time like other touch screens as well, but in addition to that, it reacts, above all, on the intensity of pressure."

The application was created with Aruino and Processing.






Thanks to Richard Van Tol for the link!

The Touch Research Project, re/Touch, and Near Field Communication Touch Interaction

The Touch Project is based in the Interaction Design department of the Oslow School of Architecture and Design in Norway. "Touch is a research project that investigates Near Field Communication (NFC), a technology that enables connections between mobile phones and physical things. We are developing applications and services that enable people to interact with everyday objects and situations through their mobile devices. Touch consists of an inter-disciplinary team involved in social and cultural enquiry, interaction/industrial design, rapid prototyping, software, testing and exhibitions." -

Nearness Explores Interaction Without Touching

Nearness from timo on Vimeo.

iPhone RFID: Object-based media

iPhone RFID: object-based media from timo on Vimeo.

reTouch Web Site

reTouch Info Sheet (pdf)

reTouch is part of the Touch project, and it " brings together hundreds of cross-cultural examples of social norms and values involving touch—all categorised according to actions related to touching. Using quotes from ethnographic accounts written between the late 1800s and the present, re/touch encourages designers and researchers to explore how touch is used by people to relate to one another and the worlds in which we live. Browse re/touch to create design briefs, refine interaction scenarios, devise game play, or otherwise think, make and do things touchrelated." -reTouch web info, Anne Galloway.


One of the members of the research team is Anne Galloway, a social researcher and the author of the  purselipsquarejaw blog, which she recently resurrected after taking a year off from blogging.

Anne also contributes to the space and culture journal.  I've followed Anne's writing for a while.  Over the course of her Ph.D. studies, she has thought deeply about the intersections of technology, space, and culture,  including cross-cultural meanings of touch.

RELATED
Inspiring Touch Related Interaction Design

Designing With RFID

View more documents from Chen pinmiao.

Original Design Thinking Approach for Researching RFID
-Nikolas Nova, Pasta and Vinegar


Note:  Nikolas Nova's Pasta and Vinegar blog is worth taking a look at if you are interested in design, UX, emerging technologies, pervasive/ubiquitous computing.


About Nikolas and his blog:
"User Experience researcher at LIFTlab. My work is about studying how people use various technologies and turn them into insights, ideas, prototypes or recommendations to inform design and foresight.This blog is a selection of the material that I collect, especially in fields such as mobility, urban environments, digital entertainment and new interfaces. I am also part of the near future laboratory."

Sample of Pasta and Vinegar Posts:
(Touch) Interaction Vocabulary
A Graphic Language for Touch-based Interactions

Mobile Gesture Design at Nokia: Gesture Interaction Around the World

From the Nokia Conversations YouTube Channel:


The video explains it all.

(Fritz Desir, thanks for the link!)

Information about Touch Screens, Multi-Touch, & Gesture Interaction is Spreading

Since the news about Windows 7 multi-touch capabilities has spread around, I haven't had enough time to keep up all of information related to multi-touch interaction. Fortunately there are a few bloggers out there who are doing a great job filling in the gaps.

The Touch User Interface blog has a wealth of information in the form of pictures, video clips, slides, and links that I'd like to share.

The following slideshow/videos were highlighted in the Touch User Interface blog post, "Touch UI: HCI Viewpoint":

Untold Stories of Touch, Gesture, & NUI
Joe Fletcher, Design Manager, Microsoft Surface

Touch and Gesture Computing, What You Haven't Heard
Dan Saffer

Tap is the New Click

Other posts of interest on the Touch User Interface blog:
Touch screens and vision impairment
Link: Designing the Palm Pre: An Interview with Michelle Koh

Touch User Interface Overview

I've updated some additional information about UX,interactive multimedia, multi-touch, and gesture interaction on my Multimedia and Interaction Resources page, which is a work in progress.

More from Multitouch Barcelona!

Multitouch Barcelona is up to more great work!

Multitouch Space Invaders XL

Multitouch Space Invaders XL from Multitouch Barcelona on Vimeo.

Guten Touch, by Multitouch Barcelona

GUTEN TOUCH from Multitouch Barcelona on Vimeo.

"Designed for the Red Bull Music Academy 08, Guten Touch is an interactive installation that involves people into a natural relationship with technology. A two projected display system plus a 3m x 2m multitouch wall showcase applications designed to engage us into human friendly experiences rather than flashy and jaw-dropping visualizations. Space Invaders hit by foam balls, pixel paintings created with brushes and digital objects held by hands try to blur boundaries between real and digital."

Multi-touch Barcelona (new site)
"Multitouch Barcelona is a recently born interaction design group that explores natural communication between people and technology. They design touch sensitive environments where real world interactions move to a digital context. Interfaces where people touch, play, move, feel...Where senses play their natural role, where everything just 'happens" as it does in the real world. "




RELATED
Offf 2009: International Festival for the Post-Digital Creation Culture

3DV Systems Motion Sensing Camera and Microsoft's Xbox 360

A while ago there was an article in Reuters that discussed how Microsoft was planning to buy 3DV Systems, a company that develops virtual reality imaging technology for digital cameras, called ZCams. The ZCams would be used as an accessory to the XBox 360 system.

It is true, according to a recent article in Business Week:

Microsoft Moves onto Nintendo's Motion Turf: "The software giant's Xbox 360 gaming console will have a camera system that lets users bring body movements and voice commands into play"

Information about the camera from the 3DV website:

"The new"ZCam^TM (previously Z-Sense), 3DV's most recently completed prototype camera, is based on DeepC^TM and is the company's smallest and most cost-effective 3D camera. At the size of a standard webcam and at affordable cost, it provides very accurate depth information at high speed (60 frames per second) and high depth resolution (1-2 cm). At the same time, it provides synchronized and synthesized quality color (RGB) video (at 1.3 M-Pixel). With these specifications, the new ZCam^TM (previously Z-Sense) is ideal for PC-based gaming and for background replacement in web-conferencing. Game developers, web-conferencing service providers and gaming enthusiasts interested in the new ZCam^TM (previously Z-Sense) are invited to contact us."

3DV System's Video Gallery

Video of 3DV Systems at CES 2008

Future of Interaction: Microsoft Lab's Vision 2019 Montage; Future Healthcare Montage

The following video is from Microsoft Office Vision 2019. If you visit the YouTube source, you'll find an interesting discussion about this five-minute+ clip.



Video Presentation from MIX09: Untold Stories of Touch, Gesture, & NUI
Joseph Fletcher, Design Manager, Microsoft Surface


"Learn about new patterns, behaviors, and design approaches for touch and gesture interfaces from a practitioners point of view. Learn early lessons from applied knowledge of touch applications, devices, and design methods."



LukeW's notes from Joseph Fletcher's presentation
LukeW's post: Design Principles at Microsoft

LukeW is the Senior Director of Product Ideation & Design at Yahoo! Inc.

How soon will we see interactive information visualization for multi-touch & gesture systems?

The field of information visualization is growing. Until recently, most visualizations were created for use on a single PC or larger screen, allowing for interaction by only one user at a time. I have a feeling that this will be changing in the very near future.

Why? Interactive duo and multi-touch interfaces are becoming more common, and now come in all sizes of screens, from the iPhone, the Surface, and CNN's multi-touch "Magic Wall". People of all ages play interactive games on the Wii, often on large flat-panel displays. In my opinion, the time is right for those developing applications for the InfoViz world to think about harnessing the power of multi-touch.

Below is a picture of the front page of the Visual Complexity website. If you go to the site, you can select a visualization, and then explore it more in detail, as each picture links to a web-page that provides background information about the visualization project, the artist or team behind the project, and links to the project's website.

I took a look at a variety of the examples posted on the Information Complexity website, and think many would be enhanced by a transformation to a multi-touch, gesture, bi-manual, or duo/multi user system. I'm interested in learning what others think about this. If you are working on a collaborative information visualization project, feel free to add a comment and post a link.

Here is a a nice quote from the website:

"Functional visualizations are more than innovative statistical analyses and computational algorithms. They must make sense to the user and require a visual language system that uses colour, shape, line, hierarchy and composition to communicate clearly and appropriately, much like the alphabetic and character-based languages used worldwide between humans." Matt Woolman Digital Information Graphics

Update: I did a search for "multi-touch" on the Visual Complexity website and found a couple of interactive applications:

Reactable (I've posted about this system a few times!)
(Reactable website)

Prototouch

(Wirmachenbunt Website)

Touching Windows 7 - Informative post, video, and comments from the Engineering Windows 7 blog

Touching Windows 7 post on the Engineering Windows 7 blog provides a good overview of Microsoft's work with touch and gesture interfaces over the past several years, building upon earlier work with the TabletPC.

There are quite a few opinions shared in the post's comment section. It is worth the read.

Below are two videos from the Windows 7 post:

Windows 7 Gestures
<a href="http://video.msn.com/?mkt=en-US&playlist=videoByUuids:uuids:891c68b3-a534-4159-b6b2-8e4ac56b6890&showPlaylist=true" target="_new" title="Windows 7 Touch Gestures">Video: Windows 7 Touch Gestures</a>

My comments will be forthcoming.

Softkinetic 3D Gesture Recognition for Games and Rehabilitative Play

Taking 3D interaction further, Softkinetic has developed middle-ware that uses a 3D camera to support full-body gesture interaction with games and other applications. No controllers or devices are needed!



The following video is narrated in Portuguese, I, think, but you can understand the content in any language. I you love the Wii, you'll probably like this!


Here is a video that demonstrate how Softkinetic and Silverfit paired together to develop rehabilitative games for the elderly and others:


The following table is from the Silverfit website:

Game	Movement trained
Puzzle	While sitting down, bend whole body left and right, and stand up. Cognitive/visual component.
Mole	Balance exercise by stepping with one leg while standing.
Catching grapes	Walking movement left and right.
Walking	Walking in place, while avoiding obstacles and thresholds. Activity of Daily Life (ADL) component.
Arm exercise	Arm stretching and reaching in all directions with one or both arms. ADL component.
Picking flowers	Walking backwards, forwards and sideways. Optionally, bending down.
Memory	Arm stretching left, right, forwards and upwards. Cognitive component.

RELATED

Softkinetic and Silverfit Introduce Senior-Targeted Gaming
(Danny Cowan, Gamasutra, 12/19/08)

Softkinetic's Gesture-Based Interactive TV Action:

More Multi-Touch and Surface Computing...

The concept of multi-touch/gesture/surface computing is spreading.

Here's more evidence:

Panasonic Touch Air Hockey


The game was demonstrated at ISE 2009 (Integrated Systems) Amsterdam. The interface was developed by UI Centric, a Soho, London company.

Microsoft's SurfaceWare at the Tangible Embedded Interactions Conference (TEI 2009):

SurfaceWare is a level-sensing software that alerts waitstaff when glasses need refilling.


Photos from Nachiket Apte, via Ru Zarin

More to come...

Interactive Virtual DJ on a transparent pane, by lm3labs and Brief-Ad

LM3LABS offers wide range creative interactive applications/systems. This Virtual DJ was developed in collaboration with Brief-Ad, of Romania, utilizing the ubiq'window. Wouldn't this be fun to have in schools!

Here is the video:


Virtual Touchless DJ from Nicolas Loeillot on Vimeo.

LM3LABS Blog

SPARSH: DYI demo of an open-source multi-touch table and applications by NUI-group members

The following video is a demonstration of "Sparsh", an interactive multi-touch FTIR table built in eight weeks by a group of engineering students in India. Most of the information regarding the hardware and software you see running on this low-cost system can be found on the open-source NUI-group website, forums, and wiki.


Sparsh Multitouch Display from anirudh on Vimeo.

I especially like the multi-touch DJ application!

For more information, view the posts related to the NUI group on this blog.

Sparsh Website

More Multi-touch Multimedia: Video demonstration of applications created with Snowflake and Flash

This video showcases the work of Natural User Interface-AB, using NUI Suite 1.0 Snowflake and Flash.

Here is the plug from the company's website:
"Natural User Interface (NUI) is a Swedish innovative emerging technology company specializing in commercially available advanced multi-touch software, hardware and service solutions. NUI's solutions can convert an ordinary surface into an interactive, appealing and intelligent display that creates a stunning user experience."

For more information and links:

For Techies and the Tech Curious: Multi-touch/Gesture from the NUI-Group

Search this blog!

Usability, Accessibility, and User Experience in a Win7 Environment

Microsoft's newest operating system, Win7 (beta), allows for multi-touch interaction and application development. From what I can tell from the news from the Consumer Electronic Show (CES 2009), touch and gesture interaction holds quite a bit of interest among consumers and application developers alike.

Hopefully people will think carefully about user experience and usability factors when developing the applications we'll be using in the not too distant future!

Because of my background as a school psychologist, I’m interested how touch/gesture applications can address accessibility and universal usability issues.

I wasn't able to locate user experience or usability information for Win7. Here are a few links from the Microsoft website that I think are worth reading:

Touch Interaction Guidelines

How to Design a Great User Experience

Designing with Windows Presentation Foundation

Accessibility

According to the research from Microsoft, ”more than half of all computer users experience difficulties or impairments related to accessibility, and are likely to benefit from the use of accessible technology. Moreover, approaching software design with the flexibility and inclusiveness that are the hallmarks of accessibility often results in overall improved usability and customer satisfaction.”

Regarding touch/gesture interaction, know that “19% (24.4 million) of computer users have a mild dexterity difficulty or impairment, and 5% (6.8 million) of computer users have a severe dexterity difficulty or impairment.”

Christian Moore, from the NUI-Group, shared this nice graphic that depicts the various fields that intersect or converge with interface design, which I think is useful when thinking about how we will design, develop, and use emerging technologies:



Concepts such as accessibility and universal usability can fit into this design!

For more information regarding multi-touch, see my previous post, "For Techies and the Tech-Curious: Multi-touch/Gesture from the NUI Group"

Bloom - Play Music with Colors: Seth Sandler's relaxing little on-line application!

Bloom: Play music with colors (link to application)

For more information about Seth Sandler's work, visit his AudioTouch website.

Here are a few pictures of his applications:








Seth integrates music into his multi-touch applications, as he has a background in both music and art. He is a member of the NUI-Group.

Demo of Duke University's multi-touch wall at RENCI, running the Cobalt Metaverse Browser

The video below shows the "pre-alpha" version of the Cobalt Metaverse Browser:



"This video shows the Cobalt metaverse browser being tested on a 13-foot by 5-foot multi-touch visualization wall equipped with six high-definition projectors located at the Renaissance Computing Institute engagement center at Duke University. The input drivers are being developed by Dr. Xunlei Wu so that users can directly manipulate high-resolution data using both hands and multiple fingers for a more natural and intuitive data exploration experience. In the video, Dr. Wu is using both gesture and touch to navigate through, and rearrange content between, two Cobalt virtual worlds."

Related:
The Open Cobalt Project (on ning)
Cobalt Website & link to download to the latest pre-alpha build
Cobalt Community,
Cobalt Google Group
EduSim (A 3D multi-user virtual world platform and authoring toolkit for K-12 interactive whiteboards. The latest version is powered by Cobalt)

Cobalt can import objects from the Google 3D warehouse as well as Google Sketch-up:
Video Tutorial: Using Google 3D Warehouse to build Cobalt & Edusim Virtual Worlds

People:
Julian Lombardi, Duke University
Xunlei Wu, Senior Visualization Researcher, RENCI, Duke University
Rich White, EduSim; Greenbush Education Service Center, Girard, KS

Kids using Cobalt-based EduSim on desktop computers, via Rich White:

BMW and Surface Computing: Video of Tabletop Interaction

This is a promotional video from BMW, showing how potential buyers can interact with a tabletop computing system to preview various ways they can customize the car. The system in the video is Microsoft's Surface:



Via Gizmodo Australia

(I wonder if Microsoft is working on a few educational games for the surface....)

Tech-Savvy Teachers at Classroom 2.0; Google Sketch-up for math, and other creative ideas...including multi-touch

Classroom 2.0

"Guzman", a member of Classroom 2.0, is a math teacher in Florence, Italy who teaches math to middle school students. In addition to math, he has an IT background. He used Google Sketchup to introduce and work with solids. He thinks that Sketchup would be a good tool to use to teach volumes, sections, and more.

Guzman's student's worked on this project one hour a week for five weeks, and created all of the models using Sketchup. The animation was created with Sketchup by Guzman.



You can find the models Guzman's students made at Google 3D Warehouse

Tom Barret, at Classroom 2.0 has started a Multi-Touch Interactive Desk Development group. Tom is involved in the SynergyNet: Multi-touch in Education research, which is part of Durham (UK) University's Technology-Enhanced Learning Research Group.

You can find related pictures on Flickr: Multi-Touch Interaction: Applications and Gesture Ideas