Even More Multi-Touch, Delivered by NUI...

May 20, 2008
NUI announces delivery of their multi-touch solution for Cityscape, Abu Dhabi 2008





www.natural-ui.com
Natural User Interface Europe Ltd.

More Multi-Touch from members of the NUI group!

It is always exciting to see what members of the NUI group are doing!

Here is a new video of a multi-touch creation by some of the members of the NUI group. Although this is a proof-of-concept example, it is fun to see how it is played out, using the little iPhone-like touch-pad widgets as a navigation tool for the large screen.


Read the "Multi-touch Goodness" article in Gizmodo of an interview with Christian Moore about this demo and his Lux open-source framework. (Christian is a colleague of Harry van der Veen, both members of the NUI group.)

Here is an excerpt from the interview:
"JD: Why Flash?
CM: Because it's fast to prototype in. However, the software is broken into several segments. One C++ application that tracks hands that talks to Flash... WPF... or another C++ app... and basically everything you can imagine. You can enable multitouch in any environment, like Cocoa."

High-resolution screen shots and additional information can be found on the nuiman website.

For my tech-minded readers:
I'm pretty sure that the C++ application that track hands and fingers in the video demo uses Touchlib, a library for creating multi-touch interaction. Touchlib can work with TUIO, a protocol for tabletop tangible user interfaces. Applications such as Flash and Processing support TUIO. For more information about TUIO, read "TUIO: A Protocol for Table-Top Tangible User Interfaces".
(Information from the NUI group website mentions that OpenCV, or Open Computer Vision Library, found on SourceForge, can support blog detection and tracking.)

The people behind TUIO are from the Reactable project, of the Music Technology Group at Pompeu Fabra University in Barcelona:

Here is my plug for the NUI group, once again!

"The NUI group, or Natural User Interface Group, is an interactive media group researching and creating open source machine sensing techniques to benefit artistic and educational applications.

We offer a collaborative environment for developers that are interested in learning and sharing new HCI (Human Computer Interaction) methods and concepts. This may include topics such as: voice/handwriting/gesture recognition, touch computing, computer vision, and information visualization."


FYI
I came across the Harry van der Veen of the NUI group in early 2007 when I was working on touch-screen projects for my HCI and Ubicomp classes, and I'm inspired by all of the creativity I've seen coming from this group.

If you'd like to see more demos, visit the Natural User Interface website, a commercial out-growth of Harry and his colleague's work, where you can view a reel that includes a few touch-screen games. I love the vision statement on this site:

"Technology should enable us to interact with computers, in the same way we interact with the real world; in a way which is natural to us, namely through gestures, expressions, movements, and manipulations. Our vision is to change the way people interact with computers."

Multi-touch Crayon Physics

Also posted on the TSHWI blog:
Watch how you can draw simple shapes that can instantly turn into a game!


Multitouch Crayon Physics from multitouch-barcelona on Vimeo.
For a better version of this video, see http://www.vimeo.com/980528 For more information, see the RXSurface blog post. On May 18, Multi touch crayon physics will be offered as an alphabeta opensource! The people behind RXSurface are members of the Natural User Interface (NUI) group:
"Natural User Interface or ~ NUI Group is an interactive media group researching and creating open source machine sensing techniques to benefit artistic and educational applications."

Virtual Math Museum: Online Math Art:

The Virtual Math Museum has a wealth of visual information useful to those in and outside the field of math. The mathmatical art section has links to the works of Paul Nylander, George Hart, Titia van Beugen, Brian Johnston, Bathsheba Grossman, Jos Leys, Paul Bourke, Jean Consant, and Luc Benard.

Each of the Math Artist pages provides information about the artist that in my opinion, would be useful to teachers who aim to encourage students to consider pursuing STEM-related careers. (Science, Technology, Engineering, Math).

The content of the entire Virtual Math Museum website is impressive on a large display or interactive whiteboard!


FYI:

"3D-XplorMath Home Page

The group in charge of the 3D-XplorMath software development project and the related Virtual Mathematics Museum website project is the 3DXM Consortium, an international volunteer group of mathematicians. The Consortium gratefully acknowledges ongoing support for these projects by The National Science Foundation (DUE Award #0514781) and is grateful to the Mathematics Department of The University of California at Irvine for hosting the 3D-XplorMath and Virtual Mathematical Museum websites."

Paul Bourke's Experiments in Interactive Visual Immersion in Second Life - and more....

"Preprocessed spherical projections from inside a crystal including the Hershfield surface"
Evaluating Second Life as a Collaborative Tool for Scientific Visualization
http://local.wasp.uwa.edu.au/~pbourke/papers/cgat08/

I thought I'd devote a post to Paul Bourke's exciting work in the area of what I call "interactive visual immersion".

According to a bio on a math art website, Paul's working life "has revolved around high performance computing and computer graphics, in particular scientific visualisation: the use of computer graphics to represent scientific data with the aim of enhancing understanding of the underlying structure and processes." Paul is also interested in the use of "novel display technologies that can further enhance the understanding of large and complicated geometric datasets...These engage capabilities of our visual system not exploited by traditional computer displays..."

Paul recently participated in the the Computer Games, Multimedia & and Allied Technology 08: International Conference & Industry Symposium on Computer Games; Animation, Multimedia, IPTV & Edutainment. (CGAT'08, Singapore, April 28-30)

The above picture is from his paper, Evaluating Second Life as a Tool for Collaborative Scientific Visualization. (pdf), taken from Paul's webpage, where you can find a link to the slides from his talk.

Bourke points out that there are few software tools available that support shared, remote collaborative scientific visualization. What is available is expensive, exploratory, and/or difficult to install and operate. Bourke proposes that Second Life might prove to be a useful tool for collaborative SciViz, despite some current limitations. Second Life is a cross-platform 3D environment that was designed specifically for interaction between many people, and it allows for texture mapping, which is a plus for visualization work. Burke notes that there are limitations, such as Second Life's low geometric complexity.

Paul Bourke's website includes a page that lists all of his papers, articles, and seminars, with impressive visuals alongside each entry. Since I recently completed a visualization class and also gave a short presentation about accessible games for health, I found many of Bourke's papers intriguing:

Vertical dome (iDome): Visualisation and Navigable movies
Visualization for scientists, museums, public outreach, and education
Immersive environments and applications to gaming
Exploiting our sense of touch for scientific visualization.
Tactile Visualization: Feel your data!
Apple technology powering displays that engage the human visual system
iDome and digital projection into hemispherical domes

Take the time to explore Bourke's entire website. Look at his texture library and his "other" section!

FYI: Here is a link to the CGAT'08 list of speakers, complete with bios and abstracts.

Seth Sandler's "How to Make a Cheap Multitouch Pad" YouTube video is going viral...

Seth Sandler, a member of the NUI group, has worked very hard at putting together low-cost multi-touch screen surfaces. Seth has a background in music, so his projects focus on interactive music applications. Over 315,000 people watched this video within the week that it was uploaded.

Thanks Seth, for sharing this vision with the world!



Seth's AudioTouch Blog: "An Interactive Multi-user, Multi-touch Musical Table and More"

Hint for high school teachers: This sort of thing would be a great project for an after-school technology club!