Interactive Multimedia and Multi-touch at CES

I received couple of interesting links about interactive multimedia applications from Anthony Uhrick, of NextWindow, who is attending CES (Consumer Electronics Show). (NextWindow is the company who produces large touch-screen displays that have duo and multi-touch capabilities.)

Kevin Kennedy and his team at InterKnowlogy partnered with Zygote 3D Human Anatomy and Intermountain Health Care to develop a health care application developed in Windows Presentation Foundation to run on Microsoft's multi-touch Surface computing table.

The application supports collaboration between health care professionals and could also support collaboration between patients and doctors as well. Aspects of the application could be useful for patient education.

I really liked the part that demonstrates how you can zoom deeply into the 3D heart and look at things from various angles.


http://silverlight.interknowlogy.com/Videos/VitruView/default.html

Best of InterKnowlogy Surface:



The above video demos an application that might be useful for teaching history with an interesting timeline interface dial.

Visit InterKnowlogy for more videos and information about what they are doing with Windows Presentation & Silverlight as partners with Microsoft's Surface team.

If you are interested in more 3D anatomy, visit Zygote's 3D Human Anatomy site and 3D Science. If you are an educator, you'll see that 3D interaction has potential for creating more engaging science and health education lessons!

Another interesting link is to TouchTV Networks, which has partnered with companies such as Vectorform, who are also working with multi-touch applications using Windows Presentation Foundation.

Video from TouchTV Networks of CES 2009 Demo:


Vectorform's Virtual Drum Kit application:


Vectorform's Surface at School - demonstrates how this can be used in a classroom:


Vectorform's Surface DJ


Does anyone want to give me a multi-touch table?

I wish I was at the Consumer Electronics Show! (Links to CES info and updates, also MacWorld)

There are plenty of people reporting and blogging about CES 2009, and I won't have time to digest it all for a while. I've embeded the CNET overview video below, which includes a demonstration of some interesting interactive technologies and applications.

If you want the latest scoop, your first stop should be CNET's CES 2009 website. It is almost as good as being there, and you won't have to deal with the crowds.



Here is the overview video from the site:

Lots of cool stuff, like 3DVU's Way2Go 3D mobile mapping and GPS system:



3DVU's Way2Go Website

(By the way, if you are interested, here is a link to CNET's MacWorld site.)

For Techies and the Tech Curious: Multi-Touch/Gesture from the NUI-Group

If you are a new visitor to this blog and interested in interactive multimedia, you'll need to know more about the NUI-Group. Natural User Interface or ~ NUI Group is an interactive media group researching and creating open source machine sensing techniques to benefit artistic and educational applications.
(For related information, please read my recent post, Usability, Accessibility, and User Experience in a Win7 Environment.)

Seth Sandler, of the NUI-Group, sent out a great email with links and resources for people who are interested in multi-touch/gesture interaction, hardware, and/or software development. The list of NUI-Group members who have completed projects is listed below, with links to project websites as well as related threads on the NUI-Group forum.

(The information can be found on the NUI-Group Wiki, which boasts a nice icon based front-page)

Thanks, Seth, for organizing this wealth of information!

The following projects are divided up by type. (Links to information about the various types of multi-touch and gesture systems can be found near the end of this message.)

FTIR - Frustrated Total Internal Reflection

Name: Seth (cerupcat)
Project Name: AudioTouch
Project Website: http://ssandler.wordpress.com
Project Thread: http://nuigroup.com/forums/viewthread/1352/ http://nuigroup.com/forums/viewthread/2309/

Name: bassmang5
Project Name: Æ-table
Project Thread: http://nuigroup.com/forums/viewthread/3144/

Name: Daniel (Zin)
Project Name: Prometheus
Project Thread: http://nuigroup.com/forums/viewthread/2612/
Name: Carsten (carschdn)
Project Name : aTRACKtive
Project Thread: http://nuigroup.com/forums/viewthread/3223/
LLP Laser Light Plane



Name: Denis Santelli(dsan)
Project Website: http://www.touchwall.fr/
Project Thread: http://nuigroup.com/forums/viewthread/3051/

LED-LP Light-Emitting Diode Laser Plane

Name: Nolan - (PeauProductions)
Project Name: PeauProductions (LCD)
Project Website: http://peauproductions.blogspot.com/
Project Thread: http://nuigroup.com/forums/viewthread/3291/

DI - Diffused Illumination

Name: Seth (cerupcat)
Project Name: MTmini
Project Website: http://ssandler.wordpress.com/MTmini
Project Thread: http://nuigroup.com/forums/viewthread/1731/

Name: Fairlane
Project Name: ORION v2
Project Website: http://orionmultitouch.blogspot.com/
Project Thread: http://nuigroup.com/forums/viewthread/1709/

Name: Abdullah (EfeNDy)
Project Name: EfeNDy’s Diffused Illumination MT
Project Thread: http://nuigroup.com/forums/viewthread/3176/

Name: Sandor
Project Name: EXPO REAL 2008
Project Website: http://vimeo.com/2240537
Project Thread: http://nuigroup.com/forums/viewthread/3576/

Name: Matthew (MatthewW)
Project Name: Design Garage
Project Website: http://www.gotuasciencecenter.org/
Project Thread: http://nuigroup.com/forums/viewthread/3730/

Touchless

Name: Jimi Hertz
Project Name: Touchless Wall
Project Website: http://sassexperience.org/projettouchwall.html
(try: http://sassexperience.org/multitouch/inprogress.html )
Project Thread: http://nuigroup.com/forums/viewthread/2414/
YouTube: http://www.youtube.com/watch?v=KCFbWPf37jw

Other Types:
DSI Diffused Screen Illumination




RELATED LINKS

Tips for Success

• Read the FAQ
• Know Your Terminology
• Understand the Techniques
• Start Small
• Study Completed Community Projects
• Plan, plan, plan

Resources

• NUI Group Tools

• NUI Group Wiki
• Play a Part - Contribute
• Frameworks and Libraries
• Multitouch Business Directory

Thanks to all NUI-Group members who have been working so hard at this mission!

I'll end this post with a YouTube video created by Jimi Hertz, a NUI-Group member. "MULTI-TOUCHLESS WALL HOW TO?"

I especially like the music!

Lyrics to Demand, Suply Rap and Link to Chapter 1 of Professor Mankiw's Econ Textbook (Cross-Post)

One of the popular posts on the Economic Sounds and Sights blog contains this link to the "Demand, Supply" rap, created by Rhythm, Rhyme, Results, an educational music company located in Cambridge, M.A.

Joyce Santos was kind enough to post the lyrics to the rap, which I've posted below. The rap is was inspired by Harvard professor Greg Mankiw's ten principles of economics. These principles can be downloaded from the following link:

Chapter 1: Ten Principles of Economics (pdf)
Principles of Economics, Fourth Edition N.Greg Mankiw

Lyrics to Demand, Supply Rap, by Rhythm, Rhyme, Results
Via Joyce Santos


RELATED
Music to Teach Core Academic Concepts: A Look at Rhythm, Rhyme, Results

Hand Dance Actualization Machine Inspired by Rave Glowsticking, by Nicholas Rubin (NYU), via Doug Fox

This is a great video of Nicholas Rubin's Physical Computing project, in which he built a volumetric interface and projection surface. Rubin is a graduate student at NYU's Interactive Telecommunications program.


Cosmic Hand Dance Actualization Machine - HD from Nicholas Rubin on Vimeo.

The following quote from the video was posted by Doug Fox, of Great Dance/Kinetic Interface:

"In building this object I used as my theoretical foundation a practice called "glowsticking" that exists predominantly in rave and underground electronic music culture. Glowstickers, at least the talented ones, have cultivated the unique ability to twirl their glowsticks in mid-air and actually generate continuous, dynamic, 3D imagery in space. This is then observed by other party-goers whom might be near them. It usually happens spontaneously on the dance floor as opposed to being strictly a performance activity."

Wow!

IKEA's Interactive Dancing and Musical Website "Welcome to the Closet", via Kinetic Interface

Doug Fox, of the Kinetic Interface blog (part of Great Dance), shared IKEA's new promotional site that allows for tons of multimedia interaction. The website features a series of rooms to highlight various products.

Visit Come into the Closet!
IKEA Interactive Multimedia Game

Unlike most static, or even flash-based websites, the user has control over many dimensions of experience:

• Simply watch the dancers and listen to the music, navigating from room to room
• Control the dancers by tapping on your computer's keyboard
• Control the dancers by clapping, singing, or making other noises
• Combine tapping your keys while watching and listening
• Upload your own Mp3's and watch the dancers dance

According to Duncan, of the The Inspiration Room Daily, the site won an award at the Epica Awards.



Here is a video preview of some of the dance interaction in the site:







Duncan, of the Inspiration Room, also posted credit information regarding the IKEA website:

The following credits were posted by Duncan on the Inspiration Room Daily:

"The site was developed at Forsman Bodenfors, Sweden by web director Mathias Appelblad, copywriter Fredrik Jansson, art director Anders Eklind, designers Anton Robsarve and Christoffer Persson, agency producers Peter Gaudiano, Charlotte Most, Asa Jansson, account director Philip Mascher."

"An earlier version of the site was developed in 2006, winning a Yellow Pencil at the DandDs, and can be viewed online at Forsman Bodenfors."

"Web development was done at Kokokaka, Gothenburg."

"Filming was shot by director Amir Chamdin via Chamdin & Stöhr, Stockholm, with director of photography Gosta Reiland."

"Music is by Dead Mono."