Musical Multitouch/Gestural Interfaces by Osmosis

I've been pleasantly surprised by the increase of interesting multi-touch and gesture-based applications developed for musical interaction on large displays.  This topic is dear to my heart -  I took a computer music technology class back in 2003, and think it would have been great if this sort of thing was available back then.  Who wants to point and click around a music app for hours on end?!


The video below shows what is new from Osmosis, a company based in NY that focuses on the development of multi-touch and gesture based software for a range of uses, including music applications.


Performance Systems for Stage/Studio from Osmosis on Vimeo.

Transparent Stage System Specs
Design
• Floating, transparent HD displays from 32"
• Haptic surface with tempered glass backing
• High gain image with wide viewing angle
• Rugged aircraft-grade aluminum build
• Enclosed projector and computer
• Minimalist style, compact footprint
• Disassembles for easy transportation


Interactivity
• Projected capacitive foil or IR bezel options
• Up to 32 simultaneous touch points
• Precise, responsive touch tracking (3mm)
• Immune to external light conditions
• Use of fingers, gloves or stylus


Technical
Display:
• DLP portable projector
• 1280×800 HD resolution
• 2500 ANSI-lumen, 1800:1 contrast
Computer:
• Mini-ITX, Core 2 Quad, 4GB RAM
• ATI Radeon X1250 graphics card
• Wireless keyboard and mouse
• Windows 7 Pro

Stuart McClean, the founder of Osmosis, shared the following information about his company:

"Osmosis is a consulting firm based in the NYC area with deep experience in interactive technology. Although we cater to a range of markets, we’re especially passionate about music production and performance. Working closely with artists, we build customized interactive systems for stage and studio. HCI technology is integrated into a range of designs including stands, desktop rigs, tables, carts and vertical screens. Interfaces are tailored to specific artist needs and combine controls, generative audio and visuals, instruments, and gestural input. Our unique and flexible systems take full advantage of multi-touch interaction and offer seamless control of Ableton Live, Traktor, or other DAWs via midi and OSC..."





For more information about the applications developed by the Osmosis team, take a look at their showcase page.  

Unlocking the Future of Cities through Multi-Touch Interactive Visualization at RENCI (UNC-Charlotte)

Here is a link to an article that was in the SciTech section of my morning paper today!


Unlocking the Future of Cities:  UNCC scientists work across disciplines to predict how urban areas will use open land. Tyler Dukes, Charlotte Observer, 10/31/10

"As part of a three-year, $286,000 grant from the National Science Foundation, the group of scientists from UNC Charlotte is researching the complex relationship between the Queen City and its surrounding forest and pastoral lands. Using a combination of social, natural and computer science, they're working to build an interactive map-based simulation capable of showing the impact of future development and policy on land use....It's a project requiring Meentemeyer's team to peel back multiple layers of cultural and economic values surrounding land in the South. The research will have implications beyond the Charlotte area...By allowing the public to explore those possibilities visually on anything from a laptop to a touch-screen table, the research team is hoping its work will mean more informed decisions about how people use the land around them."  -Charlotte Observer

Image Source: Charlotte Observer


Wouldn't this be a great tool to use to support collaborative learning projects in the schools?


RELATED
RENCI at UNC-Charlotte has a Multi-touch Table in the Visualization Center
RENCI Visualization Center Update
Visualization Resources at RENCI UNC-Charlotte
RENCI at UNC Charlotte
Multi-Touch at RENCI
Research by Touch:  RENCI Multitouch Table Gives Computer Science Research an Intuitive Interface

For Techies and the Tech Curious: Multi-Touch/Gesture from the NUI-Group

If you are a new visitor to this blog and interested in interactive multimedia, you'll need to know more about the NUI-Group. Natural User Interface or ~ NUI Group is an interactive media group researching and creating open source machine sensing techniques to benefit artistic and educational applications.
(For related information, please read my recent post, Usability, Accessibility, and User Experience in a Win7 Environment.)

Seth Sandler, of the NUI-Group, sent out a great email with links and resources for people who are interested in multi-touch/gesture interaction, hardware, and/or software development. The list of NUI-Group members who have completed projects is listed below, with links to project websites as well as related threads on the NUI-Group forum.

(The information can be found on the NUI-Group Wiki, which boasts a nice icon based front-page)

Thanks, Seth, for organizing this wealth of information!

The following projects are divided up by type. (Links to information about the various types of multi-touch and gesture systems can be found near the end of this message.)

FTIR - Frustrated Total Internal Reflection

Name: Seth (cerupcat)
Project Name: AudioTouch
Project Website: http://ssandler.wordpress.com
Project Thread: http://nuigroup.com/forums/viewthread/1352/ http://nuigroup.com/forums/viewthread/2309/

Name: bassmang5
Project Name: Æ-table
Project Thread: http://nuigroup.com/forums/viewthread/3144/

Name: Daniel (Zin)
Project Name: Prometheus
Project Thread: http://nuigroup.com/forums/viewthread/2612/
Name: Carsten (carschdn)
Project Name : aTRACKtive
Project Thread: http://nuigroup.com/forums/viewthread/3223/
LLP Laser Light Plane



Name: Denis Santelli(dsan)
Project Website: http://www.touchwall.fr/
Project Thread: http://nuigroup.com/forums/viewthread/3051/

LED-LP Light-Emitting Diode Laser Plane

Name: Nolan - (PeauProductions)
Project Name: PeauProductions (LCD)
Project Website: http://peauproductions.blogspot.com/
Project Thread: http://nuigroup.com/forums/viewthread/3291/

DI - Diffused Illumination

Name: Seth (cerupcat)
Project Name: MTmini
Project Website: http://ssandler.wordpress.com/MTmini
Project Thread: http://nuigroup.com/forums/viewthread/1731/

Name: Fairlane
Project Name: ORION v2
Project Website: http://orionmultitouch.blogspot.com/
Project Thread: http://nuigroup.com/forums/viewthread/1709/

Name: Abdullah (EfeNDy)
Project Name: EfeNDy’s Diffused Illumination MT
Project Thread: http://nuigroup.com/forums/viewthread/3176/

Name: Sandor
Project Name: EXPO REAL 2008
Project Website: http://vimeo.com/2240537
Project Thread: http://nuigroup.com/forums/viewthread/3576/

Name: Matthew (MatthewW)
Project Name: Design Garage
Project Website: http://www.gotuasciencecenter.org/
Project Thread: http://nuigroup.com/forums/viewthread/3730/

Touchless

Name: Jimi Hertz
Project Name: Touchless Wall
Project Website: http://sassexperience.org/projettouchwall.html
(try: http://sassexperience.org/multitouch/inprogress.html )
Project Thread: http://nuigroup.com/forums/viewthread/2414/
YouTube: http://www.youtube.com/watch?v=KCFbWPf37jw

Other Types:
DSI Diffused Screen Illumination




RELATED LINKS

Tips for Success

• Read the FAQ
• Know Your Terminology
• Understand the Techniques
• Start Small
• Study Completed Community Projects
• Plan, plan, plan

Resources

• NUI Group Tools

• NUI Group Wiki
• Play a Part - Contribute
• Frameworks and Libraries
• Multitouch Business Directory

Thanks to all NUI-Group members who have been working so hard at this mission!

I'll end this post with a YouTube video created by Jimi Hertz, a NUI-Group member. "MULTI-TOUCHLESS WALL HOW TO?"

I especially like the music!

FlatFrog Multitouch Videos: Point Separation, Multi-input, Multi-user input

FlatFrog Multitouch is a company based in Sweden. It was founded by Ola Wassvic and Christer Fåhraeus.  The technologies support 20+ simultaneous touches, and recognize object size, a useful feature. FlatFrog screens can be optimized for a wide range of light conditions  FlatFrog's multi-touch and gesture interaction is featured in the short video clips below.  


FlatFrog is gearing up for commercial release. According to the FAQ's on the website, "all sizes are possible, from 5" to 100" and upward.  Promethean is one of the company's investors.   There is a volume manufacturing agreement with Kortek Corporation, known for industrial and gaming displays.




Thanks Touch User Interface for sharing this information! (Touch User Interface is the blog for Sensible UI, known for the ArduMT, aka the Arduino Multi-touch Development Kit)

Regional Multimedia News: Blind Squirrel Digital Builds MultiTouch Wall (Newton, N.C.)

Blind Squirrel Digital is a digital media company located in Newton, N.C.  One of the company's services is multi-touch surface design and implementation. Below is a picture of their  recently constructed multi-touch wall:

107 N. College Avenue • Newton, NC 28658 • 828-581-4252 
• info@blindsquirreldigital.com


About Blind Squirrel Digital:
Blind Squirrel Digital's services include iPhone and iPad application development, 3D animation/Visualization/Previz, multi-touch surface design/implementation, augmented reality design/implementation, multi-platform game development, digital signage/interactive and static content management systems, kiosk development, software and hardware design, exhibit design, simulation training application development, and real-time forensic reconstruction application development.


People behind Blind Squirrel Digital:
C. Michael Neely, the founder of the company, serves as President and Creative Director of Blind Squirrel Digital.  He has experience working with 3D applications and teaches digital effects, animation, and game development technology. He also has a few film credits under his belt, including "Pirates of the Caribbean III", "Spider Man III", "Fantastic Four", and "The Incredible Hulk 2".     Jeremy Cooper is the Vice President and Producer at Blind Squirrel. He has experience working on multiple creative projects (Digital Juice, Ballistic Pixel, and the Digital Design Center), and has taught a number of courses in the Simulation and Game Development program at Western Piedmont Community College. 



(The above information was gathered from the Blind Squirrel Digital website.)


RELATED

Doorways: iPad Game by Blind Squirrel Digital
Digital degrees launching high-tech careers: WPCC offers associates in gaming, animation
Jennifer Frew, The News Herald, 2/16/11

IntuiLab's Interfaces: Multi-touch applications/solutions for presentation, collaboration, GIS, and commerce

This is a company I've been meaning to write about!   Here is the plug from the IntuiLab website:

"Founded in 2002 and headquartered in Toulouse, France, IntuiLab is a leader in the design and development of surface computing-based applications. Through IntuiFace, the company’s portable, scalable and extensible software surface computing platform, IntuiLab delivers and deploys applications that bring tangible returns on investment to its clients by providing their customers and users with a more natural, immersive and memorable interactive experience. IntuiLab is a Microsoft and Adobe partner and has clients in a wide variety of industries such as retail, food and health, banking, aerospace and defense, telecoms and hospitality."

"We are able to deliver such benefits to our customers thanks to a unique blend of skills (our multidisciplinary IntuiTeam), technology (the IntuiFace Surface Computing Software Platform), process (the IntuiSign design process) and a wide range of partners."

R.U.S.E. on Intuilab's Interface

IntuiLab lets you blow things up with your hands (Jimin Brelsford, CrunchGear 10/09/09)
 It is not all for fun and games:


Amazon Multi-touch Clinet on the IntuiFace Platform

"This video shows an example of how to access to an online retail catalogue (such as Amazon) from a Surface Computer rich client, and create, browse and merge lists of queried or selected items in a natural way." -Intuilabs



 Multi-user Web Browsing on a Windows 7-based 19" 3M Multi-touch




Pictures from the Intuilab website:

If you take a look at Intuilab's "the team" page, you'll find that they look like...graduate students! They probably are, or were, given the size of list of published papers. This tells me that they must have their heart, mind, and souls poured into the business!

IntuiLab's Partners

I should brush up on my French and pay them a visit!

Ideum's High Resolution Multitouch Table for Museum Exhibits, running NUI's SnowFlake Software Package.

The Don Harrington Discovery Center in Amarillo, Texas, and the Vulcan Park and Museum in Birmingham, Alabama will both have large, high resolution multi-touch table exhibits provided by Ideum.

Below is a demonstration video from Ideum:



Ideum's Portfolio Site
Ideum's multi-touch, multi-user mashup, created with NUI Suite 1.0 Snowflake, a gesture recognition multi-touch software package.
Ideum's mt2 Table Information & Specs (pdf)

Ideum's mt2 Table was tested at a hands-on museum during the development process.

Christian Bannister's Interactive Multi-touch and Gesture-based Subcycle Project. Use your hands to shape sound, create, and manipulate music. Wow!!

I came across a link to Christian Bannister's Subcycle Labs website when I was taking a look at the Creative Applications Network website.


If you have an interest in music technology and innovative gesture/multitouch applications, you'll appreciate the details that are shared on the Subcycle website.  In the meantime, take the time to watch a few of Christian's videos.  Enjoy!


Blip Shaper Walkthrough

Blip Shaper Walkthrough from christian bannister on Vimeo.
"a) creating percussive patterns with monome b) shaping the individual sounds that make up the patterns with multitouch gestures c) recording touchscreen gestures as automation d) storing, duplicating and navigation patterns e) recording the resulting audio to a dynamic buffer f) manipulating the buffer with a multitouch cut-up approach g) visualizing everything with dual screens"
Subcycle Walkthrough

Subcycle Blip Shaper from christian bannister on Vimeo.

"a) creating percussive patterns with monome b) shaping the individual sounds that make up the patterns with multitouch gestures c) recording touchscreen gestures as automation d) storing, duplicating and navigation patterns e) recording the resulting audio to a dynamic buffer f) manipulating the buffer with a multitouch cut-up approach g) visualizing everything with dual screens"


The following information describing the Blip Shaper is from Christian's Subcycle website/blog:
"For the drum sounds I have Drumaxx running for synthesized sounds and Battery running for sampled sounds.  These are running in parallel so for each voice there is a separate patch running in each VST.  The Parameters are modified with the touchscreen independently but in all cases a single touch gesture on the X-Axis will cross fade between the sampled version of the sound and the synthesized version of the sound.  I love this because I have never seen this before and I can never decide which technique I like better.  The synthesized drums are more malleable and have more interesting parameters to play with but the sampled sounds seem more substantial.  I will post a detailed list of parameters and gestures in the future."   


Christian currently uses Max for Live (ableton), and codes with Processing/Java, using Eclipse for organization.

Autopilot - Subcycle
autopilot - subcycle labs from christian bannister on Vimeo.
"sound visualization, multi-touch interface, break beat performance engine, autopilot, spacialized sound, dsp, max/MSP, fm synthesis, sonic navigation, sound storm visualization, time machine, granular, interactive sound sculpture, joystick array, more at subcycle.org"

SOMEWHAT RELATED 
Community Core Vision
NUI Group

BTW,I'm wondering if Christian or other NUI group members would like to do something with some of my ideas that incorporate interactive music. To learn more, see my post, "It must be  Voronoi: Looking for ideas for my music+art+dance+tech dream...."
...


....

Multitouch and Gesture News (Part I) : NUITEQ Updates

In this post, I'd like to share some news from NUITEQ, a privately held multi-touch software technology that is based in Sweden.  NUITEQ is known for Snowflake Suite, a multi-touch application that is used in a variety of situations.  


"NUITEQ is as happy as a kid in a candy shop to announce that it has released version upgrade 1.9.4 of its award-winning, industry leading multi-touch software product Snowflake Suite" - Harry van der Veen, NUITEQ


The screen shot below gives a nice view of the range of applications that included in Snowflake Suite:



-Photo from NUITEQ


DEMONSTRATION OF SNOWFLAKE SUITE




RELATED
NUITEQ's CTO Mikael Bauer nominated for the Mer-IT award in the category IT-person of the year
NUITEQ Awarded CONNECT Norr Company of the Year 2011
NUITEQ's Partners
From the NUITEQ Gallery, via Harry van der Veen

Interactive Multi-Touch for Children with Autism Spectrum Disorders: Research and Apps by Juan Pablo Hourcade, Thomas Hanson, and Natasha Bullock-Rest, University of Iowa

Dr. Juan Pablo Hourcade heads a team of researchers at the University of Iowa who are creating multi-touch applications and other technologies to support communication, collaboration, creativity, and self-expression for young people with Autism Spectrum Disorders.  The picture below is a screen shot of the team's web page that includes a few videos of the team's important work: (Videos can be found on the Technologies for Children with Autism Spectrum Disorders webpage.)

RELATED VIDEOS

pymt demo reel from Thomas Hansen on Vimeo.


Multi Touch @ University of Iowa from Thomas Hansen on Vimeo.


RELATED
Hourcade, J.P., & Hansen, T.E. (2010). Multitouch Displays to Support Preschool Children's Learning in Mathematics, Reading, Writing, Social Skills and the Arts (pdf)


Dr. Hourcade is organizing the Digital Technologies and Marginalized Youth workshop on Satuirday, June 12, 2010 at the 9th International Conference on Interaction Design and Children (IDC), which will be held this year in Barcelona, Spain.


Other workshops that will be held at IDC 2010:
Interactive Storytelling for Children
Extended Abstract: Interactive Storytelling for Children (pdf)
Designing Tangibles for Children
Play and Technology:  How does technology initiate and facilitate physical play?


Dr. Hourcade's publications

Techies: How to do Multitouch with Windows Presentation Foundation 4 using Visual Studio 2010

Here is the "how-to" video. I don't have WPF4 or VS2010, so I haven't tried this at home...yet.



I came across this video on Vinod Varma's Software Engineer's blog post, "Multi-touch programming getting simpler."


I'm sure I'm not alone in my present dilemma. I have a burning desire to experiment with multi-touch and Adobe's products, since I used to use Macromedia Studio quite a bit several years ago. Instead of learning ActionScript 3.0, I decided to learn C# and XNA Game Studio, and then went on to play with Windows Presentation Foundation, Expression Blend, and Silverlight.


And what about multi-touch web applications?!

Multi-touch on Firefox: Felipe Gome's Work

Felipe Gomes is a 4th-year computer engineering student at the University of Sao Paulo, Brazil. He's been working on a multi-touch project that enables the FireFox web browser to respond to multi-touch interaction and gestures. Below is a demonstration of this work:

Multitouch on Firefox from Felipe on Vimeo.

Code snippets for the demo can be found on the Mozilla Wiki

SPARSH: DYI demo of an open-source multi-touch table and applications by NUI-group members

The following video is a demonstration of "Sparsh", an interactive multi-touch FTIR table built in eight weeks by a group of engineering students in India. Most of the information regarding the hardware and software you see running on this low-cost system can be found on the open-source NUI-group website, forums, and wiki.


Sparsh Multitouch Display from anirudh on Vimeo.

I especially like the multi-touch DJ application!

For more information, view the posts related to the NUI group on this blog.

Sparsh Website

Link to video: Microsoft Research UK's multi-touch research team

"I think that the sort of grander vision is that 5 years to 10 years down the line, there will be lots of new displays and display technologies, and displays will become more ubiquitous and cheaper. What we're trying to do is actually explore what the interaction techniques might be on these displays, because not all of them will be connected to mice and keyboards." -Shahram Izadi, Microsoft Research UK


Direct link to the wmv file

"Inside MultiTouch: Team, Demo, Lab Tour"

Take a look at a post on the MSDN Channel 9 website about an interview of members of Microsoft Research UK's multi-touch team. The researchers on the video are Shahram Izadi, Alex Butler, and Steve Hodges. The video contains some interesting demos. This team's approach to multi-touch is different than approach taken by the Microsoft Surface team. This video is well worth the 30 minutes!

This technology would be great for interactive educational games and 3-D applications. Microsoft has plans for this technology to be used in the home and for shared applications.

MULTITOUCH NEWS: NUITEQ's interactive display at a business park; Innovation Now's multitouch anatomy application

Multitouch Display for Business Science Park Aurorum, by NUITEQ

"NUITEQ developed a customized multi-touch software solution for Corporate Reception / Lounge Areas for Business Science Park Aurorum in Luleå, based on the award-winning Snowflake Suite framework. In addition to the software, NUITEQ delivered and installed a 32 touch points multitouch dreaMTouch LCD from Germany based Elektrosil."-NUITEQ

Multitouch Solution for Corporate Reception/Lounge areas based on Snowflake Framework

Harry van der Veen, Multitouch Blog, 8/19/11

Multitouch Anatomy by Innovation Now

"Virtual anatomy surface computer in the shape of autopsy table that show and enable the user to use hand gestures to do the anatomy process virtually." -Innovation Now

Homam Alghorani, CEO, Innovation Now Sdn Bhd

MORE GEAR: Video demo of the 20-inch HP TouchSmart 300 and the 23-inch TouchSmart 600; Also, the HP LD 4200 42-Inch High Def Digital Touch Display

Looking for something techy, yet touchable?  More multi-touch screens will be on the market soon from HP.


Video of the HP TouchSmart PC 300 and 600


Information from the HP YouTube website:


Two new HP TouchSmart PCs packed with exclusive touch applications, the HP TouchSmart 300 and HP TouchSmart 600, feature stunning HD displays with a multitouch enabled screen. Consumers can now stream Netflix movies, watch TV programs, listen to music and internet radio, create photo collages and bring out their inner chef all by simply touching the PC screen. The new consumer PCs feature exclusive built-for-touch applications including: Hulu Desktop, Netflix, Twitter, the HP Music Store powered by Rhapsody, Pandora Internet radio the TouchSmart Recipe Box, and Canvas. The 16:9 widescreen tiles make multimedia, social media and other applications a rich and engaging touch experience. Some models of the HP TouchSmart 600 easily connect to gaming consoles, including Xbox, PlayStation and Wii, via HDMI or composite video ports. The HP TouchSmart 300 starts at $899 and is offered in a 20-inch diagonal widescreen (available Nov. 1). The HP TouchSmart 600 starts at $1,049 and is offered in a 23-inch diagonal widescreen (available Oct. 22).

I like the new features, especially the tilt webcam, the swivel that lets you swivel the screen around as needed,  and the recipe box application.    The a digital recipe box "scrapes" recipes from on-line websites, and allows you to listen to the recipe through a blue-tooth earphone.  The recibe box applications will talk to you as you prepare a meal, hands-free!



For businesses that are looking for high-definition interactive kiosks, 43-inch HP LD4200, diagonal digital signage touch display might be a great solution:

 "Aimed specifically at the digital signage market, with HP noting is suitability for kiosks, retail, point of sale, shopping malls, travel terminals, hotel lobbies, recreational venues, universities, stock exchanges and hospitals, the new 42” HP LD4200tm multitouch LCD display offers Full HD (1080p) resolution and, thanks to utilising infrared and imaging sensors, will happily acknowledge touch commands such as zoom pinching and drag scrolling thus bringing true interactivity to information and advertising visualisations...On top of its mulittouch capabilities the HP LD4200tm boasts ultra-wide 178 x 178 degree viewing angles and is set to ship from December with a price tag of just shy of $2,800" - Andrew Tingle, TFTS

Note:  NextWindow is the creator of the touchscreens.

V12's Dual-Touch-screen Canova: Multi-touch could support applications for universal design, education, and assistive technology.

V12 Design is a company with offices in Italy and Australia. It is developing the second-generation version of Canova . Since the product will not be on the market for at least 16 months, no pictures of the newest version were available. The first version is depicted in the photos below:

Canova Generation 1#


(Photo via Gizmodo; depicts the first version of the dual LCD laptop.)

According to information from LaptopMag, Conova was..The first-generation model....was envisioned to transform from a sketch pad, to a writing pad with an electronic pen, to a newspaper."



From the Gizmodo AU website:

"An interview with Valerio Cometti, the founder and managing director of V12 Design, confirmed that the upcoming version would support multitouch input and that a microphone would be built into the design for voice commands."

With multi-touch and audio input, this device would be a godsend for young people with learning difficulties and others who require assistive technology. It would also be very useful for people in various fields of work. I assume that the Canova will come with speakers, a DVD player, a video camera, Blue-tooth and Wi-Fi capabilities.

I was excited about the new dual-touch screen laptops in development for the One Laptop Per Child project. I'm even more excited about the Canova. Hopefully, the company is devoting attention to usability studies with a wide range of people, using a variety of interactive demo applications.

I wonder if I can get my hands on a second-generation prototype of Canova to test out my touch-screen application "experiments". I'm bursting with ideas to try out, including gaming applications.

I want one now!

The second version will be developed by a US manufacturer. If anyone knows more about this leave a comment!

Related:
V12 Designs' Dual-Touchscreen Notebook Coming Within Two Years

V12 DEsign Dual-Touchscreen Notebook will make ebook readers drool

V12 Design Delivering Dual Touchscreen Laptop Within Two Years

WONG - Multi-touch Pong Rerun - Link to Updated Game and Code (via Seth Sandler)

In 2007-2008 there were a handful of multi-touch concept demo videos created, accompanied by upbeat music. The song in this video would be great for the Glee iPad/iPhone app!

Wong was created by Seth Sandler, who recently cleaned up the code.  The latest version of Wong, along with the cleaned-up code,  can be found on the TechSparked website: http://techsparked.com/application/wall-pong

YouTube Video of WONG by Falcon4ever:


Here is a plug for Seth Sandler:

More Applications by Seth

Musical Squares

Audioshape Sequencer

Multitouch Gestures

Bloom

Multi

Seth Sandler's "How to Make a Cheap Multitouch Pad" YouTube video is going viral...

Seth Sandler, a member of the NUI group, has worked very hard at putting together low-cost multi-touch screen surfaces. Seth has a background in music, so his projects focus on interactive music applications. Over 315,000 people watched this video within the week that it was uploaded.

Thanks Seth, for sharing this vision with the world!



Seth's AudioTouch Blog: "An Interactive Multi-user, Multi-touch Musical Table and More"

Hint for high school teachers: This sort of thing would be a great project for an after-school technology club!

Why bother switching from GUI to NUI? - Asked and Answered by Josh Blake; My 2-cents; Stevie B’s Microsoft Research Video; Marco Silva’s NUI-HCI Presentation (and links)

In Chapter 1 of Natural User Interfaces in .NET,  Josh Blake asks and answers a question posed by many people who have been under the spell of keyboard input and GUI/ WIMP interaction: 


Why bother switching from GUI to NUI?  The answer?  Read Chapter 1 (pdf) of the book - the chapter is free.


Here are a few of my personal reasons:  
1.  I want to buy the next version of the iPad or something like it.
2.  I want to buy a new large-screen Internet HD TV.

3.  I want to buy a Kinect.

4.  I do NOT want to interact with my new TV with a Sony remote.  Too many tiny buttons!

5. I do NOT want to interact with my new TV with a keyboard,  because it reminds me of...work.

6.  Most importantly: 

I want to design apps for the people I care about, and others with similar needs:

    My mom.  

    My grandson.

Moms and dads with kids in tow.
People with special needs and/or health concerns, and the people who care and guide them.
Knowledge sharers and (life-long) learners....

RELATED

"Smart" Interactive Display Research

How Natural User Interfaces are changing Human Computer Interaction

 

View more presentations from Marco Silva

My YouTube Playlist:

Post-WIMP Explorers' Club Videos

"Natural user interfaces, gesture interaction, multi-touch, natural interaction, post WIMP examples and more... "

Interactive Multimedia Technology Post:
Interactive Touch-Screen Technology, Participatory Design, and "Getting It": Revisited

RELATED - and somewhat related   

Moms with Apps

Design for Care

SparkOn

NUI Group

UX Matters      "Why don't usability problems get fixed"

Encyclopedia:  Human Computer Interaction, Interaction Design, User Experience, Information Architecture, Usability and More (Interaction-Design.org)

Josh Blake's Blog: Deconstructing the NUI    Book: Chapter 1 (pdf)  Free!
Blake.NUI

"Blake.NUI is a collection of helpful controls, utilities, and samples useful for multi-touch and NUI development with WPF, Surface, and Silverlight."

OpenKinect Wiki

OpenKinect Community Founder Joshua Blake Comes Up With His Own Version of Win 7 Multitouch on Kinect   (Madhav K, KinectHacks 1/14/11)

Kinect SDK Could Open New Worlds for Motion-Controlled Interfaces (Mike Martin, TechNews World, 2/22/11)

Seth Sandler

Seth Sandler's Blog

Seth Sandler's  Ultimate List of Interactive Tables

Dan Saffer

Bill Buxton

Johnny Chung Lee's Procrastineering Blog
Adam Greenfield's Speedbird Blog

 (This is not an inclusive list.)


GUI to NUI Post-WIMP Manifesto:  TBA