Multitouch and Gesture News (Part I) : NUITEQ Updates

In this post, I'd like to share some news from NUITEQ, a privately held multi-touch software technology that is based in Sweden.  NUITEQ is known for Snowflake Suite, a multi-touch application that is used in a variety of situations.  


"NUITEQ is as happy as a kid in a candy shop to announce that it has released version upgrade 1.9.4 of its award-winning, industry leading multi-touch software product Snowflake Suite" - Harry van der Veen, NUITEQ


The screen shot below gives a nice view of the range of applications that included in Snowflake Suite:



-Photo from NUITEQ


DEMONSTRATION OF SNOWFLAKE SUITE




RELATED
NUITEQ's CTO Mikael Bauer nominated for the Mer-IT award in the category IT-person of the year
NUITEQ Awarded CONNECT Norr Company of the Year 2011
NUITEQ's Partners
From the NUITEQ Gallery, via Harry van der Veen

NCSU D.H. Hill Library has a Perceptive Pixel Multitouch Display (updated)

NCSU 'sandbox' lets students touch the technology

Jay Price, Charlotte Observer, 2/22/11

"The Perceptive Pixel display wall, which was switched on this week, is the $100,000 centerpiece of the new Technology Sandbox at the D.H. Hill Library. The sandbox is a room of cutting-edge, interactive hardware that's aimed partly at familiarizing students with the latest high-tech hardware, particularly large displays and gesture-based computing. It was paid for with a federal grant from the Institute of Museum and Library Services that is administered by the State Library of North Carolina."

Credit: Corey Lowenstein - clowenst@newsobserver.com

RELATED
Technology Sandbox introduces NCSU students to latest gadgets
WRAL Techwire, 8/25/10
New Learning Spaces for New Learning Styles (pdf)
Terry B. Hill, Mohan Ramaswamy,  NCSU

HUNT LIBRARY

North Carolina State University Libraries
Perceptive Pixel

Human-Computer Interaction (HCI) Is Changing the World: BLUR Conference, February 22-23, Omni Orlando Resort (Includes video)

Blur Conference

Tuesday, February 22, 2011 at 8:00 AM - Wednesday, February 23, 2011 at 5:00 PM (ET) Omni Orlando Resort, 1500 Masters Blvd. 

 ChampionsGate, Florida 33896 Phone: (407) 390-6664

ABOUT BLUR 

(from the conference website)

"It’s easy to forget that the computer mouse is over 45 years old."

"What’s not as easy to forget is that we’re now collectively getting used to interacting with computers via means and interfaces that have moved way beyond the keyboard and the mouse — the iPhone and Wii being the most prominent examples."

"The truth is that we stand on the verge of a major revolution in the models of Human Computer Interaction (HCI). A revolution that will fly right past academic and into a world of retail, medical, gaming, military, public event, sporting, personal and marketing applications."

"From multi-touch to motion capture to spatial operating environments, over the next 10 years, everything we know about HCI will change."

"Blur is the only conference that is exploring the line of interaction between computers and humans in a substantive, real-world and hands-on way."

"At Blur, vendors, strategists, buyers and visionaries assemble to not only discuss the larger issues of HCI, but also to lay their hands on the latest in HCI technology. Blur is the only forum for a focused, hands-on exploration of the varied technologies evolving in the HCI."

"Come play, investigate, learn and apply at Blur — where we’re changing how you interact with computers forever." -Blur



BLUR Conference Agenda
(Note:   I added the links to conference participants and/or their organizations. Feel free to leave a comment if you know of any corrections or better links!)
Keynotes:

Neuroergonomics: How an Understanding of the Brain is Changing the Practice of Human Factors Engineering - Dr. Kay Stanney, Design Interactive

On Social Robotics - Dr. Cynthia Breazeal, Personal Robotics Group, MIT

When Computers Feel: Understanding Human Emotional Measurement  - Hans Lee, EmSense

A Quick Hit on Mobility and HCI - Juan Pons, Swype

Panel Discussion: Haptics- The Beginnings and Future of Touch  - Nimish Mehta

Augmenting the World of Things - Jeff Powers, Occipital; Matt Szymczyk, Zugara; Robert Rice, Neogence; Gene Becker, Layar; Moderated by John Minnihan, Freepository

Why HCI will lead the biggest tech revolution yet - Andrew Tschesnok, Organic Motion
Location as a Primary Interface Input - Matt Galligan, SimpleGeo; Nick Brachet, Skyhook Wireless
Robotics, Gaming and The Future of Entertainment- Paul Berberian, Orbotix
Virtual Coaches in Healthcare: A Vision of the Future - Dan Siewiorek, Carnegie Mellon University
10 reasons to be happy about giving computers emotion sensing - Dr. Rosalind Picard, MIT
Commercializing HCI Technology - Dr. Paul Kedrosky, Ewing Marion Kauffman Foundation and Dr. Gerry Barnett


Breakout Sessions:
Human Instrumentation - James Park, FitBit; Ben Rubin, Zeo; Jason Jacobs, RunKeeper;
Steve Larsen, moderator
New Museum Experiences: Learning from Multitouch and Multiuser Installations - Jim Spadacinni, Ideum
Kinect Hacks - Jonathan C. Hall; Lonergan Harrington; Jim Spadacinni, Sean Kean, moderator
Interactive Ads and Consumer Experiences - Alessio Signorini, Immersive Labs; Jon Fox, Helios Interactive
Augmented Reality - Ready for Primetime? - Vikas Reddy, Occipital; Carlin Getliffe, Omniar; Edwin Rivera, Credelis; Dan Rua, moderator
Building an Interface for Endangered Language Learners - Finn Thye and Kelson Adams, Univ of Colorado - Boulder
Alternative Interface Inputs - Gary Clayton, Nuance; Nick Langdale-Smith, Seeing Machines; RJ Auburn, Voxeo; Steve Larsen, moderator
Ewing Marion Kauffman Foundation "Idea Hack" - Commercializing HCI Technology: A Discussion - led by Paul Kedrosky
Building Natural User Interfaces - Thomas Peterson, SoftKinetic; Ohad Shvueli, Prime Sense; David Minnen, Oblong
3D Interactive Design for the Human Body - Albert Hwang
Panel: Will the Kinect Change the HCI Industry Forever? A Group Discussion
HCI in the 21st Century:  Technologies for Extending and Amplifying the Human Experience (pdf) - Dr. Charlie Hughes, UCF; Dr. David Pratt; Dr. Joseph LaViola;  moderated by Steve Fiore, UCF


Some Videos of HCI/Tech featured at Blur 2011 
360 Panorama occipitalhq


"Illuminous" Eric Gradman



"Standard Gravity" Eric Gradman, OpenKinect (libfreenect/python)


Organic Motion Markerless Motion Capture


Advisory:
Steve Fiore, University of Central Florida
Bob Allen, Disney R&D
Kay Stanney, Design Interactive
Capt. Dylan Schmorrow, USN

If you haven't seen it yet, here is a video of Microsoft Surface 2.0. A new usability feature in this version- you can sit with your legs under the table!

If you haven't seen it yet, here is a video of Microsoft Surface 2.0

Toyota Vision Multi-Touch Wall at the 2011 Detroit Autoshow: Good example of a collaboration between PUSH, Juxt Interactive, GPJ, and Hush (updated)

GOOD EXAMPLE!

I didn't have the chance to get up to the Detroit Auto Show and interact with the iWall, so I watched the videos.


Toyota iWall from Justin Micklish on Vimeo.


From Justin Micklish's Vimeo site:
"Named "Belle of the Ball" at the 2011 Detroit Auto Show, the Toyota Vision Wall is a large-format interactive installation leveraging a great deal of UX intelligence and bleeding edge technology."


This project was a collaboration between a team at PUSH Offices and Juxt Interactive (lead agency), GPJ (experience marketers), and Hush (motion graphics).


Toyota Vision Multi-Touch Wall Case Study:  A good explanation of the "how and why" of this project:

Toyota Vision Multi-Touch Wall Case Study from JUXT Interactive on Vimeo.

From the JUXT Interactive Vimeo site:
"In January, Toyota debuted the largest digital multi-touch installation ever seen at the 2011 North American International Auto Show in Detroit. GPJ and JUXT Interactive created the digital touch wall experience to deliver a feast for the senses, allowing consumers to explore videos, photos and custom content through a larger-than-life, interactive surface."


RELATED
PUSH
"PUSH is a marketing & design research firm based in Venice, CA. We shirk labels and defy classifications. We have been called strategists, writers, technologists, marketers, typographers, entrepreneurs, and designers. Above all, we are curious. We make a living creating compelling experiences with our clients. Recent collaborations include work with Yahoo, West, and Sony."

Juxt Interactive 
"JUXT is a company that creates from the ground up, top to bottom, or even sideways. It kinda makes sense since we were started by a couple of architects....Lots of people ask us if we only do digital work. Well we like to think and play where people are, and these days that just happens to be the Internet. That suits us just fine because the online space has far less restrictions and barriers than other media. JUXT does not take kindly to limits, or being put in a box."
GPJ: George P. Johnson
"GPJ is the world's premier experience marketing agency, working with leading companies who are looking for innovative marketing solutions that motivate their audiences and activate their brands through live experiences."
Hush
"Hush is a design and direction studio crafting stories for digital, broadcast, mobile and physical installations. Whether using the latest technology or the most classic of techniques, we unifyu stories for agencies and brands alike."


Comment:  This post was revised on 2/11/11 to reflect a clarification from Justin MicKlish.  He's a partner and producer with Push and worked on this project with others in the role of technology consulting and software development. 

"Hi, Google. My name is Johnny" Johnny Chung Lee leaves Microsoft. (I still wish I could be Johnny Chung Lee for a day.)

"Hi, Google.  My name is Johnny"  Johnny Chung Lee announced on his Procrastineering blog that he's accepted a position at Google as a "Rapid Evaluator".   I'm not sure what he will be doing in this position, but his title is intriguing!

Here are some of my previous posts devoted to the work of Johnny Chung Lee:

I wish I could be Johnny Chung Lee for a Day!  Tracking fingers with the Wii Remote
Video Clips of Projects Inspired by Johnny Chung Lee
More about Project Natal:  Richochet - Great Gaming for Fitness, Johnnie Chung Lee's Contribution


I STILL wish I could be Johnny Chung Lee for a day!

RELATED
Microsoft Kinect Developer Johnny Chung Lee Jumps Ships and Lands at Google
Leena Rao, TechCrunch, 1/18/11
What Microsoft Kinect Defection to Google Means
Rich Tehrani, TMCnet Blog 1/18/11
Microsoft Loses a Top Kinect Researcher to Google
Tricia Duryee,Yahoo! Finance, 1/18/11

Multi-touch SmartBoard! (SMARTBoard 800 Series)

Take a look at the video demonstration of the new SMARTBoard (800 series) that offers multi-touch and gesture interaction support so that two students can interact with the board at the same time.

• Students can use 2 finger gestures to enlarge objects and move them around.
• Two students can interact with the board at the same time to complete activities.
• SMARTInk/Calligraphic Ink creates stylized print as you write. Whatever is written or drawn on the SMARTBoard becomes an object in the SMARTNotebook, allowing for things to be resized or rotated.   (2:04)
• Multi-touch gestures enabled in Window 7 and Snow Leopard work with the SMARTBoard.
• Software development kit (3:28):  Example of a physics application developed by a 3rd-party developer.  The application supports two students working at the SMARTBoard at the same time

This video, in my opinion, does not provide viewers with the full range of possibilities that the new features provide.   I'd like to see a "redo" of this video using a live teacher and a group of students.  For example, it would be interested in seeing how the physics application would be incorporated into a broader lesson or science unit.   I'd love to hear what real students have to say as they interact with the physics application, too.

Comment:

I think a multi-user interactive timeline would be a great application for the new SMARTBoard, because students could work together to create and recreate events.  This would be ideal for history, literature, and humanities activities, across a wide span of grade levels.

ICE PAD: Interactive Multitouch Ice Sculpture by Art Below Zero (video)

ICE PAD: Interactive Multitouch Ice Sculpture by Art Below Zero


Here is the information about the interactive sculpture from the Art Below Zero YouTube Channel:

"Created by David Sauer & Max Zuleta for the Lake Forest Tree Lighting Festival.This Ice Crystal Display was the 1st to be created in the USA, Transforming 300 pounds of ice into the equivalent of a giant Ipad touch screen. "People always want to touch our Ice Sculptures, This Interactive Display gave them the perfect reason to get their hands cold." said Max Zuleta owner of Art Below Zero. The public response was amazement and interest in the workings of the touch screen in ice. Our favorite guess was "It must work by sensing body heat!"..."

"...The system is known as Rear Diffused Illumination or Rear DI. It works because an Infrared light is shone from the opposite side of the ice wall through the ice. When an object such as a finger, hand, or mitten stops the infrared light it reflects the light back to a custom camera built by Peau Productions. The illuminated objects are then converted to points of interaction using an open source program Community Core Vision which outputs TUIO data streams to a Flash program for animation. We like the look and feel of the Fluid Solver flash application. The output from the computer is then projected into the ice and ice diffracts the light into something beautiful. By this method the user can manipulate a visible light screen via an invisible light that only the camera can see..."


Thanks to Nolan Ramseyer, of PeauProductions, for the link!
PeauProductions Blog: Multitouch and Technology


RELATED
Ubice = Multi-touch On Ice at the Nokia Research Center in Finland (Video + Pic via Albrecht Schmidt)
Art Below Zero

More gesture and multi-touch interaction! Windows 7 Navigation with Kinect; Product browser by Immersive Labs,

Here are a couple of new natural user interface videos.  The first video, by Evoluce, demonstrates gesture interaction/navigation in Windows 7 applications supported by Kinect. The second video, by Immersive Labs, shows multi-touch product browsing interaction on a large display.

Kinect Treatment of Windows 7, by Evoluce

Evoluce: Leading Surface Technologies


Immersive Labs - Multi-touch Product Browser

Immersive Labs

Microsoft Surface Light and Physics App for Kids at the Smithsonian

Microsoft Surface at the Smithsonian


The Surface is located in the Smithsonian's Castle,  and is part of "The Wonder of Light: Touch and Learn!" exhibit, which opened on Tuesday, November 9th (2010).  Microsoft donated the Surface unit to the Smithsonian.


Below is  slideshow of the interactive exhibit:



The video below provides a closer look at the applications created by Infostrat for the Smithsonian exhibit:


RELATED
New Interactive Exhibit Opens in Smithsonian's Castle, Bringing Light To Life
Smithsonian News Release, 11/9/20

Josh Blake's post, Microsoft Surface and Magical Object Interaction.

Interactive iPad Apps for Kids with Autism: Could some of these be transformed for multi-touch tabletop activities?

I came across a great post about interactive iPad apps for special needs:

Ten Apple iPad Apps to Help Children with Autism
Joanne Carter, MacCreate 11/5/10


In this article,  Joanne Carter shares screen shots and detailed descriptions of a variety of iPad apps that support learning and communication skills of young people with autism.  You can find additional information about the apps discussed in the article by visiting the following links: 

Proloquo2go, Story_Builder, "Off we go" book series, Soundtastic, Visual Impact, Living Safely,  Tapspeak Sequence for iPad, iCommunicate for iPad, Autoverbal Talking Soundboard Pro, Is that Gluten Free?, and I Dress for Weather. 


I think that some of these apps have the potential to be transformed and tweaked for use on multi-touch, multi-user  tables such as the SMARTTable or Microsoft's Surface.  The aim would be to encourage paired and group communication and social skills among children with special needs.  I'll share my thoughts on this topic in a future post.

Quick Link: 3M Invests in Perceptive Pixel, Jeff Han's Multitouch Tech Company

3M Invests in Perceptive Pixel

"3M, through its 3M New Ventures business, has invested in Perceptive Pixel Inc., a developer of advanced multi-touch solutions based in New York City. Terms of the transaction were not disclosed.Founded by multi-touch pioneer Jeff Han in 2006, Perceptive Pixel is dedicated to the research, development and production of multi-touch interfaces for the knowledge worker. The company's hardware and software products enable users to manipulate complex datasets through a new class of intuitive, powerful and visually rich interface techniques. The combination of its technologies with those of 3M will create incredible new opportunities for both companies."

"To see Perceptive Pixel multi-touch solutions in action on 3M Projected Capacitive Technology, see the video at http://www.3m.com/touchPPI. For more information about 3M MicroTouch products, visit www.3M.com/touch. For an overview of popular touch technologies and terminology, visit www.touchtopics.com."

RELATED
3M Touchscreen Products and Systems

Catching up with multitouch pioneer Jef Han Ina Fried, Cnet 10/22/10

Jeff Han's 2006 Ted Talk



Jeff Han, 2007



Thanks to Seth Sandler for the link!

Designing for Multitouch Tables and Surfaces, by Erin Rose, Open Exhibits Blog

If you are interested in exploring collaborative tabletop applications, take a look at the Open Exhibits blog. Erin Rose's recent post, "Designing for Multi-touch Tables and Surfaces", is a good overview of lessons learned over the past couple of years in design, development, and implementation of multi-user interactive tabletop applications.

Although the focus of Open Exhibits is on applications and systems designed for museum exhibits, many of the design challenges hold true for similar applications in other settings, such as classrooms, libraries, and other public spaces.

Erin's post explores each of the following topics in more detail:

• Don't forget that the table is omni-directional.
• Individual control of objects encourages multi-user interaction.
• Promote collaboration, founded in healthy competition.

(Erin Rose is a developer and community liaison for Open Exhibits.)

RELATED
Exhibit Files
Jim Spadaccini
Visitors Explore L.A. in Google Maps and Flickr Mashup.

Grant from the National Science Foundation for Multi-touch Interactive Museum Exhibits!

This is interesting!

"Open Exhibits is a National Science Foundation-funded initiative to develop a library of free and open multitouch-enabled software modules for exhibit development. Build using the popular Adobe Flash and Flex authoring tools, museum professionals will be able to create innovative floor and web-based exhibits easily and inexpensively" -- Open Exhibits

VIDEO: Introducing Open Exhibits: Open Source Exhibit Software


Open Exhibits Core is based on the commercial GestureWorks software package.


RELATED
Open Exhibits Funded by the National Science Foundation
Jim Spadaccini, Open Exhibits Blog 9/21/10

About Open Exhibits
Jim Spadaccini, of Ideum, is the Principal Investigator of the Open Exhibits project.  Kate Haley Goldman is the co-PI and main researcher.  The three museum partners are the Don Harrington Discovery Center, the Maxwell Museum of Anthropology, and the New Mexico Museum of Natural History and Science. 


Ideum website

Future of Screens, Interactive Video Research, XNA 4.0 Multitouch, Pogue's Recent Post

Here are a few topics and links of interest:
THE FUTURE OF SCREENS, CIRCA 2014


If you haven't seen this short video clip, take a look. It was created by TAT MobileUI, and includes examples of how screen interaction can take place across a variety of surfaces and settings.

"This is the result of TAT's Open Innovation experiment. It is an experience video showing the future of screen technology with stretchable screens, transparent screens and e-ink displays, to name a few." TAT MobileUI. TAT stands for  The Astonishing Tribe. According to information from the TAT website, "TAT is a Swedish software technology and design company offering products and services that differentiate and enhance the user experience of portable devices. TAT is headquartered in Malmö, Sweden, and has local offices in Korea and USA."


Ola Larsén, the Vice President of Marketing at TAT, recently spoke at the ARM Multimedia conference in Taiwan, focusing on UX trends and tablets:    "Enabling a cross device connected user experience". To dig deeper, see the original post in Gizmodo and take a look at the comments:
The Future of Screens Circa 2014  (Kyle VanHemert, Gizmodo, 9/1/2010)


INTERACTIVE VIDEO RESOURCES/EXAMPLES
 I have a need to create "touchable" interactive video, and I plan to share what crosses my path on this blog from time to time.   Over the past several months, there has been some growth in the world of interactive video. The information below is just a beginning:


Interactive Video Research
Thanks to a link from Johannes Schöning,  I learned about the Dragon project, headed by Dr. Jan Borchers of the Computer Science Department at RWTH Aachen University in Germany. I haven't yet explored the research or used the application, which can be downloaded from the Dragon project website.  


Description (from the Dragon website): " DRAGON is a direct-manipulation interaction technique for frame-accurate navigation in video scenes. This technique benefits tasks such as professional and amateur video editing, review of sports footage, and forensic analysis of video scenes."
     "By directly dragging objects in the scene along their movement trajectory, DRAGON enables users to quickly and precisely navigate to a specific point in the video timeline where an object of interest is in a desired location. Examples include the specific frame where a sprinter crosses the finish line, or where a car passes a traffic light."
     "DRAGON is a research project by Thorsten Karrer, Malte Weiss, Moritz Wittenhagen, Jan Borchers and others at the Media Computing Group. It is funded in part through the German B-IT Foundation and the UMIC DFG Excellence Initiative."
Related Publication (more can be found on the Dragon website)
Christian Brockly. Evaluation of direct manipulation techniques for in-scene video navigation. Master's thesis, RWTH Aachen University, Aachen, Germany, February 2009.  

The following companies are involved in some form of interactive video work, mostly focused on marketing and advertising: INNOVID in-video innovation: "Existing Video ads can be intrusive and out of context. At Innovid, we believe that online video should be as interactive as the Internet is today, with many interchangeable elements that give the viewer dynamic content rather than a static succession of frames. We`re bringing this vision to life by innovating the way viewers interact with and engage with online video ads . iRoll®, our interactive pre-roll ad product, has powered the most interactive pre-roll campaigns with well-known brands and agencies." Innovid Platform iRoll® - Interactive Pre-roll Innovid Studio Innovid is hiring! Sales Account Executive - NYC Office Flash Programmer/designer Flash/Flex Developer Computer Vision Specialist Linux Server-Side Developer with strong IT orientation Article: Interactive video: A powerful beast (David Rossiter, iMedia Connection) QUICK.TV Quick.tv is a company co-founded by Nick Bell and Tod Yeadon.  The information about the company was in the process of being updated when I visited the website. I knew if I went to the iTVT website, I'd find more information about Quick.TV and interactive video, thanks to iTVT co-founder Tracy Swedlow: QuickTV in Interactive Video Partnership with Ooyala  (Tracy Swedlow, iTVT, 7/11/10) "According to Quick.tv, Ooyala customers will see a "seamless integration" of Quick.tv overlays into the Ooyala video player. The company says that a library of off-the-shelf widgets can be used to deploy interactive features quickly, while an advanced editor allows users to create their own custom widgets. "The widget approach is efficient and flexible," Bell continued. "It offers a wide range of monetization, engagement and editorial overlays for immediate use, whilst offering an editing facility with limitless creative potential for those who want to deliver a more specific user experience. The analytics generated by viewer interactions take video accountability and market intelligence to a new level." Howto.TV in interactive video partnership with Ooyala (Tracy Swedlow, iTVT, 7/13/10) Hotspotting: Overlay.TV integrates with MarketLive to power interactive video commerce for Armani/Exchange(Tracy Swedlow, iTVT, 9/1/2010) OOYALA Ooyala is a provider of video platform applications and services. Ooyala is involved in interactive video and has an iVideo API.  The company is expanding into the field of on-line educational video.  I'd would be great if they worked towards providing interactive video content for use on classroom interactive whiteboards! I Googled Ooyala and found out that the company recently raised more than $22 million: Ooyala Raises $22 Million to Accommodate Global Expansion.   OVERLAY.TV Overlay.TV: "Helping online retailers create, manage, and deliver interactive video experiences to drive traffic, increase conversion, and engage shoppers".  While browsing through the Overlay.TV website, I came across a series of posts worth reading: "Six Interactive Video Ideas to Get You Started" Related article: Ottowa company makes clickable fashionable (CBC News, 9/8/10) Comment:  I wish the emphasis was on touch, NOT click! KOKOKAKA Kokokaka Interactive (Ad company) Wrangler's Blue Bell Website - You can drag the character around, right inside of the video!

Demonstration of Drag Video Function (Bluebell Inventions)

I'm continuing my search for examples of the use of interactive video in education- particularly video produced for larger touch-screen displays or IWBs.


INTERACTIVE MULT-TOUCH GAMES SUPPORTED BY XNA 4.0?
Shaun Hargreaves Explains It All:
Touch input on Windows in XNA Game Studio 4.0

DAVID POGUE'S RECENT POST & COMMENTS FROM HIS READERS
RELEASED TOO SOON (David Pogue, NYT, 9/16/2010)
Since most of my readers are interested in emerging technologies, I thought I'd share a link to one of David Pogue's recent posts. David Pogue knows what he's talking about.  He's a guy who keeps up with new technologies better than most.   In the article, Pogue discusses his review of a new product, Vulkano, which was designed to record TV shows and also provide a means to watch shows via the internet.  Although his post focuses on the problems that can ensue when a product is marched to market before it is ready, the best part is the conversation generated by his post about this problem.  Pogue's comments struck a chord among people across a range of industries.  

The comments should be must-reads for university students preparing for careers in the world of business and technology!

For Multi-Touch Techies and the Tech Curious- Touch and Retouch article, with code samples, by Charles Petzold

Thanks to Josh Blake, I came across a good article by Charles Petzold  in the September 2010 issue of MSDN Magazine:
Touch and Response


In this article,  Charles Petzold continues his discussion of the multi-touch support in version 4 of Windows Presentation Foundation (WPF).  I like the introduction to his article:
"Programming is an engineering discipline rather than a science or a branch of mathematics, so rarely does there exist a single correct solution to a problem. Varieties and variations are the norm, and often it’s illuminating to explore these alternatives rather than focus on one particular approach." -Charles Petzold
I also appreciate Petzold's discussion about smooth Z transitions, his thoughtful code samples and related links.

RELATED
Multi-touch Manipulation in WPF 
Charles Petzold (August, 2010, MSDN Magazine, UI Frontiers)
"Just within the past few years, multi-touch has progressed from a futuristic sci-fi film prop to a mainstream UI. Multi-touch displays are now standard on new models of smartphones and tablet computers. Multi-touch is also likely to become ubiquitous on computers in public spaces, such as kiosks or the table computer pioneered by Microsoft Surface."

"The only real uncertainly is the popularity of multi-touch on the conventional desktop computer. Perhaps the greatest impediment is the fatigue known as “gorilla arm” associated with moving fingers on vertical screens for long periods of time. My personal hope is that the power of multi-touch will actually provoke a redesign of the desktop display. I can envision a desktop computer with a display resembling the configuration of a drafting table, and perhaps almost as large." -Charles Petzold

Exploring Multi-Touch Support in Silverlight
Charles Petzold (March 2010, MSDN Magazine, Finger Style)


Comment:
I agree with Charles about the need for a re-design of desktop displays.  I like the drafting table as a form factor.  Here are a couple of my previous posts related to this topic:
Emerging Interactive Technologies, Emerging Interactions, and Emerging Integrated Form Factors (2008)
DigiBoard Multi-Touch Mixed Reality Game; Ideas for future design of a flexible, adjustable multi-touch surface (June 2008)

For the iPad: Reactable Multi-touch Mobile

More details later!

RELATED
History of the Reactable


How it works (Info from the Reactable website)
"The way the Reactable works is deeply inspired by modular analogue synthesizers such as those developed by Bob Moog in the early 60s and enhances them with new concepts of sampling and digital effects processing."

"While with modular synthesizers one typically had to connect these different modules with patch cables in a complex and error-prone process, with the Reactable this is attained in a much easier and more intuitive way, since connections between the blocks are managed automatically based on their types and affinities and on their proximity."


Martin Kaltenbrunner (Co-founder of Reactable)
"His research concentrates on tangible user interfaces and the development of novel human computer interaction concepts within open tools for creative production. As co-founder of Reactable Systems he had been mainly working on the interaction design of the Reactable - an electronic musical instrument with a tangible user interface. He is author of the open source tangible interaction framework reacTIVision and the related TUIO protocol, which have been widely adopted for the realization of tangible tabletop applications."


SOMEWHAT RELATED
Soundythingie for the iPad
iPad Apps for Making Music: What's Coming Later
SurfaceDJ iPhone App (Vectorform)

Osmosis: Multi-touch systems for... everywhere!

Not long ago I had the opportunity to chat with Stuart McLean, the founder of Osmosis, a company that delivers customized multi-touch systems of hardware and software that support human-centered natural user interaction.   Stuart has many years of experience working in more traditional IT/business roles, and knows from this experience that there is  better way to support  human computer interaction, including interaction between people.

Like many of us in the "NUI" community, Stuart was impressed by the video of Jeff Han's 2006 TED Talk, which demonstrated a variety of awesome multi-touch, multi-user applications on a high-resolution drafting table.  Stuart saw the importance of natural user interfaces and interaction and became involved with the NUI Group, a "global research community focused on the open discovery of natural user interfaces". 

Unlike traditional tech companies, Osmosis is a collaboration between a global network of engineers, designers, and developers who share the "NUI" vision. This collaboration enables the company to provide solutions for clients across a range of countries, cultures, and domains.


Below is a photo-gallery of some of the applications and systems developed by Osmosis:


Multi-touch by Osmosis

GALLERY

As you can see from the gallery photos, Osmosis provides a range of possibilities for their clients and potential clients.  All of the displays are high-definition.  Some are projection-systems, and others are displays with multi-touch sensing technology.  Since the construction is modular, a variety of form factors are available.  High-quality surround and domed sound systems are available.  Applications include information kiosks, point of sale/digital signage, hospitality, presentation and training, education, and audio-visual performance and production.  Osmosis also provides applications that support interaction with tangible objects.

Below are two videos that give a taste of what Osmosis is all about:

OSMOSIS DEMO REEL

Demo Reel from Osmosis on Vimeo.

MULTI-TOUCH EVERYWHERE

MT Everywhere from Osmosis on Vimeo.

I can see where some of these applications would be great in K-12 educational settings.  Just look at the joy on the faces of the kids in the Multi-Touch Everywhere video!

(Short video clips of the Osmosis applications in action can be found in the showcase page of the company's website.)