Microsoft is acquiring Canesta, Inc., a developer of 3-D electronic perception technology for natural user interaction, gaming, and more.

Microsoft to Acquire 3-D Chip Firm Canesta
Michael Baron, TheStreet 10/29/10

Thanks to Harry Van Der Veen, of NUITEQ, for this link!

RELATED
The following video is from the Canesta3D YouTube channel. It demonstrates the 3D input sensor in action, with four people moving around in a living room. The chip used in the system depicted in the video was the precursor to the current chip, called the "Cobra 320x200".


Below is a demo of gesture interaction using Canesta3D technology to control and select information and content on a large display.  In my opinion, this will change the way we interact with our TV's, at least for those of us who hate using bad remotes!  Microsoft's acquisition of Canesta is good news, especially if they allow this technology to be used by the masses.   I'm pretty sure it has the capability of supporting  interaction with HD TV's are internet-ready, and can support GoogleTV, LeanBack, and Vimeo's Couch Mode.




Canesta Announces Definitive Agreement to be Acquired by Microsoft
Press Rease, 10/29/10, Canesta

About Canesta (From the Canesta website)
"Canesta (www.canesta.com) is the inventor of revolutionary, low cost electronic perception technology and leading provider of single chip CMOS 3-D sensors that fundamentally change the relationship between devices and their users. This capability makes possible true 3-D perception as input to everyday devices, rather than the widely understood 3-D representational technologies as output. Canesta’s 3-D input technology, based upon tiny, CMOS 3-D imaging chips or “sensors”, enables fine-grained, 3-dimensional depth-perception in a wide range of applications. Products based on this capability can then react on sight to the actions or motions of individuals and objects in their field of view, gaining levels of functionality and ease of use that were simply not possible in an era when such devices were blind. Canesta’s focus is on mass market consumer electronics, but many applications exist in other markets as well. Canesta is located in Sunnyvale, CA. The company has filedin excess of fifty patents, 44 of which have been granted so far."


Canesta Corporate Fact Sheet (pdf)
Videos: http://canesta.com/applications/consumer-electronics/gesture-controls

I posted some videos about Canesta's technologies on the following post. There are two videos that show Canesta's 3D depth camera works on a Hitachi flat-panel display: Interactive Displays 2009 Conference

For more information about interactive TV, GoogleTV, Leanback and Couch Mode, see the second section of my recent post:
Philipp Geist: Blending the Physical with the Digital;  Google TV/Leanback, Vimeo's new Couch Mode, oh..and ViewSonic's 3D (glasses-less) pocket camcorder...

Philipp Geist: Blending the Physical with the Digital; Google TV/Leanback, Vimeo's new Couch Mode, oh...and ViewSonic's 3D (glasses-less) pocket camcorder...

I'm thinking about getting one of the new "internet ready" TVs.  I have a serious reason to do this. I'm working on some interactive video projects, and a couple of my projects are geared for teens and young adults who have autism.*   My hunch is that many of my students would like to watch- and interact with-content optimized for Google TV and Vimeo's Couch Mode.  The content is designed to look good on larger high-resolution flat-screen displays, and I'm sure it would be great on my school's newer SMARTBoards.  I need to learn more about  developing applications for this purpose.

(Currently I use my HP 22-inch TouchSmart PC to view web-based video content, and to evaluate websites that provide "touchable" and interactive content that might work well on interactive whiteboards.)

At any rate,  I've been looking for great videos that have the potential for use at work with older students who have autism. I'm also looking for effective ways that the students can use to interact with multimedia and video content. This is important, since the students have minimal verbal communication skills, have limited reading ability- if they can read at all.  They learn about their world through visual means, and are capable of learning much more - but not through traditional means.

Since our school is focusing on globalization and learning about the cultures of other countries, I've been on the lookout for some interesting videos that might appeal to our students.  

Today I came across a great find- Philipp Geist.  Who is Philipp Geist?  According to his bio, Philipp works internationally as a light and multi-media artist in the mediums of video, performance, photography and painting. Some of his work focuses on architecture, history, and cultural heritage.  A good example of his work is the installation he created for a festival in Thailand in 2009:

Bangkok / Thailand 4D Light & Sound Installation by Philipp Geist (23Min) from Philipp Geist | Videogeist on Vimeo.

"The one-hour show is the central part of the celebrations and will be seen by thousands of visitors.  It interprets artistically the king's life and his work dedicated to public welfare. The art installation combines images of the kings and his social projects in the past and present with 3D animations of Thai natural and cultural heritage and abstract painterly passages." (from the Vimeo site)

Phillip Geist's Showreel

Philipp Geist Showreel 2009 from Philipp Geist | Videogeist on Vimeo.

HIGH-RES MULTIMEDIA WEB CONTENT ON LARGE PANEL HD TV!

This might boost holiday gift sales and in turn, give a little jolt to the economy. To do my duty for my country, I will continue to research Internet TV as I narrow down my selection for my new Internet-ready TV.... Below is some Information about Google TV, Google Leanback, and Vimeo's Couch mode that I've recently gathered to share with my IMT followers:

GOOGLE TV:  "The web is now a channel"

"With Google Chrome and Adobe Flash Player 10.1, Google TV lets you access everything on the web. Watch your favorite web videos, view photos, play games, check fantasy scores, chat with friends, and do everything else you're accustomed to doing online. Plus, the world's best websites are now being perfected for television -- check out our Spotlight gallery for examples."  "The worlds' favorite websites are being tweaked and perfected for the television." -Google TV

I'm not too excited about the design of the application that transforms your Android phone or iPhone into a remote control.  I hate most remote controls.  According to Google TV, multiple phones can control the same TV, and you can use your voice to search, which seems like it would be a good thing...  I wonder if they tested this out with real families, not just families of Google TV techies .

GOOGLE LEANBACK Video (Integrated into GoogleTV)

Google Leanback 
When I visited the Leanback website, I encountered the following screen with a suggestion that I type in what I was looking for.  I typed in "lynnvm", the name of my YouTube channel.  Apparently Google provides you with a randomly generated featured video that appears in the background that has nothing to do with what you are looking for.  


In this screen shot, my YouTube channel offerings are in the foreground. "Maleficent Halloween Tutorial" is what played in the background: 

VIMEO INTRODUCES COUCH MODE: Vimeo's version of Google's Leanback is Couch Mode.  It is optimized for use on Google TV, so that makes things less complicated in the world of videoviewingland.   According to Ryan Hefner's article on the Vimeo staff blog, "Couch Mode is a special new section of Vimeo that allows you to watch collections of videos (such as Staff Picks, your inbox, your videos, etc.) completely uninterrupted like a TV channel."
Couch Mode works on computers, but since it relies on HTML5 and CSS3, without Flash, it only works with Chrome and Safari browsers.  For more information, see the video below:



RELATED

VideoGeist: Media installation/mapping, visual art concepts, visual art

Philipp's Blog

VIMEO Couch Mode

Google TV

Google TV Web Site Optimization Guide

Google TV is coming to 10,000 lucky developers

"A few of our favorites include Net-A-Porter, which lets you watch runway videos and shop for high fashion; Meegenius, a place where you can read and customize children’s books; TuneIn, a personal radio for your TV; and The Onion which always gives us a good laugh." - Google TV Blog

MeeGenius If you are a teacher, parent, kid, or lover of children's books, visit this interactive website ASAP. It is optimized for Google TV and works nicely on touch-enabled screens and devices.

As I was wrapping up this post, I came across information about Viewsonic's new 3D, glassesless pocket camcorder.  I'll update information about this new gadget when I have a chance to learn more about it. !

Comment: The idea of developing interactive multimedia apps in 3D intrigues me. At this point, the technology is too new for an "armchair technologist" like me to pursue with my incredibly busy work obligations.  I don't have the money to buy a 3D video camera.  But I might try this out, if it is true that it only costs $238.00!

Viewsonic introduces 3Dv5 3D pocket camcorder, no glasses required
Darren Murph, Engadget, 10/20/10
Film Videos In 3D for Under $250 With Viewsonic's 3DV5
HotHardware, 10/28/10


* About me:  
I presently work full time as a school psychologist at a high school and at a program for students with more severe disabilities, including autism.  The students I work with have made amazing gains through the use of interactive multimedia applications, and also have responded well to video presented on the large IWB screens.   


I went back to school to take computer courses, initially so I could make interactive multimedia applications and games. I continue to blog about interactive multimedia,  emerging/ new technologies, and topics related to post-WIMP HCI/UX/ID/IA.  Although my "spare time" is limited,  I try to keep up my technical skills whenever I can by working on projects that can support the students I work with.  

Quick Link: 3M Invests in Perceptive Pixel, Jeff Han's Multitouch Tech Company

3M Invests in Perceptive Pixel

"3M, through its 3M New Ventures business, has invested in Perceptive Pixel Inc., a developer of advanced multi-touch solutions based in New York City. Terms of the transaction were not disclosed.Founded by multi-touch pioneer Jeff Han in 2006, Perceptive Pixel is dedicated to the research, development and production of multi-touch interfaces for the knowledge worker. The company's hardware and software products enable users to manipulate complex datasets through a new class of intuitive, powerful and visually rich interface techniques. The combination of its technologies with those of 3M will create incredible new opportunities for both companies."

"To see Perceptive Pixel multi-touch solutions in action on 3M Projected Capacitive Technology, see the video at http://www.3m.com/touchPPI. For more information about 3M MicroTouch products, visit www.3M.com/touch. For an overview of popular touch technologies and terminology, visit www.touchtopics.com."

RELATED
3M Touchscreen Products and Systems

Catching up with multitouch pioneer Jef Han Ina Fried, Cnet 10/22/10

Jeff Han's 2006 Ted Talk



Jeff Han, 2007



Thanks to Seth Sandler for the link!

Update on Josh Blake, newly designated Microsoft Surface MVP

Josh Blake is the Tech Lead of the InfoStrat Advance Technology Group in DC.  He has been creating multi-touch applications Microsoft's Surface multi-user table-tops for a while. Recently, his team built a suite of applications designed for use by young children at a museum.  Below is a video demonstration of some of this work. It really looks exciting!


Microsoft Surface and Magical Object Interaction

Josh Blake's blog is called Deconstructing the NUI- for those of you new to this blog, NUI stands for Natural User Interface (also known as Natural User Interaction).  See his post, Microsoft Surface and Magical Object Interaction, for more information!

RELATED
Here is a plug for Josh Blake's book, "Multitouch on Windows"

Book Ordering Information

FYI:  InfoStrat  is hiring  WPF experts as well as Microsoft CRM and Microsoft SharePoint experts.


Microsoft Surface MVPs
Dr. Neil Roodyn
Dennis Vroegop
Rick Barraza
Joshua Blake

Reactable Mobile - Music Creation and DJ-ing On-the-Go : This is why I need an iPad!

A couple of weeks ago I posted about the Reactible Mobile,  a fun "DJ" electronic music generator for the iPod and iPad, created by Reactable Systems, makers of the Reactable.  The Reactable is a multi-touch, multi-user system for music creation, sharing, and DJ-ing, but it comes in the form of a table. Even though one version of the Reactable, the Reactable Live! is portable, it is still pretty big.

In our increasingly mobile world, it's nice to know that now we can have something similar to take everywhere we go, with the Reactable Mobile that runs on the iPhone, iPod Touch, and the iPad. You can download and buy the Reactable Mobile app for the iPhone and iPad from the iTunes Store:  http://itunes.apple.com/app/reactable-mobile/id381127666?mt=8

The following videos provide a quick overview of how the Reactable app runs on mobile devices. The first video is a demonstration of "Verde", Le Freak Selector. The second video demonstrates the Reactable app on the iPhone, iPod touch, and iPad.





Reactable Mobile (Reactable Systems SL) Description  (Taken from the iTunes website)

"Improvise and create music playfully with the Reactable mobile. Based on the award winning Reactable as used by Björk on her Volta Tour, this application brings the full creative power of the famous interactive instrument onto your mobile device."

"It uses concepts of modular synthesis, sampling, digital audio effects, DJing, and combines them with modern human computer interaction and multi-touch technology.Based on the very same audio and graphics engine as the Reactable, the mobile version brings a complete range of objects to multi-touch devices:"
A set of generator objects:
- loop players, with possibility to upload your own loops,
- synthesizers, with a large range of instruments to select from,
- oscillators, to synthesise pure and complex tones,
- input, to get audio directly from the device's microphone.
A set of effects to modify generated sounds:
- wave shapers: distortion, compression, and resampling,
- delays: reverb, feedback, and ping-pong,
- modulators: ring modulation, chorus, and flanger,
- filters: low pass, high pass, and band pass.
A set of controller objects to modify other objects parameters:
- sequencers, with step-by-step, matrix, or random modes,
- low frequency oscillators (LFO), with different waveforms,
- accelerometer, to fetch data from the movement of the device.
A set of global objects to modify the settings of the entire table:
- tempo, to change the speed of the table,
- volume, to lower or increase the loudness,
- tonalizer, to change the harmony of the melody.
"IMPORTANT NOTE: A graphic resolution issue with iPod Touch 4G prevents using the version 1.0.3 on this device. An update is on its way.  Note: as this application uses both graphic and audio resources extensively, recent devices will provide the best user experience."

RELATED
There is a Reactable in an exhibit at the Discovery Science Center in Charlotte, N.C.  I had a chance to play with it during my last visit, and it was... awesome.   For more information, including pictures and video,  take a look at this post:
Reactable Live! at Sonar Barcelona 2010 (You can play with one at Discovery Place in Charlotte, NC.)

Here is a very short video-clip of the Reactable at Discovery Place. (Because of the noise in the background, it is a bit difficult to hear what I was trying to play.)


If you are interested in tangible user interfaces, including the Reactable and other similar systems, take a look my previous posts on the topic:
Tangible User Interfaces Part 11: More Examples, Resources, and Use for TUI's in Education
Tangiblie User Interfaces, Part I: Siftables

Light Space: Interaction with digital content across all sorts of surfaces! (Demo video: Hrvoje Benko and Andy Wilson, Microsoft Research)

Hrvoje Benko and Andy Wilson from Microsoft Research demonstrate a system that uses 3D depth support tracking and interpreting the interaction between people,  It also allows for manipulating digital content across a variety of surfaces.

Information Visualization Meets Augmented Reality?

Watch the video to find out:

Child-Computer Interaction: A Featured Community at the Upcoming CHI 2011 Conference!

Last year, I attended CHI 2010 and participated in a workshop about the next generation of HCI and education.  It was a wonderful opportunity to share ideas with people from all over the world who are interested in emerging technologies, kids, and education.  I plan to attend CHI 2011 in Vancouver, Canada next May 7-11, and even though the conference is months away, I can barely wait.  The good news it that the Child-Computer Interaction community will have an important presence at the 2011 ACM CHI conference.  I wanted to share a little bit about this development on this blog. 

During CHI 2010, I signed up for the  "Designing for the iChild" course.  In one afternoon, I learned more than I had expected, especially the technique called "Layered Elaboration", a collaborative design strategy that involves inter-generational teams of children and adults.  

One of the leaders of this course was Allison Druin, Associate Professor and director of the Human-Computer Interaction Lab at the University of Maryland.  Dr. Druin's focus is in the area of child-computer interaction and how children can be meaningfully involved as partners in the design process.  

The quote below, found on the HCIL Children as Design Partners website, explains why this is so important:

"We have a chance to change technology, but more importantly we have a chance to change the life of a child. Every time a new technology enables a child to do something they never dreamed of, there are new possibilities for the future."  -Allison Druin

In my work as a school psychologist, I use technology with students quite often, especially when I'm at Wolfe, a program for students who have more complex disabilities, including severe autism.  I have been fortunate to have a new SMARTBoard at my fingertips, and access to the school's SMARTtable.  I learn from my students every day.

I believe that we are only at the "tip of the iceberg" with this sort of technology- and related applications such as the iPad and similar devices.   In my experience, well designed technologies and applications can open up a meaningful window to the world for children, teens, and others with disabilities.

Most of the information below was taking from the CHI 2011 conference website:

About the Child-Computer Interaction (CCI) community:

"At CHI, the CCI community will want to attract papers and contributions that represent real advances in the understanding of, or development and refinement of methods for, child computer interaction. It will also seek to unearth groundbreaking innovations addressing the needs, capabilities and preferences of children that have the potential to become reference works for developments in this field."

"By its very nature, The CCI community will have to be divergent in its thinking at CHI; it must also be about two of the mainstream CHI communities – engineering and design, but will potentially also be concerned with many of the communities of technologies (Smart devices, surfaces, mobile), of experiences (Play, Learning, Communication) and of methods (participatory design, evaluation)." ....

"Child Computer Interaction is a new community for CHI. It is a place for contributions where a method or a design is proposed that is especially suited to children and that could not sensibly be easily adapted for adults.  

We are keen to have contributions to all the usual CHI tracks but are also offering four special tracks for our own extra special community. These are:

• Child Partnership Projects (CPP): A design competition for teams that include children.

• Participatory Papers: Scholarly publications that are disseminated for children readers. (i.e. written in a different way)

• Lessons from the Trenches: Targeting industrial cases and experiences. A lively venue where experiences can be exchanged, and researchers can be exposed to the realities of industrial practice in this domain.

• Theatre pieces: High quality video contributions, available in a library after the conference, of methods that can be re used and learned from."

Child-Computer Interaction Chairs:
Janet C. Read
University of Central Lancashire
Panos Markopoulos
Eindhoven University of Techology
Allison Druin
University of Maryland
childcomputerinteraction@chi2010

RELATED
Walsh, G., Druin, A., Guha, ML, Foss, B., Golub, E., Hatley, L (2009)  [PDF] Layered Elaboration: A New Technique for Co-Design with Children.  ACM CHI 2009 

Essential Interaction Design Essays and Articles: Dan Saffer's Lists, Don Norman, and Interactions Magazine

I came across a link about Dan Saffer's recent post, Essential Interaction Design Essays and Articles.  Equally important is Dan Saffer's List:  Top Ten Essential Interaction Design Books. 

Dan Saffer is one of my "important influences".  When I was taking HCI and Ubiquitous Computing courses, I bought the first edition of his book,  Designing for Interaction:  Creating Innovative Applications and Devices.  In today's world of technical convergence, it is an important read, as Saffer's content crosses a number of disciplines.

Thoughts:
It doesn't surprise me to learn that the #1 book on Saffer's Essential Interaction Design Books list is  list is Don Norman's The Design of Everyday Things.  According to Saffer,  "there’s no getting around it: this is the book. Affordances, mental models, and other bits that have all become part of the general lexicon all started with The Don’s book. A must read." 

Don Norman's book was required reading in the Human-Computer Interaction class I took a few years ago.  As I read through the book, I sensed a familiar tone.  I later learned that Don Norman was the co-author of a required textbook for one of the psychology courses I took when I was a university student the first time around.    



Don Norman's thinking has influenced me for decades - he continues to be an influence, because he writes articles for one of my favorite publications, Interactions Magazine:



It brightens up my day when I open up my mailbox- the one at the end of my real-life driveway- and find my Interactions magazine, in all of its well-designed, well-written,  semi-glossy-paged glory, waiting for me to open up and read.   The September/October, 2010 issue includes articles on topics related to authenticity in new media, the complexity of "advancement", design and usability, and the politics of development. 


A must-read is Gestural Interfaces: A Step Backwards in Usability, co-authored by Don Norman and his collaborator, Jakob Neilson, 

Here is an excerpt from the article, which highlights some of the problems of rushing to get products with natural-user interfaces out to market:

"Why are we having trouble? Several reasons:

• The lack of established guidelines for gestural control
• The misguided insistence by companies (e.g., Apple and Google) to ignore established conventions and establish ill-conceived new ones.
• The developer community’s apparent ignorance of the long history and many findings of HCI research, which results in their feeling empowered to unleash untested and unproven creative efforts upon the unwitting public"

(Interactions Magazine is a publication of ACM CHI -Association of Computing Machinery, Computer-Human Interaction interest group).


Other articles by Don Norman, published in Interactions Magazine:
The Research-Practice Gap: The Need for Translational Developers 
Natural User Interfaces are not Natural 
The Transmedia Design Challenge: Technology that is Pleasurable and Satisfying
Technology First, Needs Last: The Research-Product Gulf
To be published, available on the jnd website:
Systems Thinking:  A Product is More Than The Product  


SOMEWHAT RELATED
My resource pages:
RESOURCES: Natural User Interaction, InfoViz, Multi-touch, Blog roll, and More - a huge mega-list of links! 
Conferences, Research, Resources page


Living with Complexity
Donald Norman, to be release in October 2010



Interactions Archives


Here are a list of books/articles, suggested by Dan Saffer's readers:


Designing for Interaction – Saffer, D. (2nd Edition; 2009)
Thoughts on Interaction Design – Kolko, J. (2009)
The Humane Interface – Raskin, J.
Digital Ground – McCullough, M.
Inmates are running the Asylum – Cooper, A
Designing Interactions – Moggridge, B (ed.)
Everyware – Greenfeild, A.
Designing Social Interfaces – Malone & Crumlisch
Emotional Design – Norman, D.
Invisible Computer – Norman, D.
Persuasion Technology – Fogg, BJ
Thoughtful Interaction Design: A Design Perspective on Information Technology by Jonas Lowgren and Erik Stolterman (Paperback – Mar 30, 2007)
Designing Visual Interfaces by Mullet/San
Steve Krug – Don’t Make Me Think: A Common Sense Approach to Web Usability
Design Research: Methods and Perspectives edited by Brenda Laurel 
Information Architecture (“The Polar Bear Book”) by Peter Morville.


Thanks to Putting People First for the link to Dan Saffer's list!

Grant from the National Science Foundation for Multi-touch Interactive Museum Exhibits!

This is interesting!

"Open Exhibits is a National Science Foundation-funded initiative to develop a library of free and open multitouch-enabled software modules for exhibit development. Build using the popular Adobe Flash and Flex authoring tools, museum professionals will be able to create innovative floor and web-based exhibits easily and inexpensively" -- Open Exhibits

VIDEO: Introducing Open Exhibits: Open Source Exhibit Software


Open Exhibits Core is based on the commercial GestureWorks software package.


RELATED
Open Exhibits Funded by the National Science Foundation
Jim Spadaccini, Open Exhibits Blog 9/21/10

About Open Exhibits
Jim Spadaccini, of Ideum, is the Principal Investigator of the Open Exhibits project.  Kate Haley Goldman is the co-PI and main researcher.  The three museum partners are the Don Harrington Discovery Center, the Maxwell Museum of Anthropology, and the New Mexico Museum of Natural History and Science. 


Ideum website