More News, Videos, and Links About Multi-touch and Screen Technologies: Eatang's "Holographic" Multitouch, Globacore & Blue Ocean Screens; NextWindow, NUITEQ, FingerTapps, Stantum, GUNZE USA, GestureTek

This post was recently updated and moved. You can find it at by visiting the link below:

UPDATED: More News, Videos, and Links about Multi-touch and Screen Technologies

Interactive Mobile Multimedia

A study in January of 2005 by Nokia indicated that there was a demand for interactive mobile multimedia services. That study was conducted about five years ago, before anyone had heard of the iPhone!   The technology to support interactive mobile multimedia has come a long way since then, and many of the new applications support multi-touch, or at least duo touch interactivity.

I'm very much interested in figuring out how to design web-based interactive content (and apps) that can be optimized for touch (and multi-touch/gesture) screens of various sizes, from SmartPhones/iPhones to the large interactive whiteboards that are now in a multitude of classrooms.

From my experience as a school psychologist, I know that there are many teens who have graduated from traditional cell phone to the next level.  If they don't have an iPhone, they have a smart phone.  I don't have the statistics on this, but my personal observations tell me that there are teens who come from families who are from lower economic status who are somehow able to own 3G smartphones.

What a great opportunity to provide casual interactive multimedia educational games to support student learning!  The games and activities could be assigned as homework from time to time, and with the appropriate LMS (Learning Management System), the teacher would have instant access to student progress.  In addition, the students would be provided with immediate feedback about their "work", which we know is an important factor in learning.

It is difficult to figure out the best path to forge, since nearly every week someone announces a new platform, technology, and programming approach!

At any rate, here are a few interesting things related to this topic that I'd like to share.  Many of these concepts are in the experimental phase, but are worth some attention.


SciLor's Open-Source Programs
SciLor's HD2/ Leo Multi-touch Demo v2 12/3/09 using VB.Net and Windows Mobile

SciLor's Comments: 
I have manged it to get Multitouch running in an vb.net app :)
There are still some bugs, which have to be resolved:
-Stop auto alignment!
-Identify the "Touches"


Google I/O 2009: Mastering the Android Media Framework


AT&T Interactive Mobile Website


Satellite-Terrestrial Network Delivering Mobile Video with Interactive Services - ICO mim





RELATED
Adding Multi-Touch to Your Windows Mobile Application's User Interface
Wei-Meng Lee,  DevX.com 3/24/08
Previous Post:  The new 3G iPhone:  Expanding the Possibilities of Interactive Multimedia Communication (Interactive Multimedia Technology,  6/9/08)
Note: I just skimmed the following articles - when I have more time, I'll post more of my reflections related to this set of topics.

Rethinking context framworks: Enabling cross-domain, cross-device experiences (pdf)

Daniel Stewart, Nitya Narasimhan,  Position Paper, CMPPC Workshop, Pervasive 2007

Interactive Mobile Multimedia Needs IP and Circuits
Brough Turner,  Internet Telephony, 9/09
Primetime for Mobile Television:  Extending the entertainment concept by bringing together the best of both worlds (pdf)  IBM Institute for Business Value
A Holistic Approach to Enhance Universal Usability in m-Learning
Vlado Glavinic, Sandi Ljubic, Mihael Kukec, 2008 The Second International Conference on Mobile Ubiquitous Computing, Systems, Services and Technologies
Seamless Mobility: A Continuity of Experiences across Domains, Devices, and Networks (pdf) 2005
Raghu Rau, Senior Vice President of Marketing, Motorola
Ambient Networks:  Cooperative Mobile Networking for the Wireless World
Norbert Niebert, John Wiley and Sons LTD  4/07 
Mobility management challenges and issues in 4G heterogeneous networks (link to ACM pdf)
Sadia Hussain, Zara Hamid and Naveed S. Khattak, InterSense '06.  Proceedings of the first International Conference on Integrated Internet Ad hoc and Sensor Networks
Mobile Multimedia: Tune in to Digital Convergence (pdf)
DVB-Scene (a trade magazine) 3/2008
HP OpenCall Media Plafform: a cost-effective, agile IP media server (pdf)
Whitepaper, Hewlett-Packard Development Company, L.P.  2/2009
A survey of wireless multimedia sensor networks (pdf)
Ian F. Akyildiz, Tommaso Melodia, Kaushik R. Chowdhury, 2006  Science Direct  Elsevier


Mobile Multimedia Companies/R&D
Stantum  (UMPC)

Movidity
MobIME: Mobile Internet for Media and Entertainment

Good news about the San Jose Interactive Displays Conference (that I couldn't attend)

Sadly, I was unable to attend the Interactive Displays conference that was held last week in San Jose, California. Jeff Han, the guy in the video clip in my sidebar, was one of the keynote presenters. I really wish I could have seen - and touched - the action!

Update (4/27/09) from Thomas Hansen, a member of NUI Group, who attended IDC:

"..It was certainly an interesting event. I got to talk (albeit briefly) to both Andy Wilson and Jeff Han. Both of whom produce very inspiring and world class UI/HCI research on a consistent basis. Further, it was a great honor to meet some of the other members of the nuigroup community in person, some of whom where inspiring not only because of their amazing intellect and artistic talents, but especially due to their friendliness, benevolence, and maturity."

Here are a few excerpts from people who were fortunate to attend and then write about the experience:

Putting our arms around the future of touch Ina Fried , CNET 4/23/09

"..if you used one of the interactive displays here to show a heat map of this industry, it would glow red hot. That's because touch displays, for years relegated to kiosks and industrial uses, are quickly becoming mainstream. Hewlett-Packard and Dell already have touch-capable machines, while Microsoft is set to make gesture input standard with Windows 7...For his own part, Han said he was inspired by seeing a PBS documentary in the early 1980s that showed Microsoft researcher Bill Buxton, then at the University of Toronto, using multitouch to compose music on a computer. The computer itself was a green screen with an ancient processor and little memory, but the key underlying concept was already there..

"Sometimes it takes that long for these things to marinate and gestate," Han said....And while things are now taking off, Han urged the crowd not to forsake quality in the rush to take advantage of a hot market. "That will ruin it and mess it up for all of us, and that would be a real shame," Han said."

Interactive Displays Conference Highlights Kevin Arthur, Touch Usability 4/22/09

"...He (Jeff Han) showed a great clip from an early 80s TV show called Bits and Bytes that featured a young Bill Buxton demonstrating some of his tablet work at the University of Toronto...Jeff Han's point in showing this clip was not just to share what inspired him as a kid to pursue computer science as a career. He also wanted to make the point that none of this stuff is really new. He urged the audience not to jump on whatever tech is cool this week, but to be aware of the history and to do the research. Be thoughtful and careful about what you're making. He said one of his fears with the multitouch craze is that the waters will be poisoned by bad and poorly conceived implementations. He said "don't add noise" to the ecosystem by using terms sloppily -- like "multitouch"...

The importance of being more thoughtful and mindful of prior work are not exactly new to most of us with design, HCI, or CS backgrounds, but the audience here is largely made up of marketing or other business types, I believe, who sometimes tend to get a bit carried away, you might say. I mean no disrespect to my friends in marketing..."

Interactive Displays Conference San Jose Harry van der Veen, 4/25/09
" Big thumbs up for Pira tech for managing to get so many multi-touch industry professionals (Wacom, Mindstorm, NextWindow, 3M, Jeff Han (Perceptive Pixel), LG, Tyco Electronics, Stantum and more) and hobbyists together."

NUI-Group's Christian Moore Interview-Podcast on the Interactive Display 2009 Conference website

As I write this post, the 2009 Interactive Displays conference is underway in San Jose, California. The home page of the conference website provides a series of interviews of many of the conference participants and presenters, including Chris Moore, a member of the NUI group. Chris discusses the importance of the open-source NUI (natural user interface) community in moving interactive display and NUI-based technology forward.

Interactive Displays 2009 Conference Website

Interview Participants:
Mats Johansson - EON Reality
Guillaume Largillier - Stantum
Christian Moore- NUI Group
Brent Bushnell- Tapcode
Steven Bathiche - Microsoft
Jerry Bertrand - Microscent
Henry Kaufman- Tactable

If you are at the conference and you have some video clips to share of a presentation, demonstration, or anything else that might be of interest, please give me the link so I can share it on my blog.

Below are some pictures from the companies represented by the people who were interviewed for the Interactive Displays 2009 conference:


Eon Reality


Tactable


Microsoft's Surface


NUI-Group


Tapcode


I don't usually put company logos on my blog, but if you are a visiting my blog searching for links to companies that are involved with interactive display technologies, this will save you some time. (I received no payment for this gesture.)

Interactive Displays 2009 Conference: Tuesday, April 21 -Thursday April 23, Hilton San Jose, California

The Interactive Displays Conference, sponsored by Intertech Pira, will highlight an interesting mix of existing and emerging interactive display technologies and applications. The conference will be held at the Hilton in San Jose, California, from Tuesday, April 21st through Thursday, April 23rd.

The pre-conference seminar will feature Sakuya Morimoto, of CANESTA, who will present his company's innovative single-chip 3D image sensor technology that supports gesture interaction.
Keynote speakers will be Jeff Han, of Perceptive Pixel, and Steven Bathiche, of Microsoft US.

Some Highlights:

Pre-conference Seminar: Gesture Navigation in the World of Digital Contents, Enabled by a Single-Chip 3D Image Sensor Presenter: Sakuya Morimoto, Senior Director, Business Development in Asia, CANESTA, Japan

Related:
Hitachi at CES 2009: Use of Canesta's 3D sensor to control television and home systems using hand gestures.


"With the wave of a hand, with the shake of a hand, you can control volume, you can actually change the channels, watch your favorite program...the most exciting thing, I think, is that you can actually control your temperature and the lighting in the room, the environmental lighting. So..it is very unique technology that is out there.."

Another demonstration of Hitachi's gesture interaction using the Canesta's 3=D Depth camera:



When a TV Remote is Just Too Much Effort, Wave -Jennifer Bergen, PC Magazine
CANESTA Corporate Fact Sheet (pdf)

How does Canesta's Electronic Perception Technology Work?
"Canesta’s electronic perception technology forms 3-D, real time moving images in a single chip through patented methods which use light photons to “range” the image, similar to radar. The silicon sensor chip develops 3-D depth maps at a rate in excess of 30 frames per second, and then performs additional processing on these depth maps to resolve the images into application specific information that can easily be processed by embedded processor(s) in the end-use device or machine. Since Canesta’s software starts with a three-dimensional view of the world, provided immediately by the hardware, it has a substantial advantage over classical image processing software that struggles to construct three-dimensional representations using complex mathematics, and images from multiple cameras or points of view. This dramatic reduction in complexity makes it possible to embed the processing software directly into the chips themselves so they may be used in the most cost-conscious applications."


I will highlight some of the featured presentations in future blog posts:

Steven Bathiche, Director of Research, Applied Sciences Group, Entertainment and Devices Division MICROSOFT, US
Guillaume Largillier, Chief Strategy Officer and Co-Founder, STANTUM, France
Jeff Han, PERCEPTIVE PIXEL, US
Mark Fihn, Publisher, VERITAS ET VISUS, US
Derek Mitchell, Conference Producer, INTERTECHPIRA, US
Vinita Jakhanwal, Principal Analyst, Small/Medium Displays, ISUPPLI CORPORATION, US
Joseph Carsanaro, President and CEO F-ORIGIN, US
Tommi Ilmonen, CEO MULTITOUCH OY, Finland
Stephen Sedaker, Director of Component Sales WACOM TECHNOLOGY CORPORATION, US
Brad Gleeson, Managing Director, Business Development TARGETPATH GLOBAL LLC., US
Henry Kaufman, President and Founder, TACTABLE, US
Christophe Ramstein, Chief Technology Officer, IMMERSION CORPORATION, US
Mary Lou Jepsen, CEO, PIXEL QI, US
John Newton, Chief Technology Officer, NEXTWINDOW, New Zealand
Herve Martin, CEO, SENSITIVE OBJECT, France
Scott Hagermoser, Gaming Business Unit Manager 3M TOUCH SYSTEMS, US
Bob Cooney, Vice President, Business Development, ECAST, US
Brent Bushnell, Chief Technology Officer UWINK, US
Stephan Durach, Head, Technology Office, BMW GROUP, US
Jeff Doerr, Senior Manager, Business Development Self Service Solutions Group, FLEXTRONICS, US
Andy Wilson, Senior Researcher, Adaptive Systems and Interaction Group, MICROSOFT, US
Mats W. Johansson, Chief Executive Officer, EON REALITY, US
Lenny Engelhardt, Vice President for Business Development, N-TRIG, Israel
Dr Paul Diefenbach, Director, RePlay Lab, DREXEL UNIVERSITY, US
Andrew Hsu, Technical Marketing and Strategic Partnerships Manager, SYNAPTICS, US
Dean LaCoe, Business Development Manager, GESTURETEK, Canada
Keith Pradhan, Global Director of Product Management, TYCO ELECTRONICS, ELO TOUCHSYSTEMS, US
Jerry Bertrand, Managing Member/Acting CEO, MICROSCENT, LLC, US
Frederic Kaplan, CEO and Co-Founder, OZWE, Switzerland

Related

Visionary Jeff Han and Microsoft's Steven Bathiche to Keynote at Interactive Displays 2009