CNN's Magic Wall Conspiracy Thriller on the Daily Show: John Oliver, Jeff Han, John King and a cast of TouchScreens and Windows...

"I needed to find a screen-free environment!" -John Oliver

"It's good to be King." - John King, after disposing of John Oliver...

I just took a look at a hilarious episode about interactive multi-touch screens and a conspiracy theory on the Daily Show. The episode features Jeff Han, the creator of CNN's Magic Wall, John Oliver, John King, and others from CNN.

Enjoy!



Via John Herrman and Gizmodo


If you are interested in multi-touch technology, feel free to do a search for additional information on this blog. The following post includes Jeff Han's demonstration of his multi-touch applications from TED 2006, along with resources and links:

Multi-touch and Flash: Links to Resources, Revisiting Jeff Han's TED 2006 Presentation

Note: If you are a parent, please screen the video clip before deciding if it is OK for your child to view.

Update from Multi-Touch Barcelona and Guten Touch: Multi-Touch Space Invaders

Multitouch Space Invaders Basic Demo from multitouch-barcelona on Vimeo..

For more sights and sounds from this group, visit the Red Bull Music Academy Barcelona 2008 website.

For more about multi-touch technology, including DYI instructions for creating multi-touch tables and displays, open-source code,and tutorials, visit the NUI Group website.

More from Hewlett Packard: a TouchSmart Notebook!

The new HP TouchSmart tx2 Notebook is duo-touch, with a swivel display. You can use a stylus or your fingertips to interact with the screen. The price listed on the site is $1,149.99, but it s a bit more expensive if you order "the works".




According to the HP website, some models of the notebook come with a built-in fingerprint reader to assist with log-on or lock-up functions. It includes integrated Altec Lansing stereo speakers and supports multimedia entertainment applications. The screen is 12.1", with an HP BrightView LED display. It is capable of playing HD content.

Watch the video:
http://h30440.www3.hp.com/campaigns/tx2/demo/Model.html

Explore the features in the interactive presentation.
http://h30440.www3.hp.com/campaigns/tx2/demo/Model.html


Read the WSJ Market Watch article:


"The enhanced HP MediaSmart digital entertainment software suite on the tx2 allows users to more naturally select, organize and manipulate digital files such as photos, music, video and web content by simply touching the screen.

"Breezing through websites and enjoying photos or video at the tap, whisk or flick of a finger is an entirely new way to enjoy digital content on a notebook PC," said Ted Clark, senior vice president and general manager, Notebook Global Business Unit, Personal Systems Group, HP. "With the introduction of the TouchSmart tx2, HP is providing users an easier, more natural way to interact with their PCs, and furthering touch innovation." "

The notebook uses capacitive touch technology, and supports gestures such as "pinch, rotate, arc, flick, pres and drag, and single & double tap."

For more information, see Hugo Jobling's recent post on the TrustedReviews website.
The touch-screen in HP's products are from NextWindow. NextWindow now has drivers that will work with the upcoming Windows 7, which will allow for multi-touch applications.

FYI: Video clip of HP's TouchSmart single-touch interaction, from July 2008:


From Andy Vandervells' Trusted Reviews post, "Hands On with the HP TouchSmart"

Video of touch interaction on a HP TouchSmart, with NextWindow's Gesture Server Technology

Here is a short video clip of some TouchSmart interaction:



The video shows the new NextWindow Gesture Server Application.

Info from the NextWindow website:

"NextWindow Gesture Server Application in conjunction with a NextWindow touch screen enables two-touch gestures to be used on the Microsoft Windows Vista desktop and certain applications.

You perform a gesture by double-tapping or dragging two fingers on the touch surface. The Gesture Server interprets these actions as commands to the operating system. For example a two-touch vertical drag on the Vista desktop can adjust the computer's audio volume control up or down as required."

Also from the website:

Vertical scroll: drag two fingers up or down the touch screen.

Horizontal scroll: drag two fingers left or right on the touch screen.

Zoom: move two fingers apart or together.

Double Tap: double-tap two fingers on screen.

"You can enable or disable the two-touch functionality and adjust the sensitivity of each of the four two-touch gestures. You can also select the command that is executed with the double-tap gesture."

Interactive Information Visualization: Flare & Flex; Visualization Links from Crisis Fronts

A big part of interactive multimedia is visualization, and with the latest tools, interesting things are happening!

Flare is a visualization tool for the web, and utilizes Adobe's Flex SDK, an ActionScript 3 Compiler, and Flex Builder. Basically, it is an ActionScript library, and the applications run in the Adobe Flash Player.

It was developed by the University of California, Berkeley Visualization Lab, which contains a wealth of resources and information about the visualization lab's projects and presentations.

Additional information, including tutorials, source code, sample applications, API documentation, and a help forum can be found on the Flare website

An interactive visualization created with Flare.


Here are some cool links about data visualization, via Sebastian Misiurek, of the Crisis Fronts: Cognitive Infrastructures blog:

Infosthetics

Wordle

Simple Complexity

Strange Maps

Sebastian also recommends the following papers (pdf):

Information Aesthetics in Information Visualization

Artistic Data Visualization: Beyond Visual Analytics


I especially like the description of the Crisis Fronts project:

"Crisis Fronts is the Degree Project studio and seminar run by Michael Chen and Jason Lee, with Gil Akos and Ronnie Parsons at Pratt Institute’s School of Architecture.

Crisis Fronts is an ongoing inquiry into contemporary global crises that suggest new demands and agendas for architecture, and the potential afforded by parametric and generative digital design tools to engage them."

OpenFrameworks & Interactive Multimedia: Funky Forest Installation for CineKid

The Funky Forest was created by Emily Gobeille and Theodore Watson for the 2007 CineKid festival in the Netherlands, using OpenFrameworks, an open-source application used for multimedia and multi-touch applications. Take a look at the video and pictures of the children interacting with this technology!

"It “is a wild and crazy ecosystem where you manage the resources to influence the environment around you. Streams of water flowing on the floor can be diverted to make the different parts of the forest grow. If a tree does not receive enough water it withers away but by pressing your body into the forest you create new trees based on your shape and character. As you explore and play you discover that your environment is inhabited by sonic life forms who depend on a thriving ecosystem to survive.”

The trees and creatures in the installation look really beautiful; just abstract enough to make it look like a strange magical forest, but the processes of our real ecosystems are still recognisable. A really wonderful project. And it sure looks like a lot of fun!" -Tanja, from the TakeBigBites blog

Every Surface a Computer: "Scratch" Capturing Finger Input on Surfaces using Sound. Video by Chris Harrison and Scott Hudson's Video - UIST '08

Chris Harrison and Scott Hudson, from the Human-Computer Interaction Group at Carnegie-Mellon University, presented their latest research at the UIST '08 conference. Take a look at the video below to see how gestures that result in sounds can can transformed on unpowered finger input surfaces, using a stethoscope sensors and filters:



Yes, every surface is a computer!
(Even your pants...)

For detailed information, read the paper presented at UIST '08 by Chris Harrison and Scott E. Hudson:
Scratch Input: Creating Large, Inexpensive, Unpowered, and Mobile Finger Input Surfaces

RELATED:

The Best Paper Award at UIST '08 was "Bringing Physics to the Surface", by Andrew Wilson, of Microsoft Research, and Ahahram Izadi, Otmar Hilliges, Armando Garcia-Mendoza, and David Kirk, of Microsoft Research, Cambridge.

Here is the abstract:

"This paper explores the intersection of emerging surface technologies, capable of sensing multiple contacts and of-ten shape information, and advanced games physics engines. We define a technique for modeling the data sensed from such surfaces as input within a physics simulation. This affords the user the ability to interact with digital objects in ways analogous to manipulation of real objects. Our technique is capable of modeling both multiple contact points and more sophisticated shape information, such as the entire hand or other physical objects, and of mapping this user input to contact forces due to friction and collisions within the physics simulation. This enables a variety of fine-grained and casual interactions, supporting finger-based, whole-hand, and tangible input. We demonstrate how our technique can be used to add real-world dynamics to interactive surfaces such as a vision-based tabletop, creating a fluid and natural experience. Our approach hides from application developers many of the complexities inherent in using physics engines, allowing the creation of applications without preprogrammed interaction behavior or gesture recognition."
Preparation for the Internet of Surfaces & Things?



(Cross-posted on the Technology-Supported Human World Interaction blog)

Multi-touch and Flash: Links to resources, revisiting Jeff Han's TED 2006 presentation

Despite the increase in interest in systems that support multi-touch, multi-user multimedia interaction, there is a need for creative, tech-savvy types to develop innovative applications. Why? This technology has the potential to make a powerful impact on how people learn, communicate, solve "big picture" problems, and do their various jobs.

CNN's Magic Wall was one of the first applications to gain the attention of the masses, as it was used as an interactive map during the US presidential election process. Touch-screen interaction gained even more notice after the recent SNL parody by Fred Amisen.

If you think about it, the multi-touch applications you see on the news aren't much different than what you'd get from a "single-touch" program.

Fancy, yes. Truly innovative, no.

Just imagine a 3D multi-touch, multi-user, multimedia version of Google Search. I did. I put my sketches in my idea book and hurt my brain thinking about how it could be coded.

Jeff Han, the man behind Perceptive Pixel and CNN's magic wall, had much more up his sleeve when he demonstrated his work at TED 2006. Even if you've previously seen this video, it is worth looking at again. (I've provided a link to the transcript below.)



Transcript of Jeff Han's TED 2006 Presentation

This video presentation had a transformational effect on me as I watched for the first time. Jeff Han brought to life ideas that were similar to my own as a beginning computer student thinking about collaborative educational games and multimedia applications that could be played on interactive whiteboards.

Here are some selected quotes from the video:

"I really really think this is gonna change- really change the way we interact with the machines from this point on."

"Again, the interface just disappears here. There's no manual. This is exactly what you kind of expect, especially if you haven't interacted with a computer before."

"Now, when you have initiatives like the hundred dollar laptop, I kind of cringe at the idea that we're gonna introduce a whole new generation of people to computing with kind of this standard mouse-and-windows pointer interface. This is something that I think is really the way we should be interacting with the machines from this point on. (applause)"

"Now this is going to be really important as we start getting to things like data visualization. For instance, I think we all really enjoyed Hans Rosling's talk, and he really emphasized the fact that I've been thinking about for a long time too, we have all this great data, but for some reason, it's just sitting there. We're not really accessing it. And one of the reasons why I think that is, is because of things like graphics- will be helped by things like graphics and visualization and inference tools. But I also think a big part of it is gonna be- starting to be able to have better interfaces, to be able to drill down into this kind of data, while still thinking about the big picture here."

So now what?

A recent post by "Alex", on the AFlex World blog discusses a few solutions. Alex had a chance to meet with Harry van der Veen and Pradeep George from the NUI Group, and Georg Kaindl, a multi-touch interaction designer from the Technical University of Vienna. The focus of the discussion was to come up with ideas to encourage Adobe/Flash designers and developers to learn more about multi-touch technology and interaction, and take steps to create innovative applications.

I especially like the following quote from the post:

"...A quick quote from our conversations: “When our children will walk up to a display, they will touch it and expect to do something.”

As a techie and a school psychologist, I see an immediate need for innovative applications. I know that there is a built-in market in the schools, at least for low-cost applications. Despite economic constraints, many school districts continue to invest in interactive whiteboards (IWB's). They are cropping up in preschool and K-12 settings, and teachers are searching for more than what's currently available.

Interactive, collaborative applications are needed in fields such as health care, patient education, finance & economics, urban planning, civil engineering, travel & tourism, museums & exhibitions, special events, entertainment, and more.

Smart Technologies, the company behind SmartBoards, has a new interactive multi-touch, multi-user table designed for K-6 education, the Smart Table. Hewlett Packard has several versions of the TouchSmart PC, which can support at least duo-touch, if not multi-touch, multi-user applications. There are numerous all-in-one large screen displays on the market that support multi-touch and multi-user interaction.

Quotes from Harry van der Veen, of Multitouch NL:

"In 10 years from now when a child walks up to a screen he expects it to be a multi-touch screen with which he can interact with by using gestures."

"...multi-touch screens will be as common as for children is the internet nowadays, as common as mobile phones are for us."


Here is a quote from a conversation I had with Spencer, who blogs at TeacherLED.

"It was interesting this week as I was in a classroom with a teacher who I've not worked with before... he had 2 students using the whiteboard who kept touching it together by mistake. The teacher, exasperated, said to himself, "Why can't they make these things to accept 2 touches without going crazy!"

Proof of the demand! I think you are right when teachers spot the limitations and then see the technology on visits to museums, that might stimulate demand."

Spencer creates cool interactive mini-applications, mostly for math, using Flash, that teachers (and students) love to use on interactive whiteboards. (He's interested in multi-touch, too.)


So what are we waiting for?!

Related:
Natural User Interface Europe AB meets Adobe
Georg's Touche Framework
NUI Group
TeacherLED
Interactive Touch-Screen Technology, Participatory Design, and "Getting It".
Hans Rosling's 2007 TED talk

RENCI at Duke University: Multi-Touch Collaborative Wall and Table utilizing TouchLib; More about UNC-C's Viz lab...

RENCI is a multi-disciplinary collaboration between several universities in North Carolina, with centers located at the Europa Center, Duke University, N.C. State, UNC Chapel Hill, East Carolina University, UNC-Asheville, UNC-Charlotte, and the Health Sciences Library at UNC-Chapel Hill. Many of the centers focus on visualization and collaborative technologies, and have been involved in multi-touch "surface" computing.

The pictures below are from the RENCI center at Duke University:

Duke Multi-Touch Collaborative Wall

The multi-touch wall is 13 x 5 feet, and utilizes six high-definition projectors, resulting in a combined resolution of 5760-2160, and supports multiple users. According to information on the RENCI website, the design is scalable and applicable to non-flat surfaces. The wall system runs on Windows and Linux.

(Photo by Josh Coyle)

(Photo by Josh Coyle)

DI, or Direct Illumination is used for touch detection in both the wall and the table for detecting touch. A separate instance of Touchlib runs for each of the 8 cameras used to detect touch. A gesture engine interprets the information about touches on the screen as gesture events. Each camera is handled separately for image processing and blob tracking tasks.

Graphics from the RENCI Vis Group Multi-Touch Blog

Here is cool picture of the "Multi-touch Calibration Device", which uses a built-in TouchLib utility.

Additional information can be found on the RENCI Vis Group Multi-Touch Blog.

FYI

Touchlib is a multi-touch development kit that can be found on the NUI-Group website.

"Touchlib is a library for creating multi-touch interaction surfaces. It handles tracking blobs of infrared light, and sends your programs these multi-touch events, such as 'finger down', 'finger moved', and 'finger released'. It includes a configuration app and a few demos to get you started, and will interace with most types of webcams and video capture devices. It currently works only under Windows but efforts are being made to port it to other platforms."

If you are interested in creating your own multi-touch table, the NUI-Group website and forums are a great place to start.

Related:

If you follow my blog, you probably know that I've taken several graduate courses at UNC-Charlotte. Some of my professors and a classmate or two have been involved in some exciting visualization research over the past year. (If you are serious about multi-touch and other visually-based applications, it is worth taking some time to familiarize yourself with visualization and interaction research.)

News from the UNC-Charlotte Vis Center:

At the University of North Carolina at Charlotte, RENCI is a collaboration between the UNC Charlotte Urban Institute, the Center for Applied Geographic Information Science, and the Charlotte Visualization Center.

11/06/2008
Robert Kosara’s group wins two awards at IEEE VisWeek Caroline Ziemkiewicz and Robert Kosara won Honorable Mention (the second highest award) at the IEEE InfoVis Conference for their paper, “The Shaping of Information by Visual Metaphors”. Also, Alex Godwin, Kosara’s student, won Best Poster for his submission, “Visual Data Mining of Unevenly-Spaced Event Sequences”.

The Vis Center is pretty fascinating, as you can see by the group of visitors at an open house.

If you are just as fascinated by this stuff as the guys in the picture, here are links to some recent papers by UNC-Charlotte faculty affiliated with the Vis Center:

The Shaping of Information by Visual Metaphors (Caroline Ziemkiewicz and Robert Kosara)

Evaluating the Relationship Between User Interaction and Financial Visual Analysis (Don Hyun Jeong, Wenwen Dou, Felsia Stukes, William Ribarsky, Heather Richter Lipford, Remco Chang)

Visual Analytics for Complex Concepts Using a Human Cognition Model (Tera Marie Green, William Ribarsky, and Brian Fisher)

Multi-Touch News from WinHEC and PDC

I received the following videos and links from Anthony Uhrick, who happens to be at WinHEC this week and was at PDC 2008 last week. Touch screen, multi-touch, and gesture technology is starting to catch on. (Anthony is the VP of sales for NextWindow, the company that created the touch screen for the HP TouchSmart and other multi-touch enabled displays.)

Below is a video clip of a multi-touch photo presentation system running Windows 7: Gesture + Touch - has gesture and physics engines.

Apparently the application can run on Vista, Win 7, and Win 7 Touch.

Here is an HP TouchSmart PC, running a Touch Map application on Windows 7:


The following clip is of a newscaster using a multi-touch transparent screen.The display is from U-Touch Ltd. a partner of NextWindow. In my opinion, the application enhances the viewers understanding of the various news topics, and is visually appealing as well.


The graphics engine used in this application was developed by Vizrt, the same folks who were behind CNN's video hologram. Here are a few pictures from the Vizrt website:

The workflow behind the CNN hologram (click to enlarge)

The holograph "transporter" room.

For more videos using Windows 7 apps, see creamhackered's YouTube channel. (Videos appear to be from NeoWin Net.)

Windows 7 Design Concepts and Usability Tests

CNN's Holographic Technology: Wolf Blitzer and Jessica Yellin, Anderson Cooper and Will.I.Am, and the music video.

CNN is doing a good job of exposing the masses to emerging technology!

Here is a video clip of CNN's holographic technology used to transmit a 3-D video image of Jessica Yellin, speaking with Wolf Blitzer on Election Day, November 2008. A partial transcript is included below. Before you get too excited about this technology, know that the correspondents see the image on a plasma TV, not in "real" 3-D, according to Gizmodo.



Jessica Yellin:
"There are 35 high-definition cameras ringing me, in a ring around me, I'm in the center, and they shoot my body at different angles, and I'm told that transmits what looks like an entire body image back there to New York. These cameras, I'm told, talk to the cameras in New York. So they move, and they know when to move when the cameras in New York move, and it looks a little different from a real person there, but it is pretty remarkable."

Wolf Blitzer:
"It's still Jessica Yellin, and you look just like Jessica Yellin, and we know you are Jessica Yellin....You're a terrific hologram, thanks very much Jessica Yellin is in Chicago, she's not here in New York with us... but you know what, it looks like she was right here with us, it is pretty amazing technology."


Here is the clip of Anderson Cooper interviewing Will.I.Am's hologram, beamed in from from Grand Park in Chicago.



Anderson Cooper:
"Let's see if we can beam him in now. There we go. Will, thanks very much for being
with us. How is this night for you?"

Will.I.Am:
"Ah, this is great. We're at an eve of a brand new day in America, and it feels great being here in Chicago. All this technology, I'm being beamed to you, like in Star Wars and stuff..."

Anderson Cooper:
"Yeah, it looks like, especially like, exactly like in Star Trek, when they'd beam people down, that's what it looks like here....We are doing this interview with you this way because it is a lot quieter than having you in the crowd, its very hard to hear in this crowd, and we appreciate you being with you..."

Will.I.Am goes on to discuss the song he created from an inspirational speech by Obama.

Related
How the CNN Holographic Interview System Works
-Gizmodo

Election Night TV: Networks Aim to Dazzle With Gagetry
-Edward C. Baid and Jon Swartz, TechNewsworld

Behind the hologram:
Vizrt
"Vizrt creates leading-edge content production tools for the digital media industry - From award-winning 3D graphics & maps to integrated video workflow solutions."
SportVU


FYI: Here is the video of the song, We Can Change- (My first view of this video was today, after the election.)





picture via engadget

Searching for Multi-Touch Info? Drivers for Windows 7 Available from NextWindow & HP TouchSmart...More about N-Trig..Multi-Touch Resources

Multi-Touch News and Links

Next Window Releases Touch Screen Drivers for Microsoft Windows 7

"The technology to build multi-touch applications for next year's operating system is available today."

Pleasanton, CA (PRWEB) November 4, 2008 --

"NextWindow, the leader in optical touch technology, released a touch screen driver for Windows 7 developers this week. The introduction of multi-touch gestures to this operating system will generate applications giving users more flexibility when engaging with content."

"NextWindow introduced this technology at Microsoft's Professional Developer's Conference (PDC) in October and will be presenting it at the Windows Hardware Engineering Conference (WinHEC) November 4 - 6, 2008. At this event, NextWindow will be showcasing their latest in optical touch solutions including the integrated touch display found on the HP TouchSmart All-in-One computer."

"Providing a touch screen solution for Windows 7 will give end-users an intuitive method to interact with their computers," said Anthony Uhrick, VP of Sales, NextWindow. "We've created a driver that enables developers to take full advantage of multi-touch functionality."

Software developers interested in touch solutions for Windows 7 are invited to contact NextWindow or download the driver directly from http://www.nextwindow.com/windriver. " More information about NextWindow is available at nextwindow.com."

Contact:
David Villarina, NextWindow
dvillarina @ nextwindow.com

N-trig Delivers Innovative Hands-On™ Computing to PC Industry

"Multi-Touch and Pen Technology to Humanize the Computer Interface and Create New Markets"

KFAR SABA, Israel & AUSTIN, Texas--(BUSINESS WIRE)--"N-trig, providers of DuoSense^TMTM evolution. With the industry’s only combined pen and multi-touch capabilities, N-trig is transforming the way people interact with computers. technology, combining pen and capacitive touch in a single device, brings the power of technology and the human touch together to begin a new era in interface technologies and lead the Hands-on computing evolution. With the industry’s only combined pen and multi-touch capabilities, N-trig is transforming the way people interact with computers"
"...Realizing the power of the human interface, N-trig’s DuoSense digitizers are designed to integrate easily, support any type of screen, keep devices slim, light and bright, and can support numerous applications from small notebooks to large LCDs. Combined, pen and touch enables users to open files, manipulate pictures and browse the desktop as they would the files on their desk...Currently available on the Dell Latitude XT and additional OEM designs planned to come to market in early 2009, N-trig is opening a window onto a world where multi-touch is the accepted standard for computer interfaces."
Related

N-trig

Microsoft WinHEC 2008 Conference

NextWindow's Optical Touch Screen Technology

N-trig's Capacitive Touch Technology

All you ever wanted to know about Multi-Touch:
Bill Buxton's Multi-Touch Systems that I Have Known and Loved

All you ever wanted to know about interactive tables that support collaboration:
Pasta & Vinegar's List of Interactive Tables
(From 2005, but has been updated.)

All you ever wanted to know about tangible user interfaces:
5 Lessons About Tangible Interfaces (pdf) - Nicolas Nova

All you ever wanted to know about interactive gestures:
Interactive Gestures (wiki)

All you ever wanted to know about open-source multi-touch & related technology:
NUI Group (Natural User Interface)

Resources and Links about Touch Screens, Tables, and Multi-touch

Note: I highlight news, thoughts, and reflections about interactive multimedia, multi-touch, and related emergent technologies on this blog.

If you don't see what you are looking for on this post, feel free to do a search on this blog, or my other blog, Technology-Supported Human-World Interaction.

For Multi-Touch Interaction Humor:
Multi-touch Parody of CNN's Magic Map Wall: Saturday Night Live's Weekend Update MegaPixel Giant Touch Map

Microsoft Surface Parody

Emerging Technologies: SHiFT 08 Conference - Sensor Networks and Data for the Open Internet of Things

This is a cross post from the Technology-Supported Human-World Interaction blog:

I first learned about the "Internet of Things" nearly two years ago when I was taking a Ubicomp class. Since that time, things have sped quickly along in the research arena, but I don't think most folks are aware of how this technological transformation will impact our daily lives.

The videoclip below is from David Orban's presentation at SHiFT 08, "Why We Need to Listen to our Things":



Orban discusses how we currently spend much of our time taking care of our mobile devices, but as the magnitude of devices increasing, it is difficult to manage things as we have in the past. There is just too much data...There is a need for obtaining information from sensor networks. "We must derive deep knowledge of the environment from these sensors." In the video clip, Orban goes on to discuss the various challenges in this field:

• Signal to Noise problem.
• Signal to Signal problem.
• Management of the sheer volume of data that is generated, or will be generated - how data is filtered and analysed.
• Dependability - managing spime systems and sensor networks of tens of billions of elements.
• Aggregation of data to derive second order knowledge.
• New phenomena will surprise us in the future, we will learn more about our environment, and listen to our planet more clearly.

Video by Wide Tag Inc.
October 2008



Related:

SHifT 08 was held in Lisbon, Portugal on October 15-17. The focus of this year's conference was Transient Technologies, "in the sense that technology is breaking up with it's digital boundaries and it's becoming a vital part of a lot of the things we do and interact with in our daily lives."

The themes of SHiFT 08 included user experience, mobile computing, sustainability, the social web, web design, open technologies, digital media, artificial intelligence, spimes, and knowledge & innovation.

Emerging Interactive Technologies: SecondLight from Microsoft, at PDC2008

Picture from PCMAG.Com
The videoclip below is a demonstration of the prototype of SecondLight, a Surface-like application developed by a team of researchers at Microsoft Research UK. If you place a tracing-paper like object on the surface, secondary information regarding the content on the surface can be revealed. The system relies on a projector system and a special liquid crystal on the display.



-via Thoughtware.TV

Here is another video from Slashgear that describes SecondLight. According to the video, SecondLight is a multi-point display, displaying images on a surface, and images through a surface. The system has two hi-res cameras, two projectors with optical shutters, infrared illumination, and an electrically switchable diffuser.

SecondLight can track images from a distance, track IR reflective objects, and also track IR emissive objects with mobile, multi-point touch detection.

Steven Sinofsky Discusses Multi-touch and the HP TouchSmart, Windows 7, and more at PDC2008

Steven Sinofsky at the PDC2008 Open Space


In this video, Steven discusses Windows 7 and confirms that Windows 7 works with the HP TouchSmart: "The hardware is multitouch." Sinofsky also discusses how there might be a need for multi-touch drivers for the HP TouchSmart.

Take the 25 minutes or so to watch the video. It is worth it, even the more technical aspects, including how events will be managed to minimize boot time.

Dude!
Sinofsky says you gotta say "dude!". Watch the video to get it!

IDC 2009: The 8th International Conference on Interaction Design and Children

If you are interested in children, technology, and new methods of interaction design, take a look at the web site for IDC 2009: The 8th International Conference on Interaction Design and Children. It will be held in Como, Italy Jun 3-5, 2009.

"For young people today, technology is pervasive in many aspects of life. From childhood onwards, they learn and play using computers and other technological devices; as they grow, they build and maintain friendships using computers and mobile phones; they interact with one another virtually; and even find critical interpersonal support and therapy using computers, the web, and other technology-enhanced artifacts. The IDC 2009 conference will continue IDC's tradition of better understanding children’s and youngsters’ needs in relationship to technology, exploring how to create interactive products for and with them, and investigating how technology-mediated experiences affect their life. IDC 2009 will present and discuss the most innovative contributions to research, development, and practice in these areas, gathering the leading minds in the field."


The deadline for the call for workshop proposals is January 12, 2009, full papers, January 19, 2009, and short-papers & demos, March 6, 2009.

Multi-touch on an HP Touchsmart PC; interacts with Apple's iPod, by CanineInteractive.com

This short YouTube video clip from Canine Interactive is a great demonstration of the multi-touch capabilities of the HP TouchSmart PC:



Canine Interactive is a design and development group located in central London. Their current and former clients include Alliance and Leicester,British Telecom, Verizon, and Microsoft.

He is another link to Canine Interaction's work on a multi-touch version of Monumental Adventure, featured in the above YouTube clip:

http://www.canineinteractive.com/design_monumental_touch_video.html

HP to launch TouchSmart Developer's Kit! via Rich Brown at CNET Crave's Blog

If you follow my blog, you know that I have a TouchSmart, and that I'm a little obsessed about surface-gesture-touch-screen-multi-touch-multi-user computing....

Here is some good news!


According to a recent article from Rich Brown's Crave blog (CNET news), programming guidelines for the TouchSmart require developers to be know C# and Windows Presentation Foundation. That's great for me, since I can program in C# and I've been playing with WPF for nearly a year.



Despite what Rich Brown says, I know that the TouchSmart has at least duo-touch capabilities, since the touch-screen technology was provided by NextWindow, and the TouchSmart has been used for multi-touch demos created by FingerTapps. It is possible for the TouchSmart to handle input from multiple mice, too.

Hopefully Windows 7 will make it easier for developers to harness the power of the TouchSmart. I have so many ideas I'd like to see come to fruition.

If you go to the HP website, you can join the HP TouchSmart developer community.

Grafiti - a multi-touch, table-top, surface computing application, from a member of the NUI group.

Are you interested in multi-touch gestures for multimedia tabletop applications, tangible or surface computing, and interaction design? Take a look at this video of Grafiti:



Alessandro De Nardi, a student in computer science at the University of Pisa, Italy, has worked on Grafiti during Google's Summer of Code and is still involved with the project. Alessandro, a member of the NUI-group, is also in the Music Technology Group of Barcelona's UPF University. Allesandro was supervised by by Martin Kaltenbrunner and Sergi Jorda, of the reactable project.

According to De Nardi's Google Code website:

"Grafiti is a C# framework built on top of the Tuio client that manages multi-touch interactions in table-top interfaces. The possible use of tangible objects is particularly contemplated. It is designed to support the use of third party modules for (specialized) gesture recognition algorithms. However a set of modules for the recognition of some basic gestures is included in this project.

The development is in the alpha state, going to beta soon.

The goals I've been aiming at are: generality, versatility, speed of execution, extensibility, ease of programming (integration) of external modules (simple APIs and protocols) and effective interface design with regards to HCI aspects." -Alessandro De Nardi

Demos in binary form are available for download for MacOSX and Windows on the Google Grafiti site. There is a Grafiti site on Sourceforge. Apparently the alpha version will work on all 32-bit MS Windows,, BSD platforms, and POSIX (linux).

(Note: This post was updated on 12/14/08 and includes corrections.)

Multi-touch Parody of CNN's Magic Map Wall: Saturday Night Live's Weekend Update MegaPixel Giant Touch-map

Most viewers familiar with CNN news know about the "Multi-Touch Collaboration Wall", or Magic Wall, used by John King. David Borhman, a CNN producer, was describes the purpose of the Magic Wall in a quote in a Washington Post article:

"It's a stupendous way to explain a lot of complicated data"..."Fundamentally, our job is to explain things to people, and we need it visually. This lets us do it naturally, without a keyboard or mouse getting in the way....Once you see it, you get it instantly."

This would be fun to play with- for just about everyone! If you don't have ready access to a "magic wall", take a look Fred Armisen's playfulness in a recent Saturday Night Live parody of the CNN Magic wall:


Video clip via Hulu

Update:  Transcript from the 2008 SNL Show

Partial Transcript:

"One thing we are going to look at is Pennsylvania..Have a very good look at Harrisburg.....Get in really close to this. Back a bit, back a little bit, excellent"

"Now the country can be moved up and down, like so....We can also shrink it and put it in your pocket if you need to."

"You can always change the colors. You got blue, blue again, a little bit of red...right over there, a little bit of blue of course, if you want to make something out of green, you got a little face there, some whiskers, we can ..... make a cat. Notice the triangle nose!"

"Let's look at Ohio. Lets look at the Cleveland area. Lets look really really close. Really close. Really really close, You can see the top of a warehouse. We're really going to want look at that. Very, very important, were going to want to look at that."

"You can take Oregon, lets move it out into the ocean. It will be completely surrounded by water. That's very, very dangerous."

"And here is New York.... New York was there in 2004, and you can shake it around like that.. (shakes New York)"

"Actually, what I'm doing is very important, and informational"

"OK, Fred, stop goofing around..."

Fred turns to the map, and with both hands, moves all of the states out of place.


Photo via engadget

"Check out Michigan... I can make it bounce!" (Drags down Michigan on the map, it bounces up and down once it reaches the bottom of the map.)

Rumor has it that Jeff Hans, of Perceptive Pixel, was responsible for the SNL version of the Magic Touch-Wall map.

Update 11/4/08:

CNN article confirms that Jeff Hans is the inventor behind the election 'Magic Wall'.

Jeff Han's 2006 demo of his multi-touch applications at TED.

Update
I thought I'd add the video clip that makes a little fun of Microsoft's Surface: