This video showcases the work of Natural User Interface-AB, using NUI Suite 1.0 Snowflake and Flash.
Here is the plug from the company's website: "Natural User Interface (NUI) is a Swedish innovative emerging technology company specializing in commercially available advanced multi-touch software, hardware and service solutions. NUI's solutions can convert an ordinary surface into an interactive, appealing and intelligent display that creates a stunning user experience."
With Win7's "multi-touch" capabilities, Bill Gate's statement that every surface will be a computer might come true, but from what I can see, we have a long way to go before we get it right!
One of the concerns I have about "touch" screen interaction in public spaces is that not much thought is given to the environmental factors surrounding the system. The system that is tested for the first time after installation might work just fine, but not when it is put to use under a variety of conditions or situations.
EXAMPLES(I've recycled a few of these from previous posts.)
Touch Screen Kiosk/Display in Upscale Shopping Area, St. Thomas(?)
I came across this system when I was walking around in St. Thomas with my husband. I wasn't sure what to make of it. There wasn't anything on the large display, and I couldn't tell from a short distance if the two smaller displays were active.I noticed that the display had an awning of sorts, so the fact that the display would be used in a sunny location had been considered. Unfortunately, the awning didn't solve this problem, as you can see from the pictures below:
CLOSER UP
As we approached the display, it was almost impossible to see what was on the screen. In fact, we weren't sure what the display was all about. It looked like something you'd see at an airport check-in, not in a lush tropical setting.
Below is a shot of my husband, trying to see what is on the screen. This photo shows exactly what the screen looked like at the time:
The next picture tells it all. You can see that there is some sort of alphabet on the right side of the screen, but the reflection of my husband is easier to see. We couldn't figure this one out.
The following clip demonstrates how environmental concerns, such as wind and "sideways" rain, can make an interactive display at a shopping center difficult to use. During this clip, you can hear me muttering about the difficulties I had interacting with the information on the touch-screen display. It is possible that the system wasn't working well because of the exposure to the elements.
WIND AND SIDEWAYS RAIN
You can see that the navigation system was confusing. At the end, the entire screen turned red, and I gave up.
The next video-clip is of a touch-screen map at the Cleveland Clinic hospital. I was with my elderly aunt and my sister, and we were trying to figure out how to get to a restaurant. We never found it.
Although the screen was easy to see, the application was... crazy!
In my opinion, an interactive wayfinding application should run on a larger display and support two or more people, since many hospital visitors often run in pairs or small groups.
BETT is the annual ICT & educational technology conference held in the UK. The UK has the highest number of classrooms in the world with interactive whiteboards, which has been an interesting transformation to follow over the past few years.
I've posted several video clips from BETT '09, which was held this month (January), along with some other resources. Tabletop computing applications for education were demonstrated by Microsoft Surface and Smart Technologies. Take a look!
BETT 2009 Video Overview
Microsoft Surface at BETT 2009
More Surface for Education: User Interface and Paint
Physics and Social Studies
Orientation and Images
Science: Medical and Health Care
SMARTTable at BETT 09 (Note: The two clips below look as if they were taken with a cell phone video camera. I'll post higher-quality videos if I find them.)
SMART Technologies PR video
I think there is a need for more application development in this area!
RELATED The following two clips are from the visitor's point of view, overwhelmed by it all...
Kloonigame's Crayon Physics Deluxe is a fun, interactive physics game that works well on a touch screen. It is not as complex as Algodoo, as it doesn't require the player to interact with lots of settings.
The above video is of the commercial version of the game. It is a labor of love by Petri Purho, of Helsinki, Finland. You can find Petri's games on the Kloonigame's website, including the free version. Crayon Physics won an award at the 2008 Independent Games Festival.
Algoryx, a software company, has announced an educational version of Phun Physics, called "Algodoo". It is on display Classmate PC at BETT 2009 in London this week (January 14-17).
"Algodoo is a 2D-simulation environment for creating interactive scenes in a playful, cartoony manner, making use of the physics that we use to explain our real world. Algodoo is designed to encourage young people’s own creativity, ability and motivation to construct knowledge. The synergy of science and art makes Algodoo as educational as it is entertaining. Algodoo applies a constructionistic learning paradigm - learning by designing, constructing and exploring physical systems."
"Algodoo has been optimized for the Intel-powered convertible classmate PC and makes innovative use of many of its features including the webcam for creating physical models from live photos, the touch screen and digital pen input for drawing objects, and the accelerometer for virtual experiments and very direct interaction with the physical simulation. We are quite amazed by the performance, features and look and feel of this little notebook. Learn more about it here: http://www.classmatepc.com/"
The HP TouchSmart Notes application can be used in a variety of interesting ways. I have an HP TouchSmart PC, and I like how easy it is to slide the notes about the screen using this multi-modal application. It allows the user to take capture pictures, video, or audio to create notes, as well as traditional "stickies" that allow for typing or finger-writing input. You can even draw or write over photos. It is an application that has many accessibility features. It also supports many of the principles of Universal Design for Learning (UDL).
The various notes can be put together in a variety of ways, and allow for video or photo storytelling and interesting ways of leaving messages- even a song or two. I did some hunting and found the more information about some non-verbal students with autism who are learning verbal skills through this technology at Hope Technology School in Palo Alto, California. Video of student using the HP TouchSmart Notes application at Hope Technology School:
Here are a few "How Two" videos that demonstrate the TouchSmart Notes features and interactions:
