Impress: A cool flexible interface project by Silke Hilsing

Impress, a cool flexible interface project by  Silke Hilsing:


impress - flexible display from Silke Hilsing on Vimeo.

From Sike Hilsing's website:

"Impress is the deliverance of the touch screen from its technical stiffness, coldness and rigidity. It breaks the distance in the relationship of human and technology, because it is not any longer the user which is subjected to technology, but in this case the display itself has to cave in to the human. Impress is a chance of approach of user and technology, above all, from technology.


It is a matter of a flexible display consisting of foam and force sensors which is deformable and feels pleasantly soft. Impress works with the parameters position and time like other touch screens as well, but in addition to that, it reacts, above all, on the intensity of pressure."

The application was created with Aruino and Processing.






Thanks to Richard Van Tol for the link!

Update on Interactive Mobile Phones: Sony Ericsson's Android Rachael; HTC Hero

Both Sony Ericsson and HTC have built upon Google's Android build to create new "user experiences" for mobile phones.



Sony Ericsson Rachael UI Video:


Related:
"Sony Ericsson "Rachael" Android XPERIA handset unveiled?"
(Paul Miller, engadget, 7/4/09)
Sony Ericsson's Android Rachael UI Makes Me Want to Ditch My iPhone
(Jesus Diaz, Gizmodo, 7/8/09)


"Make it Mine, Stay Close, Discover the Unexpected!" Personalization with HTC Hero Touch-enabled Smart Phone"



HTC recently launched the HTC Hero. I haven't had a chance to touch one, but it looks interesting enough to make a trip to my local mobile phone service provider and see how it works.

"HTC Hero launch event video featuring HTC Sense™ - an intuitive, seamless experience built upon three fundamental principles - make it mine, stay close, and discover the unexpected." -HTC

The two video clips below explain the rationale behind the HTC Hero and why the company thinks it is an important innovation:

PART I



PART II


A few quotes from the video:

"It begins with listening and observing people as they use their phone..."

"...there has been a fundamental shift in people's phone expectations..."

"People want to stay close with the important people in their lives, and have online information...Voice is key, but no longer enough...The SmartPhone is the New Phone, people no longer expect their Internet to be at their desks anymore. They expect it everywhere they are. The Internet is becoming the fundamental of the mobile phone. Access to web browsing, streaming media, and connected applications has taken off, and this is where Smartphone really excels. People really appreciate the experience..."

HTC Hero UI Video


Related:
HTC Debuts Hero, With Fresh Face for Android
(John Herman, Gizmodo, 6/24/09)
Google Android Info
"Android is a software stack for mobile devices that includes an operating system, middleware and key applications. The Android SDK provides the tools and APIs necessary to begin developing applications that run on Android-powered devices."

Cross-posted on the Technology Supported Human-World Interaction blog.

Touching Windows 7 - Informative post, video, and comments from the Engineering Windows 7 blog

Touching Windows 7 post on the Engineering Windows 7 blog provides a good overview of Microsoft's work with touch and gesture interfaces over the past several years, building upon earlier work with the TabletPC.

There are quite a few opinions shared in the post's comment section. It is worth the read.

Below are two videos from the Windows 7 post:

Windows 7 Gestures
<a href="http://video.msn.com/?mkt=en-US&playlist=videoByUuids:uuids:891c68b3-a534-4159-b6b2-8e4ac56b6890&showPlaylist=true" target="_new" title="Windows 7 Touch Gestures">Video: Windows 7 Touch Gestures</a>

My comments will be forthcoming.

Usability, Accessibility, and User Experience in a Win7 Environment

Microsoft's newest operating system, Win7 (beta), allows for multi-touch interaction and application development. From what I can tell from the news from the Consumer Electronic Show (CES 2009), touch and gesture interaction holds quite a bit of interest among consumers and application developers alike.

Hopefully people will think carefully about user experience and usability factors when developing the applications we'll be using in the not too distant future!

Because of my background as a school psychologist, I’m interested how touch/gesture applications can address accessibility and universal usability issues.

I wasn't able to locate user experience or usability information for Win7. Here are a few links from the Microsoft website that I think are worth reading:

Touch Interaction Guidelines

How to Design a Great User Experience

Designing with Windows Presentation Foundation

Accessibility

According to the research from Microsoft, ”more than half of all computer users experience difficulties or impairments related to accessibility, and are likely to benefit from the use of accessible technology. Moreover, approaching software design with the flexibility and inclusiveness that are the hallmarks of accessibility often results in overall improved usability and customer satisfaction.”

Regarding touch/gesture interaction, know that “19% (24.4 million) of computer users have a mild dexterity difficulty or impairment, and 5% (6.8 million) of computer users have a severe dexterity difficulty or impairment.”

Christian Moore, from the NUI-Group, shared this nice graphic that depicts the various fields that intersect or converge with interface design, which I think is useful when thinking about how we will design, develop, and use emerging technologies:



Concepts such as accessibility and universal usability can fit into this design!

For more information regarding multi-touch, see my previous post, "For Techies and the Tech-Curious: Multi-touch/Gesture from the NUI Group"

Windows Vista User Experience Guidelines: All Windows programs should be touchable!

If you are a designer/developer who would like to develop applications that can support touch interaction, it will save you some time to study the Windows Vista User Experience "Touch" guidelines. You'll find information about the eight flick events, (gestures that correspond to keyboard shortcuts for navigation and editing), the 40 or so gestures recognized by Vista, tips for creating controls, GetMessageExtraInfo function, and more.


"As touch spreads from Tablet PCs to other types of computers, software program developers and designers will find it increasingly important to support touch as well. All Windows programs should have a great touch experience. Users should be able to perform your program's most important tasks efficiently using a finger."

CNN's Magic Wall Conspiracy Thriller on the Daily Show: John Oliver, Jeff Han, John King and a cast of TouchScreens and Windows...

"I needed to find a screen-free environment!" -John Oliver

"It's good to be King." - John King, after disposing of John Oliver...

I just took a look at a hilarious episode about interactive multi-touch screens and a conspiracy theory on the Daily Show. The episode features Jeff Han, the creator of CNN's Magic Wall, John Oliver, John King, and others from CNN.

Enjoy!



Via John Herrman and Gizmodo


If you are interested in multi-touch technology, feel free to do a search for additional information on this blog. The following post includes Jeff Han's demonstration of his multi-touch applications from TED 2006, along with resources and links:

Multi-touch and Flash: Links to Resources, Revisiting Jeff Han's TED 2006 Presentation

Note: If you are a parent, please screen the video clip before deciding if it is OK for your child to view.

Every Surface a Computer: "Scratch" Capturing Finger Input on Surfaces using Sound. Video by Chris Harrison and Scott Hudson's Video - UIST '08

Chris Harrison and Scott Hudson, from the Human-Computer Interaction Group at Carnegie-Mellon University, presented their latest research at the UIST '08 conference. Take a look at the video below to see how gestures that result in sounds can can transformed on unpowered finger input surfaces, using a stethoscope sensors and filters:



Yes, every surface is a computer!
(Even your pants...)

For detailed information, read the paper presented at UIST '08 by Chris Harrison and Scott E. Hudson:
Scratch Input: Creating Large, Inexpensive, Unpowered, and Mobile Finger Input Surfaces

RELATED:

The Best Paper Award at UIST '08 was "Bringing Physics to the Surface", by Andrew Wilson, of Microsoft Research, and Ahahram Izadi, Otmar Hilliges, Armando Garcia-Mendoza, and David Kirk, of Microsoft Research, Cambridge.

Here is the abstract:

"This paper explores the intersection of emerging surface technologies, capable of sensing multiple contacts and of-ten shape information, and advanced games physics engines. We define a technique for modeling the data sensed from such surfaces as input within a physics simulation. This affords the user the ability to interact with digital objects in ways analogous to manipulation of real objects. Our technique is capable of modeling both multiple contact points and more sophisticated shape information, such as the entire hand or other physical objects, and of mapping this user input to contact forces due to friction and collisions within the physics simulation. This enables a variety of fine-grained and casual interactions, supporting finger-based, whole-hand, and tangible input. We demonstrate how our technique can be used to add real-world dynamics to interactive surfaces such as a vision-based tabletop, creating a fluid and natural experience. Our approach hides from application developers many of the complexities inherent in using physics engines, allowing the creation of applications without preprogrammed interaction behavior or gesture recognition."
Preparation for the Internet of Surfaces & Things?



(Cross-posted on the Technology-Supported Human World Interaction blog)

Even more touch! Paper Four - Capacitive Touch Paper; NUI at DreamHack 2008...

When I first started writing about interactive touch-screen technology and multi-touch, there really wasn't much going on. Things have changed over the past couple of years.

Below is a video clip of Paper Four, via Touch User Interface, of a capacitive touch paper developed by researchers at the Mid Sweden University. Sensing electrodes are printed on the paper with conductive ink:


Natural User Interface will be demonstrating multi-touch applications at the upcoming DreamHack Winter 2008 festival November 27-30. DreamHack is known as the world's largest LAN party and computer festival. For more information, see my post on the Technology Supported Human World Interaction blog.

Multi-touch & Surface Computing Thoughts:

Despite the downturn in the global economy, I truly feel in my heart that collaborative multi-touch, or surface computing, will be an important "movement", on many levels. I think that it will enable people to gain a deeper understanding and enjoyment of ideas & concepts.

It is new way of expression and communication, with the potential to support learning, exploring, music, art, cooperation, gaming, and more effective information visualization & data-driven decision making.

Not too many people really "get" the concept of multi-touch - surface computing. Yet.

Those who do seem to be creative, forward thinking, thoughtful, and optimistic. Important characteristics to have during these trying times!

First attempt at a touch-screen "Poetry Picture Share" application

This was my first attempt at a "poetry picture share" application. It was designed for use on a multi-touch table and can be accessed remotely so people in different places can move things around on the screen.   The video shows how the application works on a NextWindow Human Touch interactive large-screen display.

Version 2 will be posted soon. I am planning on adapting this application for use with students with special needs, such as those who have autism or other communication disorders.