Pervasive Checkers on Microsoft's Surface: The Gamepack Video

In early 2007, before we knew of the existence of Microsoft's multi-touch surface, I worked on a "Pervasive Checkers" project with Johnny Hopkins, a classmate in my Ubiquitous Computing class. I'd previously worked with XNA Game Studio Express in an AI for Games class, and thought that it would be cool to make a casual checkers game on a multi-touch table that could be played in gathering spots such as coffee houses and neighborhood cafes.

Below is a screen shot of what we created using Inspiration software - (in the application, you can click on an item and it expands to reveal additional information.)

Two years later, and the Pervasive Checkers idea is reality - but I wasn't involved in the process. Checkers is one of the games that is included in a game-pack created specifically for the Surface.

Take a look at the video:



From Surface Computer News:

"The Microsoft Surface Games Pack is a clear illustration of where the Natural User Interface of Windows 7 has the potential to take games. Windows is traditionally the number 1 gaming platform around the world. With the introduction of the NUI, allowing players to literally have titles at their fingertips via touch, Windows 7 can kick the gaming experience up a notch. Provided that developers rise up to the challenge."

Interactive Displays in Public Spaces

Daniel Michelis recently completed his Ph.D. dissertation on a topic that is dear to my heart. Information about his research can be found on his Interactive Displays in Public Spaces blog.

(Note: This was cross posted on the Technology-Supported Human World Interaction blog.)

Here are links to a few of his posts:

Interactive Displays: Perception, Awareness, and Interaction

Evaluating Interaction with Display Applications in Public Space

I especially like the diagrams Daniel uses to depict zones of interaction:

Figure 3: Four-phase Model
(Source: Daniel Michelis (2009), according to: Vogel and Balakrishnan, 2004)

(Author: Daniel Michelis, Institute for Media and Communications Management, University of St. Gallen)

Figure 1: Perception and Usage of Interactive Displays
(Source: Daniel Michelis (2009), according to: Brignull & Rogers, 2003)

Interactive Displays 2009: Listen to a podcast interview each day leading up to the conference.

The following people were on the podcast on 4/13/09:
Steven Bathiche- Microsoft
Jerry Bertrand- Microscent, LLC
Henry Kaufman- Tactable

Interactive Displays 2009

Note: Jeff Han will be one of the presenters.

More info to come...

Dreams about haptic overlays: Part Two- SLAP: Bridging the Gap Between Virtual and Physical Controls on Tabletops

In response to my previous post about my dream about haptic touch-screen overlays,
Martin Kaltenbrunner pointed me to an interesting link SLAP: Silicone Illuminated Active Peripherals "Bridging the Gap Between Virtual and Physical Controls on Tabletops". SLAP is a project of the Media Computing Group at RWTH Aachen University, headed by Dr. Jan Borchers.



FYI - Information from the Media Computing Group website:

• Grounded in Computer Science, we develop and study new interaction theories, techniques, and systems in the areas of interaction with multimedia, ubiquitous computing environments, tangible user interfaces, and HCI design patterns. Our goal is to make the Brave New World of ubiquitous multimedia technologies useful by making it usable. A recent overview of our research approach and research directions can be found here.

SLAP: The Movies




Here are some pictures and related information from the SLAP website:

• CHI 2009 Video on YouTube or as QuickTime video (21 MB).
• Presentation of our SLAP demo at TEI 2009 (YouTube)

Publications

2009

	Malte Weiss, Julie Wagner, Yvonne Jansen, Roger Jennings, Ramsin Khoshabeh, James D. Hollan, and Jan Borchers. SLAP Widgets: Bridging the Gap Between Virtual and Physical Controls on Tabletops. In CHI '09: Proceeding of the twenty-seventh annual SIGCHI conference on Human factors in computing systems, New York, NY, USA, 2009. ACM. .
	Malte Weiss, Julie Wagner, Roger Jennings, Yvonne Jansen, Ramsin Khoshabeh, James D. Hollan, and Jan Borchers. SLAP Widgets: Bridging the Gap Between Virtual and Physical Controls on Tabletops. In CHI '09: Extended Abstracts on Human Factors in Computing Systems, New York, NY, USA, 2009. ACM Press. .
	Malte Weiss, Julie Wagner, Roger Jennings, Yvonne Jansen, Ramsin Khoshabeh, James D. Hollan, and Jan Borchers. SLAPbook: Tangible Widgets on Multi-touch Tables in Groupware Environments. In TEI '09: Proceedings of the 3rd international conference on Tangible and embedded interaction, New York, NY, USA, 2009. ACM. .

2008

Malte Weiss, Roger Jennings, Julie Wagner, James D. Hollan, Ramsin Khoshabeh, and Jan Borchers. SLAP: Silicone Illuminated Active Peripherals. In Extended Abstracts of Tabletop '08, 2008. .

MORE FYI:

(Dr. Jan Borchers, the head of the Media Computing Group, recommends the following list of books, and I agree with his list, 100%.)

Dr. Jan Borchers' (Annotated) Top Ten List of Books on Human-Computer Interaction:

Note: I have read many of these books and I agree that they should be required reading anyone who plans to design, develop, program, or implement anything related to technology and people.

1. Alan Dix, Janet Finlay, Gregory D. Abowd, and Russell Beale: Human-Computer Interaction, 3rd ed., Prentice Hall, 2004. Currently the best, most well-rounded book I know to teach introductory HCI if you need to limit yourself to a single title. Technical enough, good breadth, not too fuzzy for a CS curriculum, very current, with a web site that includes resources such as sample programs, slides, etc.
   
   
2. Ben Shneiderman and Catherine Plaisant: Designing The User Interface, 4th ed., Pearson Addison-Wesley, 2004. Best overall reference book for all areas of HCI, providing an introduction and great up-to-date pointers to most sub-fields of HCI research and practice, especially different interaction techniques. His Golden Rules of User Interface Design and sample questionnaires for user testing are very useful in an introductory class. Unfortunately, the companion web site costs money after an initial trial period.
   
   
3. Donald A. Norman, The Design Of Everyday Things, Basic Books, 2002. A classic text from 1988 with an updated introduction that, while some of the technologies described or envisioned seem somewhat outdated now, still provides the best introduction to the spirit of good human-centered design. A not too technical read with hilarious stories of badly designed everyday technology, it provides some very useful basic models for human cognition, such as the Seven Stages of Action. This book also introduced the fundamental concept of affordances to HCI. Changed my view of the world of technology around me, and is probably the best initial brainwash for engineering students to "get" user-centered design.
   
   
4. Jenny Preece, Yvonne Rogers, and Helen Sharp: Interaction Design, 2nd ed., Wiley, 2007. This title focuses more on the process of designing good user interfaces, and is less technical, but excellent and up-to-date in the area it addresses. The companion web site has slides, case studies, and other materials.
   
   
5. Bill Moggridge, Designing Interactions, MIT Press, 2008. A truly beautiful "coffee-table style" book on interaction design, also covering product and industrial design of digital technology (Moggridge is a founder of IDEO). It has wonderful short essays about seminal digial product designs, from Engelbart's mouse, to the Mac and Palm, to Google and other internet services, as well as articles on digital product design theory. My own Sweet Sports and Baroque Technology article was based on one of the theory articles. Special treat: video interviews and chapters are available for free, on a weekly rotation, at http://www.designinginteractions.com/.
   
   
6. Bill Buxton, Sketching User Experiences, Elsevier, 2007. Similar to Moggridge's book in style, this book focuses on the early stages of product design. It also includes very interesting stories of key interactive products, such as Apple's iPod. And of course it's written by one of the long-time key players in HCI. More at http://www.billbuxton.com/.
   
   
7. Terry Winograd (ed.): Bringing Design to Software, Addison-Wesley, 1996. An excellent and very well edited collection of contributions from key players in HCI, from Kapor's Software Design Manifesto to Rheinfrank's Design Languages. Its particular value also comes from the profiles that link chapters and give an insider's view of how some of the most seminal UI designs came to be, from the Xerox Star to VisiCalc and HyperCard. Terry has some information about his book at http://hci.stanford.edu/bds/, and I used it with great success when I had the fortunate opportunity to teach an introductory HCI class in his program at Stanford in 2002.
   
   
8. Brenda Laurel (ed.): The Art of Human-Computer Interaction, Addison-Wesley, 1990. While ancient by today's standards, this book is another carefully compiled and very coherent collection of highly relevant articles on HCI by some of the most influential people in the field. I particularly like the article by Scott Kim on interdisciplinary design, and Tom Erickson's chapter.
   
   
9. Apple Computer: The Apple Software Design Guidelines, latest edition 2005. OK, I'm a Mac head, but then many HCI people are because Apple has such an excellent sense of doing the right thing when it comes to user interface design. These guidelines have been around since the 90's, with several new editions since then, and especially Part I ("Application Design Fundamentals") contains excellent, system-independent, hands-on advice for anybody developing interactive software, especially desktop applications. And it's free! Apple's developer website has the latest version both online and as downloadable PDF. I often recommend this as a quick read for engineering types that just want the bare essentials to help avoid major UI design catastrophes.
   
   
10. Jef Raskin, The Humane Interface, Addison-Wesley, 2000. Similar to Norman's book above, but more recent and more technical, this is another good first read to start thinking about user interface design, written by the father of the original Apple Macintosh. Some of the ideas presented here are quite unusual, and that's intended. Some related materials, such as demos of his Zoomable User Interface and The Humane Environment are at http://www.jefraskin.com/.
    
    

"So that's my top 10 list. I may add some more in the future. But I figure it's more important to restrict myself to those books I think are really outstanding than bother you with additional titles that don't really have that special something....For a good current PhD-level HCI reading list that is based more on papers and individual chapters than single books, see Terry Winograd's HCI reading list at Stanford University." -Dr. Jan Borchers

Last night I dreamt about haptic touch-screen overlays...

Technology Dreams
I just haven't had enough time during the day to focus on my passion for interactive technology. I wish I could grab a picture from my dream about haptic overlays and share it here on my blog!   To make sure this technology wasn't only in my dreams, I decided to google "haptic overlays", and here are some of the results:

Future Directions for Tactile Feedback (Peter Odum, Idlemode, 1/23/09)
"Current tactile solutions fall short either in reconfigurability or in pre-interaction feedback...And it’s easy to provide a physical sensation after the user interacts, but not to provide buttons that can be physically felt *before* the interaction is committed."

Some of the work regarding haptic or tactile feedback has focused on smaller screens and virtual reality:
Vinyl overlay for tactile feel on iPhone NES emulator
More Details on Nokia Haptikos Tactile Touchscreens
Haptic Overlay Device for Flat Panel Touch Displays (pdf)
Touchscreen Feedback Overview
Team Daimler-Chrysler Touch (pdf)
The Twelfth Haptic Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems 2004
Patent: Method and apparatus for multi-touch tactile touch panel actuator mechanisms
Benali-Khoudja, M., Hafez, M., Alexandre, J., Kheddar, A. Tactile Interfaces: A State-of-the-Art Survey (pdf) ISR 2004, 35th International Symposium on Robotics

Here is the concept in the form of a "wearable" design:

The surface of this design looks very much like the overlay material that I was working with in my dream, except that the grid-sensors were the same translucent color as the overlay. (I was trying to program this overlay in my dream, but that is another story!)


Here is some technical information about these little haptic finger overlays- with a little tweaking, they could be transformed into something really cute...

"The key material to the display is an electroactive polymer that can stimulate the skin without using any additional electromechanical transmission. The polymer consists of eight layers of dielectric elastomer actuator films which have been sprayed with electrodes in a specific pattern. Along with a protective layer to separate the electrodes from the skin, the entire polymer sheet is about 210 micrometers thick. In their study, the researchers fabricated an 11 x 14 mm sheet with Velcro on the edges, and rolled it up in the shape of a thimble to be worn on the finger. The display can convey information to the wearer when the electrodes induce a voltage across the films. A voltage causes the films to compress down and expand outward. In doing so, the films put pressure on the wearer’s skin, inducing a “mild sensation.” Like most polymers, the device is hyper-elastic, meaning that it can experience large amounts of elastic strain and recover its original shape.This simple stimulation mechanism, which doesn’t require complex electronics, is one of the greatest advantages of the soft tactile display compared with current displays. Its other benefits include efficient power usage, cost-effectiveness, and easy fabrication. As the researchers note, the new display has lower power and displacement values than is considered optimal, which may limit its applications to specific areas"

The Search Continues...

This journey led me to Nokia's "Morph", a device using nano-materials, something I think I posted about a while ago in one of my blogs. (This video reminds my of some of my more vivid technology dreams. It must be nice to be paid to transform technology dreams into prototypes and demonstration videos!)

The Video:

"Launched alongside The Museum of Modern Art “Design and The Elastic Mind” exhibition, the Morph concept device is a bridge between highly advanced technologies and their potential benefits to end-users. This device concept showcases some revolutionary leaps being explored by Nokia Research Center (NRC) in collaboration with the Cambridge Nanoscience Centre (United Kingdom) – nanoscale technologies that will potentially create a world of radically different devices that open up an entirely new spectrum of possibilities."

More haptic/tactile feedback touch interaction:

Nokia's Haptikos Touch Screen Handheld Web Browser

Immersion's Touch Screen: Mimics feel of real buttons
How it works:

Immersion's Fitness Market Brief (pdf)

UPDATE 7/4/09
Apple is working on this sort of thing, in a way. See my recent post:
Haptic/Tactile Feedback for the iPhone? MacRumors says, "YES!"

Dreams about haptic overlays: Part Two: Bridging the gap between virtual and physical controls on tabletops.

Joel Eden's Informative Post: Designing for Multi-Touch, Multi-User and Gesture-Based Systems

Joel Eden is a User Experience Consultant at Infragistics- he recently wrote a detailed article/post in the Architecture & Design section of Dr. Dobbs Portal, "Designing for Multi-Touch, Multi-User and Gesture Based Systems". I thought I'd share the link, since I've been writing on the same topic.

In his article, Joel explains the differences between traditional WIMP (Window, Icon, Menue, Pointer) interaction and gesture, multi-touch, and multi-user systems. These systems are also known as Natural User Interfaces, or NUI. He recommends that "rather than trying to come up with new complicated ways to interact with digital objects, your first goal should be to try to leverage how people already interact with objects and each other when designing gesture based systems."

Joel goes on to outline UX (User Experience, IxD (Interaction Design), and HCI (Human-Computer Interaction) concepts that designers should consider when developing new systems, - Affordances, Engagement, Feedback, and "Don't Make Us Think", which he summarizes in the conclusion of his article.

I especially liked Joel's references:

Clark, Andy. Supersizing the Mind: Embodiment, Action, and Cognitive Extension

Few, Stephen. Information Dashboard Design: The Effective Visual Communication of Data

Gibson, John J. The Ecological Approach to Visual Perception

Krug, Steve. Don't Make Me Think: A Common Sense Approach to Web Usability, Second Edition

Norman, Don. The Design of Everyday Things

Norman, Don. Things That Make Us Smart: Defending Human Attributes In The Age Of The Machine

I would also add the following references:
Bill Buxton
Multi-touch Systems I have Known and Loved
(Regularly updated!)
Sketching User Experiences: Getting the Design Right and the Right Design

"Our lack of attention to place, time, function, and human considerations means these fancy new technologies fail to deliver their real potential to real people." - Bill Buxton

Dan Saffer
Designing for Interaction: Creating Smart Applications and Clever Devices
Designing Gestural Interfaces
SAP
Touchscreen Usability in Short
(Summary by Gerd Waloszek of the SAP Design Guild)
SAP Design Guild Resources (User-Centered Design, User Experience, Usability, UI Guidelines, Visual Design, Accessibility)
Kevin Arthur (Synaptics)
Touch Usability
Bruce "Tog" Tognazzini
Ask Tog: Interaction Design Solutions for the Real World
Inclusive Design, Part I
First Principles of Interaction Design
John M. Carroll
Human Computer Interaction (HCI) (History of HCI)
Bill Moggridge
Designing Interactions
Ben Shneiderman
Leonardo's Laptop: Human Needs and the New Computing Technologies
Edward Tufte
Visual Explanations
Beautiful Evidence
The Visual Display of Quantitative Information
Envisioning Information
Rudolf Arnheim (Gestalt)
Art and Visual Perception: A Psychology of the Creative Eye

Update: A great reading list on general HCI. Some of the authors were involved in the early days of touch, bi-manual, and multi-touch interaction.

Jan's Top Ten List of Books on Human-Computer Interaction


FYI: If you know much about Windows Presentation Foundation, you probably know that Josh Smith, WPF guru, also works at Infragistics

Touching Windows 7 - Informative post, video, and comments from the Engineering Windows 7 blog

Touching Windows 7 post on the Engineering Windows 7 blog provides a good overview of Microsoft's work with touch and gesture interfaces over the past several years, building upon earlier work with the TabletPC.

There are quite a few opinions shared in the post's comment section. It is worth the read.

Below are two videos from the Windows 7 post:

Windows 7 Gestures
<a href="http://video.msn.com/?mkt=en-US&playlist=videoByUuids:uuids:891c68b3-a534-4159-b6b2-8e4ac56b6890&showPlaylist=true" target="_new" title="Windows 7 Touch Gestures">Video: Windows 7 Touch Gestures</a>

My comments will be forthcoming.

Put-That-There: Voice and Gesture at the Graphics Interface and more Blasts from the 1980's HCI Past

bigkif's information about "Put-That-There" about Put-That-There gives a good description of this video:

Put-That-There at CHI '84

"In 1980, Richard A. Bolt from MIT wrote Put-that-there : voice and gesture at the graphics interface. It was a pioneering multimodal application that combined speech and gesture recognition.

This demo shows users commanding simple shapes about a large-screen graphics display surface. Because voice can be augmented with simultaneous pointing, the free usage of pronouns becomes possible, with a corresponding gain in naturalness and economy of expression. Conversely, gesture aided by voice gains precision in its power to reference."

Richard A. Bolt "Put-That-There": Voice and Gesture at the Graphics Interface (pdf) SIGGRAPH '80

Here is another blast from the '80's:

Kankaanpaa A. FIDS- AFlat-Panel Interactive Display System IEEE March 1988 IEEE Computer Graphics Applications(Nokia Information Systems)

"Although the needs and expectations of these various users are very diverse, they all have a common requirement: more natural and easier methods for communicating with the computer than are available today. Furthermore, they do not want to interact with the computer; they want to communicate with the application they are using. They do not want to use computer jargon; they want to use the same natural methods that they use when they perform the same tasks without a computer."

“We believe that only three of the flat-panel technologies described above, namely LCD, EL, and plasma, will be sufficiently advanced for mass production within this decade.”

Bill Buxton was working on multi-touch and gesture interaction in the 1980's, but his dreams did not become a reality until this century, for a variety of reasons. He shared his thoughts about the paradox of the speed of technology in a presentation at the 2008 IEEE International Solid-State Circuits Conference:Surface and Tangible Computing, and the “Small” Matter of People and Design”(pdf)

‘Carrying on from an earlier thesis in our department (Mehta , 1982) , we built a tablet that was sensitive to simultaneous touches at multiple locations, and with the ability to sense the degree of each touch independently (Lee, Buxton & Smith, 1984). We stopped the work in late 1984 when I saw a much better implementation at Bell Labs – one that was transparent and mounted over a CRT. The problem was that they never released the technology, so, the whole multi-touch venture went dormant for 20 years. But, I never stopped dreaming about it. (Lesson: don’t stop your research just because someone else is way ahead of you. It might be transitory, and anyhow, remember the story of the tortoise and the hare.)

“I spoke earlier about the paradox in the speed of technology development it goes at rocket speed, but that of a glacier as well; Simultaneously! In the perfect world, this would be ideal: we could go through several iterations of ideas so that by the time the new paradigms of interaction, such as Surface and Tangible computing are ready for prime time, everything will be in place. But, the rapid iteration is more directed at supporting the old paradigms faster and cheaper, rather then helping shape the new ones. The reasons are not hard to understand. From the perspective of circuit design, the problems are really hard. So, one has to have one’s head down working flat out to get anything done. But, there is a side of me that motivated this paper that asks, If it is so hard, then isn’t it worth making sure that the things one is working on are things that are worthy of one’s hard-earned skills?”

SOMEWHAT RELATED

Bill Buxton's Haptic Input References (pdf)

The Internet of Things can be Cute: MIR:ROR by Violet

The MIR:ROR application supports memory and interaction with your computers as well as your Web 2.0 applications via a RFID Stamp. You can even figure out the last time you fed your fish!

Here is some of the promotional information from the Violet website:
"Mir:ror makes your everyday objects interactive, intelligent, communicant. Stick RFID Ztamps on them and show them to the Mir:ror: your keys will send e-mail to tell someone you’ve got home, your pills know when you’ve swallowed them, your toys play videos… Thousands of uses you can easily program through a Website."

"Nano:ztags are lovable micro-rabbits with a RFID Ztamp in their tummy. Program them to play any content or application you choose each time you show them to a Nabaztag:tag or Mir:ror."

(Also posted on the Technology Supported Human-World Interaction blog)

Albrecht Schmidt's User Interface Engineering Blog: Great Links, References, and Resources

I really like Albrecht Schmidt's User Interface Engineering blog.

Albrecht Schmidt is a professor at the University of Duisburg-Essen who focuses his research on "novel user interfaces and innovative applications enabled by ubiquitous computing." Dr. Schmidt previously headed something called the "Embedded Interaction Research Group" at the Ludwig-Maximilians University in Munich.

Albrecht Schmidt will be working in collaboration with Chris Kray's group at the Culture Lab at Newcastle University in the UK. The work will focus on creating and building interactive appliances. He also mentioned the work of Jayne Wallace, one of the researchers at the Culture Lab, who creates digital jewelry.

The best thing about Albrecht's recent post was his short list of references:

[1] Wallace, J. and Press, M. (2004) All this useless beauty The Design Journal Volume 7 Issue 2 (PDF)

[2] Jayne Wallace. Journeys. Intergeneration Project.

[3] Kern, D., Harding, M., Storz, O., Davis, N., and Schmidt, A. 2008. Shaping how advertisers see me: user views on implicit and explicit profile capture. In CHI '08 Extended Abstracts on Human Factors in Computing Systems (Florence, Italy, April 05 - 10, 2008). CHI '08. ACM, New York, NY, 3363-3368. DOI= http://doi.acm.org/10.1145/1358628.1358858

Another recent post that I like was "Teaching, Technical Training Day at the EPO". The following topics were covered during a training event at the European Patent Office in Munich, Germany:

• Merging the physical and digital (e.g. sentient computing and dual reality [1])
  
• Interlinking the real world and the virtual world (e.g. Internet of things)
  
• Interacting with your body (e.g. implants for interaction, brain computer interaction, eye gaze interaction)
  
• Interaction beyond the desktop, in particular sensor based UIs, touch interaction, haptics, and Interactive surfaces
  
• Device authentication with focus on spontaneity and ubicomp environments
  
• User authentication focus on authentication in the public
  
• Location-Awareness and Location Privacy

I liked the references that Dr. Schmidt posted, given my growing interest in topics related to interactive wireless sensor networks:

[1] Lifton, J., Feldmeier, M., Ono, Y., Lewis, C., and Paradiso, J. A. 2007. A platform for ubiquitous sensor deployment in occupational and domestic environments In Proceedings of the 6th Conference on international information Processing in Sensor Networks (Cambridge, Massachusetts, USA, April 25 - 27, 2007). IPSN '07. ACM, New York, NY, 119-127. DOI= http://doi.acm.org/10.1145/1236360.1236377

[2] Naohiko Kohtake, et al. u-Texture: Self-organizable Universal Panels for Creating Smart Surroundings. The 7th Int. Conference on Ubiquitous Computing (UbiComp2005), pp.19-38, Tokyo, September, 2005. http://www.ht.sfc.keio.ac.jp/u-texture/paper.html

[3] Schwesig, C., Poupyrev, I., and Mori, E. 2004. Gummi: a bendable computer. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vienna, Austria, April 24 - 29, 2004). CHI '04. ACM, New York, NY, 263-270. DOI= http://doi.acm.org/10.1145/985692.985726

[4] Wigdor, D., Forlines, C., Baudisch, P., Barnwell, J., and Shen, C. 2007. Lucid touch: a seethrough mobile device. InProceedings of the 20th Annual ACM Symposium on User interface Software and Technology (Newport, Rhode Island, USA, October 07 - 10, 2007). UIST '07. ACM, New York, NY, 269-278. DOI= http://doi.acm.org/10.1145/1294211.1294259

[5] Campbell, A. T., Eisenman, S. B., Lane, N. D., Miluzzo, E., Peterson, R. A., Lu, H., Zheng, X., Musolesi, M., Fodor, K., and Ahn, G. 2008. The Rise of People-Centric Sensing. IEEE Internet Computing 12, 4 (Jul. 2008), 12-21. DOI= http://dx.doi.org/10.1109/MIC.2008.90

If you take a peek at the Culture Lab website, be sure to look at the Ambient Kitchen, designed to support older people with memory difficulties:

The Ambient Kitchen probably be a great way to help busy families get meals on the table, too!

Also look at Jayne Wallace's digital jewelry website The following pictures are of a neckpiece that triggers digital visits of silent film sequences on digital displays in its vicinity:

Some of Jayne's digital jewelry was created in response to "physical, clinical, social, and emotional dynamics of memory loss".

I hope you enjoy exploring Albrecht Schmidt's User Interface Engineering blog and the Culture Lab website!

Expore Chicago Installation at O'Hare Airport: Collaboration between HP TouchSmart PC's , GigaPan, and Others

I was going to post the pictures I took today of touch-screens and other displays from the Cleveland airport, but the news about the HP TouchSmart installation at the O'Hare airport was more exciting.

Via Carnegie Mellon: Explore Chicago Via GigaPan
3/30/09
"Panoramas created with GigaPan, a technology developed by Carnegie Mellon’s Robotics Institute and NASA, are featured on a new city Web site. The imagery of iconic Chicago locations can be explored in detail with 50 HP TouchSmart PCs installed throughout the airport by HP and the Chicago Department of Aviation and Office of Tourism."

Via Flickr

"Chicago's Mayor Daley, left, and Hewlett-Packard's, Stephen DeWitt, interact with on of the kiosks for Explore Chicago, a state of the art installation featuring touch screen HP computers and high-tech lounges, offering travelers a way to connect to the Chicago Tourism Center at O'Hare Airport Monday, March 30, 2009. During the unveiling, Mayor Daley, announced plans to use Chicago's recently awarded economic stimulus package of $12M for runway expansions at O'Hare Airport. (AP Images for HP/Stacie Freundberg)"

Everyware Healthcare Links

I've decided to focus some of my posts about emerging technologies related to health care on my Technology Supported Human-World Interaction Blog. Here are a few links:

Everyware Health Care: Real Life Examples

Everyware Health Care: A Personal Focus

Everyware Health Care: Microsoft Health's Common User Interface website, usable health care applications, pervasive health games....

Softkinetic 3D Gesture Recognition for Games and Rehabilitative Play

Taking 3D interaction further, Softkinetic has developed middle-ware that uses a 3D camera to support full-body gesture interaction with games and other applications. No controllers or devices are needed!



The following video is narrated in Portuguese, I, think, but you can understand the content in any language. I you love the Wii, you'll probably like this!


Here is a video that demonstrate how Softkinetic and Silverfit paired together to develop rehabilitative games for the elderly and others:


The following table is from the Silverfit website:

Game	Movement trained
Puzzle	While sitting down, bend whole body left and right, and stand up. Cognitive/visual component.
Mole	Balance exercise by stepping with one leg while standing.
Catching grapes	Walking movement left and right.
Walking	Walking in place, while avoiding obstacles and thresholds. Activity of Daily Life (ADL) component.
Arm exercise	Arm stretching and reaching in all directions with one or both arms. ADL component.
Picking flowers	Walking backwards, forwards and sideways. Optionally, bending down.
Memory	Arm stretching left, right, forwards and upwards. Cognitive component.

RELATED

Softkinetic and Silverfit Introduce Senior-Targeted Gaming
(Danny Cowan, Gamasutra, 12/19/08)

Softkinetic's Gesture-Based Interactive TV Action:

Interesting 3D Interactive Gesture Recognition System by Atracsys: BeMerlin Product Demonstration of Nespresso Products

Via Core 77:

The following video clip is an example of BeMerlin, an infrared guesture recognition system developed by Atracsys for demonstrating 3D representations of Nexpresso's expresso machines.


The video was taken at the Home + Housewares 2009 show in Switzerland.

ElderGadget Blog

Via Technology-Supported Human World Interaction

Today I came across the ElderGadget Blog when I was searching for technology that might be helpful to my father, who recently spent the last few weeks in an intensive care unit.

Here are a few things I found on the blog, including what I found when I followed a link to the bindependent website:

Smart Table: A Broadband Communication System for the Elderly


ID Studiolab, Delft University of Technology, NL
"The smart system is aimed to prevent possible social isolation between elderly people and their social contacts. It consists of the Smart Table and the Smart Messenger, which provide easy and intuitive way for elderly people to benefit from the advantage of communication technology and improve the satisfaction of their social activities."

"During the design research, a working prototype is made and evaluated by a user test. The Smart Table offers people a way to use broadband communication without the need for a computer. The television will be used for video communication (web-cam) and the table as user-interface. On the table contact persons can be selected and images and video can be shared. The elderly person can capture images that will be shared instantly. The contact person can select images from his or her computer, which will be projected on the table of the elderly person". (TU Delft - Faculty Industrial Design Engineering - Master Design for Interaction - Project Interactive Technology Design - Vincent Steurs & Juin-Yi Huang)


Demy Kitchen Safe Touchscreen Reader



Photo Watch


Clarity-C900: Amplified Big Button Cell Phone

911 Guardian: "Tiny wearable speakerphone"


Extra Large TV Remote Control

SmartShopper: Electronic grocery-list maker



Bierley's ColorMouse Video Magnifier

Voice Pod: Digital recording and playback system

RELATED

Live from CES - Dakim's Brain Fitness Keeps Seniors Sharp

Dakim Brain Games

Previous post: Ubiquitous Computing - Grandpa and grandkids use a webcam and Skype across the miles

YouTube Vlogger: Geriatric1927

Geriatric Gripes and Grumbles

Shift Happens Update: Did You Know? 3.0 (Infographic Video) & Updated 4.0!

 Update:  Here is Did You Know 4.0!


The first version Did You Know? (Shift Happens) started out as a PowerPoint presentation by Karl Fisch, an instructional technology specialist at Arapahoe High School as part of his staff development program. The goal was to convey information about the speed of change in our world through the use of a variety of statistical facts - on a global scale, and ultimately spark a conversation about the meaning of technology and the future among the educators in the room.

As you probably know, the conversation went well beyond the walls of Arapahoe High School!

In 2007, Did You Know? was updated by some of the designers at Xplane as a volunteer effort, and as of today, 3/25/09, had been viewed by 3,026,101 times on YouTube.

Did You Know? 3.0


Did You Know 2.0 Xplane version:


Did You Know 1.0 "Shift Happens" narrated with photographs:



Shift Happens Wiki
The FischBowl Blog

Note:
I came across the Did You Know? 3.0 video clip on Antoine RJ Wright's Mobile Ministry Magazine.

I first ran into Antoine at a coffee shop about a year ago. We both happened to be checking our email's on the same device, the beloved Nokia n800 Internet tablet. n800's are a rarity in the Charlotte area.

We soon learned that we shared a fascination for touch screen interaction and UI, but Antoine focuses primarily on mobile devices, and is a deep thinker on this topic. He showed me some of work he was doing with interface design on the n800 and I was impressed. Much of what he does could be transformed to the large screen with only a few tweaks, in my opinion.

Antoine runs Nokia's Mobile Web Server on his cell phone, which enables the phone to be accessible on the Internet and provides a personal "mobsite".

FYI: Antoine will be speaking at BibleTech '09 in Seatle, Washington soon on the topic of "Mobile Technology and Connecting Communities". If you have never given a thought about the intersection of technology and religion, you might be surprised at what is going on.

Struktable Multi-touch Installation at TOCA ME Design Conference

Struktable Multitouch Installation from Gregor Hofbauer on Vimeo.


Strukt is a design studio in Vienna, Austria, that specializes in interactive and generative design for a variety of purposes, such as interactive environments and installations, ambient intelligent environments, games, and multi-touch tables, screens, and walls. The video is a demonstration of applications that were presented at the March 2009 TOCA ME Design Conference in Munich, Germany. The applications were developed using vvvv. (More information regarding vvvv can be found at the end of this post.)




INFO FOR THE TECH-SAVVY OR TECH-CURIOUS:

According to information from the vvvv website, vvvv is a "toolkit for real time video synthesis. It is designed to facilitate the handling of large media environments with physical interfaces, real-time motion graphics, audio and video that can interact with many users simultaneously. vvvv is a visual programming interface. Therefore it provides a graphical programming language for easy prototyping and development. vvvv is real time, where many other languages have distinct modes for building and running programs, vvv only has one mode, run-time. vvvv is free for non-commercial use."

VVVV Screenshots
VVVV's Propaganda Page
Other projects using VVVV
Struktable: the 70-inch Multitouch Table

STRUK ON A SPHERE: Interactive installation at a Mercedes Benz conference

Pattie Maes TED Talk: Sixth Sense - Mobile Wearable Interface and Gesture Interaction (for the price of a cell phone?!)

In the following video, Pattie Maes and Pranav Mistry,of MIT's Fluid Interfaces Group, demonstrate SixthSense, wearable technology that incorporates a video camera, a projector, a digital camera:


From the SixthSense website:

"The SixthSense prototype is comprised of a pocket projector, a mirror and a camera. The hardware components are coupled in a pendant like mobile wearable device. Both the projector and the camera are connected to the mobile computing device in the user’s pocket. The projector projects visual information enabling surfaces, walls and physical objects around us to be used as interfaces; while the camera recognizes and tracks user's hand gestures and physical objects using computer-vision based techniques. The software program processes the video stream data captured by the camera and tracks the locations of the colored markers (visual tracking fiducials) at the tip of the user’s fingers using simple computer-vision techniques. The movements and arrangements of these fiducials are interpreted into gestures that act as interaction instructions for the projected application interfaces. The maximum number of tracked fingers is only constrained by the number of unique fiducials, thus SixthSense also supports multi-touch and multi-user interaction."

Photo from the SixthSense website

Of course it is similar to Minority Report, but I don't consider it to be a problem, because it supports multi-touch and multi-user interaction, and it is a "mobile" application of useful technology.

The interaction that had me at "hello world".