I Love the Wii.

More women are playing games, and the Wii has grabbed a good portion of attention from them, especially with titles such as Wii Fit.

While some say this is due to Nintendo's marketing strategy, in my opinion, I think it is because Nintendo developed a system that is non-geek and family-friendly. When I first heard of the Wii, they were in short supply. I spent quite a bit of time stalking out the local GameStop stores to buy one. I wasn't the only female doing the same thing.

Think about it. The Wii was introduced just at the time when prices of large flat-panel TVs were coming down, making them more affordable to families. Although Dad might have hankered for a large-screen TV to watch sports, any Mom in her right mind would want to multi-purpose such an expense. If you have to have a huge TV messing up your family room decor, it makes sense to use it for multiple purposes, like playing the Wii.

Not long after the Wii made it home, it eventually sprouted legs and was adopted by my young adult daughters.  Now the only way I get to play the Wii is if I make the trip uptown, a 30 minute drive. And if everyone is playing Rock Band, I have to wait my turn to play the drums.

I need to buy another Wii!  I think it will carry me through old age:






It will help me keep my girlish figure (this is NOT a picture of me, by the way)






Seriously, the Wii is turning out to be handy for folks, young and old,  with health problems:

Pulse Sensing:  Wii Vitality Sensor


Here is a video showing how the Wii is used at Madonna Rehabilitation Hospital's brain injury program:


Since more therapists and nurses are female, it stands to reason that a game console such as the Wii, which is very user-friendly, would be top on the list for use in health and rehabilitation settings.

The Wii is the focus of research with the elderly:
An exploratory study on senior citizen's perceptions of the Nintendo Wii: the case of Singapore International Convention on Rehabilitation Engineering and Assistive Technology, 2009

Here is a video of what seems to be an HCI student testing out the Wii with her grandparents:





Nintendo might have some competition once Microsoft's Project Natal comes to market. Natal doesn't require any sort of device to interact with the games. For more information about the latest in games for health and "exergames",  take a look at the following blogs:

• Exergame Lab
• Befitt
• Exergame Fitness
• Exergaming Australia
• Exergaming Evangelist
• FootGaming
• Gamercize
• GamerSize
• Health Gamers
• TEN = ExerGame Network
• Humana's Games for Health Website
  Conference:  Games for Health 2010
  

RELATED

Nintendo Boasts 9 Million Player Advantage Among Female Console Gamers
Video Games in Play
 "And despite the stereotypes about teenage males, gamers are not monolithic. In fact, 45% of active gamers are female and women account for half (49%) of all Wii owners and 52% of Sony Playstation Portable (PSP) owners."
Seniors Bowled Over by Wii
Wii-habilitation could prevent elderly from falls
(Thanks to Josh B. for pointing out the how the stats could be a problem. I still can't find the original research!"

Multi-touch and Tangible Computing & the Lumino Project

Professor Patrick Baudisch and his student researchers at the Haaso Plattner Institute in Germany have focused on Human-Interaction for a quite a while.  One look at the research project page of Dr. Baudisch says it all.  Over the past few years, the human-computer interaction (HCI) teams at Hasso Plattner have explored multi-touch and tangible computing, with very interesting results.  

Take a look at the following video from Design Boom's YouTube Channel, and follow the related links for more information!


Tangible Tabletop Computing with Lumino

(The Lumino project was developed using Microsoft Surface.)


RELATED
Lumino Project Website


Lumino Team:
Professer Patrick Baudisch, Torsten Becker, Frederik Rudeck
Human Computer Interaction, Hasso Plattner Institute
"The Human Computer Interaction group headed by Prof. Dr. Patrick Baudisch is concerned with the design, implementation, and evaluation of interaction techniques, devices, and systems. More specifically, we create new ways to interact with small devices, such as mobile phones and very large display devices, such as tables and walls."


Articles/Posts
Lumino (Design Boom, no author or date)
Smart 'Lego" blocks take touch screens into 3D   Colin Barras, New Scientist (10/6/09)
"Fat Fingers" can become dainty for touch Screens   Colin Barris, New Scientist (11/24/09)


Microsoft Surface and Objects (Features Lumino "Tangible Blocks" at the 1:02 marker)

Nokia Research Center's Mixed Reality Concept Video

Nokia Mixed Reality- Nokia World


More info:
The World Is My Interface blog

Mobile Gesture Design at Nokia: Gesture Interaction Around the World

From the Nokia Conversations YouTube Channel:


The video explains it all.

(Fritz Desir, thanks for the link!)

SensoramaLab - Interactive Systems for Rehabilitation Applications

The SensoramaLab at Aalborg University Esbjerg is involved in a variety of research activities focusing on interactive systems, including virtual reality, for use in rehabilitation.

Pictures from the SensoramaLab website:








International Society for Virtual Rehabilitation

ArtAbilitation

Michael Haller Discusses Multi-touch, Interactive Surfaces, and Emerging Technologies for Learning

I came across an excellent overview of interactive display technologies that hold promise for education. The link below is a research article written by Michael Haller for BECTA, formally known as the British Educational Communications and Technology Agency.

Emerging Technologies for Learning: Interactive Displays and Next Generation Interfaces(pdf)
Becta Research Report (2008) Michael Haller Volume 3 (2008)

"Multi-touch and interactive surfaces are becoming more interesting, because they allow a natural and intuitive interaction with the computer system.

These more intuitive and natural interfaces could help students to be more actively involved in working together with content and could also help improve whole-class teaching activities. As these technologies develop, the barrier of having to learn and work with traditional computer interfaces may diminish.

It is still unclear how fast these interfaces will become part of our daily life and how long it will take for them to be used in every classroom. However, we strongly believe that the more intuitive the interface is, the faster it will be accepted and used. There is a huge potential in these devices, because they allow us to use digital technologies in a more human way." -Michael Haller

Michael Haller works at the department of Digital Media of the Upper Austria University of Applied Sciences (Hagenberg, Austria), where he is the head of the Media Interaction Lab.

Michael co-organized the Interaction Tomorrow course at SIGGRAPH 2007, along with Chia Shen, of the Mitsubishi Electric Research Laboratories (MERL). Lecturers included Gerald Morrison, of Smart Technologies, Bruce H. Thomas, of the University oof Southern Australia, and Andy Wilson, of Microsoft Research. The course materials from Interaction Tomorrow are available on-line, and include videos, slides, and course notes.

Below is an excerpt from the discription of the Interaction Tomorrow SIGGRAPH 2007 course:

"Conventional metaphors and underlying interface infrastructure for single-user desktop systems have been traditionally geared towards single mouse and keyboard-based WIMP interface design, while people usually meet around a table, facing each other. A table/wall setting provides a large interactive visual surface for groups to interact together. It encourages collaboration, coordination, as well as simultaneous and parallel problem solving among multiple people.

In this course, we will describe particular challenges and solutions for the design of direct-touch tabletop and interactive wall environments. The participants will learn how to design a non-traditional user interface for large horizontal and vertical displays. Topics include physical setups (e.g. output displays), tracking, sensing, input devices, output displays, pen-based interfaces, direct multi-touch interactions, tangible UI, interaction techniques, application domains, current commercial systems, and future research."

It is worth taking the time to look over Haller's other publications. Here is a few that would be good to read:

M. Haller, C. Forlines, C. Koeffel, J. Leitner, and C. Shen, 2009. "Tabletop Games: Platforms, Experimental Games and Design Recommendations." Springer, 2009. in press [bibtex]

A. D. Cheok, M. Haller, O. N. N. Fernando, and J. P. Wijesena, 2009.
"Mixed Reality Entertainment and Art," International Journal of Virtual Reality, vol. X, p. X, 2009. in press [bibtex]

J. Leitner, C. Köffel, and M. Haller, 2009. "Bridging the gap between real and virtual objects for tabletop games," International Journal of Virtual Reality, vol. X, p. X, 2009. in press [bibtex]

M. Haller and M. Billinghurst, 2008.
"Interactive Tables: Requirements, Design Recommendations, and Implementation." IGI Publishing, 2008. [bibtex]

D. Leithinger and M. Haller, 2007. "Improving Menu Interaction for Cluttered Tabletop Setups with User-Drawn Path Menus," Horizontal Interactive Human-Computer Systems, 2007. TABLETOP 07. Second Annual IEEE International Workshop on, pp. 121-128, 2007. [bibtex]

J. Leitner, J. Powell, P. Brandl, T. Seifried, M. Haller, B. Dorray, and P. To, 2009."Flux: a tilting multi-touch and pen based surface," in CHI EA 09: Proceedings of the 27th international conference extended abstracts on Human factors in computing systems, New York, NY, USA, 2009, pp. 3211-3216. [bibtex]




P. Brandl, J. Leitner, T. Seifried, M. Haller, B. Doray, and P. To, 2009. "Occlusion-aware menu design for digital tabletops," in CHI EA 09: Proceedings of the 27th international conference extended abstracts on Human factors in computing systems, New York, NY, USA, 2009, pp. 3223-3228. [bibtex]


References from the BECTA paper:

Elrod, S., Bruce, R., Gold, R., Goldberg, D., Halasz, F., Janssen, W., Lee, D., Mc-Call, K., Pedersen, E., Pier, F., Tang, J., and Welch, B., Liveboard: a large interactive display supporting group meetings, presentations, and remote collaboration, CHI ’92 (New York, NY, USA), ACM Press, 1992, pp. 599–607.

Morrison, G., ‘A Camera-Based Input Device for Large Interactive Displays’, IEEE Computer Graphics and Applications, vol. 25, no. 4, pp. 52-57, Jul/Aug, 2005.

Albert, A. E. The effect of graphic input devices on performance in a cursor positioning task. Proceedings ofthe Human Factors Society 26th Annual Meeting, Santa Monica, CA: Human Factors Society, 1982, pp. 54-58.

Dietz, P.H., Leigh, D.L., DiamondTouch: A Multi-User Touch Technology, ACM Symposium on User Interface Software and Technology (UIST), ISBN: 1-58113-438-X, pp. 219-226, November 2001.

Rekimoto, J., SmartSkin: An Infrastructure for Freehand Manipulation on Interactive Surfaces,
CHI 2002, 2002.

Kakehi, Y., Iida, M., Naemura, T., Shirai, Y., Matsushita, M.,Ohguro, T., ‘Lumisight Table: Interactive View-Dependent Tabletop Display Surrounded by Multiple Users’, In IEEE Computer
Graphics and Applications, vol. 25, no.1, pp 48 – 53, 2005.

Streitz, N., Prante, P., Röcker, C., van Alphen, D., Magerkurth, C.,Stenzel, R., ‘Ambient Displays and Mobile Devices for the Creation of Social Architectural Spaces: Supporting informal communication and social awareness in organizations’ in Public and Situated Displays: Social and Interactional Aspects of Shared Display Technologies, Kluwer Publishers, 2003. pp. 387-409.

Morrison, G., A Camera-Based Input Device for Large Interactive Displays, IEEE Computer Graphics and Applications, vol. 25, no. 4, pp. 52-57, Jul/Aug, 2005.

Ishii, H., Underkoffler, J., Chak, D., Piper, B., Ben-Joseph, E., Yeung, L. and Zahra, K., Augmented Urban Planning Workbench: Overlaying Drawings, Physical Models and Digital Simulation. IEEE and ACM International Symposium on Mixed and Augmented Reality ACM Press, Darmstadt, Germany.

Han, Y., Low-cost multi-touch sensing through frustrated total internal reflection, UIST ’05 (New York), ACM Press, 2005, pp. 115–118.

Hull., J., Erol, B., Graham, J., Ke, Q., Kishi, H., Moraleda, J., Olst, D., Paper-Based Augmented Reality. In Proceedings of the 17th International Conference on Artificial Reality and Telexistence (Esbjerg, Denmark,November 28-30, 2007). ICAT ’07. IEEE, 205-209.

Haller, M., Leithinger, D., Leitner, J., Seifried, T., Brandl, P., Zauner, J., Billinghurst, M., The shared design space. In SIGGRAPH ’06: ACM SIGGRAPH 2006 Emerging technologies, page 29, New York, NY,USA, 2006. ACM Press.

Research email: emtech@becta.org.uk
Main email: becta@becta.org.uk
URL: www.becta.org.uk

(This was also posted on the TechPsych blog.)

RENCI at Duke University: Multi-Touch Collaborative Wall and Table utilizing TouchLib; More about UNC-C's Viz lab...

RENCI is a multi-disciplinary collaboration between several universities in North Carolina, with centers located at the Europa Center, Duke University, N.C. State, UNC Chapel Hill, East Carolina University, UNC-Asheville, UNC-Charlotte, and the Health Sciences Library at UNC-Chapel Hill. Many of the centers focus on visualization and collaborative technologies, and have been involved in multi-touch "surface" computing.

The pictures below are from the RENCI center at Duke University:

Duke Multi-Touch Collaborative Wall

The multi-touch wall is 13 x 5 feet, and utilizes six high-definition projectors, resulting in a combined resolution of 5760-2160, and supports multiple users. According to information on the RENCI website, the design is scalable and applicable to non-flat surfaces. The wall system runs on Windows and Linux.

(Photo by Josh Coyle)

(Photo by Josh Coyle)

DI, or Direct Illumination is used for touch detection in both the wall and the table for detecting touch. A separate instance of Touchlib runs for each of the 8 cameras used to detect touch. A gesture engine interprets the information about touches on the screen as gesture events. Each camera is handled separately for image processing and blob tracking tasks.

Graphics from the RENCI Vis Group Multi-Touch Blog

Here is cool picture of the "Multi-touch Calibration Device", which uses a built-in TouchLib utility.

Additional information can be found on the RENCI Vis Group Multi-Touch Blog.

FYI

Touchlib is a multi-touch development kit that can be found on the NUI-Group website.

"Touchlib is a library for creating multi-touch interaction surfaces. It handles tracking blobs of infrared light, and sends your programs these multi-touch events, such as 'finger down', 'finger moved', and 'finger released'. It includes a configuration app and a few demos to get you started, and will interace with most types of webcams and video capture devices. It currently works only under Windows but efforts are being made to port it to other platforms."

If you are interested in creating your own multi-touch table, the NUI-Group website and forums are a great place to start.

Related:

If you follow my blog, you probably know that I've taken several graduate courses at UNC-Charlotte. Some of my professors and a classmate or two have been involved in some exciting visualization research over the past year. (If you are serious about multi-touch and other visually-based applications, it is worth taking some time to familiarize yourself with visualization and interaction research.)

News from the UNC-Charlotte Vis Center:

At the University of North Carolina at Charlotte, RENCI is a collaboration between the UNC Charlotte Urban Institute, the Center for Applied Geographic Information Science, and the Charlotte Visualization Center.

11/06/2008
Robert Kosara’s group wins two awards at IEEE VisWeek Caroline Ziemkiewicz and Robert Kosara won Honorable Mention (the second highest award) at the IEEE InfoVis Conference for their paper, “The Shaping of Information by Visual Metaphors”. Also, Alex Godwin, Kosara’s student, won Best Poster for his submission, “Visual Data Mining of Unevenly-Spaced Event Sequences”.

The Vis Center is pretty fascinating, as you can see by the group of visitors at an open house.

If you are just as fascinated by this stuff as the guys in the picture, here are links to some recent papers by UNC-Charlotte faculty affiliated with the Vis Center:

The Shaping of Information by Visual Metaphors (Caroline Ziemkiewicz and Robert Kosara)

Evaluating the Relationship Between User Interaction and Financial Visual Analysis (Don Hyun Jeong, Wenwen Dou, Felsia Stukes, William Ribarsky, Heather Richter Lipford, Remco Chang)

Visual Analytics for Complex Concepts Using a Human Cognition Model (Tera Marie Green, William Ribarsky, and Brian Fisher)

Interactive Displays and Whiteboards: Link to TechPsych Post

(photo from http://www.nextwindow.com)

I've posted new information and links about resources for interactive whiteboards and displays on the TechPsych blog:

So You're Getting an Interactive Whiteboard. Now What?

Post about CITEd's multimedia instruction of social skills and related links.

The Center for Implementing Technology in Education (CITEd ) is a website with a wealth of information about technology and education. I particularly like the section that focuses on the use of multimedia for social skills instruction. Take a look at my post on the TechPsych blog for more information and links.

Cross Posted on TechPsych: Classroom 2.0 - Social Networking and Resources for Educators

Classroom 2.0 is a good resource for educators who would like to keep up with the fast pace of technology. If you work with digital natives, you know how difficult it can be to keep one step ahead of the game! Classroom 2.0 provides forums, Wikkis, and resources on a variety of topics and the content is maintained by members of the network, which at the last count was at 3998.

From the Classroom 2.0 website

"The social network for educators using collaborative technologies!"

"Welcome to Classroom20.com, the social networking site for those interested in Web 2.0 and collaborative technologies in education. We especially hope that those who are "beginners" will find this a supportive community and a comfortable place to start being part of the digital dialog. Feel free to explore!"

About: Roomba - Human Family Interaction (NSF)

The National Science Foundation has a great article about a researcher from Carnegie-Mellon, Jodi Forlizzi who studies how families interact with their "adopted" Roombas.

Although Roombas were intended to function as lowly vacuums, when hacked, they just might have some interactive multimedia potential! Having a Roomba in the family room- and the classroom - might be a way to interest young people in exploring engineering and technology.



Related
NSF article

Techeblog article with video clips and link to some downloadable code, if you are so inclined:

Five Top Roomba Hacks

1. Roomba Frogger Redux
2. Super Roomba with airsoft gun and laser sight
3. Caroling Roombas
4. Wiimote + Roomba
5. Cellphone-controlled Roomba

FutureLabs Research: Teaching with Games

This on-line report from FutureLab (UK) provides new information about ways teachers can use interactive games in educational settings:

"Teaching with Games: A one-year project supported by Electronic Arts, Microsoft, Take-Two and ISFE Final report: Using commercial off-the-shelf computer games in formal education
By Richard Sandford, Mary Ulicsak, Keri Facer and Tim Rudd (September 2006)"

The appendix includes a summary of lesson plans.

Additional links from the FutureLab website include a literature review on the topic of games and learning, a games handbook, and the following external links:
Serious Games Interactive: www.seriousgames.dk
The Education Arcade: www.educationarcade.org
Serious Games Initiative: www.seriousgames.org
Room 130: labweb.education.wisc.edu/room130/index.htm
Games Parents Teachers: www.gamesparentsteachers.com
Department of Defense Game Developers' Community: www.dodgamecommunity.com
EdGames: edweb.sdsu.edu/courses/edtec670
Games For Change: www.seriousgames.org/gamesforchange
Learning Lab Denmark - Rikke Magnussen's research on science games:www.lld.dk/consortia/learninggames/news/chi2004presentation/en
Serious games entry on Wikipedia: en.wikipedia.org/wiki/Serious_game