What happens when a 2-year old wakes up to the sound of the Google Map Lady? "I CAN'T turn left right now!"

Google Map Lady says, "Turn Left", toddler yells from the back seat, "I CAN'T..."

If you are new to this blog, you might not know that I'm the grandmother of a 2-year-old little boy.  Watching him grow in an increasingly technology-enriched world has been an eye-opener at times, from his first interaction with my iPad, fingers-and-toes at 7 months of age, to his attempts at rafting down a digital river, playing the Kinect Adventure! River Rush game. 

Technology is rapidly changing how we learn, interact, and navigate our world.  Designers, developers, and others who are involved in the process of creating for the near future must be mindful of the ways newer technologies might play out in the real world, where the "user" is not always the person intended for the "user experience".  Off-the-desktop technologies are rapidly advancing, and impact people of all ages, wherever they happen to be.

Today's story is just one example.

I'm fortunate to live about a 35 minute drive from my grandson, and for this reason, I sometimes take him out and about, especially when his parents have a lot of errands to run.

After a nice lunch at Amelie's French Bakery  near the NoDa neighborhood (Charlotte, NC),  and exploring the floor murals in the little mall behind the bakery, I told my grandson that we were going to the "Big Park" (Freedom Park). 

He was so excited, but within a few minutes, he was fast asleep.

I drove up towards the airport to kill time, thinking that he'd wake up and we'd watch the planes. He was still sleeping.  Now what?

I opened up Google Maps on my cell phone to get directions from the airport to the Carolina Raptor Center at Latta Plantation Park, since I wasn't sure how to get there from the airport.

About 15 minutes later, as the Google Map Lady gave directions, Levi woke up, saying "What's that sound? A lady's voice?". The Google Map Lady spoke again, and said something like, "In 1000 feet, take a left turn." 

Levi replied empathically, "I CAN'T turn left right now!". Google Map Lady responded with the next direction, and Levi replied, "I CAN'T do that!". 

The little guy was visibly upset, because he thought the lady was telling him what to do. It was obvious to him that he could not comply with her request.

What to do?   How do I explain the "Google Map Lady" this to a 2-year old? 

This is how I handled the situation:

I told him that the lady's voice was to help me know where turn so I could drive to the raptor center.  I kindly told him that the directions were just for me, not little boys who can't turn the car because they are in car seats and can't drive. He nodded and said, with relief, "Lady's voice for Mi-Mi, NOT for little boys", and was fine after that.

Note:
Although I did not know it at the time, my grandson had somehow wriggled out of the left harness of his car seat. I discovered the problem as I went to unfasten him from the car seat, and wondered how long he'd not been secured safely.  It hadn't occurred to me that this would happen - everything was in place at the beginning of our ride, as you can see from the first picture.  

As I lifted my grandson out of the car seat, it crossed my mind that it would be a good idea if car seats came with sensors to let the driver know if the car seat straps, snaps, or buckles became unsecured. (Systems like Forget Me Not provide a warning system to parents if the child is forgotten in the car.)

After conducting a quick search, I found that Sherine Elizabeth Thomas has applied for a patent that includes the use of a sensor to alert the adult that a child has unbuckled their seat belt.  I think that a system could be developed to provide an alert if the child was not safely secured, as in the case of my wiggly grandson.  

RELATED AND SOMEWHAT RELATED

Technology for Today's Family (CHI Workshop)

Forget Me Not Wireless Child Tether 

(Self-activating, self-aware digital wireless safety system)

Forget-Me-Not Car Safety Website

How Getting Married and Having Kids Made Me a Better Programmer

John Polaceck, 3/24/13

Grandma Got STEM blog (More info to come on this topic!)

New Hollywood Hard Rock Cafe Sparkles with Interactive Multi-touch Wall and Microsoft Surface Booths!

I came across a blogpost entitled "Tourist in my own town". In this post, the author shares is positive experience of his visit to the new Hard Rock Cafe, located on the Hollywood Walk of Fame.  I loved his comment:  "A whole wall of Microsoft software running and not a single BSOD!"  In addition to the interactive wall, visitors have the chance to play with the content on Microsoft's interactive Surface tables. Below is a picture from the post from the Sure Beats Work blog:



-Sure Beats Work


A recent post on the Hard Rock Cafe blog provides more information about the interactive technologies at the Hollywood site: "Hard Rock International Rocks Its Way to Hollywood Boulevard":


New Look ~ New Vibe ~ New Memorabilia Technology
"In the latest example of Hard Rock’s concept-driven design evolution, the Hollywood Boulevard cafe was developed to integrate technology, creating a new look and vibe that will rock Hollywood. Hard Rock Cafe Hollywood on Hollywood Boulevard showcases new and unique interactive experiences for guests – from an 18’ x 4’ Rock Wall™ to touch screens in booths throughout the cafe to Microsoft Surface™, each featuring innovative multi-touch technology that enables fans to explore the world’s greatest rock ‘n’ roll memorabilia collection and virtually tour all of Hard Rock’s venues worldwide."

"In addition to the cutting-edge multimedia memorabilia experience, hundreds of items from Hard Rock’s iconic collection adorn the walls of Hard Rock Cafe Hollywood on Hollywood Boulevard, including items from many of the world’s most beloved and recognizable musicians, as well as contemporary artists with local ties. Key memorabilia items are now on display, from Jimi Hendrix’s purple crushed velvet hat; to Janis Joplin’s love letter to then boyfriend Peter LeBlanc; Jim Morrison’s leather pants and handwritten lyrics to “L.A. Woman”; to Katy Perry’s sparkly dress and Fergie’s tour outfit worn while on tour with the Black Eyed Peas."

The memorabilia wall was created for the Hard Rock Cafe by Obscura Digital, a company that is involved in off-the-desktop ubiquitous computing, including ambient technologies that include natural-user interfaces and interaction. Obscura Digital aims to "make data pervasive and accessible in almost any situation, allowing virtually any surface to be turned into a portal to the Internet".  


The Memorabilia Wall has been installed in several Hard Rock Cafes around the world- additional pictures can be found on the Obscura Digital website.The first installation of the wall was at the Hard Rock Cafe in Las Vegas in 2009. - Below is the interaction of the wall at the Las Vegas Hard Rock Cafe:

-Obscura Digital

The following video, set to Beck's "Elevator Music", provides a great demonstration of the Hard Rock Cafe Memorabilia application as experienced on the Surface:

Hard Rock memorabilia app for Microsoft Surface (extended) from Duncan/Channon on Vimeo.
(The music in the video "Elevator Music, by Beck.)


RELATED
My megapost about the Hard Rock Cafe interactive wall and website:

Interactive Memorabilia at the Hard Rock Cafe: 
Microsoft's Multi-touch Rock Wall, Companion Surface Installations, and Awesome Touch-Responsive Interactive Memorabilia Website

Below is a screenshot of the main portal of the Hard Rock Cafe interactive memorabilia website, which compliments the "real" wall. You can interact with all 1532 items and learn more about the history behind the various artists.  It is fun to play with on a touch-screen display!


Duncan Channon: Sin City Memorabilia Interfaces


SOMEWHAT RELATED
Obscura Digital
Obscura Digital's Cuelight, and interactive pool table at the SOHO Esquire House:

Cuelight from Obscura Digital on Vimeo.
"Featured at the Esquire House's "Ultimate Bachelor Pad" in NYC, the one-of-a kind Obscura CueLight projection system turns a game of pool into an amazing interactive art display"

Interactive Multimedia Technology Themes -Update on Travel Technologies

Over the next month or so I will be re-organizing this blog. I'll be analyzing the various themes that have emerged since I started this on 4/11/06, over three years ago, as part of an assignment for a class about distance education and on-line communication tools.

My first topic was "Games, Simulations, and Virtual Worlds". Although I continue to focus on those themes, I mostly center around off-the-desktop interactive, collaborative, and emerging technologies that support interaction and activities in public spaces.

One theme that interests me is technology that supports travel experiences. Since I've had the opportunity to travel a great deal (before the economy started to go downhill), I've had a chance to explore this arena as a participant-observer*, and have documented my findings through photographs and video.

It is a joke in my family that if I disappear from the tribe, I can usually be found nearby, poking at an interactive touch screen, photographing something related to technology, or sneaking in a few shots of other people interacting with technology, and sometimes even talking to strangers as they use technology. (I usually ask permission to take pictures of people who are in my view finder, but sometimes they just happen to be in my line of sight.)

It is amazing what an earful you can get about technology as a fellow traveller!

I came across the work of Nanonation when I was on a Royal Caribbean cruise ship, and was a little disappointed with the touch-screen content and interaction around the ship. From what I can tell from the NanoNation website, the applications have been improved somewhat, especially the way-finding application on the Freedom of the Seas:

Wayfinding Application, Freedom of the Seas

-Nanonation

Nanonation was also involved in the development of a "Discovery Wall" at the Umpqua bank. This system incorporates tangible icons that sit on a shelf located near the Discovery Wall that trigger an interactive flash presentation on a screen. The icons represent various bank products, and are RFID enabled.

Discovery Wall, Umpqua Bank

-Nanonation

Back to the topic of cruise ship/travel technology:

When I was on the Ruby Princess cruise in December of 2008, I was impressed with the "Movies Under the Stars" set-up. At night, the sunning decks are transformed into out-door movie viewing spots, where you can lounge around, basking under the stars at you watch the gigantic silver screen and excellent sound system.

During the day, the system is used to display games that people play on the Wii, which provides the non-playing sunbathers additional entertainment.

I recently learned that the Movies Under the Stars system was developed and installed by FUNA, an international company that focuses on marine-related industries, as well as land-based industries.

Take a look to my "Wii-OOH" Flickr set slideshow to see the Wii in action on the large screen of the Ruby Princess, and on smaller screens in the food-court of the Concord Mills (NC) mall:

(Note, the mall pictures were taken with my cell phone.)

I want to go back!

HCI Note

*I was trained in the use of participant observation long ago, when I was studying social science

and psychology at the University of Michigan. It is a method that was developed early on by anthropologists

and sociologists, and adopted later by researchers in other fields. Some human-computer interaction

researchers use this method, and related techniques, such as ethnography, in their work.

Exploring the Design Space in Technology- Augmented Dance at CHI 2010: Celine Latulipe's team from UNC-Charlotte

I was at the CHI conference in Atlanta for a few days earlier this month, where I participated in a workshop on on the next generation of human-interaction and emerging technologies for education.  While I was at the conference, I managed to attend several interesting presentations, which I'll be including in future posts.  I was not able to stay for the entire conference.  The good thing is that many of the conference participants provided links to video, photos, slides, and related papers!

I had a chance to see a performance of dancers from the Dance.Draw team, headed by Dr. Celine Latulipe from UNC-Charlotte.  Dr. Latulipe is involved in several related projects that explore creativity, interaction, dance, music, and art:

Description of the performances held at the April CHI 2010 Conference, Atlanta, Georgia:

Layered Surveillance - A Collaborative Interactive Art Installation 
Celine Latulipe, University of North Carolina at Charlotte Annabel Manning, New Media Artist
View Video Demonstration
Artist Annabel Manning explores the world of immigration and identity, and explores imagery related to border crossings and surveillance. Computer scientist Celine Latulipe explores embodied, collaborative interaction. The intersection of these two worlds leads to research in embodied collaborative interaction and an interactive art exhibit in which participants can explore both static images through interactive layers, and moving video through interactive surveillance lenses. Participants can explore alone or with others, using gyroscopic mice to control different aspects of the artwork. The participants are led, through interaction, to contemplate the (in)visibility of the immigrant and the agency of surveillance.


Photos from the Layered Surveillance Flickr Photostream (Annabel Manning)



Exploring the Design Space in Technology- Augmented Dance (Dance.Draw)
Celine Latulipe, Sybil Huskey, David Wilson, University of North Carolina at Charlotte, USA
Mike Wirth, Queens University of Charlotte, USA
Berto Gonzalez, Arthur Carroll, Melissa Word, Erin Carroll, Vikash Singh, University of North Carolina at Charlotte, USA
Danielle Lottridge, University of Toronto, Canada


Video demonstration of the Dance.Draw project (mp4 file)
"This performance is part of an ongoing Dance.Draw project at the University of North Carolina at Charlotte, which investigates lightweight methods for integrating dance motion with interactive visualizations and enhancing audience interaction with dance."



-Photo from the Dance Draw website 


RELATED

References for Layered Surveillance:

	C. Latulipe, I. Bell, C. L. Clarke, and C. S. Kaplan. sym-Tone: Two-handed manipulation of tone reproduction curves. In GI 2006 Proceedings, pages 9--16. Canadian Information Processing Society, 2006. C. Latulipe and A. Manning. Interactive surveillance: Audience interaction with moving digital paintings. Interactive Installation at the (re)Actor3 Digital Live Art Conference, September 2008. http://www.digitalliveart.com/. L. Loke, A. T. Larssen, T. Robertson, and J. Edwards. Understanding movement for interaction design: frameworks and approaches. Personal Ubiquitous Comput., 11(8):691--701, 2007. D. Maynes-Aminzade, R. Pausch, and S. Seitz. Techniques for interactive audience participation. In ICMI '02:Proceedings of the 4th IEEE International Conference on Multimodal Interfaces, page 15, Washington, DC, USA, 2002. IEEE Computer Society. S. S. Snibbe and H. S. Raffle. Social immersive media: pursuing best practices for multi-user interactive camera/projector exhibits. In CHI '09: Proceedings of the 27th international conference on Human factors in computing systems, pages 1447--1456, New York, NY, USA, 2009. ACM.

Below is a post I wrote about Dance.Draw in 2008:

DANCE.DRAW: EXQUISITE INTERACTION
(Updated)

"The movement of the visualizations are artifacts in real-time of the movements of the dancers. They draw while they dance, they dance together and they draw together. Every performance generates a new visual imprint." -DanceDraw website

Interactive multimedia technology, blended with the arts!

Dr. Celene LaTulipe, from UNC-Charlotte's Software and Information Systems Department, Professor Sybil Huskey, from the dance department, dance students, and others collaborated to create an amazing performance that I had the opportunity to see performed during the Visualization in the World Symposium in April (2008).

If you look closely, you will see that each dancer holds two wireless mice, one in each hand. The mice trigger the visualization that is projected in the background. Dr. LaTulipe has focused some of her research on two-handed computer interaction. It is interesting to see how her work has been applied to this beautiful "off-the-desktop" application.

Dance.Draw is a work in progress- visit the following links for more information:

Website (Updated)
Movie
Technical Info
Dr. Kosara's Eager Eyes post about Dance.Draw

Note:
Dr. LaTulipe was my HCI professor- Dr. Kosara was my Visualization/Visual Communication professor.

Jeff Han Discusses Windows 8 for Large Displays, Microsoft's New Multi-touch, Ink & Pen Tech; Experience Design for Large Displays (2012 Microsoft Build)

Earlier this year, Microsoft bought Jeff Han's company, founder of Perceptive Pixel.  Jeff Hans now works for the Microsoft Office division of the company, where there is a push to bring new and improved large multi-touch displays to the corporate world. With this off-the-desktop move, developers are challenged to develop applications for Windows 8 that will be geared towards supporting collaboration in corporate settings.

Jeff Han and Nathan Fish were at Microsoft's "Build" conference recently  to give a presentation about the nuts and bolts of the new technology - how it works, and suggestions for design.  Although the video presentation is over an hour long, it is worth setting aside some time to watch! 

New multi-touch, ink, and pen technologies that can revolutionize your apps on any size of screens (10/30/12, Microsoft Build)



Here is the description of the presentation:
"Develop solutions that flow with your customers business - starting with individuals and information workers on their phones, desks or virtual offices, moving into conference rooms, brainstorm areas, boardrooms and common areas.  Learn how Microsoft's new pen and touch capabilities, software and hardware will enable you to develop products that will help businesses be more efficient.  Have a sneak peek on what our large multi-touch displays (82' and 55') can bring to your solutions." -Microsoft Build

Jeff Han emphasized that touch interaction is everywhere and is a fundamental requirement in applications. Windows 8 apps should be designed for all screen sizes, saying "It's all about collaboration of people and a collaboration of devices that gets your work done....this is the real thing, and it is about to happen.  Devices (referring to large displays) are coming... we do have a mechanism for early access hardware."

During the second half of the video (38:00), Nathan Fish discusses guidelines for designing experiences on large displays, including optimization, handling various interactions via pen, touch, and gestures, the use of application bars and context menus, and more.

At the beginning of his presentation, Nathan Fish briefly discusses the uncharted territory of designing for collaborative large displays, and tells the audience that the guidelines are just suggestions, " nothing is written, we are figuring this out as we go."

My fear is that Windows 8 developers might not have the inclination to think past the smaller screens of smartphones and tablets, resulting in touchy-feely variations of PowerPoint and other Office applications that have been around for too long.

RELATED
Microsoft Welcomes Perceptive Pixel to the Office Division
The Official Microsoft Blog, 7/30/12


What happened to the Surface Table?
I was surprised that Jeff Han's company was not folded into PixelSense, formally known as Surface, the division of Microsoft that focuses on large multi-touch tables. In my opinion, the tables had some potential to support collaborative work in the corporate world.  It will be interesting to see how things unfold!  

PixelSense
Take a look at the video clip below for more information:
 

Discover the Samsung SUR40 (with PixelSense)
Samsung SUR40 with Microsoft PixelSense
PixelSense Development Partners
Insights on Interactive Tabletops: A Survey of Researchers and Developers (pdf)
Hrvoje Benko, Meredith Ringel Morris, A.J. Bernheim Brush, and Andrew D. Wilson 2009, Microsoft Research

SOMEWHAT RELATED
I've been interested in large screen displays and how they interact with smaller devices for a very long time.  In 2007, I was taking graduate courses at UNC-Charlotte and planned to pursue further research and work related to this area.   At the time, I prepared a paper to present at a conference, but was unable to present due a serious health emergency in my family.  The abstract is below:


"Large screen displays support the collaboration of two or more people, especially 
when the nature of the content is visual.  These displays, in the form of walls, windows, 
boards, and touch-tables, will become ubiquitous in the future, and can be found in workplaces, educational institutions, museums, and other public spaces. New display systems have been developed that allow for co-located communication between groups of people, and also allow for collaboration with individuals in remote locations, using mobile computing or communication devices.  This paper will provide an overview of the technologies that support  this new way of communication, discuss the challenges involved in 
establishing "interoperability" within these new systems, and examine the possibilities for 
the future."

If this topic interests you, take a look at one of my Flickr collections:

Ubiquitous Sightings of Urban Screens: Interactive Displays in Public Spaces, Digital Signage, and Screens of All Sizes

Description:

"All kinds of displays are cropping up in shopping centers, malls, banks, stores, airports, schools, businesses, and meeting places. What is the purpose of all of these displays?

Displays and mobile devices, everywhere we go.

It doesn't look like we've really figured out how to harness the potential of the technology that surrounds us."

Link to Innovative Interactivity (II) & post: SMART Technologies' acquisition of NextWindow: A "smart window" to the world

I am happy to announce that will be contributing a post bi-weekly on the 1st and 3rd Thursday of each month for the  Innovative Interactivity (II) blog.

In my first post, I discuss interactive technologies in education and the explosion in the number of interactive whiteboards making way in classrooms in the US and around the globe.   The motivation for this post came from last week's announcement of Smart Technologie's acquisition of NextWindow.  Not long after the announcement, I had a chance to speak with Al Monro, CEO of NextWindow, and Nancy Knowlton, CEO of Smart Technologies. I share some of their insights in my post:

SMART Technologies' acquisition of NextWindow: A "smart window" to the world

About Innovative Interactivity (II):


"Innovative Interactivity serves as an open forum for multimedia producers, web developers and all other visualization junkies. Content focuses on the dynamics and theory of how people receive and react to different forms of information on the Web, both through visual, multimedia storytelling and interactive data visualization."

"The goal is that this blog will provide an outlet for those in the online realm, whether you are interested in learning about multimedia, interactivity, programming languages, data visualization, or all of the above. Hopefully you will be inspired from what you read here to surpass your current web standards in order to develop highly effective multimedia interactives for the digital community."

Tracy Boyer | Founder & Managing Editor

Tracy Boyer is an award-winning multimedia producer, specializing in interactive Web development and multimedia storytelling. Currently, she is a dual master’s candidate (MBA/MSIS) at UNC-Chapel Hill where she is studying Human-Computer Interaction in the School’s Information Science program and Entrepreneurship at Kenan-Flagler Business School.

Previously, she was a multimedia producer at Roanoke.com, served as the UNC correspondent for CNN.com and interned with The Atlanta Journal-Constitution. In 2007, she was selected to participate in the Poynter Summer Fellowship. Boyer graduated with a multimedia degree from UNC’s School of Journalism and Mass Communication. Her passions lie in travel and multimedia production with a focus on video, audio and interactive graphics. See more of her work at www.tracynboyer.com.

Boyer is available for speaking engagements and seminars. Please contact her for more information.

Andrea Ballocchi | Spanish Editor & Social Media Manager

Andrea Ballocchi is a Chilean journalist. She studied video production at the Art Institute in Fort Lauderdale, Fla., and worked as an assistant producer for Sábado Gigantes on channel 13 in Santiago, Chile, and as a producer at Anticipa, an internet company also in Chile.
In 2005, she participated in the multimedia project “The Ancient Way”, in Spain. Since then she has participated in several other projects, including “Chasing Crusoe,” “Atacama Stories,” “Special Olympics in Shanghai and Idaho,” and “South of Here.” She has also taught and coordinated projects at Universidad de los Andes, Chile.
Andrea Ballocchi is currently a multimedia journalism graduate student at the University of Miami, Fla. and works at The Knight Center for International Media.

Ellen Peck | Contributor, Philanthropic Multimedia

Posts publish bi-weekly on the 2nd and 4th Thursdays of each month

Ellen Peck works as consultant with a focus on the Non-profit sector. Ellen worked for over 15 years with Save the Children as a Director of Development, and also created and managed their Emergencies and Crisis Leadership Council. She has worked with start-up non-profits, and first-time capital campaigns for more established organizations. She has been involved in fundraising and strategic partnerships with individuals, corporations, foundations and organizations, and in strategic planning with artists, agency project teams and senior management at organizations for new initiative development.

Ellen also serves in the role of producer and creative/content advisor to documentary film, music and other projects in the arts associated with social and environmental issues. Her projects include the film and soundtrack for “Born into Brothels,” (USA) which garnered the Oscar for Best Documentary in 2005, and for “Stolen,” (Australia) currently showing at international film festivals.

Ellen is a Liberal Arts grad with a degree from Amherst College.

Lynn Marentette | Contributor, Academic Multimedia

Posts publish bi-weekly on the 1st and 3rd Thursdays of each month

Lynn Marentette has over 20 years of professional experience as a school psychologist, and has used interactive multimedia applications and games with students who have disabilities since the early 1990’s. She is passionate about emerging collaborative technologies, natural user interactions and interfaces, and how the power of interactive multimedia can be harnessed in education. In addition to her work as a psychologist, she blogs about accessible off-the-desktop natural-user interfaces at “Interactive Multimedia Technology.”

Lynn has presented on topics such as multimedia thinking and learning, universal usability of interactive multimedia, and universal design and accessibility for games. She returned to school a few years ago to learn how to make interactive multimedia applications and games for the web, handheld devices, and large displays, and has taken graduate courses such as game design, ubiquitous computing, and virtual reality in preparation for a potential PhD in Information Technology at UNC-Charlotte.

A few links: GizmoWatch's 10 Interactive User Interfaces for the Future, CNN's Eatocracy, EVA 2010 and More!

Here's a quick link to a recent Gizmowatch post, Ten Interactive User Interfaces for the Future.  Bharat, the authro, reviews a variety of interfaces, input methods, and interaction techniques, such as Skinput, a water-based touch screen, a muscle-computer interface, air gestures, brain-computer systems, and even a mud-tub interface.


I was fortunate to see some of these interaction techniques and interfaces when I attended CHI 2010 this past April, and plan to share some of my photos and video clips from the conference on this blog soon.


Totally Unrelated


Online connection for foodies
Eatocracy is a new website within the CNN pages that provides news- and more- about all things related to food. The categories on the site include "main", "news", "bite", "sip", "make", "think", and "buzz".  The best part, in my opinion, is the heirloom recipe collection index, where people can upload and share family recipies and the stories behind them.

Here is the description of Eatocracy from the website:

Eatocracy  "is your online home for smart, passionate conversation and information about food news, politics, culture. We'll highlight regional and family recipes, dive into restaurants and food shopping, chat with celebrity and local chefs, and show you what's for dinner around the world tonight. Grab a place at the table and read with your mouth full."

Enjoy!

(The above is a repost from The World is My Interactive Interface)

Coming Soon

--More about 3D TV and Interactive TV

--Highlights from CHI 2010 (better late than never!)

--My experiments- SMARTTable, a game, interactive timeline prototype pictures...

--A post about Lieven van Velthoven's interesting Post-WIMP explorations - here are some links that he recently sent me:

• 3D birthday invitation: http://www.youtube.com/watch?v=pNOP5aIoS9o
• Virtual overgrowth in the real world: http://www.youtube.com/watch?v=nuJPoUpBIKU
• Make race tracks for virtual cars with any real stuff you can find: http://www.youtube.com/watch?v=e1K3og8qLcA
• Smoke Pong: Pong, ONLY for smokers: http://www.youtube.com/watch?v=zwrsVo5p2_E
• Webcam Airmouse: http://www.youtube.com/watch?v=57kTrKJHOjM 
• MusicalNodes: the visual music library: www.musicalnodes.com, http://www.youtube.com/watch?v=czQdhfA__UY (will be published at EVA2010)

As I took a peek at Lieven's video links, I noticed an interesting video mash-up Lieven created from the open-source code from the RadioHead's House of Cards music video and his One Million Particles app. I'll post them soon.

I'll try to get video, pictures, and commentary about EVA 2010.  EVA stands for Electronic Visualization and the Arts. "Electronic Information, the Visual Arts, and Beyond.

FYI

I'm in the process of sorting through and re-organizing my blogs, which have been around for over four years!  During this time, my blogs have attracted a growing number of readers. Because of this, I'd like to make things a bit user-centered.  So expect to see little changes here and there.  I promise I'll give my readers warnings in advance if I make any serious changes! 

If you are new to this blog, you should know that my blogs started out as on-line filing cabinets, open to the world.  Although there is a bit of overlap of material and some cross-posting between the blogs, they are arranged to serve as a paper-less way of keeping track of things that I've learned through my coursework, conference attendance, readings, and research. Since emerging technologies are high on my list of interests, I also use my blogs to share interesting things that cross my path.    

  

I changed the name of my World Is My Interface blog to The World Is My Interactive Interface.   "Off-the-desktop natural user interfaces, interaction, and user experience" are the main topics of the blog.  It sometimes includes information about ubiquitous computing and DOOH, otherwise known as Digital Out Of Home.

I plan to tinker with my TechPsych blog later on. It focuses on topics that are useful to psychologists, educators, special education teachers, speech and language therapists, health and wellness professionals, and parents.

Feel free to leave comments, as I welcome your input.

Interactive Displays and "Billboards" in Public Spaces; Pervasive Displays 2013

The 2013 International Symposium on Pervasive Displays (PerDis 2013), recently convened  in Mountain View, California.  Since I couldn't attend this conference, I was happy to learn from Albrecht Schmidt that the conference proceedings were recently uploaded to the ACM Digital library.  There are many exciting things going on in this interdisciplinary field!

Researchers involved with the Instant Places project, described in the video below, presented their work at PerDis 2013. The Instant Places project was part of PD-Net, a series of research efforts exploring the future of pervasive display networks in Europe. (See the "Related" section for additional references and links.)


Instant Places: Tools and Practices for Situated Publication in Display Networks

Below is information from the Instant Places video and website:
"The video describes a novel screen media system that explores new practices for individual publication and identity projection in public digital displays." 

"Instant Places has been developed by the Ubicomp group of the Information Systems Department, at the University of Minho, and has been funded within the scope of pd-net: Towards Future Pervasive Display Networks, by the European Union Seventh Framework Programme (FP7/2007-2013) under grant agreement no. 244011."

Saul Greenberg was the keynote speaker at PerDis 2013.  His keynote, "Proxemic Interactions: Displays and Devices that Respond to Social Distance", highlights how far off-the-desktop our digital/physical lives have become, and how this has influenced recent research in human-computer interaction. Saul is a professor at the University of Calgary and leads research in Human Computer Interaction, Computer Supported Cooperative Work, and Ubiquitous Computing.

Although the video of Saul Greenberg's presentation below is not from PerDis 2013, it touches on the same topics and is worth taking an hour to watch.  In this video, Greenberg presents an overview of the history of human-computer interaction. He also offers up a discussion how an understanding social theory, perception of spatial relationships, and embodied interaction can be applied to the design of natural user interfaces and interactive systems.  Useful examples of interaction design explorations, within an ecological context, are provided later in the video.

Proxemic Interactions: the New Ubicomp?

RELATED

My Backstory

Regular readers of this blog know that to subject interactive displays in public spaces holds my interest. When I was taking computer courses during the mid 2000s, I focused some of my energy on projects designed for large interactive displays, inspired by reading articles like "Physically Large Displays Improve Performance on Spatial Tasks" (Desney S. Tan, Darren Gergle, Peter Scupelli, and Randy Pausch) and "Dynamo: public interactive surface supporting the cooperative sharing and exchange of media" (Shahram Izadi, Harry Brignull, Tom Rodden, Yvonne Rogers, Mia Underwood).  

Jeff Han's 2006 TED talk was another inspiration. I remember my excitement as watched his demonstration of an interactive multi-touch touch screen the size of a drafting board, before the iPhone/iPad was born.  Another inspiration was Hans Rosling's TED Talk  about health statistics, with his animated interactive data visualizations presented on a huge screen.

The following year, I stumbled upon the  NUI-Group while searching for information about multi-touch displays, and was inspired by many of the early members of the group.  I also became acquainted with a world-wide network of people who share similar interests, such as Albrecht Schmidt and his team of researchers at the Unversity of Stuttgart. This busy group recently presented at PerDis 2013 and at CHI 2013 and are involved in a wider range of ongoing projects.

INTERACTIVE DISPLAYS

Alt, F. Sahami, A., Kubitza, T., Schmidt, A.  Interaction Techniques for Creating and Exchanging Content with Public Displays. In: Proceedings of the 2013 ACM Annual Conference on Human Factors in Computing Systems 

Hinrichs, U., Carependale, S., Valkanova, N., Kulkkaniemi, K., Jacucci, G., Moer, A.V., Interactive Public Displays   Computer Graphics, Vol. 33(2) IEEE Computer Society (25-27)

The International Symposium on Pervasive Displays (PerDis 2013)

PerDis 2013 Program
Sample Papers:
Otero, N., Muller, M., Alissandrakis, A., and Milrad, M. Exploring video-based interactions around digital public displays to foster curiosity about science in the schools. PerDis 2013 (pdf)
Alt, F., Schneegass, S., Girgis, M., Schmidt, A. Cognitive Effects of Interactive Public Display Applications. Proceedings of the 2nd ACM International Symposium on Pervasive Displays. 2013
Langeinrich, M., Schmidt, A., Davies, N., and Jose, R.  A practical framework for ethics: the 

Note:  Members of ACM have access to all of the proceedings of PerDis2013 in the ACM Digital Library. Non-members have access to the abstracts.

PD-NET

PD-net approach to supporting ethics compliance in public display studies. Proceedings of the 2nd ACM International Symposium on Pervasive Displays. 139-143
PD-Net 
PD-NET Publications - a great reference list, with links to many papers
Reading List on Pervasive Public Displays
About Instant Places
About the Living Lab for Screens Set

DOOH-DIGITAL OUT-OF-HOME

Digital Out of Home (DOOH): Screens Large and Small at the Mall (and some touch-screen Coke machines!) Interactive Multimedia Technology, 1/1/10

Daily Digital Out of Home post "Billboards That Look Back" : Could miniature cameras embedded in ads lead to Big Brother at the mall? The World Is My Interactive Interface, 5/28/08
J. Müller et al., "Looking Glass: A Field Study on Noticing Interactivity on a Shop Window," Proc. 2012 SIGCHI Conf. Human Factors in Computing Systems (CHI 12), ACM, 2012, pp. 297–306
Michelis, D., Meckel, M. Why Do We Want to Interact With Electronic Billboards in Public Space?  First Workshop on Pervasive Advertising, Pervasive 2009, 5/11/09
The Rage of Interactive Billboards
The Print Innovator, 11/28/12
10 Brilliant Interactive Billboards (Videos)
Amy-Mae Elliot, Mashable, 8/21/11

SOME INTERESTING EARLIER WORK

Jeff Han's 2006 TED Talk (This is worth revisiting, as it came out before the iPhone, iPad, etc.)

Tan, D.S., Gergle, D, Scupelli, P., Pauch, R. Physically large displays improve performance on spatial tasks. ACM Transactions on Computer-Human Interaction, V13(1) 2006 (71-99)

Revisiting promising projects: Dynamo an application for sharing information on large interactive displays in public spaces (blog post)
Lynn Marentette, Interactive Multimedia Technology, 09/16/07

Brignull, H., Izadi, S., Fitzpatrick, G., Rogers, Y., Rodden,  T. The introduction of a shared interactive surface into a communal space. Proceedings of the 2004 ACM conference on Computer supported cooperative work (CSCW'04), Chicago, ACM Press, 2004 (pdf)

Izadi, S., Brignull, H., Rodden, T., Rogers, Y. and Underwood,M. Dynamo: public interactive surface supporting the cooperative sharing and exchange of media. In Proc. User

Interfaces and Software Technologies (UIST’03), Vancouver, ACM Press, 2003, 159-168. (pdf)

Proxemics (Wikipedia)

Why Do We Want to Interact With Electronic Billboards in Public Space? 

WHY DO WE WANT TO INTERACT WITH ELECTRONIC BILLBOARDS IN PUBLIC SPACE? from danielmichelis