"The Touch Interface specification defines a set of low-level events that represent one or more points of contact with a touch-sensitive surface, and changes of those points with respect to the surface and any DOM elements displayed upon it (e.g. for touch screens) or associated with it (e.g. for drawing tablets without displays). It also addresses pen-tablet devices, such as drawing tablets, with consideration toward stylus capabilities."
"Our research shows that the vast majority of people polled in both developed and emerging markets see great potential for NUI applications beyond entertainment. This is especially true in China and India, where 9 out of 10 respondents indicate they are likely to use NUI technology across a range of lifestyle areas – from work, education and healthcare, to social connections, entertainment and the environment. We believe that taking technology to the next billion can be aided by NUI – making technology more accessible and more intuitive to a wider audience". - Steve Clayton, Microsoft
The people at Microsoft don't own the concept! I'm a member of the NUI Group (May, 2007) and SparkOn. Both are on-line communities where you can find people who live and breathe NUI, learn about their work, and even share designs and code. If you are intrigued by NUI - as a designer, developer, or user, please join us.
Note: I've been an evangelist and cheerleader for the NUI cause for many years. If you search this blog for "post-WIMP", "NUI", "multi-touch", "gesture", "off-the-desktop", "natural user interaction", "natural user interface", or even "DOOH", you'll be provided with an overwhelming number of posts that include videos, photographs, and links to NUI-related resources, including scholarly articles. There is a small-but-growing number of people from many disciplines, quietly working on NUI-related projects.
In this post, Robert reviews of some of the important trends in information visualization in 2010, discusses the potential of HTML5 for creating information visualization experiences on the web, and makes a few predictions about the near future. Robert is pretty sure that the world is ready for "truly interactive, browser-based visualization". He notes that the Protovis Primers he shares on his website are quite popular.
Most of the following resources and links were taken from the eagereyes website:
Over the next 9 months or so, I'll be in the market for a computer, an iPad or something similar, a Kinect, and maybe a mid-size Internet-enabled HDTV. As a consequence, I turned in to a Best Buy on my way home from work Friday to see what I could find. I didn't want to spend much time at the store, since I'm the type of shopper who goes in, finds the desired item(s), and leaves.
During this trip to Best Buy, my shopping habits were broken, at least temporarily. I found myself wandering around, looking at the numerous displays of all sizes located about the store. The displays distracted me from my intended mission. Below is a slideshow of the pictures I snapped as I wandered about Best Buy:
As a result of the displays, I spend more time in the store than I'd planned. I left the store empty-handed. But that is OK, since I think that this strategy, in the long run, will have the power to entice me back to the store and leave knowing that I've made an informed purchase.
According to Gail Chiasson in her Daily DOOH post,"Best Buy's New In-Store Network", Best Buy established an internal advertising and editorial team in 2009, and officially launched a multichannel network called Best Buy On, which extends the in-store network of displays, to the online magazine, also called Best Buy On . Best Buy On focuses on different theme each month. This month's theme featured all of the cool things that were unveiled at the recent Consumer Electronics Show.
The bottom line with in-store DOOH is that customers are provided with with enhanced information about various products in each department, and this information is coordinated with the enhanced information they can access on-line. Put together, this might lead to better sales, and happier repeat customers in the long run.
As I went about Best Buy, I thought that it would be better if the in-store network of displays was less disjointed. I also was puzzled by the somewhat inconvenient placement of some of the displays. People who stand in the middle of an aisle to look at a screen block the view of the screen and the other items on display, and also block the paths of other shoppers!
Although I didn't spend a lot of time scrutinizing the content on all of the screens I encountered, what I did look at gave me the impression that there is need for improvement. Pretty multimedia content might be attractive to the eye, but if it doesn't meet the needs of customers in specific departments, it might not be effective.
Here is a personal scenario: My 80-year-old mother needs a new laptop and would also like to find an eReader that is suitable for someone her age. She needs a new printer and is thinking about getting a digital camera. She has some money to spend, but from what I can tell, she'd be a little confused by all of the flashing screens!
I'm not sure what my mother would make of the displays, especially those that run animated comments about products from Facebook fans!
(Note: I plan to go with my mom to Best Buy soon, and I'll share this experience on this blog in the future.)
Although there is room for improvement, the Best Buy On approach is a start. I would like to see more touch-enabled displays as part the in-store network, given the fact that Best Buy sells touch-screen gadgets, tablets, and all-in-one PCs. The large-screen touch-enabled displays could provide customers with an Amazon- like advisory feature. This is something that would be very helpful to my mom and other non-geeks.
Best Buy also needs to get the Kinect demo up and running!
FAR OUT 1/9/11 (Best Buy On video about products at CES)
Comment: I went to Best Buy today and almost bought a Kinect. Unfortunately, the demo hadn't come in yet, so I decided to wait until I could give it a try. I'm curious to experiment with what it can do.
This might interest readers who are interested in digital signage and DOOH (Digital Out-of Home):
Bill Gerba is the author of Wirespring's Digital Signage Insider blog and his articles are worth taking the time to read. I especially like the way he's conceptualized the world of digital signage. He includes a graphic from 2008 and rolls out an updated version that shows how things have changed in the industry over the past few years.
As I read Bill's post, it occurred to me that the changes represented in the 2011 graphic are similar to those occurring in other technology-related areas. Things are changing rapidly and it is not always easy to conceptualize things on the fly. It is helpful to understand complexity through an ecosystems model, in my opinion.
"Hi, Google. My name is Johnny" Johnny Chung Lee announced on his Procrastineering blog that he's accepted a position at Google as a "Rapid Evaluator". I'm not sure what he will be doing in this position, but his title is intriguing!
Here are some of my previous posts devoted to the work of Johnny Chung Lee:
One of my Facebook friends recently shared a link to the SoundCloud website, a site that is new to me. I was pleasantly surprised to learn about it!
"SoundCloud is a platform that puts your sound at the heart of communities, websites and even apps. Watch conversations, connections and social experiences happen, with your sound as the spark." -SoundCloud
"Everyday is a good day...and make it that way!" - Walter Bruening
Some quotes from the video:
If you could give one piece of advice to today's youth, what would it be?
"I'd tell them to stay in school, get educated, as much as you can, because if you're not educated today, fully, all about computers and everything like that, you are not going to get a job, because you got to be fully qualified to go to work on any kind of job right now."
Walter Bruening's words to live by: "Be good to everybody, be kind to them." "People should be helping other people." "The more you do for other people, the better your going to help your self."
Interview of Walter Breuning at age 11, includes a multimedia timeline:
(Video starts at the end of the CSI ad)
Although younger generations will leave the world digital legacies in some form or another, the ideas, and views of our elders are not often found online. Wouldn't it be great if we could capture the wisdom of our elders in a broad way and get it on the web?
It would be great if students in schools around the world could work on a shared on-line multimedia timeline project like this, highlighting their elderly relatives and friends of the family!
If something like this exists, please let me know.
I'm always on the lookout for videos that work nicely on interactive whiteboards for students with multiple special needs, including autism. The video below is a time-lapse of the Perseid Meteor Shower and the galactic core of the Milky Way, from Joshua Tree National Park. It was produced by Henry Jun Wah Lee, of Evosia Studios.
Teachers of studets with special needs might want to incorporate this short video clip into lessons, (in this case, science). It provides a soothing touch through the use of music, and looks fantastic on a large interactive whiteboard. The video isn't too boring if it is looped, making it great for students who require repetition of content.
COMMENT Designers and developers need to think about off-the-desktop technologies as a new form of the web/internet. Information architects who understand interactive media/transmedia, cross-display/device, cross-platform, and interaction design within a broader context are sorely needed in this space.
The presentation below, by Chris Thorne, Lead Information Architect and User Experience Consultant working for the BBC, provides a good overview about this topic:
Over the past months I've been gathering video and photos of my encounters and interactions with digital signage as a consumer/customer/user during my every-day activities such as shopping, traveling, vacationing, and so forth, which will be included in a post or series of posts in the near future.
I have content related to interaction with various QR tags, interactive kiosks, interactive displays and TV on a cruise ship, an interactive touch screen at J.C. Penny, and more. If you are a regular reader of this blog, you know that my interests include user experience of DOOH, interactive displays in public spaces, and so forth.
Note: Despite all of the technological innovations in this converging field, issues related to context, usability, and accessibility are not consistently addressed from a broader systems point of view.
Today I'm starting something new for this blog, "Saturday Quick Links". I'll post videos and links. I'll revisit the topics highlighted in my "Saturday Links" with my comments/analysis/reflections. There is so much happening now in the converging world of interactive multimedia technology!
From the "about us" section of the itvt.com website:
"Founded in 1998 by Tracy Swedlow and co-owned by Richard Washbourne, InteractiveTV Today [itvt] is the most widely read and trusted news source on the rapidly emerging medium of multiplatform, broadband interactive television (ITV).
We provide concise, original coverage of industry developments, technologies, content projects, and the people building the business to our readership, which is made up of hundreds of thousands of executives from around the world..."
To learn more about this project, take a look at the video and related publications below. This is a great example of a team that is harnessing emerging technologies to improve the lives of people with disabilities.
The deadline for submissions to the CHI 2011 Child Computer Interaction: 2nd Workshop on UI Technologies an their Impact on Educational Pedagogy has been extended to February 18, 2011.
The workshop will be held on May 7, 2011, Vancouver, Canada, in conjunction with ACM's CHI 2011 conference. Interested researchers should submit a 4-page position paper in the ACM CHI adjunct proceedings style to the workshop management system. Note that the best 3 papers will be pre-accepted for a upcoming for a theme issue of the Springer Journal Personal and Ubiquitous Computing on “Child Computer Interaction”.
Note: Deadlines for several other CHI 2011 workshops have also been extended to February 18th. (Pictures and links from the CHI 2010 workshop are located at the end of this post.)
CALL FOR PAPERS
IN CONJUNCTION WITH CHI 2011
Child Computer Interaction: Workshop on UI Technologies and Educational Pedagogy
in conjunction with CHI 2011, Vancouver
May 7th, 2011
Topic: Given the emergence of Child Computer Interaction and the ubiquitous application of interactive technology as an educational tool, there is a need to explore how next generation HCI will impact education in the future. Educators are depending on the interaction communities and to deliver technologies that will improve and adapt learning to an ever- changing world. In addition to novel UI concepts, the HCI community needs to examine how these concepts can be matched to contemporary paradigms in educational pedagogy. The classroom is a challenging environment for evaluation, thus new techniques need to be established to prove the value of new HCI interactions in the educational space. This workshop provides a forum to discuss key HCI issues facing next generation education. We invite authors to present position papers about potential design challenges and perspectives on how the community should handle the next generation of HCI in education. Topics of interest include: • Gestural input, multitouch, large displays, multi-display interaction, response systems • Mobile Devices/mobile & pervasive learning • Tangible, VR, AR & MR, Multimodal interfaces, universal design, accessibility • Console gaming, 3D input devices, 3D displays • Co-located interaction, presentations, tele-presence, interactive video • Child Computer Interaction, Educational Pedagogy, learner-centric, adaptive “smart” applications, • Empirical methods, case studies, linking of HCI research with educational research methodology •Usable systems to support learning and teaching: Ecology of learning, any where, anytime, (UX of cloud computing to support teaching and learning) Submission: The deadline for workshop paper submissions is February 18, 2011. Interested researchers should submit a 4-page position paper in the ACM CHI adjunct proceedings style to the workshop management system. Acceptance notifications will be sent out March 15, 2011. The workshop will be held May 7, 2011 in Vancouver, Canada. Please note that at least one author of an accepted position paper must register for the workshop and for one or more days of the CHI 2011 conference.
I came across this video display at a Porche Design shop in St. Martin. The video was well-done, but the display was difficult to see from a distance. The saleswoman wasn't sure who produced the content.
I thought that it would be more interesting if the content was interactive- something for do while my husband shopped!
The following video and article focuses on some research that I think will be very useful for creating interactive multimedia timelines in the future. I'd like to learn more about ways this interaction can be implemented in gesture-based systems!
Content-Aware Dynamic Timeline for Video Browsing From Gonzalo's YouTube channel: "When videos have more frames than pixels in the player's timeline slider, frames become inaccessible and scrolling actions cause sudden jumps in a video's continuity. We propose a content-aware dynamic timeline control that decouples video speed and playback speed and allow salient shots to be presented at an intelligible speed."
Note: The researchers are investigating the use of audio/sound in a similar manner, making this form of video browsing/search truly multimedia. An example of this is included near the end of the above video clip.
The following video is a demonstration of something I could use in my work as a school psychologist, since I use a lot of video for assessing students with disabilities, including those with autism. I also use video to create digital social stories for many of the students.
I have an HP TouchSmart PC, and found that the touch-screen interaction offered by this website was better than using the mouse. I'm pretty sure that this website would be fun to use on a larger touch-enabled display, and in in the classroom, on interactive whiteboards.
To my surprise, I also discovered that the website offers a 3D augmented reality version of "Our Changing World": Experience the changing world in augmented reality
"See the world and the information that shapes it. Watch it come to life as a 3-D hologram..."
(I'll play with the AR hologram later today.)
The FedEx website provides links to additional resources for each topic area, as well as a link to the sources used for the data included in the information graphics. It is important to remember that graphics do not always accurately depict the numbers!
"At experience.fedex.com, visitors can interact through a world map with data and content provided by The Economist Intelligence Unit on eight world trends initially, including air travel, people in cities, entrepreneurs and success, paper trail, business growth, education, money and happiness, and research and development.Visitors also have an opportunity to analyze the data, share information, or participate in real-time, online polls....“At FedEx, we pride ourselves on our ability to offer great customer experiences,” said Malcolm Sullivan, vice president, Marketing, FedEx Express Asia Pacific. “Experience.fedex.com is an effective way for us to extend these experiences to the virtual world. By making visualizations of complex and important information available to people everywhere, FedEx makes it easy for anyone to learn about their world and share their discoveries with friends.”"
Interactive Graphic (Timeline) Political Targets "Arizona Rep. Gabrielle Giffords is not the first member of Congress to be attacked while in office. Take a look back at some prominent political shootings involving members of Congress". Wall Street Journal Research
RELATED Slideshow On the Scene in Tucson "In the wake of the shooting of Rep. Gabrielle Giffords, an Arizona Democrat, and a number of bystanders Saturday, police investigators began to piece togehter clues while friends and onlookers mourned."
Wall Street Journal, 1/10/11
(Pictures were taken by photographers from various news media organizations.) Article Victims in Giffords Shooting "Six people died in the shooting that left Rep. Gabrielle Giffords critically injured. Learn more about Judge John Roll, Christina Taylor Green, Phyllis Schneck, Dorwan Stoddard, Gabriel Zimmerman and Dorothy Morris."
Wall Street Journal, 1/10/11