Jan 24, 2009

Digital Storytelling Platforms and Multiple Perspectives: A look at the work of Jonathan Harris - Food for Thought for Interactive Timeline Design

I'm in the process of creating an interactive timeline, and as I revisited my links and bookmarks, I came across a link to a video of Jonathan Harris discussing his ideas regarding digital storytelling, overlapping threads, and multiple perspectives.

Jonathan explores real-life stories and celebrates the interconnections between events, ideas, feelings, and people. Linear narrative and linear time lines do not do justice to the richness and complexities of human experience
.


"Combining elements of computer science, anthropology, visual art and storytelling, Jonathan Harris designs systems to explore and explain the human world."



"Jonathan Harris is redefining the idea of what it means to tell a story. Take a ride through an arctic whale hunt and plunge headfirst into the feelings Harris finds running rampant in cyberspace as he describes what he calls “storytelling platforms.” "

Below are links to two story-telling platforms described in the presentations. The Whale Hunt is organized so that the user can explore the story through a variety of perspectives and interfaces, and at different points in time.

The first screenshot shows how the user can select one of the "cast" members to see how the story unfolds from that person's point of view.





"Every few minutes, the system searches the world's newly posted blog entries for occurrences of the phrases "I feel" and "I am feeling". When it finds such a phrase, it records the full sentence, up to the period, and identifies the "feeling" expressed in that sentence (e.g. sad, happy, depressed, etc.). Because blogs are structured in largely standard ways, the age, gender, and geographical location of the author can often be extracted and saved along with the sentence, as can the local weather conditions at the time the sentence was written. All of this information is saved...The result is a database of several million human feelings, increasing by 15,000 - 20,000 new feelings per day. Using a series of playful interfaces, the feelings can be searched and sorted across a number of demographic slices, offering responses to specific questions..."


Jonathan Harris also presented at the December 2007 EG Conference. The video and related information can be found on the TED website.

Jonathan Harris: The art of collecting stories


If you have some time on your hands, explore Jonathan's Universe project:

http://universe.daylife.com/common/statement-universe.gif
This photo depicts the nine stages of the Universe environment.

"Universe is a system that supports the exploration of personal mythology, allowing each of us to find our own constellations, based on our own interests and curiosities. Everyone's path through Universe is different, just as everyone's path through life is different. Using the metaphor of an interactive night sky, Universe presents an immersive environment for navigating the world's contemporary mythology, as found online in global news and information from Daylife. Universe opens with a color-shifting aurora borealis, at the center of which is a moon, and through which thousands of stars slowly move. Each star has a specific counterpart in the physical world — a news story, a quote, an image, a person, a company, a team, a place — and moving the cursor across the star field causes different stars to connect, forming constellations. Any constellation can be selected, making it the center of the universe, and sending everything else into its orbit."

Universe was created using Processing, which is an open-source software that is used by people from all sorts of disciplines to create interesting interactive information visualizations and more. The data used in Universe is from Daylife. For more information about Daylife, visit the Daylife Labs.

Sidenote:
Jonathan Harris collaborated with Sep Kamvar on the We Feel Fine project. Sep Kamvar teaches classes like "Social Software" and "Computational Methods in Data Mining" at Stanford University. Sep is part of the Stanford Human Computer Interaction (HCI) Group.

Stanford's HCI group's weekly seminars highlight a variety of interesting speakers. Current and previous talks are available via Stanford OnLine. You can link to current presentations and videos from the Human Computer Interaction Seminar website. If you are curious, past presentations/abstracts can be accessed on-line alphabetically or by date, going as far back as 1990.

Dan Saffer, author of Designing Gestural Interfaces, presented "Tap is the New Click" on January 23rd, 2009 at Stanford.  You can access the
video directly.

Pop! Tech PopCast

Jan 20, 2009

Children at the Surface Table: BETT 2009

The picture below was posted on the Shakeout blog, and shows children gathered around Microsoft's Surface at the recent BETT 2009 educational technology conference in the UK. Read "Interesting tidbits from BETT 2009" for more information.



Also posted on the TechPsych blog

Baby Multi-Touch Interaction on a Win7 HP TouchSmartPC running BabySmash.

I'm preparing myself to explore the multi-touch potential of my HP TouchSmart PC with the beta version of Win7, Microsoft's newest operating system. While I was searching for information, I came across this cute video of a baby interacting with the touch-screen. The dad in the video is software developer Kurt Brockett.

The application is BabySmash, a free application created by Scott Hanselman for his little ones. If you are interested in learning more about how BabySmash was created, see Scott's 6-part tutorial, "Learning WPF (Windows Presentation Foundation) with BabySmash". It includes information about incorporating speech synthesis into the application. The BabySmash! source code can be found on the CodePlex site. Ideas for improving the application can be found on the BabySmash! feedback forum.


I have lots of ideas for touch screen interaction applications for kids of all ages. Please leave a comment if you have a TouchSmart and working with Win7, or plan to do so in the future.

More Multi-touch Multimedia: Video demonstration of applications created with Snowflake and Flash



This video showcases the work of Natural User Interface-AB, using NUI Suite 1.0 Snowflake and Flash.

Here is the plug from the company's website:
"Natural User Interface (NUI) is a Swedish innovative emerging technology company specializing in commercially available advanced multi-touch software, hardware and service solutions. NUI's solutions can convert an ordinary surface into an interactive, appealing and intelligent display that creates a stunning user experience."

For more information and links:

For Techies and the Tech Curious: Multi-touch/Gesture from the NUI-Group

Search this blog!

Jan 19, 2009

Touch Screen Interaction in Public Spaces: Room for Improvement, if "Every Surface is to be a Computer"

Via Technology Supported Human-World Interaction

With Win7's "multi-touch" capabilities, Bill Gate's statement that every surface will be a computer might come true, but from what I can see, we have a long way to go before we get it right!

One of the concerns I have about "touch" screen interaction in public spaces is that not much thought is given to the environmental factors surrounding the system. The system that is tested for the first time after installation might work just fine, but not when it is put to use under a variety of conditions or situations.


EXAMPLES
(I've recycled a few of these from previous posts.)


Touch Screen Kiosk/Display in Upscale Shopping Area, St. Thomas(?)

I came across this system when I was walking around in St. Thomas with my husband. I wasn't sure what to make of it. There wasn't anything on the large display, and I couldn't tell from a short distance if the two smaller displays were active. I noticed that the display had an awning of sorts, so the fact that the display would be used in a sunny location had been considered. Unfortunately, the awning didn't solve this problem, as you can see from the pictures below:

CLOSER UP


As we approached the display, it was almost impossible to see what was on the screen. In fact, we weren't sure what the display was all about. It looked like something you'd see at an airport check-in, not in a lush tropical setting.

Below is a shot of my husband, trying to see what is on the screen. This photo shows exactly what the screen looked like at the time:



The next picture tells it all. You can see that there is some sort of alphabet on the right side of the screen, but the reflection of my husband is easier to see. We couldn't figure this one out.




The following clip demonstrates how environmental concerns, such as wind and "sideways" rain, can make an interactive display at a shopping center difficult to use. During this clip, you can hear me muttering about the difficulties I had interacting with the information on the touch-screen display. It is possible that the system wasn't working well because of the exposure to the elements.


WIND AND SIDEWAYS RAIN



You can see that the navigation system was confusing. At the end, the entire screen turned red, and I gave up.

The next video-clip is of a touch-screen map at the Cleveland Clinic hospital. I was with my elderly aunt and my sister, and we were trying to figure out how to get to a restaurant. We never found it.


Although the screen was easy to see, the application was... crazy!

In my opinion, an interactive wayfinding application should run on a larger display and support two or more people, since many hospital visitors often run in pairs or small groups.


Jan 18, 2009

BETT 09: UK's Annual ICT (Ed Tech) conference - Tabletop Computing and More

BETT is the annual ICT & educational technology conference held in the UK. The UK has the highest number of classrooms in the world with interactive whiteboards, which has been an interesting transformation to follow over the past few years.

I've posted several video clips from BETT '09, which was held this month (January), along with some other resources. Tabletop computing applications for education were demonstrated by Microsoft Surface and Smart Technologies. Take a look!


BETT 2009 Video Overview


Microsoft Surface at BETT 2009

More Surface for Education: User Interface and Paint


Physics and Social Studies


Orientation and Images


Science: Medical and Health Care


SMARTTable at BETT 09
(Note: The two clips below look as if they were taken with a cell phone video camera. I'll post higher-quality videos if I find them.)



SMART Technologies PR video

I think there is a need for more application development in this area!

RELATED
The following two clips are from the visitor's point of view, overwhelmed by it all...


SMARTTechnologies SMARTTable

Microsoft Surface
BETT 2008 Video Magazine
BETT 2008 Teachers TV Report