New Hollywood Hard Rock Cafe Sparkles with Interactive Multi-touch Wall and Microsoft Surface Booths!

I came across a blogpost entitled "Tourist in my own town". In this post, the author shares is positive experience of his visit to the new Hard Rock Cafe, located on the Hollywood Walk of Fame.  I loved his comment:  "A whole wall of Microsoft software running and not a single BSOD!"  In addition to the interactive wall, visitors have the chance to play with the content on Microsoft's interactive Surface tables. Below is a picture from the post from the Sure Beats Work blog:



-Sure Beats Work


A recent post on the Hard Rock Cafe blog provides more information about the interactive technologies at the Hollywood site: "Hard Rock International Rocks Its Way to Hollywood Boulevard":


New Look ~ New Vibe ~ New Memorabilia Technology
"In the latest example of Hard Rock’s concept-driven design evolution, the Hollywood Boulevard cafe was developed to integrate technology, creating a new look and vibe that will rock Hollywood. Hard Rock Cafe Hollywood on Hollywood Boulevard showcases new and unique interactive experiences for guests – from an 18’ x 4’ Rock Wall™ to touch screens in booths throughout the cafe to Microsoft Surface™, each featuring innovative multi-touch technology that enables fans to explore the world’s greatest rock ‘n’ roll memorabilia collection and virtually tour all of Hard Rock’s venues worldwide."

"In addition to the cutting-edge multimedia memorabilia experience, hundreds of items from Hard Rock’s iconic collection adorn the walls of Hard Rock Cafe Hollywood on Hollywood Boulevard, including items from many of the world’s most beloved and recognizable musicians, as well as contemporary artists with local ties. Key memorabilia items are now on display, from Jimi Hendrix’s purple crushed velvet hat; to Janis Joplin’s love letter to then boyfriend Peter LeBlanc; Jim Morrison’s leather pants and handwritten lyrics to “L.A. Woman”; to Katy Perry’s sparkly dress and Fergie’s tour outfit worn while on tour with the Black Eyed Peas."

The memorabilia wall was created for the Hard Rock Cafe by Obscura Digital, a company that is involved in off-the-desktop ubiquitous computing, including ambient technologies that include natural-user interfaces and interaction. Obscura Digital aims to "make data pervasive and accessible in almost any situation, allowing virtually any surface to be turned into a portal to the Internet".  


The Memorabilia Wall has been installed in several Hard Rock Cafes around the world- additional pictures can be found on the Obscura Digital website.The first installation of the wall was at the Hard Rock Cafe in Las Vegas in 2009. - Below is the interaction of the wall at the Las Vegas Hard Rock Cafe:

-Obscura Digital

The following video, set to Beck's "Elevator Music", provides a great demonstration of the Hard Rock Cafe Memorabilia application as experienced on the Surface:

Hard Rock memorabilia app for Microsoft Surface (extended) from Duncan/Channon on Vimeo.
(The music in the video "Elevator Music, by Beck.)


RELATED
My megapost about the Hard Rock Cafe interactive wall and website:

Interactive Memorabilia at the Hard Rock Cafe: 
Microsoft's Multi-touch Rock Wall, Companion Surface Installations, and Awesome Touch-Responsive Interactive Memorabilia Website

Below is a screenshot of the main portal of the Hard Rock Cafe interactive memorabilia website, which compliments the "real" wall. You can interact with all 1532 items and learn more about the history behind the various artists.  It is fun to play with on a touch-screen display!


Duncan Channon: Sin City Memorabilia Interfaces


SOMEWHAT RELATED
Obscura Digital
Obscura Digital's Cuelight, and interactive pool table at the SOHO Esquire House:

Cuelight from Obscura Digital on Vimeo.
"Featured at the Esquire House's "Ultimate Bachelor Pad" in NYC, the one-of-a kind Obscura CueLight projection system turns a game of pool into an amazing interactive art display"

Updated: Coding for Multimedia Interaction On ( and Around) Screens of All Sizes - with some interesting links

The last time I created an application for a mobile device was about four years ago.  It was in the olden days when most of us knew nothing about multi-touch interaction on any size or sort of display.  Soon after that, I focused my work on large displays, and tried not to get too distracted by the iPhone when it was introduced.

I can't ignore the iPad, as I think it holds a ton of potential for education and supporting people with special needs.

I can't ignore Android, since I have an Incredible. (I'm tethered to a never-ending family contract with Verizon.)

I have to figure things out during my summer break, right?  Brushing up on my "old" coding skills won't move me forward. Soooooo.......

On top of everything else* I'm trying to pack in,  I plan to take a peek at Sencha Touch  http://www.sencha.com/products/touch/, an HTML 5 mobile application framework that allows for Apple iOS and Google Android touchscreen devices.

I am searching for the magic solution that will allow the development of applications that allow for smooth interaction across screens of all sizes, from smartphones to huge displays.

Summer is a great time for dreaming and searching, but it is so short.  Time-saving advice from my readers would be greatly appreciated!  I'm also looking for good information about programming for stereoscopic 3D games for my series of posts about 3D innovations.

*What I'm trying to pack in:
Volunteering for the Society for Information Display, working on a SMARTTable app, exploring ideas for a multi-dimensional  interactive timeline, etc.

RELATED
Parallel Timelines


SOMEWHAT RELATED
FYI:  Recent posts on The World Is My Interface blog
WSJ's Interactive Graphics:  China's Housing Markets, via Innovative Interactivity
The First Self-replicating Cell with a Computer for a Parent:  Synthetic Life
More TED Talks:  Chip Conley's discussion about measuring what makes life worthwhile
Fractals in our world:  "I'm a mathemetician and I'd like to stand on your roof" - Ron Eglash on African Fractals

Coding for Multimedia Interaction On (and Around) Screens of All Sizes

Here is the updated version of post:

http://interactivemultimediatechnology.blogspot.com/2010/06/updated-coding-for-multimedia.html

John Underkolffler Demonstrates G-Speak-collaborative, multi-display interaction (TED Talk Video by John Underkloffer, Minority Report science advisor)

John Underkloffer Points to the Future of UI (User Interface)


"Minority Report science adviser and inventor John Underkoffler demos g-speak -- the real-life version of the film's eye-popping, tai chi-meets-cyberspace computer interface. Is this how tomorrow's computers will be controlled?"

In this video, technologies that have been around for 10-15 years are demonstrated, along with newer user interface interaction, navigation, manipulation, and analysis techniques. Includes 3D interaction as well as collaborative, multi-display interaction.


"Media should be accessible, in fine grained form."

Children and Technology: "A 2.5 Year-Old Has A First Encounter With An iPad"

Handing his daughter a new iPad, the daddy says, "We have a new toy. Are you ready for a new toy?!" Of course she's ready!


Info from Todd Lappin's YouTube Channel:

"A fascinating UI experiment. My daughter likes playing with my iPhone, but this was her very first encounter with an iPad. As you'll see, she took right to it... although she too wonders why it doesn't have a camera! More critical comment on her user-interface test here: http://laughingsquid.com/a-2-5-year-old-uses-an-ipad-for-... PS: The spelling apps she uses in the video are FirstWords Animals and FirstWords Vehicles. They're great... except for the fact that the splash screen UI is non-intuitive for her. ;-)" -Todd Lappin (the dad in the video)

RELATED

Todd Lapin's Laughing Squid post: A 2.5 Year-Old Uses an iPad for the First Time

"If you’re good at understanding kid-speak, you’ll also notice that she immediately saw its potential as a video-display device. She lamented the lack of a camera, and wondered about its potential for playing games"

CHI 2010 Course 

New Methods for Designing for and with the iChild: Strategies for Today's Mobile, Social, and Internet Technologies

I took this class when I attended the recent CHI 2010 conference. We worked in groups and I was assigned the role of a 7 year-old child, designing an iPad app for "kid reporters".  It was fun.  Note:  For the iPad to be used this way in education, it really needs to have a camera/video camera.

The Children of Cyberspace

(Brad Stone, New York Times, January 9, 2010)

"...But these are also technology tools that children even 10 years older did not grow up with, and I’ve begun to think that my daughter’s generation will also be utterly unlike those that preceded it.   Researchers are exploring this notion too. They theorize that the ever-accelerating pace of technological change may be minting a series of mini-generation gaps, with each group of children uniquely influenced by the tech tools available in their formative stages of development."... “People two, three or four years apart are having completely different experiences with technology,” said Lee Rainie, director of the Pew Research Center’s Internet and American Life Project. “College students scratch their heads at what their high school siblings are doing, and they scratch their heads at their younger siblings. It has sped up generational differences.”..." -Brad Stone

... (more info)  

Web-based Technology-Supported Interaction: 6Rounds mixes webcam, games, and social media....

I've been so busy writing reports* that this almost passed me by!

I found out about 6rounds because they use Twitter as a promotional platform.  I happened to notice that this company was following me and clicked on the link.

6rounds started out as an outgrowth of a speed dating website, and the application was initially designed for people to use while waiting for speed dating sessions. According to the 6rounds website FAQ's, "6rounds is a live meeting point, offering users a variety of experiences that they enjoy together using a combination of webcams, real-time games, social activities and media engagements."

Since I'm a happily married middle-aged woman, I'm not sure 6rounds is up my alley.  I think  social singles, college students, and others who don't mind flashing their faces through a webcam would like it.

If I had time, I might like to play around with GixOO, the opensource API that underpins 6rounds. GixOO has the potential for developers to develop games and activities.  The application allows the users to track each other as they move their mice, and also enables people to see the same things as their friends as they interact online.

6rounds looks like it might provide possibilities for collaborative projects in education, but I won't be sure until I give it a try.

So what is 6rounds?



FOR THE TECH-CURIOUS

The following information was quoted from the Openomics blog from Sun Microsystem's  ISV Engineering:


"6rounds is the first product built on the GixOO live social platform, initially developped on the LAMP stack. As a member of the Sun Startup Essentials program, GixOO connected with Sun's ISV Engineering team to test the scalability of their platform on SAMP --the Solaris-based AMP stack, available in an integrated and optimized package from Sun, the Sun Glassfish Web Stack f.k.a. CoolStack. At the time, we ran the benchmark on a Sun SPARC Enterprise T5120 server --featuring the 64-way CoolThreads processor UltraSPARC T2-- running Solaris 10 and CoolStack 1.3. GixOO loved the DTrace kernel instrumentation of Solaris 10 --DTrace gives unique insights into how the application performs, live on a production system-- and the Containers technology a.k.a. Zones --this light-weigth virtualization layer of Solaris allows multiple applications to run in isolation from each other on the same physical hardware--, and quickly adopted them for their internal use.

"At GixOO, we use Sun SPARC-based server, powered by Solaris 10 for our R&D environment. The system gives us the required flexibility and components isolation that we need. Thanks to SPARC's great SMP abilities, we achieve high performance for many development environments running on one single 1U server.
Solaris Zones are very comfortable and simple to configure, and allow the full utilization of the great power hidden in this small machine, which makes Solaris 10 an excellent choice for system administrators. We are using Sun MySQL Server which gives our application high speed data storage solution, and in the future we might migrate to the MySQL Cluster solution to get even faster results."
Dmitry Shestak, CTO, GixOO"

Somewhat Related

2/26/10: Oracle bought Sun in 2009. Here were the latest results when I did a search to get more information:

Not Really Related 


*For those new to this blog, I'm a school psychologist who returned to her day job full time a year and 1/2 ago, when the economy was taking a nosedive. Before that, I was working part-time and taking computer and technology classes, initially to learn how to create interactive multimedia applications and games.  


Since some of the kids and teens I work with have a range of abilities and disabilities, including autism, I developed an interest in accessibility.  How can universal design principles  be applied to games and emerging interactive technologies?   I'm also fascinated by interactive displays and surfaces of all sizes, especially ubiquitous systems that support cognition, collaboration and communication.  

One of my pet projects:

My vision? A collaborative multimedia, multi-modal interactive time-line might help us to understand  complex, interrelated factors and events more effectively. It would provide an opportunity for the inquisitive to view things from a broad perspective, and also explore things in rich detail. Ideally, the time-line would support multi-touch, multi-user interaction on larger displays and interactive whiteboards, and allow for people who are remotely located to participate in the process. 


Now that one of my schools will be getting a multi-touch SMARTTable, I'd like to experiment with time-line concepts and interactions on a table surface. I'd also like to figure out how this can work seamlessly with the existing SMARTBoard that is in the classroom.  Of course, this would have to take place during after work hours!

iPad multi-touch gestures for iWork, page navigator tool, fast data entry & infographs, on-touch form creation, iPad wall.(Updated 1/30/10.)

Update 1/30/10
Know HTML & JavaScript?  Open source PhoneGap lets you create apps for the iPhone and other platforms. (Update: Including the iPad.)
Update 1/30/10
According to Brian Chen's Gadget Lab post, Apple recently made a change to enable the iPhone and iPad function as web phone:
"ICall, a voice-over-Internet Protocol (VOIP) calling company, said the latest revisions in Apple’s iPhone developer agreement and software development kit enable the iPhone to make phone calls over 3G data networks. ICall promptly released an update to its app today, adding the 3G support...Because the iPad includes a microphone and will run iPhone apps, that means the tablet will gain internet telephony, too." Read More http://www.wired.com/gadgetlab/2010/01/iphone-voip/#ixzz0e5aErE6q

Interactions in Apple's iWork Applications for iPad


RELATED
Interesting iPad Interactions  -Craig Villamor
New Multi-touch Interactions on the Apple iPad - Craig Villamore & Luke Wroblewski
The iPad's Actually New UI and Gestures -Matt Buchanan, Gizmodo
-Multi-finger multi-touch
-Popovers
-Media Navigator
-"Long" touch and drag
-Layered UI elements
iPad.org Forum


ClarkeHopkinsClarke iPad Wall Concept for a Library

I Love the Wii.

More women are playing games, and the Wii has grabbed a good portion of attention from them, especially with titles such as Wii Fit.

While some say this is due to Nintendo's marketing strategy, in my opinion, I think it is because Nintendo developed a system that is non-geek and family-friendly. When I first heard of the Wii, they were in short supply. I spent quite a bit of time stalking out the local GameStop stores to buy one. I wasn't the only female doing the same thing.

Think about it. The Wii was introduced just at the time when prices of large flat-panel TVs were coming down, making them more affordable to families. Although Dad might have hankered for a large-screen TV to watch sports, any Mom in her right mind would want to multi-purpose such an expense. If you have to have a huge TV messing up your family room decor, it makes sense to use it for multiple purposes, like playing the Wii.

Not long after the Wii made it home, it eventually sprouted legs and was adopted by my young adult daughters.  Now the only way I get to play the Wii is if I make the trip uptown, a 30 minute drive. And if everyone is playing Rock Band, I have to wait my turn to play the drums.

I need to buy another Wii!  I think it will carry me through old age:






It will help me keep my girlish figure (this is NOT a picture of me, by the way)






Seriously, the Wii is turning out to be handy for folks, young and old,  with health problems:

Pulse Sensing:  Wii Vitality Sensor


Here is a video showing how the Wii is used at Madonna Rehabilitation Hospital's brain injury program:


Since more therapists and nurses are female, it stands to reason that a game console such as the Wii, which is very user-friendly, would be top on the list for use in health and rehabilitation settings.

The Wii is the focus of research with the elderly:
An exploratory study on senior citizen's perceptions of the Nintendo Wii: the case of Singapore International Convention on Rehabilitation Engineering and Assistive Technology, 2009

Here is a video of what seems to be an HCI student testing out the Wii with her grandparents:





Nintendo might have some competition once Microsoft's Project Natal comes to market. Natal doesn't require any sort of device to interact with the games. For more information about the latest in games for health and "exergames",  take a look at the following blogs:

• Exergame Lab
• Befitt
• Exergame Fitness
• Exergaming Australia
• Exergaming Evangelist
• FootGaming
• Gamercize
• GamerSize
• Health Gamers
• TEN = ExerGame Network
• Humana's Games for Health Website
  Conference:  Games for Health 2010
  

RELATED

Nintendo Boasts 9 Million Player Advantage Among Female Console Gamers
Video Games in Play
 "And despite the stereotypes about teenage males, gamers are not monolithic. In fact, 45% of active gamers are female and women account for half (49%) of all Wii owners and 52% of Sony Playstation Portable (PSP) owners."
Seniors Bowled Over by Wii
Wii-habilitation could prevent elderly from falls
(Thanks to Josh B. for pointing out the how the stats could be a problem. I still can't find the original research!"

Participatory Design Conference 2010 "Participation :: The Challenge" + some thoughts

I really want to go to Australia next year and attend this conference! Below are links to the conference, along with an excerpt from the conference description:

11th Biennial Participatory Design Conference:  Participation :: The Challenge (pdf)
PDC2010 Conference Website
PDC2008 Conference Website

"Participation is the complex, contested, changing, creative and celebratory core of participatory design. We invite you to explore what participation can and needs to mean in the design contexts where we are working now and those we are likely to encounter soon. While current ‘best practice’ in many areas of interactive technology design now at least pays lip service to people’s participation, how is this participation being negotiated and defined, and by whom? And if Participatory Design methods developed some 20 years ago are claimed to have become standard design practice, how do we go about developing the methods that will define standard design practice 20 years from now?"


REFLECTION
Judging from what I've experienced as a consumer/user,  there are many things that are floating around in the form of electronics, software, and related gadgets that are examples of the absence of participatory design.

My daily pet peeve is the remote control for my entertainment set-up, which includes DVR and a small but growing number of interactive TV channels.  Another pet peeve is the usability of productivity software, including the software I must use for work.

At any rate, below are links to some of my thoughts related to usability topics that might be of interest to people who are thinking about or practicing participatory design or user-centered design.

2007 Letter to the Editor, Pervasive Computing
Useful Usability Studies (pdf)

2007 Blog Post
Usability/Interaction Hall of Shame (In a Hospital)

2008 Blog Posts
Interactive Touch-Screen Technology, Participatory Design, and "Getting It"
An Example of Convergence: Interactive TV: uxTV 2008

2009 Blog Posts
Microsoft: Are You Listening?  Cool Cat Teacher (Vicki Davis) Tries out Microsoft's Multi-touch Surface Table
Haptic/Tactile Interface:  Dynamically Changeable Physical Buttons
The Convergence of TV, the Internet, and Interactivity:  Update
UX of ITV:  The User Experience and Interactive TV (or Let's Stamp Out Bad Remote Controls)
ElderGadget Blog: Useful Tech and Tools

A little off-topic: Video parody of the Facebook friending ritual, only in real life - (and more serious thoughts about social software apps)

Facebook in Real Life is a short parody of the Facebook "friending" ritual by theBritish comedy sketch group, Idiots of Ants



I came across this video featured in a blog post on the Core77 website, "Software: The Other "Design for Social Impact", by Gentry Underwood, after following a link from Experientia's Putting People First blog. 

Gentry Underwood works at IDEO, and he's spent some time thinking deeply about social software design and everything that surrounds it.  His article is long, but in my opinion, very important to read, even if you are not a designer or developer.  

After you finish the article, you might be interested in visiting Underwoods' new Designing Social Software website.

Adobe's Resources: Contextual Solutions, Rich internet applications across devices, and Open Screen.

I thought I'd share a few interesting resources from Adobe.  The company is focused on the future, and I plan to watch what unfolds.  Adobe believes that the next generation of the company's products will move us forward to a world of seamless access to content, across screens of all sizes, everywhere we go.

I'm hoping that this will not lead to an environment where we have difficulty escaping "skip intro" ads everywhere we turn.  Hopefully it won't be too bad!

I found a few gems of wisdom in the Adobe white paper,   Designing Contextual Solutions and Applications.  The paper provides a conceptual framework that I think would be helpful to web designers/developers who are interested in off-the-desktop application development.


Here is an excerpt from the introduction of the white paper:
"With its platforms and products that are inherently multichannel and multidevice, Adobe envisions a new class of “contextual solutions” taking hold in the marketplace. These solutions are broader in scope than a device, a campaign, or a single service; rather, they encapsulate the various contexts in which the end user exists, interacts, thinks, consumes, and purchases. And when content owners understand the different types of users and how they differ in their contexts, they are in a much better position to design experiences that are compelling and sticky. At the heart of every contextual solution is at least one or more contextual applications—an emerging type of application that spans multiple devices and uses system, user, and network contexts to provide an optimized user experience and deliver improved business results.

This white paper provides an overview of the types of contexts that compose a contextual solution and application. With examples given along the way, it culminates with a framework for considering all appropriate contexts while designing and developing a new contextual solution or an application that is part of an existing solution."


Another Adobe white paper is quite useful - Rich Internet Applications across devices: The emergence of contextual applications.  It provides examples of RIA's across devices, such as Amazon Video On Demand,  Demandbase, Atlantic Records: Fanbase, Finetune, and Times Reader 2.0.

Additional Adobe Resources
Contextual Applications
Open Screen Project:  "Singular experience, multiple devices"
Adobe Flash Platform

Interactive Multimedia Across Platforms and Screens: Adobe's Open Screen Project; MEX Mobile User Experience Manifesto.... (Please don't annoy the user!)

I'm not sure what I think about ubiquitous Flash 10.1. and Adobe's Open Screen project. I like the idea of anything that is seamlessly cross-platform, but I shudder to think that this might let out a wave unwanted or annoying "push" advertising on on-the-go screens of all sizes. I'm assuming web developers, along with TV ad producers, will be jumping on this train without fully thinking about how their applications and designs will play out in the off-the-desktop, digital-out-of home world.

I decided to take a look, drill down through the hype, and share a few links related to this topic.

Adobe Pushes for a Flash-ier Mobile Web
Rob Pegararo, Faster Forward, Washington Post (10/5/09)
"Are you anxious to bring Flash to the mobile Web, even if it means being subjected to some over-eager Web coder's song-and-dance routine? Or would you rather do without it on the go, even if that means having to switch to a "real" computer to use some Web sites' features?"

Hopefully the "over-eager web coders" will heed the MEX Manifesto:

MEX:  Mobile User Experience 2009 Manifesto (pdf)
"The Manifesto sets out our beliefs as to how user-centred design principles can enhance the experience of multi-platform digital services."

A framework for user journeys in a multi-platform world:  Marek Poawlowski, founder of MEX

MEX: User experience journeys in a multi-platform environment from Marek Pawlowski on Vimeo.

"User experiences are evolving into increasingly complex sets of interactions between multiple devices.  In this video presentation, Marek Pawlowski of the MEX Mobile User Experience strategy forum, shows how a framework can be used to map user journeys through the multi-platform environment."

"Unencumbered by wires, information is flowing into every corner of our world at an ever increasing rate and through an ever increasing range of digital platforms. The single greatest challenge facing digital industries is understanding how this explosion of data will be woven into the fabric of consumers' lives." -- Marek Pawlowski, founder of MEX.

MEX Blog 

OPEN SCREEN VIDEO

Open Screen Project from Vyshak V on Vimeo.

"The Open Screen Project is an industry-wide initiative, led by Adobe and backed by other industry leaders who all share one clear vision: Enable consumers to engage with rich Internet experiences seamlessly across any device, anywhere. Partners in the Open Screen Project are working together to provide a consistent runtime environment for open web browsing and standalone applications — taking advantage of Adobe® Flash® Player and, in the future, Adobe® AIR®. This consistent runtime environment will remove barriers to publishing content and applications across desktops, mobile phones, televisions, and other consumer electronics." Learn more

Reinventing Storytelling in the Digital Age Across Platforms, Across Screens

NAB 2009 presentation by Shantanu Narayen of Adobe and A.D. Albers, of Disney Interactive Media Group, from NAB 2009
Adobe and NVIDIA Deliver Rich Web Experiences on Netbooks and Mobile Devices
Reuters (10/5/009)
"At Adobe MAX, Adobe's worldwide developer conference, Adobe Systems Incorporated and NVIDIA Corporation..announced that both companies are bringing uncompromised browsing of rich Web content to netbooks, smarphones and smartbooks built with NVIDIA GPUs. The companies have been working closely together as part of the Open Screen Project to optimize and dramatically improve performance of Flash Player 10.1 by taking advantage of GPU video and graphics acceleration on a wide range of mobile Internet devices. NVIDIA customers embracing Flash Player 10.1 for their new devices include HP, Lenovo, Samsung, Acer, Asus and more..."


RIM Joins Open Screen Project  Reuters (10/4/09 )


Honey I Shrunk the Flash Player Simon Bisson and Mary Branscome, ZDNET, 10/12/09

Teaming up with Adobe and the Open Screen Project -Google Blog   Bill Coughran (10/5/09)


Paramount Digital Entertainment Launches Interactive Thriller on MySpace  Tracy Sedlow, InteractiveTV Today (10/28/09)
"The company says that it can deliver the show's multiple interactive elements to viewers across devices using Adobe Flash Player and Adobe AIR, "because of efforts by the Open Screen Project, an industry-wide initiative led by Adobe and supported by PDE and close to 50 other industry leaders, to enable people to engage with rich Internet experiences across any device, anywhere." -

GDIF: Gesture Description Interchange Format, a tool for music-related movements, actions, and gestures.

There has been a flurry of work in the computer music technology world that relates to what has been going on with interactive display technology, multi-touch & gesture interaction. I came across a link to the GDIF website when I was searching for information about interactive music and the use of multi-touch technologies for a future blog post.   

So what is GDIF?  Gesture description interchange format

"The Gesture Description Interchange Format (GDIF) is being developed as a tool for streaming and storing data of music-related movements, actions, and gestures.  Current general purpose formats developped within the motion capture industry and biomechanical community (e.g. C3D) focus mainly on describing low-level motion of body joints.  We are more interested in describing gesture qualities, performer-instrument relationships, and movement-sound relationships in a coherent and consistent way.  A common format will simplify working with different software, platforms and devices, and allow for sharing data between institutions."  (The Jamoma environment is used to prototype GDIF.)

Alexander Refsum Jensenius is the man who initiated the GDIF project.  He's written a variety of articles about music, gestures, movement, and emerging technologies.  


Here's Alexander's bio: "Alexander (BA, MA, MSc, PhD) is a music researcher and research musician working in the fields of embodied music cognition and new interfaces for musical expression (NIME) at the University of Oslo and at the Norwegian Academy of Music. He studied informatics, mathematics, musicology, music performance and music technology at UiO, Chalmers, UC Berkeley and McGill. Alexander is active in the international computer music community through a number of collaborative projects, and as the initiator of GDIF. He performs on keyboard instruments and live electronics in various constellations, including the Oslo Laptop Orchestra (OLO)."

Related Publications

Godoy, R. I., E. Haga, and A. R. Jensenius (2006b). Playing `air instruments':Mimicry of sound-producing gestures by novices and experts. InS. Gibet, N. Courty, and J.-F. Kamp (Eds.), Gesture in Human-Computer Interaction and Simulation, GW 2005, Volume LNAI 3881, pp. 256{267.Berlin: Springer-Verlag.

Jensenius, A. R (2009): Motion capture studies of action-sound couplings in sonic interaction. STSM COST Action SID report. fourMs lab, University of Oslo.

Jensenius, A. R. (2007). Action - Sound: Developing Methods and Tools to Study Music-related Body Movement. PhD thesis. Department of Musicology. University of Oslo, Norway

Jensenius, A. R., K. Nymoen and R. I. Godoy (2008): A Multilayered GDIF-Based Setup for Studying Coarticulation in the Movements of Musicians. Proceedings of the International Computer Music Conference, 24-29 August 2008, Belfast.

Jensenius, A. R., T. Kvifte, and R. I. Godoy (2006). Towards a gesture description interchange format. In N. Schnell, F. Bevilacqua, M. Lyons, and A. Tanaka (Eds.), NIME '06: Proceedings of the 2006 International Conference on New Interfaces for Musical Expression, Paris, pp. 176{179. Paris: IRCAM { Centre Pompidou.}

Kvifte, T. and A. R. Jensenius (2006). Towards a coherent terminology and model of instrument description and design. In N. Schnell, F. Bevilacqua, M. Lyons, and A. Tanaka (Eds.), Proceedings of New Interfaces for Musical Expression, NIME 06, IRCAM - Centre Pompidou, Paris, France, June 4-8, pp. 220–225. Paris: IRCAM - Centre Pompidou. [PDF]

Marshall,M. T., N. Peters, A. R. Jensenius, J. Boissinot, M. M. Wanderley, and J. Braasch (2006). On the development of a system for gesture control of spatialization. In Proceedings of the 2006 International Computer Music Conference, 6-11 November, New Orleans. [PDF]

RELATED

The Musical Gestures Project

People working on the Musical Gestures Project

Sonic Interaction Design (SID)

"Sonic Interaction Design is the exploitation of sound as one of the principal channels conveying information, meaning, and aesthetic/emotional qualities in interactive contexts."

SID Action has four working groups:

WG1: Perceptual, cognitive, and emotional study of sonic interactions

WG2: Product sound design

WG3: Interactive art and music

WG4: Sonification

Tom Erbe, Father of SoundHack, Interviewed (Pt.1)

"SoundHack was my main thing for a long time, and I poured a lot of effort into it. It was the place I put my ideas. I did have something of a mission with SoundHack. I wanted to take some computer music techniques that were only used in academia, and get them out there so that all types of musicians could use them."-Tom Erbe  SoundHack Spectral Shapers

Csound Blog "Old School Computer Music"

"Csound is a sound and music synthesis system, providing facilities for composition and performance over a wide range of platforms. It is not restricted to any style of music, having been used for many years in the creation of classical, pop, techno, ambient, experimental, and (of course) computer music, as well as music for film and television."-Csound on Sourceforge

Quote from Dr. Richard Boulanger (Father of CSound):

"For me, music is a medium through which the inner spiritual essence of all things is revealed and shared. Compositionally, I am interested in extending the voice of the traditional performer through technological means to produce a music which connects with the past, lives in the present and speaks to the future. Educationally, I am interested in helping students see technology as the most powerful instrument for the exploration, discovery, and realization of their essential musical nature - their inner voice."

Upcoming post about innovations at Stantum:

I'll be focusing on Stantum and its music and media technologies division, JazzMutant. in my next post. It is interesting to note that the co-founders of Stantum, Guilliam Largilleir and Pascal Joget, have a background in electronic music.  Guiliam specializes in multi-modal user interfaces and human-machine interface technologies. Pascal has a background in physics and electronics, and has worked as a sound engineer.

My music back-story:

The very first computer-related course I took was Computer Music Technology (in 2003), since I play an electronic midi/digital keyboard and previously tried to teach myself a few things, long before computers and related technologies were "easy" for me to figure out.  During the mid-90's, I tried my hand at Dr. Richard Boulanger's  CSound, and tried to acquaint myself with tools from Cycling'74, but I gave up.  Not long after that, bought the first version of MOTU's  Freestyle, which nicely worked on my Performa 600, hooked up to my Ensoniq 32, after the nice people at MOTU sent me an update that was compatible with my set-up.  Later on,  I came across Tom Erbe's SoundHack freeware.   

A lot has changed since then! 

Thomas Hansen's Multi-Touch Wisdom: "Windows Touch vs PyMT - Why programming on Windows is too complicated!"

If you are interested in designing or programming multi-touch programs and like elegant, concise code, you'll appreciate Thomas Hansen's recent blog post:


Windows Touch vs PyMT:  Why multi-touch programming on Windows is too complicated!


Here is an excerpt from Thomas Hansen's blog post:


"If you read the rest of the blog post, I’ll show you what I mean about context, and why e.g.  Windows Touch makes life difficult if you want to program multi-touch.  I’ll show you how to rewrite a windows touch example project (5 C# source files and > 400 lines of code) in Python using PyMT (1 source file with 12 lines of code).  Yes 12 lines, you read correctly (and then there is the whole thing about it just running on Linux or OSX as well…but we’ll leave that for another blog post)."


At the end of his post, Thomas makes a comment that I think is worth considering:


"The interaction paradigm is so revolutionary, I think we need to adopt our development tools more to it and explore the interaction space.  Instead I think people are jumping the gun on trying to standardize the interface while using the development paradigms we used for the GUI."


Well said!


Thomas Hanson is a member of the NUI Group.  He is a graduate student at the University of Iowa, pursuing his PhD in Computer Science, specifically Human Computer Interaction.  

Interactive Touch Screens Out and About: Touch Screen Party Planner for ASDA, by H Squared LTD

Found on YouTube:



The video below was produced by H Squared LTD, a creative retail design company based in the UK. It demonstrates how a single-touch application is used to help people plan their parties when they visit the ASDA store.



This company just uploaded a number of videos, which can be viewed on the H Squared LTD YouTube channel. It looks like this company has some experience with interactive television. I'm not sure if this company has ventured into multi-touch.

To learn more, I visited  the H Squared LTD website, and found that it works pretty nicely on my TouchSmart PC. You can turn the pages of Issue 1 of the magazine.  The music's fun, too, and it sounds as if someone put some thought into how it was mixed.

If you are contemplating what sort of outfit you'd like to wear to your next costume party, take a look at the styles  in the ASDA's photoshoot video.  The music? "Somebody's Watching Me".

A great beat, and you can dance to it.