Interactive Mobile Multimedia

A study in January of 2005 by Nokia indicated that there was a demand for interactive mobile multimedia services. That study was conducted about five years ago, before anyone had heard of the iPhone!   The technology to support interactive mobile multimedia has come a long way since then, and many of the new applications support multi-touch, or at least duo touch interactivity.

I'm very much interested in figuring out how to design web-based interactive content (and apps) that can be optimized for touch (and multi-touch/gesture) screens of various sizes, from SmartPhones/iPhones to the large interactive whiteboards that are now in a multitude of classrooms.

From my experience as a school psychologist, I know that there are many teens who have graduated from traditional cell phone to the next level.  If they don't have an iPhone, they have a smart phone.  I don't have the statistics on this, but my personal observations tell me that there are teens who come from families who are from lower economic status who are somehow able to own 3G smartphones.

What a great opportunity to provide casual interactive multimedia educational games to support student learning!  The games and activities could be assigned as homework from time to time, and with the appropriate LMS (Learning Management System), the teacher would have instant access to student progress.  In addition, the students would be provided with immediate feedback about their "work", which we know is an important factor in learning.

It is difficult to figure out the best path to forge, since nearly every week someone announces a new platform, technology, and programming approach!

At any rate, here are a few interesting things related to this topic that I'd like to share.  Many of these concepts are in the experimental phase, but are worth some attention.


SciLor's Open-Source Programs
SciLor's HD2/ Leo Multi-touch Demo v2 12/3/09 using VB.Net and Windows Mobile

SciLor's Comments: 
I have manged it to get Multitouch running in an vb.net app :)
There are still some bugs, which have to be resolved:
-Stop auto alignment!
-Identify the "Touches"


Google I/O 2009: Mastering the Android Media Framework


AT&T Interactive Mobile Website


Satellite-Terrestrial Network Delivering Mobile Video with Interactive Services - ICO mim





RELATED
Adding Multi-Touch to Your Windows Mobile Application's User Interface
Wei-Meng Lee,  DevX.com 3/24/08
Previous Post:  The new 3G iPhone:  Expanding the Possibilities of Interactive Multimedia Communication (Interactive Multimedia Technology,  6/9/08)
Note: I just skimmed the following articles - when I have more time, I'll post more of my reflections related to this set of topics.

Rethinking context framworks: Enabling cross-domain, cross-device experiences (pdf)

Daniel Stewart, Nitya Narasimhan,  Position Paper, CMPPC Workshop, Pervasive 2007

Interactive Mobile Multimedia Needs IP and Circuits
Brough Turner,  Internet Telephony, 9/09
Primetime for Mobile Television:  Extending the entertainment concept by bringing together the best of both worlds (pdf)  IBM Institute for Business Value
A Holistic Approach to Enhance Universal Usability in m-Learning
Vlado Glavinic, Sandi Ljubic, Mihael Kukec, 2008 The Second International Conference on Mobile Ubiquitous Computing, Systems, Services and Technologies
Seamless Mobility: A Continuity of Experiences across Domains, Devices, and Networks (pdf) 2005
Raghu Rau, Senior Vice President of Marketing, Motorola
Ambient Networks:  Cooperative Mobile Networking for the Wireless World
Norbert Niebert, John Wiley and Sons LTD  4/07 
Mobility management challenges and issues in 4G heterogeneous networks (link to ACM pdf)
Sadia Hussain, Zara Hamid and Naveed S. Khattak, InterSense '06.  Proceedings of the first International Conference on Integrated Internet Ad hoc and Sensor Networks
Mobile Multimedia: Tune in to Digital Convergence (pdf)
DVB-Scene (a trade magazine) 3/2008
HP OpenCall Media Plafform: a cost-effective, agile IP media server (pdf)
Whitepaper, Hewlett-Packard Development Company, L.P.  2/2009
A survey of wireless multimedia sensor networks (pdf)
Ian F. Akyildiz, Tommaso Melodia, Kaushik R. Chowdhury, 2006  Science Direct  Elsevier


Mobile Multimedia Companies/R&D
Stantum  (UMPC)

Movidity
MobIME: Mobile Internet for Media and Entertainment

More Urban Screens and Outdoor 3D Media Facades

Maybe this will sprout up on outdoor building walls in a city near you!  
 
 
There's more to life than a Volvo - Frankfurt 2009 "3D projection and production by NuFormer in coorporation with Saatchi & Saatchi"  

RELATED  
3D Projections on Buildings: A distinctive way of communicating  
Communicating Through Architecture:  Media Facades and the Digital Infrastructure  The Rathous 
(Contains an assortment of videos and pictures)  
Art and Commerce Meet on Building's Interactive Media Facades Kelsey Keith, Fast Company, 10/2/209 

International Urban Screens Association  

"Urban Screens are dynamic digital displays and visual interfaces located within urban public spaces. They include LED screens and signs, plasma screens, information terminals and projection surfaces as well as intelligent architectural surfaces and media facades...Urban Screens transform the capacity of public spaces to serve as a platform for user-generated civic and cultural expression, community building, multiculturalism and public engagment in issues related to social, cultural and environmental sustainability....Through networking, content sharing and joint broadcasting, they constitute a rapidly expanding and still largely experimental global multimedia infrastructure for commercial and cultural exchange." "The IUSA aims to inform and support the ‘worldwide Urban Screens movement’: the expanding use of dynamic digital displays in public spaces; their considerate and sustainable integration in the urban landscape; and the ability for screen communities to collaborate in the digital space to share content, experience, ideas, innovations and emerging possibilities."

Book:  Media Facades:  History, Technology and Content, M.Hank Haeusler 

Cross-posted on The World Is My Interface

Touch-screen Interaction at Digital Bus Shelter - Video via Daily DOOH

JCDecaux Innovate Touch-Screen Bus Shelters
Chris Sheldrake, Daily DOOH (Digital Out of Home) 12/2/09

RELATED
The World is My Web Browser: Interactive Technology in Public Spaces
(Watch the video of the interactive "Splat the Cadbury Creme Egg" game played on a large touch screen display at a bus shelter.)

JCDecaux Innovate - Gorillaz for Bus Shelters

People-Centric Public Media, Public Media 2.0, & New Media: Considerations for Interactive, Collaborative Multimedia Content

I followed a link from an article written by Andy Oram, of the O'Reilly Radar and found some interesting information related to public media. The graphics and quotes below are from a publication, Public Media 2.0: Dynamic, Engaged Publics (pdf), written by people from the Center for Social Media at the School of Communication, American University.

Public Media 2.0: Dynamic, Engaged Publics    Full Report pdf

Center for Social Media,  School of Communication, American University



"Multi-platform, participatory, and digital, public media 2.0 will be an essential feature
of truly democratic public life from here on in. And it’ll be media both for and by the
public. The grassroots mobilization around the 2008 electoral campaign is just one
signal of how digital tools for making and sharing media open up new opportunities
for civic engagement.

But public media 2.0 won’t happen by accident, or for free. The same bottom-line logic
that runs media today will run tomorrow’s media as well. If we’re going to have media
for vibrant democratic culture, we have to plan for it, try it out, show people that it
matters, and build new constituencies to invest in it.

The first and crucial step is to embrace the participatory—the feature that has also been most disruptive of current media models. We also need standards and metrics to define truly meaningful participation in media for public life. And we need policies, initiatives, and sustainable financial models that can turn today’s assets and experiments into tomorrow’s tried-and-true public media.

Public media stakeholders, especially such trusted institutions as public broadcasting, need to take leadership in creating a true public investment in public media 2.0."

Action Agendas
"Public media institutions and makers need to develop a participatory national network and platform; to cross cultural, social, economic, ethnic, and political divides; to collaborate; and to learn from others’ examples, including their mistakes.

• Policymakers need to create structures and funding to support national coordination of public media networks and funding for production, curation, and archiving; to use universal design principles in communications infrastructure policy and universal service values in constructing and supporting infrastructure; to support lifelong education that helps everyone be media makers; and to build grassroots participation into public policy processes using social media tools.

• Funders can invest in media projects that build democratic publics; in norms setting, standardization of reliability tools, and impact metrics; and in experiments in media making, media organizations, and media tools, especially among disenfranchised communities."
Some key points from the article:
Five fundamental ways that people's media habits are changing - The Five Media Habits:
Choice
Conversation
Curation
Creation
Collaboration
Trends with possibilities for public media 2.0:
Ubiquitous video (choice, creation, collaboration)
Powerful databases (curation, creation)
Social networks as public forums (conversation, collaboration)
Locative media (choice, creation)
Distributed distribution (choice, curation)
Hackable platforms (creation, collaboration, curation)
Accessible metrics (creation, curation)
Cloud content (choice, creation)
Pervasive gaming (choice, collaboration)

RELATED
Eight Public Media 2.0 Projects That Are Doing it Right
Jessica Clark, Mediashift, 10/6/09
("MediaShift tracks how new media -- from weblogs to podcasts to citizen journalism -- are changing society and culture.")
The intersection of media literacy and public media 2.0
Katie Donnelly, Public Media 2.0, 10/16/09
VoiceThread "VoiceThread is a powerful new way to talk about and share your images, documents, and videos"

I'll update this post with some of my thoughts/reflections about Public Media 2.0 and interactive multimedia content development.

Brief Post and Links: Multimedia Semantics, Focus of the December issue of IEEE's Computing Now

I haven't read the latest issue of IEEE's Computing Now, but it looks like it has a few good articles that might be of interest:

Multimedia Metadata and Semantic Management

Guest Editors' Introduction, IEEE Computing Now

Harald Kosch and Christian Timmerer, December 2009

"Effective multimedia management must span the metadata life cycle—from its creation through processing, storage, distribution, and deployment—and work whether the metadata is tightly connected with or independent of the media it describes.

Finally, we need better integration of situational context. This includes not only domain knowledge, but also legal and cultural issues, metadata and semantic quality, compression and encryption techniques."

3D Media and the Semantic Web pdf

Michela Spagnuolo and Bianca Falcidieno, National Research Council of Italy

Managing and Querying Distributed Multimedia Metadata Collections pdf

Sebastien Laborie, Ana-Maria Manzat, and Florence Sedes

Using Social Networking and Collections to Enable Video Semantics Acquisition pdf

Stephen J. Davis, Christian H. Ritz, Ian S. Burnett

RELATED

IEEE MultiMedia  

Some of my favorite tech journals/magazines:

Virtual Carol Singing Experiment on Britain's ITV, via Tracy Swedlow

ITV's "This Morning" Teams with YouTube on "Virtual Choir" Promotion -Tracy Swedlow

ITV, the U.K. Independent Television Network, is inviting viewers to participate in a virtual Christmas choir. If you want to participate download the headphone track, and sing "We Wish You a Merry Christmas". When you are ready, get out turn on your videocam, keep your headphones in, and sing along to the track. When you have finished, you'll upload the video to YouTube.

If you can follow the headphone track and sing the carol in tune, you might just have a chance to be seen as part of a montage of videos, either singing the carol in all at once with your virtual choir-mates, or as part of one carol sung by many people, one at a time.

How to participate:


ITV This Morning website

ITV This Morning YouTube Channel