URBAN MUSICAL GAME: Play with musical-sensor sports balls and friends (Real-Time Musical Interactions team at IRCAM)

One of my favorite things at CHI 2012 was the Interactivity sessions.  I especially liked the  Urban Musical Game, played with musical sports balls.  I didn't want to stop playing!


This just might transform P.E. and recess.


Below is a version of the game from 2011 created for the Future en Seine festival by the Real-Time Musical Interaction team at the IRCAM, in collaboration with NoDesign, Phonotonic, and composer Andrea Cera:

The balls in the game contain wireless sensors, which trigger sounds and interactive music.  It is supported by MO  (Modular Musical Object) technology, and Max/MSP. Below is a video of the balls in action (in French).

Nicolas Rasamimanana - Phonotonic, Paris, France 
Frederic Bevilacqua - IRCAM, France 
Julien Bloit - IRCAM, France Norbert Schnell - IRCAM, France 
Emmanuel Flety - IRCAM, France Andrea Cera - IRCAM, France 
Uros Petrevski - NoDesign, France 
Jean-Louis Frechin - NoDesign, France


Comment:
This would be a great activity for the large therapy room at Wolfe, a program for students with significant disabilities (including autism), where I spend most of my work days as a school psychologist.  I'd love to have it demonstrated in-person for students at the CATA (Central Academy of Technology & Arts), the high school I also serve, to inspire students about the creative aspects of technology.


I would also like to create my experiments with this sort of technology, based on a number of interesting ideas that have popped up in my mind over the past decade or so.  I'm especially curious to know how this could work in environments that also have multiple large interactive visual displays....


How can I make it so?
(Update:  It is a small world.  I looked up one of the people involved in the Urban Musical Game on Facebook and found that we share three mutual FB "friends".)

FYI: Google's Knowledge Graph

RELATED
Google calls Knowledge Graph first baby step towards "Star Trek computer".
The above article originally appeared on theverge.com as Google launches Knowledge Graph, a new intelligent search platform, by Nathan Ingraham (5/16/12)

FYI: TED-Education Beta Website and YouTube Channel

TED-Ed aims share the wisdom and knowledge of great teachers by providing educators with the opportunity to have their lessons transformed into videos enhanced by creative animators. The videos and lessons are available for learners all around the world, online.  I'll share more about the TED-Ed concept in a future post.


 


Information from the TED-Ed website:
"TED-Ed's videos aim to capture and amplify the voices of the world's greatest educators. To achieve this, we pair extraordinary educators with talented animators to produce a new library of exceptional educational videos. This website, similar to TED.com, is ever-evolving and we depend on you, the TED community, to nominate inspiring teachers that have touched your life or clever animators who have the skills to bring a gifted teacher's lesson to life." -TED-Ed


Below is the TED-Ed Website Tour introductory video:


RELATED
TED-Ed|Lessons Worth Sharing (website)
Flipped Learning Network
"Flipped learning happens when the teacher’s lecture is delivered outside of the traditional class time, via a video students view on their own as homework. Class time is used for active problem solving by students and one-to-one or small group tutoring with the teacher. Students can watch the short lectures as many times as they wish to grasp the content and then come to class ready to jump into the lesson, answer questions, work on collaborative projects, and explore the content further.  Teachers are embracing Flipped Learning in elementary and secondary schools for all disciplines"  -Flipped Learning.

NUITEQ's Latest Multitouch Showreel: Snowflake Suite

I've been following a number of people that have been working in the area of natural user interfaces and interaction for many years.  An example of this work is NUITEQ, a company lead by Harry van deer Veen.  Below is NUITEQ's most recent show reel of Snowflake Suite, an off-the-shelf multitouch SDK.


Here is the description of the software from the naturaluserinterface YouTube channel:


"NUITEQ's award-winning multitouch software product Snowflake Suite comes off the shelf with 30+ apps, a free SDK to develop your own multitouch software apps and its content is easy to customize. The solution is offers high performance, stability, quality and comes with dedicated support. Apps includes presentation, productivity and creativity tools as well as games. The software can be used in different scenarios such as corporate presentations, exhibitions, entertainment, education, public spaces, consumer electronics, retail and digital signage."

FYI: Tutorials about the user of Snowflake Suite can be found on the naturaluserinterface YouTube channel. 


Harry van der Veen has been sharing his NUI journey journey since 2007 on his Multitouch blog.

Interactive Technology from CHI 2012 Supporting Literacy, Storytelling, and Narrative

I spent the last several days at CHI 2012 and was so immersed in the experience, I held off blogging until I arrived home.  


I was pleasantly overwhelmed by the experience at CHI 2012, There was so much to see, hear, and touch, there were so many bright, creative people all around - I was on mind/sensory overload.  Omar L. Gallaga, the author of Digital Savant (Austin 360), attended the conference, and the quote below from his recent post nicely sums it up: "When your mind gets blown multiple times in a very short period of time, it begins to feel as is your brain is quickly rewiring itself to accept that the reality is that anything is possible and that the continual, pleasurable surprise of discovery is the new norm."


For this post, I'm sharing a few things that were presented at CHI 2012 that focus on literacy, storytelling, and narrative.  I'll share more in future posts.


Creating and Using Interactive Narratives: Reading and Writing Branching Comics 
The short video below provides a good overview of the project, which was presented at CHI 2012 during the Out of the Box" session, chaired by Shahram Izadi, of Microsoft Research USA

"We employ comics and combine paper with a multi-touch interface to explore an approach to reading and writing interactive narratives."
Dan Andrews and Chris Baber from the University of Birmingham (UK) 
Sergei Efremov and Mikhail Komorov from the Moscow State Institute of Electronics and Mathematics (Russia).


If you are interested in learning more about this process, take a look at the references that were reviewed in the paper about this creative, thoughtful work.

Tap & Play: An End User Toolkit for Authoring Interactive Pen and Paper Language Activities 
The following video was created several months before CHI 2012:




Tap & Play:  An End User Toolkit for Authoring Interactive Pen and Paper Language Activities
Ann Marie Piper, Nadir Weibel, James Hollan, 


The following video is related to the Textual Tinkerability paper, presented during the Literacy on the Margin session, chaired by Juan Pablo Hourcade, at CHI 2012:
 


Textual Tinkerability:  Encouraging Storytelling Behaviors to Foster Emergent Literacy    Angela Chang, Cynthia Breazeal, Fardad Faridi, Tom Roberts, Glorianna Davenport, Henry Lieberman, Nick Montfort, Massachusetts Institute of Technology


Related: TinkRBook: Shared Reading Interfaces for Storytelling (IDC 2011)
TinkRBook

RELATED

CHI 2012:  brain expanding bits of brilliance
Omar L. Gallaga, Digital Savant, 5/11/12


FYI:   I was one of the organizers for the EIST (Educational Interfaces, Software & Technology) workshop, held on May 5th and 6th. The participants came from all around the world to spend two days of presenting, sharing, and brainstorming.  Everyone worked hard to make the workshop a success. (I'll share more about EIST soon, but if you are curious, the above link will provide you with more information about the program and papers that were presented.) 

Vignettes exploring the dual capacities of software and medicine to heal and hurt. Food for thought, by Jonathan Harris

I just checked my email and was pleasantly surprised to find a link to the Modern Medicine vignettes, created by Jonathan Harris to explore and compare software and medicine. 


The following topics are included in this work:
Social Engineers 
Urges & Outcomes 
The Ethics of Code 
Healers & Dealers 
The Problem of Advertising 
A Staging Ground for the Future 
Medicine Men 
Crazy Times 
A Self-Fulfilling Prophecy


I especially like this quote:

"As engineers, we can ask ourselves some basic questions:  Will we feel accountable for the behavioral outcomes of the software we introduce to the world? Will we recognize our responsibility to our fellow human beings to build them decent, useful, powerful, and ethical tools? Will we make things that trick and seduce, or things that nourish and teach? Will we optimize for page views and profit, or for social impact and beauty?"

Jonathan Harris "makes projects that re-imagine how humans relate to technology and to each other".