Google Glass and Kids- BYOGG? Quick Links to MIT Tech Review Post and more

Now that I'm set to experiment with Leap Motion, I started thinking about Google Glass - I know if I visit my grandson wearing them, he'd figure he should, too.  Why not?  He expects to play with my iPad for at least a short while during our visits.

I can see the potential for active educational game applications with this device.

I wonder if Google Glass will follow the path of cell phones into classroom settings. Once banned, many schools are embracing their use in BYOD (Bring Your Own Device) programs. BYOGG?  TIme will tell.


Here is a video from Google provides a view of what the Google Glass experience might be like for a variety of people:
 



Here is an example of a mother of a 2-month-old infant, wearing Google Glass as she shares special moments:

I'm guilty of BTV (baby TV)- in the form of BetaMax and VHS tape recordings.  If Google Glass was around when my kids were babies, I'd probably do the same.


Here is another example of "Project Glass": 



I work with a number of students who are non-verbal and have severe autism. I think there is potential for use with children and adults disabilities.   

Some ideas that come to mind:

Facial expression translator/decoder (for people with autism spectrum disorders)
Two-way sign language translator
Augmented device for the visually-impaired, elderly, etc.
Accessible games, active games
Travel guide, museum guide, health care/hospital stay guide
Exercise companion
InfoVis advisor
Shopping trip/fashion advisor for people like me who hate shopping


RELATED
Growing Up with Google Glass: When Google Glass launches it will be used by kids as well as adults.
Tom Simonite, MIT Technology Review, 3/5/13

Can You See How Google Glass Will Disrupt Higher Education?
Jimmy Daly, EDTECH, 2/26/13

The rise of smartglasses in education: or, A shameless plea to Jaime Casap
Thomas B. Segal, Education Week, 3/5/13

Leap Motion: My Dev Kit Arrived - Now What?! Thoughts About "NUI" Child-Computer-Tech-Interaction - and More

My Leap Motion developer kit arrived last week. I carefully unboxed the small device and tried out the demo apps that came with the SDK.  I'm doing more looking than leaping at this point.

I'd like to create a simple cause-and-effect music, art and movement application for my 2-year-old grandson, knowing that he'll be turning three near the end of this year.  It would be nice if my app could provide young children with enough scaffolding to support gameplay and learning over a few years of development.

Now that I'm a grandmother, I've spent some time thinking about what the evolution of NUI will mean for young children like my grandson.   Family and friends captured his first moments after birth with iPhones, and shared across the Internet.  Born into the iWorld, he knows how to use an iPad or smart phone to view his earlier digital self on YouTube, without ever touching a mouse or a physical keyboard.

The little guy is pretty creative in his method of interacting with technology, as I've informally documented on video.   He was seven months old when he first encountered my first iPad.  It was fingers-and-toes interaction from the start.  

In the first picture below,  he's playing with NodeBeat.  In the second picture, he's 27 months old, experimenting with hand and foot interaction, on a variety of apps.

My grandson is new to motion control applications, so I'm just beginning to learn what he likes,  and what he is capable of doing.  A couple of weeks ago, we played River Rush, from the Kinect Adventures game. He loved jumping up and down as he tried to hit the adventure pins. Most of the time, he kept jumping right out of the raft!  (I think next time we'll try Kinect Sesame Street TV, or revisit Kinectimals.)  


One of the steps I'm taking to prepare for my Leap Motion adventure is take a look at what people have done with it so far.  There are at least 12,000 developer kits released, so hopefully there will be some interesting apps to go along with the retail version of Leap Motion when it is released at Best Buy on May 19th of this year.

One app I really like is  Adam Somer's AirHarp, featured in the video clip below:


I also like the idea behing the following app, developed by undergraduate students:

Social Sign: Multi-User sign language gesture translator using the Leap Motion Controller (git.to/socialSign)
 
"Built at the PennApps Spring 2013 hackathon, Social Sign is a friendly tool for learning sign language! By using the Leap Motion device, the BadApples team implemented a rudimentary machine learning algorithm to track and identify American Sign Language from a user's hand gestures."

"Social Sign visualizes these hand gestures and broadcasts them in textual and visual representations to other signers in a signing room. In a standard chat room fashion, the interface permits written communication but with the benefit of enhanced learning in mind. It's all about learning a new way to communicate."-BadApples Team

There are a few NUI-focused tech companies that have experimented with Leap Motion. Today, I received a link to the following videoclip Joanna Taccone, of Intuilab, featuring their most recent work:
Gesture recognition with Leap Motion using IntuiFace Presentation

"Preview of our work with the Leap Motion controller. In the same spirit as our support for Microsoft Kinect, we have encoded true gesture support, not just mouse emulation, for the creation of interactive applications by non-programmers. The goal is to hide complexity from designers using our product, IntuiFace Presentation (IP). Through the use of IP's trigger/action syntax, designers simply select a gesture as a trigger - Swipe Left, Swipe Right, Point, etc. - and associate that gesture with an action like "turn the page" or "rotate the carousel". As you can see in this video, it works quite well. :-) We will offer Leap support as soon as it ships." -IntuiLab



Below is a demonstration of guys playing Drop Cord, a collaboration between Leap Motion and Double Fine.  From the video, you can tell that they had a blast!  

Here is an excerpt from the chatter:  "The thing is that everyone just looks cool..Yeah, I know, it doesn't matter what you are doing...it's got the right amount of speed-up-slow-down stutter-y stuff...it is like a blend of art and science.."

According to the website, Drop Chord is a "A music-driven score challenge game for the Leap Motion controller, coming soon for PC, Mac, & IOS from the creators of Kinect Party.."  

The following video is a demonstration of the use of Leap Motion to control an avatar and other interaction in Second Life:

Below are a few more videos featuring Leap Motion:


Control Your Computer With a Chopstick: Leap Motion Hands On (Mashable)


The Leap Motion Experience at SXSW 2013


LEAP Motion demo: Visualizer, Windows 8, Fruit Ninja, and More...



RELATED
Air Harp for Leap Motion, Responsive Interaction
Leap Motion and Double Fine team on Dropchord, give air guitar skills an outlet
John Fingas, Engadget, 3/7/13
Leap Motion Controller Set To Ship May 13 for Global Pre-Orders, In Best Buy Stores May 19.
Hands on With Leap Motion's Controller
Lance Ulanoff, Mashable, 3/10/13
Leap Motion website
Social Sign
IntuiLab
Leap Motion: Low Cost Gesture Control for Your Computer Display

SOMEWHAT RELATED
Kinect for Windows Academic: Kaplan Early Learning
"3 years & up. Hands-on play with a purpose -- the next generation way. This unique learning tool uses your body as the game controller making it a great opportunity to combine active play and learning all in one. Use any surface to actively engage kinesthetic, visual, and audio learners. Bundle includes the following software: Word Pop, Directions, Patterns, and Shapes."

Comment:
I've been an enthusiastic supporter of natural-user interfaces and interaction for years - back in 2007 I worked on touch-screen applications for large displays as a graduate student, and became an early member of the NUI group.  I'm also a school psychologist, and from my experience, I understand how NUI-based applications and technologies, such as interactive whiteboards and touch-tablets, such as the iPad can support the learning, communication, and leisure needs of students who have significant special needs.   It looks like Leap Motion and similar technologies have the potential to support a wide range of applications that target special populations, of all ages.

CCRMA Summer Workshops:Stanford's Center for Computer Research in Music and Acoustics

I would love to take a few summer workshops at Stanford's Center for Computer Research in Music and Acoustics, CCRMA.  I took a computer music technology class back in 2003 and have longed for more. 

Here is the schedule of workshops at CCRMA, from the CCRMA website:

6/17 - 6/21   Network Sound and Data:  Juan Pablo Caceres and Carr Wilkerson
6/24 - 6/28  Intelligent Audio Systems: Foundations and Applications of Music Information Retrieval:  Jay LeBoeuf, Leigh Smith, Steve Tjoa
7/8 - 7/12      Aspects of Sound in Art: Elaine Buckholtz and Sasha Leitman
7/15 -  7/19   SuperCollider: Fernando Lopez Lezcano and Bruno Ruviaro
7/22 - 7/26    The World of Auditory and Music Perception: Takako Fujioka, Poppy Crum, Pierre Divenyi
7/29 - 8/2      Music and Mobile Computing:  Mark Cerqueira and Spencer Salazar 
8/12 - 8/16    New Music Controllers: Edgar Berdahl and Michael Gurevich
8/19 - 8/23    Stompbox Design: Edgar Berdahl and Esteban Maestre
8/26 - 8/30    3D Printing for Acoustics :  John Granzow , Marlo Kohn, Scott Summit 
9/9 - 9/13      Perceptual Audio Coding:  Marina Bosi and Rich Goldberg


Tuition is $450.00 for each workshop. More information can be found on the CCRMA site.


If you happen to be interested, CCRMA offers undergraduate and graduate university degrees.   In addition to traditional courses, such as "Musical Acoustics" and "Seminar in Music Perception", other courses are offered, such as "Future Media/Media Archaeology", "Interactive Sound Art", and "Neuroplasticity and Musical Gaming".

I'd be just as happy with a visit to IRCAM, the Institute for Research and Coordination in Acoustics and Music in France.

Disney Research: Touche, Touch and Gesture Sensing

The following video is a demonstration of something called Swept Frequency Capacitive Sensing. It recognizes various configurations of hands and body during interactions.  This system is different than conventional capacitive touch sensing, as it senses a range of frequencies to develop a capacitive profile that provides a significant amount of data that can be analysed and utilized in an application.

At 1:23, the SFCS is demonstrated on a table, sensing body posture or body configuration. It is a wireless system and can be used on smaller touch screens, such as mobile devices.  It can recognize interactions in liquids.


Touche was awarded Best Paper at ACM CHI 2012:

RELATED
Touche: Touch and Gesture Sensing for the Real World
Disney Research
Sato, M., Poupyrev, I, and Harrison, C. Touché: Enhancing Touch Interaction on Humans, Screens, Liquids, and Everyday Objects. In Proceedings of CHI’12. 2012. ACM.
Paper [PDF, 10Mb]
Touche with Arduino
Swept Frequency Capacitive Sensing (SFCS)
Audrey Cropp, Responsive Landscapes, 2/18/13

SOMEWHAT RELATED Synthetic Ecologies Course Reading List
Responsive Environments Course
Allen Sayegh, Harvard Graduate School of Design

AirHarp for Leap Motion, a Responsive Musical Natural User Interface

I like this demonstration of Adam Somers  AirHarp music application for use with the Leap Motion 3D controller:


AirHarp is being developed in C++ using Adam Somer's audio processing toolkit, MusKit.  This looks interesting!  Things have changes since I last took a computer music technology course (back in 2003).

Adam Somers is a senior software engineer at Universal Audio.  He has a graduate degree in music technology from Stanford, and a background in computer science, electronics, human-computer interaction, and signal processing.

Leap Motion is a motion-control software and hardware start-up company located in San Francisco, California. According to promotional information from the website, the company's first product, the Leap Motion controller, is 200 times more sensitive than existing technologies.  It will be interesting to see how this plays out.  (I'm still waiting for my pre-order.)

RELATED
AirHarp (links to GitHub)
Leap FAQs
Leap Motion Website
Leap Motion Developer Portal
Leap Motion Leadership Team
Leap Motion goes retail: Motion controller sold exclusively at Best Buy
Michael Gorman, engadget, 1/16/13

Leap Motion: Low Cost Gesture Control for your Computer Display
Asus partners up with Leap Motion, PCs with 3D motion control to debut in 2013
Michael Gorman, engadget, 1/3/13
Stanford Center for Computer Research in Music and Acoustics

Part II: Websites and Apps for Teens and Education

If you plan to design/develop websites or applications that provide an element of "edutainment" or informal educational activities for teens, it might be good to think about how your site/application can fit into the requirements of an educational system. Much has changed over the past three years. 

For example, many schools have adopted a 1:1 laptop/netbook/tablet initiative. In some cases, the students no longer carry textbooks, because digital versions are installed on their devices. They access on-line digital content, such as videos and interactive learning games, and self-correcting quizzes provided by the textbook publisher. These activities are accessed by the students during and after school hours. 

Teachers do not limit their assignments to the resources provided by text-book publishers. In some classes at the high school level, students are required to work on group projects that extend over several weeks. Students use protected websites, i.e. Moodle, provided by the school district, to store digital content and collaborate on group projects. 

During the course of a group project, teachers provide students with links to approved websites. Some of these websites provide tools to assist in the creation of content related to their project. Students might work together to create an animation or video, or work individually on one component of the project to contribute to the final project. For example, one student might work on an animation to demonstrate a biological process, and another might be responsible for organizing a story board for a video that the group presents to the class.

After completion, the products generated from the students' work may be available for viewing by others on-line, and in some cases, featured on the school's website.

If you are interested in developing applications or content for use in education, it is important to know that most states have adopted the Common Core Standards. Educational applications must align with these content standards in order to support the learning and teaching goals for a particular subject. 

It is also important to have a grasp of learning and teaching theories, an understanding of child and adolescent development, and a working knowledge of applications and technologies that have been successfully used with this age group to support learning.  Consider working with a knowledgeable interdisciplinary team!

RELATED/SOMEWHAT RELATED

Nielson-Norman Group Research Reports

Children 3-12 on the Web

Teenagers (Ages 13-17) on the Web

College Students (Ages 18-24) on the Web

Pew Research Center Resources

Featured Research: Teens

Pew Research Center Trend Data (Teens)

In-store Mobile Commerce During the 2012 Holiday Shopping Season

Teens and Education Resources 

The following websites also provide resources for other age groups and related topics.

Edudemic

Edudemic Ed-Tech Tools 

Edutopia

Edutopia: 6-8 Grade Level Resources

Edutopia: 9-12 Grade Level Resources

Mind/Shift

Other Resources

National Center on Universal Design for Learning

National Education Technology Plan 2010
National Educational Technology Standards

Common Core Standards Initiative

For readers interested in learning more about educational technology and related "nuts and bolts", the following links will provide food for thought:

Virginia DOE Educational Technology Plan Executive Summary (pdf)