Google Glass and Kids- BYOGG? Quick Links to MIT Tech Review Post and more

Now that I'm set to experiment with Leap Motion, I started thinking about Google Glass - I know if I visit my grandson wearing them, he'd figure he should, too.  Why not?  He expects to play with my iPad for at least a short while during our visits.

I can see the potential for active educational game applications with this device.

I wonder if Google Glass will follow the path of cell phones into classroom settings. Once banned, many schools are embracing their use in BYOD (Bring Your Own Device) programs. BYOGG?  TIme will tell.


Here is a video from Google provides a view of what the Google Glass experience might be like for a variety of people:
 



Here is an example of a mother of a 2-month-old infant, wearing Google Glass as she shares special moments:

I'm guilty of BTV (baby TV)- in the form of BetaMax and VHS tape recordings.  If Google Glass was around when my kids were babies, I'd probably do the same.


Here is another example of "Project Glass": 



I work with a number of students who are non-verbal and have severe autism. I think there is potential for use with children and adults disabilities.   

Some ideas that come to mind:

Facial expression translator/decoder (for people with autism spectrum disorders)
Two-way sign language translator
Augmented device for the visually-impaired, elderly, etc.
Accessible games, active games
Travel guide, museum guide, health care/hospital stay guide
Exercise companion
InfoVis advisor
Shopping trip/fashion advisor for people like me who hate shopping


RELATED
Growing Up with Google Glass: When Google Glass launches it will be used by kids as well as adults.
Tom Simonite, MIT Technology Review, 3/5/13

Can You See How Google Glass Will Disrupt Higher Education?
Jimmy Daly, EDTECH, 2/26/13

The rise of smartglasses in education: or, A shameless plea to Jaime Casap
Thomas B. Segal, Education Week, 3/5/13

PO-MO, a creative group that combines digital art, interaction, movement, and play to create engaging surfaces and spaces.

I recently learned more  PO-MO, a relatively new start-up tech company based in Winnipeg, Canada. According to the company's information, PO-MO "specializes in interactive digital display solutions, including gesture and motion based interactivity, interactive display content creation and management, and large interactive display and projection services for advertisers, educators, and events."  


Po-Motion was a finalist in an elevator pitch video contest last fall. It has several advantages over potential competitors.  The system is easy to use, and priced within the range that is affordable for schools, museums, and other cost-conscious groups who would like to provide technology-supported immersive interactive experiences for people of all ages.  The PO-MOtion software designed for interactive floors and walls starts at $39.99, and works on any computer, using any USB web camera and a projector. Other applications make use of Kinect sensors.


I especially like one of PO-MO's recent projects, the Impossible Animals Museum Exhibit, created using Unity 3-D, for the Manitoba Children's Museum.  How does it work?  Children create a colored egg using crayons and paper, which is then scanned into the exhibit and digitally embedded into the system, which includes an interactive wall and floor.  When the egg is touched, it is activated to hatch, and then becomes a motion reactive animal.  The environment includes things like water, landscapes, and even a spaceship.  The system has a "reset world" button for museum staff to use when needed.  

Impossible Animals Exhibit

Impossible Animals Interactive Museum Installation from PO-MO Inc. on Vimeo.



The following video explains how the PO-MO system works:

PO-MO is also involved in promotional projects, assisting retailers, ad agencies, and brand managers with creative ways to engage customers and clients:

Ragpackers Kinect-based Window Display

Ragpickers Kinect Window Display from PO-MO Inc. on Vimeo.


The following video provides a scrolling description about PO-MO's work, including promising data collected during implementation:

SAP demo final from PO-MO Inc. on Vimeo.

Other products and services provided by PO include mobile app development. I especially like the augmented reality business card depicted in the following video clip:

Augmented Reality Business Card from PO-MO Inc. on Vimeo

Imagine if your local shopping centers, museums, libraries, or even schools offered this level of immersive interaction on a regular basis!

RELATED
The PO-MOtion system has a wide range of uses. It is currently used in an educational setting in a sensory room for students with special needs, something that I'd like to try out in the near future with students at Wolfe School. I plan to share more about this in another post.

PO-MO Case Studies


PO-MO Bios:

Meghan Athavale – Director/CEO, PO-MO Inc.

"Meghan has been a professional designer and animator since graduating from Red River College in 1997. After graduation, she moved to Calgary, where she spent almost two years directing projects at Aurenya Studios, a start-up animation company. In 2001, Meghan was engaged by Community Connections to support community-based IT development projects in rural Manitoba and in Winnipeg’s inner city.  In 2008, Meghan joined Manlab, developing educational interactive games and resources for Immigrate Manitoba. She also launched Meghan PO-MO Project, a sole proprietorship which provided sound reactive visuals for DJs and venues across Canada. In 2009, Meghan was contracted as the User Experience Designer at Tipping Canoe, a multinational internet marketing company.

In 2010, Meghan formed PO-MO Inc. in partnership with Curtis Wachs. She began working exclusively for the company in December, 2010. Today, Meghan is the driving force behind PO-MO Inc."

Curtis Wachs – Technical Director/COO, PO-MO Inc.
"Curtis graduated from Assiniboine Community College in 2003 where he studied object oriented programming. Directly upon graduating, Curtis was hired by Assiniboine Community College to help design and develop software for online classes. Curtis relocated to Winnipeg in 2006 to create interactive training material for sales staff at E.H. Price. During the course of his work, Curt was apprenticed in 3D modelling and animation by Liem Ngyuen, a former Frantic Films resident. In 2008, Curtis joined Manlab, where he created online educational games for Travel Manitoba, Immigrate Manitoba, and other clients. In 2010, Curtis formally joined PO-MO Project, and the company became a partnership. In June 2010, PO-MO Inc. was founded.

Curtis is currently the technical director at PO-MO Inc., overseeing the project management and workflow of contracted and R&D development projects."

Johnny Chung Lee's Recent Words of Wisdom & Google's Open-Source Ceres Non-Linear Least Squares Solver

I have been a fan of Johnny Chung Lee since 2007 or 2008, before he finished his Ph.D in Human-Computer Interaction.  Johnny went on to work at Microsoft (Kinect) and then Google, where he works as a Rapid Evaluator. 


Johnny is known for his experiments with the Wii Remote, which he introduced to the world during a TED Talk in 2008.  He continues to maintain his Procrastineering blog, and from time-to-time, uses his blog to share his take on the world of technology.  The following quote is a good example of his viewpoint, taken from his post, "Technology as a Story":


"...what saddens me is when I encounter technologists with the brilliance to create new and wonderful things, but lack a sense of what is beautiful to people. Technology is most often known for being ugly and unpleasant to use, because technologists most often build technology for other technologists.
...But to touch millions of people, you have to tell a story - a story that they can believe in, a story that can inspire them. Technology is a tool by which new stories can be crafted." - 



Today, I came across Johnny's most recent post, which asks, "So, what exactly is a "non-linear least squares solver"?  And why should you care?   Take a moment to read his post, "Ceres: solving complex problems using computing muscle".  Google just open sourced the Ceres Non-Linear Least Squares Solver.


If Johnny Chung Lee thinks that this is "probably the most interesting code library" that he's had a chance to work with, it probably has some value. 


Even if if you don't have a clue about the Ceres Non-Linear Lest Squares Solver,  you might appreciate Johnny's examples of how would it would useful. In today's rapidly-accelerating technology-supported world, you just might need it in your future!


Here are a few examples:
---Making sense of sensor data from multiple locations (see video "SLAM 1: Viewed at 6X speed")
---Figuring out the position of a camera and the objects in view (see video "Parallel Tracking and Mapping for Small AR Workspaces")
---Combining GPS data with vehicle sensors in cars. (see video "Street View Sensor Fusion with Ceres")


RELATED
Johnny Chung Lee's Website
Excerpt from a post I wrote about Johnny Chung Lee four years ago:
I wish I could be Johnny Chung Lee for a Day! 3/2/08
I've mentioned in previous posts that I am a fan of Johnny Chung Lee, a Ph.D. student in the Human-Computer Interaction department at Carnegie-Mellon University. Johnny expects to complete his Ph.D this year. Johnny recently presented his innovative work at TED 2008. 


What impresses me about Johnny is the way that he has documented his intellectual journey in a very accessible way, by using YouTube and his well-organized, appealing website. Johnny has taken interesting ideas that most would dismiss as silly or impractical, and transformed them into useful, usable applications that hold great promise for future work. 


 In my opinion, many of Johnny's "hacks" will spark ideas related to the design and development of universally designed technologies and applications that will meet the technology needs of a wider range of people. This is important, especially now that an increasing number of "connected" interactive displays and kiosks (known by the marketing industry as interactive digital signage) in public spaces.


January 2011 post:
"Hi, Google. My name is Johnny Chung Lee": Johnny Chung Lee Leaves Microsoft. (I still wish I could be Johnny Chung Lee for a day.)

Starbucks Cup Magic: Augmented Reality App for iPhone and Android!

The app was developed by Blast Radius.  FYI, Blast Radius is hiring.

"Blast Radius is a global agency that takes a strategic approach to tackling the complex issues of growing brand and revenue in a digitally connected world."


For more information, tak a look at the Starbucks Cup Magic iTunes preview.


Thanks to Ajit Jaokar for the link!

Augmented Reality Cookies: Link to video and website for QKies, a new twist that blends cookies and AR.

QKies is a cooperative project of Juchem Gruppe, a German food trade company, and DFKI, the German Research Center for Artificial Intelligence.  QKies is a special twist on baking cookies that involves the use of QR codes that people can share as they share cookies with others:

"Give your friends and acquaintances cookies, they send you directly to a specific site. For example, this can be a video on YouTube, a photo from Flickr or your own website."



Below is a picture from a blog post about QKies:

-Bemme51 

Here is an introductory video of the product, in German:

QKies - sag's mit Keksen from r3 media on Vimeo.

Below is a video created by Johannes Schoening of his augmented reality Christmas Cookies.  The idea for the concept, as you see, started out as a joke, after his wife asked him to bake some cookies for the holidays. 




Johannes worked as a senior researcher at DFKI and is now following his new motto,  "Baked to the Future" at "people interactive" (http://www.people-interactive.de/) in Cologne.

Hans Rosling Interacts with Health Data: 200 Countries, 200 Years, 4 Minutes

Hans Rosling's enthusiasm for data visualization has increased my appreciation for statistics. In the video below, Rosling interacts with 120,000 data points related to 200 countries over 200 years. I especially like the "Alternate Reality" effect.



"Unveiling the beauty of statistics for a fact based world view"

Hans Rosling is a Professor of Global Health in Stockholm, Sweden, and the Director of the Gapminder Foundation.  The Gapminder World website has a wealth of resources for teachers, students, and anyone who is interested in learning about things through the use of information visualization.

According to information from the website, "Gapminder is a non-profit venture – a modern “museum” on the Internet – promoting sustainable global development and achievement of the United Nations Millennium Development Goals.Gapminder was founded in Stockholm by Ola Rosling, Anna Rosling Rönnlund and Hans Rosling on February 25, 2005. Gapminder is registered as a Foundation at Stockholm County Administration Board (Länstyrelsen i Stockholm) with registration number (organisationsnummer) 802424-7721."


Below is a list of annotated links to various Gapminder webpages:

Gapminder Labs: "Gapminder Labs is where we experiment with new features, visualizations and tools. Some of these might later gain a more prominent place on Gapminder.org."
Gapminder for Teachers: "This section is for educators who want to use Gapminder in their education. You'll find shortcuts to tools and guides for Gapminder in a classroom."
Gapminder Downloads: This section includes links to downloadable content, such as Gapminder Desktop, handouts, lesson plans, including teacher guides, and a good number of interesting interactive presentations.
Gapminder Videos: The videos include interesting presentations as well as a number of Hans Rosling's TED talks. The material is free to use and distribute under the Creative Commons License.
Data in Gapminder World:  This section includes all of the indicators displayed in Gapminder World.
Gapminder World
Gapminder FAQs

Cross-posted on the TechPsych and The World Is My Interface blogs

Augmented Reality Eyeglasses: I AM geeky enough to make this fashion statement!

THE AR WALKER, from NTT DoCoMo

Jason Sosa tweeted about the latest trend, the AR Walker, augmented reality for your glasses. This technology from NTT DoCoMo allows you to instantly access location-based information about the things around you. This would be very convenient for people walking about in urban areas, or for tourists. The system also provides easy access to other kinds of information. For example, if you look up towards the sky, you'll get weather information...beyond what you'd figure out on your own.

Of course, the fashionable get-up is in the prototype stage, so you won't be able be seen in public with the newest type of shades anytime soon. For more information, see the video below:


AR WALKER


RELATED

Augmented Reality On Your Glasses, Maps in Your Eyes, Aaron Saenz,  Singularity Hub.

DoCoMo shows prototype augmented reality display, Nick Barber, IDG News Service

LAYAR: Augmented Reality Browser (website)

Total Immersion's Partner Success Story: Demo Reel of AR&Co in Indonesia

Cross posted on The World Is My Interactive Interface blog.

Emerging Interactive Ed. Tech: Classmate Assist and Wayang Outpost -Sensors, AI, and Context Awareness for Learning -and Teaching

Brief background: I've been following developments in intelligent tutoring systems for a while, and find it interesting to see how researchers are combining artificial intelligence, learning theory, affective computing, and sensor networks to create applications that might prove to be useful and effective.

The advantage of using intelligent tutoring applications in some cases is that it provides students with additional support and feedback the moment it is needed, something that is difficult for teachers to provide to students in large classrooms. With the increase in use of smartphones and other mobile devices such as the iPad, there is a good chance that this sort of technology will be used to support learning anywhere, anytime.

Although most intelligent tutoring systems are geared for 1-1 computing, I think there are some components that could be tweaked and then transfered to create intelligent "tutoring" systems for collaborative learning. Students like game-based learning, and what could be more fun than playing AND learning with a partner or group of peers? (I plan to revisit the research in this area in an upcoming post.)

Some thoughts:I envision a system could support learning as well as important skills useful to students in life beyond the school walls, such as positive social interaction, teamwork, and problem-solving skills. The path of least resistance? Most likely applications that support the learning of pairs or small groups of students working at one display. However, in this era of the "21st Century Learner", there is a growing need for applications that can support small groups of students for collaborative groups and project-based learning activities.

There are a few applications developed for collaborative learning activities around a multi-touch table, such as the SMARTTable or the Surface, and more are needed. Also needed are intelligent systems that can support video conferencing and collaborative learning between students who are not physically co-located.

There are some problems that have yet to be solved. For example, the use of multiple sensors for an application designed for young people might be too intrusive. There are serious issues related to privacy/security. Who would have access to data regarding a student's emotional or physiological state? How would this data be utilized? How would this information be protected? Many school districts have security vulnerabilities, so it is possible that this information could be misused, if in the wrong hands.

Below I've highlighted two "intelligent" tutoring systems that incorporate the use of sensors in one form or another to generate information about student learning in a way that simulates what good teachers do every day. The ClassroomAssist application was developed by researchers at Intel, in collaboration with several universities. The Wayang Outpost application was developed by researchers at UMASS, and is aligned with the principles of Universal Design for Learning.

CLASSROOM ASSIST
ClassmateAssist is an application developed by Intel's Everyday Sensing and Perception team. Here is the description of the application from Intel Research:"The advent of 1:1 computing in the classroom opens the door for teachers to set up individualized learning for their students who have a wide spectrum of interests and skills. ClasmateAssist technology uses computer vision and image projection to assist and guide students in a 1:1 learning environment, helping them to independently accomplish tasks at their own pace, while at the same time allowing teachers to be apprised of student progress."

In the following video, Richard Beckwith, a developmental psychologist at Intel, demonstrates a prototype of an application that uses video-sensing to track student's hand movements during a coin sorting lesson. The application provides feedback to the student, and also tracks data about the student's progress that can be transformed into a report for the teacher. The system can also monitor student's facial expression, note attention levels, and provide feedback.

Intel Research: Everyday Sensing and Perception

Socially and Physically Aware Interaction Systems (SPAIS)

SPAIS Publications:

Theocharous, G., Beckwith, R., Butko, N., Philipose, M. Tractable POMDP Planning Algorithms for Optimal Teaching in "SPAIS". International Joint Conferene on Artificial Intelligence (IJCAI) workshop on Plan Activity, and Intent Recognition (PAIR), Pasadena, California, July 2009.

 May 2010.

Theocharous, G., Butko, N., Philipose, M. Designing a Mathematical Manipulatives Tutoring System using POMDPS. (pdf). POMDP Practitioners Workshop: Solving Real-world POMDP Problems, International Conference on Automated Planning and Scheduling (ICAPS). Toronto, May 2010

Intel Research Press kit

Wayang Outpost: Web-based Interactive Math/Intelligent Tutoring System, with Sensors.

I've followed the work of Beverly P. Woolf and her colleagues for some time.  Much of their research has centered around a web-based application, Wayang Outpost, an intelligent electronic tutoring system that incorporates multimedia and animated adventures while providing activities designed to prepare teens for standardized math tests, such as the SAT and state-mandated end-of-course exams.

In recent years, the team has been using non-invasive sensors in their research, including a camera that views facial expressions, a posture-sensing device located in the seat of the student's chair, and a pressure-sensitive mouse, and a wireless skin conductance wristband. Data collected through all of these sensors can provide useful information about student learning.  The system can also note when students try to "game" the system.

Related Publications

Woolf, B.P., Arroyo, I., Muldner, K., Burleson, W., Cooper, D., Dolan, R., Christopherson, R.M (2010)The Effect of Motivational Learning Companions on Low Achieving Students and Students with Disabilties (pdf) International Conference on Intelligent Tutoring Systems, Pittsburgh.
Abstract "We report the results of a randomized controlled evaluation of the effectiveness of pedagogical agents as providers of affective feedback. These digital learning companion were embedded in an intelligent tutoring system for mathematics, and were used by approximately one hundred students in two public high schools. Students in the control group did not receive the learning companions. Results indicate that low-achieving students—one third of whom have learning disabilities—had higher affective needs than their higher achieving peers; they initially considered math problem-solving more frustrating, less exciting, and felt more anxious when solving math problems.  However, after they interacted with affective pedagogical agents, low-achieving students improved their affective outcomes, e.g., reported reduced frustration and anxiety."


Arroyo, I., Cooper, D.G., Burleson, W., Woolf, B.P., Muldner, K., Christopherson, R. (2009)

Emotion Sensors Go To School. AIED 2009. Pp. 17-24. IOS Press.
Low-tech description of Wayang Outpost, the math application used in the above publication: 

How's Your Math Mood?  Math software senses students' anxiety, boredom 

Paul Franz, Recoder.Com 5/16/09
Cooper, D.G., Arroyo, I., Woolf, B.P., Muldner, K., Burleson, W., Christoperson, R.  Sensors Model Student Self-Concept in the Classroom (pdf) UMass Amherst, June 22, 2009/UMAP 2009

Cross posted in the TechPsych Blog

Virtual Reality Effectively Treats PTSD and Related Disorders: Skip Rizzo's TEDx Talk about promising interdisciplinary work at the Institute for Creative Technologies

-Skip Rizzo, Co-Director of the VRPSYCH Lab at the USC Institute of Creative Technologies (ICT)

Note: Skip's talk begins about 4 minutes into the presentation.


In this TEDx Talk video, Marilyn Flynn, Dean of the University of Southern California's School of Social Work, introduces Skip Rizzo, a research scientist and Co-Director of the VRPSYCH Lab at the USC  Institute of Creative Technologies (ICT).  Skip's research has focused on the use of virtual realty and related technologies for treatment and training purposes.

In this talk,  Skip provides an overview of the interdisciplinary research taking place at the Institute of Creative Technologies (ICT). Skip goes on to explain the urgency of ICT's current work, focusing on the treatment of Post Traumatic Stress Disorder and other problems experienced by people who have sacrificed so much to serve our country in places of wars and conflicts such as Iraq and Afganistan.  Neary one-third of our military personnel are significantly at-risk for developing PTSD or other debilitating conditions that will negatively affect their functioning upon returning home.

Skip goes on to show how the latest VR (Virtual Reality) related technologies and applications combine with with evidence-based intervention and treatment strategies to successfully treat PTSD.  Recent research indicates that 75% of clients treated through 10 sessions of exposure therapy no longer exhibit clinical symptoms of the disorder. Given the numbers of people suffering from PTSD and related disorders, the potential for this treatment method holds promise.

Skip points out that one problem many veterans or their loved ones experience is that they are not aware that effective treatment is available.  Additionally, there are few therapists who are trained in the use of VR as a therapeutic tool.  By working with USC's School of Social Work, this may no longer be the case in the future.  Therapist can learn ways to provide effective evidence-based treatment through interacting with a "virtual human" application that uses an "intelligent" character that simulates the conversational exchanges that are likely to occur during treatment sessions. Additionally, the research behind this effort has resulted in the creation of an on-line system that includes virtual guides that can provide support and guidance to people suffering from PSTD in order to get them to engage in the treatment they require.


Here is information from the Institute of Creative Technologies regarding Skip Rizzo's TEDx USC Talk:
Skip Rizzo's TEDx USC Talk Now Online
"ICT’s Skip Rizzo spoke at this year’s TEDx USC conference and was introduced by Dean Marilyn Flynn of the USC School of Social Work. Video of their talk is now available for viewing on the TEDx Talk’s Channel on YouTube...Of the more than 1.6 million men and women deployed to Iraq and Afghanistan, nearly one-third are expected to return with disabling combat stress disorders that may affect some for a lifetime if left untreated.

Through and unlikely marriage of social work and cutting edge technology, the USC Institute for Creative Technologies and the USC School of Social Work are revolutionizing the training methods for a new generation of mental health professionals, shifting the way clinicians learn to interact with their patients."
  
Introduction: Marilyn Flynn, Dean, USC School of Social Work
Virtual Reality Demonstration: Albert “Skip” Rizzo, Research Scientist, USC Institute for Creative Technologies 

RELATED
USC Institute for Creative Technologies
"The USC Institute for Creative Technologies brings together high-tech tools + classic storytelling to pioneer new ways to teach + to train."
Virtual Reality & Convergence with Game Technology IMT blogpost, 7/2006
Convergence:  Video Games and Virtual Reality for Special Needs: Autism, ADD, Fetal Alcohol Syndrome, Social Skills TechPsych blogpost, 8/2006
(I will revisit this and related topics in future posts.)

OpenFrameworks & Interactive Multimedia: Funky Forest Installation for CineKid

The Funky Forest was created by Emily Gobeille and Theodore Watson for the 2007 CineKid festival in the Netherlands, using OpenFrameworks, an open-source application used for multimedia and multi-touch applications. Take a look at the video and pictures of the children interacting with this technology!

"It “is a wild and crazy ecosystem where you manage the resources to influence the environment around you. Streams of water flowing on the floor can be diverted to make the different parts of the forest grow. If a tree does not receive enough water it withers away but by pressing your body into the forest you create new trees based on your shape and character. As you explore and play you discover that your environment is inhabited by sonic life forms who depend on a thriving ecosystem to survive.”

The trees and creatures in the installation look really beautiful; just abstract enough to make it look like a strange magical forest, but the processes of our real ecosystems are still recognisable. A really wonderful project. And it sure looks like a lot of fun!" -Tanja, from the TakeBigBites blog