Leap Motion and Google Earth Experiment: Cute Doggie Photo-globe Mashup

Leap Motion and Google Earth Experiment: Cute Doggie Photo-globe Mashup 

I finally experimented with my Leap Motion controller and Google Earth, using a mashup I created a few years ago with pictures of cute dogs from my Flickr photo-stream.  In the video below, you can see that my gesture navigation skills still need some practice!

I should have watched the following video of Leap Motion in action with Google Earth before trying this experiment at home : )  

I am pretty sure that developers will be able to tweak Leap Motion + Google Earth interaction in the near future.  I'd like to adapt it for use with kids as well as adults who have mild motor impairments.

Cute Doggies Photo-Globe Mash-up using Google Earth and a Flickr Set (How-to)

If you'd like to make your very own photo-globe using Google Earth and Flickr photos, here are the directions, ported and updated from a previous post:

This photo is a screen shot of photos of just about every dog I know, and some that happened to cross my path. In this post, I'll share some information about how to create a photo-globe in Google Earth. 

The first step is to make sure you have lots of pictures related to your theme uploaded to a site such as Flickr.  (You can also create a photo-globe using pictures from your computer's hard drive.)

To get the pictures into Google Earth, I used the Image Overlay feature, and in the "link" textbox, I entered the image URL for each picture that I'd previously loaded as a set in Flickr.

To do prepare for this, make sure you go to "view" tab on the upper left-hand section of your screen, and make sure that "toolbar" is checked. Also make sure that "Grid" is selection, as this will help make it easier to arrange and align your pictures.  You can turn off this feature later. Near the top of the screen, click on the Image Overlay icon. (I've highlighted it in the picture.)

You'll have to enter the URL of the image you'd like to add to the globe in the "Link" textbox, which I've highlighted in the above picture.  In this case, I've used a link to one of my pictures in a Flickr set I created for this project.

One thing to keep in mind is that the picture will take up a much larger space than you might prefer, so you'll have to adjust the size using the green markers:


The following directions are from the "Positioning the Imagery in the Viewer" section in the help section:

1. Use the center cross-hair marker to slide the entire overlay on the globe and position it from the center. (Tip: do this first.)
2. Use the triangle marker to rotate the image for better placement.
3. Use any of the corner cross-hair markers to stretch or skew the selected corner. If you press the Shift key when selecting this marker, the image is scaled from the center.
4. Use any of the four side anchors to stretch the image in or out of from the selected side. If you press the Shift key when doing this, the image is scaled from the center.

TIP:  Try positioning the center of the image as a reference point first, and then use the Shift key in combination with one of the anchors to scale the image for best positioning.

Directions updated to reflect latest version of Flickr, as of 5/27/13:

To find the image URL for a photo in Flickr that you wish to link on your photo-globe, select your desired photo and right click "Copy Image URL".

Put your curser in the Link section of  the "New Image Overlay" dialog box in Google Earth, and right click to select "paste" from the drop-down menu

Then repeat the process.  It helps to name each picture so that you can find it easily in Google Earth.

To enhance your mash-up, you can add place-marks that contain URLs that link to additional information about the subject of a picture, such as blog posts with embedded videos and/or text related to a picture, and so forth. Directions can be found in Google Earth's help section.

The process of building a photo-globe in Google Earth is a bit tedious.  If someone has a short-cut to share, please let me know!

RESOURCES
Google Earth
Flickr
Programmable Web (My hunch is that this site might provide some information about shortcuts for creating a photo-globe in Google Earth.)
LEAP Motion

Summer of Fun and Game Development with Unity

Summer of Fun and Game Development- Unity

I just downloaded the GameAnalytics Unity Package and plan to spend some of my summer break digging deeper into Unity.  I have been experimenting with Xcode stuff and Leap Motion.  

I want to make the most of my 5 weeks "Summer of Code". Unity fits the bill.  It has offers a wealth of wonderful online  learning resources.  

I've explored Unity in the past and loved it, and am very impressed with how it has evolved over the past few years.

I'll add more to this post later!

Xbox One and Kinect 2 for the Playground of the Future

Xbox One and Kinect 2, Playground of the Future

The big news in tech today is the unveiling of the new Xbox One/Kinect 2 system.  For now, the video below might be the closest you'll get to the system.  Wired's senior editor, Peter Rubin had a chance to interview Scott Evans, of Microsoft, as he demonstrated the fascinating technical details in a family-room type setting.

Wired's interview of Scott Evans and demo of the new Xbox One and Kinect 2, using Active IR technology.

From what I learned, the new Kinect sensor has six times the fidelity of the previous version. Paired with the new Xbox One, it can do amazing things.  Engineers from around the world collaborated on this project, providing expertise in facial recognition, digital signal processing, speech recognition, machine learning, and computer vision.  The Xbox One is fueled by an 8-core x86 processor, supported by 8GB of RAM, which is sure to handle the hardest gamer's needs. It also includes a 500GB hard drive and an HD Blu-ray player.


The new system was designed to enhance the gaming/user experience. The 1080p camera provides a field of view that is 60 degrees larger than its  predecessor, and can handle a high level of detail.  It provides a better means of interpreting movement and orientation, and it processes skeleton and hand movements more precisely.  The system features "muscle man", a human-based physics model that is layered over the skeleton and depth map. It senses and calculating the forces the player uses while moving in a game. 

What I find interesting is that the camera can detect the player's pulse by measuring subtle changes of the skin that can't be perceived by the naked eye.  It also can quickly identify each player (it handles up to six), and identify facial expressions.  The active IR (infrared) system provides the system with better accuracy than the original Kinect. 

I wasn't able to find out much information regarding privacy issues with this system.  This is a concern, since it can sense your physiological responses, movement patterns, and facial expressions.  Over time, a good deal of very personal information would be gathered about each user. I shudder to think about the consequences if the data fell into the wrong hands.  

Possibilities for Special Needs Populations

I can see that the Xbox One + Kinect 2 system has the potential for games and other interactive applications for use in physical rehabilitation and fitness.  Since it can interpret facial expressions, it could also provide a way to support social skills learning among children and teens who have autism spectrum disorders.

RELATED

Microsoft invests a good deal of attention to proof-of-concept projects that may or not become part of a commercial product.  Below is an example of IllumiRoom:

Hrvoje Benko, of Microsoft Research, discusses the IllumiRoom concept during an interview at CHI 2013.

Xbox One Website
The new Xbox One Kinect tracks your heart rate, happiness, hands and hollers
Matthew Panzarino, The Next Web, 5/22/13
Kinect 2 Full Video Walkthrough: The Xbox Sees You Like Never Before
Kyle Wagner, Gizmodo, 5/21/13
Hands-on with prototypes of the Xbox One and New Kinect Sensor
Ben Gilbert, engadget, 5/21/13
Efficient Human Pose Estimation from Single Depth Images
Shotton, J., Girshick, R., Fitzgibbon, A., Sharp, T., Cook, M., Finocchio, M., Moore, R., Kohli, P., Crinisi, A., Kipman, A., Blake, A.   Video
Consumer Depth Cameras for Computer Vision:  Research Topics and Applications
Fossati, A., Gall, J., Grabner, H., Ren, X., Konolige, K. (Eds.)
Xbox One: Microsoft's supergeeks reveal what's inside the hardware
Dean Takahashi, VentureBeat, 5/21/13
Next Xbox Will Face New Array of Rivals
Nick Wingfield, New York Times, 5/21/13

Astronaut Chris Hadfield's Awesome Music Video from Space - in case you missed it!

Amazing Music from Space

I finally got around to watching Canadian astronaut Chris Hadfield's wonderful remake of David Bowie's Space Oddity, created on the International Space Station.  Hadfield makes the music his his own, changing a few words, to share his experience with the world.  

I was impressed with the quality of this video, from the editing to the sound mix.  



Chris Hadfield spent the last several months in space, and during this time, he connected with thousands of people, young and old, around the globe.  Although he is now known for his space music video,  many school children learned before his video went viral. His tweets, pictures, and video clips from space were followed by students in classrooms around the world.  (See "Related" section at the bottom of this post for links to related information about Chris Hadfield.)


I really liked the images from the video. Below are screen shots of some of my favorite scenes:

:49 Chris Hadfield looking out towards Earth and space

1:12 Guitar floating in space station

2:31 Chris Hadfield playing guitar

2:41 View of Earth and clouds from space

2:47 View of Earth at night

4:10 View of earth and darkness of space from window

RELATED

Chris Hadfield Twitter

Chris Hadfields Google+ Page

Chris Hadfield's Facebook Page

Biography of Chris Hadfield, Canadian Space Agency

5 things Chris Hadfield did that amazed us

John Bowman, CBCNews Your Community Blog, 5/14/13

How Chris Hadfield Made Us Care About Astronauts Again

Kyle Wagner, Gizmodo, 5/13/13

Jay Leno's Interactive Pumpcast News: Will and Monifa Sims 15 minutes of Karaoke Fame

"You sir, on pump 16!"

If you haven't seen this video yet, take a look.  It is a great example of interactive TV at the gas station pump!   

Pumpcast News is a segment featured on Jay Leno's Tonight Show that catches people by surprise at the gas pump as they try to ignore the TV blaring away. 

In the following video clip, Pumpcast news anchor Jack Rafferty offers free gas if the customer, Will Sims, will sing karaoke.  Will sings "Living on a Prayer", by Bon Jovi, with all of his heart and soul.  Later,  his wife, Monifa, joins in and belts out Sweet Dreams, by the Eurythmics.


I especially liked Will's "living on a free tank of gas" improvisation at about 2:28.

I don't think this segment was staged,  but even if it was, the interactive TV is a great concept.  It certainly engaged the customers.   

Who knows?  Would you purchase one brand of gas over another if you knew you'd have a random chance to get a free tank of gas and 15 minutes of fame?

RELATED
Will and Monifa Sims were invited to sing on The Tonight Show:

Human-Glass Interaction: SNL Google Glass Parody by Randall Meeks

Do these glasses make me look smart?

Human-Glass Interaction: SNL Weekend Update parody by Randall Meeks, looking full of himself wearing his Google Glasses.  Are we there yet?

 


"Peacock, Peacock, Peacock.... go back, go back, go back....Italian, Italian, Italian"

"See how simple that was!"  "Mute, mute, mute, mute... I have to reboot it. Reboot, reboot, reboot.."

RELATED 
Google Glass
16 Funny Google Glass Comics and Parody Videos
Daniel Zeevi, Dashburst, 3/1/13