Showing posts sorted by relevance for query kinect. Sort by date Show all posts
Showing posts sorted by relevance for query kinect. Sort by date Show all posts

Jan 3, 2012

"Kinect-based Telepresence with Room Sized 3D Capture and Life Sized Display", Includes Behind-the Scene "how-to" (UNC Chapel Hill)

Jim Spadaccini, of Open Exhibits, recently told me about a project that involves the real-time, interactive 3-D capture of people in a room.  As the viewer moves around the screens, the depth-detecting feature of the Kinect is harnessed to set the stage for a realistic telepresence experience.  


Take the time to view the video, which contains some interesting views of how the system works:





Thanks, Jim, for the link!

RELATED/SOMEWHAT RELATED
Kinect Real-Time Room Telepresence
Kinecthacks, 1/3/12
From the project's website:
Maimone, A. and H. Fuchs. "A First Look at a Telepresence System with Room-Sized Real-Time 3D Capture and Large Tracked Display." The 21st International Conference on Artificial Reality and Telexistence (ICAT) (Osaka, Japan, November 28-30, 2011) [paper] [video]
Maimone, A. and H. Fuchs. "Encumbrance-free Telepresence System with Real-time 3D Capture and Display using Commodity Depth Cameras." The IEEE International Symposium on Mixed and Augmented Reality (ISMAR) 2011 (Basel, Switzerland, October 26-29, 2011) [paper] [video]
Open Exhibits

Mar 7, 2011

Monday Musing and Meanderings: Interesting videos and links about emerging technologies.

INTERACTIVE TANGIBLE TABLETOP MUSIC


Reactable Live! SubMixPro Studio Torino

The Reactable featured in the above video is used for DJ-ing in clubs. The one I've played with is at the science museum in my area - I love it. It is fun to improvise on the Reactable with another person.  For more information, see my previous blog posts featuring the Reactable.

AUGMENTED REALITY
While listening to CNBC on my satellite radio on the way home today,  I heard that investing in Qualcomm might be a good idea.   I wonder if this means that Wall Street analysts think that  AR will become mainstream soon...   


The video below shows a variety of creative AR game applications:


Qualcomm has an AR SDK that comes with tutorials, samples, an API reference, and developer forums. The SDK can be downloaded from the Qualcomm AR web-page.



For more information:
GDC 11:  AR- The Augmented Future of Mobile Serious Games?  Eliane Alhadeff, Serious Games Market, 3/7/11
Qualcomm's secret mobile weapon:  Augmented Reality Robert Enderle,  TG Daily, 2/24/11

This sort of technology has been around for a while. For an example, take a look at  the 2007 MScape game demo of the AR game, Roku's Reward:



THE KINECT FOR MEDICAL DATA VISUALIZATION 
Here is another use of augmented reality, but this time, harnessing the Kinect:
Madhav K. ,  Kinecthacks 

PHOTOELASTIC TOUCH

Transparent Rubbery Interface using a LCD and Photoelasticity
Toshiki Sato, Haruko Mamiya, Taro Tokui, Hideki Koike,  The Unversity of Electro-Communications;  Kentaro Fukuchi, Japan Science and Technology Agency
Abstract (pdf)


ART AND SCREENS

Feb 26, 2011

Why bother switching from GUI to NUI? - Asked and Answered by Josh Blake; My 2-cents; Stevie B’s Microsoft Research Video; Marco Silva’s NUI-HCI Presentation (and links)

In Chapter 1 of Natural User Interfaces in .NET,  Josh Blake asks and answers a question posed by many people who have been under the spell of keyboard input and GUI/ WIMP interaction: 


Why bother switching from GUI to NUI?  The answer?  Read Chapter 1 (pdf) of the book - the chapter is free.


Here are a few of my personal reasons:  
1.  I want to buy the next version of the iPad or something like it.
2.  I want to buy a new large-screen Internet HD TV.
3.  I want to buy a Kinect.
4.  I do NOT want to interact with my new TV with a Sony remote.  Too many tiny buttons!


5. I do NOT want to interact with my new TV with a keyboard,  because it reminds me of...work.

6.  Most importantly: 

I want to design apps for the people I care about, and others with similar needs:
    My mom.  
    My grandson.
Moms and dads with kids in tow.
People with special needs and/or health concerns, and the people who care and guide them.
Knowledge sharers and (life-long) learners....

RELATED

"Smart" Interactive Display Research

 
View more presentations from Marco Silva

My YouTube Playlist:
"Natural user interfaces, gesture interaction, multi-touch, natural interaction, post WIMP examples and more... "
RELATED - and somewhat related   
Encyclopedia:  Human Computer Interaction, Interaction Design, User Experience, Information Architecture, Usability and More (Interaction-Design.org)

Josh Blake's Blog: Deconstructing the NUI    Book: Chapter 1 (pdf)  Free!
Blake.NUI
"Blake.NUI is a collection of helpful controls, utilities, and samples useful for multi-touch and NUI development with WPF, Surface, and Silverlight."
 (This is not an inclusive list.)


GUI to NUI Post-WIMP Manifesto:  TBA

Feb 24, 2011

Today I hooked up a Wii to the IWB in the school's therapy room. Next - a Kinect?! (Angels are welcome to help us expand the school's "games" programs for students with special needs)



Today, I hooked up our school's Wii to the newly-installed IWB in the therapy room for the first time, and used it during a session for for a social-skills activity with two students who have autism spectrum disorders.  The students helped each other to create their own "Mii" avatars.  I had them play the bowling game, and was impressed how this activity elicited social conversation between the students, with minimal effort on my part.

Most of students in the program at Wolfe are in grades 6-12. They have cognitive, language, and motor delays.  A good number of the students also have autism spectrum disorders. Some have multiple special needs.

We have found that when our students are provided with interactive activities displayed on the large screen of an IWB, they tend to increase their level of attention to their peers and also communicate more with one-another, as well as with the teachers and staff.

By using an IWB for games at school, we are extending the reach of how this technology can be used with students who have more complex special needs.   By providing a means  for our students to learn to play positive games, we help them develop important physical, social, and leisure skills that they can use outside the school setting with non-disabled peers and siblings.  My hunch is that the games will also help promote cognitive/problem solving skills, too.

NOTE:
The funds to purchase the Wii were donated to our school, but did not cover additional games or accessories. We'd like to purchase Rock Band and Wii Fit. We'd also like to expand our program and purchase an Xbox with a Kinect.   An iPad or two would be OK, too : )

If there are any angels out there who'd like to donate funds for our "games" program at Wolfe, please contact me through my Google profile. I will connect you with the appropriate person.

Game designer/developers/researchers/students:
If you are interested in volunteering your efforts to work on a basic cooperative, pro-social game for the Kinect, SMARTTable, or interactive whiteboard, please contact me.


Feb 18, 2011

New Radiohead video, Lotus Flower: Will we see Thom Yorke's moves on Kinect's Dance Central or Just Dance 2 anytime soon?

When I saw the new Radiohead video, Lotus Flower, featuring a dancing Thom Yorke, I wondered how his moves might play out in a dance application for the Kinect or Wii.

Wouldn't it be fun to figure out a way to represent the dance "steps" in this video?  Just a thought.  



RELATED
Radiohead Surprises With Early Release
Jon Pareles, New York Times 2/18/11
"Wii Just Dance 2 and Kinect Dance Central: UI and Usability Approaches"

Jan 18, 2011

"Hi, Google. My name is Johnny" Johnny Chung Lee leaves Microsoft. (I still wish I could be Johnny Chung Lee for a day.)

"Hi, Google.  My name is Johnny"  Johnny Chung Lee announced on his Procrastineering blog that he's accepted a position at Google as a "Rapid Evaluator".   I'm not sure what he will be doing in this position, but his title is intriguing!

Here are some of my previous posts devoted to the work of Johnny Chung Lee:

I wish I could be Johnny Chung Lee for a Day!  Tracking fingers with the Wii Remote
Video Clips of Projects Inspired by Johnny Chung Lee
More about Project Natal:  Richochet - Great Gaming for Fitness, Johnnie Chung Lee's Contribution


I STILL wish I could be Johnny Chung Lee for a day!

RELATED
Microsoft Kinect Developer Johnny Chung Lee Jumps Ships and Lands at Google
Leena Rao, TechCrunch, 1/18/11
What Microsoft Kinect Defection to Google Means
Rich Tehrani, TMCnet Blog 1/18/11
Microsoft Loses a Top Kinect Researcher to Google
Tricia Duryee,Yahoo! Finance, 1/18/11

Dec 9, 2010

Interested in the OpenNI Initiative? OpenKinect? To learn more, read Josh Blake's Interview of Tamir Berliner of PrimeSense




Josh Blake, Deconstructing the NUI, 12/9/10



Josh Blake recently interviewed Tamir Berliner, one of the founders of PrimeSense.  If you haven't heard, Microsoft's Kinect was based on work by PrimeSense, and licensed their technology. PrimeSense provides consumer electronics with natural user interaction capabilities. The good news is that the company recently released open-sourced middleware for natural interaction and depth-camera drivers. It will be interesting to see how this will play in the near future!




In the interview, Tamir discussed a number of topics related to postWIMP technologies.  He also announced the newly created  OpenNI, "an industry-led, not-for-profit organization formed to certify compatibility and interoperability of Natural Interaction (NI) devices, applications, and middleware."   It is good to see this level of support for the cause!


Here is a quote from the interview that I especially liked:

"I believe that till today the devices we’ve been using, made us learn greatly lot about them before we could use them and gain their value. I’m pretty sure everyone who is reading this has got at least 3 remotes sitting on his living room table, and at least once a week needs to help someone use their computer/media center/phone/etc. It’s time for that to change and it’s up to us, the technologists to make this revolution happen, it’s time for the devices to take the step of understanding what we want and making sure we get that, even without asking if it’s a trivial task as opening a door when we approach, closing the lights when we leave the room, even making sure we have hot water to shower with when we return from work or wake up in the morning, depends on what we normally do." -Tamir


RELATED
Here are a couple of videos from the OpenNI website that demonstrate OpenNI-compliant applications:

OpenNI-compliant real time skelton tracking by PrimeSense


OpenNI-compliant real time SceneAnalyzer by PrimeSense



FYI: 
Josh Blake is the author of the Deconstructing the NUI blog. Over the past couple of years, he's explored natural user interfaces and interactions through his work on applications designed for Microsoft Surface and Win7 with Windows Presentation Foundation.
About a month ago, Josh organized OpenKinect, an on-line community to support collaboration among people interested in exploring ways to use Kinect with PCs and other devices.  An example of this effort is the open source code, libfreenect, which includes drivers and libraries for Windows, Linux, and OS X. 


The Natural User Interface Revolution
Josh Blake, 1/5/09


Kinect for Xbox 360: The inside story of Microsft's secret 'Project Natal'  (long, but worth reading) David Rowan, Wired UK, 10/29/10


People of libreenect

OpenNI User Guide (pdf)

Dec 6, 2010

Interactive Information Visualization for the Kinect? Something like Jer Thop's "Just Landed-36 Hours" might work nicely if revamped!

I follow the O'Reilly Radar blogs and came across a recent post about an information visualization created by blprnt two years ago using Processing. I think it would have great potential if it was re-purposed for use on the Kinect! In the article, Edd Dumbill discusses the advantages of using Processing to create data and information visualizations.  


One example of the power of Processing is an information visualization, "Just Landed -36 Hours, created by Jer Thorp.  Jer gathered tweets from Twitter that included the statement, "just landed", along with location information for each tweet, within a 36-hour period, to create the visualization.


36 Hours- Just Landed is a great 3D visualization of air travel on our planet.  I especially lik the different views that the application provides. As soon as I watched the Just Landed video, I thought it would be great if it could be revamped for use on the Kinect!   (Leave a comment if you know of anyone working on a project in this area.)


Just Landed - 36 Hours from blprnt on Vimeo.


Information about the video from blprnt's Vimeo site:


"I was discussing H1N1 with a bioinformatics friend of mine last weekend, and we ended up talking about ways that epidemiologists model transmission of disease. I wondered how some of the information that is shared voluntarily on social networks might be used to build useful models of various kinds...I'm also interested in visualizing information that isn't implicitly shared - but instead is inferred or suggested...This piece looks for tweets containing the phrases 'just landed in...' or 'just arrived in...'. Locations from these tweets are located using MetaCarta's Location Finder API. The home location for the traveling users are scraped from their Twitter pages. The system then plots these voyages over time...I'm not entirely sure where this will end up going, but I am reasonably happy with the results so far.   Built with Processing (processing.org) You can read more about this project on my blog - blog.blprnt.com"


RELATED
Strata Gems:  Write your own visualizations:  The Processing language is an easy way to get started with graphics
Edd Dumbill, O'Reilly Radar, 12/3/10

Dec 3, 2010

More gesture and multi-touch interaction! Windows 7 Navigation with Kinect; Product browser by Immersive Labs,

Here are a couple of new natural user interface videos.  The first video, by Evoluce, demonstrates gesture interaction/navigation in Windows 7 applications supported by Kinect. The second video, by Immersive Labs, shows multi-touch product browsing interaction on a large display.

Kinect Treatment of Windows 7, by Evoluce

Evoluce: Leading Surface Technologies


Immersive Labs - Multi-touch Product Browser

Immersive Labs

Jul 27, 2013

Drawing with Sounds, an Interactive Musical Drawing App Created with Processing

This is my first creation using the Drawing with Sounds application. This cause and effect application was created with Processing 1.5.1 and produces musical sounds and patterns, along with random abstract shapes that are triggered through movements of a mouse. The application has been adapted for switch users, making it accessible to those who have motor impairments.

Processing is an open-source programming and integrated development environment that was build on the Java programming that has been easy to learn by people who have limited technical backgrounds. It is used by people from from a range of fields, such as art, music, journalism, and data visualization.

The fact that Processing is easy to use makes it great for people with just a little bit of coding knowledge to adopt a variety of open-source applications and tweak a few of the variables to according to the need.   Using the Drawing with Sounds app as an example, I wanted to change the size of the interactive canvas.  By typing in a few keystrokes,  I changed the original size of the screen from 800 x 800 to something larger, as shown below:



























I then typed in another variable for the background color, and was pleased with the results:
























The application was developed from Andrew R. Brown's tutorial on "SoundCipher", based on the SoundCipher library for Processing.  According to the description of the application, "The sketch is intended for use....as a sensory stimulus using sound, shape and color to create engagement". 




Below is a videoclip created by Keith Manville, demonstrating what happens when you interact with Drawing with Sounds: 


I look forward to sharing more on this topic in future blog posts.  I'll be sure to include basic "how-to" information for my "low-tech" readers and colleagues who desire to learn a bit more about using and creating basic interactive applications that appeal to young people with special needs.  


RELATED
Note:  SEN is the UK acronym for "Special Educational Needs"

James Winchester, SEN Classroom Blog, 10/31/13

Keith Manville, opensen blog, 10/27/12
"Open-source, Sensory and Interactive Technology in SEN"

(An accessible switch-enabled version of Drawing with Sounds can be downloaded from the above link.)

Free sensory applications built in Processing 1.5.1"Download links for sensory applications built in Processing 1.5.1, designed to assist SEN students in engaging in learning through the the use of ICT, interactive “Smart” boards, touchscreen or tablet technologies.  Our experience is that using applications on these devices or with natural user interfaces such as the Microsoft Kinect can increase the opportunities for engagement and social communication with many students."


I will be posting more information about emerging interactive technologies for special needs in the future. In the meantime, take a look at the following resources:

The SHAPE Project, technologies to enhance learning for young people on the Autism Spectrum
iPadSEN
KinectSEN Wiki
"Using Kinect in Special Schools for Pupils with Severe Learning Difficulties"
iGazeSEN
OPENSEN Videos



Jan 29, 2013

OpenPilot: A Next-Gen Open Source Autopilot Approach to Aerial Videography

I recently learned about OpenPilot, an open-source project that promotes the development of economical unmanned aerial vehicles, or UAVs.  

According to information on the website, "OpenPilot is an ideal platform for researchers and hobbyists working on aerial robotics or other mobile vehicular platforms where stabilization and guidance are required. OpenPilot brings the cost down to reasonable prices so people can focus on developing and refining applications rather than paying the extremely high prices of most commercial offerings, or having to do ‘from the ground up’ hardware development."

A number of OpenPilot community members have used their UAVs to explore interesting landscapes and at the same time, create engaging video clips.  Wouldn't it be fantastic to figure out how to get a 3D or 360 camera in a UAV?  

Below is an assortment of videos I came across while visiting the OpenPilot website. (I've also included some videos that were created using YellowBird 360 technology, which to my knowledge, has not been attempted with a UAV.)






OpenPilot Revolution Trailer from OpenPilot on Vimeo.

I think that the UAV concept would be great for an after-school technology club. It similar to robotics, but it also would get the kids outdoors.   It would provide a great experience for students who are also interested in photography and videography. 

RELATED
OpenPilot Website
OpenPilot Wiki
YellowBird

Here are some examples of YellowBird 360 videos: 
Interactive YellowBird 360 Video for KIA ceed

Behind the Scenes - Mont Blanc 360º shoot from yellowBird on Vimeo.





YellowBird 360 Interaction with Kinect

yellowBird 360º video player - KINECT from yellowBird on Vimeo.

Jan 14, 2012

You Know You've Secretly Wanted to Learn To Code! (Info, links, video!)

You know you've secretly wanted to learn to code. Just do it! 


"Make your New Year's resolution learning to code.Sign up on Code Year to get a new interactive programming lesson sent to you each week and you'll be building apps and web sites before you know it." -Code Year  http://codeyear.com/


BTW, coding skills are needed beyond the world of apps and websites. Take a look at some of the posts and links on this blog - your imagination just might be sparked!  If you already know how to code, why not commit to learning something new?  


COMMENT:  There is much more to coding than what you'll learn through Code Academy's Code Year process. If you are serious about learning more about coding, computer science, and software systems, take an introductory course at your local community college or university extension program,  preferably with a friend. Ask the instructor if some of the assignments can be done through the "paired programming" technique.  It is more fun and social than the traditional way of coding!


Of all the textbooks, videos, and coding/programming self-help books I've come across, the series that has made the most sense to me is the brain-friendly "Head First" publications from O'Reilly.  It explains things well for beginners. Although it contains text and code, there are many pictures, diagrams, and humorous visual representation of basic concepts that are much more engaging than traditional "learn-to-code" tomes.


It is not too late to learn to code! 
There are so many great resources available to us now, in 2012, there is no excuse to ignore your inner geek.  If some (or all) of your hair is grey, why do crossword puzzles or Sudoku when you can be creative with code?


I took my first programming class about 8 years ago, when my youngest daughter was in high school.  It was daunting at first, because the textbook was dry, the programming labs were tedious, and some of my mostly-male classmates already knew how to code.  In my case, I was motivated to learn to code because I wanted to create games at the time, and this got me over the hump.  I soon learned that coding is both a science and an art, and learning to code opens up a whole new way of thinking. (See the video of Jeanette Wing's presentation about computational thinking, at the end of this post.)


RELATED
Why your 2012 New Year's Resolution Should Be Learning to Code
Sarah J., SPOTLIGHT on Digital Media and Learning Blog 1/9/12
PLAYBACK:  Pedagogy, Coding and Teaching Kids to Think Deeply
Sarah J., SPOTLIGHT on Digital Media and Learning 1/13/12
Center for Computational Thinking
Computational Thinking (pdf) (Jeannette Wing)
Code Academy
http://codeyear.com/
Head First Labs
Coding4Fun
Coding4Fun Blog
Coding4Fun KinectToolkit
Kinect for Windows SDK
CSTA:  ACM K-12 Computer Science Model Curriculum, 2nd Edition
CS Model Curriculum, 2nd Edition (pdf)
Jeanette M. Wing's Vision: "Computational thinking will be a fundamental skill used by everyone in the world by the middle of the 21st Century"
br />

For 2012, my goal is to brush up on my previously learned coding skills and learn a few new ones related to the Kinect. I also want to become comfortable with HTML5.














May 31, 2011

Top 10 All-Time Posts on the Interactive Multimedia Technology Blog

I'm finishing up the last couple weeks of the school year, so I'll have little time to post this week.  I hope you enjoy exploring the following links!


Revised Post 8/1/06: Interactive multimedia for social skills, understanding feelings, relaxation and coping strategies


Teliris Interact TouchTable and TouchWall: Immersive Collaboration & Telepresence; DVE's Holographic Tele-Immersion Room


Games to lift stress away: Flower, flOw, (and Cloud), from thatgamecompany


Power to the Pixel Cross-Media Forum Streaming Live from London Today #PttP


HACKED KINECT MULTITOUCH using libFreenect and libTISCH (via Florian Echtler)


Link to iTV Doctor Rick Howe's post about 2D to 3D, 3D TV data points, and 3D content distributers


Temple Grandin - A gifted visual thinker, who also has autism, featured in HBO movie starring Claire Danes.  Update: Video of Claire Danes' acceptance of a Golden Globe for her performance


Algodoo physic app. for the SMART Board 800 series, supports multi-user interaction!


Wii Just Dance2 and Kinect Dance Central:  UI and Usability Approaches; Challenges for Developoing Accessible Games


Interactive Touch-Screen Technology, Participatory Design, and "Getting It" -Revisited







Apr 10, 2011

Immersive Cocoon Interaction: "It's people who are now the interface" (Updated, with videos, photos, links.)

"It's people who are now the interface." -Ole Bowman, cultural and architectural historian


I found the above quote from the Immersive Cocoon website and smiled.


When I first learned about the Immersive Cocoon in 2008, I thought it was just another technological fancy that probably would not come to market anytime soon.  Although it still is in the concept stage, I think it has a chance of making it, given the rapid advances in interactive technology over the past few years.

It wouldn't surprise me to see i-Cocoons finding a place in libraries, educational settings, museums, and other public spaces within the next 5-8 years, given an economic turnaround.


What is the Immersive Cocoon?
"The Immersive Cocoon is a future concept study by Tino Schaedler with design collective NAU; an idea to push the envelope and provoke a new conception of interface technology...Directed and 3D CG by Oliver Zeller. More info, behind the scenes and full credits at i-cocoon.com.-adNAU"


What is inside the cocoon?



Photo: arch.nau.coop

Photo: arch.nau.coop
Teaser Video:


"Please play fullscreen and LOUD! ...This spec teaser reveals an evolution in computing interaction, within a setting inspired by the penultimate scene from Stanley Kubrick's 2001: A Space Odyssey...Starring that film's lead actor, Keir Dullea; "2011" was developed over a two year period. Live action was filmed multi-camera, against green screen atop a backlit plexi floor on a shoestring budget. Mr. Dullea was then integrated into an entirely digitally created CG set rendered at 1080HD."


Here are some previous videos about the iCocoon concept:




RELATED
Immersive Cocoon Concept Website
Designers developing virtual-reality 'Cocoon'
Mark Tutton, 9/12/08, Telepresence Options /Human Productivity Lab
Immersive Cocoon-Facebook
"NAU is an international, multidisciplinary design firm, spanning the spectrum from architecture and interior design to exhibitions and interactive interfaces. As futurists creating both visual design and constructed projects, NAU melds the precision of experienced builders with the imagination and attention to detail required to create innovative exhibits, public events and architecture."
FYI:
Concerning interactive technology, things have changed a bit in my corner of the world - as I write this post, there is a Kinect beckoning me to dance in my bonus room. The Kinect was something that came to market much sooner than I expected.  I'll have an iPad2 sometime in the near future- another example of how rapidly things are evolving.   I skim the news by touch/swiping my now-outdated HTC Incredible.  My 88-year-old aunt, has used Skype more than once to "chat" with her baby great-nephew across the miles.


I use a Wii at work at least once a week to support social interaction skills with some students who have moderate-to-severe autism. Every classroom in the main school I serve has a huge, immersive, interactive whiteboard that relies on touch and kinesthetic interaction-my colleagues can't imagine going back to teaching without them.