Showing posts sorted by date for query kinect. Sort by relevance Show all posts
Showing posts sorted by date for query kinect. Sort by relevance Show all posts

May 19, 2012

Johnny Chung Lee's Recent Words of Wisdom & Google's Open-Source Ceres Non-Linear Least Squares Solver


I have been a fan of Johnny Chung Lee since 2007 or 2008, before he finished his Ph.D in Human-Computer Interaction.  Johnny went on to work at Microsoft (Kinect) and then Google, where he works as a Rapid Evaluator. 


Johnny is known for his experiments with the Wii Remote, which he introduced to the world during a TED Talk in 2008.  He continues to maintain his Procrastineering blog, and from time-to-time, uses his blog to share his take on the world of technology.  The following quote is a good example of his viewpoint, taken from his post, "Technology as a Story":


"...what saddens me is when I encounter technologists with the brilliance to create new and wonderful things, but lack a sense of what is beautiful to people. Technology is most often known for being ugly and unpleasant to use, because technologists most often build technology for other technologists.
...But to touch millions of people, you have to tell a story - a story that they can believe in, a story that can inspire them. Technology is a tool by which new stories can be crafted." - 



Today, I came across Johnny's most recent post, which asks, "So, what exactly is a "non-linear least squares solver"?  And why should you care?   Take a moment to read his post, "Ceres: solving complex problems using computing muscle".  Google just open sourced the Ceres Non-Linear Least Squares Solver.


If Johnny Chung Lee thinks that this is "probably the most interesting code library" that he's had a chance to work with, it probably has some value. 


Even if if you don't have a clue about the Ceres Non-Linear Lest Squares Solver,  you might appreciate Johnny's examples of how would it would useful. In today's rapidly-accelerating technology-supported world, you just might need it in your future!


Here are a few examples:
---Making sense of sensor data from multiple locations (see video "SLAM 1: Viewed at 6X speed")
---Figuring out the position of a camera and the objects in view (see video "Parallel Tracking and Mapping for Small AR Workspaces")
---Combining GPS data with vehicle sensors in cars. (see video "Street View Sensor Fusion with Ceres")


RELATED
Johnny Chung Lee's Website
Excerpt from a post I wrote about Johnny Chung Lee four years ago:
I wish I could be Johnny Chung Lee for a Day! 3/2/08
I've mentioned in previous posts that I am a fan of Johnny Chung Lee, a Ph.D. student in the Human-Computer Interaction department at Carnegie-Mellon University. Johnny expects to complete his Ph.D this year. Johnny recently presented his innovative work at TED 2008. 


What impresses me about Johnny is the way that he has documented his intellectual journey in a very accessible way, by using YouTube and his well-organized, appealing website. Johnny has taken interesting ideas that most would dismiss as silly or impractical, and transformed them into useful, usable applications that hold great promise for future work. 


 In my opinion, many of Johnny's "hacks" will spark ideas related to the design and development of universally designed technologies and applications that will meet the technology needs of a wider range of people. This is important, especially now that an increasing number of "connected" interactive displays and kiosks (known by the marketing industry as interactive digital signage) in public spaces.


January 2011 post:
"Hi, Google. My name is Johnny Chung Lee": Johnny Chung Lee Leaves Microsoft. (I still wish I could be Johnny Chung Lee for a day.)

Jan 14, 2012

You Know You've Secretly Wanted to Learn To Code! (Info, links, video!)

You know you've secretly wanted to learn to code. Just do it! 


"Make your New Year's resolution learning to code.Sign up on Code Year to get a new interactive programming lesson sent to you each week and you'll be building apps and web sites before you know it." -Code Year  http://codeyear.com/


BTW, coding skills are needed beyond the world of apps and websites. Take a look at some of the posts and links on this blog - your imagination just might be sparked!  If you already know how to code, why not commit to learning something new?  


COMMENT:  There is much more to coding than what you'll learn through Code Academy's Code Year process. If you are serious about learning more about coding, computer science, and software systems, take an introductory course at your local community college or university extension program,  preferably with a friend. Ask the instructor if some of the assignments can be done through the "paired programming" technique.  It is more fun and social than the traditional way of coding!


Of all the textbooks, videos, and coding/programming self-help books I've come across, the series that has made the most sense to me is the brain-friendly "Head First" publications from O'Reilly.  It explains things well for beginners. Although it contains text and code, there are many pictures, diagrams, and humorous visual representation of basic concepts that are much more engaging than traditional "learn-to-code" tomes.


It is not too late to learn to code! 
There are so many great resources available to us now, in 2012, there is no excuse to ignore your inner geek.  If some (or all) of your hair is grey, why do crossword puzzles or Sudoku when you can be creative with code?


I took my first programming class about 8 years ago, when my youngest daughter was in high school.  It was daunting at first, because the textbook was dry, the programming labs were tedious, and some of my mostly-male classmates already knew how to code.  In my case, I was motivated to learn to code because I wanted to create games at the time, and this got me over the hump.  I soon learned that coding is both a science and an art, and learning to code opens up a whole new way of thinking. (See the video of Jeanette Wing's presentation about computational thinking, at the end of this post.)


RELATED
Why your 2012 New Year's Resolution Should Be Learning to Code
Sarah J., SPOTLIGHT on Digital Media and Learning Blog 1/9/12
PLAYBACK:  Pedagogy, Coding and Teaching Kids to Think Deeply
Sarah J., SPOTLIGHT on Digital Media and Learning 1/13/12
Center for Computational Thinking
Computational Thinking (pdf) (Jeannette Wing)
Code Academy
http://codeyear.com/
Head First Labs
Coding4Fun
Coding4Fun Blog
Coding4Fun KinectToolkit
Kinect for Windows SDK
CSTA:  ACM K-12 Computer Science Model Curriculum, 2nd Edition
CS Model Curriculum, 2nd Edition (pdf)
Jeanette M. Wing's Vision: "Computational thinking will be a fundamental skill used by everyone in the world by the middle of the 21st Century"
br />

For 2012, my goal is to brush up on my previously learned coding skills and learn a few new ones related to the Kinect. I also want to become comfortable with HTML5.














Jan 3, 2012

"Kinect-based Telepresence with Room Sized 3D Capture and Life Sized Display", Includes Behind-the Scene "how-to" (UNC Chapel Hill)

Jim Spadaccini, of Open Exhibits, recently told me about a project that involves the real-time, interactive 3-D capture of people in a room.  As the viewer moves around the screens, the depth-detecting feature of the Kinect is harnessed to set the stage for a realistic telepresence experience.  


Take the time to view the video, which contains some interesting views of how the system works:





Thanks, Jim, for the link!

RELATED/SOMEWHAT RELATED
Kinect Real-Time Room Telepresence
Kinecthacks, 1/3/12
From the project's website:
Maimone, A. and H. Fuchs. "A First Look at a Telepresence System with Room-Sized Real-Time 3D Capture and Large Tracked Display." The 21st International Conference on Artificial Reality and Telexistence (ICAT) (Osaka, Japan, November 28-30, 2011) [paper] [video]
Maimone, A. and H. Fuchs. "Encumbrance-free Telepresence System with Real-time 3D Capture and Display using Commodity Depth Cameras." The IEEE International Symposium on Mixed and Augmented Reality (ISMAR) 2011 (Basel, Switzerland, October 26-29, 2011) [paper] [video]
Open Exhibits

Dec 13, 2011

Kinect in Education! (kinectEDucation)

Although I'm currently exploring the world of interactive HTML5, interactive video, etc., I think I just might make "kinecteducation" the focus of my tech-hobbies. I have some experience with game programming-one of my computer courses required a project using XNA- and I know quite a bit about gesture and multitouch, multi-user interactio, so it would'nt be too much of a stretch.


My motivation?

As a school psychologist, my main assignment is a school/program for students with disabilities, including about 40 or so who have autism spectrum disorders. Yesterday, the principal of the school attended a demonstration of the Kinect and requested that our school be considered for piloting it. One of my other assignments is a magnet high school for technology and the arts, and rumor has it that it will be offering a game programming curriculum.  I'd love to co-sponsor an after-school game club and encourage the students to program educational apps for the Kinect sometime in the near future! 


I'm also working as a client, in collaboration with come of my educator colleagues, with a team of university students who are creating a communication/social skills game suite geared for students with autism and related disabilities....


I'm inspired by the possibilities!


We have large SMARTboards in each classroom and in other locations around the building, and we have a Wii set up in the large therapy room adjacent to my office. The Wii has proven to be very useful in helping the students develop social and leisure skills that they can use in and outside of the school settings, but some of the students have difficulty manipulating the buttons on the controllers.


You can get Kinect-based apps from the Kinect Education website! Below are selected links from the website:

You can also get additional information from the Microsoft in Education "Kinect in the Classroom" website.

Below are a few videos to give you an overview of how open-source applications designed for the Kinect can be used in education: 






Dec 12, 2011

UPDATE POST: Educational Interfaces, Software, and Technology: 2012 ACM-CHI Workshop Call for Papers/Presentations

There is still time left to submit your paper!


CALL FOR PAPERS
EDUCATIONAL INTERFACES, SOFTWARE, AND TECHNOLOGY 2012
3rd Workshop on UI Technologies and Educational Pedagogy
May 5-6 2012
in conjunction with ACM-CHI 2012, Austin, Texas

This will be our third annual workshop in conjunction with CHI 2012.



One of the primary goals of teaching is to prepare learners for life in the real world. In this ever changing world of technologies such as mobile interaction, cloud computing, natural user interfaces, and gestural interfaces like the Nintendo Wii and Microsoft Kinect, people have a greater selection of tools for the task at hand. Teachers and students can leverage these tools to improve learning outcomes. Educational interfaces and software are needed to ensure that new technologies serve a clear purpose in the classrooms and homes of the future.



Since teachers are always looking for creative ways to engage 21st century learners, there needs to be an academic venue for researchers to discuss novel educational tools and their role in improving learning outcomes. This workshop aims at filling this void: combining the pedagogical expertise of the cooperative learning, and learning sciences communities with the technical creativity of the CHI, UIST and interactive surface communities. The objective of this workshop is to become a conference within two years


We invite authors to present position papers about potential design challenges and perspectives on how the community should handle the next generation of HCI in education. 




Topics of interest include:

  • Gestural input, multitouch, large displays
  • Mobile Devices, response systems (clickers)
  • Tangible, VR, AR & MR, Multimodal interfaces
  • Console gaming, 3D input devices
  • Co-located interaction, presentations
  • Educational Pedagogy, learner-centric, Child Computer Interaction
  • Empirical methods, case studies
  • Multi-display interaction
  • Wearable educational media
Submission:  The deadline for workshop paper submissions is Dec 20, 2011. Interested researchers should submit a 4-page position paper in the ACM CHI adjunct proceedings style to the workshop management system. Acceptance notifications will be sent out February 20, 2012. The workshop will be held May 5-6, 2012 in Austin, Texas. Please note that at least one author of an accepted position paper must register for the workshop and for one or more days of the CHI 2012 conference.

Website: http://smarttech.com/eist2012
Contact: Edward Tse, SMART Technologies, edwardtse@smarttech.com


RELATED
Educational Interfaces, Software, and Technology Workshop Organizers
Edward Tse, SMART Technologies 
Lynn V. Marentette, Union County Public Schools
 Syed Ishtiaque Ahmed, Cornell University
 Alex Thayer, University of Washington
 Jochen Huber, Technische Universität Darmstadt

 Max Mühlhäuser, Technische Universität Darmstadt
 Si Jung “Jun” Kim, University of Central Florida

 Quincy Brown, Bowie State University

Oct 11, 2011

Hacking Autism: Touch Technology for Young People with Autism Spectrum Disorders (October 11 is the Hackathon!)

October 11, 2011 is a special day. A number of software programmers will be working to develop "innovative, touch-enabled applications for the autism cimmunity and make this software available for free on HackingAutism.org." Take a moment to watch the following video clip, and then explore the Hacking Autism website!
"When touch-enabled computing was introduced to the world, no one could have anticipated that this technology might help open up a new world of communication, learning and social possibilities for autistic children. Yet it has. Hacking Autism is a story of technology and hope and the difference it's making in the lives of some people who need it most.Hacking Autism doesn't seek to cure autism, but rather it aims to facilitate and accelerate technology-based ideas to help give those with autism a voice." -hackingautism.org
Touch technology + people with autism spectrum disorders = 
One of the reasons why I returned to school to take computer courses and explore natural user interfaces and interaction.   

RELATED
Interacting with HP TouchSmart Notes: Photo, Video, Audio and More
Interactive Visual Supports for Children with Autism:  Gillian Hayes' Work at the Social and Technology Action Research Group
Open Source Multi-touch Software for Young People with Autism
Interactive iPad Apps for Kids with Autism: Could some of these be transformed for multi-touch tabletop activities?
iPad Apps: Supporting Communication for Young People with Autism (links to Moms with Apps)
Reflections about interactivity in my present world (Aug. 2010)
Interactive Multi-touch for Children with Autism Spectrum Disorders: Research and Apps by Juan Paplo Hourcade, Thomas Hanson, and Natasha Bullock-Rest, University of Iowa
Open Autism Software "Where Social Skills and Interest in Computers Meet"
Sen H. Hirano, Michael T. Yeganyan, Gabriela Marcu, David H. Nguyen, Lou Anne Boyd, Gillian R. Hayes vSked: Evaluation of a System to Support Classroom Activities for Children with Autism. In CHI 2010 (Atlanta, GA, 2010).(pdf) Gillian R. Hayes, Sen Hirano, Gabriela 
Marcu, Mohamad Monibi, David H. Nguyen, and Michael Yeganyan. Interactive Visual Supports for Children with Autism. Personal and Ubiquitous Computing. April 2010. 
Monibi, M., Hayes, G.R. Mocotos: Mobile Communication Tools for Children with Special Needs. Proceedings of Interaction Design and Children, pages 121-124 ACM, 2008 
SOMEWHAT RELATED
Hope Technology School
Do2Learn JobTips
Autism Research Group at Georgia Tech
Immersive Cocoon Interaction"  "It's people who are now the interface"
Today I hooked up a Will to the IWB in the school's therapy room.  Next, a Kinect? 
(IWBs + Games + Social Skills)

Jul 27, 2011

Apple's iOS 5 facial recognition feature opens up interactive possibilities

I've been thinking about creating my first iPad app, and as I was searching for information, I came across a few articles related to Apple's new iOS 5 that I found interesting.  


Because my target user group includes young people with autism spectrum disorders (ASD),  I was intrigued by the possibility that the facial recognition APIs might provide a means of assessing mood or emotional states.   Most of us understand that our faces function as mirrors to feelings, and we use our facial expressions to communicate our feelings to others.  Unfortunately, this is a concept that is difficult for young people with ASD to understand.  My hunch is that there is an "app for that".   


I'd love to great to create a little iPad app for young people with ASD for education, intervention, and/or communication activities that incorporates the facial recognition feature!


Apple's iOS facial recognition could lead to Kinect-like interaction
Darrell Etherington, GigaOm/Reuters, 7/27/11
Here is a quote from the above article:
"You could create apps that track a user’s eye movement and dynamically change content accordingly, for instance. App developers might even be able to use data gathered from facial recognition APIs to identify so-called “hotspots,” providing insight about where a user is looking most within an app and arranging content accordingly. In time, an iPhone app might even be able to assess the emotional state of the user, based on whether they’re frowning or smiling, and address the user in a manner appropriate to their mood. It might also be able to tell how engaged users are with mobile ads and content, which might be useful for iAd customers, among others."


Stan Schroeder, Mashable, 7/26/11
Below is a video from from the above post which demonstrates an app developed by Polar Rose, a company that was purchased by Apple.
RELATED
Apple plans native panorama functionality in iOS5
Seth Weintraub, 9TO5Mac, 7/8/11
iOS 5's final release may include "Assistant" speech-to-text feature
Chris Rawson, TUAW, 7/23/11

Jul 24, 2011

Video: Kinect SoundWall, links to info and code!





Here is information about the project from the KinetHacks SoundWall site:

"Kinect sound machines become prettier and easier with each development! The Kinect SoundWall is a drum beat music machine controlled by gestures and voice commands. This video by  displays this digital music machine at work and how through various gesture and voice commands, users can create awesome beats to dance to. In the video, the user gestures to to certain blocks in the screen in order to create a beat there or render the beats void. Through various voice commands, the beat can start, increase tempo, stop etc. Through the proper integration of both voice and gesture commands, the Kinect SoundWall sets the standard for a great and efficient sound machine of the Kinect!"
"For more information about the Kinect SoundWall visit the project’s website."
RELATED
Vertigo SoundWall CodePlex Project Site

Jul 18, 2011

Emerging Interactive Multimedia, New Models of HCI for Museum Exhibits (Course offered by Ideum's Jim Spadaccini, plus info about the MT55 multi-touch table)

Jim Spadaccini, the director and founder of Ideumwill be teaching a course on exhibit development through the University of Victoria, "Emerging Exhibits: Exploring New Models of Human Computer Interaction (HCI).  The excerpt from the course description provides a glimpse of how emerging technologies are beginning to change the museum experience:


"Computer-based interactive exhibits are undergoing a major transformation. The lone, single-user kiosk is now being replaced by multitouch tables and walls, motion-capture spaces, networked installations, and RFID-based exhibits. Advances in augmented reality, voice recognition, eye tracking, and other technologies promise even more radical change for exhibits in the near future."


I've been following Jim's journey with Ideum, a multimedia design firm that collaborates with museums and related non-profits, for many years, and I am impressed with the work of this company.  In addition to his work at Ideum,  Jim serves as the Principal Investigator of a National-Science Foundation sponsored open-source exhibit software project, Open Exhibits, which provides a free software development kit that supports the creation of multi-touch and multi-user software applications for museums and educational settings.


I'm happy to put in a plug for Ideum's latest product, the MT55 Platform Multi-Touch Table. It incorporates a range of features that I'm sure will meet the needs of museum visitors.  In my opinion, this table would be a fantastic resource for all types of libraries, including those in K-12 settings.

The MT55 Platform Multi-touch Table, from Ideum

The MT55 Platform Multitouch Table from Ideum on Vimeo.  (Note: This video features music by Moby, the track "Sevastopol" on his current album, Destroyed. The music was used with the artists' permission. Learn more at: moby.com") - Ideum

"The thinnest, largest, most powerful multitouch table available.The MT55 Platform multitouch table houses a powerful computer and a 55-inch interactive LCD display that responds to 32 touch-points, inside a rugged aluminum body."

"The bright 55″ 1920×1080 HD display has a 5,000,000:1 contrast ratio. A wide 178-degree viewing angle accommodates multiple users around the table. The optical multitouch system supports 32 simultaneous touch points for collaborative interaction. The system is multitouch-enabled from start-up, and runs Windows 7 64-bit professional edition."


"The integrated computer is packed with power. It contains an Intel® Hyper-Threaded DualCore i5® which runs at 2.66 GHz, 8GB of RAM, and a 128 GB solid-state drive (upgradeable to an i7®)."


"The table comes complete with WIFI, Bluetooth, and Ethernet connectivity. It also has multiple HDMI outputs that allow you to easily mirror the table's display, extend the desktop, or connect to and display from another computer or HDMI device."

"Convenient, but secure ports: CAT5, HDMI, and USB 2.0 are available on both the side on bottom the table."

"The MT55 Platform includes blue LED under-lights to illuminate the area beneath the interactive surface (custom LED colors are available). Every MT table includes a sophisticated internal cooling cell to maintain operating conditions that exceed the optimum environmental specifications for the internal components."

"The interactive surface of the MT55 Platform protected by a sheet of hardened, crystal clear, low-iron 5mm tempered glass surface...
As an option, we offer Sevasa HapticGlas®, produced exclusively for Ideum. Micro-etched HapticGlas® provides tactile feedback, reduces fingerprints, increases scratch resistance, and directs user focus." -Ideum
 

RELATED
High-res photos of the MT55 Platform

GestureWorks Software
Open Exhibits
Ideum
Open Exhibits Tuio Kinect

Jul 12, 2011

Summer Break: Music Apps, Multimedia, Kinect, My New iPad2, Tech-reading, Google+, Dancing...

I'm on summer break, which for me, means that I spend an increased amount playing/creating music and doing all of the other fun stuff I don't have much time for during the school year. I'm still exploring what I can do with my new iPad2 - there are so many music apps!  My favorite at this moment is Garage Band. It keeps me engaged for hours, and I can take it with me anywhere I go.  I'm also exploring iPad apps for education and students with special needs, since many of the young people I work with have autism spectrum disorders.  They all really love music.


Today, I came across turntable.fm, a "social-djing" website, from a link shared by Dimitri Diakopoulos.  I think it would be fun to play with.




















Turntable.FM, The Fastest-Growing Music Service You're Not Using
William Fenton, PC Magazine, 6/23/11
Social DJing with Turntable.FM
Andrew Mager, 5/28/11


I'm still plowing through technology journals and zines from previous months - I had to skip over my stack to read the cover article of the most recent Communications of the ACM:
Michael Edwards, University of Edinburgh, 2011


I LOVE the design of this cover. It would make for a nice interactive interface for an iPad music app. Or a larger touch-screen display. Or even a SMARTBoard! (BTW, My first computer-related course was Computer Music Technology, in 2003. My undergraduate honors research (psychology), years ago, focused on constructive cognition and music recognition/memory. This topic is dear to my heart.)

I've spent some quality time with my first grand-baby this summer.  Although his "screen time" is limited, given his age of 7 1/2 months, he enjoys playing with music on my iPad.  He likes the drums found in the iPad GarageBand application.  Here he is playing with NodeBeat, an app created by Seth Sandler and Justin Windle:













Most of his time is spent off-screen:





Over the last few months, there has been a surge of interactive touch-enabled apps for education, including some for young people with special needs.  This will be the topic of a few of my future posts.

Jun 17, 2011

In case you missed this: Microsoft Releases Kinect SDK Beta for PC

Kinect for Windows SDK Beta!   IT IS TRUE!!!!!


My Kinect and PC are waiting for my summer project.    What a great opportunity to "practice" programming over my 5 week summer break..... I already know C#, and I've done a little game programming (ie. AI for Game Development - using XNA Game Studio Express- it has been a while).  
Skeleton tracking image
-Photo credit: Microsoft Research


I have some cool ideas for basic games that might be good for the students I work with who have autism spectrum disorders... and some ideas that might be fun for my grand-baby.  I can't wait to have time to code again!   


Here's some info from the Microsoft Kinect for Windows SDK Beta website:


"The Kinect for Windows SDK beta is a programming toolkit for application developers. It enables the academic and enthusiast communities easy access to the capabilities offered by the Microsoft Kinect device connected to computers running the Windows 7 operating system."


"The Kinect for Windows SDK beta includes drivers, rich APIs for raw sensor streams and human motion tracking, installation documents, and resource materials. It provides Kinect capabilities to developers who build applications with C++, C#, or Visual Basic by using Microsoft Visual Studio 2010."


This SDK includes the following features:


Raw sensor streams
Access to raw data streams from the depth sensor, color camera sensor, and four-element microphone array enables developers to build upon the low-level streams that are generated by the Kinect sensor.
Skeletal tracking
The capability to track the skeleton image of one or two people moving within the Kinect field of view make it easy to create gesture-driven applications.
Advanced audio capabilities
Audio processing capabilities include sophisticated acoustic noise suppression and echo cancellation, beam formation to identify the current sound source, and integration with the Windows speech recognition API.
Sample code and documentation
The SDK includes more than 100 pages of technical documentation. In addition to built-in help files, the documentation includes detailed walkthroughs for most samples provided with the SDK.
Easy installation
The SDK installs quickly, requires no complex configuration, and the complete installer size is less than 100 MB. Developers can get up and running in just a few minutes with a standard standalone Kinect sensor unit (widely available at retail outlets)."



Nicholas Kolakowski, Application Development News, 6/16/11


May 31, 2011

Top 10 All-Time Posts on the Interactive Multimedia Technology Blog

I'm finishing up the last couple weeks of the school year, so I'll have little time to post this week.  I hope you enjoy exploring the following links!


Revised Post 8/1/06: Interactive multimedia for social skills, understanding feelings, relaxation and coping strategies


Teliris Interact TouchTable and TouchWall: Immersive Collaboration & Telepresence; DVE's Holographic Tele-Immersion Room


Games to lift stress away: Flower, flOw, (and Cloud), from thatgamecompany


Power to the Pixel Cross-Media Forum Streaming Live from London Today #PttP


HACKED KINECT MULTITOUCH using libFreenect and libTISCH (via Florian Echtler)


Link to iTV Doctor Rick Howe's post about 2D to 3D, 3D TV data points, and 3D content distributers


Temple Grandin - A gifted visual thinker, who also has autism, featured in HBO movie starring Claire Danes.  Update: Video of Claire Danes' acceptance of a Golden Globe for her performance


Algodoo physic app. for the SMART Board 800 series, supports multi-user interaction!


Wii Just Dance2 and Kinect Dance Central:  UI and Usability Approaches; Challenges for Developoing Accessible Games


Interactive Touch-Screen Technology, Participatory Design, and "Getting It" -Revisited







Apr 26, 2011

Multi-touch and Gesture Interaction News and Updates You Might Have Missed (Part I)

Over the past couple of months, I've come across many interesting links related to multi-touch and gesture interaction, but I haven't had time to devote a thoughtful post to each one.  "Part I",  is a nice collection of experimental, commercial, and non-commercial efforts by a variety of creative technologists, with a smattering of industry news that might be of interest to IMT readers. 


Ideum's MT55 HD Multitouch Table 4/19/11

New MT55 HD Multitouch Table Now Shipping,  Jim Spadaccini, Ideum Blog 4/11/11

Smithsonian American Art Museum to Open Education Center  Sara Beladi, NBC Washington News, 4/4/11 (Rumor has it that the Smithsonian American Art might include touch and multi-touch displays in it's plans for a new education center.  The center was funded by an anonymous $8 million dollar gift.)

Bill Buxton, Microsoft Research, 4/7/11 - Includes lots of pictures, links to videos, and more information of what might be the first touch-screen.  Also see Bill Buxton's companion website, Multi-Touch Systems that I have Known and Loved, updated on 3/21/11.  Bill Buxton knows all (almost!)


"The MTbiggie uses the "Front Diffused Illumination" multitouch technique, with ambient infrared light and a DIY infrared webcam. The MTbiggie is similar to the MTmini, but includes a projected image and infrared webcam (rather than a normal webcam)...The MTbiggie isn’t the most stable and robust setup, but it is the easiest to build. To see other methods of building more stable multitouch displays, view the full multitouch display list." -Seth Sandler

(Also check out NodeBeat, a multi-touch music/audio sequencer/generator app by Seth Sandler and Justin Windle)

Intuilab, 4/13/11
"IntuiLab, a global leader in surface computing software applications, today announced support for the revolutionary Microsoft Kinect device across its full line of IntuiFace products and solutions including IntuiFace Presentation and IntuiFace Commerce...Microsoft Kinect brings distant gesture control to interactive solutions. These gesture controls allow users to interact with displayed digital assets from a distance at their own pace and path – for example, browsing through a large quantity of products in a store catalog or manipulating 3D models (such as a mobile phone) – all without having to actually touch the screen..."  -IntuiLab (Take a look at the IntuiLab team- an interactive page!)




Sparkon:  Videos and links related to multi-touch and gesture-based applications



Official Kinect SDK to be Open SourceJosh Blake, Deconstructing the NUI, 4/18/11  
9 This bit of news excited me, but don't get your hopes up. If anyone knows what will happen with the Kinect SDK, please leave a comment.)
"Update 4/18 7:34pm: Mary Jo Foley picks up this story, but the Microsoft spokesperson she talked to denied that the Kinect SDK will be open source. As she notes, Microsoft has pulled 180’s before regarding Kinect. After spokespeople initially were hostile to the idea of Kinect hacking, Xbox executives later embraced the idea that people are using Kinect for non-gaming purposes on the PC. Let’s hope Microsoft stays open to this idea." -Josh Blake

Kenrick Kin, Tom Miller, Bjoern Bollensdorff, Tony DeRose, Bjoern Hartmann, Manees Agrawala (Pixar Online Library)

Flight Race Game on 3DFeel lm3Labs, 4/18/11


JazzMutant Lemure Version 2 : "The only multi-touch and modular controller for sequencers, synthesizers, virtual instruments, vjing and lights, now even better."


Harry van der Veen's Multitouch Blog (NUITEQ)


Stantum "Unlimited Multi-Touch" Latest News

At Immersive Labs, Ads Watch Who Looks at Them Amy Lee, Huffington Post, 4/26/11 

Immersive Labs

Hard Rock Cafe International Using NextWindow Touch Screens:  "Rock Wall Solo displays enhance music lovers' experience in Seattle, Dallas, Detroit and Berlin" 4/12/11 (Full press release pdf)
Music on Touch Screens (NextWindow)

Razorfish: Thoughts on MIX 11 ,James Ashley, Razorfish Blog, 4/20/11  Also see: Razorfish Lab's Prototypes




"The multitouch microscope brings new dimensions into teaching and research. Researchers at the Institute for Molecular Medicine Finland (FIMM) and Multitouch Ltd have created a hand and finger gesture controlled microscope. The method is a combination between two technologies: web-based virtual microscopy and a giant size multitouch display."
"The result is an entirely new way of performing microscopy: by touching a table- or wall-sized screen the user can navigate and zoom within a microscope sample in the same way as in a conventional microscope. Using the touch control it is possible to move from the natural size of the sample to a 1000-fold magnification, at which cells and even subcellular details can be seen."  -Multitouchfi  Also see the Multitouch website.



Big Size Multitouch Display Turned into a MicroscopeMicroscopy-News, 3/28/11
Mac OX 10.7 Lion: new multi-touch gestures, Dock integration for Expose, Launchpad, Mission Control Appleinsider, 4/14/11


Vectorform App featured in Royal Caribbean's Video Promotion: James Brolin, Dean Cain get hands-on with Vectorform app Alison Weber, Vectorform Blog, 3/3/11


3M Touch Systems's YouTube Channel

Social Mirror 3D Gestural Display, Now Using Kinnect:  SnibbeInteractive