Ron George, an interaction designer, recently posted a comment on my blog. So I visited his blog and found that he has a great set of resources that many of my readers would appreciate!
For starters, take a look at Ron's Interaction Design Toolbox page, and then spend some time browsing around the rest of his site/blog.
Ron works at Microsoft on a team that is exploring Natural User Interface/Interaction (NUI). He previously was on the Surface team.
Focused on interactive multimedia and emerging technologies to enhance the lives of people as they collaborate, create, learn, work, and play.
Showing posts sorted by relevance for query "natural user interaction". Sort by date Show all posts
Showing posts sorted by relevance for query "natural user interaction". Sort by date Show all posts
Aug 28, 2009
Oct 13, 2013
UPDATE: NUITEQ's Snowflake ABC has been updated, improved, and retitled-- Snowflake MultiTeach®
August 24, 2016 Update
This post was originally published on October 13, 2013, and focused on Snowflake ABC, a software suite of entertaining educational apps developed by NUITEQ®.
Fast forward to 2016, and you'll see many great improvements have been made by the NUITEQ® team. Along with the changes came a new name, Snowflake MultiTeach®.
Snowflake MultiTeach® was designed for multi-touch, multi-user displays and tables, but can be used on single-touch displays or traditional computers/laptops with a mouse. It works well for "front-of-class" presentations and has many features that support collaborative group work.

So what is new?
The Lessons app was added to the suite of applications, along with Nodes, a concept-mapping and presentation application that supports project and problem based learning, STEM, and STEAM.
The Lessons app is a powerful addition to Snowflake MultiTeach®. Within this app, teachers (and students) can build a variety of interactive, engaging lessons, learning games, and quizzes, with little effort.
Snowflake MultiTeach® can support several lessons and apps running at the same time, using the Zones feature, which makes it ideal for students working in pairs or small groups.
To compliment the Lessons app, the online MultiTeach® Lessons Community was developed to provide a way for teachers to share lessons they've created. The lessons posted on the MultiTeach® Lessons Community can be accessed from within the Lessons home screen. Lessons can be searched by subject and level and imported directly into the Lessons home screen.
Lessons created with Snowflake MultiTeach® can be exported directly from the Lessons home screen to the MultiTeach® Lessons Community so they can be shared with others. Snowflake MultiTeach® and sign-up to the MultiTeach® Lessons Community is required for access.
To support teachers as they make the transition from single-touch whiteboards to multi-user displays, the MultiTeach® Pinterest site was created. There you can find curated and regularly updated information about how to use Snowflake MultiTeach®, 21st century teaching and learning, free digital resources for the classroom, and much more.
For information about how teachers can integrate Snowflake MultiTeach® into their classrooms, take some time to read the following blog posts. Share with your peers!
Infuse Arts into STEM Projects Using Collaborative Touch Screen Technology
Collaborative STEM Education and Careers Exploration
How to MultiTeach®: Introduction to Snowflake MultiTeach® Nodes App
Differentiated instruction through Snowflake MultiTeach®
Like what you see?
If you are interested in replacing your current single-touch interactive whiteboard with a multi-touch display, contact a representative from NUITEQ® by following the email link on the website, and you will be connected to someone in your region who can assist you.
Here is the old post for reference.
FYI: Most of the ABC apps shown below can be found within the current version of Snowflake MultiTeach®.
NUITEQ is a multi-touch & gesture tech company based in Sweden focused on collaborative natural user interfaces and interaction. Instead of using a traditional mouse and keyboard, NUITEQ's products support the effective use of fingers and hands to interact and explore digital content. I've been following this company since it was launched by Harry van der Veen in 2007 and have been happy to share NUITEQ's updates on this blog over the years.
NUITEQ's products can be found in public spaces, such as museums, retail centers, and transportation hubs, at special events, such as trade shows and exhibitions, in collaborative work settings, such as board rooms and design studios, and in educational settings.
One of the latest innovations from NUITEQ is Snowflake ABC, multi-touch software for children and teens. It runs on a range of multi-touch hardware surfaces, including Lenovo, 3M Touch Systems, Zytronic, Flatfrog, PQ Labs, Touch International, Lumio, and others.
Multitouch software Snowflake ABC for kids (K-12) from multitouch software on Vimeo.
In my opinion, Snowflake ABC would be great for use in homes, libraries, and classrooms. Although the video shows children using the software on large displays and tables, it works well on smaller 27-inch touch screens, preferably those that support multi-touch interaction. A free trial version is available. For parents considering purchasing a home computer, the Lenovo IdeaCenter A520 and other multi-touch "all-in-ones" come loaded with a variety of Snowflake apps.
Below is a screen shot various Snowflake ABC educational apps, from the Snowflake Suite website.
RELATED
Multi-touch software Snowflake ABC 1.3 for kids released (K-13) - Now with 18 languages out of the box! NUITEQ Blog, 9/26/13
Snowflake ABC Brochure (pdf)
NUITEQ Signs OEM Agreement with Lenovo for its Multitouch Software Platform Snowflake Suite PRWEB, 8/31/12
Review: Lenova IdeaCentre A520
Jason Palaszewski, 8/22/13, Lenovo Blog
Snowflake Interactive Display at Skellefteå Airport (Snowflake Suite)
This post was originally published on October 13, 2013, and focused on Snowflake ABC, a software suite of entertaining educational apps developed by NUITEQ®.
Fast forward to 2016, and you'll see many great improvements have been made by the NUITEQ® team. Along with the changes came a new name, Snowflake MultiTeach®.
Snowflake MultiTeach® was designed for multi-touch, multi-user displays and tables, but can be used on single-touch displays or traditional computers/laptops with a mouse. It works well for "front-of-class" presentations and has many features that support collaborative group work.

So what is new?
The Lessons app was added to the suite of applications, along with Nodes, a concept-mapping and presentation application that supports project and problem based learning, STEM, and STEAM.
The Lessons app is a powerful addition to Snowflake MultiTeach®. Within this app, teachers (and students) can build a variety of interactive, engaging lessons, learning games, and quizzes, with little effort.
Snowflake MultiTeach® can support several lessons and apps running at the same time, using the Zones feature, which makes it ideal for students working in pairs or small groups.
To compliment the Lessons app, the online MultiTeach® Lessons Community was developed to provide a way for teachers to share lessons they've created. The lessons posted on the MultiTeach® Lessons Community can be accessed from within the Lessons home screen. Lessons can be searched by subject and level and imported directly into the Lessons home screen.
Lessons created with Snowflake MultiTeach® can be exported directly from the Lessons home screen to the MultiTeach® Lessons Community so they can be shared with others. Snowflake MultiTeach® and sign-up to the MultiTeach® Lessons Community is required for access.
To support teachers as they make the transition from single-touch whiteboards to multi-user displays, the MultiTeach® Pinterest site was created. There you can find curated and regularly updated information about how to use Snowflake MultiTeach®, 21st century teaching and learning, free digital resources for the classroom, and much more.
For information about how teachers can integrate Snowflake MultiTeach® into their classrooms, take some time to read the following blog posts. Share with your peers!
Infuse Arts into STEM Projects Using Collaborative Touch Screen Technology
Collaborative STEM Education and Careers Exploration
How to MultiTeach®: Introduction to Snowflake MultiTeach® Nodes App
Differentiated instruction through Snowflake MultiTeach®
Like what you see?
If you are interested in replacing your current single-touch interactive whiteboard with a multi-touch display, contact a representative from NUITEQ® by following the email link on the website, and you will be connected to someone in your region who can assist you.
Here is the old post for reference.
FYI: Most of the ABC apps shown below can be found within the current version of Snowflake MultiTeach®.
NUITEQ is a multi-touch & gesture tech company based in Sweden focused on collaborative natural user interfaces and interaction. Instead of using a traditional mouse and keyboard, NUITEQ's products support the effective use of fingers and hands to interact and explore digital content. I've been following this company since it was launched by Harry van der Veen in 2007 and have been happy to share NUITEQ's updates on this blog over the years.
NUITEQ's products can be found in public spaces, such as museums, retail centers, and transportation hubs, at special events, such as trade shows and exhibitions, in collaborative work settings, such as board rooms and design studios, and in educational settings.
One of the latest innovations from NUITEQ is Snowflake ABC, multi-touch software for children and teens. It runs on a range of multi-touch hardware surfaces, including Lenovo, 3M Touch Systems, Zytronic, Flatfrog, PQ Labs, Touch International, Lumio, and others.
Multitouch software Snowflake ABC for kids (K-12) from multitouch software on Vimeo.
In my opinion, Snowflake ABC would be great for use in homes, libraries, and classrooms. Although the video shows children using the software on large displays and tables, it works well on smaller 27-inch touch screens, preferably those that support multi-touch interaction. A free trial version is available. For parents considering purchasing a home computer, the Lenovo IdeaCenter A520 and other multi-touch "all-in-ones" come loaded with a variety of Snowflake apps.
Below is a screen shot various Snowflake ABC educational apps, from the Snowflake Suite website.
| Credit: NUITEQ |
RELATED
Multi-touch software Snowflake ABC 1.3 for kids released (K-13) - Now with 18 languages out of the box! NUITEQ Blog, 9/26/13
Snowflake ABC Brochure (pdf)
NUITEQ Signs OEM Agreement with Lenovo for its Multitouch Software Platform Snowflake Suite PRWEB, 8/31/12
Review: Lenova IdeaCentre A520
Jason Palaszewski, 8/22/13, Lenovo Blog
Snowflake Interactive Display at Skellefteå Airport (Snowflake Suite)
Posted by
Lynn Marentette
Jan 10, 2013
Gesture Markup Language (GML) for Natural User Interaction and Interfaces
Quick post:
Photo credit: Ideum
RELATED
Ideum Blog
OpenExhibits Free multitouch and multiuser software initiative for museums, education, nonprofits, and students
GestureWorks Multi-touch authoring for Windows 8 & Windows 7
Ideum's GestureWorks Platform Will Let Developers Create Complex Gestures for Ultrabook Apps -Alex Williams, Tech Crunch, 11/18/12
5 Perspectives On The Future Of The Human Interface -Alex Williams, Tech Crunch, 11/4/12
NUI Group
More to come!
"GML is an extensible markup language used to define gestures that describe interactive object behavior and the relationships between objects in an application. Gesture Markup Language has been designed to enhance the development of multiuser multi-touch and other HCI device driven applications." -Gesture ML Wiki
GestureML was created and maintained by Ideum.
More information to come!

Photo credit: Ideum
RELATED
Ideum Blog
OpenExhibits Free multitouch and multiuser software initiative for museums, education, nonprofits, and students
GestureWorks Multi-touch authoring for Windows 8 & Windows 7
Ideum's GestureWorks Platform Will Let Developers Create Complex Gestures for Ultrabook Apps -Alex Williams, Tech Crunch, 11/18/12
5 Perspectives On The Future Of The Human Interface -Alex Williams, Tech Crunch, 11/4/12
NUI Group
More to come!
Posted by
Lynn Marentette
Mar 1, 2012
Seamless Collaborative Computing Between Tables and Tablets: nSquared Presenter -Video
I came across the following video about nsquare's presenter application. It looks like it has potential. It supports "seamless" collaboration between people, multimedia content, interactive tables, interactive touch screens, and tablet devices.
RELATED
nsquared website
Video presentation about "Seamless Computing", by Neil Roodyn
More blog posts on the topic of natural user interaction, interfaces, and examples of seamless computing are planned for the future!
This was shared by one of my FB friends.
RELATED
nsquared website
Video presentation about "Seamless Computing", by Neil Roodyn
More blog posts on the topic of natural user interaction, interfaces, and examples of seamless computing are planned for the future!
This was shared by one of my FB friends.
Posted by
Lynn Marentette
Oct 11, 2011
Hacking Autism: Touch Technology for Young People with Autism Spectrum Disorders (October 11 is the Hackathon!)
October 11, 2011 is a special day. A number of software programmers will be working to develop "innovative, touch-enabled applications for the autism cimmunity and make this software available for free on HackingAutism.org." Take a moment to watch the following video clip, and then explore the Hacking Autism website!
"When touch-enabled computing was introduced to the world, no one could have anticipated that this technology might help open up a new world of communication, learning and social possibilities for autistic children. Yet it has. Hacking Autism is a story of technology and hope and the difference it's making in the lives of some people who need it most.Hacking Autism doesn't seek to cure autism, but rather it aims to facilitate and accelerate technology-based ideas to help give those with autism a voice." -hackingautism.org
Touch technology + people with autism spectrum disorders =
One of the reasons why I returned to school to take computer courses and explore natural user interfaces and interaction.
RELATED
Interacting with HP TouchSmart Notes: Photo, Video, Audio and More
Interactive Visual Supports for Children with Autism: Gillian Hayes' Work at the Social and Technology Action Research Group
Open Source Multi-touch Software for Young People with Autism
Interactive iPad Apps for Kids with Autism: Could some of these be transformed for multi-touch tabletop activities?
iPad Apps: Supporting Communication for Young People with Autism (links to Moms with Apps)
Reflections about interactivity in my present world (Aug. 2010)
Interactive Multi-touch for Children with Autism Spectrum Disorders: Research and Apps by Juan Paplo Hourcade, Thomas Hanson, and Natasha Bullock-Rest, University of Iowa
Open Autism Software "Where Social Skills and Interest in Computers Meet"
Sen H. Hirano, Michael T. Yeganyan, Gabriela Marcu, David H. Nguyen, Lou Anne Boyd, Gillian R. Hayes vSked: Evaluation of a System to Support Classroom Activities for Children with Autism. In CHI 2010 (Atlanta, GA, 2010).(pdf) Gillian R. Hayes, Sen Hirano, Gabriela
Marcu, Mohamad Monibi, David H. Nguyen, and Michael Yeganyan. Interactive Visual Supports for Children with Autism. Personal and Ubiquitous Computing. April 2010.
Monibi, M., Hayes, G.R. Mocotos: Mobile Communication Tools for Children with Special Needs. Proceedings of Interaction Design and Children, pages 121-124 ACM, 2008
SOMEWHAT RELATED
Hope Technology School
Do2Learn JobTips
Autism Research Group at Georgia Tech
Immersive Cocoon Interaction" "It's people who are now the interface"
Today I hooked up a Will to the IWB in the school's therapy room. Next, a Kinect?
(IWBs + Games + Social Skills)
"When touch-enabled computing was introduced to the world, no one could have anticipated that this technology might help open up a new world of communication, learning and social possibilities for autistic children. Yet it has. Hacking Autism is a story of technology and hope and the difference it's making in the lives of some people who need it most.Hacking Autism doesn't seek to cure autism, but rather it aims to facilitate and accelerate technology-based ideas to help give those with autism a voice." -hackingautism.org
Touch technology + people with autism spectrum disorders =
One of the reasons why I returned to school to take computer courses and explore natural user interfaces and interaction.
RELATED
Interacting with HP TouchSmart Notes: Photo, Video, Audio and More
Interactive Visual Supports for Children with Autism: Gillian Hayes' Work at the Social and Technology Action Research Group
Open Source Multi-touch Software for Young People with Autism
Interactive iPad Apps for Kids with Autism: Could some of these be transformed for multi-touch tabletop activities?
iPad Apps: Supporting Communication for Young People with Autism (links to Moms with Apps)
Reflections about interactivity in my present world (Aug. 2010)
Interactive Multi-touch for Children with Autism Spectrum Disorders: Research and Apps by Juan Paplo Hourcade, Thomas Hanson, and Natasha Bullock-Rest, University of Iowa
Open Autism Software "Where Social Skills and Interest in Computers Meet"
Sen H. Hirano, Michael T. Yeganyan, Gabriela Marcu, David H. Nguyen, Lou Anne Boyd, Gillian R. Hayes vSked: Evaluation of a System to Support Classroom Activities for Children with Autism. In CHI 2010 (Atlanta, GA, 2010).(pdf) Gillian R. Hayes, Sen Hirano, Gabriela
Marcu, Mohamad Monibi, David H. Nguyen, and Michael Yeganyan. Interactive Visual Supports for Children with Autism. Personal and Ubiquitous Computing. April 2010.
Monibi, M., Hayes, G.R. Mocotos: Mobile Communication Tools for Children with Special Needs. Proceedings of Interaction Design and Children, pages 121-124 ACM, 2008
SOMEWHAT RELATED
Hope Technology School
Do2Learn JobTips
Autism Research Group at Georgia Tech
Immersive Cocoon Interaction" "It's people who are now the interface"
Today I hooked up a Will to the IWB in the school's therapy room. Next, a Kinect?
(IWBs + Games + Social Skills)
Posted by
Lynn Marentette
Labels:
ASD,
asperger,
assistive,
autism,
hackathon,
hacking autism,
hackingautism.org,
HP,
interactive,
multimedia,
multitouch,
technology,
touch
No comments:
May 18, 2011
CHI 2011, Bill Buxton, and the Buxton Collection: Explore 35 years of interactive devices, online!
Bill Buxton is a researcher at Microsoft who focuses on Human-Computer Interaction and is known for his work in user experience design and natural user interfaces such as multi-touch surfaces. His talk at the recent CHI 2011 conference, held in Vancouver, Canada, was an overview of the Buxton Collection, an on-line historical archive of interactive input devices spanning over the past 35 years.
It was interesting to note that at the time of the presentation, the Vancouver Conference Center, where the conference was taking place, was having serious problems with the network/internet connections, and as a consequence, Buxton was not able to demonstrate the on-line version of his collection as planned.
RELATED
Previous IMT posts about Bill Buxton
Bill Buxton's Presentation Video: "A Little Tale about Touch" (Microsoft Worldwide Partner Conference, 2010)
Two good articles by Bill Buxton: The Mad Dash Towards Touch Technology; The Long Nose of Innovation
Buxton Collection
Buxton Collection, PivotViewer
Back to the Past: Bill Buxton Shows Off 36 Years of Tech Devices
Microsoft News Center, 5/9/11
Microsoft's Bill Buxton exhibits gadget collection 35 years in the making
Donald Melanson, engadget, 5/9/11
Bill Buxton's Haptic Input References (pdf)
Bill Buxton's website
Multi-touch Systems that I Have Known and Loved (Bill Buxton)
CES 2010: NUI with Bill Buxton
It was interesting to note that at the time of the presentation, the Vancouver Conference Center, where the conference was taking place, was having serious problems with the network/internet connections, and as a consequence, Buxton was not able to demonstrate the on-line version of his collection as planned.
Not to worry. The physical version of the Buxton's archive was on display during the conference, along with Buxton, who was happy to tell the story behind every device and gadget in the archive, with much enthusiasm. The slideshow below provides a glimpse of the Bill Buxton archive displayed at CHI 2011:
My Buxton Collection Slideshow, CHI 2011, Vancouver, Canada
Buxton's archive of gadgets comes with a rich history, accumulated over the years. Much of this history, until now, has resided in Buxton's head. Holding and touching the items in the archive while listening to Buxton's passionate stories about each one, was unlike anything I had ever experienced. His archive is a labor of love, and the interactive, on-line version of the Buxton Collection is his way of sharing his knowledge with the world.
During his talk, Buxton pointed out that in computer science programs, students are not required to have much exposure to the "history of ideas" in the field. Huge chunks of work are often ignored in the literature, and in some cases, the wheel is unknowingly reinvented, and this is something that must be addressed within the CHI community, according to Buxton.
I agree.
During his talk, Buxton pointed out that in computer science programs, students are not required to have much exposure to the "history of ideas" in the field. Huge chunks of work are often ignored in the literature, and in some cases, the wheel is unknowingly reinvented, and this is something that must be addressed within the CHI community, according to Buxton.
I agree.
Previous IMT posts about Bill Buxton
Bill Buxton's Presentation Video: "A Little Tale about Touch" (Microsoft Worldwide Partner Conference, 2010)
Two good articles by Bill Buxton: The Mad Dash Towards Touch Technology; The Long Nose of Innovation
Buxton Collection
Buxton Collection, PivotViewer
Back to the Past: Bill Buxton Shows Off 36 Years of Tech Devices
Microsoft News Center, 5/9/11
Microsoft's Bill Buxton exhibits gadget collection 35 years in the making
Donald Melanson, engadget, 5/9/11
Bill Buxton's Haptic Input References (pdf)
Bill Buxton's website
Multi-touch Systems that I Have Known and Loved (Bill Buxton)
CES 2010: NUI with Bill Buxton
On Engineering and Design: An Open Letter Microsoft Research Principal Scientist Bill Buxton calls for engineers and user experience designers to learn to appreciate one another
Bill Buxton, Bloomberg Businessweek, 4/29/09
Posted by
Lynn Marentette
Labels:
#CHI2011,
2011,
Bill Buxton,
buxton collection,
CHI,
design,
devices,
gadgets,
HCI,
history,
input devices,
interaction,
interactive devices,
NUI
No comments:
Feb 20, 2011
Human-Computer Interaction (HCI) Is Changing the World: BLUR Conference, February 22-23, Omni Orlando Resort (Includes video)
Tuesday, February 22, 2011 at 8:00 AM - Wednesday, February 23, 2011 at 5:00 PM (ET) Omni Orlando Resort, 1500 Masters Blvd.
ChampionsGate, Florida 33896 Phone: (407) 390-6664
ABOUT BLUR
(from the conference website)
"It’s easy to forget that the computer mouse is over 45 years old."
"What’s not as easy to forget is that we’re now collectively getting used to interacting with computers via means and interfaces that have moved way beyond the keyboard and the mouse — the iPhone and Wii being the most prominent examples."
"The truth is that we stand on the verge of a major revolution in the models of Human Computer Interaction (HCI). A revolution that will fly right past academic and into a world of retail, medical, gaming, military, public event, sporting, personal and marketing applications."
"From multi-touch to motion capture to spatial operating environments, over the next 10 years, everything we know about HCI will change."
"Blur is the only conference that is exploring the line of interaction between computers and humans in a substantive, real-world and hands-on way."
"At Blur, vendors, strategists, buyers and visionaries assemble to not only discuss the larger issues of HCI, but also to lay their hands on the latest in HCI technology. Blur is the only forum for a focused, hands-on exploration of the varied technologies evolving in the HCI."
"Come play, investigate, learn and apply at Blur — where we’re changing how you interact with computers forever." -Blur
BLUR Conference Agenda
(Note: I added the links to conference participants and/or their organizations. Feel free to leave a comment if you know of any corrections or better links!)
Keynotes:
Neuroergonomics: How an Understanding of the Brain is Changing the Practice of Human Factors Engineering - Dr. Kay Stanney, Design Interactive
On Social Robotics - Dr. Cynthia Breazeal, Personal Robotics Group, MIT
When Computers Feel: Understanding Human Emotional Measurement - Hans Lee, EmSense
A Quick Hit on Mobility and HCI - Juan Pons, Swype
Panel Discussion: Haptics- The Beginnings and Future of Touch - Nimish Mehta
Augmenting the World of Things - Jeff Powers, Occipital; Matt Szymczyk, Zugara; Robert Rice, Neogence; Gene Becker, Layar; Moderated by John Minnihan, Freepository
Why HCI will lead the biggest tech revolution yet - Andrew Tschesnok, Organic MotionLocation as a Primary Interface Input - Matt Galligan, SimpleGeo; Nick Brachet, Skyhook Wireless
Robotics, Gaming and The Future of Entertainment- Paul Berberian, Orbotix
Virtual Coaches in Healthcare: A Vision of the Future - Dan Siewiorek, Carnegie Mellon University
10 reasons to be happy about giving computers emotion sensing - Dr. Rosalind Picard, MIT
Commercializing HCI Technology - Dr. Paul Kedrosky, Ewing Marion Kauffman Foundation and Dr. Gerry Barnett
Breakout Sessions:
Human Instrumentation - James Park, FitBit; Ben Rubin, Zeo; Jason Jacobs, RunKeeper;
Steve Larsen, moderator
New Museum Experiences: Learning from Multitouch and Multiuser Installations - Jim Spadacinni, Ideum
Kinect Hacks - Jonathan C. Hall; Lonergan Harrington; Jim Spadacinni, Sean Kean, moderator
Interactive Ads and Consumer Experiences - Alessio Signorini, Immersive Labs; Jon Fox, Helios Interactive
Augmented Reality - Ready for Primetime? - Vikas Reddy, Occipital; Carlin Getliffe, Omniar; Edwin Rivera, Credelis; Dan Rua, moderator
Building an Interface for Endangered Language Learners - Finn Thye and Kelson Adams, Univ of Colorado - Boulder
Alternative Interface Inputs - Gary Clayton, Nuance; Nick Langdale-Smith, Seeing Machines; RJ Auburn, Voxeo; Steve Larsen, moderator
Ewing Marion Kauffman Foundation "Idea Hack" - Commercializing HCI Technology: A Discussion - led by Paul Kedrosky
Building Natural User Interfaces - Thomas Peterson, SoftKinetic; Ohad Shvueli, Prime Sense; David Minnen, Oblong
3D Interactive Design for the Human Body - Albert Hwang
Panel: Will the Kinect Change the HCI Industry Forever? A Group Discussion
HCI in the 21st Century: Technologies for Extending and Amplifying the Human Experience (pdf) - Dr. Charlie Hughes, UCF; Dr. David Pratt; Dr. Joseph LaViola; moderated by Steve Fiore, UCF
Some Videos of HCI/Tech featured at Blur 2011
360 Panorama occipitalhq
"Illuminous" Eric Gradman
"Standard Gravity" Eric Gradman, OpenKinect (libfreenect/python)
Organic Motion Markerless Motion Capture
Advisory:
Steve Fiore, University of Central Florida
Bob Allen, Disney R&D
Kay Stanney, Design Interactive
Capt. Dylan Schmorrow, USN
Posted by
Lynn Marentette
Dec 3, 2010
More gesture and multi-touch interaction! Windows 7 Navigation with Kinect; Product browser by Immersive Labs,
Here are a couple of new natural user interface videos. The first video, by Evoluce, demonstrates gesture interaction/navigation in Windows 7 applications supported by Kinect. The second video, by Immersive Labs, shows multi-touch product browsing interaction on a large display.
Kinect Treatment of Windows 7, by Evoluce
Evoluce: Leading Surface Technologies
Immersive Labs - Multi-touch Product Browser
Immersive Labs
Kinect Treatment of Windows 7, by Evoluce
Evoluce: Leading Surface Technologies
Immersive Labs - Multi-touch Product Browser
Immersive Labs
Posted by
Lynn Marentette
Labels:
evoluce,
gesture,
immersive labs,
kinect,
multi-touch,
NUI,
product browser,
touch,
Windows 7
No comments:
Jul 7, 2009
Lonely Planet Travel App by Amnesia-Razorfish for the Surface
I came across this video on the Microsoft Surface blog about a demo created for Lonely Planet by Amnesia-Razorfish, from REMIX 2009 Australia this past June:
Lonely Planet proof-of-concept at REMIX Australia 2009
Following a link from the Surface blog, I found yet another video:
Design in the Round. Creating Compelling User Experiences for Surface
The video provides an overview of the history of human computer interaction and look towards the future of NUI (natural user interface). The Surface is viewed as only as a step towards NUI, which follows a person as they go about the day, interacting with technology via a variety of devices and settings.
"Designing for multi-touch, gesture-based and tangible experience like Microsoft Surface presents a new set of challenges. How do you design for a user interface that doesn't have a top? How to allow for multiple simultaneous users without them getting in each other's way?..."
Lonely Planet proof-of-concept at REMIX Australia 2009
Following a link from the Surface blog, I found yet another video:
Design in the Round. Creating Compelling User Experiences for Surface
The video provides an overview of the history of human computer interaction and look towards the future of NUI (natural user interface). The Surface is viewed as only as a step towards NUI, which follows a person as they go about the day, interacting with technology via a variety of devices and settings.
"Designing for multi-touch, gesture-based and tangible experience like Microsoft Surface presents a new set of challenges. How do you design for a user interface that doesn't have a top? How to allow for multiple simultaneous users without them getting in each other's way?..."
Posted by
Lynn Marentette
Jul 11, 2009
Where are they now? Revisiting Interactive User Interface Projects
I've been blogging about interactive multimedia and interesting human-computer interfaces/ interaction for a while. I thought I'd revisit some of the projects and prototypes that interested me and find out what happened to all of those visionary graduate students after they earned their degrees. (Feel free to leave a comment and a link if you have any information to update about yourself or someone you know.)
This will be a topic I'll touch on from time-to-time, and since I've covered so many projects, it might take quite a while!
In the meantime, I've posted a video of the TANGerINE Inspirational Cube, a mixed reality interactive multimedia project between the University of Florence, University of Bologna, along with the contributions of other researchers. The video was produced in 2007, I think.
Here is a 2008 picture of some of the people who continued to work with the TANGerINE project at CHI 2008:

Here is the video of "TANGerINE Cities: Collaborative Tangible Sonorization" from Nicola Torpei's Vimeo page:
Somewhat Related:
Note: Stephano Baraldi, one of Nicola Torpei's colleagues who worked on the TANGerINE project, worked for a while at a company called Natural Interaction, now part of iO. To read more about iO, take a look at Alessandro Valli's whitepaper, "Natural Interaction, iO"(pdf). Stephano Baraldi's prototype of the Sensitive Table is mentioned in this paper.
iO's Interactive Climbing Wall
(If you just happen to be interested in spaghetti western music, you can listen to it at Last FM: http://www.last.fm/tag/spaghetti+western Ennio Morricone is one of the top artists of this genre.)
This will be a topic I'll touch on from time-to-time, and since I've covered so many projects, it might take quite a while!
In the meantime, I've posted a video of the TANGerINE Inspirational Cube, a mixed reality interactive multimedia project between the University of Florence, University of Bologna, along with the contributions of other researchers. The video was produced in 2007, I think.
Here is a 2008 picture of some of the people who continued to work with the TANGerINE project at CHI 2008:

Here is the video of "TANGerINE Cities: Collaborative Tangible Sonorization" from Nicola Torpei's Vimeo page:
TANGerINE cities - collaborative tangible sonorization from Nicola Torpei on Vimeo.
And here is a link to a Flickr slideshow from TANGerINE Cities at the Frontiers of Interaction 09 conference, held recently in Rome, Italy: http://www.flickr.com/photos/nicolatorpei/sets/72157619553939994/show/ Below is a video of the conference highlights, set to spaghetti western music:Somewhat Related:
Note: Stephano Baraldi, one of Nicola Torpei's colleagues who worked on the TANGerINE project, worked for a while at a company called Natural Interaction, now part of iO. To read more about iO, take a look at Alessandro Valli's whitepaper, "Natural Interaction, iO"(pdf). Stephano Baraldi's prototype of the Sensitive Table is mentioned in this paper.
iO's Interactive Climbing Wall
(If you just happen to be interested in spaghetti western music, you can listen to it at Last FM: http://www.last.fm/tag/spaghetti+western Ennio Morricone is one of the top artists of this genre.)
Posted by
Lynn Marentette
Nov 4, 2008
Searching for Multi-Touch Info? Drivers for Windows 7 Available from NextWindow & HP TouchSmart...More about N-Trig..Multi-Touch Resources
Multi-Touch News and Links
Next Window Releases Touch Screen Drivers for Microsoft Windows 7
"The technology to build multi-touch applications for next year's operating system is available today."
KFAR SABA, Israel & AUSTIN, Texas--(BUSINESS WIRE)--"N-trig, providers of DuoSenseTMTM evolution. With the industry’s only combined pen and multi-touch capabilities, N-trig is transforming the way people interact with computers. technology, combining pen and capacitive touch in a single device, brings the power of technology and the human touch together to begin a new era in interface technologies and lead the Hands-on computing evolution. With the industry’s only combined pen and multi-touch capabilities, N-trig is transforming the way people interact with computers"
"...Realizing the power of the human interface, N-trig’s DuoSense digitizers are designed to integrate easily, support any type of screen, keep devices slim, light and bright, and can support numerous applications from small notebooks to large LCDs. Combined, pen and touch enables users to open files, manipulate pictures and browse the desktop as they would the files on their desk...Currently available on the Dell Latitude XT and additional OEM designs planned to come to market in early 2009, N-trig is opening a window onto a world where multi-touch is the accepted standard for computer interfaces."
Related
All you ever wanted to know about Multi-Touch:
Bill Buxton's Multi-Touch Systems that I Have Known and Loved
All you ever wanted to know about interactive tables that support collaboration:
Pasta & Vinegar's List of Interactive Tables
(From 2005, but has been updated.)
All you ever wanted to know about tangible user interfaces:
5 Lessons About Tangible Interfaces (pdf) - Nicolas Nova
All you ever wanted to know about interactive gestures:
Interactive Gestures (wiki)
All you ever wanted to know about open-source multi-touch & related technology:
NUI Group (Natural User Interface)
Resources and Links about Touch Screens, Tables, and Multi-touch
Note: I highlight news, thoughts, and reflections about interactive multimedia, multi-touch, and related emergent technologies on this blog.
If you don't see what you are looking for on this post, feel free to do a search on this blog, or my other blog, Technology-Supported Human-World Interaction.
For Multi-Touch Interaction Humor:
Multi-touch Parody of CNN's Magic Map Wall: Saturday Night Live's Weekend Update MegaPixel Giant Touch Map
Microsoft Surface Parody
Next Window Releases Touch Screen Drivers for Microsoft Windows 7
"The technology to build multi-touch applications for next year's operating system is available today."
"NextWindow, the leader in optical touch technology, released a touch screen driver for Windows 7 developers this week. The introduction of multi-touch gestures to this operating system will generate applications giving users more flexibility when engaging with content."
"NextWindow introduced this technology at Microsoft's Professional Developer's Conference (PDC) in October and will be presenting it at the Windows Hardware Engineering Conference (WinHEC) November 4 - 6, 2008. At this event, NextWindow will be showcasing their latest in optical touch solutions including the integrated touch display found on the HP TouchSmart All-in-One computer."
"Providing a touch screen solution for Windows 7 will give end-users an intuitive method to interact with their computers," said Anthony Uhrick, VP of Sales, NextWindow. "We've created a driver that enables developers to take full advantage of multi-touch functionality."
Software developers interested in touch solutions for Windows 7 are invited to contact NextWindow or download the driver directly from http://www.nextwindow.com/windriver. " More information about NextWindow is available at nextwindow.com."
Contact:
David Villarina, NextWindow
dvillarina @ nextwindow.com
David Villarina, NextWindow
dvillarina @ nextwindow.com
N-trig Delivers Innovative Hands-On™ Computing to PC Industry
"Multi-Touch and Pen Technology to Humanize the Computer Interface and Create New Markets"
KFAR SABA, Israel & AUSTIN, Texas--(BUSINESS WIRE)--"N-trig, providers of DuoSenseTMTM evolution. With the industry’s only combined pen and multi-touch capabilities, N-trig is transforming the way people interact with computers. technology, combining pen and capacitive touch in a single device, brings the power of technology and the human touch together to begin a new era in interface technologies and lead the Hands-on computing evolution. With the industry’s only combined pen and multi-touch capabilities, N-trig is transforming the way people interact with computers"
"...Realizing the power of the human interface, N-trig’s DuoSense digitizers are designed to integrate easily, support any type of screen, keep devices slim, light and bright, and can support numerous applications from small notebooks to large LCDs. Combined, pen and touch enables users to open files, manipulate pictures and browse the desktop as they would the files on their desk...Currently available on the Dell Latitude XT and additional OEM designs planned to come to market in early 2009, N-trig is opening a window onto a world where multi-touch is the accepted standard for computer interfaces."
Related
All you ever wanted to know about Multi-Touch:
Bill Buxton's Multi-Touch Systems that I Have Known and Loved
All you ever wanted to know about interactive tables that support collaboration:
Pasta & Vinegar's List of Interactive Tables
(From 2005, but has been updated.)
All you ever wanted to know about tangible user interfaces:
5 Lessons About Tangible Interfaces (pdf) - Nicolas Nova
All you ever wanted to know about interactive gestures:
Interactive Gestures (wiki)
All you ever wanted to know about open-source multi-touch & related technology:
NUI Group (Natural User Interface)
Resources and Links about Touch Screens, Tables, and Multi-touch
Note: I highlight news, thoughts, and reflections about interactive multimedia, multi-touch, and related emergent technologies on this blog.
If you don't see what you are looking for on this post, feel free to do a search on this blog, or my other blog, Technology-Supported Human-World Interaction.
For Multi-Touch Interaction Humor:
Multi-touch Parody of CNN's Magic Map Wall: Saturday Night Live's Weekend Update MegaPixel Giant Touch Map
Microsoft Surface Parody
Posted by
Lynn Marentette
Feb 14, 2013
Affinity+: Semi-Structured Brainstorming on Large Displays, from Pacific Northwest National Laboratory
The Affinity+ concept has the potential to be useful in educational settings such as schools, museums, and libraries. Although it was designed to support collaborative activities among software designers/developers, it could support a wide range of collaborative project-based learning activities. The clearly narrated video below was produced by a team from the Pacific Northwest National Laboratory.
"Affinity diagraming is a powerful method for encouraging and capturing lateral thinking in a group environment. The Affinity+ Concept was designed to improve the collaborative brainstorm process through the use of large display surfaces in conjunction with mobile devices like smart phones and tablets. The system works by capturing the ideas digitally and allowing users to sort and group them on a large touch screen manually. Additionally, Affinity+ incorporates theme detection, topic clustering, and other processing algorithms that help bring structured analytic techniques to the process without requiring explicit leadership roles and other overhead typically involved in these activities." -PNNL
RELATED
Affinity+ Semi-Structured Brainstorming on Large Displays
Russ Burtner, Richard May, Randy Scarberry, Ryan LaMothe, Alex Endert
Pacific Northwest National Laboratory
Information Visualization Core Area: Natural User Interactions
Information Visualization Core Area: User Experience
Pacific Northwest National Laboratory
Large Displays: Will it ever be enough? (pdf)
Richard May, Jim Thomas, Pacific Northwest National Laboratory
Although this paper is from 2006, it contains a discussion of the "Top Ten Research Challenges" associated with large high-resolution displays:
A Survey of Large High-Resolution Display Technologies, Techniques, and Applications (pdf)
Tao Ni, Greg S. Schmidt, Oliver G. Staadt, Mark A Livingston, Robert Ball, Richard May
IEEE Virtual Reality Conference 2006, pp223-226 Virginia Tech, 2006
Advanced Visualization and Interaction Techniques for Large High-Resolution Displays (pdf)
Sebastian Thelen (in Ariane Middel, Inga Scheler, and Hans Hagen (eds.), Visualization of Large and Unstructured Data Sets - Applications in Geospatial Planning, Modeling and Engineering (IRTG 1131 Workshop), VLUDS 2010, March 19-21, 2010, Bodega Bay, CA, USA DOI: 10.4230/OASIcs.VLUDS.2010.73
Affinity Diagraming
Usability Net
"Affinity diagraming is a powerful method for encouraging and capturing lateral thinking in a group environment. The Affinity+ Concept was designed to improve the collaborative brainstorm process through the use of large display surfaces in conjunction with mobile devices like smart phones and tablets. The system works by capturing the ideas digitally and allowing users to sort and group them on a large touch screen manually. Additionally, Affinity+ incorporates theme detection, topic clustering, and other processing algorithms that help bring structured analytic techniques to the process without requiring explicit leadership roles and other overhead typically involved in these activities." -PNNL
RELATED
Affinity+ Semi-Structured Brainstorming on Large Displays
Russ Burtner, Richard May, Randy Scarberry, Ryan LaMothe, Alex Endert
Pacific Northwest National Laboratory
Information Visualization Core Area: Natural User Interactions
Information Visualization Core Area: User Experience
Pacific Northwest National Laboratory
Large Displays: Will it ever be enough? (pdf)
Richard May, Jim Thomas, Pacific Northwest National Laboratory
Although this paper is from 2006, it contains a discussion of the "Top Ten Research Challenges" associated with large high-resolution displays:
A Survey of Large High-Resolution Display Technologies, Techniques, and Applications (pdf)
Tao Ni, Greg S. Schmidt, Oliver G. Staadt, Mark A Livingston, Robert Ball, Richard May
IEEE Virtual Reality Conference 2006, pp223-226 Virginia Tech, 2006
Advanced Visualization and Interaction Techniques for Large High-Resolution Displays (pdf)
Sebastian Thelen (in Ariane Middel, Inga Scheler, and Hans Hagen (eds.), Visualization of Large and Unstructured Data Sets - Applications in Geospatial Planning, Modeling and Engineering (IRTG 1131 Workshop), VLUDS 2010, March 19-21, 2010, Bodega Bay, CA, USA DOI: 10.4230/OASIcs.VLUDS.2010.73
Affinity Diagraming
Usability Net
Posted by
Lynn Marentette
May 15, 2012
NUITEQ's Latest Multitouch Showreel: Snowflake Suite
I've been following a number of people that have been working in the area of natural user interfaces and interaction for many years. An example of this work is NUITEQ, a company lead by Harry van deer Veen. Below is NUITEQ's most recent show reel of Snowflake Suite, an off-the-shelf multitouch SDK.
Here is the description of the software from the naturaluserinterface YouTube channel:
"NUITEQ's award-winning multitouch software product Snowflake Suite comes off the shelf with 30+ apps, a free SDK to develop your own multitouch software apps and its content is easy to customize. The solution is offers high performance, stability, quality and comes with dedicated support. Apps includes presentation, productivity and creativity tools as well as games. The software can be used in different scenarios such as corporate presentations, exhibitions, entertainment, education, public spaces, consumer electronics, retail and digital signage."
FYI: Tutorials about the user of Snowflake Suite can be found on the naturaluserinterface YouTube channel.
Harry van der Veen has been sharing his NUI journey journey since 2007 on his Multitouch blog.
Here is the description of the software from the naturaluserinterface YouTube channel:
"NUITEQ's award-winning multitouch software product Snowflake Suite comes off the shelf with 30+ apps, a free SDK to develop your own multitouch software apps and its content is easy to customize. The solution is offers high performance, stability, quality and comes with dedicated support. Apps includes presentation, productivity and creativity tools as well as games. The software can be used in different scenarios such as corporate presentations, exhibitions, entertainment, education, public spaces, consumer electronics, retail and digital signage."
FYI: Tutorials about the user of Snowflake Suite can be found on the naturaluserinterface YouTube channel.
Harry van der Veen has been sharing his NUI journey journey since 2007 on his Multitouch blog.
Posted by
Lynn Marentette
Aug 2, 2010
New Hollywood Hard Rock Cafe Sparkles with Interactive Multi-touch Wall and Microsoft Surface Booths!
I came across a blogpost entitled "Tourist in my own town". In this post, the author shares is positive experience of his visit to the new Hard Rock Cafe, located on the Hollywood Walk of Fame. I loved his comment: "A whole wall of Microsoft software running and not a single BSOD!" In addition to the interactive wall, visitors have the chance to play with the content on Microsoft's interactive Surface tables. Below is a picture from the post from the Sure Beats Work blog:

-Sure Beats Work
A recent post on the Hard Rock Cafe blog provides more information about the interactive technologies at the Hollywood site: "Hard Rock International Rocks Its Way to Hollywood Boulevard":
New Look ~ New Vibe ~ New Memorabilia Technology
"In the latest example of Hard Rock’s concept-driven design evolution, the Hollywood Boulevard cafe was developed to integrate technology, creating a new look and vibe that will rock Hollywood. Hard Rock Cafe Hollywood on Hollywood Boulevard showcases new and unique interactive experiences for guests – from an 18’ x 4’ Rock Wall™ to touch screens in booths throughout the cafe to Microsoft Surface™, each featuring innovative multi-touch technology that enables fans to explore the world’s greatest rock ‘n’ roll memorabilia collection and virtually tour all of Hard Rock’s venues worldwide."
"In addition to the cutting-edge multimedia memorabilia experience, hundreds of items from Hard Rock’s iconic collection adorn the walls of Hard Rock Cafe Hollywood on Hollywood Boulevard, including items from many of the world’s most beloved and recognizable musicians, as well as contemporary artists with local ties. Key memorabilia items are now on display, from Jimi Hendrix’s purple crushed velvet hat; to Janis Joplin’s love letter to then boyfriend Peter LeBlanc; Jim Morrison’s leather pants and handwritten lyrics to “L.A. Woman”; to Katy Perry’s sparkly dress and Fergie’s tour outfit worn while on tour with the Black Eyed Peas."
The memorabilia wall was created for the Hard Rock Cafe by Obscura Digital, a company that is involved in off-the-desktop ubiquitous computing, including ambient technologies that include natural-user interfaces and interaction. Obscura Digital aims to "make data pervasive and accessible in almost any situation, allowing virtually any surface to be turned into a portal to the Internet".
The Memorabilia Wall has been installed in several Hard Rock Cafes around the world- additional pictures can be found on the Obscura Digital website.The first installation of the wall was at the Hard Rock Cafe in Las Vegas in 2009. - Below is the interaction of the wall at the Las Vegas Hard Rock Cafe:
-Obscura Digital
The following video, set to Beck's "Elevator Music", provides a great demonstration of the Hard Rock Cafe Memorabilia application as experienced on the Surface:
Hard Rock memorabilia app for Microsoft Surface (extended) from Duncan/Channon on Vimeo.
(The music in the video "Elevator Music, by Beck.)
RELATED
My megapost about the Hard Rock Cafe interactive wall and website:

-Sure Beats Work
A recent post on the Hard Rock Cafe blog provides more information about the interactive technologies at the Hollywood site: "Hard Rock International Rocks Its Way to Hollywood Boulevard":
New Look ~ New Vibe ~ New Memorabilia Technology
"In the latest example of Hard Rock’s concept-driven design evolution, the Hollywood Boulevard cafe was developed to integrate technology, creating a new look and vibe that will rock Hollywood. Hard Rock Cafe Hollywood on Hollywood Boulevard showcases new and unique interactive experiences for guests – from an 18’ x 4’ Rock Wall™ to touch screens in booths throughout the cafe to Microsoft Surface™, each featuring innovative multi-touch technology that enables fans to explore the world’s greatest rock ‘n’ roll memorabilia collection and virtually tour all of Hard Rock’s venues worldwide."
"In addition to the cutting-edge multimedia memorabilia experience, hundreds of items from Hard Rock’s iconic collection adorn the walls of Hard Rock Cafe Hollywood on Hollywood Boulevard, including items from many of the world’s most beloved and recognizable musicians, as well as contemporary artists with local ties. Key memorabilia items are now on display, from Jimi Hendrix’s purple crushed velvet hat; to Janis Joplin’s love letter to then boyfriend Peter LeBlanc; Jim Morrison’s leather pants and handwritten lyrics to “L.A. Woman”; to Katy Perry’s sparkly dress and Fergie’s tour outfit worn while on tour with the Black Eyed Peas."
The memorabilia wall was created for the Hard Rock Cafe by Obscura Digital, a company that is involved in off-the-desktop ubiquitous computing, including ambient technologies that include natural-user interfaces and interaction. Obscura Digital aims to "make data pervasive and accessible in almost any situation, allowing virtually any surface to be turned into a portal to the Internet".
The Memorabilia Wall has been installed in several Hard Rock Cafes around the world- additional pictures can be found on the Obscura Digital website.The first installation of the wall was at the Hard Rock Cafe in Las Vegas in 2009. - Below is the interaction of the wall at the Las Vegas Hard Rock Cafe:
-Obscura Digital
The following video, set to Beck's "Elevator Music", provides a great demonstration of the Hard Rock Cafe Memorabilia application as experienced on the Surface:
Hard Rock memorabilia app for Microsoft Surface (extended) from Duncan/Channon on Vimeo.
(The music in the video "Elevator Music, by Beck.)
RELATED
My megapost about the Hard Rock Cafe interactive wall and website:
Interactive Memorabilia at the Hard Rock Cafe:
Microsoft's Multi-touch Rock Wall, Companion Surface Installations, and Awesome Touch-Responsive Interactive Memorabilia Website
Below is a screenshot of the main portal of the Hard Rock Cafe interactive memorabilia website, which compliments the "real" wall. You can interact with all 1532 items and learn more about the history behind the various artists. It is fun to play with on a touch-screen display!

Duncan Channon: Sin City Memorabilia Interfaces
SOMEWHAT RELATED
Obscura Digital
Obscura Digital's Cuelight, and interactive pool table at the SOHO Esquire House:
Cuelight from Obscura Digital on Vimeo.
"Featured at the Esquire House's "Ultimate Bachelor Pad" in NYC, the one-of-a kind Obscura CueLight projection system turns a game of pool into an amazing interactive art display"
Microsoft's Multi-touch Rock Wall, Companion Surface Installations, and Awesome Touch-Responsive Interactive Memorabilia Website
Below is a screenshot of the main portal of the Hard Rock Cafe interactive memorabilia website, which compliments the "real" wall. You can interact with all 1532 items and learn more about the history behind the various artists. It is fun to play with on a touch-screen display!
Duncan Channon: Sin City Memorabilia Interfaces
SOMEWHAT RELATED
Obscura Digital
Obscura Digital's Cuelight, and interactive pool table at the SOHO Esquire House:
Cuelight from Obscura Digital on Vimeo.
"Featured at the Esquire House's "Ultimate Bachelor Pad" in NYC, the one-of-a kind Obscura CueLight projection system turns a game of pool into an amazing interactive art display"
Posted by
Lynn Marentette
Subscribe to:
Posts (Atom)
