Open-source Eye-tracking: The ITU Gaze Tracker 2.0 Beta Via Martin Tall, NUI-Group Member

I came across the first version of the open-source ITU Gaze Tracker on the NUI Group forum in April of 2009 and played around with it a bit.  I was impressed.  I'm happy to say that the new version looks even better, although I haven't had the time to try it out.  Below are two recent videos that will give you a better understanding about gaze tracking.  


For the tech-curious, make sure you take the time to view the second video!  Links to info & code are below.


GT2 High speed remote eye tracking "Pushing the limits"


Technical Demonstration


Info about  the ITU Gaze Tracker 2.0 Beta from the NUI Group Forum, posted by Martin Tall:

Introducing the ITU Gaze Tracker 2.0 Beta

"We’ve made great progress since the initial release, today we open the doors for version 2.0. Internally we’ve rewritten major parts of the platform to gain flexibility and higher performance.  First version was DIY playtime, this version is nothing short of a screamer. High performance, very accuracy tracking. People are telling us we are crazy giving it away but we’re dedicated to the mission: Accessible eye tracking for all, regardless of nationality and means. We’re making it happen."

Important highlights for GT2.0b:
- Supports three modes of operation, head-mounted, remote mono/binocular
- Vastly improved performance, +500fps head mounted, +170fps remote binocular (both eyes)
- Awesome accuracy, avg. 0.3 - 0.7 degrees of visual angle (remote binocular)
- New U.I, looks so.. 2010
- Automatic tuning (optimization of algorithms parameters)
- Relatively low CPU-utilization and memory footprint (12%, 170Mb, core i7 860 win7-64)
- Many enhancements, bug-fixes etc.

More info:
http://forum.gazegroup.org
http://develop.gazegroup.org

Update on Josh Blake, newly designated Microsoft Surface MVP

Josh Blake is the Tech Lead of the InfoStrat Advance Technology Group in DC.  He has been creating multi-touch applications Microsoft's Surface multi-user table-tops for a while. Recently, his team built a suite of applications designed for use by young children at a museum.  Below is a video demonstration of some of this work. It really looks exciting!


Microsoft Surface and Magical Object Interaction

Josh Blake's blog is called Deconstructing the NUI- for those of you new to this blog, NUI stands for Natural User Interface (also known as Natural User Interaction).  See his post, Microsoft Surface and Magical Object Interaction, for more information!

RELATED
Here is a plug for Josh Blake's book, "Multitouch on Windows"

Book Ordering Information

FYI:  InfoStrat  is hiring  WPF experts as well as Microsoft CRM and Microsoft SharePoint experts.


Microsoft Surface MVPs
Dr. Neil Roodyn
Dennis Vroegop
Rick Barraza
Joshua Blake

Interactive Tabletops and Surfaces: 2010 ACM Conference, Nov. 7-10, Saarbrucken, Germany. Wish I could go!

If you are new to this blog, you should know that I'm passionate about interactive tables and surfaces of all sizes!   Although this technology has been around for a while, it is a new concept to most people.  The researchers and practitioners involved in the upcoming 2010 Interactive Tabletops and Surfaces Conference have been an important influence in the way people think about interacting with technology, and have made significant contributions to this emerging field over the past several years.   It hasn't been an easy road, given that most of us have minds brainwashed through years of forced keyboard-and-mouse interaction and traditional WIMP (Windows, Icons, Menus, Pointers) interfaces.

I first learned about the first Interactive Tabletops conference, held in 2006, in early 2007.  At the time, I was working on projects for my HCI and Ubiquitous Computing classes, trying to learn everything I could about natural user interaction, large touch-screen displays, tabletop computing, and multi-touch.   I was inspired by the interesting work going on in this field.  This was before the first iPhone was introduced, before Microsoft's multi-touch Surface was unveiled, and three years before Apple broke out with the iPad.

Many of the people involved with the 2010 Interactive Tabletops and Surfaces Conference are (or have been) affiliated with the NUI group.  NUI stands for Natural User Interface, or Natural User Interaction - the NUI group is "a global research community focused on the open discovery of natural user interfaces."  I joined the NUI-group in 2007 when I was looking for more information about the nuts and bolts of multi-touch programming and systems, and have been encourage to see how things have evolved since then.

Members of another group, sparkon, are also participating in the Interactive Tabletops and Surfaces conference.  Sparkon is an on-line community that includes people involved with  interactive technologies, including tabletop and surface computing. "On sparkon, you'll find projects demonstrating the latest interactive techniques, applications, software frameworks, case studies, and blog articles relating to creative and emergent technology."  (I'm also a member of Sparkon.)


Here's the information from the conference website:

ACM Interactive Tabletops and Surfaces, Saarbrücken, Germany:  7-10 November, 2010
"ITS 2010 is a premier venue for presenting research in the design and use of new and emerging tabletop and interactive surface technologies. As a young community, we embrace the growth of the discipline in a wide variety of areas, including innovations in ITS hardware, software, interaction design, and studies expanding our understanding of design considerations of ITS technologies and of their applications in modern society. ITS 2010 will bring together top researchers and practitioners who are interested in both the technical and human aspects of interactive tabletop and surface technologies. It is our hope that we will be able to achieve increased synergy of approaches between the disciplines engaged in the research in the area of interactive tabletops and surfaces, Design, HCI, UbiComp, Psychology, MobileHCI and other related fields. More directly, we intend to encourage immediate interdisciplinary collaboration on future research topics. Young scholars and Ph.D. students are especially encouraged to submit papers and participate in the doctoral colloquium."


Johannes Schöning, DFKI GmbH
Antonio Krüger, DFKI GmbH
Conference General Chairs


KEYNOTE SPEAKER:  W. Bradford Paley

"Bio: W. Bradford Paley uses computers to create visual displays with the goal of making readable, clear, and engaging expressions of complex data. He did his first computer graphics in 1973, founded Digital Image Design Incorporated in 1982, and started doing financial & statistical data visualization in 1986. He has exhibited at the Museum of Modern Art; he created TextArc.org; he is in the ARTPORT collection of the Whitney Museum of American Art; has received multiple grants and awards for both art and design, and his designs are at work every day in the hands of brokers on the floor of the New York Stock Exchange. He is an adjunct associate professor at Columbia University, and is director of Information Esthetics: a fledgling interdisciplinary group exploring the creation and interpretation of data representations that are both readable and esthetically satisfying."


SAMPLE TOPICS

• Applications
• Gesture-based interfaces
• Multi-modal interfaces
• Tangible interfaces
• Novel interaction techniques
• Data handling/exchange on large interactive surfaces
• Data presentation on large interactive surfaces
• User-interface technology
• Computer supported collaborative systems
• Middleware and network support
• Augmented reality
• Social protocols
• Information visualizations
• Interactive surface hardware, including sensing and input technologies with novel capabilities
• Human-centered design & methodologies

RELATED
Previous Conferences

• Tabletop 2009 in Banff, Canada
• Tabletop 2008 in Amsterdam, The Netherlands
• Tabletop 2007 in Newport, RI, USA
• Tabletop 2006 in Adelaide, Australia

PLUGS
From the conference website -Links to the conference sponsors:

We appreciate the generous support of the following sponsors, without whom this conference would not be possible. Click on the logos to learn more about our generous supporters, and let us know if you are interested in becoming a sponsor.

Champions:

 

Benefactors:

  

Donors:

Contributors:

Academic Sponsors:

     

Osmosis: Multi-touch systems for... everywhere!

Not long ago I had the opportunity to chat with Stuart McLean, the founder of Osmosis, a company that delivers customized multi-touch systems of hardware and software that support human-centered natural user interaction.   Stuart has many years of experience working in more traditional IT/business roles, and knows from this experience that there is  better way to support  human computer interaction, including interaction between people.

Like many of us in the "NUI" community, Stuart was impressed by the video of Jeff Han's 2006 TED Talk, which demonstrated a variety of awesome multi-touch, multi-user applications on a high-resolution drafting table.  Stuart saw the importance of natural user interfaces and interaction and became involved with the NUI Group, a "global research community focused on the open discovery of natural user interfaces". 

Unlike traditional tech companies, Osmosis is a collaboration between a global network of engineers, designers, and developers who share the "NUI" vision. This collaboration enables the company to provide solutions for clients across a range of countries, cultures, and domains.


Below is a photo-gallery of some of the applications and systems developed by Osmosis:


Multi-touch by Osmosis

GALLERY

As you can see from the gallery photos, Osmosis provides a range of possibilities for their clients and potential clients.  All of the displays are high-definition.  Some are projection-systems, and others are displays with multi-touch sensing technology.  Since the construction is modular, a variety of form factors are available.  High-quality surround and domed sound systems are available.  Applications include information kiosks, point of sale/digital signage, hospitality, presentation and training, education, and audio-visual performance and production.  Osmosis also provides applications that support interaction with tangible objects.

Below are two videos that give a taste of what Osmosis is all about:

OSMOSIS DEMO REEL

Demo Reel from Osmosis on Vimeo.

MULTI-TOUCH EVERYWHERE

MT Everywhere from Osmosis on Vimeo.

I can see where some of these applications would be great in K-12 educational settings.  Just look at the joy on the faces of the kids in the Multi-Touch Everywhere video!

(Short video clips of the Osmosis applications in action can be found in the showcase page of the company's website.)

Interesting blog roll and links on Christian Zoellner's TUI Blog by FORM+ZWECK; FILE Electronic Arts Festival

Christian Zoellner blogs about "tangible interaction & new interfaces" on the TUI Blog by Form + Zweck, a design magazine.  Christian is a designer and "presearcher" who lives and works in Berlin, Germany.  He teaches at the University of Fine Arts, Berlin. He maintains the Christian Zoellner website.

As I write this post, Christian is attending the FILE electronic arts festival, which focuses on "interactive art in public spaces, game design, and sonification".  It sounds like a fantastic conference! The festival is actually a group of events:  File Machinima, File Documenta, File Media Art, File Hypersonica, File Games, File Symposium, File Prix Lux, and workshops.


Christian Zoellner's Links:

• algorhythmics
• alt N research
• arduino
• bausteln
• cc
• christian zoellner
• createdigitalmotion.com
• createdigitalmusic.com
• de:bug
• doors of perception
• form+zweck
• fritzing
• groovemechanic
• hardhack
• interactiondesign.org
• interactivemultimediatechnology
• intuity.medialab
• M.I.T
• maker faire
• my future me
• nui-group
• openprocessing
• prado media lab
• processing
• salection
• smiles at strangers
• TEI conference
• the kitchen
• tinker
• tui.blog @ youtube

(I just noticed I'm on this list of links.)

RELATED

FILE SAO PAULO 2010:  July 27-August 29

"This year, besides the Centro Cultural FIESP - Ruth Cardoso programme, FILE launches FILE PAI (Paulista Avenue Interactive = Interactive Public Art), a project of digital public art that will occupy several spaces at Paulista Avenue with interactive works of art.

0 - Interactive Projection, 1 - Brigadeiro subway station, 2 - Electronic sound bus, 3 - Nomadic electronic graffiti, 4 - Paraíso subway station, 5 - Fnac store, 6 - FIESP Cultural Center - Ruth Cardoso, 7 - Trianon-Masp subway station, 8 - Conjunto Nacional building, 9 - Consolação subway station, 10 - Cervantes Institute, and 11 - São Paulo Art Museum - MASP compose the FILE PAI set, which intends to highlight the significance of interactive public art in order to understand and to absorb the new social phenomena provided by technology and, thus, to constitute strategies to interconnect with those new mass behaviors."

SOMEWHAT RELATED
Building Music at Spark Festival 09 (opens up to a full screen video of a musical building,from  Play the Magic.

Multi-touch and NUI News: NUITEQ's Multi-touch Snowflake Suite for Windows 7

NUITEQ is a company that has been involved in multi-touch technologies for the past few years, and works diligently at ensuring that it keeps up with the evolution in interactive displays and software.  The company's Snowflake Suite is now available for Windows 7, and is compatible with 3M Touch Systems, N-trig, NextWindow, Lumino, and other third-party platforms.  

Here is the current compatibility list, and also a list of Snowflake Suite for Winodws 7 features:

Compatibility

* NextWindow platforms like HP TouchSmart IQ500, IQ770, IQ800 series and the Dell Studio One (all 2 touch)
* N-trig platforms like HP TouchSmart TX2, Dell Latitude XT/XT2 and others
* 3M Touch Systems multi-touch kit
* Lumio platforms
* dreaMTouch
* PQ Labs
* Wacom

Snowflake Suite for Windows 7 Features

* Detailed user manual included with FAQ

* Developed on fast and reliable C++ platform

* Intuitive

* Customizable backgrounds, logo's, images, 3d models, videos etc

* Gesture recognition library

* TUIO / OSC (Open Sound Control) support (sending and receiving events)

* Low level API

* Hardware accelerated rendering

* Support for wide variety of media types (jpg,jpeg,tga,png,dds,gif,tif, tiff, bmp,mov,avi,wav,ogg)

* Advanced window handler that supports scaling and rotation

* Audio support

* Multi-threaded resource handler (For fast data visualization)

Snowflake Suite is also compatible with the following systems:

* TouchCore 

* Visual Planet

* NextWindow

* NEXIO Plugin

RELATED 

NUITEQ now offers 3M 22" true multi-touch displays bundled with its Snowflake Suite software

"The 3M multi-touch displays support up to 20 finger touches simultaneously and come with a one year warranty. NUITEQ's Snowflake Suite, is included at no additional charge, offering the benefits of a complete bundled product of hardware and software, being the perfect solution to get started with multi-touch technology."

Brochure (pdf) 

NUITEQ Flat 46" Multi-touch LCD 

Photo Credit: NUITEQ

Case Study
"NUITEC freely assisted handicapped children with their education, by applying multi-touch technology for Action For Kids, a UK based national charity working with children and young people with physical and learning disabilities.The children used NUITEQ’s award winning multi-touch software product Snowflake Suite, to enhance their way of learning, by offering a more playful and intuitive solution, in comparison to conventional learning methods."

More Multi-touch: New video from NUITEQ: Snowflake Suite Multi-touch Software on a 46" HD LCD

Here is the promotional information from NUITEQ:


"NUITEQ's Snowflake Suite off the shelf multi-touch software product showcased on a 46" flat full HD multi-touch LCD.  Available for purchase now.


Snowflake Suite is honored with a Stevie Awards finalist recognition for Best Product or Service of the Year 2009 in the category Media and Entertainment for the International Business Awards. Snowflake Suite is available to OEM's, SI's, VAR's, software engineers and end clients. Snowflake Suite comes with hands full of multi-touch applications, an API and a SDK.


Compatible with different multi-touch hardware technology platforms, including: 3M Touch Systems, N-trig, NextWindow, Lumio, Nexio, IR Touch, rear camera based systems, dreaMTouch and others."


"Natural User Interface Technologies AB (NUITEQ) is a Swedish technology company, that offers off the shelf and customized software for interactive single and multi-touch devices. Additionally NUITEQ executes large scale customization projects, concerning multi-touch technology hardware, software and services. In parallel, NUITEQ is working on other innovative emerging technologies within the field of Human Computer Interaction (HCI)."


Today's News:  NUITEQ wins MerlT Award for development through collaboration, growth potential and innovative thinking.


RELATED

NUITEQ Flat 46'' Multi-touch LCD

Key Features Size: 46" Snowflake Suite life time license included Full HD Simultaneous detectionand tracking of up 32 touch points Definite and reliable detection of touch points Real multi-touch function: no specific constraints, like temporal order or position of touch points Particularly suitable for embedded systems: Processing of complex evaluation steps via touch controller, e.g. keyboard emulation Sample rate: 50 frames/s Glass: 4 mm toughened safety glass Slim design: only 3 cm construction depth and 5 cm frame width USB interface and separate power supply No drift, no calibration required Applicable to all display technologies Protocol: TUIO Detection of size and position of objects in the active area 2 years warranty Electrical Power Supply: 19 V DC ± 20 % Power Consumption: 11 W Interface: USB 1.1, full speed   Functional Simultaneous Touch Points: 32 Touch Point Size: > 10 mm Spatial Resolution: < 2 mm Communication Protocol : Propriatary or ·· TUIO 1.0 (2Dcur and 25Dcur profiles) Scan Speed: 55 ms Mechanical Data Frame Dimensions: 1136 x 680 x 28 mm Frame Finish: Black powder coating (RAL 9011) Active Area: 1018.1 x 572.7 mm Window: 4 mm double-sided anti-reflective laminted safety filterglass Weight: 11 kg (including filter glass) Monitor: Direct fit to SHARP PN-465E (35,5 KG) Environmental Operating Temperature: 0 °C to 40 °C Operating Humidity: 20 % to 80 % (no condensation)

Also available as a horizontal solution.









NUITEQ Wiki
Harry van der Veen's NUITEQ Blog
(I've been following Harry van der Veen's journey since he was a university student. At the time, he was a leading member of the NUI-Group, creating a DYI multi-touch table as part of his studies. This was before Microsoft Surface was born.)