Showing posts with label NUI. Show all posts
Showing posts with label NUI. Show all posts

Dec 19, 2009

UPDATED: More News, Videos, and Links about Multi-touch and Screen Technologies

UPDATED
More news about multi-touch and screen technologies!

"Holographic" Multitouch   (Eatang Digital Technology)

Holographic muitltouch from eggwong on Vimeo
Eggwong's company is Eatang Digital Technology.  Although most of the website is in Chinese, it looks like it provides interactive design services as well as software kits.


How to Build a 20" Multiitouch Screen in Three Weeks (Ben Unsworth - Globalcore)

How to Build a 20' Multitouch Screen in 3 Weeks from Ben Unsworth on Vimeo.


Globacore
Globacore used four 72" Blue Ocean Low Gain Screens 16:9 to create their twenty-foot multi-touch wall, which I think was also used for the "holographic" screen in the first video. The tracker and base flash API from the NUI-group were used in this system.
I wasn't sure if I'd heard about Blue Ocean screens.  Much to my surprise, the company behind Blue Ocean is Nippura, located in Japan.  Nippura has another office in Charlotte, N.C.
For years,  Nippura's core business has been focused on creating "the world's largest acrylic panels, tunnels, cylinders and spheres for the professional aquarium industry", but is also focused on screen systems as well.

US Nippura/Blue Ocean Projection Screens
Blue Ocean screens were use in the second videos of this post.  Below is some information the screens from the company's website:
"Blue Ocean® Projection Screens are the first ever to cast the screen into a hi-tolerance viewing plane centered between two ultra-clear panels of cell-cast acrylic, the same type of material used in hi-optic fighter jet canopies and the world’s largest aquariums. Blue Ocean® Projection Screens also offer something never before found in screens: self-rigidity.  The thickness of each screen can be fabricated so that it maintains its form without external frames or tension systems. Frameless high definition projected images without borders amplify the infinite depth viewing experience.  Because of its durability, outdoor applications of entertainment around the garden and pool are also possible. Normal wear and tear scratching has no long-term effect on the screens’ performance, and a ten year old screen, simply re-polished, will literally look and perform exactly as it did the day it left the factory."
Super High Definition Stereo Image using 4K Projection Systems (pdf)
Tetsuro Ogi, Hiroaki Daigo, So Sato, Yoshisuke Tateyama, Yasuaki Nishida, International Conference on Artificial Reality and Telexistence 2008

NUITEQ
 

NUITEQ offers single and duo-touch plugins for Snowflake Suite that enables the software to run on NEXIO and NextWindow screens, including NextWindow's screens that are integrated in the HP TouchSmart and Dell Inspiron all-in-one PC's and others.  SnowFlake Suite is also compatable with 3M Touch Systems, N-Trig, and Lumino.  You can view the SnowFlake Suite application in action on NUITEQ's YouTube channel.
"NUITEQ's software product Snowflake Suite, which received a Stevie Awards finalist recognition for Best New Product or Service of the Year 2009 - Media & Entertainment, is available to end clients, software developers, system integrators, VAR's and OEM's. Snowflake operates on a wide variety of hardware technology platforms including rear camera based solutions, IR overlay systems, bending wave, surface acoustic wave (SAW), projected and surface capacitive, resistive and other touch technologies for small hand held mobile devices and larger scale interactive displays."
Recent news: NUITEQ Assists LTU Skelleftea at SACO event with new educational multi-touch desk


FingerTapps
Software platform for multi-touch solutions:
Video:  FingerTapps on the Dell Inspiron 19
Dell Studio One 19:  All-in-One Stunner Takes Japan
FingerTapps collaborated with DigitalDM Digital Publishing to support interactive media panels (IMAS) for use in retail settings, as well as digital print publishing.  


NextWindow and All-In-One PC's:
NextWindow, the company that made the large single-touch display I used for a couple of class projects nearly three years ago, has really grown over the past few years.  NextWindow provides optical touch screens for the HP TouchSmart PC, and also for the Dell Inspiron Studio One All-In-One PC, and the Dell Sx2210T desktop monitor.   The next Dell with a NextWindow touch screen will be the Inspirion One 19, an all-in-one PC.   You can find NextWindow touch screens in the Medion X9613, the NEC ValueStar W, and the Sony L Series.  (NextWindow has Windows 7 certification for touch screens)

STANTUM and GUNZE USA
Stantum has partnered with Gunze USA, a manufacturer of resistive touch-panels, to co-design and deliver multi-touch products.  "Gunze USA will provide these custom multi-touch modules to the North American market for use in industrial, automotive, defense, aerospace, medical, kiosk/point-of-sales, and other professional applications. Unlike capacitive multi-touch, Stantum’s technology is particularly well suited to these professional markets, thanks to its:
  • immunity to EMI issues, via easy coexistence with Wi-Fi or Bluetooth antennas around the screen;
  • stylus input and high precision, enabling handwriting recognition; and
  • ability to work flawlessly with gloves."
According to the press release, Stantum's multi-touch technologies provide advantages such as handling 10 or more touches at a time, finger and stylus input, finger-pressure consumption, and native Windows 7 support, with no need for a driver. Developers can order the "beta" version of the Slate PC, based on the Dell Inspiron Mini netbook platform, from the Stantum website. 


GESTURETEK
The video below is of an interactive 3D application created for the Gondwana Das Praehistorium in Schiffweler, Germany, and provides an simulation of what it might be like to be a flying ancient pterosaur of giant dragonfly.  Two gamers can play at the same time.  If you want to fly, you flap your arms, and navigate by leaning. You crouch to dive, and increase your speed by flapping your arms even faster:
GestureTek's 3D Interactive Flying and Virtual Game Experience for Gonwana Museum

This company always has something going on that looks fun and interactive.  To get an idea this company's interactive work, take a look at the information on the GestureTek website links below. GestureTek has a variety product videos on the website.


GestureTek Health
GestureTek Mobile Gaming
GestureTek mobile gaming videos
GestureTek Product Summary
GestureTek in Science Centers, Aquariums, Zoos, and Visitor Centers


Lm3Labs


View more documents from LM3LABS.

Lm3labs Air Strike Overview (Slideshare)


SNIBBE INTERACTIVE
Snibbe Interactive was founded by Scott Snibbe to develop social immersive media as a communication medium that incorporates the language of cinema and engages participation and interaction with others (and technology) through unencumbered body movements.  
Snibbe Interactive (22 of 66) by armadillu.


Get in the Action Prototype

Get in the Action Prototype - Snibbe Interactive from Oriol Ferrer MesiĆ  on Vimeo.




Scott Snibbe's Social Immersive Media presentation at Stanford's Seminar on People, Computers and Design, 5/2009

'Scott Snibbe of Sona Research discusses a distinct form of augmented reality focused on social interaction: social immersive media. He discusses design principles and interaction techniques to create strong emotional responses and social engagement through visceral interaction. He also describes approaches to clearly communicate cultural and scientific ideas through the medium, and how to promote specific distinct social behavior in uses." -YouTube description


RELATED
Globacore  "Globacore was founded by Ben Unsworth and Jeff Williams out of a passion for technology, art, and business. Globacore began as a web hosting and development company supporting the the technical needs of sports apparel startup VC Ultimate and it's associated companies."
"Globacore Inc. was officially incorporated in April 2003. In 2007 Ben and Jeff were joined by programmer Kyle Davis and graphic designer (and trail biker) Matt Venhuizen. In 2008, the Flexmaster Lukasz Ruminski joined us and continues to be a huge member of our team.Update: We'd like to welcome our newest team member: Developer Dave Rapin!"
Globacore Interactive Technologies
67 Mowat Ave. Suite 431
Toronto, ON
M6K 3E3
Phone: + 1 (416) 925-2082
Tollfree: + 1 (888) 309-7658
Fax: + 1 (647) 477-3270 
General Email: info@globacore.com


BLUE OCEAN/NIPPURA
Blue Ocean/ Nippura US Website
Blue Ocean Product Information (pdf)
3611 Tryclan Dr.
Charlotte, NC  28217
Phone: 704-561-9191
Web: www.usnippura.com



NEXTWINDOW
NextWindow's Touch Technologies Overview
Optical Touch and All-In-One PC's
News Release:  NextWindow Patents (pdf)

Contact: David Villarina, NextWindow
+1 (925) 272-4530
dvillarina@nextwindow.com



NUITEQ
Natural User Interface Technologies AB(Headquarters)
LaboratorgrƤnd 7
93162 SkellefteƄ
Sweden

Phone: +46 702865975
Fax: +46 851989240
mail@nuiteq.com



3M Touch Systems US
3M's Touch Topics information site
Multi-touch@mmm.com
 
Natural User Interface Asia Pte Ltd (Asia office)
12 Little Road
#06-01 Lian Cheong Industrial Building
Singapore 536986
Phone: +65 6748 5245
Fax: +65 6748 7961


FINGERTAPPS
Contact: James Bell-Booth
james[at]fingertapps.com
+64 21 226 6399

www.fingertapps.com/


STANTUM
Slate PC Proof of Concept Datasheet (pdf)
Contact: Francois Jeanneau
Sales and Business Development
Director, Stantum North America

Berkeley, CA, USA
Cell: +1 (510) 928 56 17
f.jeanneau@stantum.com

GUNZE USA
Product Overview
Contact:Gunze Electronics USA
2113 Wells Branch Parkway, #5400
Austin, Texas 78728
Tel: 512-990-3400 Fax: 512-252-1181



LM3LABS
Website: http://lm3labs.com/ENG/index_eng.html
info@lm3labs.com
Europe:
Antipolis Innovation Campus
300, route des Cretes
06560 Sophia-Antipolis France
Hong Kong, China
+852-8198.8406
Australia
+61(02)8011.3342
USA: +1(646)461.6146
TGarden Square 409
3-5-26 Funabori
Edogawa-ku
134-0091 Tokyo, Japan
+81(0)3.3877.0779


SNIBBE INTERACTIVE
1073 Howard Street
San Francisco, CA 94103
+1 415 822 1442
sales@snibbeinteractive.com
Snibbe Interactive Blog
2010 Interactive Catalog (pdf)
HOLDING TANK
Peau Productions
Diffusers and Projection Screens Comparison Site
(Provides photos and video of various screens and diffusers used for optical-based multi-touch systems.)


NUI-Group
Wiki: Comparison of rear projection films
Forum Thread

Outdoor Media Company (China)
Products
Contact: Kuo Lin  (?)
 42"46"Multi Touch LCD Display
42x46 Multi-touch LCD Display

HIWAD TOUCH - Beijing Yhjn Science and Technology Co. LTD



Interactive Sandbox 
400×300
"An interactive sand box or sand table for use in tactical training includes an automated control system and image generator so that infinitely variable visual images may be projected onto the contoured surface of the sand for training and preparation for action in the military field and disaster control, industrial planning, environmental protection, and similar situation."


Interactive Holographic Touch Screen
327×245


Beijing Yihejianing Science and Technology Co., Ltd
Address: Room 621, Jinyuan Modern shopping Mall, NO.1 Yuanda Road, Haidian District, Beijing, China
TE:8610-88892897,88892895
FAX:8610-88892867-801
Email: hxrong2001@hotmail.com
http://www.cnhci.cn

Dec 17, 2009

Sensacell Modular Interactive Surface Technology: Interactive Art in NYC

Interactive surfaces continue to crop up in public spaces.  Today I came across information about Sensacell, an interface system consisting of "smart" modules that can be put together to form a communication network. The system integrates non-contact sensors that can detect people and objects up to six feet away, and this sensing can occur even through glass, plastics, wood, and so forth.  The sensors are capable of tracking environmental changes.


The Sensacell Corporation is led by Leo Fernekes and is often used to support interactive art  and related displays in public spaces. The most recent installation is located in Manhattan and can be accessed by peop on the street.


Robert Stratton Interactive Art

According to the information on the YouTube video, the Sensacell Interactive LED Wall was created with Max/MSP/Jitter.


"The artwork by Robert Stratton entitled semiboneless transforms the storefront window into an electronic interactive canvas that senses hand movements through the window glass, allowing the viewer to interact and influence the behavior of the piece- art that begs to be touched." (YouTube description)


"The work is located at 141 East 33rd Street, on the north-east corner of Lexington Ave. and 33rd St. in Manhattan, New York. The exhibition will run from 12/14/2009 though 1/12/2010 and is viewable 24 hours day. The artwork is installed in a large storefront window of a street level retail space." (PR Web 12/17/09)


Sensacell: Below is a video of an 8 x 8 LED Wall Sensacell Module



RELATED
Working with Sensacell: Modular Interactive Proximity Sensor and Lighting System (pdf)
Sensacell Corporation Presents an Interactive Storefront Art Installation by Artist Robert Stratton  (PRWeb, 12/17/09)
Robert Stratton Interactive Art
Chashama (An arts group - provided space for the interactive art installation.)
"chashama supports thriving cultural communities by transforming temporarily vacant properties into spaces where art can flourish. By recycling and repurposing buildings in transition, we invest in neighborhoods, foster local artists, and sustain a vast range of creativity and culture."


Sensacell has been around for a while
2005 post:   Sensacell  (Interactive Architecture blog)


Sensacell Interactive Floor


Cross posted on The World Is My Interface

Dec 14, 2009

Missed this one: Microsoft Surface in the Mix Lounge on Holland America Cruise Ships

They didn't have this on the Veendam when I was on the cruise! This video doesn't show anything new or exciting if you are familiar with tabletop/multi-touch/gesture based computing. I'm sure it will be eye opening to the average cruise ship passenger.



Microsoft Surface is New Coolness on Veendam Holland America Blog (5/4/09)


Press Release:
Seattle, Wash., December 7, 2009 —
"As part of its ongoing Signature of Excellence enhancements, Holland America Line will install five Microsoft® Surface® units in Mix, its newest lounge venue with three specialty bars — Martinis, Champagne, and Spirits & Ales. Already in full operation on ms Veendam, Mix and Surface units will be completed on ms Rotterdam by mid-December, followed by three additional ships."


"An exciting new entertainment space, Mix is a destination lounge where guests can meet and mingle throughout the day and night. Mix is an open and inviting space anchored by a pianist providing entertainment for the three distinctly themed specialty bars."


More:  Holland America Line Features Microsoft Surface in New Mix Lounge on Several Ships





Mary Lou Jepsen, Inventor of Pixel Qi Technology, Discusses Screen Technologies & Multi-touch Tablets

I've been meaning to devote a few more posts about the new screen technologies as multi-purpose netbooks become available.  In my opinion, this technology will change the way we access all sorts of interactive media, including news and entertainment.

In this post, I feature Mary Lou Jepsen, an engineer who is the inventor of Pixel Qi technology. During the first quarter of 2010, there is a possibility that a few Pixel Qi screens will become available to the DIY community.  The first units will be multi-touch. Pixel Qi will be at the January CES in Las Vegas.

Mary Lou has worked on the screen technology found in One Laptop per Child (OLPC) project, and her work has resulted in affordable net-books and laptops.  According to information from the Pixel Qi website, "Mary Lou founded Pixel Qi Corporation in 2008 and is its CEO.  Previously, Mary Lou has founded 4 companies, served as a professor at RMIT (Australia) & MIT,  and in executive management at Intel Corporation.  Mary Lou holds a Ph.D. in Optical Sciences, a B.S. in Electrical Engineering and a B.A. in Art (req.) all from Brown University as well as a Master of Science (in Holography) from the MIT Media Lab.".

Mary Lou Jepsen, an engineer,  tests out "e-paper" content in the sunlight and in the shade on three screens. In the following video, the E-ink Amazon Kindle, an Acer Pixel Qi 3Qi LCD netbook, and a Toshiba transflexive R600 laptop are compared.  At 4:20, Jepsen discusses touch and remarks that there are new touch technologies that might work. (The content on the resistive touch screen that was on hand during the video was difficult to see.)


Mary Lou Jepson demonstrates the Pixel Qi screen in her home lab/laundry room on the OLPC (One Laptop Per Child). Jepson is focused on making screens that everyone can use.


Mary Lou Jepsen Answers User Questions



Comparison Chart (from the Pixel Qi website)

null

Pixel Qi is working on a design of a sub-10 watt HDTV that can run on a minimal power supply, including a battery that can be charged with a crank or solar pane.

Dec 13, 2009

Multi-touch and Tangible Computing & the Lumino Project

Professor Patrick Baudisch and his student researchers at the Haaso Plattner Institute in Germany have focused on Human-Interaction for a quite a while.  One look at the research project page of Dr. Baudisch says it all.  Over the past few years, the human-computer interaction (HCI) teams at Hasso Plattner have explored multi-touch and tangible computing, with very interesting results.  

Take a look at the following video from Design Boom's YouTube Channel, and follow the related links for more information!


Tangible Tabletop Computing with Lumino

(The Lumino project was developed using Microsoft Surface.)


RELATED
Lumino Project Website


Lumino Team:
Professer Patrick BaudischTorsten Becker, Frederik Rudeck
Human Computer Interaction, Hasso Plattner Institute
"The Human Computer Interaction group headed by Prof. Dr. Patrick Baudisch is concerned with the design, implementation, and evaluation of interaction techniques, devices, and systems. More specifically, we create new ways to interact with small devices, such as mobile phones and very large display devices, such as tables and walls."


Articles/Posts
Lumino (Design Boom, no author or date)
Smart 'Lego" blocks take touch screens into 3D   Colin Barras, New Scientist (10/6/09)
"Fat Fingers" can become dainty for touch Screens   Colin Barris, New Scientist (11/24/09)


Microsoft Surface and Objects (Features Lumino "Tangible Blocks" at the 1:02 marker)

Dec 3, 2009

Touch-screen Interaction at Digital Bus Shelter - Video via Daily DOOH



JCDecaux Innovate Touch-Screen Bus Shelters
Chris Sheldrake, Daily DOOH (Digital Out of Home) 12/2/09

RELATED
The World is My Web Browser: Interactive Technology in Public Spaces
(Watch the video of the interactive "Splat the Cadbury Creme Egg" game played on a large touch screen display at a bus shelter.)

JCDecaux Innovate - Gorillaz for Bus Shelters

Nov 28, 2009

Fantasy HCI! Dream Lab and Dream Team for the Future

Fantasy HCI!  

My wish is to have my own lab so I can create and test out various interactive applications that run on screens of all sizes, and play with new interactive gadgets and displays. I'd also like to provide mobile lab services so I can go out and see how emerging technologies play out in real-life situations and settings during the design & development process as well as after-market.

I'd like to focus on social-collaborative & cognitive aspects of emerging technologies. Because of my background in school psychology, I'd work towards ensuring that new applications, technologies, and systems follow the guidelines of Universal Design for Learning as well as Universal Usability. I have some ideas about the transdisciplinary characteristics I'd like to see for members of the lab's Dream Team, but I'm saving that for another post. Now I just need to win the lottery so I can hire my team and run with the ball. Team Charlotte, N.C., anyone?

FYI:
The HCI link is to a blog that corresponds to the Theory and Research in Human Computer Interaction class at Rensselaer Polytechnic Institute. 

For more information about HCI, visit the Human-Computer Interaction Resources website.

Quick Post: Video of Stantum's Multi-touch "Slate PC" Digital Resistive Touch Screen Netbook



The video is is of the Stantum Slate PC, via Netbooked's YouTube channel...The system in the video is running on a modded Dell Mini 10, and doesn't require calibration. Notice how the system easily handles a variety of interaction- fingers, thumbs, pinch, rotation, multiple finger swipes, brush strokes, fingernail action, stylus, and more.

At this time, the Stantum Slate is available for developers only.

RELATED POSTS

Stantum's Multi-touch Slate PC, Windows 7 Certified (11/17/09)
Interactive multi-touch for sound design, dj-ing, and music creation (10/25/09)
Stantum's Mobile Phone Multi-touch Interface:  Demonstration of precise interactions on a resistive touch screen (9/7/09)
Updates about NextWindow and Stantum; Upcoming Emerging Displays Technologies Conference (6/2/09)

FYI:   Netbooked's Netbook Blog

Nov 24, 2009

Morning Tech News: Razorfone: Windows 7 & WPF Retail Demo on a Multi-touch Screen, via I Started Something


Razorfone Interactive Retail Experience from Razorfish - Emerging Experiences on Vimeo.

This demo was created by the Emerging Experiences team at Razorfish. Here's the video description from Vimeo:

"Customers are being faced with increasingly complex buying decisions, especially when it comes to technology and services. As a result, increased pressure is being placed on store associates to provide knowledgeable service to customers. Our Emerging Experiences team used this opportunity to develop a solution to demonstrate how an immersive interactive experience can assist customers and store associates with complex buying decisions in a retail setting."


Comment:   We've graduated from 2D multi-touch manipulation of photos via pan-zoom-rotate-resize-drag to 3D multi-touch manipulation of "objects".

So?  I'm expecting much more.

There is much room for creative growth in this area! 

RELATED
Emerging Experiences Blog
I Started Something Blog

Nov 23, 2009

Morning Tech News: LED "Tatoos"; Sixth Sense Wearable Displays

Since I am usually crunched for time, I thought I'd try posting "morning tech news" on this blog in a brief format, and return to the topic later - hopefully later in the day or at the most, within the week.

If you are familiar with this blog, what I consider "news" is sometimes new to me.  It might be something that crossed my path a while ago and never posted.  It might be something that I missed.   It doesn't even have to be "news",  if it is something that is unique, catches my fancy, or is something that I think is an important innovation that should be followed and shared.

Today's news I caught from Wired, which linked to an article in MIT's Technology Review, "Implantable Silicon-Silk Electronics:  Biodegradable circuits could enable better neural interfaces and LED  tatoos", written by Katherine Bourzac.

"By building thin, flexible silicon electronics on silk substrates, researchers have made electronics that almost completely dissolve inside the body. So far the research group has demonstrated arrays of transistors made on thin films of silk. While electronics must usually be encased to protect them from the body, these electronics don't need protection, and the silk means the electronics conform to biological tissue. The silk melts away over time and the thin silicon circuits left behind don't cause irritation because they are just nanometers thick."


RELATED
WIRED's Gadget Lab:  The Illustrated Man:  How LED Tattos Could Make Your Skin a Screen Charlie Sorrel 11/20/09
"The silk substrate onto which the chips are mounted eventually dissolves away inside the body, leaving just the electronics behind. The silicon chips are around the length of a small grain of rice — about 1 millimeter, and just 250 nanometers thick. The sheet of silk will keep them in place, molding to the shape of the skin when saline solution is added.
These displays could be hooked up to any kind of electronic device, also inside the body. Medical uses are being explored, from blood-sugar sensors that show their readouts on the skin itself to neurodevices that tie into the body’s nervous system — hooking chips to particular nerves to control a prosthetic hand, for example."
Tatoo You:  Silicon LED's can act as photonic tattoos that can show blood sugar readings
-Surfdaddy Orca,  hplusmagaizine 11/17/09


"Brian Litt, associate professor of neurology and bioengineering at the University of Pennsylvania, is working with researchers from Beckman Institute at the University of Illinois and Tufts University to develop medical applications for the new transistors. Their silk-silicon LEDs can act as photonic tattoos that can show blood-sugar readings, as well as arrays of conformable electrodes that might interface with the nervous system."


Litt Lab : Translational NeuroEngineering 
(Brian Litt's lab.)


SOMEWHAT RELATED
I've been thinking about flexible touch-screen applications, and it never occurred to me that the concept might be something that would transfer to human skin!  Here are a few of my posts related to this topic:

Last night I dreamt about haptic touch-screen overlays...
Rhizome 2009:  A Lovely Interactive Multi-touch App on a Flexible Lycra Screen
Impress:  A cool flexible interface project  by Silke Hilsing


More about this "somewhat related topic" to come: 
Latest SixthSense demo features paper "laptop" camera gestures
Nilay Patel, Engadget  11/18/09
Adding a "SixthSense" to your Cellphone
Vikas Bajaj, Bits, New York Times 11/6/09
Pattie Maes TED Talk:  Sixth Sense-  Mobile Wearable Interface and Gesture Interaction (for the price of a cell phone!) - my post from 3/2009

Nov 19, 2009

Multi-touch & Gesture Interaction News: NUITEQ's Snowflake Suite 1.7 compatible with Windows 7 and 3M Touch Systems, N-trig and Lumio



"This video demonstrates the N-trig DuoSense true multi-touch solution utilizing up to four fingers. The video features various multi-touch enabled applications, including how to pan and rotate using up to four fingers on Google Earth, a demonstration of how to play various onscreen musical instruments using the Snowflake Suite Music application, and a new hands-on way to play Sudoku. The Corel Paint it!™ application shows how existing images can be transformed using multi-touch, and a 3D desktop organizer application from BumpTop demonstrates new and innovative ways in which to organize your desktop using up to four fingers"   -avitaintrig's YouTube description

Snowflake Suite and NextWindow Plugin Information
NUITEQ in the media

3M Touch Systems

nTrig

Lumio

Bumptop

NextWindow
(SnowFlake Suite 1.7 works on NextWindow screens.)

I'll post more news and information about the natural interface/interaction biz very soon!

Nov 17, 2009

Stantum's Multi-touch Slate PC, Windows 7 Certified

Slate PC

The Stantum Slate PC is based on the Dell Inspiron Mini netbook platform. The 10.1 Slate accepts handwriting, gestures, and text-based input. Is in the "proof-of-concept stage.

Slate PC Proof of Concept (pdf) Includes specifications. Stantum also offers Multi-Touch Development Kits (MDK's) that include a controller board featuring PMatrix, a controller chip. and a touch panel.

How PMatrix Works (from the Stantum website):
How it works

RELATED

Stantum's unlimited multitouch meets Mini 10 in a fight to the death
(Josephe L. Flatley, Engadget, 11/17/09)

JAZZ MUTANT
Jazz Mutant is the Music & Media product division of Stantum.  I offers multi-touch control surfaces for audio and media - Dexter and Lemur.

More information about Stantum and other multi-touch focused companies to come!

Nov 4, 2009

Interactive Video Art in Action: MuchoWall from Tangible Display (and Jimmy Hertz)

muchomanos_web 

Photo of MuchoWall, an 80" multimodal sensitive wall from Tangible Displays (Jimmy Hertz, Founder)

Jimmy Hertz is a member of the NUI-Group and has been involved in various activities to spread the world about natural-user interfaces and interaction.



Be sure to watch the entire video. It is almost like watching a dance performance when you watch artist interact with the display.


Thanks, Seth Sandler, for the the link!

Oct 28, 2009

libTISCH, a multi-touch development framework with multi-touch widgets and more!

For techies and the tech-curious who like technologies that support collaboration and multi-touch interaction,  this is great news!

Florian Echtler announced the first stable releas of libTISCH, a multi-touch development framwork, which can be found on Sourceforge.  TISCH stands for Tangible Interaction Surfaces for Collaboration between Humans.  libTISCH, a C++ software framework, is included in this project.  It provides a means for creating GUIs based on multi-touch and/or tangible input devices.

Here is how it works:

Architecture Layers































Here is information from libTISCH announcement:


Highlights of this release are, among others, the following features:

- ready-to-use multitouch widgets based on OpenGL
- reconfigurable, hardware-independent gesture recognition engine
- support for widely used (move, scale, rotate..), pre-defined gestures
 as well as custom-defined gestures

- hardware drivers for FTIR, DI, Wiimote, DiamondTouch..
- TUIO converters: source and sink

- cross-platform: Linux, MacOS X, Windows (32 and 64 bit)
- cross-language: C++ with bindings for C#, Java, Python

libTISCH has a lot to offer for the multitouch developer. For example, 

the textured widgets enable rapid development of applications for many
kinds of multi-touch or tangible interfaces. The separate gesture
recognition engine allows the translation of a wide range of highly
configurable gestures into pre-defined or custom events which are then
acted on by the widgets. While the lower layers of libTISCH provide
functionality similar to tbeta, touche etc. (you can interface existing
TUIO-based software with libTISCH in both directions), it goes far
beyond.

More information about the library and underlying architecture can be
found on http://tisch.sf.net/ and in the Sourceforge wiki at
http://sourceforge.net/apps/mediawiki/tisch/


TISCH Project Wiki

RELATED
Florian is on the scientific staff at the Technisch Universitat Munchen in Germany. Be sure to check out his  webpage.

I especially like the concept of the MeTaTop: "A Multi-Sensory Table Top System for Medical Procedures" that is linked from Florian's website.
MeTaTop A Multi Sensory Table Top System for Medical Procedures

Interactive Multimedia Across Platforms and Screens: Adobe's Open Screen Project; MEX Mobile User Experience Manifesto.... (Please don't annoy the user!)

I'm not sure what I think about ubiquitous Flash 10.1. and Adobe's Open Screen project. I like the idea of anything that is seamlessly cross-platform, but I shudder to think that this might let out a wave unwanted or annoying "push" advertising on on-the-go screens of all sizes. I'm assuming web developers, along with TV ad producers, will be jumping on this train without fully thinking about how their applications and designs will play out in the off-the-desktop, digital-out-of home world.

I decided to take a look, drill down through the hype, and share a few links related to this topic.

Adobe Pushes for a Flash-ier Mobile Web
Rob Pegararo, Faster Forward, Washington Post (10/5/09)
"Are you anxious to bring Flash to the mobile Web, even if it means being subjected to some over-eager Web coder's song-and-dance routine? Or would you rather do without it on the go, even if that means having to switch to a "real" computer to use some Web sites' features?"

Hopefully the "over-eager web coders" will heed the MEX Manifesto:

MEX:  Mobile User Experience 2009 Manifesto (pdf)
"The Manifesto sets out our beliefs as to how user-centred design principles can enhance the experience of multi-platform digital services."

A framework for user journeys in a multi-platform world:  Marek Poawlowski, founder of MEX

MEX: User experience journeys in a multi-platform environment from Marek Pawlowski on Vimeo.

"User experiences are evolving into increasingly complex sets of interactions between multiple devices.  In this video presentation, Marek Pawlowski of the MEX Mobile User Experience strategy forum, shows how a framework can be used to map user journeys through the multi-platform environment."

"Unencumbered by wires, information is flowing into every corner of our world at an ever increasing rate and through an ever increasing range of digital platforms. The single greatest challenge facing digital industries is understanding how this explosion of data will be woven into the fabric of consumers' lives." -- Marek Pawlowski, founder of MEX.

MEX Blog 

OPEN SCREEN VIDEO

Open Screen Project from Vyshak V on Vimeo.
"The Open Screen Project is an industry-wide initiative, led by Adobe and backed by other industry leaders who all share one clear vision: Enable consumers to engage with rich Internet experiences seamlessly across any device, anywhere. Partners in the Open Screen Project are working together to provide a consistent runtime environment for open web browsing and standalone applications — taking advantage of Adobe® Flash® Player and, in the future, Adobe® AIR®. This consistent runtime environment will remove barriers to publishing content and applications across desktops, mobile phones, televisions, and other consumer electronics." Learn more

Reinventing Storytelling in the Digital Age Across Platforms, Across Screens

NAB 2009 presentation by Shantanu Narayen of Adobe and A.D. Albers, of Disney Interactive Media Group, from NAB 2009
Adobe and NVIDIA Deliver Rich Web Experiences on Netbooks and Mobile Devices
Reuters (10/5/009)
"At Adobe MAX, Adobe's worldwide developer conference, Adobe Systems Incorporated and NVIDIA Corporation..announced that both companies are bringing uncompromised browsing of rich Web content to netbooks, smarphones and smartbooks built with NVIDIA GPUs. The companies have been working closely together as part of the Open Screen Project to optimize and dramatically improve performance of Flash Player 10.1 by taking advantage of GPU video and graphics acceleration on a wide range of mobile Internet devices. NVIDIA customers embracing Flash Player 10.1 for their new devices include HP, Lenovo, Samsung, Acer, Asus and more..."


RIM Joins Open Screen Project  Reuters (10/4/09 )


Honey I Shrunk the Flash Player Simon Bisson and Mary Branscome, ZDNET, 10/12/09
Teaming up with Adobe and the Open Screen Project -Google Blog   (10/5/09)


Paramount Digital Entertainment Launches Interactive Thriller on MySpace  Tracy Sedlow, InteractiveTV Today (10/28/09)
"The company says that it can deliver the show's multiple interactive elements to viewers across devices using Adobe Flash Player and Adobe AIR, "because of efforts by the Open Screen Project, an industry-wide initiative led by Adobe and supported by PDE and close to 50 other industry leaders, to enable people to engage with rich Internet experiences across any device, anywhere." -

Oct 25, 2009

Interactive multi-touch for sound design, dj-ing, and music creation

NUI-Group member Christian Bannister, a musician, designer, and developer behind Subcycle Labs has been experimenting with music and multi-touch technology and interactions. Here's a demonstration of what he's come up with so far:


multi-touch the storm - interactive sound visuals - subcycle labs from christian bannister on Vimeo.
.
"The big picture goal of this project is to bridge the gap between sound visualization and musical instrument. With multi-touch interaction it is possible to manipulate multiple characteristics of a sound—directly and visually. Right now a lot of electronic music involves staring at the back of the performers laptop. This is a shame because in many cases a lot of really interesting things are happening on the computer that the audience is completely unaware of. This project hopes to create a common visual language and experience for the electronic musician and the audience by enhancing the perception of sound and music on both sides...These sketches are built with Processing and Max/MSP networked with OSC on a single computer..." -Christian Bannister



JazzMutant Lemur
The multi-touch tech company now known as Stantum evolved from JazzMutant, Jazzmutant was founded in 2002 by Guilluame Largillier and Pascal Joguet, and joined by Julien Olivier in 2003. The original focus was to create a multi-touch controller for music applications, and the Lemur was born. It is now in version 2, with features such as a gesture object that provides three ways for people to interact with sound, extended scripting abilities, and remote control of your computer's mouse cursor or keyboard.  Stantum recently developed a next-gen multi-touch screen system for use in mobile devices such as smart phones and netbooks.  (I'll discuss this further in a future post.)



Mapping Ableton Live to Jazz Mutant's multi-touch Lemur for sound design:


Additional tutorials can be found the Jazzmutant YouTube channel.


Ableton Live, the software used in the above video, will include Max. Max/MSP is now known as MAX 5:
"In use for over twenty years by performers, composers, artists, scientists, teachers, and students, Max is the way to make your computer do things that reflect your individual ideas and dreams. Version 5 is a dramatic transformation of Max that begins a new chapter in the program's history."

RELATED
Video:  Max for Live
Max is a product of cycling74
Cycling74 created the Make Controller Kit, which includes fully programmable controllers. The kit is networked based. It is capable of working with actuators and can read sensor information into Max.
Jamoma, a platform for interactive art-based research and performance. Jamoma is the prototyping environment for SpatDIF, the Spatial Sound Description Interchange Format, and GDIF, the Gesture Description Interchange Format.
GDIF: Gesture Description Interchange Format, a tool for music related movements, actions, and gestures 
Stantum's Mobile Phone Multi-touch Interface:  Demonstration of precise interactions on a resistive touch screen

How the Stantum's Resistive Multi-Touch Screen Works