Jul 18, 2010

Interactive Technology in the Carolinas: T-1 Visions Update

Interactive off-the-desktop technologies are taking off in many regions, including the Carolinas. I'd like to share some of this "post-WIMP" goodness with my readers.  There are lots of interesting things developing in my own backyard!

About a year ago, I wrote a post about T1 Visions, the company behind the interactive technology at the T1 Tapas restaurant in Huntersville, NC.  In May of this year (2010), Mike Feldman, the president of T1 Visions, LLC, and inventor of the T1 Connection Booth, participated in a panel discussion about innovative technologies for the restaurant sector at the National Restaurant Association (NRA) Show in Chicago, Illinois.

The T1 Connection booth is an integrated system that includes a durable interactive multi-user touch screen table, powered by a mac. It also includes a high-quality audio system and high-definition video screen. It can accommodate a variety of mobile devices, such as iPods, iPhones, MP3 players, and laptops.  If you have digital photos, you can easily connect to the system and view them on the video screen.

The T1 Connection Booth was designed for use in restaurants, bars, and nightclubs. In the Charlotte area, booths can be found at Harper's Restaurant in South Park, and soon will be ready for action at a new restaurant, Cowfish. According to a press release, the system is more affordable than the Microsoft Surface, and can be

The T1 Connection booth looks like it could be re-purposed for a variety of settings. I've experienced the T1 Connection Booth "hands on" a few times while visiting T1 Tapas, and I'm sure that it has potential for use in museums, libraries, and other public spaces.  T1Visions also provides high-definition display systems that coordinate with the T1 Connection booths.   T1 Vision's displays and digital signs are in use at the newly-opened NASCAR Hall of Fame museum, and also at the Charlotte Convention Center.


T1 Visions Touchscreen Experience


2009 Five Ventures Conference: T1 Visions, Inc.


The TechnoFiles, CNN Video Feature of T-1 Vision's High Tech Restaurant, T1 Tapas (2009):


RELATED
T1 Visions Website
T1 Tapas Website
Connection Booth Brochure (pdf)
High Definition Display Systems Brochure (pdf)
Post-WIMP links


Previous IMT post about T1 Tapas, July 16, 2009:
T1 Tapas, a restaurant north of Charlotte, N.C., in the Birkdale Village in Huntersville, has majority owners with a technology background. Mike Feldman and Jim Morris started up Digital Optics Corporation, which focused on optics for computers and imaging, and after they sold their company, they teamed up with Denise Feldman to establish their company.
T 1 Connection Booth with Multi-User Touch Screen, HD TV, Sound System, Computer, & more:

"T1 Connection Booth seating gives you access to music, photos, and videos through built-in touchscreen tabletops, brilliant monitors, speakers, and computers." -Picture and taken from the T 1 Tapas website

The restaraunt serves as a test bed for T 1 Visions to try out their software and hardware designed to enhance the digitally connected dining experience. The restaurant was featured in May of this year on CNN.

Interactive Technology in the Carolinas: Discovery Place Science Center

I recently visited the Discovery Place science center in Charlotte, N.C.  It was my first visit without kids, and I thought it would be fun to explore all of the exhibits at my own pace. I was excited to play with the interactive applications created for exhibits running on Microsoft's Surface table-top computers. There were so many kids and teens at Discovery Place that every exhibit was in use. Fortunately, I obtained permission from parents to videotape/photograph some of the action.


Next time, I'll make sure that I visit at a less-busy time!

The following displays were developed by the Microsoft Surface team at Quatrefoil.  Quatrefoil is a company located in Maryland that develops immersive interactive experiences, primarily for museum exhibits and related projects.

Midwife Toad App on a Microsoft Surface


Project Build Exhibit video, from the Quatrefoil YouTube website, helps people understand the architectural design process:


THEM exhibit, from the Quatrefoil YouTube site:

"This health-related exhibition at Discovery Place in Charlotte, NC, explores how the human body is an ecosystem with a myriad of flora and fauna. Visitors are presented with an exciting and educational experience. The content is delivered in a way that carefully walks the line between gross-out information and the need to keep the context within the human body...Quatrefoil Associates designed the exhibit and produced creative media including Attack of the Superbugs, a video about antibiotic-resistant bacteria." -Quatrefoil Associates

The Reactable at Discovery Place

Jul 17, 2010

Preview of the Official Boxee Video Streaming System: Digital Convergence in Action

In the following video, tech entrepreneur Zach Klein shows his company's official version of Boxee, a set-top box system that provides users a "plug-and-play" opportunity to view Web-based video on their televisions.


The first Boxee Box arrived from the D-Link Factory from Zach Klein on Vimeo.
Note:  Zach Klein is the co-founder of Vimeo.



Web video and content, viewed on a large-screen HD display, in the comfort of a cozy recliner or sofa, is in line with the "Slow Media" movement, as well as the concept behind Google's "YouTube Leanback" application (see links and info below).

Relax.  Share.  Interact.  Chill with your Web.

RELATED
Boxee Website
Boxee Readies Its Set-Top Box Nick Bilton, New York Times, 7/16/10
Boxee debuts Boxee Box, ready to take on Roku Jacob Brody, SocialBeat Venture, 12/7/09
Hands-On With the Boxee Set-Top Box and Remote Brian X. Chen, Wired Gadget Lab, 1/8/10
Designing for Interactive TV:  Boxee Case Study (Method)
Boxee and Digital Convergence Lynn Marentette, Interactive Multimedia Technology, 3/22/09


SOMEWHAT RELATED
Slow Media Manifesto
"The concept “Slow”, as in “Slow Food” and not as in “Slow Down”, is a key for this. Like “Slow Food”, Slow Media are not about fast consumption but about choosing the ingredients mindfully and preparing them in a concentrated manner. Slow Media are welcoming and hospitable. They like to share."
Google YouTube Leanback (Google)
YouTube Leanback offers effortless viewing (Google)
"YouTube Leanback a different way of watching videos on YouTube. Just as its name implies, YouTube Leanback is all about letting you sit back, relax and be entertained. Videos are tailored to autoplay as soon as you get started, in full screen and high definition, so watching YouTube becomes as effortless as watching TV. YouTube Leanback is simple to use, easy to navigate with your keyboard's arrow keys, and is personalized to your unique preferences."
YouTube's 'Leanback' Wants to Friend Your Television Remote Eliot Van Burskirk, Wired  7/8//10


Somewhat Related IMT Posts
All IMT posts referring to remote controls and usability (This will continue to be a problem as our digital streams converge)
Video and Links about Google TV: Another Flavor of Android - "Google TV brings everything you love about the Web to your television".
Designing for TV Screen Interaction:  Interesting IxDA Thread
Digital Convergence & Interactive Television
An Example of Convergence: Interactive TV - uxTV 2008

Jul 15, 2010

Interactions Magazine: Cover story by Dennis Littky, looking at the UX of high schools and colleges.

I'm out and about with no time to blog. Even so, I had to post a link to one of my favorite magazines, ACM's Interactions. Here is the introduction to the most recent issue, which comes with membership in ACM SIGCHI:
interactions, XVII.4



July / August, 2010



The cover story of a recent issue of Interactions Magazine is written by Dennis Littky, who focuses on ways to improve the success of our high schools and colleges, from a UX perspective:
Cover Story
Time Goes By, Everything Looks the Same. 

Full article for Free! 



More:
interactions: subtlety and change

Full article for Free! 
"There are some strange changes under way in our world. We constantly hear the refrain of the massive chaos around us, yet the allure of such a large, looming flux may distract us from something more important: the countless tiny, nuanced, and fundamental ways in which our culture and society are advancing. This issue of interactions describes these subtleties and teases them out of the greater topics that we've grown accustomed to discussing: environmental change, the role of education and government in a technological society, and the nature of behavior."

Jul 14, 2010

Interference Inc. Looking for Interactive Engineer and Programmer, NYC, (via Seth Sandler and Christine Lane)

I don't usually post job listings on this website, but I know that this particular position would appeal to some of my readers!  The company, Interference Inc. is based in NYC,  The position starts out with a 3-month independent contractor position, but looks like it leads to a permanent position if all goes well.  Seth Sandler posted the job announcement on his blog.  The details are below, and the information can be downloaded from the corresponding link at the end of this post.

interference 300x56 Interference looking for new hires! This may be the job for you!!
Company: Interference Inc.
Positions: We are looking for a PROGRAMMER and an INTERACTIVE ENGINEER
Position Type: Full-Time
Experience:
Candidates who have worked/have familiarity with multi-touch platforms previously and are eager to explore and learn more in a fast paced marketing/technology environment creating installations for major
global brands.
The position for the first 3 months is a probation period where the person is hired as an independent contractor and paid 1099. Depending on review and evaluation, the candidate is then hired full-time with
benefits: full medical, 401K, and 2 weeks of vacation.
Location: New York, NY
Start Date:
 ASAP
THE COMPANY
Interference Inc. is a world-renowned experiential marketing agency specializing in integrated, guerrilla and buzz marketing. Out of Interference, The SuperTouch Group was born in 2009, bringing creative technology offerings to the same impressive roster of clients. The SuperTouch mission is to generate wonder through simple, fun, entertaining and educational uses of interactive technology. We create innovative products for people to interact with technology in unique and compelling ways, and ideally away from the platforms that they are used to. SuperTouch develops Interactive Mirrors, touch surfaces, live gaming and creative custom technology builds as well as the back-end programming.
JOB SUMMARY
The Programmer and Interactive Engineer will report directly to the project’s Lead Engineer and to the Head of Production/Account. Qualified candidates should possess a couple of key skills itemized in the lists below.
PROGRAMMING SKILLS (Please specify where you are proficient)
• Proficiency with Flash/Flex/Actionscript 3, .NET/C#/WPF, Python, Java, C++ (or others, please specify)
• Knowledge of Computer Vision (OpenCV, Augmented Reality Frameworks)
• Knowledge of microcontrollers (arduino or similar) and working with sensors
• Proficiency with openFrameworks, processing, max/msp, or pd
• Knowledge of Adobe Creative Suite including, InDesign, Photoshop, Illustrator and After Effects
• Knowledge of computer networking
ENGINEERING SKILLS (Please specify where you are proficient)
• Experience in architecture, hardware design, and/or fabrication
• Ability to source, test and assess hardware for fabrication and to assemble working prototypes
• Experience in soldering, electronics, and lab testing
• Experience in interactive or touch technology with an emphasis in multi-touch computing
REQUIREMENTS
• Extremely organized individual who is a self-starter and able to learn quickly in a fast-paced environment
• Ability to think creatively, multi-task, and go beyond off-the-shelf solutions
• Strong logistical, time management and planning skills when implementing creative solutions for client deadlines
• The individual must be polished and professional and be prepared to interact with high level clientele onsite
Please note, the Interactive Engineer position may require travel to install, maintain, and breakdown
technologies across the U.S. as well as internationally. Candidates applying for the position must be able to
travel with the necessary documentation, willing to travel 1-2 times per month, and maintain a valid driver’s
license.

IF INTERESTED, PLEASE SUBMIT RESUMES TO: Christine Lane, Christine@interferenceinc.com

You can download and save the job description below:
document Interference looking for new hires! This may be the job for you!!
Interferece Job Description 10_07_13 Supertouch Tech Description.doc
Date:July 14, 2010


Collaborative Travel Planning App for Microsoft Surface, by Object Consulting



Information from the Microsoft Surface YouTube Channel:
"Object Explore is a collaborative travel planner for use by travel consultants and consumers on Microsoft Surface. Explore deep levels of interactive content through intuitive navigation, ensuring the customer doesn't get lost in the process. All content is tailored to the current client and can be taken away through mobile or email. Object Explore is built upon Object Consulting's Object Zoom framework, which brings intuitive Zoom exploration to sectors including retail, finance and museums."Object Consulting


SOMEWHAT RELATED
I worked on a collaborative travel planning application a few years ago for an HCI class project- before the Surface was unveiled by Microsoft.  It would have been fun to implement it in a Surface environment, since applications on the Surface can easily interface with mobile devices.

Below is a screenshot of a working prototype of "navSmart", a mash-up using photo-overlays linking to travel related information, including YouTube videos of related travel videos and information. You spin the globe around to explore possible destinations and vacation activities.   This concept worked best on a large touch-screen display.
PhotoGlobe and YouTube Travel Videos, using Google Earth.

Jul 12, 2010

What is new at SMART Technologies? 3D-Ready SMART Board 600i, Mixed Reality Document Camera, Scholastic's Story Stage App for the SMARTTable, an IPO, and more!

A lot is happening at one SMART Technologies, one of my favorite "interactive" companies.  Not long ago, SMART Technologies, a company most known for interactive whiteboards found in classrooms and businesses, acquired one of my favorite interactive touch-screen display companies, NextWindow. (SMART Technologies' acquisition of NextWindow: A "smart window" to the world)

SMART Technologies is moving ahead into the world of augmented reality (AR) with a new document camera.  The company's latest interactive whiteboard, the fourth generation 600i,  is ready for stereoscopic 3D content, which is on the way via the Discovery Channel and other media companies.  The SMARTTable looks like it will be provided with more content, at least in the UK, where Scholastic has partnered with SMART Technologies to provide multi-touch and multi-student interaction via the collaborative Story Stage application.

For those with money to invest, SMART Technologies has filed for a proposed initial IPO (Initial Public Offering).


-The SMART Table at Wolfe School 

New SMART Document Camera 330 is mixed reality ready:  Document camera enables exploration of 2D, 3D, animated and audio-enriched content
"Mixed Reality Technology -Manipulate and explore 2D, 3D, text, animation and audio-enriched content on the SMART Board interactive whiteboard by placing a physical object bearing a digital marker under the SMART Document Camera lens"


SMART introduces next-generation SMART Board™ 600i: New projector lowers total cost of ownership and is 3D-ready
"Available in both standard and widescreen formats, the latest generation of the 600i system features an improved and easy-to-use extended control panel (ECP) and a fully integrated short-throw projector that is 3D-ready and has a longer lamp life. The newly designed ECP is mounted to the interactive whiteboard bezel, not to the wall, making it aesthetically pleasing and easier to install."


SMART and Scholastic to develop multi-touch educational content:  Story Stage application for SMART Table to encourage student creativity and collaboration
"Story Stage is an easy-to-use resource designed to facilitate collaborative literacy work. The interactive activities use digital puppets to encourage pairs or groups of children to work together to create their own imaginative retellings of familiar stories."


SMART Classroom Suite 2010 enhances interactive learning: New version offers improved wireless performance and greater support for formative assessment
"The software combines classroom management, assessment, lesson creation and assignment management tools in one offering."


RELATED
SMART Technologies Files for Proposed Initial Public Offering: Stock to be listed on NASDAQ and TSX
Scholastic Story Stage
SOMEWHAT RELATED
Updates: Cognitive "bursts", technology-supported interactive whiteboards, digital storytelling, social skills, and reflections about a new SMARTtable. (long post)
SMART Technologies' acquisition of NextWindow: A "smart window" to the world
InfoComm AV Whitepaper:
Reaching Learners: Immersive Education through Interactive Multimedia (pdf)
By Lynn V. Marentette, Sp.A., NCSP and Anthony Uhrick, VP Sales & Marketing, NextWindow "The value of an immersive approach to education, using multimedia technologies, over traditional classroom environments."












Also posted on the TechPsych blog.

Design for Emotion and Flow: Trevor van Gorp's Presentation Slides & References

Trevor van Gorp works at Affective Design. He presented at the iA Summit 2010, a conference sponsored and run by ASIS&T, the American Society for Information Science and Technology.

In this presentation, Trevor discusses concepts such as emotion, attention, and arousal, the differences between novice and experienced users, differences in goals, such as experiential, goal-directed, how stress affects arousal and performance, and other topics, accompanied by clear examples, of ways to incorporate "emotion and flow" principles into web and information design.

It should be noted that "emotion and flow" strategies have been consciously implemented in video games by designers/developers for a long time, and these concept most likely have value across various digital domains, such as multimedia journalism, interactive television, and interactive surface or large display applications.
Design for Emotion and Flow
View more presentations from Trevor van Gorp.


Below are the references from the presentation, as posted on SlideShare:



  1. References


    • Csikszentmihalyi, Mihaly. (1990). Flow - the Psychology of Optimal Experience . New York: Harper Perennial.
    • Csikszentmihalyi, Mihaly. (1990). Flow – the Psychology of Optimal Experience. New York: Harper Perennial.
    • Desmet, Pieter, R. (2002). Designing Emotions . Pieter Desmet. Delft.
    • Russell, J.A. (1980). “A circumplex model of affect”. In Journal of Personality and Social
    • Csikszentmihalyi, M. (2008). Creativity, Fulfillment and Flow, TED talk. 2008
    • Fehrman, Kenneth R. and Cherie Fehrman. (2000). Color - The Secret Influence . New Jersey: Prentice Hall, Inc.
    • King, Andrew B. “Chapter 2 – Flow in Web Design.” 2003. http://www.websiteoptimization.com/speed/2/ accessed on January 21/2007.
    • Hoffman, D.L, Novak, T (1996), “Marketing in hypermedia computer-mediated environments: conceptual foundations’”, Journal of Marketing, Vol. 60 pp. 50-68.



    • Novak, T.P, Hoffman, D.L (1997), “Measuring the flow experience among Web users,” Interval Research Corporation.
    • Novak, T, Hoffman, D, Young, Y (1998), “Measuring the flow construct in online environments: a structural modeling approach”, Owen Graduate School of Management, Vanderbilt University, working paper.
    • Novak, T. P., Hoffman, D. L., and Yung, Y. 2000. Measuring the Customer Experience in Online Environments: A Structural Modeling Approach. Marketing Science 19, 1 (Jan. 2000), 22-42
    • Rettie, R., (2001), An Exploration of Flow during Internet Use, Internet Research, 11(2), 103 – 113.
    • Simon, H. A. (1971), “Designing Organizations for an Information-Rich World”, in Martin Greenberger, Computers, Communication, and the Public Interest, Baltimore, MD: The Johns Hopkins Press, ISBN 0-8018-1135-X. pp. 40-41.
    • van Gorp, Trevor, J. (2006). Emotion, Arousal, Attention and Flow: Chaining Emotional States to Improve Human-Computer Interaction. University of Calgary, Faculty of Environmental Design, Master’s Degree Project
RELATED
Trevor van Gorp's Boxes and Arrows article:
Design for Emotion and Flow (8/7/08)
Affective Design Blog
Some ASIS&T Special Interest Groups:
SIGVIS (Visualization, Images, Sound)
Information Architecture (IA)
Arts & Humanities

Jul 10, 2010

Tech Fashion: The iPad Murse (Murse = Man Purse)

I'm vacationing this week, but since it is impossible for me to fully pull myself away from tech, I grabbed my husband's arm and made a beeline to the iPad display during our walk around Historic Charleston yesterday.  Nearly every iPad on the display had been temporarily adopted by a kid. All of them wanted one, and it was clear that the interaction design was intuitive for them to use. 

My husband commented that he didn't see what the buzz was all about.  His first comment?  "How would anyone carry this? It is too big for a pocket or a purse!   I pointed out that unlike me, most of the women in the store had huge purses.  Huge fancy purses that could probably hold a bazillion iPads.   (My mind is made up. I need an iPad AND a huge fancy purse.)

I noticed that a dad of one of the iPad-exploring kids was holding an iPad in a zippered case in his hand, so I asked him about it.  It turns out that the guy is a "Virtual IT CIO",  so he knows his stuff.  He said that he loves his iPad and has no problem carrying it around.    Knowing my husband, carrying around the iPad in a case without a handle would be a problem.  A deal-breaker.

I guess that the lack of an iPad Murse (man-purse) is something worth considering.  We all want to project a professional image, right?  I chuckled to myself as I read the following article:
Scott Stein, CNET, 7/9/10

In the article, Stein reviews a variety of "murses" suitable for the iPad and netbooks, including Cocoon's Grid-It 10-inch Harlem Netbook/iPad and Gramercy Messenger slings, Booq's Taipan Slim XS, and STM Bags' Scout Laptop Shoulder Bag.
Searching for an iPad bag isn't easy.
(Credit: Sarah Tew/CNET)


(Credit: waynesuttun12, flickr)

Jul 8, 2010

AquaLux 3D: Text, video, images, and even Tetris on a multi-layered water display

I recently came across the INAVATE website, and I've found several articles on topics that I'm sure will interest my blog readers. The article that intrigued me today was about the AquaLux 3D project by researchers at Carnegie Mellon University. In the videos, you can see how text, video, and images can be created with light and water droplets. The researchers used this technology to create a multi-dimensional Tetris game!

A Multi-Layered Display with Water Drops (non-technical version)

"Using a projector and rows of water drop emitters, we create a multi-layer display that can be used for text, videos, and interactive games."

How the Water-drop Multi-display Works: SIGGRAPH 2010 Submission:


RELATED
Projecting Onto Water for 3D Show
INAVATE 7/8/2010
Peter Barnum, Ph.D. Student (AquaLux 3D researcher)
A Multi-layered Display with Water Drops(pdf)
Peter C. Barnum, Srinivasa G. Narasimhan and Takeo Kanade
ACM Transactions on Graphics (SIGGRAPH), July 2010.
"A Projector-Camera System for Creating a Display with Water Drops"
P. C. Barnum, S. G. Narasimhan, and T. Kanade
Workshop on Projector-Camera Systems (PROCAMS), in conjunction with CVPR, June 2009. (Best paper award)
[PDF] [Slides with videos]

YouTube's Move to Slower Media: Leanback - in HD, full screen, minimal clicks, merges with your other online "stuff".

The details are demonstrated in the video below:


My hunch?
One motivation behind Leanback is to prepare us for the next wave of online 3D HDTV, which is a "slow media" experience, best viewed from a comfy sofa or recliner.  This is the "10-foot experience".

RELATED
YouTube Leanback offers effortless viewing
Broadcasting Ourselves ;): The Official YouTube Blog, 7/7/10
Kevin Purdy, Lifehacker, 7/8/10
Brad NcCartym, thenextweb, 7/8/10
Brian Barrett, Gizmodo, 7/7/10
YouTube launches Leanback, mobile site gets HTML5 revamp (video)
Ross Miller, Engadget, 7/7/10
YouTube tries for the TV again with Leanback
Tom Krazit, CNET, 7/7/10

SOMEWHAT RELATED

Jul 6, 2010

Multi-touch and NUI News: NUITEQ's Multi-touch Snowflake Suite for Windows 7

NUITEQ is a company that has been involved in multi-touch technologies for the past few years, and works diligently at ensuring that it keeps up with the evolution in interactive displays and software.  The company's Snowflake Suite is now available for Windows 7, and is compatible with 3M Touch Systems, N-trig, NextWindow, Lumino, and other third-party platforms.  

Here is the current compatibility list, and also a list of Snowflake Suite for Winodws 7 features:


Compatibility
* NextWindow platforms like HP TouchSmart IQ500, IQ770, IQ800 series and the Dell Studio One (all 2 touch)
* N-trig platforms like HP TouchSmart TX2, Dell Latitude XT/XT2 and others
* 3M Touch Systems multi-touch kit
* Lumio platforms
* dreaMTouch
* PQ Labs
* Wacom

Snowflake Suite for Windows 7 Features

* Detailed user manual included with FAQ
* Developed on fast and reliable C++ platform
* Intuitive
* Customizable backgrounds, logo's, images, 3d models, videos etc
* Gesture recognition library
* TUIO / OSC (Open Sound Control) support (sending and receiving events)
* Low level API
* Hardware accelerated rendering
* Support for wide variety of media types (jpg,jpeg,tga,png,dds,gif,tif, tiff, bmp,mov,avi,wav,ogg)
* Advanced window handler that supports scaling and rotation
* Audio support
* Multi-threaded resource handler (For fast data visualization)

Snowflake Suite is also compatible with the following systems:

RELATED 
"The 3M multi-touch displays support up to 20 finger touches simultaneously and come with a one year warranty. NUITEQ's Snowflake Suite, is included at no additional charge, offering the benefits of a complete bundled product of hardware and software, being the perfect solution to get started with multi-touch technology."


http://www.nuiteq.com/images/products_shot.jpg
Photo Credit: NUITEQ

Case Study
"NUITEC freely assisted handicapped children with their education, by applying multi-touch technology for Action For Kids, a UK based national charity working with children and young people with physical and learning disabilities.The children used NUITEQ’s award winning multi-touch software product Snowflake Suite, to enhance their way of learning, by offering a more playful and intuitive solution, in comparison to conventional learning methods."

Samsung Transparent OLED + Wedge Camera, Glassless 3D, Telepresence, Mid-air Interaction: Applying Science at Microsoft

The Microsoft Applied Sciences Group has been working on several projects that have the potential of changing how we interact with various displays and surfaces in the very near future.   Here's some what I came across my RSS feeds and Google Alerts this morning:
INAVATE  July 5, 2010

According to an article in InAVate, "Microsoft has combined Samsung’s transparent OLED with a sub-two-inch camera to revolutionize the Microsoft Surface platform. The touchless telepresence screen creates a 3D gesture-control interface that tracks movement by seeing through the display. The company’s Applied Sciences Group has also added its recently revealed wedge shaped lens, that InAVate reported on last month, to deliver glasses-free 3D content...the latest breakthrough could revolutionize the Surface concept, taking touch away from the display and projecting the images in 3D.-InAVate 7/5/2010


3D Gesture Interaction

"In this demonstration, we've placed the Microsoft Applied Science's wedge technology behind Samsung's transparent OLED display. This enables a camera to image through the display, see the user's hand above it, and alter the image based upon her gestures." -Microsoft Applied Sciences Group

3D Without the Glasses: A new type of display from Microsoft produces multiple images and tracks the viewers eyes - Kate Greene, MIT Technology Review (6/11/2010)

According to an article in MIT's Technology Review, "the new lens, which is thinner at the bottom than at the top, steers light to a viewer's eyes by switching light-emitting diodes along its bottom edge on and off. Combined with a backlight, this makes it possible to show different images to different viewers, or to create a stereoscopic (3-D) effect by presenting different images to a person's left and right eye. "What's so special about this lens is that it allows us to control where the light goes," says Steven Bathiche, director of Microsoft's Applied Sciences Group." -Kate Greene, Technology Review

Steerable Multi-view Display

"In this demonstration, we use head tracking to determine where multiple users are. Then, with the Microsoft Applied Sciences' wedge technology, we steer completely independent images to each user. In the video, one user is seeing a sun while at the same time another is seeing a rocket. This is maintained even as the users change positions relative to each other." -Microsoft Applied Sciences Group
Transparent Display for Telepresence

"In this demonstration, we've placed the Microsoft Applied Science's wedge technology behind Samsung's transparent OLED display. This enables a camera to image directly through the display. In the video, objects held up to the screen are captured and shown to the user on the other side of the telepresence communication (the other monitor in the video), while far away from the screen, the display shows the user a view dependent image."-Microsoft Applied Sciences Group
Steerable 3D Auto Stereo Display

"In this demonstration, we use head tracking to determine where a user's eyes are. Then, with the Microsoft Applied Sciences' wedge technology, we steer different views of the scene to each eye to produce a 3D image without the need for glasses or for fixing the location of the user." -Microsoft Applied Sciences Group
Mid-air Interactive Display

"In this demonstration, we illuminate objects above the display with infrared light. We capture the reflection using the Microsoft Applied Sciences' wedge technology. This enables us to see above the display while keeping the form factor small. Seeing above the display allows us to track the interaction between direct contacts on the display. In the video, the user associates a function (color choice) with one hand and a different function (zoom/rotation) with the other hand. This tool persistence is maintained regardless of the relative positions of the hands." -Microsoft Applied Sciences Group

RELATED
About Microsoft Applied Sciences Group
"The Applied Sciences Group (ASG) is an applied research and development team dedicated to createing the next generation of computer interaction technologies.  The interdisciplinary group focuses on the synergy between optics, electronics and software to create novel human computer interfaces.  The ASG is part of the Entertainment and Devices Division at Microsoft Corp. and mainly supports projects for Microsoft Hardware, XBox, and Microsoft Surface.  It also works closely with Microsoft Research."