Showing posts with label NUI. Show all posts
Showing posts with label NUI. Show all posts

Oct 25, 2009

GDIF: Gesture Description Interchange Format, a tool for music-related movements, actions, and gestures.

There has been a flurry of work in the computer music technology world that relates to what has been going on with interactive display technology, multi-touch & gesture interaction. I came across a link to the GDIF website when I was searching for information about interactive music and the use of multi-touch technologies for a future blog post.   

So what is GDIF?  Gesture description interchange format

"The Gesture Description Interchange Format (GDIF) is being developed as a tool for streaming and storing data of music-related movements, actions, and gestures.  Current general purpose formats developped within the motion capture industry and biomechanical community (e.g. C3D) focus mainly on describing low-level motion of body joints.  We are more interested in describing gesture qualities, performer-instrument relationships, and movement-sound relationships in a coherent and consistent way.  A common format will simplify working with different software, platforms and devices, and allow for sharing data between institutions."  (The Jamoma environment is used to prototype GDIF.)


Alexander Refsum Jensenius is the man who initiated the GDIF project.  He's written a variety of articles about music, gestures, movement, and emerging technologies.  


Here's Alexander's bio"Alexander (BA, MA, MSc, PhD) is a music researcher and research musician working in the fields of embodied music cognition and new interfaces for musical expression (NIME) at the University of Oslo and at the Norwegian Academy of MusicHe studied informatics, mathematics, musicology, music performance and music technology at UiOChalmersUC Berkeley and McGill. Alexander is active in the international computer music community through a number of collaborative projects, and as the initiator of GDIFHe performs on keyboard instruments and live electronics in various constellations, including the Oslo Laptop Orchestra (OLO)."




Related Publications
Godoy, R. I., E. Haga, and A. R. Jensenius (2006b). Playing `air instruments':Mimicry of sound-producing gestures by novices and experts. InS. Gibet, N. Courty, and J.-F. Kamp (Eds.), Gesture in Human-Computer Interaction and Simulation, GW 2005, Volume LNAI 3881, pp. 256{267.Berlin: Springer-Verlag.
Jensenius, A. R (2009): Motion capture studies of action-sound couplings in sonic interaction. STSM COST Action SID report. fourMs lab, University of Oslo.
Jensenius, A. R. (2007). Action - Sound: Developing Methods and Tools to Study Music-related Body Movement. PhD thesis. Department of Musicology. University of Oslo, Norway
Jensenius, A. R., K. Nymoen and R. I. Godoy (2008): A Multilayered GDIF-Based Setup for Studying Coarticulation in the Movements of Musicians. Proceedings of the International Computer Music Conference, 24-29 August 2008, Belfast.
Jensenius, A. R., T. Kvifte, and R. I. Godoy (2006). Towards a gesture description interchange format. In N. Schnell, F. Bevilacqua, M. Lyons, and A. Tanaka (Eds.), NIME '06: Proceedings of the 2006 International Conference on New Interfaces for Musical Expression, Paris, pp. 176{179. Paris: IRCAM { Centre Pompidou.}
Kvifte, T. and A. R. Jensenius (2006). Towards a coherent terminology and model of instrument description and design. In N. Schnell, F. Bevilacqua, M. Lyons, and A. Tanaka (Eds.), Proceedings of New Interfaces for Musical Expression, NIME 06, IRCAM - Centre Pompidou, Paris, France, June 4-8, pp. 220–225. Paris: IRCAM - Centre Pompidou. [PDF]
Marshall,M. T., N. Peters, A. R. Jensenius, J. Boissinot, M. M. Wanderley, and J. Braasch (2006). On the development of a system for gesture control of spatialization. In Proceedings of the 2006 International Computer Music Conference, 6-11 November, New Orleans. [PDF]

RELATED
"Sonic Interaction Design is the exploitation of sound as one of the principal channels conveying information, meaning, and aesthetic/emotional qualities in interactive contexts."
SID Action has four working groups:
WG1: Perceptual, cognitive, and emotional study of sonic interactions
WG2: Product sound design
WG3: Interactive art and music
WG4: Sonification



    "SoundHack was my main thing for a long time, and I poured a lot of effort into it. It was the place I put my ideas. I did have something of a mission with SoundHack. I wanted to take some computer music techniques that were only used in academia, and get them out there so that all types of musicians could use them."-Tom Erbe  SoundHack Spectral Shapers


Csound Blog "Old School Computer Music"
"Csound is a sound and music synthesis system, providing facilities for composition and performance over a wide range of platforms. It is not restricted to any style of music, having been used for many years in the creation of classical, pop, techno, ambient, experimental, and (of course) computer music, as well as music for film and television."-Csound on Sourceforge


Quote from Dr. Richard Boulanger (Father of CSound):
"For me, music is a medium through which the inner spiritual essence of all things is revealed and shared. Compositionally, I am interested in extending the voice of the traditional performer through technological means to produce a music which connects with the past, lives in the present and speaks to the future. Educationally, I am interested in helping students see technology as the most powerful instrument for the exploration, discovery, and realization of their essential musical nature - their inner voice."


Upcoming post about innovations at Stantum:
I'll be focusing on Stantum and its music and media technologies division, JazzMutant. in my next post. It is interesting to note that the co-founders of Stantum, Guilliam Largilleir and Pascal Joget, have a background in electronic music.  Guiliam specializes in multi-modal user interfaces and human-machine interface technologies. Pascal has a background in physics and electronics, and has worked as a sound engineer.


My music back-story:



The very first computer-related course I took was Computer Music Technology (in 2003), since I play an electronic midi/digital keyboard and previously tried to teach myself a few things, long before computers and related technologies were "easy" for me to figure out.  During the mid-90's, I tried my hand at Dr. Richard Boulanger' CSound, and tried to acquaint myself with tools from Cycling'74, but I gave up.  Not long after that, bought the first version of MOTU's  Freestyle, which nicely worked on my Performa 600, hooked up to my Ensoniq 32, after the nice people at MOTU sent me an update that was compatible with my set-up.  Later on,  I came across Tom Erbe's SoundHack freeware.   


A lot has changed since then! 




Oct 21, 2009

The WSN-Bar: Ambient Intelligence + Wireless Sensor Network + Interactive Touch Technology + Art

AMBIENT INTELLIGENCE + WIRELESS SENSOR NETWORK + INTERACTIVE TOUCH TECHNOLOGY + ART


Graduate students at the Center for Art and Technology -Taipei National University of the Arts,created a interactive touch creation, called the WSN-BAR, based on the concept of ambient intelligence, utilizing a wireless sensor network and vision-based tracking technologies. The video below demonstrates two modules, the Garden of Light, and Vivacious Bushes.

According to information from the WSN-Bar website, the installation detects the changes in the brightness of the environment, temperature, the C02 density of the outdoor air, and the movement of people within a building. This technology works in harmony to support the artistic focus of the WSN-BAR. It provides a means of looking at environmental factors and the relationships between humans and nature, in an innovative way. 

WSB-Bar


The WSN-Bar was created by Jiun-Shian Lin, SuChuHsu, and Ying-Chung Chen. The artwork was by Chiung-Fang Tsao, Chia-Wen Chen, Yu-Hsiung Huang and Yi-Wei Chia.  I'm not sure who created the relaxing ambient background music in the video.


 
 -Interactive WSN-Bar


Wireless Sensor Networks:  a building block for Mass Creativy and Learning (pdf)
(To appear in the Proceedings of ACM Creativity & Cognition 2009 - Understanding the Creative Conversation)

Thanks to Kevin O'Mahony for the link!

RELATED
ACM Creativity & Cognition 2009
Everyday Creativy: Shared Languages & Collective Action
Octobmer 27-30 2009
Berkeley Art Museum & UC Berkeley
 
KEYNOTE SPEAKERS
Mihály Csíkszentmihályi Professor of Psychology & Management
Claremont Graduate University [California, USA]

JoAnn Kuchera-Morin Director, Allosphere Research Laboratory
Nanosystems Institute [California, USA]


Jane Prophet Professor of Interdisciplinary Computing
Goldsmiths University of London [London, UK]

Oct 18, 2009

Techies: How to do Multitouch with Windows Presentation Foundation 4 using Visual Studio 2010

Here is the "how-to" video. I don't have WPF4 or VS2010, so I haven't tried this at home...yet.



I came across this video on Vinod Varma's Software Engineer's blog post, "Multi-touch programming getting simpler."


I'm sure I'm not alone in my present dilemma. I have a burning desire to experiment with multi-touch and Adobe's products, since I used to use Macromedia Studio quite a bit several years ago. Instead of learning ActionScript 3.0, I decided to learn C# and XNA Game Studio, and then went on to play with Windows Presentation Foundation, Expression Blend, and Silverlight.


And what about multi-touch web applications?!

Oct 15, 2009

Interactive Motion Graphics Showreel from Filmview Services - great content!

Here is a showreel from Filmview Services that simulates how tech-usability in an interactive gesture/touch world should be!



Here is a quote from the Filmview Services blog:


What Are Screen Graphics?

"...So it works out more cost effective for the films to actually have someone put the graphics on the screens for real. It also greatly enhances the performance of the actors. You only have to watch any of the Star Wars Eps 1-3 to see how wooden acting is when you don’t actually know what is in front of you. Actors love to be able push buttons and bang touch screens during their scenes. Having to actually do it in a certain order can stretch their capabilities mind you, and I am pretty gob smacked at how absolutely computer illiterate some of them are. Don’t they use email?


Anyway, due to this diminished ability to hit and bang things in any certain order, it is our job to make it impossible to mess things up. That’s why they are all genius typers. We make it so they can type any old thing and the letters still come out the way they are meant to each time. We also put little locking codes into our programming so they can’t accidentally escape the graphic mid job. It’s amazing how many of them can type the Esc button when they are meant to be spelling LOGIN."

Thanks, Tim!

SOMEWHAT RELATED
Coincidentally,  when I was visiting the NUI-Group forums this morning, I came across a link to Jakob Nielsen's "Usability in the Movies -- Top 10 Bloopers", which are worth taking a look at. I've posted the list, but you'll need to go to Nielson's web page to read the descriptions. You'll smile.

1. The Hero Can Immediately Use Any UI
2. Time Travelers Can Use Current Designs
3. The 3D UI
4. Integration is Easy, Data Interoperates
5. Access Denied/Access Granted
6. Big Fonts
7. Star Trek's Talking Computer
8. Remote Manipulators (Waldo Controls)
9. You've Got Mail is Always Good News
10."This is Unix, It's Easy"

Oct 9, 2009

WIRED's Overview of Touchscreen PC's and Interface Innovations (and some links for the tech-curious)

According to Priya Ganapati's recent article in WIRED,  only 3% of all PC's and notebooks have interactive touchscreens.  More are coming to market, such as Sony's Vaio L Touch HD PC,  Dell's all-in-one, and Lenovo's tablet PC and ThinkPad laptop.  HP came out with the TouchSmart PC and touch-enabled laptops, and will be adding updated versions soon.

This is a great opportunity for developers interested in touch, multi-touch, and gesture interaction applications.   I think there will be even more opportunity for web developers to create websites that are touch-enabled, or at least optimized for touch screen interaction.

Will the  multi-touch web might be right around the corner?    

At the moment, there is some confusion about what designers should consider when developing applications.  There is not standard system of touch or gesture interaction,  and researchers are still very busy figuring things out.   Some companies have rushed out and patented gestures,  which in my opinion, is like patenting how we breath. But that is another story.

If you are a designer or developer, you might be interested in the Touch First Microsoft Surface Developer Challenge.  It is a chance to win your very own Microsoft Surface!  Hurry, the deadline is October 12th.

If you want to learn more, read WIRED's Gadget Lab:  "Touchscreen PC's Prompt Interface Innovations" for a good overview of what's happening in the Touch PC world.

If you are curious and would like to dig deeper into this topic, take some time to look at some of my blog-posts about multi-touch, touch screen news, innovations, and related musings:

The World Is My Interface:  An Introduction (and some links)
Interactive Touch-Screen Technology, Participatory Design, and "Getting It".
Multimedia and Interaction Resources (a mega-list, work-in-progress)
Bump Top 3D Desktop on a Touch Screen:  Toss Your Photos to your Facebook Icon!
Ron George's Interaction Design Toolbox
So how are people using their multi-touch all-in-ones?  Medion X9613 will be released soon..
Multi-touch, multimedia, multi-modal:  Fujitsu LIFEBOOK 54310 has a multitude of possibilties
Windows Vista User Experience Guidelines: "All Windows programs should be touchable!"

Oct 6, 2009

I want to play with mice! Microsoft's Multiple Multi-touch Mice Preview

Hot off the press from Microsoft's Applied Sciences Group at UIST 2009!
Mouse 2.0: Multi-touch Meets the Mouse

"In this paper we present novel input devices that combine the standard capabilities of a computer mouse with multi-touch sensing. Our goal is to enrich traditional pointer-based desktop interactions with touch and gestures. To chart the design space, we present five different multi-touch mouse implementations. Each explores a different touch sensing strategy, which leads to differing form-factors and hence interactive possibilities. In addition to the detailed description of hardware and software implementa-tions of our prototypes, we discuss the relative strengths, limitations and affordances of these novel input devices as informed by the results of a preliminary user study."

The following video is courtesy of Microsoft's Applied Sciences Group:



Music:  "Motion Blur", by Bjorn Hartman. (Bjorn is an HCI researcher and electronic musician.)

The researchers on the team: 
Nicolas Villar, Shahram Izadi, Dan Rosenfeld, Hrvoje Benko, John Helmes, Jonathan Westhues, Steve Hodges, Eyal Ofek, Alex Butler, Xiang Cao and Billy Chen


Here is a video preview/demo of the multi-touch mice prototypes from Microsoft's Applied Sciences Group Lab, courtesy of CrunchGear:





meese
-CrunchGear

Oct 5, 2009

Good News for Creative Techies: Adobe Flash Player 10.1 Adds Support for Multitouch!

I sort of knew something was going on at Adobe when I posted the following video clip on this blog a few months ago. Rumors can transform into realities, right?

If you want to cut to the chase, sign up NOW to be notified about the BETA release of Flash Professional CS5 BETA:  Adobe Labs:  Adobe Flash Professional CS5 BETA

Here are the new features as described from the CS5 BETA website:

  •  Applications for iPhone — Publish ActionScript 3® projects in Adobe Flash Professional to run as applications for iPhone. Learn more.
  • New text capabilities via the Text Layout Framework (TLF) — Get unprecedented text control and creativity with projects created in Flash. Advanced styling and layout, including right to left text, columns, and threaded text blocks, let you work with text in Flash like never before.
  • XML based FLA files — Manage and modify project assets using source control systems and enable teams to easily collaborate on files.
  • Code Snippets panel — Choose prebuilt code that can be injected into projects to increase interactivity and also reduce the ActionScript 3 learning curve.
  • Flash Builder™ integration — Use Adobe Flash Builder software as your ActionScript editor within projects in Flash.
  • Improved ActionScript editor — Improve productivity with custom class code hinting and completion.
This will give me a reason to brush up on ActionScript.    I'm a code-snippet queen, so I anticipate that I'll love the Code Snippets panel!



Adobe tries keeping Flash in Web vanguard
Stephen Shankland, CNET news 10/4/09


"Flash Player 10.1 also adds support for multitouch user interfaces, which are all the rage for good reason right now because they can enable an intuitive, direct interaction with computing equipment. There have been experiments with multitouch in Firefox, but it's a complicated issue in general since there's some contention about whether the operating system, a browser, or a browser plug-in is in charge of interpreting multitouch commands" 



 

Sep 27, 2009

SpaceClaim's Multi-touch 3-D Modeling Software Video Teaser (with music by Kevin MacLeod)



YouTube Description:
"A preview demonstration of modeling in 3D using a SpaceClaim's prototype multi-touch user interface that will be added to SpaceClaim this fall. Also includes clips of ANSYS Workbench, Blue Ridge Numerics CFdesign, and Bunkspeed Hypershot, showing some finger dancing that you can do without multi-touch."


At the end of the video:

Special Thanks
3M Corporation
ANSYS, Inc.
Blue Ridge Numerics, Inc.
Bunkspeed, Inc.
Microsoft Corporation
N-trig Ltd.
Music: Kevin MacLeod

(I always like product demo video clips that have danceable music with a great beat!)

Much more to come related to this topic!

Sep 26, 2009

More Multi-touch and Gesture-based Natural User Interfaces: Bamboo Wacom Tablet; Multi-touch PresTop Kiosk and Snowflake Suite software

Wacom Tablets Get Multi-Touch, Gestures
(Charlie Sorrel, Wired, 9/24/09)
"For the tech-curious, the new tablets have 512 pressure levels in the pen tip and the active area of the tablet is 5.8 x 3.6 inches, and all lose the in-pack mouse (for obvious reasons). The Touch and the Pen models are both $70, and the Pen & Touch is $100. Also, if you were thinking of buying Photoshop Elements 7 for the same price, get a tablet instead — Elements comes in the box."




http://www.wired.com/images_blogs/gadgetlab/2009/09/cth460k_3-660x371.jpg

Official Wacom Video

"Bamboo Touch is new type of computer input device by Wacom that lets you navigate and perform commands like zoom, scroll, rotate and more with a series of simple finger taps and hand gestures. Bamboo Touch brings Multi-Touch capability to your Mac or PC"

Video from a Wacom user:

A nice alternative to a mouse.  I'm going to get one for my laptop!


Multi-touch Kiosks!
Press release:  Dutch touchscreen supplier PresTop partners with Natural User Interface (NUITEQ)
 
http://prestop.nl/images/gallery/products/st_UU_zuil_wit.png
http://prestop.nl/images/gallery/products/st_DSC02106.png

RELATED

I couldn't find any video clips of PresTop's multi-touch interaction. From what I can tell, PresTop multi-touch screens will be using SnowFlake Suite from Natural User Interface Technogies AB.

How-to:SnowFlake Suite Flash multi-touch Interactable component (NUIversity)

Without a single line of code, you can do quite a bit with Snowflake Suite

"This video covers how to make a rotatable and scalable image. The beauty about this is, that we have developed a Flash mouse input simulator, so that there is no need for multi-touch hardware in order to develop your applications. Simply simulate multiple mouse inputs for multi-touch.This project is still in alpha phase and a download will become available with the next release of Snowflake Suite 1.7 for the NextWindow platform and camera based multi-touch solutions."


Below is a video of single-touch interaction for PresTop, from Omnivision:


PresTop  PresTop offers interactive hardware and software solutions that can be used indoors as well as in outdoor environments.

Sep 22, 2009

Impress: A cool flexible interface project by Silke Hilsing

Impress, a cool flexible interface project by  Silke Hilsing:


impress - flexible display from Silke Hilsing on Vimeo.

From Sike Hilsing's website:

"Impress is the deliverance of the touch screen from its technical stiffness, coldness and rigidity. It breaks the distance in the relationship of human and technology, because it is not any longer the user which is subjected to technology, but in this case the display itself has to cave in to the human. Impress is a chance of approach of user and technology, above all, from technology.


It is a matter of a flexible display consisting of foam and force sensors which is deformable and feels pleasantly soft. Impress works with the parameters position and time like other touch screens as well, but in addition to that, it reacts, above all, on the intensity of pressure."

The application was created with Aruino and Processing.


http://www.silkehilsing.de/impress/blog/wp-content/uploads/2009/03/final_4.jpg



Thanks to Richard Van Tol for the link!

Sep 18, 2009

Engaged, Interactive, Collaborative: Microsoft Surface, Finguistics, and Churchend School in the UK - Watch the video!

Finguistics created educational applications for Microsoft Surface. Watch how engaged the students are in this video as they work in groups, and look at the excitement on the faces of the teachers!



The teachers and students have lots of positive things to say about it. Play = Learn

I would like to have the chance to convert my single-touch prototypes to multi-touch for use on the Surface or something similar, but for now, I'm happy with the newly-installed SmartBoards at my favorite school and the two existing Promethean boards, which are used to deliver interactive, rather than passive learning activities for students with multiple special needs, including autism.

RELATED
Under the Hood with Finguistics
Educators get Microsoft Surface!
(MSDN Academic Alliance subscribers now have access to the Surface SDK Workstation Edition)

Sep 17, 2009

Interactive Touchscreen Displays at the Chicago Botanic Gardens

http://www.chicagobotanic.org/images/masthead/banner_newbuilding.jpg



 http://www.pitchengine.com/brands/15letters/images/25019/economicbotany.jpg
"15 letters, a Chicago-based interactive design company developed eight interactive, educational touch-screen kiosks that will enable Garden visitors to get a hands-on experience in understanding the essential role plants play in every day life and the critical role garden scientists are playing to preserve and better manage natural plant communities."


“Each of the eight interactive touch-screen exhibits in the new Rice Plant Conservation Science Center is dedicated to a specific lab in the facility,” Rattin continued. “We created interactive game-like simulations that will allow visitors to manipulate an environment and see the outcomes of their actions. This hands-on approach to education is becoming more commonplace as museums and research centers are encouraging the development of the next generation of scientists.”

Research laboratories featuring interactive kiosks include:
• Harris Family Foundation Plant Genetics Laboratory
• Economic Botany Laboratory
• Reproductive Biology Laboratory
• Dixon Tallgrass Prairie Seed Bank Preparation Laboratory and Seed Bank
• Herbarium
• Population Biology Laboratory
• Soil Laboratory
• Abbott Ecology Laboratory


For more information, there are a number of videos regarding the Chicago Garden Interactive Kiosk Project



Plant Conservation Science Center Fly-through Simulation



I plan on visiting Chicago again, and I'll make sure I visit the Chicago Botanic Gardens!

Sep 15, 2009

Applications for touch, multi-touch, and gesture interaction: What's Marching to Market?

Every week or so, I hear about a new multi-touch enabled laptop.Today, I came across a review on Gizmodo about the Lenovo ThinkPad T400, which is a 14.1 capacitive touchscreen laptop that can handle four touches at once:

Lenovo ThinkPad T400s with Multitouch Review: Finger Flicking Fun


The Multitouch ThinkPad in Action

Lenovo ThinkPad T400s with Multitouch from Gizmodo on Vimeo.

SCREENSHOT
 http://cache.gawker.com/assets/images/gizmodo/2009/09/SimpleTab.jpg
"The screen is pure beauty. Like a capacitive touchscreen phone, light taps on the display are responsive and you don't have to think about positioning your finger in a certain way to open apps or rearrange windows." - Joanna Stern, Gizmodo, 9/15/09


OTHER EXAMPLES
 
THE FUJITSU LIFEBOOK T5010

Add the Fujitsu LifeBook t5010 to the Windows 7 Multitouch Laptop List
Gizmodo, Joanna Stern, 9/15/09
http://cache.gawker.com/assets/images/gizmodo/2009/09/LifeBook_T5010_multitouch.jpg


DELL LATITUDE XT2
 Dell Latitude XT2 Tablet PC


http://i.dell.com/images/global/products/latit/latit_highlights/laptop-latitude-xt2-overview3.jpg






 












TOUCH DEMO- HP TOUCHSMART TX2 & WINDOWS 7


AIR HOCKEY FOR WINDOWS 7: IDENTITY MINE


FINGERTAPPS





Want to create something multi-touch?

It looks like there will be a growing need for Windows 7 application developers.  Here's some code examples using Windows Presentation Foundation and the Windows 7 Multitouch API

Windows 7 Multitouch Application Development, Part I (The Code Project: Kunal Chowdhury)


Other Developer Resources

Touchlib Multi-touch Development Kit  (NUI GROUP)

MSDN Windows Touch: Developer Resources

nTrig's Multi-Touch Download for Windows 7

NUITech's Snowflake Suite for NextWindow

TouchKit Multi-touch Development Kit


GestureWorks Flash Multitouch SDK

3M Multi-touch Developer Kit


RELATED
Touch-less Interaction from lm3labs

Create the future you want. with ubiq'window from Nicolas Loeillot on Vimeo.

More about gesture interaction and multi-touch can be found on this blog- do a search!

Sep 11, 2009

Ru Zarin's Interactive Multi-touch Applications for the Cognitively Disabled: Social stories, talking symbols, a piano, and more!

 http://uidresearch.files.wordpress.com/2009/07/multi_touch_trollskogen_1024.jpg


Trollskogen Final Demo from Ru Zarin on Vimeo.

The above video is a demonstration of Ru Zarin's masters degree project at Umea Universitet.

This project examined ways to use multi-touch technologies to support communication and learning among children with Down syndrome, autism, and related diagnoses within the age group of 5-8. I especially liked the animated social story application.

"Trollskogen is a communicative framework designed to enhance communication among people with cognitive disabilities. The forest is split up into interactive modules that provide a fun and engaging learning environment while helping improve on certain aspects of speech, reading/writing and symbol based languages. This framework has been deployed on a custom multi-touch table prototype built at the Interactive institute Umeå, enabling the children to interact with their fingers in a more natural, intuitive way rather than a traditional keyboard/mouse setup."

RELATED READING
RELATED VIDEOS OF THE PROJECT DEVELOPMENT

Ru collaborated with the illustrator Linda Arvidsson for the characters and objects found in the troll forest theme.  

I especially liked the Troll Forest Cabin, which is shown in the social stories section of the video.

http://uidresearch.files.wordpress.com/2009/05/sketch_cabin.jpg

Cross-posted on the TechPsych blog.

Sep 7, 2009

Multi-touch, multimedia, multi-modal: Fujitsu LIFEBOOK T4310 has a multitude of possibilities!

Multi-touch, multi-media, multi-modal... the Fujitsu LIFEBOOK T4310 looks like it provides multiple possibilities for people from all walks of life:

-GestureWorks

The LIFEBOOK T4310 comes with an integrated web cam and fingerprint reader, and a variety of I/O options, including HDMI, USB, Firewire, BlueTooth,  LAN, analog video output, SD card reader, line in/out, a wireless switch for the integrated 3G and UMTS, and an express card reader. There is an optional modular bay that can accommodate an additional drive or battery.


The fun part is that the Fujitsu LIFEBOOK T4310 hands-on comes with Microsoft's Touch Pack applications, which are demonstrated in the video below:
  • Microsoft Surface globe
  • Surface Collage
  • Microsoft Rebound touch game
  • Surface Lagoon screensaver, which provides a water-ripple effect and little fish that respond to touch interaction.



As demonstrated in the video, the LIFEBOOK supports gesture interaction, multi-touch interaction, stylus interaction, and traditional keyboard interaction. The capacitive display has a bi-directional hinge, allowing it to be turned 360 degrees, and also positioned so that the display can be set facing up horizontally over the keyboard. (This feature would be welcomed in educational settings, if the notebook was used in education settings, as it could support paired and group collaborative learning activities.)


What I like about the LIFEBOOK is that it has an integrated ambient light sensor, which automatically adjusts the brightness of the display according to the level of light in the environment. This feature is important for people like me who are on the go and must use their computing devices under a range of lighting conditions.


I would love to get my hands on the Fujitsu LIFEBOOK T4310 for a month and test the system in-depth in my day-job as a school psychologist, and in my leisure pursuits as a UX/designer/developer/musician/gamer/etc,  "hobbyist".


Can anyone make this dream come true?


RELATED:
Fujitsu's multitouch LIFEBOOK T4310 tablet makes quick work of Microsoft's Touch Pack 
(Paul Miller, Engadget, 9/6/009)
Microsoft Touch Pack Gallery (Engadget)
Engadget's Reader Comments


I visited Fujitsu's website to gather additional information, and found a couple of press releases in German:


IFA 2009:  Fujitsu setzt auf Fingerspitzengefuhl und prasentiert  Notebook mit Multiple-Touch-Function (pdf)


Here is the press contact:


Fujitsu Technology Solutions
Melanie Wolf, Senior PR Manager
Tel.: + 49 (0) 89 62060 4458, Mobile: + 49 (0) 171 33 42 882,
Melanie.wolf@ts.fujitsu.com

Sep 6, 2009

Interactive Memorabilia at the Hard Rock Cafe: Microsoft's Multi-touch Rock Wall, Companion Surface Installations, and Awesome Touch-Responsive Interactive Memorabilia Website.

UPDATE: Video of Hard Rock Cafe's Memorabilia Multi-touch Wall



I came across the updated Hard Rock Cafe website and found that it provides an awesome interactive experience!  Visitors can explore the extensive Memorabilia collection in detail. This site is almost ready for inclusion in my UX/Interactive Hall of Fame!

According an article posted on the Hospitality Technology website, ""Tech, Love, and Rock 'n' Roll,  the website was built using Silverlight, and is part of an initiative to expand the reach of the Hard Rock Cafe's extensive memorabilia collection.

"It all started last year with what we call 'Memo 2.0,'" [for memorabilia 2.0] and the rollout of Microsoft's new Silverlight (www.silverlight.net) technology, explains Joe Tenczar, senior director of technology and CIO for Hard Rock International. Silverlight is a web application framework, similar in scope to Adobe flash, that lets companies build custom apps. Hard Rock partnered with its brand agency Duncan/Channon (www.duncanchannon.com) and software developer Vertigo (www.vertigo.com) to create a custom Silverlight application for www.hardrock.com."


Below is a video of the website when it was still under development, unveiled during a MIX08 keynote:


The website is a companion project that is part of a bigger vision that includes an 18-foot interactive multi-touch wall that mirrors the Memorabilia website.  The article goes on to mention that the "Rock Wall can be used by one person to blow up a piece of memorabilia as large as the screen, or optimized for six different user experiences at one time, though the technology has been tested for responsiveness to hundreds of simultaneous touches. "Imagine seeing Bob Dylan's Harley at more than life size; big impact," says Tenczar....Rock Wall uses a single piece of Stewart projection glass, custom-made at the factory for Hard Rock, along with three Christie projectors, numerous lasers, and multiple IR cameras to create a unified projection and touch experience. "The graphics are driven by a Nvidia Quadro Plex and there are two other dedicated servers for localized content and physics. I have seen a lot of cool technology, but this still makes my jaw drop whenever I see it in person." And the technology is smart. "If I walk up to the screen, it will blow up where I am."
 
According to information from the Hard Rock Cafe's press release, the interactive wall was created by Obscura Digital, a company located in San Francisco, along with Technomedia Systems was also involved in this project.  Here's a quote from the press release:

"We were excited to work with Hard Rock on this revolutionary project," said Obscura Digital CEO Patrick Connolly. "This is the longest, largest and most technologically sophisticated multi-touch wall we’ve built. It utilizes our newest Fireframe technology, and the result is the highest resolution, seamless multi-touch display we have ever seen. We are delivering a 6000 x 1000 pixel display, so that multiple users at a time can enjoy the vast Hard Rock Memorabilia collection in stunningly high resolution. With this display, customers can literally zoom so deep into the images, that things like a scratch on Buddy Holly's glasses can be seen 3 feet wide. The graphic quality of this system is something the public has never seen, and the impact on the customers is something they will not soon forget." 
Hard Rock Cafe Multi-Touch
In addition to the website and Rock Wall, booths at the Hard Rock Cafe provide customers with access to music videos from a video distribution server, or VDS, created by Coleman Technologies.  Each booth's touch screen display terminal has its own computer, and this allows guest control over the music videos that are played at the cafe.  Content from the memorabilia system can be explored by customers right from the booth, from what I understand.

http://www.duncanchannon.com/wp-content/uploads/2009/09/hard-rock-microsoft-surface.jpg

Microsoft's Surface tables were installed in the cafe, running a custom application created by Vertigo. that allows customers to interact with a spinning globe to locate and explore other Hard Rock Cafe's around the world.





Memorabilia Website UX:

Unfortunately, I am not in Las Vegas, so I haven't had a chance to interact with the Hard Rock Cafe's Rock Wall or any of the Microsoft Surface installations, which are the centerpiece of this project.

Not to worry. The companion Hard Rock Cafe Memorabilia website, experienced from the comfort of my home on an HP TouchSmart PC, provides a great user experience, even thought it is not fully optimized for touch navigation.

One of the things that I like about the site is that it uses Microsoft's Deep Zoom feature. When you zoom in, you can explore each photo without sacrificing resolution, and explore everything in minute detail.

If you want to try your hand at touch navigation, you will be pleasantly surprised, even though you will have to rely on your mouse at times. To zoom in, tap the initial presentation screen, and use your fingertips to pan around. What you touch and release won't go flying about the screen, which is a good thing.

If you lightly tap an item of interest, you will get a translucent information box on the right side of the screen. The information box might include video clip of an interview with a musician, a story, and a means to share the experience through embedding a widget on your website or blog, posting a link, or emailing a link.

After poking around the site using Firefox, I switched to Internet Explorer, turned the zoom setting to 125%, and had no difficulty using my right index finger to navigate through the information box. (It was more difficult to do this using Firefox.)

The directions for traditional navigation are simple:

"Turn on, zoom in, zoom out. Use your mouse wheel to zoom in and out. You can also zoom in by clicking and zoom out by shift-clicking. To pan, click and drag."

Featured artists on the Memorabilia site include The Who, The Beatles, James Brown, John Lennon, Bob Dylan, Guns N'Roses, Buddy Holly, Madonna, Motley Crue, Elvis Presley, Queen, and The Rolling Stones. You can sort the main presentation page by artist or year, and explore the collection by artist, type of item, genre of music, decade, and location.

This website provides an interactive, user-friendly means of exploring the history of rock music. (It would be cool if the site offered some form of interactive sound track.)

I'm impressed.

I embedded the widgets below from the Memorabilia site. I wasn't sure exactly what might turn up. The interactive widgets, created with Silverlight, went beyond my expectations.  You can explore the content right from this post, if you have Silverlight installed:





I shot some HD video of my touch interaction of the website and will post the videos as soon as I can. For now, take a look at some of the screen shots:

Main portal:



















Eric Clapton's Guitar and Backstory:


















Screen shot of memorabilia sorted by type - instruments:


















Zooming in:



















Screenshot of Gibby Hayne's art:




















Detail of one of Madonna's decorative costumes:


Sep 5, 2009

More Multi-touch: Packard Bell's Viseo 200T Touch Edition; oneTwo M and L All-In-One; MSI's HD AE2400

More multi-touch!


Packard Bell Press Release: oneTwo M and oneTwo L press release (pdf)


"The use of multi-touch technology is expected to rapidly expand because it provides a fast and
intuitive interface for the user. In fact, it is not meant for computer literate or techno-maniacs, it’s addressing users who want easy-to-use and complete digital solutions, who love unique and expressive style.The Packard Bell oneTwo Series gathers all these needs into an all-in-one PC with easy-to-use touch-screen technology, eye-catching style, and fantastic entertainment and media sharing."

Packard Bell Press Release:  Viseo 200 Touch and enjoy! (pdf)

The MSI promotional video shows some interesting touch-screen interaction with the media. I'm not sure how much of this video is special effects!



MSI had a contest for people to create and share their videos to promote the benefits of touch screens over traditional PC's. Here's the promo for the contest:



The videos can be seen on the MSI contest website or on YouTube.

It is rumored that MSI will be releasing a multi-touch all-in-one sometime in the future, the MSI AE2400.


I haven't had a chance to test out any of these computers.  If you have had the opportunity, please leave a comment.

I'm hoping that there will be an influx of great touch and multi-touch applications in the future.  Multi-touch web browsers exist, but are only in the experimental phase, as far as I know, and most web-sites are not optimized for even single-touch interaction.

Sep 3, 2009

The Future of Interactive Technology: Links to VentureBeat's series of articles

Put your finger on it: The future of interactive technology
Matt Marshall, 8/12/09

"Touch" technology for desktop computing finally taking off
Al Monro (CEO, NextWindow) 8/28/09

hptouchsmart

Speech, touchscreen--been there, done that. What's the user interface of tomorrow?
9/2/09 Mary Czerwinski (Microsoft)
mundie_interface
How phones emerged as main computing devices, and why user interface will improve

Andrew Hsu (Synaptics) 8/24/09

SOMEWHAT RELATED

Playing Tetris could be good for your brain, study says

tetris-2


Mind Research Network
BRAIN IMAGING SHOWS PLAYING TETRIS LEADS TO BOTH BRAIN EFFICIENCY AND THICKER CORTEX

"Over a three-month period, adolescent girls practiced Tetris, a computer game requiring a combination of cognitive skills. The girls who practiced showed greater brain efficiency, consistent with earlier studies. Compared to controls, the girls that practiced also had a thicker cortex, but not in the same brain areas where efficiency occurred."

"We showed that practice on a challenging visuospatial task has an impact on the structure of the cortex, which is in keeping with a growing body of scientific evidence showing that the brain can change with stimulation and is in striking contrast with the pervasive and only-recently outmoded belief that our brain’s structure is fixed,” said Dr. Sherif Karama, a co-investigator at the Montreal Neurological Institute. This study, published in the open-access journal BMC Research Notes, is one of the first to investigate the effects of practice in the brain using two imaging techniques. The girls completed both structural and functional MRI scans before and after the three-month practice period, as did girls in the control group who did not play Tetris. A structural MRI was used to assess cortical thickness, and a functional MRI was used to assess efficient activity."