Photo of MuchoWall, an 80" multimodal sensitive wall from Tangible Displays (Jimmy Hertz, Founder)
Jimmy Hertz is a member of the NUI-Group and has been involved in various activities to spread the world about natural-user interfaces and interaction.
Be sure to watch the entire video. It is almost like watching a dance performance when you watch artist interact with the display.
I'm sure I'm not alone in my present dilemma. I have a burning desire to experiment with multi-touch and Adobe's products, since I used to use Macromedia Studio quite a bit several years ago. Instead of learning ActionScript 3.0, I decided to learn C# and XNA Game Studio, and then went on to play with Windows Presentation Foundation, Expression Blend, and Silverlight.
BEN, or Breakable Experiemental Network, is a mix of network visualization and multi-touch technology on a very large screen. The project aims to provide better network monitoring and management tools in a user-friendly, intuitive and efficient manner. It is also looks like great tool for learning about network engineering.
Near Interaction is a company based in Lisbon, Portugal, and London, England. They are a team of interaction and media designers, focsuing on interactive physical and digital installations. Here is a sample of their work:
Information about the Fashion Graduate Exhibition 2009 from NearInteraction's Vimeo site: "The London College of Fashion Graduate Exhibition 2009 displays six multi-touch tables with integrated object recognition to unveil the 570 student portfolios. From a wide choice displayed on the three walls, visitors can make a selection of their preferred cards. Activating once a card is placed on the tables, visitors can move, zoom and rotate by touching the surface of the table a variety of portfolio images representing the chosen student...London College of Fashion Graduate Exhibition 2009 was designed and produced by NearInteraction in association with Paul Albert and John Nussey."
London College of Fashion Graduate Exhibition 2009
"As part of Future Labs - Visual Experiences of the Future at FPC, Tangible Multi-touch Connectivity explores the multi-touch gestural concepts of touch to activate, pinch to enlarge and scroll to select within a multi-user environment, combined with the interaction concepts of user-identity, networks, and behavioural lifespan through a metaphorical game."
NearInteraction Playtecture: Physical + Digital + Kids + Play
Looking for something techy, yet touchable? More multi-touch screens will be on the market soon from HP.
Video of the HP TouchSmart PC 300 and 600
Information from the HP YouTube website:
Two new HP TouchSmart PCs packed with exclusive touch applications, the HP TouchSmart 300 and HP TouchSmart 600, feature stunning HD displays with a multitouch enabled screen. Consumers can now stream Netflix movies, watch TV programs, listen to music and internet radio, create photo collages and bring out their inner chef all by simply touching the PC screen. The new consumer PCs feature exclusive built-for-touch applications including: Hulu Desktop, Netflix, Twitter, the HP Music Store powered by Rhapsody, Pandora Internet radio the TouchSmart Recipe Box, and Canvas. The 16:9 widescreen tiles make multimedia, social media and other applications a rich and engaging touch experience. Some models of the HP TouchSmart 600 easily connect to gaming consoles, including Xbox, PlayStation and Wii, via HDMI or composite video ports. The HP TouchSmart 300 starts at $899 and is offered in a 20-inch diagonal widescreen (available Nov. 1). The HP TouchSmart 600 starts at $1,049 and is offered in a 23-inch diagonal widescreen (available Oct. 22).
I like the new features, especially the tilt webcam, the swivel that lets you swivel the screen around as needed, and the recipe box application. The a digital recipe box "scrapes" recipes from on-line websites, and allows you to listen to the recipe through a blue-tooth earphone. The recibe box applications will talk to you as you prepare a meal, hands-free!
For businesses that are looking for high-definition interactive kiosks, 43-inch HP LD4200, diagonal digital signage touch display might be a great solution:
"Aimed specifically at the digital signage market, with HP noting is suitability for kiosks, retail, point of sale, shopping malls, travel terminals, hotel lobbies, recreational venues, universities, stock exchanges and hospitals, the new 42” HP LD4200tm multitouch LCD display offers Full HD (1080p) resolution and, thanks to utilising infrared and imaging sensors, will happily acknowledge touch commands such as zoom pinching and drag scrolling thus bringing true interactivity to information and advertising visualisations...On top of its mulittouch capabilities the HP LD4200tm boasts ultra-wide 178 x 178 degree viewing angles and is set to ship from December with a price tag of just shy of $2,800" - Andrew Tingle, TFTS
Note: NextWindow is the creator of the touchscreens.
Above is a link to my TechPsych post about the Cook Children's Health Care System's use of multi-touch technology for children and teens who have suffered traumatic brain injuries or have other significant neurological disorders.
Here are a couple of kids on Ideum's MT-50 multi-touch, multi-user table. You can see the delight!
The picture was taken from the videoclip below:
According to information from the video, the MT-50 screen provides a higher resolution than Microsoft's Surface. It comes with bundled with GestureWorks, a software development kit that works with Adobe's CS4, and NUITech's multi-software product, Snowflake Suite.
The MT 50 is designed for use in interactive museum exhibits, but in my opinion, holds great potential for use in public libraries and K-12 media centers (libraries), and even in classroom settings.
A reader brought to my attention the work of EyeClick, an interactive multimedia advertising company that has been around for a few years. They create interactive floors, and use "intuitive body motion with floors and surface areas". -EyeClick
I've included several videos below, but for more information and related details, check out EyeClick's product page, which has a nice showreel, and information about the benefits of interactive marketing.
EyeClick appears to be similar to lm3labs, a company I've posted about previously.
I took a look at an on-line community, Dance-Tech.NET which focuses on the "interdisciplinary explorations on the performance of motion". I was happy to find that two people I know are members of this vibrant group of people:
Celine Latulipe
Dr. Celine Latulipe is a Human-Computer Interaction researcher at the University of North Carolina-Charlotte. She is the lead in the Dance.Draw project, a collaboration between the Software and Information Systems department, the Department of Dance, and a digital artist.
As Celine puts it, "You are more than your eyes and one hand. Why should you have to be less than you are when confronted with a digital device? Exquisite interaction is a collection of research projects...that aim to enrich your expressive creativity in the digital realm by allowing you and your collaborators to use more of your body in that digital interaction"
Doug Foxcreated and maintains theGreat Danceand Kinetic Interface blogs. When he was 42, he decided to study dance - modern, ballet, and jazz. He is interested in the intersection of dance and technology, and more recently became involved in the study of animation related to dance and movement.
The following is from Doug's "About" page - the videos and links are worth exploring:
"As a starting point, I'd like to encourage readers to visit the Movement Is at the Heart of Scientific and Technological Change background page. Here you will find 16 videos (plus links to more videos) that show in very concrete terms how new computer interfaces and digital devices being used in a range of fields are, in essence, body-centric and movement-centric..."
Contest winners were paired with choreographers, who created a new dance work based on a peer-reviewed article in a scientific journal. (The Science Dance Match-Up Challenge)
I just had to post the videos here - you can read detailed descriptions about each video on YouTube:
The role of Vitamin D in beta-cell function
Cerebral activation patterns induced by inflection of regular and irregular verbs with positron emission tomography: A comparison between single subject and group analysis
A Molecular Dance in the Blood, Observed
Popular Choice: Physics Tango "Single Molecule Measurements of Protelomerase TelK-DNA Complexes."
The four videos generated by the professional choreographers can be accessed on Vimeo.
Links to the scientific articles, the bios of the choreographers and scientists, and videos of the choreographer's renditions of the scientist's work can be found on the Science/AAAS website:
The Gonzo Scientist: The Science Dance Match-Up Challenge John Bohannon, Science, 4/17/09 SOMEWHAT RELATED Usually I reserve this section for links and information from external sources, but this time, I thought I'd share a few of my opinions that are somewhat related to this topic.
Why do I think interdisciplinary pursuits are important?
In my opinion, to move forward, the arts and other disciplines need to embrace the interdisciplinary way of thinking. There is much that is mixing and converging as I type these words. There is less emphasis for young people to pick one little corner of a field of study and make it their life's obsession. I have always had an "interdisciplinary" approach to life, ever since I can remember. I attribute this to my parents, who nurtured me as a musical, dancing, artistic child to pursue my talents at a young age, and when faced with choosing a college major, to go for a double major.
My interdisciplinary nature has fueled my journey into the world of technology, and my early background in the arts probably explains why I'm excited about interactive multimedia, extending into the realms of emmersive games, multi-touch and gesture interaction, and technology-supported interaction that takes place in larger public spaces.
Note:
As many of my readers know, I work as a school psychologist in my "day job". I DO miss the time when I was working part-time and taking graduate classes at UNC-Charlotte, but when the economy went downhill, It was necessary for me to return to work full-time.
The upcoming academic year will be busy! With the recent budget cuts to school districts in the in the state of North Carolina, I will have another school added to my schedule. I'm excited that it is a high school for technology and the arts, and that the school has a strong dance program!
I've posted quite a bit recently, since I have plenty to share. Soon I will only have time to post about 3 times a week.
I have Numpty Physics on my Nokia n800 internet tablet, and Crayon Physics on my HP TouchSmart PC. Both are designed for single touch, and are fun to play. Since my TouchSmart can handle duo-touch input, I wondered what Crayon Physics might be like if it supported two players at once.
As you can see from the video, Thomas Perl and his colleagues have figured this out- at least with Numpty Physics!
Numpty Physics and Crayon Physics both use the Box2D engine. Here is some information from the website: "NuMTyPYsics are our enhancements to Tim Edmond's NumptyPhysics game. We added support for receiving TUIO messages from tbeta via PyTUIO by embedding an Python interpreter into the NumptyPhysics code. Currently, we simply emulate mouse input by pushing hand-crafted input events (SDL_Event) onto the SDL event queue (SDL_PushEvent). In the future, we plan to do bi-directional communication between the game engine (written in C++) and our multi-touch handling code, which will be written in Python." -Thomas Perl
Note: I've use Crayon Physics Deluxe with several of the students I work with who have severe autism. It is amazing how well they can figure out solutions for the levels. It would be even better if it could be enabled for duo-touch. It supports joint attention, which is a very important social interaction skill for young people with autism to develop.
"Introducing The Cube - a compact, turnkey, 'plug and play' interactive display unit that brings the power of gesture control to a variety of display spaces. Project the interactive 80” diagonal display onto almost any floor, wall, table or counter for branding, advertising, entertainment and product promotion. The Cube will engage customers, turn heads and drive business results." Brochure (pdf)
I came across the Multi-touch 360 project today and I thought it would be the best surface for a prototype I worked on a couple of years ago. Multi-touch 360 would be great for travel planning and teaching geography. I could see one of these interactive spheres in the lobby of every cruise ship!
This on this!
The Multi-touch 360 project is the work of Thorsten Blum and Johann Korndorfer, based on their previous work on the Space Invader's 360 game, featured later in this post. It is similar to Microsoft's Sphere project.
Space Invaders 360: An Interactive Multplayer Gaming Installation That Makes You Move (pdf) MindTrek 2008 October 6-9, 2008, Tampere, FINLAND ACM ABSTRACT"Space Invaders 360 is a tribute to the video game Space Invaders designed by Tomohiro Nishikado in 1978. While the original version is a two-dimensional arcade shooter game, we have created an interactive gaming installation combin-ing the fun and thrill of the classic video game with experimental concepts of display technologies and new ways ofuser interaction. Beside the technical aspects we also want to discuss the social aspects of our work. How does the gameplay changein the 21st century? What new ways of user interaction can be thought of? The success of Nintendo Wii and NintendoDS [7] shows the interest of professional and casual gamers in new methods of user interaction. While the last decadeshave been dominated by video games on fixed screens, over- sized gamepads and realistic graphics, gamers are now moving towards video gaming with a focus on physical interaction."
Thorsten maintains another blog, which is worth a look. I like the links he posts:
"Our prototype device builds on a commercially available globe projection system (Global Imagination’s Magic Planet). We have added touch-sensing capabilities with an infrared camera that shares the optical path with the projector. This novel configuration permits us to enclose both the projection and the sensing mechanism in the base of the device and allows for easy 360 degrees access to the device and high degree of interactivity without shadowing or occlusion problems. We have also developed a custom graphics projection pipeline that solves the distortion problems and enables projected data to be correctly visualized on the curved surface.
The applications developed for Sphere currently include a picture and video browser, interactive globe visualization, finger painting, globe visualization, and an omni-directional video-conferencing application (360 degree panoramic video from Microsoft RoundTable device). These applications are designed for highly interactive public space environments (e.g., museums, lobbies, information booths) and highlight the appeal of the device as well as its visualization and interaction capabilities."Hrvoje Benko, Andy Wilson, Ravin Balakrishnan, Billy Chen Note: Microsoft's RoundTable 360 video conferencing application is now known as the Polycom CX5000 Unified Conference Station, optimized for the Microsoft Office Communicator. More information can be found on the Polycom website.
Multimedia augmented business cards offered by Lm3Labs. When a corporate logo on the business card is viewed by a customer's webcam, multimedia events are triggered:
"Catchyoo Face Tracker tracks faces of passing people for creating eye-catching interactivity with digital content. Faces become pointers which trigger events and follow people".
This window looks like it would be fun to play with!
Touch-screen applications are making headway with seniors in the form of brain fitness games and therapeutic rehabilitation activities. It makes sense to take this to the next level, via multi-touch and gesture interaction.Here is a brief overview of a few systems that are making some headway in skilled nursing facilities, in homes, and on-line:
"Seniors are empowered to connect and communicate online, to immerse themselves in rich multimedia experiences, to play, to explore, create, to revisit and document their histories. In short, to be engaged in a multitude of ways that help them remain physically and mentally active.
IN2L uses an easy touch-screen interface that allows each resident to have their own profile that they can access just by touching the screen. Touching picture-based icons on the screen gives the individual access to a wide variety of experiences, games and therapies, including simulation programs like driving, flying and biking." - Mel Fabrikant, The Paramus Post, 5/7/09
"The turnkey hardware/software system includes a touch screen computer appliance that requires no mouse or keyboard, plus brain games that adjust to different ability levels and are automatically updated every few days over the Internet to avoid boredom. Already the #1 brain wellness program in senior living communities, the Dakim unit is now being released in a home edition that makes brain fitness fun while also fighting mental decline."
Loran Bey is a member of the NUI group. He created Rhizome 2009 using Unity 3D and tBeta, now know as CCV (Community Core Vision). The screen in the video is made from flexible lycra, and this provides a tangible interaction effect. The music in the background is Aphix Twin's Avril 14th.
Unity 3D is a game development tool for browser-base games, including games optimized for the iPhone. (If you visit the Unity 3D website, be sure to download their 3D web plugin and visit their relaxing on-line Tropical Paradise.)
The screen displayed in the video was inspired by the 2005 Khronos Projector installation, by Alvero Cassinelli, an assistant professor at the Ishikawa Komuro Laboratory at the University of Tokyo. Khronos is described as a "video time-warping machine with a deformable screen."
The Khronos Projector website provides several simulation applets built with Processing that you can play with. They were fun to interact with on my HP TouchSmart PC. I liked Behind the Door the best.
The following video demonstrates how the Khronos application works:
Take a look at Alvaro Cassinelli's archive of his interactive media art if you have the chance!
"The goal of this group is to research methods for capturing and manipulating information that is normally inaccessible to humans and machines. In doing so, we hope to create new ways of perceiving the world and interacting with technology. Our research methods span fields such as human-computer interaction, media arts, physiology, and ethics."
I was going to post the pictures I took today of touch-screens and other displays from the Cleveland airport, but the news about the HP TouchSmart installation at the O'Hare airport was more exciting.
Via Carnegie Mellon: Explore Chicago Via GigaPan 3/30/09 "Panoramas created with GigaPan, a technology developed by Carnegie Mellon’s Robotics Institute and NASA, are featured on a new city Web site. The imagery of iconic Chicago locations can be explored in detail with 50 HP TouchSmart PCs installed throughout the airport by HP and the Chicago Department of Aviation and Office of Tourism."
Via Flickr
"Chicago's Mayor Daley, left, and Hewlett-Packard's, Stephen DeWitt, interact with on of the kiosks for Explore Chicago, a state of the art installation featuring touch screen HP computers and high-tech lounges, offering travelers a way to connect to the Chicago Tourism Center at O'Hare Airport Monday, March 30, 2009. During the unveiling, Mayor Daley, announced plans to use Chicago's recently awarded economic stimulus package of $12M for runway expansions at O'Hare Airport. (AP Images for HP/Stacie Freundberg)"
Henry Jenkins will be moving from MIT to USC Annenburg School of Communication and the Cinematic Arts School. He'll be teaching courses such as "Transmedia Storytelling" and "New Media Literacies". "...there is a learning ecology now, one that takes place outside of the classroom in the after school world...and right now, schools are cutting themselves out of the learning ecology by blocking games, by blocking YouTube, by putting filters on the computers. They block off ways the students are technologically connected, from the best ways of learning..and they leave those students who are trapped behind the participation gap from having access to the experiences that prepare the technically literate for the future."
"..Good teachers are fighting a valiant battle just to be able to access the materials of YouTube .. the other day we discovered that students could not access online resources about Moby Dick, the great American novel, because it had the word "Dick" in it."
My high school blocks websites about games. TeacherTube is blocked, too!
In the above video, a school that integrates the use of games within the curriculum is mentioned. The school isQuest to Learn, scheduled to open for the 2009-2010 school year. It is known as "New York's school for today's digital kids".
"Quest supports a dynamic curriculum that uses the underlying design principles of games to create highly immersive, game-like learning experiences for students. Games and other forms of digital media also model the complexity and promise of “systems.” Understanding and accounting for this complexity is a fundamental literacy of the 21st century."
It has been a while since I shared information about accessible games. If you are a parent of a child or teen with a disability, if you have a disability, or if you hope to keep on gaming through your golden years no matter what ails you, keeping an eye on innovations in this field is worth your time.
"GATE is actually a Wiki, which is a piece of server software that allows users to freely create and edit Web page content using any Web browser. It's a little like Wikipedia, but just concentrating on assistive technology. GATE is very simple to use, with a control panel enabling you to add content and more. More about Wikis . . .
This wiki has been created by AbilityNet, the UK's largest provider of advice and information on all aspects of Access to technology. The purpose of the wiki is to provide live and up to date information on all aspects of Assistive Technology."
"A really good place to start is their Switch Systems entry here. They are lacking their own accessible games section so hopefully someone (maybe me) will take up the gauntlet for that soon."
Mystic Mine Multi-player One Switch Game
"Just released this February - Mystic Mine is now available to buy on-line at Koonsolo for $19.95 (use www.xe.com for a currency conversion). It is massive fun as a multi-player game and highly recommended by OneSwitch.org.uk. If I had an all time top 10 list of one-switch games this would be a strong contender to make the list. Free demo version available here. Sweet." -posted by One-Switch Games on the Game Accessibility blog
"Pantech is one of three giant mobile phone manufacturers in Korea, among them Samsung and LG. Pantech sold over 10 million phones internationally in 2008, and under the "Sky" brand in the local market. Now, it's about to launch a blow-controlled mobile phone, the IM-S410K, which is also known as the Sky Wind." "Looks like it's got potential for some fun accessible games using sip/puff control." Link Via: Thomas Westin at IGDA GASIG Mailing List, via OneSwitch Games Stevie Wonder calls for accessible technology
"Stevie Wonder is calling for greater access in technology: "[technology] being more accessible is always a plus and I think really, for various companies ... making it exciting and accessible for people who can see, it would take very little to make it accessible to everyone. So I encourage all the manufacturers to do that." "When you can ... make it accessible and make it possible, you should just include that in the overall picture. ". Link via: Mike Taylor of Excitim.
LM3LABS offers wide range creative interactive applications/systems. This Virtual DJ was developed in collaboration with Brief-Ad, of Romania, utilizing the ubiq'window. Wouldn't this be fun to have in schools!