The video below gives a demo of Sony's RayModeler, "A 360-Degree Display that doesn't require glasses". The video shows how the auto-stereoscopic 3D content is filmed. It also shows how items within the display respond to gesture interaction. The first prototype was introduced in 2009 and then brought out at the SIGGRAPH conference this summer.
According to an article written by Richard Lawler, Core77 created "Breakout" for the RayModeler, a game similar to Pong. I'll have to think more about this technology before I form an opinion!
RELATED
Sony's 360-degree RayModeler 3D display brings its glasses-free act to LA, plays Breakout
Richard Lawler, Engadget 7/28/10
Sony's 360-degree 3D display prototype makes virtual pets more lifelike, expensive
Thomas Ricker, Engadget 10/19/09
Showing posts sorted by date for query gesture. Sort by relevance Show all posts
Showing posts sorted by date for query gesture. Sort by relevance Show all posts
Sep 18, 2010
Aug 21, 2010
Reflections About Interactivity in my Present World
Background: For those of you who are new to this blog, I work as a school psychologist in a public school district in North Carolina. During the mid 2000's, I took a variety of computer courses, leading up to a decision to work part time while taking graduate courses part-time such as human-computer interaction, games, information visualization, ubiquitous computing, VR, etc. I returned to work full time in 2008, due to the economic downturn.
I continue to maintain my passion for technology that supports natural user interaction, and share my interests on this blog and to a lesser extent, two other blogs. I initially started blogging because it was a requirement for one of my courses, and found that my blogs served me well as on-line filing cabinets.
Update: I don't usually post much about my work on this blog, but I have some exciting things to share.
New School Year, New SMARTBoard: I'd like am excited about the upcoming school year because my "home" school, Wolfe, a program that serves mostly teens and young adults up to age 22 who have more severe disabilities (including autism), now has an interactive whiteboard in every classroom.
School started for Wolfe students on July 26th, and three more whiteboards were installed. One of the new SMARTboards is in the speech and language room, along with a multi-touch SMARTTable the school received last April, one is in the Art/Work Adjustment room, and one is in the room I use with small groups of students, which is used for music one day a week.
Although I have used interactive whiteboards in my work with students for several years, this is the first year that I have had one available to me most of the time in a school. Since most of the teachers received their IWBs over the past year, there is a pressing need to figure out what works, why it works, and how to create useful interactive content that is appropriate for the needs of students who have severe or multiple disabilities. We really can't wait.
Why is this important to me?
Technology and my role as a school psychologist:
Designing effective interventions is part of my job as a school psychologist, and mixing interactive whiteboards and interventions is fairly uncharted territory. I know that there are probably a few other school psychologists, counselors, social workers, and speech/language therapists out there who are wondering what to make of this technology and the students they serve directly, or indirectly through consultation. There isn't much literature about this topic, so it is difficult to know what is truly "evidence based".
We are in the process of discovery. Within a school that has an IWB in every classroom, serving students with the most complex needs within the school district, how can I best follow professional school psychology practices(pdf) regarding the provision of direct and indirect services. Some of these expectations are listed below:
Working towards solutions:
I work closely with my colleague Kelly Cross, a speech and language therapist who serves Wolfe school and two classrooms of students with severe autism at a "regular" elementary school. Kelly also serves as the assistive technology and augmentative communication consultant for our school district. She's used interactive applications and web resources for many years along with more traditional "hands-on" materials, but like me, has had limited access to IWB's until recently. She now has a SMARTboard in her room, along with the portable multi-touch SMARTTable Wolfe received last April. We work with many of the same students, so with the influx of IWBs in our school, we've stepped up our collaboration.
One of Kelly's challenges is to figure out ways for teachers to integrate assistive technology and/or augmentative communication systems into their work with students during activities that involve interactive whiteboards. Most of the research the area of assistive technology/aug com focuses on the use of technology to access applications as they are displayed on laptops or computer monitors, or factors related to the use of individual communication devices. The vSked project, led by Dr. Gillian Hayes at the University of California at Irvine, is on the right track in that it incorporates the use of a large interactive display that was used with students with autism, along with smaller hand-held communication systems, which I've discussed in a previous post.
vSKED in action
Workshop Presentation
This past week, Kelly and I presented at a workshop held in the Arlington VA school district that focused on the use of interactive whiteboards and related applications and web resources with students with special needs. We shared some of the exciting things we've noticed with our students and shared "before and after" examples. Included in the presentation were some of the video clips I quickly put together during the first days of school that had an impressive positive impact with students when they were used during interactive whiteboard activities. (Some of these video clips can be found in a previous post: Video clips that help students with autism learn and feel calm at the same time!)
During the workshop, we discussed a few guiding principals, such as the "least dangerous assumption" and the concept of Universal Design for Learning. We also provided a sampling of resources previously used on the "small screen" appear to powerful when used with students interacting on the larger whiteboard screens. Below are a few of the resources we shared:
Clicker5 is an application to support reading and writing that provides a natural voice output, and child-friendly word processor. It works well on interactive whitboards It can incorporate several communication symbol systems. It is a good tool for informal assessment with students with communication and other related needs.
At Wolfe, we'd like to create a conversation wheel with related activities for the SMARTTable that co-ordinate with SMARTBoard activities. We'll probably experiment with the conversation wheel concept on the SMARTboard first.
Considerations:
One thing we've learned over the past few months is that it is bit more complicated to create content and activities for the SMARTTable than for the SMARTBoard notebook or Promethean flipchart. We hope to have it customized to support scaffolded, customized classroom activities for students with special needs, but it might take more time than we had anticipated. The school's immediate need is for touchable interactive content for all of the classroom IWB's, suitable for our students.
Complications:
Programming for the SMARTTable, for those who have 64-bit computers, requires Windows 7, Visual Studio 2008, and Expression Blend 3. My HP Touchsmart, my home computer, is 64 bit, but runs Vista. My school-issued laptop runs Windows XP and is also 64-bit. To upgrade it, I will have to send it to the tech department for several weeks. It will be slow-going, since I have to plan for my day-to-day activities and evaluations with students first.
Possible SMARTTable Solutions:
I'm hoping that some students from UNC-Charlotte might want to try their hand at multi-touch programming and help us out! We'd welcome volunteers from other universities as well. Wolfe's principal, Mary Jo Breckenridge, is very supportive of the use of innovative technologies with students with special needs, and would figure out a way to make a collaboration happen.
I continue to maintain my passion for technology that supports natural user interaction, and share my interests on this blog and to a lesser extent, two other blogs. I initially started blogging because it was a requirement for one of my courses, and found that my blogs served me well as on-line filing cabinets.
Update: I don't usually post much about my work on this blog, but I have some exciting things to share.
New School Year, New SMARTBoard: I'd like am excited about the upcoming school year because my "home" school, Wolfe, a program that serves mostly teens and young adults up to age 22 who have more severe disabilities (including autism), now has an interactive whiteboard in every classroom.
School started for Wolfe students on July 26th, and three more whiteboards were installed. One of the new SMARTboards is in the speech and language room, along with a multi-touch SMARTTable the school received last April, one is in the Art/Work Adjustment room, and one is in the room I use with small groups of students, which is used for music one day a week.
Although I have used interactive whiteboards in my work with students for several years, this is the first year that I have had one available to me most of the time in a school. Since most of the teachers received their IWBs over the past year, there is a pressing need to figure out what works, why it works, and how to create useful interactive content that is appropriate for the needs of students who have severe or multiple disabilities. We really can't wait.
Why is this important to me?
Observations of positive changes:
Students who previously had limited interest in applications on the computer, or a limited attention span for such activities, demonstrate a high degree of interest and engagement with the activities on the IWBs we've tried so far. Many students who do not attend to learning materials, or only for brief periods of time, actively look at the IWB screen and even interacting with it, and smile. Some students who rarely-or never- speak sometimes vocalize more often during IWB activities! Some are making connections between learning materials and what they interact with on the screen, something that simply did not happen previously. Some students who rarely established eye contact with others or demonstrated joint attention do so during IWB activities, something I discussed in a post on the TechPsych blog.
Designing effective interventions is part of my job as a school psychologist, and mixing interactive whiteboards and interventions is fairly uncharted territory. I know that there are probably a few other school psychologists, counselors, social workers, and speech/language therapists out there who are wondering what to make of this technology and the students they serve directly, or indirectly through consultation. There isn't much literature about this topic, so it is difficult to know what is truly "evidence based".
We are in the process of discovery. Within a school that has an IWB in every classroom, serving students with the most complex needs within the school district, how can I best follow professional school psychology practices(pdf) regarding the provision of direct and indirect services. Some of these expectations are listed below:
"School psychologists promote the development and maintenance of learning environments that support resilience and academic growth, promote high rates of academic engaged time, and reduce negative influences on learning and behavior."
"School psychologists use information and assistive technology resources to enhance students’ cognitive and academic skills."
"School psychologists work with other school personnel to develop, implement, and evaluate effective interventions for increasing the amount of time students are engaged in learning."
"School psychologists facilitate design and delivery of curricula to help students develop effective behaviors, such as self-regulation and self-monitoring, planning/ organization, empathy, and healthy decision-making."
I work closely with my colleague Kelly Cross, a speech and language therapist who serves Wolfe school and two classrooms of students with severe autism at a "regular" elementary school. Kelly also serves as the assistive technology and augmentative communication consultant for our school district. She's used interactive applications and web resources for many years along with more traditional "hands-on" materials, but like me, has had limited access to IWB's until recently. She now has a SMARTboard in her room, along with the portable multi-touch SMARTTable Wolfe received last April. We work with many of the same students, so with the influx of IWBs in our school, we've stepped up our collaboration.
One of Kelly's challenges is to figure out ways for teachers to integrate assistive technology and/or augmentative communication systems into their work with students during activities that involve interactive whiteboards. Most of the research the area of assistive technology/aug com focuses on the use of technology to access applications as they are displayed on laptops or computer monitors, or factors related to the use of individual communication devices. The vSked project, led by Dr. Gillian Hayes at the University of California at Irvine, is on the right track in that it incorporates the use of a large interactive display that was used with students with autism, along with smaller hand-held communication systems, which I've discussed in a previous post.
vSKED in action
Workshop Presentation
This past week, Kelly and I presented at a workshop held in the Arlington VA school district that focused on the use of interactive whiteboards and related applications and web resources with students with special needs. We shared some of the exciting things we've noticed with our students and shared "before and after" examples. Included in the presentation were some of the video clips I quickly put together during the first days of school that had an impressive positive impact with students when they were used during interactive whiteboard activities. (Some of these video clips can be found in a previous post: Video clips that help students with autism learn and feel calm at the same time!)
During the workshop, we discussed a few guiding principals, such as the "least dangerous assumption" and the concept of Universal Design for Learning. We also provided a sampling of resources previously used on the "small screen" appear to powerful when used with students interacting on the larger whiteboard screens. Below are a few of the resources we shared:
Clicker5 is an application to support reading and writing that provides a natural voice output, and child-friendly word processor. It works well on interactive whitboards It can incorporate several communication symbol systems. It is a good tool for informal assessment with students with communication and other related needs.
Sensory World provides an intuitive navigation system for students to use as they explore various areas of a house and engage in learning and related activities. The site map for all of the areas of the house, as well as the activities, is graphical.
We shared resources from the National Gallery of Art's Kids Zone, a great website that offers plenty of interactive content:
Teachers who want a limited browsing environment for their students the Zac Browser is great for use on IWBs and the new large all-in-one touch screen displays:
Teachers who want a limited browsing environment for their students the Zac Browser is great for use on IWBs and the new large all-in-one touch screen displays:
"The intention is that symbol readers, teachers and carers will contribute, and we are delighted at the number of contributors that have already sent us their work"
We shared a recent find, Taptu rthat can be used on an IWB. Although Taptu focuses on the mobile touchable web, accessed through smartphones with internet access, it provides links to a wide range of websites designed with intuitive touch interaction in mind, perfect for students with special needs. In many cases, Taptu web navigation resources work fine on the larger screen of the IWB. The advantage is that a icon/visual based touch navigation system supports students who can't type and also those who have very limited reading skills.
Sports Navigation for Taptu
Below is a slideshow about the touchable web:
Taptu: Virtual Roundtable
Update: SMARTTable
Considerations:
One thing we've learned over the past few months is that it is bit more complicated to create content and activities for the SMARTTable than for the SMARTBoard notebook or Promethean flipchart. We hope to have it customized to support scaffolded, customized classroom activities for students with special needs, but it might take more time than we had anticipated. The school's immediate need is for touchable interactive content for all of the classroom IWB's, suitable for our students.
Complications:
Programming for the SMARTTable, for those who have 64-bit computers, requires Windows 7, Visual Studio 2008, and Expression Blend 3. My HP Touchsmart, my home computer, is 64 bit, but runs Vista. My school-issued laptop runs Windows XP and is also 64-bit. To upgrade it, I will have to send it to the tech department for several weeks. It will be slow-going, since I have to plan for my day-to-day activities and evaluations with students first.
Possible SMARTTable Solutions:
I'm hoping that some students from UNC-Charlotte might want to try their hand at multi-touch programming and help us out! We'd welcome volunteers from other universities as well. Wolfe's principal, Mary Jo Breckenridge, is very supportive of the use of innovative technologies with students with special needs, and would figure out a way to make a collaboration happen.
Upcoming Interactive Multimedia Technology Posts
I have about 6 posts in draft form about interesting interactive technologies, research, people, and companies involved with multi-touch, interactive multimedia, and natural user interface/interaction applications. I'll get them up as soon as possible.
One post is about 3M Touch Systems. Another is about an interesting multi-touch start-up company, Osmosis. I revisited Ballantyne Village to update the use of interactive touch screen technology, something I discussed in detail, along with photos and video clips, in a 2008 post, Technology Supported Shopping and Entertainment User Experience at Ballantyne Village: "A" for concept, "D" for touch-screen usability". I got some inside scoop about the rationale behind the changes at the upscale center from a seasoned owner of a high-end audio-visual store I interviewed about 3D TV. I have some interesting information about current research in "glasses-less" 3D displays. Sharp will be coming out with a 3D cell-phone camera AND glasses-less cell-phone display in the not-to-distant future.
I'm preparing for posts that highlight a few of my favorite blogs. Until then, take a look at the recent posts on Tracy Boyer's Innovative Interactivity blog, and also InteractiveTV Today.
RELATED & SOMEWHAT RELATED
"The AAC-RERC conducts a comprehensive program of research, development, training, and dissemination activities that address the NIDRR priorities and seek to improve technologies for individuals who rely on augmentative and alternative communication (AAC) technologies. The mission of the AAC-RERC is to assist people who rely on augmentative and alternative communication to achieve their goals by advancing and promoting AAC technologies and supporting the individuals who use, manufacture, and recommend them."
Janet Light, Kathy Drager, Penn State University
Jul 6, 2010
Multi-touch and NUI News: NUITEQ's Multi-touch Snowflake Suite for Windows 7
NUITEQ is a company that has been involved in multi-touch technologies for the past few years, and works diligently at ensuring that it keeps up with the evolution in interactive displays and software. The company's Snowflake Suite is now available for Windows 7, and is compatible with 3M Touch Systems, N-trig, NextWindow, Lumino, and other third-party platforms.
Here is the current compatibility list, and also a list of Snowflake Suite for Winodws 7 features:
Compatibility
* NextWindow platforms like HP TouchSmart IQ500, IQ770, IQ800 series and the Dell Studio One (all 2 touch)
* N-trig platforms like HP TouchSmart TX2, Dell Latitude XT/XT2 and others
* 3M Touch Systems multi-touch kit
* Lumio platforms
* dreaMTouch
* PQ Labs
* Wacom
* N-trig platforms like HP TouchSmart TX2, Dell Latitude XT/XT2 and others
* 3M Touch Systems multi-touch kit
* Lumio platforms
* dreaMTouch
* PQ Labs
* Wacom
Snowflake Suite for Windows 7 Features
* Detailed user manual included with FAQ
* Developed on fast and reliable C++ platform
* Intuitive
* Customizable backgrounds, logo's, images, 3d models, videos etc
* Gesture recognition library
* TUIO / OSC (Open Sound Control) support (sending and receiving events)
* Low level API
* Hardware accelerated rendering
* Support for wide variety of media types (jpg,jpeg,tga,png,dds,gif,tif, tiff, bmp,mov,avi,wav,ogg)
* Advanced window handler that supports scaling and rotation
* Audio support
* Multi-threaded resource handler (For fast data visualization)
Snowflake Suite is also compatible with the following systems:
RELATED
"The 3M multi-touch displays support up to 20 finger touches simultaneously and come with a one year warranty. NUITEQ's Snowflake Suite, is included at no additional charge, offering the benefits of a complete bundled product of hardware and software, being the perfect solution to get started with multi-touch technology."
Photo Credit: NUITEQ
Case Study
"NUITEC freely assisted handicapped children with their education, by applying multi-touch technology for Action For Kids, a UK based national charity working with children and young people with physical and learning disabilities.The children used NUITEQ’s award winning multi-touch software product Snowflake Suite, to enhance their way of learning, by offering a more playful and intuitive solution, in comparison to conventional learning methods."
Case Study
"NUITEC freely assisted handicapped children with their education, by applying multi-touch technology for Action For Kids, a UK based national charity working with children and young people with physical and learning disabilities.The children used NUITEQ’s award winning multi-touch software product Snowflake Suite, to enhance their way of learning, by offering a more playful and intuitive solution, in comparison to conventional learning methods."
Labels:
3M,
disabilities,
dreaMTtouch,
interactive display,
multi-touch,
n-trig,
NEXIO,
NextWindow,
NUI,
NUITEC,
Snowflake Suite,
TouchCore,
Visual Planet,
Wacom,
Windows 7
No comments:
No comments:
Samsung Transparent OLED + Wedge Camera, Glassless 3D, Telepresence, Mid-air Interaction: Applying Science at Microsoft
The Microsoft Applied Sciences Group has been working on several projects that have the potential of changing how we interact with various displays and surfaces in the very near future. Here's some what I came across my RSS feeds and Google Alerts this morning:
INAVATE July 5, 2010
3D Gesture Interaction
"In this demonstration, we've placed the Microsoft Applied Science's wedge technology behind Samsung's transparent OLED display. This enables a camera to image through the display, see the user's hand above it, and alter the image based upon her gestures." -Microsoft Applied Sciences Group
3D Without the Glasses: A new type of display from Microsoft produces multiple images and tracks the viewers eyes - Kate Greene, MIT Technology Review (6/11/2010)
According to an article in MIT's Technology Review, "the new lens, which is thinner at the bottom than at the top, steers light to a viewer's eyes by switching light-emitting diodes along its bottom edge on and off. Combined with a backlight, this makes it possible to show different images to different viewers, or to create a stereoscopic (3-D) effect by presenting different images to a person's left and right eye. "What's so special about this lens is that it allows us to control where the light goes," says Steven Bathiche, director of Microsoft's Applied Sciences Group." -Kate Greene, Technology Review
Steerable Multi-view Display
"In this demonstration, we use head tracking to determine where multiple users are. Then, with the Microsoft Applied Sciences' wedge technology, we steer completely independent images to each user. In the video, one user is seeing a sun while at the same time another is seeing a rocket. This is maintained even as the users change positions relative to each other." -Microsoft Applied Sciences Group
Transparent Display for Telepresence
"In this demonstration, we've placed the Microsoft Applied Science's wedge technology behind Samsung's transparent OLED display. This enables a camera to image directly through the display. In the video, objects held up to the screen are captured and shown to the user on the other side of the telepresence communication (the other monitor in the video), while far away from the screen, the display shows the user a view dependent image."-Microsoft Applied Sciences Group
Steerable 3D Auto Stereo Display
"In this demonstration, we use head tracking to determine where a user's eyes are. Then, with the Microsoft Applied Sciences' wedge technology, we steer different views of the scene to each eye to produce a 3D image without the need for glasses or for fixing the location of the user." -Microsoft Applied Sciences Group
Mid-air Interactive Display
"In this demonstration, we illuminate objects above the display with infrared light. We capture the reflection using the Microsoft Applied Sciences' wedge technology. This enables us to see above the display while keeping the form factor small. Seeing above the display allows us to track the interaction between direct contacts on the display. In the video, the user associates a function (color choice) with one hand and a different function (zoom/rotation) with the other hand. This tool persistence is maintained regardless of the relative positions of the hands." -Microsoft Applied Sciences Group
RELATED
"In this demonstration, we use head tracking to determine where a user's eyes are. Then, with the Microsoft Applied Sciences' wedge technology, we steer different views of the scene to each eye to produce a 3D image without the need for glasses or for fixing the location of the user." -Microsoft Applied Sciences Group
Mid-air Interactive Display
"In this demonstration, we illuminate objects above the display with infrared light. We capture the reflection using the Microsoft Applied Sciences' wedge technology. This enables us to see above the display while keeping the form factor small. Seeing above the display allows us to track the interaction between direct contacts on the display. In the video, the user associates a function (color choice) with one hand and a different function (zoom/rotation) with the other hand. This tool persistence is maintained regardless of the relative positions of the hands." -Microsoft Applied Sciences Group
RELATED
Microsoft Applied Sciences Group Website
About Microsoft Applied Sciences Group
"The Applied Sciences Group (ASG) is an applied research and development team dedicated to createing the next generation of computer interaction technologies. The interdisciplinary group focuses on the synergy between optics, electronics and software to create novel human computer interfaces. The ASG is part of the Entertainment and Devices Division at Microsoft Corp. and mainly supports projects for Microsoft Hardware, XBox, and Microsoft Surface. It also works closely with Microsoft Research."
Jul 2, 2010
Gesture and object recognition on your kitchen counter: The Oasis Project demo from Intel Labs
Intel's Oasis system uses object recognition that triggers various applications that generate such things as shopping lists and recipes. The system can handle more than one item of food. It includes videos of how to prepare meals, a great feature for people just starting , or those who are learning to prepare healthier meals.
In my opinion, this sort of application would be useful to people with disabilities that affect memory.
(Previously posted on THE WORLD IS MY INTERACTIVE INTERFACE blog.)
In my opinion, this sort of application would be useful to people with disabilities that affect memory.
(Previously posted on THE WORLD IS MY INTERACTIVE INTERFACE blog.)
Jun 22, 2010
Kinect Sensor for Xbox 360 Offers Full-Body and Gesture Interaction: No controllers or remotes!
Project Natal was the code name for the Kinect Sensor for Xbox 360. For $149.99 you can pre-order your very-own system from the Microsoft Store that will allow you to interact with video games with your body alone. No need for controllers or 'motes!
Presentation about the fitness benefits of the Kinect Sensor for Xbox 360:
This video is a preview of a dance game for the Xbox using the Kinect Sensor:
It would be great if I could do my Zumba moves with Kinect Sensor system and a great Xbox application!
Here's another video that explains the system in more detail, with brief interviews of innovators from Microsoft:
Here is a copy of my previous post about Project Natal:
How It Works: Microsoft's Project Natal for the Xbox 360 video from Scientific American
Microsoft gathered a wealth of biometric data to recognize the range of human movement in order to develop an algorithm for the next generation of controller-less gaming. "Natal will consist of a depth sensor that uses infrared signals to create a digital 3-D model of a player's body as it moves, a video camera that can pick up fine details such as facial expressions, and a microphone that can identify and locate individual voices."
The technology behind Natal has the potential for a range of uses beyond gaming.
Scientific American article:
Binary Body Double: Microsoft Reveals the Science Behind Project Natal for Xbox 360
Presentation about the fitness benefits of the Kinect Sensor for Xbox 360:
This video is a preview of a dance game for the Xbox using the Kinect Sensor:
It would be great if I could do my Zumba moves with Kinect Sensor system and a great Xbox application!
Here's another video that explains the system in more detail, with brief interviews of innovators from Microsoft:
Here is a copy of my previous post about Project Natal:
How It Works: Microsoft's Project Natal for the Xbox 360 video from Scientific American
Microsoft gathered a wealth of biometric data to recognize the range of human movement in order to develop an algorithm for the next generation of controller-less gaming. "Natal will consist of a depth sensor that uses infrared signals to create a digital 3-D model of a player's body as it moves, a video camera that can pick up fine details such as facial expressions, and a microphone that can identify and locate individual voices."
The technology behind Natal has the potential for a range of uses beyond gaming.
Scientific American article:
Binary Body Double: Microsoft Reveals the Science Behind Project Natal for Xbox 360
May 29, 2010
Preview: Update on Touch & Multitouch Technologies, Websites, and Touch-Interactive Multimedia Apps
It is about time for an update about touch/gesture- interactive technologies.
I've been researching the latest in "touch" screens and new developments in interactive multi-media content. In just one year, a multitude of websites have been transformed from static to interactive.
Although the initial objective for some of these websites was to optimize the interface and navigation for people accessing websites via touch-screen cell phones, some are ideal for use on touch-enabled slates, the iPad, and even larger touch screen displays and surfaces.
Convergence seems to be the buzz word of the day. Interactive TV. Game sets with Internet access. Movies on your cell phone. Touch screen Coke machines displaying movie trailers. What's happening now, and what is next?
I welcome input from my readers in the form of links to websites, university labs with grad students and professors who are obsessed with emerging interactive technologies, proof-of-concept video clips, video clips of related technologies that are new-to-market, etc.
I will add video clips to the following playlist:
FYI: I'm also in the middle of writing a series of posts about 3D television technologies for the Innovative Interactivity blog, and welcome input from my readers about this topic.
RELATED (Previous posts)
(the above post includes links to various multi-touch developer kits and resources)
Multi-touch Linux on a Stantum Slate PC & More (links to a nice overview about multi-touch interaction from ENAC)
Multimedia, Multi-touch, Gesture, and Interaction Resources (needs a little updating)
Labels:
display,
interactive,
interactive website,
multi-touch,
post-WIMP,
research,
resources,
technology,
touch,
update
No comments:
No comments:
May 13, 2010
Gesture Vocabulary from N-Trig: "N-act Hands-on"
N-Trig is a company founded in 1999 that provides pen and multi-touch solutions that integrate into LCDs and other devices, and provides opportunities for independent software vendors (ISVs) and original equipment manufacturers (OEMs) to create new interactive and hands-on computing experiences, according to the company's profile. The latest news about N-Trig's interactive capabilities was outlined in a recent article by DanaWollman, in Laptop:
The N-act Gesture Set (depicted in the video below)
N-act3SideSweep for browsing, use fingers together for browsing
N-act2+1 - select from a displayed menu
N-act3Tap- displays open windows in a 3D carousel
N-act3Hold-rotates the 3D carousel
N-act2Scroll- scroll through a document
N-act2Tap-minimizes the open window, displays the desktop
N-act1Touch- select an item on the screen
N-act4Tap-displays customized, relevant list of web page icons; selected text/item is pasted into the chosen app.
N-act4Zoom-magnifies a movable selected area of the screen
N-act4Select-selects an area and opens a context sensitive menu
avitalntrig
Here is the promotional information from the YouTube video:
"This video demonstrates the N-trig N-act Gesture Vocabulary, a set of true multi-touch gestures for two plus one, three- and four-fingers, enabling users to perform an action directly on the screen, and providing a rich set of hand movements that enhance the overall user experience, enabling a whole new approach to how we interact with our computing devices, for a true Hands-on computing experience."
RELATED
www.n-trig.com
N-trig DuoSense Technology
The Future is Now: Creating and Developing a Touch-Enabled World (pdf)
N-trig N-act Hands-On Gesture Vocabulary (N-Trig website)
Better Multi-Touch Displays Coming
Mike Miller, Forward Thinking Blog, PC Mag (3/3/10)
DuoSense: Creating a Multi-touch Enabled World (November 2009)
I found the following video from N-Trig on YouTube, released on 5/11/10, that shows the new gesture set that is supported by N-Trig:
The N-act Gesture Set (depicted in the video below)
N-act3SideSweep for browsing, use fingers together for browsing
N-act2+1 - select from a displayed menu
N-act3Tap- displays open windows in a 3D carousel
N-act3Hold-rotates the 3D carousel
N-act2Scroll- scroll through a document
N-act2Tap-minimizes the open window, displays the desktop
N-act1Touch- select an item on the screen
N-act4Tap-displays customized, relevant list of web page icons; selected text/item is pasted into the chosen app.
N-act4Zoom-magnifies a movable selected area of the screen
N-act4Select-selects an area and opens a context sensitive menu
avitalntrig
Here is the promotional information from the YouTube video:
"This video demonstrates the N-trig N-act Gesture Vocabulary, a set of true multi-touch gestures for two plus one, three- and four-fingers, enabling users to perform an action directly on the screen, and providing a rich set of hand movements that enhance the overall user experience, enabling a whole new approach to how we interact with our computing devices, for a true Hands-on computing experience."
RELATED
Dana Wollman, 5/1/10, Laptop
www.n-trig.com
N-trig DuoSense Technology
The Future is Now: Creating and Developing a Touch-Enabled World (pdf)
N-trig N-act Hands-On Gesture Vocabulary (N-Trig website)
Better Multi-Touch Displays Coming
Mike Miller, Forward Thinking Blog, PC Mag (3/3/10)
DuoSense: Creating a Multi-touch Enabled World (November 2009)
May 7, 2010
The attracTable is Coming Soon: Sony will launch a high-definition touch and gesture- interactive tabletop, using Actracsys's technology!
Sony will be introducing a full high-definition interactive table, a result of a collaboration with the Swiss company Atracsys.
(At about 2:14 in the video below, there is a demonstration of an application that recognizes facial features and expressions, which are used to control and manipulate images on the screen.)
Images from the Sony Stand at Vision 2009
Here is an "overview" video that shows a number of uses for the Attractable:
Here is the "Nespresso" table, which provides people with information about the type of coffee that you are drinking. It makes more sense as demonstrated in the video.
Atracsys @ Baselworld 2010
beMerlin: Interactive gesture-based application for retail:
(At about 2:14 in the video below, there is a demonstration of an application that recognizes facial features and expressions, which are used to control and manipulate images on the screen.)
Images from the Sony Stand at Vision 2009
Here is an "overview" video that shows a number of uses for the Attractable:
Here is a version of the atracTable, using a tangible user interface to create music:
Here is the "Nespresso" table, which provides people with information about the type of coffee that you are drinking. It makes more sense as demonstrated in the video.
Atracsys @ Baselworld 2010
beMerlin: Interactive gesture-based application for retail:
Labels:
atracsys,
attractale,
beMerlin,
gestures,
HD,
interactive,
sony,
surface,
tabletop,
touch
No comments:
No comments:
Apr 25, 2010
LM3Labs' Catchyoo Interactive Koi Pond; release of ubiq'window 2.6 Development Kit and Reader
Catchyoo Koi FX, from LM3Labs
Catchyoo Koi FX from Nicolas Loeillot on Vimeo.
The music on the video clip is by the band Remioromen, from Japan.
LM3Labs recently released ubiq'window 2.6 Pack, a development kit and reader that handles gesture interaction for proximity touch-less technology based on computer vision. It includes a calibration mode, usage statistics, and is compliant with Windows 7. In the near future, LM3Labs will release new software for their partners and ubiq'window developers.
About LM3Labs:
"Focused on fast transformation of innovation into unique products, LM3Labs is a recognized pioneer in computer vision-based interactivity solutions. LM3Labs is a fast growing company based in Tokyo, Japan and Sophia-Antipolis, France." -LM3Labs Blog
Jan 31, 2010
Flexible Interfaces & Useful Wearables for All - Combining Good Concepts: Slap Bracelet, flexible ePaper, Morph, Asus Waveface, the Porcupine, Sixth Sense, and the iPhone/iPad. (How about an iCuff?!)
One of the projects I toyed with for a Ubiquitous Computing class three years ago was an application that would work nicely on a PDA that I could somehow strap to my wrist. I wanted to something that would allow me to keep my hands free and support some of my work functions as a school psychologist, such as observing and assessing students, counseling young people, and consulting with teachers and parents. The application would also be useful to my colleagues.
The second part of this application would support teens and young adults with more severe disabilities who participate in a community-based vocational training program. The application would provide a means of giving the students feedback during on-site work activities as well as in work adjustment simulation activities at school.
I abandoned the idea early on, due to frustrating BlueTooth issues and the lack of a suitable way to secure the PDA to various types of wrists.
It is 2010 and now we have the iPhone, iPad, touch-screen netbook/slates, e-readers, 3GS, consumer-ready RFID, low-cost portable GPS devices, and in some places, ubiquitous free Wi-Fi, low-cost digital cameras, and a range of devices that have the potential to play together in some way. Below are a few examples of how far things have come.
EXAMPLES
True Wearable, by Propeller (This was a prototype introduced in 2007, I think.)
(Belkin Sports Armband for iPhone; Trueband, by Grantwood Technology; MarewareSportShell)
RIDGELINE W200
The water-resistant Ridgeline has many of the features I'd like, such as the touch screen interface, a blacklit keypad, an adjustable strap, and range of I/Os. I kind of liked the wearable scanner and imager feature. The scanner/imager can be rotated. If the imager also included a video camera, it would be a plus, since I use video quite a bit to develop video social stories for some of the students I work with who have autism spectrum disorders.
The Ridgeline W200 is too ugly and clunky for me to consider wearing! I'm sure price of the Ridgeline would be out of the question for public school employees and community mental health workers who work with young people with special needs.
(Ridgeline W200 Wearable Touch-Screen Computer)
"Everybody had them or at least seen ‘em. Slap bracelets were usually made of thin piece of aluminum wrapped in fabric. Using the same form, Chocolate Agency came up with a mini multimedia device that snaps on with a slap. The entire surface is E-Paper and possesses all its thin, high contrast, power efficient qualities. The length can be adjusted by adding magnetic snaps to the ends. Best part is there’s no recharging needed. It gets all the power it needs via kinetic energy so go ahead, go slap happy." -Yanko Design
Nokia Morph (Concept)
The Nokia Morph is a concept project that integrates nanotechnology into mobile devices. I posted about the Morph last year: Last Night I Dreamt About Haptic Touch-Screen Overlays
Asus Waveface Smartphone (Video from CES 2010)
The Porcupine
This morning I devoted about 45 minutes skimming over the Proceedings for the Fourth International Conference on Tangible, Embedded, and Embodied Interaction, TEI '10, held January 25-27 in Cambridge, MA. A paper related to the Porcupine, a wearable sensing device, caught my eye:
Coming to Grips with the Objects We Grasp: Detecting Interactions with Efficient Wrist-Worn Sensors (Eugin Berlin, Jun Liu, Kristof van Laerhoven, Bernt Schield, TEI 2010)
From what I can tell, the features of the Porcupine, if embedded in a wearable iPhone-type device, would be extremely useful in a variety of fields, including special education, rehabilitation/habilitation, health care, mental health, vocational training for people with more complex disabilities, and so on.
Porcupine
Porcupine Project Documents
(The code for Porcupine is available on Sourceforge.net.)
I posted about Sixth Sense earlier in 2009:
The second part of this application would support teens and young adults with more severe disabilities who participate in a community-based vocational training program. The application would provide a means of giving the students feedback during on-site work activities as well as in work adjustment simulation activities at school.
I abandoned the idea early on, due to frustrating BlueTooth issues and the lack of a suitable way to secure the PDA to various types of wrists.
It is 2010 and now we have the iPhone, iPad, touch-screen netbook/slates, e-readers, 3GS, consumer-ready RFID, low-cost portable GPS devices, and in some places, ubiquitous free Wi-Fi, low-cost digital cameras, and a range of devices that have the potential to play together in some way. Below are a few examples of how far things have come.
EXAMPLES
True Wearable, by Propeller (This was a prototype introduced in 2007, I think.)
(Belkin Sports Armband for iPhone; Trueband, by Grantwood Technology; MarewareSportShell)
RIDGELINE W200
The water-resistant Ridgeline has many of the features I'd like, such as the touch screen interface, a blacklit keypad, an adjustable strap, and range of I/Os. I kind of liked the wearable scanner and imager feature. The scanner/imager can be rotated. If the imager also included a video camera, it would be a plus, since I use video quite a bit to develop video social stories for some of the students I work with who have autism spectrum disorders.
The Ridgeline W200 is too ugly and clunky for me to consider wearing! I'm sure price of the Ridgeline would be out of the question for public school employees and community mental health workers who work with young people with special needs.
(Ridgeline W200 Wearable Touch-Screen Computer)
"Everybody had them or at least seen ‘em. Slap bracelets were usually made of thin piece of aluminum wrapped in fabric. Using the same form, Chocolate Agency came up with a mini multimedia device that snaps on with a slap. The entire surface is E-Paper and possesses all its thin, high contrast, power efficient qualities. The length can be adjusted by adding magnetic snaps to the ends. Best part is there’s no recharging needed. It gets all the power it needs via kinetic energy so go ahead, go slap happy." -Yanko Design
The Nokia Morph is a concept project that integrates nanotechnology into mobile devices. I posted about the Morph last year: Last Night I Dreamt About Haptic Touch-Screen Overlays
Asus Waveface Smartphone (Video from CES 2010)
The Porcupine
This morning I devoted about 45 minutes skimming over the Proceedings for the Fourth International Conference on Tangible, Embedded, and Embodied Interaction, TEI '10, held January 25-27 in Cambridge, MA. A paper related to the Porcupine, a wearable sensing device, caught my eye:
Coming to Grips with the Objects We Grasp: Detecting Interactions with Efficient Wrist-Worn Sensors (Eugin Berlin, Jun Liu, Kristof van Laerhoven, Bernt Schield, TEI 2010)
From what I can tell, the features of the Porcupine, if embedded in a wearable iPhone-type device, would be extremely useful in a variety of fields, including special education, rehabilitation/habilitation, health care, mental health, vocational training for people with more complex disabilities, and so on.
Porcupine
Porcupine Project Documents
(The code for Porcupine is available on Sourceforge.net.)
Sixth Sense
I posted about Sixth Sense earlier in 2009:
Pattie Maes TED Talk: Sixth Sense - Mobile Wearable Interface and Gesture Interaction (for the price of a cell phone?!) Sixth sense allows you to use ANY surface for interaction, and can provide you relevant information about whatever is in front of you. This would be a great feature for people with disabilities and in the future might also function as a cognitive prosthesis.
Below is a TED Talk video of Pranav Mistry, the Ph.D student who invented Sixth Sense, discussing open-source Sixth Sense and related applications:
Below is a TED Talk video of Pranav Mistry, the Ph.D student who invented Sixth Sense, discussing open-source Sixth Sense and related applications:
So now what?
After the iPad was unveiled, several people who blog about assistive technology and augmentative communication were curious to see if the new device had the potential for use with people who have disabilities.
It does.
After the iPad was unveiled, several people who blog about assistive technology and augmentative communication were curious to see if the new device had the potential for use with people who have disabilities.
It does.
Here are a few links:
From what I understand, the iPad will work with Proloquo2Go, an alternative/ augmentative communication program for Apple's iPhone and iPod Touch. Proloquo2Go is priced at a level much lower than other PDA-based systems, and can be purchased at the iTunes App Store. It can be downloaded for use on the iPad once the iPad is available to consumers.
This is great news.
Now someone just needs to get on the convergence train and develop a flexible, mobile device that incorporates the best features of the devices and applications that currently exist!
This is great news.
Now someone just needs to get on the convergence train and develop a flexible, mobile device that incorporates the best features of the devices and applications that currently exist!
Jan 28, 2010
TEI '10 Info and Links: Fourth Annual International Conference on Tangible, Embedded, and Embodied Interaction
In my dreams, I am a full-time tech student. Fortunately, I can follow my inner geek and share what I find on this blog. The information below was inspired by links from a Facebook status update by Laurence Muller, author of the Multi-Gesture blog.
The video below is a montage of TEI'10 hands-on studio:
TEI Studios from jay silver on Vimeo.
"From TEI 2010. These are the hands-on studios (like workshops) where 200 people participated in building and making all day long elbow to elbow, getting into the details and taking perspectives."
About TEI:
TEI '10: Fourth International Conference on Tangible, Embedded, and Embodied Interaction, January 25-27, Cambridge, MA.
"TEI, the conference on tangible, embedded, and embodied interaction, is about HCI, design, interactive art, user experience, tools and technologies, with a strong focus on how computing can bridge atoms and bits into cohesive interactive systems."
Here is a link to the keynote:
http://www.vikmuniz.net/
Here is a link to one of the papers presented at TEI:
Electronic Popables: Exploring Paper-Based Computing through an Interactive Pop-Up Book (pdf)- Jie Qi and Leah Buechley, MIT Media Lab, High-Low Tech Group
More about Laurence Muller:
Laurence Muller (M.Sc.)
, is a Fellow at the Harvard University (USA) at the School of Engineering and Applied Science (SEAS) / The Initiative in Innovative Computing (IIC) in the Scientists' Discovery Room Lab (SDR Lab). Currently he is working on innovative scientific software for multi-touch devices and display wall systems. (I took Laurence's information from his blog.)
More to come!
The video below is a montage of TEI'10 hands-on studio:
TEI Studios from jay silver on Vimeo.
"From TEI 2010. These are the hands-on studios (like workshops) where 200 people participated in building and making all day long elbow to elbow, getting into the details and taking perspectives."
About TEI:
TEI '10: Fourth International Conference on Tangible, Embedded, and Embodied Interaction, January 25-27, Cambridge, MA.
"TEI, the conference on tangible, embedded, and embodied interaction, is about HCI, design, interactive art, user experience, tools and technologies, with a strong focus on how computing can bridge atoms and bits into cohesive interactive systems."
Here is a link to the keynote:
http://www.vikmuniz.net/
Here is a link to one of the papers presented at TEI:
Electronic Popables: Exploring Paper-Based Computing through an Interactive Pop-Up Book (pdf)- Jie Qi and Leah Buechley, MIT Media Lab, High-Low Tech Group
More about Laurence Muller:
Laurence Muller (M.Sc.)
, is a Fellow at the Harvard University (USA) at the School of Engineering and Applied Science (SEAS) / The Initiative in Innovative Computing (IIC) in the Scientists' Discovery Room Lab (SDR Lab). Currently he is working on innovative scientific software for multi-touch devices and display wall systems. (I took Laurence's information from his blog.)More to come!
Subscribe to:
Posts (Atom)