For the tech-savvy or tech-curious: RKVS Raman's UbuntuStudio work-around on the HP TouchSmart PC!

Getting the most out of a HP TouchSmart PC...

I have a TouchSmart, and if I wasn't so busy at my job, I would love to spend my time digging into the core of the system.

Thanks, RKVS Raman, for your explanation about the way to identify the NextWindow touch screen as an input device in the HP TouchSmart PC using UbuntuStudio. This was something I was curious about.

Here is RKVS Raman's "how-to", from his RKVS Raman Blogs

"This gotcha explains how we made it to work.

1) Installed xserver-xorg-input-evdev
2) HP Touch Smart uses NextWindow TouchScreen. The tricky part was to find which input device is connected. An cat /proc/buc/input/devices pointed wrongly to event2.
3) After googling a lot, we found evtest. Downloaded evtest.c and compile it.
4) Ran evtest as root with various input devices like /dev/input/event[1...X]
5) One of the runs showed Input Device as NextWindow TouchScreen. That was the one. The device was /dev/input/event4

Input driver version is 1.0.0
Input device ID: bus 0x3 vendor 0x596 product 0x1 version 0x200
Input device name: "NextWindow TouchScreen"
Supported events:
Event type 0 (Reset)
Event code 0 (Reset)
Event code 1 (Key)
Event code 3 (Absolute)
Event type 1 (Key)
Event code 330 (Touch)
Event type 3 (Absolute)
Event code 0 (X)
Value 0
Min 0
Max 32687
Event code 1 (Y)
Value 0
Min 0
Max 32687

6) Made the necessary changes to our xorg.conf according to this page. Change the /dev/input/event1 to the device that we found as connected to touchscreen (/dev/input/event4) through our evtest runs.

7) Saved xorg.conf and rebooted. And Voila, touchscreen works.

Now that touchscreen works, let me load Sugar, it's gonna be fun."

Sugar is the core of the One Laptop Per Child (OLAP) Human Interface. It can be emulated on a PC, but doesn't have all of the features of the original.

Of interest to computer students and armchair technologists:

RKVS Raman teaches data structures (and artificial intelligence?), at least from what I gather from his blog posts.

I liked the link to a B-tree animation applet. If you are a computer student, remember not to confuse a B-tree with a binary tree!

There is more. RKVS Raman has an interesting post about Dijkstra's Algorithm and Human Psyche.

Dijkstra's algorithm

Interactive Touch-Screen Technology, Participatory Design,and "Getting It"....

PLEASE SEE THE UPDATED VERSION OF THIS POST:
Interactive Touch Screen Technology, Participatory Design, and "Getting It", Revisited

There's been some discussion over the reasons why so many people don't understand touch screen, or "surface" computing, even though research in this area has been going on for years.

As the new owner of the HP TouchSmart, I know that I get it.

The research I've conducted in this area suggests that people will "get-it" only if there is a strong commitment to develop touch-screen "surface" applications through a user-centered, participatory design process. In my view, this should incorporate principles of ethnography, and ensure that usability studies are conducted outside of the lab.

This approach was taken with Intel's Classmate PC. Intel has about 40 ethnographic researchers, and sent many of them to work with students and teachers in classrooms around the world. (A video regarding ethnographic research and the Intel Classmate project can be found near the end of this post.)



Where to start?
K-12 classrooms and media centers. Public libraries. Malls. Hospital lobbies and doctor's offices. Any waiting room. Staff lounges in medical centers, schools, and universities. Community festivities and events. Movie theater lobbies. Museums and other points of interests.

I believe we need to take a "touching is believing" approach.

Here are some thoughts:

When I try to explain my fascination with developing touch-screen interactive multimedia applications, (interactive whiteboards, multi-touch displays and tables, and the like), many of my friends and family members eyes glaze over. This is particularly true for people I know who are forty-ish or over.

Even if you are younger, if you never saw the cool technology demonstrated in the movie Minority Report, or if you have limited experience with video games, or if you haven't came within touching distance of an interactive whiteboard, the concept might be difficult to understand.

The reality?

Even people who have the opportunity to use surface computing technology on large screens do not take full advantage of it. Multi-touch screens are often used as single-touch screens, and interactive whiteboards in classrooms are often serve as expensive projector screens for teacher-controlled PowerPoint presentations.

Most importantly, there are few software developers who understand the surface computing approach, even with the popularity of the iPhone and iPod Touch. Most focus on traditional business-oriented or marketing applications, and have difficulty envisioning scenarios in which surface computing would be a welcome breath of fresh air.

Another factor is that not all people entrusted to market surface or touch screen computing fully understand it.


Despite a cool website showing off the goods, Microsoft's Surface multi-touch table has been slow to take off, limiting hope of bringing down the price tag to a price most families or schools could afford. (The picture above depicts an application for the Surface designed for health care professionals, not K-12 science education.)

Although you can't buy a Surface table for your family room, it is possible to buy a TouchSmart.
HP's TouchSmart website is engaging and highlights some examples of touch-screen interaction, but most people don't seem to know about it.

Unfortunately, you wouldn't have a clue that the HP TouchSmart exists browsing the aisles at Circuit City or Best Buy!

When I was shopping for my new TouchSmart, I noticed that from a distance, the TouchSmart looked just like the other larger flat-screen monitors filling up the aisles. The salespeople at both stores were not well-informed about the system. The only reason I knew bout the new TouchSmart was related to my obsession with interactive multimedia touch-screen applications- designing them, developing them, studying them, reading about them, blogging about them.... ; }

More thoughts:

After studying HCI (Human-Computer Interaction), and relating this knowledge to what I know as a psychologist, my hunch is that the "Window Icon Mouse Pointing-device" (WIMP) and keyboard input mind-set is embedded in our brains, to a certain extent. Like driving a car, it is something automatic and expected. This is true for users AND developers.

Think about it.

Suppose one day, you were told that you no longer were allowed to control your car by turning on the ignition, steering the wheel, or using your feet to accelerate, slow down, or stop the car! Instead, you needed to learn a new navigation, integration, and control system that involved waving your hands about and perhaps speaking a few commands.

For new drivers who'd never seen a car before, this new system would be user-friendly and intuitive. Perhaps it would be quite easy for 16-year-old kids to wrap their heads around this concept. For most of us, no. Imagine the disasters we would see on our streets and highways!

When we think about how newer technologies are introduced to people, we should keep this in mind.

In my mind, spreading the word about surface computing is not a "if you build it, they will come" phenomenon, like the iPhone. We can't ignore the broader picture.

From my middle-age woman's vantage point, I believe that it is important that the those involved with studying, developing, or marketing surface computing applications realize that many of us simply have no point of reference other than our experiences with ATMs, airline kiosks, supermarket self-serve lanes, and the like.

(The video clip at the very end of this post provides a good example of touch-screen technology gone wrong.)

Be aware that there are substantial numbers of people who might benefit from surface computing who prefer to avoid the ATMs, airline kiosks, and self-serve grocery shopping.

Realize that the collective experience with technology, in many cases, has not been too pretty. Many people have had such user-unfriendly experiences with productivity applications, forced upon them by their employers, that any interest or desire to explore emerging technologies has been zapped.

My own exposure to interactive "surface" related technology was somewhat accidental.

A few years ago, a huge box was deposited into the room I worked in a couple of days a week as a school psychologist at a middle school. After a week or so, I became curious, and found out that it was a SmartBoard. Until then (2002!), I did not know that interactive whiteboards existed.

The boxed remained unopened in the room for the entire school year, but no worry. I played with the only other SmartBoard in the school, and found a couple at the high school where I also worked. I hunted for all of the applications and interactive websites that I could find, and tried them out. That is when I was hooked. I could see all kinds of possibilities for interactive, engaging subject area learning activities. I could see the SmartBoards potential for music and art classes. With my own eyes, I saw how the SmartBoard engaged students with special needs in counseling activities.

(By the way, if you are working with middle school students, PBS Kid's ItsMyLife website activities work great on an interactive whiteboard.)

A few years have passed, and reflecting on all of my fun experiences with interactive whiteboards, with and without students, I now understand that many teachers still have had limited exposure to this technology.

This school year, many teachers are finding themselves teaching in classrooms recently outfitted with interactive whiteboards, scrambling along with educational technology staff development specialists, to figure out how it works best with various groups of students, and what sort of changes need to be made regarding instructional practice.

For the very first time, interactive whiteboards were installed in two classrooms at one of the schools I work at. One of the teachers I know thanked me for telling her about interactive whiteboards and sharing my resources and links.

If I hadn't let her know about this technology, she wouldn't have volunteered to have one installed in her classroom. It has transformed the way she teaches special needs students.

In the few months that she's used the whiteboard, I can see how much it has transformed the way the students learn. They are attentive, more communicative, and engaged. The students don't spend the whole day with the whiteboard - the interactive learning activities are woven into lessons at various times of the day, representing true technology integration.

Now let's see what happens when all-in-one touch-screen PC's are unleashed in our schools!

Some resources:
HP TouchSmart PC website, with demo
HP's TouchSmart YouTube videos
lm3labs (catchyoo, ubiq'window)
NUI Group (See member's links)
NextWindow
Fingertapps
thirteen23
SmartTechnologies
Perceptive Pixel - Jeff Hans
Microsoft Surface
iPhone
(More can be found by doing a search on this blog or The World Is My Interactive Interface.)

Value of ethnographic research:
Ethnographic Research Informed Intel's Classmate PC
"Intel looked closely at how students collaborate and move around in classroom environments. The new tablet feature was implemented so that the device would be more conducive to what Intel calls “micromobility”. Intel wants students to be able to carry around Classmate PCs in much the same way that they currently carry around paper and pencil." -via Putting People First and Ars Technica

The video below is from Intel's YouTube Channel. Information about Intel's approach to ethnographic research in classrooms during the development of the Classroom PC is highlighted. This approach uses participatory design and allows the set of applications developed for the Classmate PC to reflect the needs of local students and teachers. Schools from many different countries were included in this study.




FYI:

Need for Improvement: User-Unfriendly Information Kiosk Interactive Map

Here are some interesting pictures from lm3labs, which are in my interactive usability hall of fame:

Samsung's new Omnia SDG i900 was re-created in a much larger size, using lm3lab's Ubiq'window touchless technology.

For more about lm3labs, including several videoclips, take a look at one of my previous posts:
Lm3Labs, Nicolas Leoillot, and Multimedia Interaction

Fingertapps and NextWindow's Multi-Touch Firmware on the New HP Touchsmart PC,

Fingertapps is working on an application that utilizes NextWindow's multi-touch firmware, running on the second-generation HP Touchsmart PC. Fingertapps will be demonstrating their work in the NextWindow booth at Infocomm 2008 in Las Vegas, June 14-20.

Off-topic: Now I know why some people think I'm a Microsoft shill!

A while ago, I posted a response on another blog, and someone mistakenly thought that I was a Microsoft shill. Me?!

Now I know why.



When I was looking at my blog stats, I noticed that one of my visitors found a recent post via a Google search on microsoft new interactive technology. Curiously, the post was at the very top of the list:

New Interactive Technology: Tag Galaxy, Windows 7, PaperVision 3D, Microsoft Surface, Touch Screens, and Blog Posts Revisited

Results 1 - 10 of about 29,600,000 for microsoft new interactive technology. (0.12 seconds)

How did my post beat out over 29 million pages on the web?!

I've had an Apple computer, in one form or another, since 1985. When I decided to take a programming class a few years ago, I soon realized I had to adapt to the Windows world. I like C#, Silverlight, WPF, and XNA Game Studio. This does not make me a Microsoft shill.

I just happen to be overly passionate about interactive displays of all sizes, and fascinated with the possibilities of mult-touch. iPhones, touch-tables, touch-walls, devices that interact with displays (think Johnny Chung Lee), gesture + touch, urban screens, interactive exhibits, interactive way-finding... and the multimedia applications that support this sort of interaction.

I've written several posts about Apple's new technologies, like the iPod Touch and the new 3G iPhone. I'll be writing more about Apple as they research and develop flat panel displays:

"Apple is looking for a Senior Panel Process Engineer to lead the engineering activities to develop the new process and design for the multi-touch panel used in Apple products. This individual will serve as a focal point in the designing and the process development of advanced multi-touch panels from the concept to the product ramp."

I'd say I'm more of a cheerleader for all of those out there who are working so hard to create useful+cool technology for the future.

Update:
The Next Generation HP TouchSmart PC
The new TouchSmart PC's, which can display high definition content, aren't out on the market yet. HP is taking pre-orders.

NextWindow, a company that produces large interactive touch-screen displays, including those with multi-touch capabilities, was responsible for the touch-screen embedded in the TouchSmart PC.

Related:

HP Redefines Home Computing, Putting the Digital Lifestyle at People's Fingertips with New TouchSmart PC's

HP Introduces World's First Affordable Color-critical Display

Interactive User Interfaces: Nat Torkington's list of links to new and cool technologies.

Quick post:

Nat Torkington recently wrote a post on O'Reilly Radar with links and descriptions about new interactive interfaces, such as a multi-touch Rubik's Cube, a weather map with haptic feedback, NextWindow's multi-touch screens, Cyber Goggles, NUI, and more.

FireFly Game for Microsoft Surface: Demo by Carbonated Games; A look at a Multi-touch from Next Window

Watch the video clip to see more about Firefly game that was developed by Carbonated Games to take advantage of Microsoft's multi-touch enabled Surface table computer system. The game is in demo form only.For more information, see the article from Gaming Today.

For those of you who need multi-touch before you can get your hands on the Surface, you might be interested in NextWindow's multi-touch display, recently demonstrated at an expo:



Here are links to touch-screen project prototypes I worked on for HCI and Ubicomp classes I took in 2007:
poetry picture share photo-globe explorer

Interactive Displays and Whiteboards: Link to TechPsych Post

(photo from http://www.nextwindow.com)

I've posted new information and links about resources for interactive whiteboards and displays on the TechPsych blog:

So You're Getting an Interactive Whiteboard. Now What?

Cross Post from technology-supported human-world interaction blog: Interactive large-screen visitor information/concierge

This video is a news clip about interactive visitor kiosks in Kern County, California, designed to promote tourism in the region. Using a large touch-screen display, people have access to a wide range of information, displayed in a multi-media format. One of the featured displays is NextWindow's 2800 "Rugged Integrated Touch Panel", developed to withstand environmental wear and tear, with software developed by JupiterBay.




How it works:


Related Link:

Outdoor Interactive Displays Highlight Technology Collaboration

Top 15 interactive display technologies -Gizmo Watch

My HCI project prototype would be something fun to interact with on one of these kiosks!



I'd love to see interactive displays in parks, museums, libraries, malls, schools, hospitals, waiting rooms, hotel lobbies, cruise ships... Wouldn't it be great if these displays could interact with cell phones and PDA's?

Detailed post about NextWindow on the Future-Making Serious Games Blog

Elaine Alhadeff's has an extensive post about the various uses for NextWindow touch-screen displays on her Future-Making Serious Games blog. Take a look!

Savant's "Rosie" Interactive Table

Savant, an A/V home entertainment and control systems company, has announced "Rosie", a coffee table similar to Microsoft's new "Surface".

Introduction to Rosie
(after the intro, click on "coffee table")

According to information from the Savant website, the Rosie table has interactive multimedia features that "include integration and interaction with iTunes multimedia content, digital cameras, IP network cameras, business card readers, and many more digital devices on the horizon."

If anyone has information about the availability and pricing of the Rosie table, please leave a comment. I'd like to see if any of my touch-screen projects-in-process look on this display. I'm impressed by the features and sensitivity of the NextWindow Human Touch displays - I wonder if the Rosie will match the same level of quality.

At the moment, I'm working on some applications for use on touch-enabled displays/surfaces for education/literacy, cooperative learning activities, and adapted instruction and assessments for students who have special needs.

Visual Learning Lab Supports Effective Teaching and Learning

It seems that the UK is often on the cutting edge of using multimedia technology in education.

Here is a quote from the Visual Learning Lab website, at the University of Nottingham about ways the Humanities department is using visual learning technologies:

‘Showing Seeing Centre’ & ‘Visual Analysis Lab’

"Archaeology and Classics are both highly visual disciplines. In order to further develop the use of visual in teaching and learning, the VLL supports the creation of two new facilities, the Showing Seeing Centre and the Visual Analysis Lab."

"The Showing Seeing Centre will provide a context for students to work with visual resources using 3D-enabled computers for access to virtual reconstructions of archaeological sites and ancient civilizations, e.g. in gaming environments. Students will also have access to a range of equipment for digitzing and analysing visual material and for producing presentations and portfolio material. The equipment provided by the VLL consists of a wall-mounted LCD-screen, 4 high-spec laptops, a
high-spec A4-scanner, colour laser printer and a Playstation."

"The Visual Analysis Lab will provide facilities for teaching and learning in relation to the identification of archaeological remains (such as plant materials, animal bones and ceramics). The equipment provided by the VLL consists of two high- quality microscopes linked to digital cameras, a laptop and a data projector."

A 2007 report (pdf) from the University of Nottingham's Visual Learning Lab reviews of how visual learning technology will be used by departments such as pharmacy, veterinary medicine, medical sciences, modern language and cultures, biosciences, humanities, fildm and telvision studies, learning sciences, and computer sciences.

Link to article from the University of Nottingham: Visual Learning for the 21st Century

Related information:

FutureLab, of the UK, hosted a debate of the educational merits of interactive whiteboards, one of the technologies used to support visual and interactive multimedia teaching and learning. With the rush to adopt this technology for primary and secondary students, the participants pointed out that in order for teaching and learning to be effective, appropriate teacher training must take place.

If you have been following the Interactive Multimedia Technology or the Tech Psych blogs, you know that I'd like to see something like Microsoft's Surface in classrooms. Touch screen displays, such as the NextWindow Human Touch, appear to be more effective if they aren't dependent on a projector.

HP TouchSmart PC - an interactive touch screen for the home- and classroom?

Photos from the HP TouchSmart Website

I think this PC has possibilities for use in libraries, school media centers, and in classrooms.




This is a short video clip about the HP TouchSmart PC, a medium-sized touch-screen display that runs on Window's Vista. From what I understand, it uses technology from NextWindow.

If you use TouchSmart PC or something similar, or if you develop applications for the TouchSmart or other interactive touch applications, let me know what you think!

For related videos, visit the TouchSmart YouTube channel.
http://www.youtube.com/user/TouchSmart

Interactive web-based science and math: Link to my TechPsych post about ExploreLearning Gizmos

ExploreLearning is a website that offers a variety of engaging math and science activities, called "Gizmos", for students in grades 6-12.


ExploreLearning's Gizmos would be great on large touch-screen surfaces or displays, such as a NextWindow Human Touch, a SmartBoard, or Microsoft's Surface.

Since the activites are designed as learning modules and are web-based, the Gizmos might even work on iPhones!

Check out my TechPsych post for more information and links.

Photo courtesy of ExploreLearning.

More touch screen "surface" display musings...

I had my first chance to use an interactive touch-screen SmartBoard, by Smart Technologies in 2002-03. Since I work mostly with kids and teens, I wondered why large-display touch screen technology wasn't more widespread, since there are so many free, interactive websites that provide pretty engaging activities for users.

One of the things I learned was that large-display touch-screen technology is in the preschool stage. There are problems with screen responsiveness, screen resolution, durability, and input.

In recent years, the idea of a touch screen has evolved to table-tops and drafting boards, embedded within wireless systems that allow for interoperability with mobile devices and remote applications.

Great technology exists, but no-one has pulled all the components together in a way that can easily scale for the people who would benefit from this sort of technology the most - people who spend most of day time teaching, learning, or both. I had a great experience using a NextWindow Human Touch large-screen display for some of my projects last semester. It was difficult for me to track one down, but once I got my hands on it, I liked it, even though it did not have multi-touch capabilities.

One laptop for each child? That was a good idea for the late 1990's and early 2000's. One high-quality, affordable, large touch-screen display or table for each classroom would be more effective.

One touch-screen display/table for every 4-6 students would be better. Is there anyone out there who is up for the challenge?

Next Post: Updated links to interactive multimedia websites appropriate for large touch screen surfaces.

Usabililty guidelines for touch screen or surface applications from SAP

Here is a link to usability design guidelines for touch-screen applications on the SAP design guild website, posted by Gerd Waloszek, of the Product Design Center.

Although these guidelines were written in 2000, they still hold true in 2007, especially now that larger touch-screen applications such as Microsoft Surface (Madrid) have recently been unveiled.


Touch Screen Design Guide

Microsoft Surface multi touch screen table - I wish I had one for my projects last semester!

Microsoft Research recently unveiled Microsoft Surface: http://microsoft.com/surface

This multi - touch table can be used for a variety of applications, as outlined in the video from CNET and YouTube below:



I'd like to work on applications for use on a touch-table to support students with special needs, especially those who have autism spectrum disorders.

Last semester, I worked on prototype applications for use on a touch-screen surface -here is a photo. We used a NextWindow Human Touch large-screen display, which provided great screen resolution and touch-response.






This application was part of a travel-planning prototype developed for a course in Human-Computer Interaction. The application was demonstrated on a NextWindow Human Touch large screen display. Would it work on the iPhone?





Update: Examples from some of my other posts:


Here is another demo videoclip of a globe created in GoogleEarth using photo-overlays, with links to video clips uploaded to YouTube and embedded in individual posts on a blog. The above photo and the video clip show the application on a NextWindow Human Touch large-screen display.

This application would be great on a touch-table or touch-table set up on a drafting board. Although it was designed for a travel-planning application, it would work well in educational settings in subjects such as geography.


Poetry Picture Share



This was my first attempt at a "poetry picture share" application. It was designed for use on a multi-touch table and can be accessed remotely so people in different places can move things around on the screen. The video shows how the application works on a NextWindow Human Touch interactive large-screen display.

I am planning on adapting this application for use with students with special needs, such as those who have autism or other communication disorders.

First attempt at a touch-screen "Poetry Picture Share" application

This was my first attempt at a "poetry picture share" application. It was designed for use on a multi-touch table and can be accessed remotely so people in different places can move things around on the screen.   The video shows how the application works on a NextWindow Human Touch interactive large-screen display.

Version 2 will be posted soon. I am planning on adapting this application for use with students with special needs, such as those who have autism or other communication disorders.

Google Earth with photo overlays on a touch screen 2

Here is another demo videoclip of a globe created in GoogleEarth using photo-overlays, with links to video clips uploaded to YouTube and embedded in individual posts on a blog. The above photo and the video clip show the application on a NextWindow Human Touch large-screen display.

This application would be great on a touch-table or touch-table set up on a drafting board. Although it was designed for a travel-planning application, it would work well in educational settings in subjects such as geography.

NextWindow Human Touch Interactive display using photo overlays on Google Earth

This application was part of a travel-planning prototype developed for a course in Human-Computer Interaction.   The application was demonstrated on a NextWindow Human Touch large screen display.

Would it work on the iPhone?