RENCI at Duke University: Multi-Touch Collaborative Wall and Table utilizing TouchLib; More about UNC-C's Viz lab...

RENCI is a multi-disciplinary collaboration between several universities in North Carolina, with centers located at the Europa Center, Duke University, N.C. State, UNC Chapel Hill, East Carolina University, UNC-Asheville, UNC-Charlotte, and the Health Sciences Library at UNC-Chapel Hill. Many of the centers focus on visualization and collaborative technologies, and have been involved in multi-touch "surface" computing.

The pictures below are from the RENCI center at Duke University:

Duke Multi-Touch Collaborative Wall

The multi-touch wall is 13 x 5 feet, and utilizes six high-definition projectors, resulting in a combined resolution of 5760-2160, and supports multiple users. According to information on the RENCI website, the design is scalable and applicable to non-flat surfaces. The wall system runs on Windows and Linux.

(Photo by Josh Coyle)

(Photo by Josh Coyle)

DI, or Direct Illumination is used for touch detection in both the wall and the table for detecting touch. A separate instance of Touchlib runs for each of the 8 cameras used to detect touch. A gesture engine interprets the information about touches on the screen as gesture events. Each camera is handled separately for image processing and blob tracking tasks.

Graphics from the RENCI Vis Group Multi-Touch Blog

Here is cool picture of the "Multi-touch Calibration Device", which uses a built-in TouchLib utility.

Additional information can be found on the RENCI Vis Group Multi-Touch Blog.

FYI

Touchlib is a multi-touch development kit that can be found on the NUI-Group website.

"Touchlib is a library for creating multi-touch interaction surfaces. It handles tracking blobs of infrared light, and sends your programs these multi-touch events, such as 'finger down', 'finger moved', and 'finger released'. It includes a configuration app and a few demos to get you started, and will interace with most types of webcams and video capture devices. It currently works only under Windows but efforts are being made to port it to other platforms."

If you are interested in creating your own multi-touch table, the NUI-Group website and forums are a great place to start.

Related:

If you follow my blog, you probably know that I've taken several graduate courses at UNC-Charlotte. Some of my professors and a classmate or two have been involved in some exciting visualization research over the past year. (If you are serious about multi-touch and other visually-based applications, it is worth taking some time to familiarize yourself with visualization and interaction research.)

News from the UNC-Charlotte Vis Center:

At the University of North Carolina at Charlotte, RENCI is a collaboration between the UNC Charlotte Urban Institute, the Center for Applied Geographic Information Science, and the Charlotte Visualization Center.

11/06/2008
Robert Kosara’s group wins two awards at IEEE VisWeek Caroline Ziemkiewicz and Robert Kosara won Honorable Mention (the second highest award) at the IEEE InfoVis Conference for their paper, “The Shaping of Information by Visual Metaphors”. Also, Alex Godwin, Kosara’s student, won Best Poster for his submission, “Visual Data Mining of Unevenly-Spaced Event Sequences”.

The Vis Center is pretty fascinating, as you can see by the group of visitors at an open house.

If you are just as fascinated by this stuff as the guys in the picture, here are links to some recent papers by UNC-Charlotte faculty affiliated with the Vis Center:

The Shaping of Information by Visual Metaphors (Caroline Ziemkiewicz and Robert Kosara)

Evaluating the Relationship Between User Interaction and Financial Visual Analysis (Don Hyun Jeong, Wenwen Dou, Felsia Stukes, William Ribarsky, Heather Richter Lipford, Remco Chang)

Visual Analytics for Complex Concepts Using a Human Cognition Model (Tera Marie Green, William Ribarsky, and Brian Fisher)

Interactive Data Visualization Online: NY Times Examples

All of Inflation's Little Parts

This interactive data visualization can be found in the on-line version of the New York Times.










This is what you see in the zoom view.













For those of you interested in sports data, here an interactive chart about Tiger Woods:

How Woods Wins a Major







If you look closely, the data that relates from the various years is brushed to a fader shade. By clicking on various years, you can look at patterns and trends in the data, and see how Tiger did in the various areas.












Links via Ranjit S. Mathoda: When will blogs start presenting data using interactive visuals alongside their stories?

Update 6/3/08: Another InfoGraphic from the New York Times, via Randy Krum:

Virtual Math Museum: Online Math Art:

The Virtual Math Museum has a wealth of visual information useful to those in and outside the field of math. The mathmatical art section has links to the works of Paul Nylander, George Hart, Titia van Beugen, Brian Johnston, Bathsheba Grossman, Jos Leys, Paul Bourke, Jean Consant, and Luc Benard.

Each of the Math Artist pages provides information about the artist that in my opinion, would be useful to teachers who aim to encourage students to consider pursuing STEM-related careers. (Science, Technology, Engineering, Math).

The content of the entire Virtual Math Museum website is impressive on a large display or interactive whiteboard!


FYI:

"3D-XplorMath Home Page

The group in charge of the 3D-XplorMath software development project and the related Virtual Mathematics Museum website project is the 3DXM Consortium, an international volunteer group of mathematicians. The Consortium gratefully acknowledges ongoing support for these projects by The National Science Foundation (DUE Award #0514781) and is grateful to the Mathematics Department of The University of California at Irvine for hosting the 3D-XplorMath and Virtual Mathematical Museum websites."

Paul Bourke's Experiments in Interactive Visual Immersion in Second Life - and more....

"Preprocessed spherical projections from inside a crystal including the Hershfield surface"
Evaluating Second Life as a Collaborative Tool for Scientific Visualization
http://local.wasp.uwa.edu.au/~pbourke/papers/cgat08/

I thought I'd devote a post to Paul Bourke's exciting work in the area of what I call "interactive visual immersion".

According to a bio on a math art website, Paul's working life "has revolved around high performance computing and computer graphics, in particular scientific visualisation: the use of computer graphics to represent scientific data with the aim of enhancing understanding of the underlying structure and processes." Paul is also interested in the use of "novel display technologies that can further enhance the understanding of large and complicated geometric datasets...These engage capabilities of our visual system not exploited by traditional computer displays..."

Paul recently participated in the the Computer Games, Multimedia & and Allied Technology 08: International Conference & Industry Symposium on Computer Games; Animation, Multimedia, IPTV & Edutainment. (CGAT'08, Singapore, April 28-30)

The above picture is from his paper, Evaluating Second Life as a Tool for Collaborative Scientific Visualization. (pdf), taken from Paul's webpage, where you can find a link to the slides from his talk.

Bourke points out that there are few software tools available that support shared, remote collaborative scientific visualization. What is available is expensive, exploratory, and/or difficult to install and operate. Bourke proposes that Second Life might prove to be a useful tool for collaborative SciViz, despite some current limitations. Second Life is a cross-platform 3D environment that was designed specifically for interaction between many people, and it allows for texture mapping, which is a plus for visualization work. Burke notes that there are limitations, such as Second Life's low geometric complexity.

Paul Bourke's website includes a page that lists all of his papers, articles, and seminars, with impressive visuals alongside each entry. Since I recently completed a visualization class and also gave a short presentation about accessible games for health, I found many of Bourke's papers intriguing:

Vertical dome (iDome): Visualisation and Navigable movies
Visualization for scientists, museums, public outreach, and education
Immersive environments and applications to gaming
Exploiting our sense of touch for scientific visualization.
Tactile Visualization: Feel your data!
Apple technology powering displays that engage the human visual system
iDome and digital projection into hemispherical domes

Take the time to explore Bourke's entire website. Look at his texture library and his "other" section!

FYI: Here is a link to the CGAT'08 list of speakers, complete with bios and abstracts.

Cross Post from Tech Psych: Visualization Symposium, Visualization Day

This is cross-posted on the Tech-Psych blog.

I recently attended the Visualization in the World Symposium, hosted by the Charlotte Viz Center at UNC-Charlotte. I was impressed by the variety of disciplines represented at the symposium- the speakers came from fields such as architecture, psychology, and geography. The audience was also diverse.

The slides from the presentations will be available soon, so check back to follow the links, or visit the Charlotte Visualization Center's website.

If you are interested in visual thinking, visual literacy, visual communication, and visualization in education, take the time to explore the links once they are posted!

FYI: There is a growing group of people who'd like to get a "World Visualization Day" off the ground. Earth Day is celebrated in our schools, why not a visualization day?! Dr. Kosara, the author of the Eager Eyes blog, is a strong supporter of this movement.

At the moment, various colleges and organizations offer a "visualization day" from time-to-time. If you live in the New York area, you might be interested in attending Visualization Day at City College of New York.

British Library's Online Gallery: Turning the Pages- Great for an interactive whiteboard or display

The British Library offers an on-line interactive gallery, "Turn the Pages" , where you can "turn" the pages of great books, page by page, view additional information about the information of the page you are looking at, and also listen to an audio description. You also have the option of using a magnifying feature that you can move over the surface of the page to get a closer view of the text or illustrations.

If you have an interactive touch screen display or whiteboard, you can turn the pages with your hand, and also move the magnifying viewport about the screen. What a great resource for the classroom!

Here is additional information from the "Turning the Pages" website that will help you get started:

"The standard version of Turning the Pages™ uses the Shockwave plugin, which can be downloaded from the Adobe website, to simulate the action of turning the pages of a real book. For Mac OS X users there is an alternative download. The volumes may not open if you block popups on your computer. Technical specification"

"A new version, Turning the Pages 2.0™, runs on Microsoft Vista operating system (and on Windows XP with the .NET 3 framework). It will also run on other operating systems using the Microsoft Silverlight plugin. Technical specification"

"And there are alternative versions which do not need a plugin but display static images (and enlargements) in standard web pages, in the same window."

Here are some sample titles:

Masterpiece of the Renaissance, Landmarks in Medical History, Glimpses of Medieval Art, Mozart's Musical Diary (with 75 audio excerpts), 15th-Century Church Book, Flemish Masters in Miniature,
Sketches by Leonardo, Classic of Botanical Illustration, The Original Alice, by Lewis Carrol....

More touch-screen videos...

Here is an interesting video about TouchTable's $59,000.00 system:



ESRI's ArcGIS running on a TouchTable:



The application supports collaboration. People can interact with one another around a single table, with others at remote tables, and people using laptops and mobile devices out in the field.

Link: ESRI's GIS for K12 Schools

Visualizing Content on the Web: Great pictures, descriptions, and links on Max Kiesler's blog

"Content Visualizations: The Next Wave of Interaction Design" is the topic of Max Kiesler's recent blog post.

Searches conducted on the Web are primarily word-based, and the same is true for searches conducted on PC's. What results is a list of phrases, which are often difficult to sort and prioritize quickly.

The increased bandwidth available on the web now allows for content that contains a range of multimedia components, such as photos and video clips. Many on-line journal articles, blog posts, and of course, information visualization websites, contain important visual-oriented information that might be missed through traditional searches.

Kiesler discusses some solutions to this problem in his post. Take a look at it soon- it contains great visualizations, as well as links to additional information and resources.

Although Keisler does not state it directly, his post makes the case for the importance visual and multimedia literacy in our society.

Note: For those of you who follow my blog, you'll know that this sort of visual approach would be a great tool in education, especially when presented on interactive large-screen displays.

Yet another video about an interactive touch-table desk with potential for educational settings

Here is yet another video of a touch table from Microsoft's Center for Information Work that I think has great potential for use in education settings and for "serious games".

Microsoft appears to be targeting business, retail, and entertainment for new "surface computing" applications. I'd like to see Microsoft focus some of their efforts with this technology on education, as I think this technology would support "engaged learning". It might also inspire young people to consider future careers in technology. Given that we have a high school dropout-rate of about 30% in the US, we don't have too much time to waste.


This system allows for hands-free search via voice, which would be great for people who have physical disabilities.

As a school psychologist, I can see many uses for this sort of set-up to support what I do at work. I can envision interactive assessments on this table- if you work in education or psychology, or if you are interested in this sort of technology, leave a comment!

Microsoft's Center for Information Work, the group working on the technology behind the table shown in the video clip.

For a glimpse of some of the work I did last semester using touch-screen displays, take a look at the following posts:

Touch Screen Poetry Picture Share

Google Earth with photo-overlays

Google Earth photo-overlay on a touch screen