RENCI Update: Combining Gaming and Visualization Technologies to Support Efficient and Effective Decision-Making

        RENCI stands for the Renaissance Computing Institute.  It is a multidisciplinary collaboration between UNC-Chapel Hill, Duke University, and North Carolina State University, with Engagement Sites at UNC Asheville, Duke University, Eastern Carolina University, North Carolina University, UNC Chapel Hill, UNC Charlotte, and the UNC Costal Studies Institute.  
        According to the mission statement, "RENCI develops and deploys advanced technologies to enable research discoveries and practical innovations."  Much of the work of RENCI focuses on large-scale information and data visualization.
        Why is this important?  It provides an effective visual-cognitive means of understanding complex data from a variety of disciplines, and also supports the collaboration of researchers across a variety of disciplines.   It has the potential to support larger-scale decision-making and problem-solving in our technology-dependent, interconnected world.  

Take a few minutes and explore what I've posted below:
       
Press release from RENCI about the interactive dome, pictured below (photo credit: RENCI-UNC Asheville):  "To understand human-induced global changes, there's no place like dome" Nancy Foltz, 10/12/11

RENCI: Gaming the Future
        The video below provides an overview of how innovative interactive visualization tools support decision-making across many disciplines.

RENCI: Unity 3D game engine to support immersive information visualization applications:

RENCI Situation Room Multi-touch Table, UNC-Charlotte:





RELATED

RENCI pioneering the visualization industry with innovative interfaces
Tracy Boyer Clark, Innovative Interactivity (II), 2/8/10
RENCI Visualization Center Update
Lynn Marentette, Interactive Multimedia Technology, 2/9/10
RENCI Tutorial: "Beautiful Code, Compelling Evidence: Functional Programming for Information Visualization and Visual Analytics" (pdf)  J.R. Heard
RENCI: Data to Decisions
Recent Publications from RENCI:

Y. Xin, I. Baldine, A. Mandal, C. Heermann, J. Chase, and A. Yumerefendi. “Embedding Virtual Topologies in Networked Clouds.”The 6th International Conference on Future Internet Technologies (CFI). Seoul, Korean, June 2011 
Y. Xin, I. Baldine, J. Chase, T. Beyene, B. Parkhurst, and A. Chakrabortty. “Virtual Smart Grid Architecture and Control Framework.” 2nd IEEE International Conference on Smart Grid Communications (IEEE SmartGridComm), Brussels, Belgium, Oct. 2011 
X. Ju, H. Zhang, W. Zeng,M. Sridharan, J. Li, A. Arora, R. Ramnath, Y. Xin. “LENS: Resource Specification for Wireless Sensor Network Experimentation Infrastructures. ” The 6th International Workshop on Wireless Network Testbeds, Experimental Evaluation and Characterization (WinTECH), Las Vegas, Nevada, Sep. 2011
RENCI's Facebook Page
Twitter: @RENCI

Hacking Autism: Touch Technology for Young People with Autism Spectrum Disorders (October 11 is the Hackathon!)

October 11, 2011 is a special day. A number of software programmers will be working to develop "innovative, touch-enabled applications for the autism cimmunity and make this software available for free on HackingAutism.org." Take a moment to watch the following video clip, and then explore the Hacking Autism website!
"When touch-enabled computing was introduced to the world, no one could have anticipated that this technology might help open up a new world of communication, learning and social possibilities for autistic children. Yet it has. Hacking Autism is a story of technology and hope and the difference it's making in the lives of some people who need it most.Hacking Autism doesn't seek to cure autism, but rather it aims to facilitate and accelerate technology-based ideas to help give those with autism a voice." -hackingautism.org
Touch technology + people with autism spectrum disorders = 
One of the reasons why I returned to school to take computer courses and explore natural user interfaces and interaction.   

RELATED
Interacting with HP TouchSmart Notes: Photo, Video, Audio and More
Interactive Visual Supports for Children with Autism:  Gillian Hayes' Work at the Social and Technology Action Research Group
Open Source Multi-touch Software for Young People with Autism
Interactive iPad Apps for Kids with Autism: Could some of these be transformed for multi-touch tabletop activities?
iPad Apps: Supporting Communication for Young People with Autism (links to Moms with Apps)
Reflections about interactivity in my present world (Aug. 2010)
Interactive Multi-touch for Children with Autism Spectrum Disorders: Research and Apps by Juan Paplo Hourcade, Thomas Hanson, and Natasha Bullock-Rest, University of Iowa
Open Autism Software "Where Social Skills and Interest in Computers Meet"
Sen H. Hirano, Michael T. Yeganyan, Gabriela Marcu, David H. Nguyen, Lou Anne Boyd, Gillian R. Hayes vSked: Evaluation of a System to Support Classroom Activities for Children with Autism. In CHI 2010 (Atlanta, GA, 2010).(pdf) Gillian R. Hayes, Sen Hirano, Gabriela 
Marcu, Mohamad Monibi, David H. Nguyen, and Michael Yeganyan. Interactive Visual Supports for Children with Autism. Personal and Ubiquitous Computing. April 2010. 
Monibi, M., Hayes, G.R. Mocotos: Mobile Communication Tools for Children with Special Needs. Proceedings of Interaction Design and Children, pages 121-124 ACM, 2008 
SOMEWHAT RELATED
Hope Technology School
Do2Learn JobTips
Autism Research Group at Georgia Tech
Immersive Cocoon Interaction"  "It's people who are now the interface"
Today I hooked up a Will to the IWB in the school's therapy room.  Next, a Kinect? 
(IWBs + Games + Social Skills)

Stantum's Multi-Modal, Multi-Touch Technology: Looks Great for 21st Century Learners, Supports Creative, Collaborative Knowledge-Sharing

Not long a go I had the opportunity to participate in a phone conference with Guillaume Largillier, of Stantum,  to learn more about the company's work in developing multi-touch technology, and how this technology can support a wide range of uses.  

What is exciting is that the tablet technology was designed from the beginning with content-creation in mind, unlike the iPad and similar Android-based tablets.  Although Stantum's tablet technology supports  passive "entertainment" and Internet content viewing, it offers so much more.  

I agree with Guillaume that this technology will be ideal for use in education. It is ideal for 21st Century teaching and learning.   In the very near future,  I'm sure we'll see fewer students lugging heavy  backpacks as this technology transforms textbooks to multi-modal, interactive experience platforms!

Stantum' IVSM multi-touch technology (IVSM = Interpolated Voltage Sensing Matrix) enables 10 finger touches with stylus input.  The goal is to enable content creation via tablets, for educational and office settings. This technology provides reliable palm rejection and contact discrimination,  a useful feature for students or anyone else who might have the need for a versatile tablet.  A multi-touch tablet is demoed in the video below:
 



Intel-Quanta Redvale Tablet featuring Stantum's Digital Resistive Technology
RELATED
Add Ambidexterity and Multi-modality to your Touch-enabled Devices
Guillaume Largillier, Electronic Design, 7/14/11
 "In South Korea, the government recently confirmed its plan to replace all printed textbooks nationwide by electronic counterparts by 2015, a move that will benefit from now available multi-touch technologies with precision and stylus input that enable handwriting recognition, making them especially suitable for products sold into Asian markets." 
About Guillaume Largillier:
"Guillaume Largillier’s background with the company includes seven years of entrepreneurship – co-founding JazzMutant and serving as CEO as it evolved into Stantum. Largillier has a broad knowledge of human-machine interface technologies, with strong expertise in multi-modal user interfaces. He has participated in major industry conferences (including SIGGRAPH, Microsoft Summit, SID Mobile Display Conference, Microsoft TechDays, and Interactive Displays Conference). Largillier earned an MA degree in audio-visual studies at the University of Bordeaux." -Stantum


Post: Multi-touch Update from Stantum
2010 Demo: MeeGo Tablet on Intel Moorestown 
Stantum's TouchPoints Newsletter (July 2011)
Stantum Whitepapers:
How to Evaluate Multi-Touch While Standing in a Store (pdf) - a great source of information.
Jim Meador, Pascal Auriel, Gauthier Chastan, Stantum
Specifying and Characterizing Tactile Performances for Multi-touch Panels: Toward a User-Centric Metrology (pdf) - outlines some important points!
Guillaume Largillier, Pascal Joguet, Cyril Recoquillon, Pascal Auriel, Axel Balley, Jim Meador, Julien Olivier, Gauthier Chastan
Stantum: info@stantum.com

Intel's 'Museum of Me': Moving 3D visualizations of your Facebook life.

(I missed this one when the buzz started. Thanks to Liz Dorland for the link.)


Museum of Me is a website created by Intel that provides a variety of interesting information visualizations of your photos and other information from Facebook.  Below is a video from Intel that gives a preview of what Museum of Me is about.  Better yet, take a look at all of the 'Museum of Me' videos posted on YouTube.

Video Demo: Museum of Me


RELATED
Intel's 'Museum of Me' is Cool, Creepy Facebook Fun
Sarah Jacobsson Purewal, PCWorld, 6/1/11


Intel's Facebook 'Museum of Me' is a Must-Try
Don  Reisinger, CNET News, The Digital Home 6/2/11

Intel on Facebook

MindHabits Online Demo: Useful Serious Game for Social Skills Group Activities

I'd like to share the on-line demo of MindHabit's suite of serious games that I've found useful in my work with teens and young adults who need support in the area of social-emotional skills. 


What I like about the online demo is that it adjusts to the player's responses. This feature made it fun to use during the last few social skills groups I facilitated at work, since it could be played by students with a range of cognitive abilities. I had students take turns playing the game using a SMARTboard, and found that all of the students paid attention to what was going on. In my opinion, using the interactive whiteboard supported "off-the-shoulder" learning among the students who were not at the board. 


MindGames is available for Windows and Macs, and the full version is just $19.99 and provides 100 game levels.  The full version tracks progress and includes four games.


Here's some information from the company's website:  
"Based on social intelligence research conducted at McGill University, these stress busting, confidence boosting games use simple, fun-to-play exercises designed to help players develop and maintain a more positive state of mind." 
 "Based on the principles of social intelligence: Inhibition - uses game mechanics to promote positive habits; Association - connects personal info to positive feedback; Activation - uses personal references"

You are playing the MindHabits Trainer online demo. Your progress will not be logged beyond this session. Copyright © 2008 MindHabits inc. All rights Reserved.

Upcoming: 

• Interview with Guillaume Largillier about Stantum's multi-touch tablet.
• Collaboration with Stevens Institute of Technology, focusing on a serious game project to support learning of "on-the-job" social skills for teens and young adults with autism spectrum disorders and related challenges.
• More news about large interactive displays, multi-touch, and gesture applications/installations.
• Cross-platform/device interactive "TV".
• Cathy Davidson's new book:  Now You See It: How The Brain Science of Attention Will Transform The Way We Live, Work, and Learn (Viking)

Update, plus iGaze app by Dunedin Multimedia for use during social skills group activities

So what am I up to now?  


I'd like to share with my readers that I've decided to continue in my present position as a school psychologist, while still devoting a portion of my free time to technology. From time-to-time I think deep thoughts about usability, accessibility,  and UX/Interaction related to off-the-desktop interactive multimedia applications running on screens of all sizes.  I'm hoping to create a few multimedia experiments using HTML5 and JavaScript, and explore jQuery if and when I can find the time!  


For the present school year, my main school is a program for students with more significant disabilities, including autism spectrum disorders.  My second school is a magnet high school for technology and the arts,  located on the same campus.  I also consult throughout the district on cases involving students who have suffered traumatic brain injuries, as well as students who have multiple disabilities.  I am thankful that I have a job in a school district that values 21st Century technology.  


I'm looking forward to another technology-rich school year.  I've spent some of the time I usually devote to blogging devoted exploring iPad apps instead.  Since I'm new to the world of iPads, I'm still in discovery mode.  What an adventure!   


There are plenty of educational apps out there, and many of them are suitable for students with special needs.  On the other hand, there is much room for improvement - across all iPad app categories.  Since there is very little research about what makes up a killer app- or suite of apps- for students with special needs, experimenting with  iPad apps is uncharted territory. 

I made the decision to bring my personal iPad2 to work after I discovered a number of apps that I thought would be useful in my work as a school psychologist with students who have special needs, including autism spectrum disorders.  

One of my intervention themes this year focuses on social skills.   This is especially important for students who participate in our schools community-based job training program.  I'm using some content from Unique Learning's transition materials,  as well as on-line activities from Do2Learn's JobTips website, because my aim is to facilitate social skills that will be useful in a variety of job and community settings.   


Although my main technology tool for working with groups is the SMARTBoard,  I've found that using a combination of interactive whiteboard and iPad activities to be especially effective.  I'm paving the way for more role-play activities in the future, and attempting to use technology to my advantage.


This past week, I used the iGaze app, created by Dunedin Multimedia, to help a group of high-school level students practice establishing and maintaining eye gaze, something that is difficult for most of them to demonstrate "in-person".  I was amazed.  Each student was excited to take his or her turn.  Even more amazing?  When each student took a turn, the other students looked at their eyes and faces.  No one rocked or "stimmed".  No one made noises.  I observed several instances of joint attention, much to my delight.   

Below is a video from Dunedin Multimedia's YouTube channel that is similar to what the students viewed during their group activity:

Here is some information from Dunedin Multimedia about the iGaze app:

"Eye contact is important to communication and social development, and yet the impaired ability to make and maintain eye contact is one of the most striking aspects of autism. iGaze is an eye contact simulator that can help to build confidence in using this important means of nonverbal social communication.  The app also contains information on eye contact and eye gaze, with links to relevant research."

During the social skills activity involving the iGaze app,  I used the SMART Board to display a large picture of a boss and a worker standing face to face, making eye contact, engaged in conversation.  The picture served as an anchor to remind the students of pictures and videos they'd previously viewed that illustrated the concept of face-to-face interaction and the importance of establishing eye-contact with others from time-to-time.


I'm hoping I will be able to access the YouTube videos from Dunedin so I can use them on the SMART Board. It will be interesting to see how this plays out!   I'm also planning to take a closer look at Dunedin Multimedia's emotion x app for the iPad.


RELATED 
Screen-shot of iGaze for the iPad Dunedin:

SOMEWHAT RELATED
The SMART Table at my school was updated today - I'm looking forward to using it for some group activities, now that it is back in working order and has new applications loaded up and ready to go!


If you are interested in learning more about technology related to students with special needs, be sure to check out Kate Ahern's blog, Teaching Learners with Multiple Special Needs

Kate's post about the features of Unique Learning Systems.


Upcoming:  more about tablets, interview with folks from Stantum, social-skills game-in-progress.....large displays in public spaces update....