Looking forward to CHI 2012: Child Computer Interaction, Educational Interfaces, Health, Special Needs, and Much More!

I am looking forward to attending the ACM-CHI 2012 conference!


On Saturday and Sunday I'll be at the Educational Interfaces, Software, and Technology (EIST) workshop, which is part of the Child Computer Interaction/HCI and Kids community.  I've selected a few papers/presentations/panels that I hope to attend during the remainder of the conference below.


If you are curious about other topics that will be presented at CHI 2012, take a look at the short video previews on the CHIMadness2012 YouTube channel.  

VocSyl


VocSyl: Designing Visualizations to Facilitate Multisyllabic Speech with Children with Autism and Speech Delay (pdf)
Joshua Hailpern, Andrew Harris, Reed LaBotz, Brianna Birman, Karrie Karahalios, Laura DeThorne, Jim Halle (Social Spaces Research Group, University of Illinois at Urbana Champaign)

Social Scripts
 
Fatima Bourjarwah: Facilitating the Authoring of Multimedia Social Skills Instructional Modules for Adolescents with High-Functioning Autism

Autism and Maths Tutor
Research Showcase - Autism & Maths tutor - CHI 2012 from George Chan on Vimeo.

ShoeSense


Giles Bailly, Joerg Mueller, Michael Rohs, Daniel Wigdor, Sven Kratz
ShoeSense: A New Perspective on Hand Gestures and Wearable Applications


Escobedo, L., Nguyen, D.H., Boyd, L., Hirano, S.H., Rangel, A., Garcia, D., Tentori, M., & Hayes, G.R. (2012). MOSOCO: A Mobile Assistive Tool to Support Children with Autism Practicing Social Skills in Real-Life Situations. Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2012). Austin, Texas (May 5-10, 2012). New York: ACM Press. To appear

Design of an Exergaming Station for Children with Cerebral Palsy

(Research team from Queen's University, Canada, Holland Bloorview Kids Rehabilitation Hospital)


Illumishare


Paper: IllumiShare: Sharing Any Surface

Sasa Junuzovic, Kori Inkpen, Tom Blank, Anoop Gupta, Microsoft Research

Panel: Tangible Interfaces for Children: Cognitive, Social & Physical Benefits and Challenges
Shuili Gilutz, Sandra Calvert, Kathleen Kremer, Barbara Chamberline, Geri Gay

Paper: Improving Literacy in Developing Countries Using Speech-Recognition-Supported Games on Mobile Devices 
Anuj Kumar, Pooja Reddy, Anuj Tewari, Rajat Agrawal, Matthew Kam


Tap & Play: And End-User Toolkit for Authoring Interactive Pen and Paper Language Activities (pdf) Ann Marie Piper, Nadir Weibel, James D. Hollan


RELATED
About the CHI Conference (from the CHI 2012 Conference Preview)
"Originally a small conference for psychologists interested in user interface design, the annual CHI conference has grown to include a very diverse participant group (such as interaction designers, computer scientists, engineering psychologists, developers, performing artists and more). It has also grown to deal with larger problems such as the organizational integration of technology and the use of technology in the home rather than only office settings. This year's conference marks 30 years of research, innovation and development in the field of Human-Computer Interaction and is expected to draw more than 2500 professionals from over 40 countries. The experience at CHI 2012 offers innovative opportunities for interacting with future technologies. The following areas represent a small portion of the total conference. For complete information about this year's conference, consult the Advance Program."


"Featuring over 900 works, the CHI conference is the premier worldwide forum for the exchange of information on all aspects of human-computer interaction. Typically the works presented address the concerns of design, engineering, management and user experience professionals. This year's conference also features works that focus on: Digital Arts, Games and Entertainment, Human-Computer Interaction for Kids, Health and Sustainability. Works are presented in several different venues. After two days of intimate pre-conference workshops, the main conference includes panel discussions, courses that provide leading-edge HCI knowledge, paper sessions, case studies, works-in-progress, student competitions (involving design, research and games), interactive demonstrations, special interest groups, and a Tuesday evening video night (popcorn included)." 



SIG-CHI is the Special Interest Group on Computer-Human Interaction, and is part of ACM, the Association for Computing Machinery


Child Computer Interaction/HCI for Kids Chairs:
Janet C Read, University of Central Lancashire, UK
Panos Markopoulos, Eindhoven University of Technology
Allison Druin, University of Maryland


Educational Interfaces, Software, and Technology workshop organizers
CHI 2012 Facebook Page
EIST 2012 Facebook Page


SOMEWHAT RELATED 
The Autism Experience in Ubiquitous Computing (pdf)
Monica Tenority, Ph.D., UZBC, Ensenada, BC


Gillian Hayes:  Assistant Professor in Informatics, School of Information and Computer Sciences; Department of Education, University of California, Irvine.
Social and Technological Action Research (STAR), 

Interactive Technologies for Children with Special Needs IDC 2012 
(11th International Conference on Interaction Design and Children)

As special themes, IDC 2012 would like to discuss children's needs under the perspectives of "pedagogical aspects in theory and practise" as well as "children from diverse cultural backgrounds".


Grawemeyer, B., Johnson, H., Brosnan, M., Ashwin, E., Benton, L. (2012) Developing an Embodied Pedagogical Agent With and For Young People with Autism Spectrum Disorder. Accepted for presentation at the 11th International Conference on Intelligent Tutoring Systems, ITS 2012.

Starbucks Cup Magic: Augmented Reality App for iPhone and Android!

The app was developed by Blast Radius.  FYI, Blast Radius is hiring.

"Blast Radius is a global agency that takes a strategic approach to tackling the complex issues of growing brand and revenue in a digitally connected world."


For more information, tak a look at the Starbucks Cup Magic iTunes preview.


Thanks to Ajit Jaokar for the link!

Summer Blogging Plans - Lots of interesting updates -Sony's Tablet video(s), more to come...

I've been wrapping up the loose ends of the last few weeks of what turned out to be quite a busy school year,  so I haven't posted in about 10 days!    I have lots to cover, including interesting updates about a variety of tech companies I follow.


Today, I'm sharing a video from Sony that highlights the features of the company's iPad-like tablet in a creative way:


The video is the first of a 5-part campaign to promote the S1 and S2 Android tablets  For more information:


Sony Teases New Tablets With a Mysterious Video
Stan Schroeder, Mashable 6/17/11
Sony Launching 2 New Tablets, Both Run Android Honeycomb
Jolie O'Dell, Mashable, 4/26/11


Here's a previous teaser:

"Here's a preview of our two tablets - codename S1 and S2.With the S1 designed for comfort and S2 built for safe portability Sony enters the Tablet arena with two very distinct offerings."-Sony

Note: If you are a new visitor,  I work as a school psychologist in my "day job",  which can spill over to evenings and weekends at times...  I returned to school to take computer and technology courses back in the  '00s,  and started to blogging because it was a requirement for one of my courses.


I never stopped.  


My blogs still serve me well as on-line filing cabinets, since I have a fairly wide range of interests and I like to drill down deeper into topics that strike my fancy.  I'm curious that way.  Because of my interest in interactive multimedia technology,  most of my posts include video clips, photos, and links to interesting websites.    

Pervasive Retail: Theme of the April-June edition of Pervasive Computing (IEEE)

This is just a teaser.  I'll have time to read it next week when I'm on break!


FYI: This is one of my favorite tech journals. This issue's theme focuses on the use of pervasive technology in retail settings.   Other topics in this issue include wearables, pervasive health, smartphone computing in the classroom, innovative Ubicomp products, and more.


IEEE Pervasive Computing

About the Web of Things - Great Presentations & Links

"The Web of Things is a community of developers, researchers, and designers that explore the future of the physical Web. We explore how to leverage Web standards to interconnect all types of embedded devices (sensors, mobile phones, etc), in order to make them easier to use and to integrate in classic Web applications. We aim to build a future Web of devices that is truly open, flexible, and scalable, and we believe Web standards are the best way to do it."


WEB OF THINGS PRESENTATIONS
Web of Things - Towards Open and Sharable Networks of Embedded Devices

View more presentations from vladounet.

Design of a Web-based Distributed Location-aware Infrastructure for Mobile Devices

View more presentations from vladounet

WoT @ Oracle-Labs

View more presentations from Dominique Guinard.




RELATED

Web of Things Publications

Pdf versions of Web of Things publications

Vlad Trifa's Lift11 Talk:  A Web of Things for Smarter Cities (pdf)

Web of Things Upcoming Event
What: 2nd International Workshop on the Web of Things (WoT 2011)
Where: Pervasive 2011 conference, San Francisco, USA
When: June 12, 2011
For who: Hackers, developers, web, and ubicomp/pervasive researchers.
Web of Things Projects

BlackBerry's "iPad" preview video! -- PlayBook

Thanks to Seth Sandler for the link!

More about this topic later...

More Multi-touch: Microsoft's Courier Touch & Stylus Input "Digital Journal"; Pre-order the iPad ---Possibilities for education!

Lately I've been thinking deeply about ways new multi-touch technologies, running on screens and surfaces of all sizes, can support learning and collaboration, in and outside of the classroom.  Microsoft's Courier and Apple's iPad are two tools I'd love to test out in the digital mix in the schools. Here's the latest information about the Courier, via Engadget:

The applications running on this demo look useful!

Apparently the Microsoft Courier, a dual screen 7-inch notebook, accepts multi-touch and stylus input:


-via Deeper2K's YouTube channel

According to Engadget, the Courier is "built on Tegra 2 and runs on the same OS as the Zune HD, Pink, and Windows Mobile 7 Series...We're also hearing that there will be a built-in camera, and there's a headphone jack for media playback. Most interestingly, it looks like the Courier will also serve as Microsoft's e-book device...."

More information can be found on the Engadget website:
Microsoft's Courier "digital journal": Exclusive pictures and details (update: video!)
Also read Ina Fried's article on CNET news:
More details leak on Microsoft's 'Courier'

-Engadget: Courier User Interface Gallery


By the way, you can pre-order your shiny new iPad from the Apple Store right now!


-Apple Store

For the Techies and the Tech-Curious:

The iPhone SDK 3.2 beta includes what you'll need for developing applications for the iPad. You can go to the iPad webpage and dowload the SDK, which includes an iPad Simulator, programming guide, sample code, human interface guide, and more.   But first, you must be a member of the iPhone Developer Program.  The fee is $99.00 a year.

I will share my thoughts about these devices and their use for learning/education in future posts.

Interactive Mobile Multimedia

A study in January of 2005 by Nokia indicated that there was a demand for interactive mobile multimedia services. That study was conducted about five years ago, before anyone had heard of the iPhone!   The technology to support interactive mobile multimedia has come a long way since then, and many of the new applications support multi-touch, or at least duo touch interactivity.

I'm very much interested in figuring out how to design web-based interactive content (and apps) that can be optimized for touch (and multi-touch/gesture) screens of various sizes, from SmartPhones/iPhones to the large interactive whiteboards that are now in a multitude of classrooms.

From my experience as a school psychologist, I know that there are many teens who have graduated from traditional cell phone to the next level.  If they don't have an iPhone, they have a smart phone.  I don't have the statistics on this, but my personal observations tell me that there are teens who come from families who are from lower economic status who are somehow able to own 3G smartphones.

What a great opportunity to provide casual interactive multimedia educational games to support student learning!  The games and activities could be assigned as homework from time to time, and with the appropriate LMS (Learning Management System), the teacher would have instant access to student progress.  In addition, the students would be provided with immediate feedback about their "work", which we know is an important factor in learning.

It is difficult to figure out the best path to forge, since nearly every week someone announces a new platform, technology, and programming approach!

At any rate, here are a few interesting things related to this topic that I'd like to share.  Many of these concepts are in the experimental phase, but are worth some attention.


SciLor's Open-Source Programs
SciLor's HD2/ Leo Multi-touch Demo v2 12/3/09 using VB.Net and Windows Mobile

SciLor's Comments: 
I have manged it to get Multitouch running in an vb.net app :)
There are still some bugs, which have to be resolved:
-Stop auto alignment!
-Identify the "Touches"


Google I/O 2009: Mastering the Android Media Framework


AT&T Interactive Mobile Website


Satellite-Terrestrial Network Delivering Mobile Video with Interactive Services - ICO mim





RELATED
Adding Multi-Touch to Your Windows Mobile Application's User Interface
Wei-Meng Lee,  DevX.com 3/24/08
Previous Post:  The new 3G iPhone:  Expanding the Possibilities of Interactive Multimedia Communication (Interactive Multimedia Technology,  6/9/08)
Note: I just skimmed the following articles - when I have more time, I'll post more of my reflections related to this set of topics.

Rethinking context framworks: Enabling cross-domain, cross-device experiences (pdf)

Daniel Stewart, Nitya Narasimhan,  Position Paper, CMPPC Workshop, Pervasive 2007

Interactive Mobile Multimedia Needs IP and Circuits
Brough Turner,  Internet Telephony, 9/09
Primetime for Mobile Television:  Extending the entertainment concept by bringing together the best of both worlds (pdf)  IBM Institute for Business Value
A Holistic Approach to Enhance Universal Usability in m-Learning
Vlado Glavinic, Sandi Ljubic, Mihael Kukec, 2008 The Second International Conference on Mobile Ubiquitous Computing, Systems, Services and Technologies
Seamless Mobility: A Continuity of Experiences across Domains, Devices, and Networks (pdf) 2005
Raghu Rau, Senior Vice President of Marketing, Motorola
Ambient Networks:  Cooperative Mobile Networking for the Wireless World
Norbert Niebert, John Wiley and Sons LTD  4/07 
Mobility management challenges and issues in 4G heterogeneous networks (link to ACM pdf)
Sadia Hussain, Zara Hamid and Naveed S. Khattak, InterSense '06.  Proceedings of the first International Conference on Integrated Internet Ad hoc and Sensor Networks
Mobile Multimedia: Tune in to Digital Convergence (pdf)
DVB-Scene (a trade magazine) 3/2008
HP OpenCall Media Plafform: a cost-effective, agile IP media server (pdf)
Whitepaper, Hewlett-Packard Development Company, L.P.  2/2009
A survey of wireless multimedia sensor networks (pdf)
Ian F. Akyildiz, Tommaso Melodia, Kaushik R. Chowdhury, 2006  Science Direct  Elsevier


Mobile Multimedia Companies/R&D
Stantum  (UMPC)

Movidity
MobIME: Mobile Internet for Media and Entertainment

GestureTek & Sprint's Interactive Wall: 3D depth-sensing allows wall interaction with a cell phone.

I missed this one! The video and photos below are of the Sprint Center Interactive Wall, powered by GestureTek's 3D depth-sensing system.  The media art was created by Takashi Kawashima,a designer/media artist who lives in San Francisco.   He has an MFA in Design| Media Arts from UCLA.

The interactive display can be controlled by a cell phone.



YouTube description/plug:
"GestureTeks 3D depth sensing technology powers an attention-grabbing interactive digital signage system for telecom leader Sprint. The 3D depth sensing interactive display screen, with mobile phone connectivity, tracks peoples body movements, and responds by sending a Sprint promotional message that follows them the entire length of the interactive billboard. The interactive motion-detecting advertising message invites users to create their own personalized interactive wall art on Sprints gesture control screen, by calling Sprint on their mobile phone. GestureTeks 3D tracker is the heart of the system. Installation lead: Mission Electronics. Creative: Goodby Silverstein."

The Instant DJ application looks fun!  It allows you to mix the music tracks on the large display with your phone.


Phone Painter:  Sprint Center Interactive Wall



Instant DJ



Now Widget


RELATED
Sprint Uses GestureTek 3D Tracking & Control System for New Interactive Digital Signage Campaign
GestureTek Announces 3D Gesture Tracking Initiatives for Sprint and Hitachi; Shares New 3D Patent Information

SOMEWHAT RELATED
GestureFX:  Next Generation Pediatrics Business Case (interactive floor for a pediatric clinic's waiting room)
AirPoint Hand-Tracking Unit for Mouse Replacement and "Point to Control" Interactivity

Cross posted on The World Is My Interface blog

Interactive Content & Communication Across Platforms, Screens, and Situations: Nokia's The Way We Live Next 3.0

Nokia's The Way We Live Next 3.0 conference was held November 10-11, 2009, and I was fortunate to come across the concept video shared during the opening presentation.



-Via Putting People First and Nokia Conversations

RELATED
Nokia The Way We Live Next 3.0  Putting People First post

The Way We Live Next:  Social apps and open-source R&D (Jesse Sutton 11/11/09,  Wired UK)
(Discusses Life Tools, Health Radar, Mobile Job Hunt applications.)

Nokia- life in 2015 (JBC, Nokia Conversations, 11/11/09 - a review Heikki Norta's presentation. Norta is head of corporate strategy.)

Multiplying our Efforts (pdf)  Presentation: Henry Tirri, SVP, Head of Nokia Research Center

Communities creating Computers – Computers connecting Communities (pdf)  Presentation:  Peter Schneider, Head of Technology Marketing, Maemo Devices, Nokia

Communities of the Future (pdf)  Presentation:  Purnima Kochikar, VP, Head of Forum Nokia & Developer Community

Go Mobile with Cash (pdf)   Presentation:  Teppo Paavola, VP, General Manager of Mobile Financial Services, Nokia

SOMEWHAT RELATED

The Nokia Braille Reader (Experimental)


The Nokia Braille Reader is a joint project between Nokia, Tampere University, and the Finnish Federation of Visually Impaired.

Cross Posted on The World Is My Interface

Adobe's Resources: Contextual Solutions, Rich internet applications across devices, and Open Screen.

I thought I'd share a few interesting resources from Adobe.  The company is focused on the future, and I plan to watch what unfolds.  Adobe believes that the next generation of the company's products will move us forward to a world of seamless access to content, across screens of all sizes, everywhere we go.

I'm hoping that this will not lead to an environment where we have difficulty escaping "skip intro" ads everywhere we turn.  Hopefully it won't be too bad!

I found a few gems of wisdom in the Adobe white paper,   Designing Contextual Solutions and Applications.  The paper provides a conceptual framework that I think would be helpful to web designers/developers who are interested in off-the-desktop application development.


Here is an excerpt from the introduction of the white paper:
"With its platforms and products that are inherently multichannel and multidevice, Adobe envisions a new class of “contextual solutions” taking hold in the marketplace. These solutions are broader in scope than a device, a campaign, or a single service; rather, they encapsulate the various contexts in which the end user exists, interacts, thinks, consumes, and purchases. And when content owners understand the different types of users and how they differ in their contexts, they are in a much better position to design experiences that are compelling and sticky. At the heart of every contextual solution is at least one or more contextual applications—an emerging type of application that spans multiple devices and uses system, user, and network contexts to provide an optimized user experience and deliver improved business results.

This white paper provides an overview of the types of contexts that compose a contextual solution and application. With examples given along the way, it culminates with a framework for considering all appropriate contexts while designing and developing a new contextual solution or an application that is part of an existing solution."


Another Adobe white paper is quite useful - Rich Internet Applications across devices: The emergence of contextual applications.  It provides examples of RIA's across devices, such as Amazon Video On Demand,  Demandbase, Atlantic Records: Fanbase, Finetune, and Times Reader 2.0.

Additional Adobe Resources
Contextual Applications
Open Screen Project:  "Singular experience, multiple devices"
Adobe Flash Platform

The World Is My Interface

THE WORLD IS MY INTERFACE  is the new  title of my Technology-Supported Human-World Interaction blog.  The name was just too long!

The first post written under the new title has a variety of links about ubiquitous computing, off-the-desktop interaction design, use of technology in public spaces, and so forth.  There are a few links to scholarly research and related projects, too.

V12's Dual-Touch-screen Canova: Multi-touch could support applications for universal design, education, and assistive technology.

V12 Design is a company with offices in Italy and Australia. It is developing the second-generation version of Canova . Since the product will not be on the market for at least 16 months, no pictures of the newest version were available. The first version is depicted in the photos below:

Canova Generation 1#


(Photo via Gizmodo; depicts the first version of the dual LCD laptop.)

According to information from LaptopMag, Conova was..The first-generation model....was envisioned to transform from a sketch pad, to a writing pad with an electronic pen, to a newspaper."



From the Gizmodo AU website:

"An interview with Valerio Cometti, the founder and managing director of V12 Design, confirmed that the upcoming version would support multitouch input and that a microphone would be built into the design for voice commands."

With multi-touch and audio input, this device would be a godsend for young people with learning difficulties and others who require assistive technology. It would also be very useful for people in various fields of work. I assume that the Canova will come with speakers, a DVD player, a video camera, Blue-tooth and Wi-Fi capabilities.

I was excited about the new dual-touch screen laptops in development for the One Laptop Per Child project. I'm even more excited about the Canova. Hopefully, the company is devoting attention to usability studies with a wide range of people, using a variety of interactive demo applications.

I wonder if I can get my hands on a second-generation prototype of Canova to test out my touch-screen application "experiments". I'm bursting with ideas to try out, including gaming applications.

I want one now!

The second version will be developed by a US manufacturer. If anyone knows more about this leave a comment!

Related:
V12 Designs' Dual-Touchscreen Notebook Coming Within Two Years

V12 DEsign Dual-Touchscreen Notebook will make ebook readers drool

V12 Design Delivering Dual Touchscreen Laptop Within Two Years

My Nokia n800 Internet Tablet!

I recently purchased a Nokia n800 Internet tablet for about $225.00. I'm impressed with all of the features for the price! It works well for making Internet calls via Skype, as it provides an integrated camera/ webcam.

The screen is crisp and easy to read, especially when zoomed in. The screen can be manipulated with a stylus or fingers, and the on-screen keyboard can be enlarged to allow for finger-typing.

Playing around with the device, I can see that it has potential for use in education. In my opinion, the n800 the potential to support low-cost assisted technology and augmented communication applications.

Screen shot of pictures on flickr.

A few specs:

• Direct access to shared media over Universal Plug and Play (UPnP) connectivity and Windows network shares
• Rhapsody Music service client (only available in US)
• Direct access to Nokia Internet Radio Directory with free internet radio stations available
• Supported audio formats: AAC, MP3, WMA, AMR, AWB, M4A, MP2, RA (RealAudio), WAV
• Supported video formats: 3GP, AVI, H.263, H.264, MP4, ASF, WMV, MPEG-1, MPEG-4, RV 7/8/9 (RealVideo)
• Supported playlist formats: M3U, PLS, ASX, WAX, WVX, WPL
• Desktop applet for internet radio
• Storage support for memory cards up to 8GB
• Additional specifications
  

Resources:

Nokia nSeries n800

Detailed Review of n800 running OS2008
(Tips, tricks, hacks, and news about Nokia Internet Tablets and related technology.)

Maemo Downloads for the n800

Internet Tablet Talk

Internet Tablet Wiki

The m-Learning potential of the n800

Linux on Board: Developing for the Nokia n800
Debian/Linux