Nov 6, 2012

Jeff Han Discusses Windows 8 for Large Displays, Microsoft's New Multi-touch, Ink & Pen Tech; Experience Design for Large Displays (2012 Microsoft Build)

Earlier this year, Microsoft bought Jeff Han's company, founder of Perceptive Pixel.  Jeff Hans now works for the Microsoft Office division of the company, where there is a push to bring new and improved large multi-touch displays to the corporate world. With this off-the-desktop move, developers are challenged to develop applications for Windows 8 that will be geared towards supporting collaboration in corporate settings.

Jeff Han and Nathan Fish were at Microsoft's "Build" conference recently  to give a presentation about the nuts and bolts of the new technology - how it works, and suggestions for design.  Although the video presentation is over an hour long, it is worth setting aside some time to watch! 

New multi-touch, ink, and pen technologies that can revolutionize your apps on any size of screens (10/30/12, Microsoft Build)



Here is the description of the presentation:
"Develop solutions that flow with your customers business - starting with individuals and information workers on their phones, desks or virtual offices, moving into conference rooms, brainstorm areas, boardrooms and common areas.  Learn how Microsoft's new pen and touch capabilities, software and hardware will enable you to develop products that will help businesses be more efficient.  Have a sneak peek on what our large multi-touch displays (82' and 55') can bring to your solutions." -Microsoft Build

Jeff Han emphasized that touch interaction is everywhere and is a fundamental requirement in applications. Windows 8 apps should be designed for all screen sizes, saying "It's all about collaboration of people and a collaboration of devices that gets your work done....this is the real thing, and it is about to happen.  Devices (referring to large displays) are coming... we do have a mechanism for early access hardware."

During the second half of the video (38:00), Nathan Fish discusses guidelines for designing experiences on large displays, including optimization, handling various interactions via pen, touch, and gestures, the use of application bars and context menus, and more.

At the beginning of his presentation, Nathan Fish briefly discusses the uncharted territory of designing for collaborative large displays, and tells the audience that the guidelines are just suggestions, " nothing is written, we are figuring this out as we go."

My fear is that Windows 8 developers might not have the inclination to think past the smaller screens of smartphones and tablets, resulting in touchy-feely variations of PowerPoint and other Office applications that have been around for too long.

RELATED
Microsoft Welcomes Perceptive Pixel to the Office Division
The Official Microsoft Blog, 7/30/12


What happened to the Surface Table?
I was surprised that Jeff Han's company was not folded into PixelSense, formally known as Surface, the division of Microsoft that focuses on large multi-touch tables. In my opinion, the tables had some potential to support collaborative work in the corporate world.  It will be interesting to see how things unfold!  

PixelSense
Take a look at the video clip below for more information:
 

Discover the Samsung SUR40 (with PixelSense)
Samsung SUR40 with Microsoft PixelSense
PixelSense Development Partners
Insights on Interactive Tabletops: A Survey of Researchers and Developers (pdf)
Hrvoje Benko, Meredith Ringel Morris, A.J. Bernheim Brush, and Andrew D. Wilson 2009, Microsoft Research

SOMEWHAT RELATED
I've been interested in large screen displays and how they interact with smaller devices for a very long time.  In 2007, I was taking graduate courses at UNC-Charlotte and planned to pursue further research and work related to this area.   At the time, I prepared a paper to present at a conference, but was unable to present due a serious health emergency in my family.  The abstract is below:


"Large screen displays support the collaboration of two or more people, especially 
when the nature of the content is visual.  These displays, in the form of walls, windows, 
boards, and touch-tables, will become ubiquitous in the future, and can be found in workplaces, educational institutions, museums, and other public spaces. New display systems have been developed that allow for co-located communication between groups of people, and also allow for collaboration with individuals in remote locations, using mobile computing or communication devices.  This paper will provide an overview of the technologies that support  this new way of communication, discuss the challenges involved in 
establishing "interoperability" within these new systems, and examine the possibilities for 
the future."

If this topic interests you, take a look at one of my Flickr collections:

Ubiquitous Sightings of Urban Screens: Interactive Displays in Public Spaces, Digital Signage, and Screens of All Sizes

Description:

"All kinds of displays are cropping up in shopping centers, malls, banks, stores, airports, schools, businesses, and meeting places. What is the purpose of all of these displays?

Displays and mobile devices, everywhere we go.

It doesn't look like we've really figured out how to harness the potential of the technology that surrounds us."





Nov 4, 2012

Interactive Display at the Local Hyundai Dealership

I was at the auto dealership to get my car's oil changed a few weeks ago and noticed a large interactive display that featured an in-depth explanation of Hyundai's BlueLink technology. The display also provided touch-screen interaction to explore information and view videos about the features of new cars.  

My toddler grandson loves cars, so when he came to visit, I brought him along. Since it is difficult to interact with a touch screen display and at the same time discreetly video the experience with a toddler in tow, I wasn't able spend much time exploring the display's features. The following video is what I managed to capture.


I am still hunting down information about the story behind the display.   

RELATED
HYUNDAI's Interactive BlueLink website

Overview of BlueLink 


The Tube (2008)
This project was installed in 180 Hyundai dealerships in the U.S.  It was created with a Papervision3D menu to display media types such as video, audio, animation, and zoomable bitmaps. The application was designed to run within a local network. I'm not sure if the display I saw at my local dealership was an updated version of this project or something new.

The web-version of the application that was in "The Tube" project does not have all of the features that can be accessed in the local version. The photos were taken from Mike Connor's website:  rocketnumber9.org/flash-developer/touchscreen-kiosk-hyunda/
Touchscreen Kiosk - Car Dealership 5


Touchscreen Kiosk - Car Dealership 6

From the Digitally Yours blog:

Audi City: Car Showroom of the Future
Digital at New York Auto Show '12

Note: 
The Digitally Yours blog covers lots of topics related to interactive technologies. For your convenience, here are some category links: 
Augmented Reality & QR CodesInteractive WebsitesInstallationsShopper MarketingInfographicsLocation BasedApps and MobileProduct Launches.

CFP for Special Issue of Personal and Ubiquitous Computing on Educational Interfaces, Software, and Technology (EIST) -Extended Deadline: December 9, 2012

CFP for Special Issue of Personal and Ubiquitous Computing on Educational Interfaces, Software, and Technology (EIST) -Extended Deadline: December 9, 2012

Overview 
One of the primary goals of teaching is to prepare learners for life in the real world. In this ever-changing world of technologies such as mobile interaction, cloud computing, natural user interfaces, and gestural interfaces like the Nintendo Wii and Microsoft Kinect, people have a greater selection of tools for the task at hand. Given the potential of these new interfaces, software, and technologies as learning tools, as well as the ubiquitous application of interactive technology in formal and informal learning environments, there is a growing need to explore how next-generation technologies will impact education in the future. 

As a community of Human-Computer Interaction (HCI) and educational researchers, we need to theorize and discuss how new technologies should be integrated into the classrooms and homes of the future. In the last three years, three CHI workshops have provided a forum to discuss key issues of this sort, particularly in the context of next-generation education. The aim of this special issue of Personal and Ubiquitous Computing is to summarize the potential design challenges and perspectives on how the community should handle next-generation technologies in the education domain for both teachers and students. 


We invite authors to present position papers about potential design challenges and perspectives on how the community should handle the next generation of HCI in education. Topics of interest include but are not limited to: 

  • Gestural input, multitouch, large displays 
  • Mobile devices, response systems (clickers) 
  • Tangible, VR, AR & MR, multimodal interfaces 
  • Console gaming, 3D input devices 
  • Co-located interaction, presentations 
  • Educational pedagogy, learner-centric, child computer interaction 
  • Empirical methods, case studies 
  • Multi-display interaction 
  • Wearable educational media 
Important Dates 

  • Full papers due: December 9, 2012 
  • Initial reviews to authors: January 18, 2013 
  • Revised papers due: March 15, 2013 
  • Final reviews to authors: April 26, 2013 
  • Final papers due: June 14, 2013 


Submission Guidelines 

Submissions should be prepared according to the Word template located at the bottom of this page. All manuscripts are subject to peer review. Manuscripts must be submitted as a PDF to the easychair submission system. Submissions should be no more than 8000 words in length. 

Guest Editors and Contact Information 

  • Syed Ishtiaque Ahmed, Cornell University 
  • Quincy Brown, Bowie State University 
  • Jochen Huber, Technische Universität Darmstadt 
  • Si Jung “Jun” Kim, University of Central Florida 
  • Lynn Marentette, Union County Public Schools, Wolfe School 
  • Max Mühlhäuser, Technische Universität Darmstadt 
  • Alexander Thayer, University of Washington 
  • Edward Tse, SMART Technologies 

Contact: eistjournal2012@easychair.org 

Information about the Journal of Personal and Ubiquitous Computing 


Submission Template: PUC_EIST_article_template.docx  (59k)

Stantum Update: Innovative Tablet and Mobile Tech; Tablets Push Leap Towards Interactive Multimedia "Textbooks"

Step into a school and you might notice that older desktop computers have been replaced by an assortment of portable devices.   In many cases, students still carry around book bags that contain an assortment of textbooks, binders, worksheets, along with something digital.  

So what is that "something digital"?   

In some  cases, it might be a school-issued laptop or net-book.  In other cases, it could be an iPad, an e-reader, or another sort of tablet.  In other cases, it could be whatever the student brings to school, as part of a "BYOD" (Bring Your Own Device) experiment.

No one has yet figured all out, but many people, from a number of disciplines, are trying!

Stantum is an example of a company that has an interest in the use of innovative technology for education.  Stantum develops multi-touch technology for mobile devices, including tablets, and follows trends in education closely. 

I've had the opportunity speak with Guillaume Largillier, Stantum's co-founder and CSO on several occasions, most recently in late October.  I'm happy to say that Stantum looks like it will be making some important inroads in education.  

Why? 

Stantum is aware that as educational institutions, K-12 and above, leave textbooks behind, there will be an enormous need for devices that will seamlessly support teaching and learning, all around the world.  Guillaume spoke of  developments in countries such as South Korea, France, Turkey, Thailand, Columbia, Argentina, and China to adopt digital textbooks. Some of these countries have initiated pilot programs using some sort of tablet or mobile devices, or plan to do so in the very near future.


During our conversation, Guilluame pointed out that Stantum is involved in developing durable components and tablets made from materials that can withstand the knocking about that sometimes happens when handled by young hands.  

Unlike the iPad, the tablets will not need a rugged, more expensive case, so it is likely that the cost to schools will be lower.  Since the tablets are open to most operating systems, they are likely to be easier for school IT administrators to deploy, update, and maintain.


A bit about the technology:    

Stantum's Interpolated Voltage Sensing Matrix (IVSM) technology supports 10 simultaneous touches and can handle touch and stylus input at the same time. It "knows" if it has been touched by a finger and can disregard a palm.  This is a good feature to have if a tablet is used young people.  

Earlier this year, Stantum announced its partnership with NISSHA, a company based in Japan, and unveiled its newest development, Fine Touch Z Technology, powered by IVSM.  It can support Windows and Android operating systems.  It has a fast scanning engine, high-resolution handwriting input, and does not produce ghost or masking effects.  (See video below).

One appealing feature of this technology is that it provides has low power consumption. This is a plus when considering the need students to have a device that has an extended battery life. 


Fine Touch Z from Stantum on Vimeo.


RELATED

A leap towards interactive digital "textbooks":

Although students have been accessing educational content in digital form on computers and through educational television programming for a long time, textbooks and paper-based assignments have been major tools used in school to transmit the curriculum.  

The tools are changing as we move to a digital, multimedia world of communication, collaboration, knowledge sharing, teaching, learning, and creating.  There are many questions to consider.
  • What sort of digital content will replace traditional textbooks?
  • Who will create this content? 
  • Will traditional textbook publishers simply transform textbooks into slightly more interactive versions of the ho-hum content students love to hate?
  • How will digital interaction change the way everyone learns?  How will this be measured?
  • How will teachers and students be provided with opportunities to create new ways of sharing knowledge?
  • How will usability and accessibility concerns be addressed, for students, teachers - and family members, given that digital content will be accessed both in and outside of school?
  • What sort of software systems will need to be developed?
  • What sort of infrastructure will be needed to support this influx of online activity and transfer of large data files -  at schools, in homes, and in communities?
  • How will the technological ecology support learning, given multiple devices, interactive whiteboards and other interactive surfaces? 

With change, there is usually confusion as old ways are set aside and people explore new options.  

Apple is making some inroads with the iPad, providing educators (and students) to create interactive books with the free iBooks Author program. Some schools have 1-1 laptop programs in place, and provide access to educational content through more traditional course management systems or web-based activities that accompany existing textbooks.  Schools are signing up for resources such as Google in Education and Microsoft Partners in Learning.  

If you are looking for some resources about the rapid increase in interest and adoption of interactive digital textbooks, not just in the U.S., but around the world, take a look at my recent blog post,  "Got Interactive (Multimedia) Textbooks Inside Your iPad or Tablet?  Lots of Resources!".  In the post, I provide a wealth of links to information from the LEAD commission, the FCC's Digital Textbook Playbook, and more.  

You might also want to take a look at Audrey Watters' article, The Truth About Tablets: Educators are getting iPads and e-readers into students'hands--but it's not easy, which was published online in the School Library Journal earlier this year.

For a global perspective, read Alex Wukman's article, World Bank Begins Global Digital Textbook Initiative 

It wouldn't hurt to learn more about what the textbook publishers have in mind.  For that reason, I've put together a sample of resources about interactive digital content from major educational media and textbook publishing organizations:

DISCOVERY EDUCATION
Techbooks
In the following video, students and teachers from an elementary school in Winston-Salem give their reviews of the new Discovery Education Science Techbook.  Students can access the Discovery Techbook via the web.  In this video, students interact with the content using traditional desktop computers as well as interactive whiteboards.  Techbooks are designed to work on tablets or laptops, too.  At :39, a first grade teacher explains exactly why she likes the science techbook:


"...everything is right here at your hands, it is interesting to the kids, they love to watch the videos, and you can take it further - beyond than that, and everything is done for you, it is just really helpful. It even has the prep, the content review, and it is all aligned to the curriculum." -Laurie Moran



Discovery Education Science Techbook from Judy Uhrig on Vimeo.

Discovery Education Science Techbook Overview (Video)
Techbook for High School Science
Techbook for K-8 Science

PEARSON
Pearson's new interactive textbook for the iPad
"It is really going to revolutionize how we think about the classroom experience and what happens in the classroom in the way of learning, and what happens outside the classroom." -Joseph Levine, Author, Miller & Levine Biology




INKLING
Major Publisher Investment Advances Inkling as the Future of Digital Textbooks
Audrey Watters, ReadWrite, 3/22/11
"What makes Inkling’s apps unique is the fact that “content isn’t bound by pages or sections or chapters in the same linear fashion. Rather, it’s hierarchical, richly illustrated and augmented. It’s interactive. It’s social,” Watters writes. The digital versions include quizzes, interactive infographics, and a scrolling and searchable interface." -Matt MacInnis, Inkling

McGRAW-HILL RYERSON
McGraw-Hill Ryerson Launches New High School iBooks Textbooks
PRNewswire, 10/25/12

HARCOURT
Harcourt Interactive Textbooks (Produced by Vertex)


SOMEWHAT RELATED
The Truth About Tablets:  Educators are getting iPads and ereaders into students'hands--but it's not easy
Audry Watters, School Library Journal, 2/1/12

Nov 3, 2012

iPad3 and iPad Mini: Hands-on Side-by Side Comparison Video, by Eric Sailers (quick post)

Here is a good side-by-side "hands-on" comparison of the new iPad3 and the new iPad Mini by Eric Sailers:



Eric Sailers is a speech and language pathologist who has co-created apps for iOS devices since 2009. His website has a wealth of information iOS devices and apps for education, especially for children with special needs.  

Oct 31, 2012

Got Interactive (Multimedia) Textbooks Inside Your iPad or Tablet? Lots of Resources!

If you live in the US, and haven't yet heard, the U.S. government is encouraging K-12 schools to adopt interactive digital textbooks within the next five years.  Are we ready?  I don't think so.  There is a battle of the tablets going on as I type this post.  

Traditional, "old-school" textbook publishers appear to be key players in this game, but I am not sure if they have the know-how to create interactive content that is fresh, "touchable", engaging, and meaningful to young people.  A boring textbook, tweaked tweaked for a bit of interactivity and multimedia content will not suffice.

Feel free to take your time and visit the links I've shared so far. I'm still reflecting on what I've learned so far and will share more of my thoughts in future related posts.

Leaders Discuss Transition to Digital Textbooks
The LEAD commission 

Nation's Digital Learning Report Card (Interactive map)
Digital Learning Now!

US FCC: Digital Textbook Playbook (website)

Digital Textbook Playbook (pdf)
The Digital Textbook Collaborative, 2/1/12


Slide PresentationCharting our Transition to "Interactive Digital Textbooks"  (pdf)
FCC LEAD Commission (Leading Education by Advancing Digital)
Video: Remarks by (FCC) Chairman Genachowski and Digital Education Leaders on National Adoption of Digital Textbooks

Key players: 
Dan Caton, McGraw-Hill
Will Ethridge, Pearson
Jose Ferreira, Knewton
Bill Goodwyn, Discovery Education
Joel Klein, News Corp
Matt MacInnis, Inkling
Osman Rashid, Kno
Dan Rosenweig, Chegg 
Linda Zecher, Houghton Mifflin 
Harcourt


Arne Duncan Calls for Textbooks To Become Obsolete in Favor of Digital  
Josh Lederman, Huff Post Education 10/2/12


Kno Interactive Textbooks App Now Available for Google Nexus Tablet and Google Play 
Business Wire, 10/29/12  Kno

Teaching with tablets: Will our children be using electronic textbooks to learn?  
Jamie Carter, 10/19/12

In digital textbook transition, device availability is just the beginning
Ki Mae Heusser, Gigaom, 10/22/12

Amazon challenges Apple in education with Whispercast
Ki Mae Heussner, Gigaom, 10/17/12

To empower students, let's bring interactive learning tools into the classroom  
Troy Williams (President of Macmillan New Ventures) Venture Beat, 10/30/12

Press Release: McGraw-Hill Ryerson Launches New High School iBooks Textbooks Digital Book Wire, 10/25/12

South Korea Classrooms to go fully Digital by 2015
Ben Gruber, Reuters, 10/5/12


South Africa: Launch of OS-Agnostic Digital Textbook Publishing Platform 
All Africa, 10/23/12

Whitepaper: From Paper to Pixel: Digital Textbooks and Florida Schools (pdf) 
Marcia Mardis, Nancy Everhart, Daniella Smith, Janice Newsum, Sheila Baker, Florida State University PALM Center, 2010

Whitepaper:  The Digital World of Young Children: Imact on Emergent Literacy (pdf))  Jay Blanchard, Terry More, Arizona State University, 2010 (Includes demographics about digital media survey data in selected developing and least developed nations.)

Apple Pushes Interactive Textbooks on iPads  
NPR Staff and Wires, 1/19/12
"Forrester Research said e-books accounted for only 2.8 percent of the $8 billion U.S. textbook market in 2010."

Engage: Apples New Tools for Interactive Books on iPad  
Tim Carmody, Wired, 1/19/12

Inkling Reinvents Textbooks as Interactive, Multimedia Learning Tools on the Tablet  David Weir, 7x7 SF, 7/1/11
Inkling

iBooks Author (free app)  -Apple

What's New in iBooks Author 2.0 -Apple

Houghton Mifflin Harcourt Press Release: Student Math Scores Jump 20 Percent with HMH Algebra Curriculum for Apple iPAd; App Transforms Classroom Education1/20/12HMH Fuse Pilot Program (Website)

SOMEWHAT RELATED
Digital Book World (Website)
MediaShift: Your Guide to the Digital Media Revolution (PBS website)
The Transition to Digital Journalism  Paul Grabowicz, Knight Digital Media Center, Berkeley, 10/26/12
How to make BYOD (Bring Your Own Device) work for your schools Laura Dvaney, eSchool News, 10/29/12
BLOG: Mind/Shift: How we will learn (KQED)
iBooks Author