Showing posts with label touch screen. Show all posts
Showing posts with label touch screen. Show all posts

Nov 18, 2015

Highlights from UIST 2015 - Animatronics + Digital Storytelling and More!

I recently attended the 28th ACM User Interface Software and Technology Symposium (UIST2015), held in Charlotte, N.C.   Although the focus of the conference was not on educational interfaces, a good number of the presentations and demos were related to education in some way.


I've been looking at ways newer technologies can take a bigger role in education, something that is important, given the spread of STEAM (Science, Technology, Engineering, Arts and Mathematics) in K-12 settings.  The STEM/STEAM approach requires students to work collaboratively through project-based learning activities designed to support a variety of skills that they will need as university students-- and beyond.

The focus of this year's UIST Student Innovation Contest  session was storytelling and animatronics!

According to info from the UIST website: "Schools and museums are starting to offer experimental Animatronics classes where kids build furry robotic animals and use them to tell amazing stories. These courses blur traditional lines - between art and engineering, between the virtual and physical worlds - all while demonstrating the universality of creativity across disciplines. Everybody learns how to write stories, build mechanisms, program motions, provide voice performances, etc. In this way, kids see how it all works together, and it has a way of inspiring kids to see new career possibilities."

I was delighted to see so many kid-friendly interfaces.  The first one that caught my eye was "ZOOO".

The ZOOO platform supports digital storytelling through the creation and use of electronic stage, computer-assisted animated puppets, and an a easy-to-use visual software programming environment.  ZOOO would appeal to teachers who are implementing project-based STEAM activities with their students.

ZOOO poster, UIST 2015

















ZOOO programming interface

















I liked the visual design of the programming interface, which can be accessed through a touch-screen.  ZOOO was created by a team of students at the IInterdisciplinary Program of Information Art & Design, Academy of Arts & Design,Tsinghua University, China.

Another demo that caught my eye was Show-Flow. Show-Flow is a software tool designed to create a non-linear animatronic puppet show.  In the following video, the story is entitled "Zee's Mystery": 


The Show-Flow software was created by Nuirit Kirshenbaum, and is available for download on github.

So where is all of this headed?

In today's K-12 classrooms following the Common Core Standards, STEM/STEAM subjects are often integrated into the English/Language Arts curriculum.  Reading instruction is very important, but new ways of teaching and learning are taking hold, such as project-based learning.   Projects are interdisciplinary in nature and require careful planning on the part of teachers---and also require plenty of space for students to communicate, collaborate, brainstorm, design, and share ideas.   

In some schools, teachers are finding that laptops, productivity software, and multimedia resources on the web are good for supporting project based learning activities, but there are limitations. Teachers can't always see what is going on with the students, and laptop screens don't allow for more than two children, at best, to easily see content and collaborate. 

What is exciting is that many schools are thinking beyond 2015.  Tired of the cost of replacing projector bulbs and "touchy" interactive whiteboards, some schools are embracing solutions that are likely to support authentic collaboration -- for example, the picture below shows young children on a Clear Touch display running NUITEQ's Snowflake MultiTeach software.  


Picture of children interacting on a Clear Touch multi-touch table and NUITEQ Snowflake MultiTeach Software.



















In a classroom setting, NUITEQ's Snowflake MultiTeach software can support students working individually or in collaborative groups.  Teachers can create a variety of game-like lessons using the versatile Lessons App.    With the multi-touch, multi-user  Clear Touch display, teachers can orient the screen to meet the needs of the students - upright in an interactive presentation mode, at an angle for design and brainstorming activities, or horizontally, in a table mode.  

All of this is great for supporting science lab activities-- and also student collaboration and planning for STEAM projects. 

I'll be posting more about UIST 2015 highlights soon!

REFERENCES/RESOURCES

UIST 2015
Conference Website

ZOOO
毛成鹏 Chengpeng Mao
清华大学美术学院 信息艺术设计系
Interdisciplinary Program of Information Art & Design, Academy of Arts & Design,Tsinghua University
Mobile  (+86)155-011-21372
Beijing• China  100084
Email  adrainmao@gmail.com

SHOW-FLOW
Nuirit Kirshenbaum

NUITEQ 
MultiTeach Pinterest
MultiTeach Lessons Community

CLEAR TOUCH
Clear Touch Interactive Experience




Disclosure: I am a K-12 Technology Specialist with NUITEQ.

Mar 15, 2014

Graphene, Nanotechnology, and Programmable Interfaces; Samsung Galaxy Demo


I've been intrigued by graphene's multiple possibilities for the future. It is a flexible, programmable material that harness nano-technology to create flexible touch screens, "wearables", efficient energy storage systems, and more.  The following videos provide just two examples of graphene's potential.  

The details?  If you are curious, follow the links at the end of this post.  




Here is a short clip of a demo of a graphene touch screen on a Samsung Galaxy:


RELATED
Graphene nanoribbons could be the savior of Moore's Law
Ryan Whitwam, Extreme Tech, 2/17/14
High-Performance Multifunctional Graphene Yarns: Toward Wearable All-Carbon Engery Storage Textiles
ACS NANO, 2/11/14
Hydrogenation-Assisted Graphene Origami and Its Application in Programmable Molecular Mass Uptake, Storage, and Release
Shuze Zhu and Teng Li, University of Maryland, ACS Nano, 2/24/14
Teng Li Group, Harvard University
Chemically and structurally functionalized graphene for real-world applications
Marko Spasenovic, Graphenea, 3/06/14
Nanoscale graphene origami cages set world record for densest hydrogen storage
Kurzweil Newsletter, 3/14/14
Auto-switchable graphene bio-interface with a 'zipper' nanoarchitecture
Onur Parlak, Anthony P.F. Turner, Ashutosh Tiwari, Nano Werk 10/31/13
Samsung files patent for graphene-based touch screen
Marko Spasenovic, Graphene Tracker, 3/7/14
Graphene: Wikipedia
Grahpene:  Flexible touch screen, made from a sheet of carbon the thickness of one atom!   
Lynn Marentette, Interactive Multimedia Technology blog, 6/23/10


Jan 17, 2013

Telemedicine in Schools: Promoting Health (and Mental Health)

Telemedicine might be coming to a school near you in the future!

The use of a Telemedicine cart, made by Rubbermaid, will be piloted in one of the Union County Public Schools soon. In the article below,  the school district's superintendent was quoted as saying that she hopes the technology can also be used to tackle the problem of mental health:

Presbyterian, UCPS partner to put Telemedicine in schools
Carolyn Steeves, The Enquirer Journal, 1/9/13 


According to information from the Rubbermaid Healthcare Telemedicine website, the cart supports high definition video teleconferencing, a plug and play I/O panel, platform computing, and is white board capable. The touchscreen has annotation capabilities.  

For more information, view the following video and also see the Rubbermaid Telemedicine Resources site.



Here's the promotional information from the Rubbermaid website:

HD Video, Touch-Screen Apps, & Shared Content 

"The Rubbermaid Telemedicine Cart combines full computing capabilities with HD video conferencing into one, easy-to-use, mobile point-of-care clinical platform. Its clean, slim line design and small footprint provide access into the smallest and busiest clinical settings. Its multi-touch interface, simple integration, and superior maneuverability streamlines work flow and creates high adoption rates by staff members."

 "Each Telemedicine Cart comes equipped with a 720p HD video camera, upgradable to 1080p HD video. It also provides computing access to any software or web-based application, including electronic medical records and PACS imaging systems. It can be outfitted with any number of optional medical devices (both analog and digital) that can be shared through the computer or video conferencing equipment or both. The Telemedicine Cart supports digital input through DVI and HDMI as well as legacy inputs such as VGA, S-Video, and composite video. In addition, it is a fully portable platform that runs for two hours via built-in battery power and can be quickly and easily wheeled from room to room, requiring only a standard, high speed internet connection (wired or wireless) to initiate an HD video conference."

Below is a screen shot of telemedicine images from a Google search:



RELATED
Rubbermaid Healthcare Telemedicine Resources (Videos, Whitepapers, News)
Rubbermaid Healthcare Telemedicine
FCC Gives Telehealth $400M Boost
Mary Mosquera, Healthcare IT News, 1/10/13


Nov 6, 2012

Revisiting the Multi-touch Parody of CNN's Magic Map, by Fred Armisen on Saturday Night Live Weekend Update


Photo via engadget

About four years ago I almost rolled out on the floor laughing at Fred Armisen's parody of CNN's Magic Map Wall during the Weekend Update segment of Saturday Night Live.  When I came across the video clip, I couldn't resist sharing it on my blog, and thought I'd share the video clip once again in honor of Election Day:



Video clip via Hulu


My 10/25/08 post,  Multi-touch Parody of CNN's Magic Map Wall by Fred Armisen on SNL's MegaPixel Giant Touch-map, was written when large touch-screen displays were beginning to gain steam in a variety of markets.  At the time, not all of the kinks had been worked out, and there were few people around who knew much about developing programs for use on these displays.  Since then, there have been many improvements in both hardware and software.   

Jeff Han, of Perceptive Pixel, provided the multi-touch screen system for CNN and the SNL parody.  He recently sold Perceptive Pixel to Microsoft and now works as a general manager for Microsoft Office. He's spreading the word about Microsoft's venture into large multi-touch displays- (55 and 82 inches), powered by Windows 8.  

For more information about Jeff Han and Microsoft Office, take a look at my blog post featuring  a recent video of Jeff Han's presentation about Windows 8 for large displays, Microsoft's new multi-touch, pen, and ink technology. The video also includes a presentation about experience design considerations for large displays, by Nathan Fish.




Nov 3, 2012

iPad3 and iPad Mini: Hands-on Side-by Side Comparison Video, by Eric Sailers (quick post)

Here is a good side-by-side "hands-on" comparison of the new iPad3 and the new iPad Mini by Eric Sailers:



Eric Sailers is a speech and language pathologist who has co-created apps for iOS devices since 2009. His website has a wealth of information iOS devices and apps for education, especially for children with special needs.  

Oct 13, 2012

Lenovo's Touchy-Twisty Tablet-Laptops (Video)

I plan to get my hands on the IdeaPad Yoga and ThinkPad Twist someday soon. I'm curious to see how Windows 8 plays out the new touch-tablets.

In the following video, David Schmook, of Lenovo, demonstrates the new IdeaPad Yoga and Twist, running Windows 8.  


IdeaPad Yoga and ThinkPad Twist: Windows 8 Computers Bend and Twist
Joanna Stern, ABC News, 10/09/12


FYI: Lenovo will be manufacturing the "Think" family of computer products in my home state, North Carolina starting January, 2013. 

PHOTO: Lenovo's Windows 8 IdeaPad Yoga, ThinkPad Twist and Lynx convertibles have touchscreens and keyboards.
Photo Credit: Lenovo

Sep 20, 2012

Thinking about a Kurio 7 Tablet for your kid? Here is a start!

I haven't had a chance to play with the Kurio, a 7 inch Android tablet designed for children and their families, so I haven't formulated an opinion about the device, or the applications that it runs.  I thought I'd share the promotional video and related information/links:


Kurio Tablet from CIDE on Vimeo.

Parents can view a number of "how-to" videos to get the tablet up and running. Developers can apply to be part of the Kurio store. From what I can see, the Kurio is in need of some creative, child-friendly apps.

Below is a hands-on demo:




RELATED
Kurio at Toys'R'Us
Toon Goggles Partners with Techno Source on New Kurio7 Android Tablet for Families
PR Web 7/9/12
Kurio's Features

Toys 'R' Us has its own tablet, the Tabeo:

Feb 4, 2012

Interactive Technology: Take a look at Corning's "Day Made of Glass 2: Unpacked" Video !

The videos below tell it all:

"Watch and share "A Day Made of Glass 2: Unpacked," to see how Corning's highly engineered glass, with companion technologies, will help shape our world. Take a journey with our narrator for details on these technologies, answers to your questions, and to learn about what's possible -- and what's not -- in the near future." -Corning Incorporated





Here is the first "Day Made of Glass":



RELATED
A Day Made of Glass 2: Same Day. Expanding Corning Vision






















Nov 5, 2011

GOOGLE CHROME WEB STORE: All sorts of apps, educational and more!

 I'll have to admit, I no longer consider myself an early adopter.  I put off exploring the Google Chrome Web Store until.... today.  Most of my recent explorations have centered on discovering great apps for my iDevices, but since I'm a cross-platform, cross-device, transmedia type of person, I could not neglect the world of interactive web apps!


Here is a screen shot of the educational web apps from the Google Chrome Web Store:


























After you select a few web apps, you can access them from your Chrome browser by selecting a new tab or new window.  The screen shot below shows the apps I've currently chosen to explore:

I have an HP TouchSmart, and I found that many of the web app worked out OK with touch interaction, even 3D  "rotate and pan".  My hunch is that many of the web apps will work fine on an interactive whiteboard. 


I took a quick look at the MeeGenius! Children's Books interactive web app and was pleasantly surprised.  This web app is a talking book that highlights each word as it is spoken. A human voice is used for the narration.


I'm looking forward to getting into work early on Monday to see what web apps work well on the SMARTboard!

RELATED and SOMEWHAT RELATED
Free Education Apps from Google's New Chrome Web Store
The Yellin Center for Mind, Brain, and Education, 2/9/11
Below is a list of educational Chrome apps recommended in the above linked post:

  • Planetarium –an interactive star map for kids (or adults!) interested in astronomy
  • Google Books – millions of free e-books in a plethora of subjects
  • 3DTin – A realistic 3D model-maker
  • MathBoard – a math learning tool appropriate for elementary and kindergarten students
  • MeeGenuis! Children’s Books – personalized, “enhanced” web books for younger students
  • LucidChart – a collaborative diagramming tool, not unlike Inspiration or MindManager
  • Picnik Photo Editor – web-based photo manipulation a la Photoshop
  • 20 Things I Learned about Browsers & the Web – a great introduction to how the internet works
  • Springpad – note-taking tool that can incorporate assignments, photos, to-do lists, etc.
  • Bomomo – an innovative illustration and drawing tool
  • variety of flashcard-based apps which can aid memory, vocabulary, math skills and more

Plinks and Tonecraft - two music tools for Chrome
Danny Nicholson, The Whiteboard Blog  10/11/11
Dinahmoe Labs  (creators of Plink and Tonecraft)
The Whiteboard Blog


Aug 19, 2011

MULTITOUCH NEWS: NUITEQ's interactive display at a business park; Innovation Now's multitouch anatomy application

Multitouch Display for Business Science Park Aurorum, by NUITEQ


"NUITEQ developed a customized multi-touch software solution for Corporate Reception / Lounge Areas for Business Science Park Aurorum in Luleå, based on the award-winning Snowflake Suite framework. In addition to the software, NUITEQ delivered and installed a 32 touch points multitouch dreaMTouch LCD from Germany based Elektrosil."-NUITEQ

Harry van der Veen, Multitouch Blog, 8/19/11


Multitouch Anatomy by Innovation Now


"Virtual anatomy surface computer in the shape of autopsy table that show and enable the user to use hand gestures to do the anatomy process virtually." -Innovation Now

Homam Alghorani, CEO, Innovation Now Sdn Bhd

Aug 7, 2011

Usability of Touchable-Moveable Multimedia Content. Part I (carousels and more)

I've been revisiting the topic of interaction design/usability for "touchable/moveable" multimedia content for the past couple of weeks.    I recently got an iPad2, so I'm in the "app" exploration phase -  a new world, since I never had an iPhone, iPod touch, or iPad "1".  


I plan to share  experiences, thoughts, opinions, and suggestions related to this topic during the upcoming months.   I welcome input from IMT readers!


Getting back to my iPad2....In addition to using the device to run apps, like most people, I also use it to visit websites.  Many sites now appear to be optimized for mobile devices, which is great for my Android-based smartphone, but for my iPad, not so much.   I thought by now we'd have more touchy-feely content to play with.


I've noticed that  basic features that work OK with touch interaction, such as the carousel, 
seem to miss the target, as discussed in the following article:



5 Big Usability Designers Make on Carousels
Anthony, UX Movement, 8/2/11


Although the above article was written from a "click" rather than "touch" perspective, many of the comments Anthony brings up ring true for websites and apps that are accessed through tablets and other touch enable screens.



I'm disappointed.  Here are a few of my grumbles:

  • Many designers/developers have been slow to look at the increasing number of people who are accessing websites and applications via touch-enabled screens - of any size.   
  • Many designers/developers have been slow to catch on that a website or app might be viewed/used by more than one person at a time.  Websites for house-hunting, home furnishings, vacation/travel, and education are a few examples that come to mind.
  • Too many "multimedia" apps/websites are flat. Many still have a power-pointy feel.
  • Websites optimized for mobile devices often leave important features out.
  • Designers/developers sometimes don't seem to think about the various scenarios in which their applications/websites might be used - while balancing a baby on one hip, preparing a meal,  working out,  walking the dog, trotting around the mall with a friends/kids/spouse,  eating, waiting at a stop light, etc.

Too many iPad apps are flat and power-pointy. Too many apps don't take full advantage multi-touch features.  Very few apps allow for efficient interaction between two people on the screen.  




SOMEWHAT RELATED
Carousel Design Patterns   I will add more related links in the future - not limited to carousels : )
Carousel Interaction #21 (Mike Highfield's Rapid eLearning Blog
Carousel (Interaction Patterns Wiki)
Carousel (Welie)
Mobile Implementation of a Web 3D Carousel with Touch Input
Bjorkskog, C., Jacucci, G., Lorentin, B., Gamberinit, L.



Photo Credit:  Ohad





May 28, 2011

NEWSEUM, a highly interactive museum in D.C. with an online component -I want to visit!



What is a newseum?

"The Newseum -- a 250,000-square-foot museum of news -- offers visitors an experience that blends five centuries of news history with up-to-the-second technology and hands-on exhibits.  Within its seven levels of galleries and theaters, the Newseum offers a unique environment that takes museum-goers behind the scens to experience how and why news is made."

"The Newseum is one of the most technologically advanced museums in the world. The Newseum ordered 100 miles of fiber-optic cable to link up-to-the-second technologies that include electronic signage and interactive kiosks, two broadcast studios, 15 theaters and a 40-by-22-foot high-resolution media screen."


Below are some examples of what visitors can experience at the Newseum, located in Washington, D.C.:


Bloomberg Internet, TV and Radio Gallery
Bloomberg Internet, TV and Radio Gallery
-Newseum
Time Warner World News Gallery
Time Warner World News Gallery
-Newseum


The New York Times --Ochs-Sulzberger Family Great Hall of News 
Surrounded by the flow of information
The New York Times–Ochs-Sulzberger Family Great Hall of News
-Newseum
"Around, above and below, visitors to the Great Hall of News are surrounded by a continuous flow of news. Instant, breaking, historic news that is uncensored, diverse and free."


NBC News Interactive Newsroom



"In this 7,000-square-foot interactive gallery, visitors can select any of 48 interactive kiosks or experiences where they can immerse themselves in the many roles -photojournalist, editor, reporter, anchor — required to bring the news to the public. The gallery features eight “Be a TV Reporter” stations that allow visitors to choose from a variety of video backdrops, take their place in front of the screen, read their report from a TelePrompter and see themselves in action." -Newseum










NEWSEUM exhibits have an on-line component.  Here are a few:
Newseum Microsite (Great for use on an interactive whiteboard to introduce students to the museum.)

Apr 28, 2011

Touch the Music: Drums, Keyboards, and More on NextWindow Touchscreens Featured in Megan Slankard's Music Video, "Sails"

Megan Slankard and her band performing "Sails", from the album "a little extra sun":

"To put its technology to the artistic test, NextWindow introduced Megan Slankard and her band to the freedom of creating music using touch screens. With 13 touch screens manufactured by NextWindow – seven 46-inch screens and six All-in-One desktop touch computers – Megan and her band set out to create a music video with a touch of technology they’ve never utilized before."-NextWindow


For detailed information about the touch screens and music applications shown in the video below, visit the Music on Touch Screens page of NextWindow's website. The website shows a good "behind the scenes" video of the various band members exploring the touch screens used to create the music in the video.


Applications and Hardware
Controller/Mixing/Sequencing: FL Studio software.
Touch screen technology:  NextWindow 2550 Profile Touch, NextWindow 2700 Touch  Overlay, NextWindow 1900 Desktop

This technology would be awesome in K-12 music classes!

Feb 6, 2011

Another close encounter with in-store digital display marketing at Best Buy, bad internet TV controllers, bowling with the Kinect, and more...

Not long ago I visited a Best Buy. While I was there, I wanted to play around with the Kinect, but the demo system hadn't arrived.  As I wandered around the store, I encountered quite a few digital displays, part of  Best Buy's recent in-store digital media marketing effort.  I later shared my experience in a blog post,  Close Encounter with "Best Buy On": Example of a multi-channel marketing approach using in-store digital media that includes an on-line magazine.  


During today's visit to Best Buy,  I noticed that there were more display centers in various departments in the store, and many of the displays had useful and informative content. The Kinect demo was up and running, too.


Within the store,  I noticed a strong emphasis on HDTVs with internet capabilities. I  was hoping that the new Internet HDTVs would come with user-friendly touch-screen controllers, or at least an app for use on touch-screen smartphones, iPads, or other touch-screen tablets. 

What I found was disappointing.  On display were traditional-looking multi-button remote controllers, controllers that looked like PC keyboards,  and of course, Sony's confusing multi-featured contribution to the Internet TV scene.


None of the controllers seemed to be easy-to-use, or capable of supporting web-navigation and other web interactions on HDTVs from a distance, especially when the goal is to watch movies and video from a recliner in a darkened family room.  


What sort of user-centered design or usability studies were in place during the hatching of Sony's Internet TV controller?!  (For more about bad remote controls, one of my pet peeves,  see  "Oh! No! Sony's "Mother of Remote Controls" for Google TV, 74 Buttons and Counting")


Below is a partially annotated slideshow of pictures I took of some of the displays and other things I encountered at Best Buy.  Enjoy!



Close Encounter with Kinect Bowling
It wasn't easy trying to bowl and take video with a phone at the same time! 
(Please excuse the shaky video effects and the view of my fingers.)

Feb 4, 2011

Immersive Labs' Intelligent Interactive Display/Billboard App Demo

"If a "Minority Report" future was possible, and if it is coming, how do we create a model of it that is not intrusive, that is fun to play with, that is social, that is respectful and not intrusive, that doesn't invade people's privacy?" -Jason Sosa, CEO, Immersive Labs



Future of Advertising Technology (Immersive Labs demo from 2 years ago)

Future of Advertising Technology from Immersive Labs on Vimeo.


RELATED
Immersive Labs is looking for an interactive developer!


Some of my thoughts on this topic:  Interactive Touch-Screen Technology, Participatory Design, and "Getting It" - Revisited

Jan 28, 2011

W3C Touch Events Specification! Editors Draft 1/29/11 (quick link)

Touch Events Specification, W3C

https://dvcs.w3.org/hg/webevents/raw-file/tip/touchevents.html

"The Touch Interface specification defines a set of low-level events that represent one or more points of contact with a touch-sensitive surface, and changes of those points with respect to the surface and any DOM elements displayed upon it (e.g. for touch screens) or associated with it (e.g. for drawing tablets without displays). It also addresses pen-tablet devices, such as drawing tablets, with consideration toward stylus capabilities."



Editors: Doug SchepersW3CSangwhan MoonOpera Software ASAMatt BrubeckMozilla