Showing posts with label interaction design. Show all posts
Showing posts with label interaction design. Show all posts

Dec 28, 2013

The Art of Video Games Exhibition - Coming to a Museum Near You!

The Smithsonian American Art Museum has an impressive collection, and video games are some of the most recent additions.  The study and preservation of video games as an artistic medium is now a part of the museum's Film and Media Arts Initiative.  The Art of Video Games exhibition took place at the museum in 2012, and set off for a tour of museums around the U.S.  (See below.)

The following video trailer provides a brief overview of some of the video games included in the exhibition:


A few quotes from the Art of Video Games trailer:

"Games are so much more than just code that runs inside of a computer.  You are looking at the output of passion, of love, of art, and the people who create these games." - Chris Melissinos, Curator, The Art of Video Games

"One of the things that is really fun with games is the whole idea of the playful mind…and how can we make games surprise you." - Nolan Bushnell, Founder of Atari

"You don't need technology to create feelings, and love, and fear, and hate, and passion…you need great storytelling." -Jen MacLean, Video game developer


The trailer and photo below are from "Flower", the first video game included in the museum's collection.  Flower was created by Jenova Chen and Kellee Santiago (ThatGameCompany).  It is a delightful, stress-reducing game - and one of my favorites.




Credit: Sony Entertainment/Smithsonian American Art Museum, Via NPR

(I first learned about Jenova Chen's work when he was a student at UCS's School of Cinema and Television. At the time, he wrote his MFA thesis on the topic of "Flow in Games", building on psychologist Mihaly Csikszentmihali's theory of flow.  Part of his MFA work included the game "Cloud", which was available for free download.  I found the game to be very useful in my worked with teens who were considered "at-risk" or who had special needs.)

MoMA and Video Games
The Smithsonian isn't the only place where video games are curated.  The Museum of Modern Art (MoMA) has invested in a number of video games, supported by Paola Antonelli, the MoMA's senior curator of architecture and design.  

"The real core issue of interaction design is behavior.  Designers that deal with interaction design behaviors that go to influence the rest of our lives. They're not just limited to our interaction with the screen…" -Paola Antonelli

The following TED-Talk video explains the rationale behind MoMA's video game curation efforts.  It is worth taking the time to watch!


National Tour: The Art of Video Games 

Present:
Everson Museum of Art in Syracuse, New York 
(October 25, 2013–January 19, 2014) 

Upcoming:
Hudson River Museum in Yonkers, New York 
(February 15, 2014–May 18, 2014) 
Toledo Museum of Art in Toledo, Ohio 
(June 19, 2014–September 28, 2014) 
Flint Institute of Arts in Flint, Michigan 
(October 25, 2014–January 18, 2015) 
Chrysler Museum of Art in Norfolk, Virginia 
(February 13, 2015–May 10, 2015) 
Memphis Brooks Museum of Art in Memphis, Tennessee 
(June 6, 2015–September 13, 2015) 
The Patricia and Phillip Frost Art Museum at Florida International University in Miami, Florida (October 9, 2015–January 25, 2016) 

Past venues:
Boca Raton Museum of Art in Boca Raton, Florida 
(October 24, 2012–January 13, 2013) 
EMP Museum in Seattle, Washington 
(February 16, 2013–May 13, 2013) 
Phoenix Art Museum in Phoenix, Arizona 
(June 16, 2013—September 29, 2013) 

Here is a description of the original Art of Video Games exhibition:

"The Art of Video Games is one of the first exhibitions to explore the forty-year evolution of video games as an artistic medium, with a focus on striking visual effects and the creative use of new technologies. It features some of the most influential artists and designers during five eras of game technology, from early pioneers to contemporary designers. The exhibition focuses on the interplay of graphics, technology and storytelling through some of the best games for twenty gaming systems ranging from the Atari VCS to the PlayStation 3. Eighty games, selected with the help of the public, demonstrate the evolution of the medium. The games are presented through still images and video footage. In addition, the galleries will include video interviews with twenty developers and artists, large prints of in-game screen shots, and historic game consoles. Chris Melissinos, founder of Past Pixels and collector of video games and gaming systems, is the curator of the exhibition..." -Smithsonian American Art Museum

RELATED
Video Games: Now A Part of American ARt's Collection
Eye Level, Smithsonian American Art Museum, 12/17/13
April Fehling, NPR All Tech Considered, 12/22/13
The Art of Video Games (Exhibit website, Smithsonian American Art Museum)
Book: The Art of Video Games: From Pac-Man to Mass Effect (Chris Melissinos, Patrick O'Rourke
The art of Video Games Book Cover













Film and Media Arts Initiative, Smithsonian American Art Museum
Games to lift stress away:  Flower, flOw, (and Cloud), from thatgamecompany
Lynn Marentette, Interactive Multimedia Technology Blog, 8/15/09
That Game Company  "Our Mission:  Create timeless interactive entertainment that makes positive change to the human psyche world wide."   Hiring!
Video Games: 14 in the Collection, for Starters
Paola Antonelli, Inside/Out, MoMA PS1Blog
Video Games: Seven More Building Blocks in MoMA's Collection
Paul Galloway, Inside/Out PS1Blog, 6/28/13
'All Hell Broke Loose': Why MoMA Is Exhibiting Tetris and Pac-Man




Jul 23, 2013

Monkeying Around with Autism Assessments: Kinect-based game by Vectorform and Kaiser Permanente therapists offers a barrel of possibilities!

"The goal was to build a game that is extremely accessible, non-complex and includes simple mechanics that children with autism can quickly understand to retain their attention, prevent over-stimulation, encourage play, and prevent frustration." -Vectorform "Monkey Business" Team


I recently had the chance to visit the team at Vectorform's Royal Oak (MI) headquarters and experience a demo of one of their newest applications, a Kinect-based game developed to assist in the assessment of children with autism. The game, known as Monkey Business, was designed in collaboration with physical, occupational, and speech therapists from Kaiser Permanente, a large health care service provider in California. The project was supported by Kaiser Permanente's Innovation Fund for Technology group.

I was impressed!

As I watched the demo, it was clear that much time and attention was given to the input of the therapists at Kaiser Permanente. The avatar in the game is a friendly monkey who embodies the mannerisms of a friendly, curious child.  The artwork is visually appealing and not too busy. The sound effects relate to the interaction at hand and provide feedback to the child as they engage in various game-like tasks designed to assess visual-motor, gross motor, and basic receptive language skills.  Another good feature of this application is the simplicity of the screens designed for input of the child's information and viewing data regarding progress.

In my opinion, the Monkey Business assessment game has the potential for use in school settings, and would be enhanced if additional assessment activities are provided in the application.  Expanded activities within the Monkey Business environment could support a range of treatment, education, and related intervention efforts. In addition to supporting assessment and intervention of children with autism, the Monkey Business concept would be especially useful in working with children who have experienced a traumatic brain injury.


Below are screen shots and descriptions of a few activities from the Monkey Business game:

Lily Pad Jumping Test
In the jumping test, the child is asked to jump across a pond, from one lily pad to another.  The child is provided with a set of toy lily pads on the floor.  As the child jumps, the Kinect sensor picks up movement and displays the jumps on the screen in the form of the monkey.























Balance Beam Test
The following screen shot depicts the monkey avatar crossing a stream on a balance beam. The monkey's movements reflect the child's movements across a real balance beam in front of the Kinect sensor and a large screen display.






















Block Building Test
In the block building test, the monkey avatar encourages the child to build a tower of blocks to match the one displayed on the large screen.  The child uses real blocks, placed on a table, to build a tower while the monkey provides encouragements.  Objects other than blocks can be used, as the Kinect sensor is capable of identifying a variety of objects that can be use for building and stacking.






















Clinician Screens
The screens designed for inputting and reviewing data regarding the child are designed with simplicity and ease-of use in mind, as shown in the pictures below:












































In the present version of Monkey Business, a TV remote is used to control the application. It is possible that future versions of Monkey Business could integrated with a Smartwatch to input student information and control the activities in the application.  


Comment: As a school psychologist who works with children, teens, and young adults with autism and other significant disabilities, I know how difficult it can be to conduct assessments using traditional test materials.  If a student has difficulty interacting with unfamiliar adults, has communication challenges, or has motor difficulties, it may not be possible to administer an assessment that generates meaningful or valid results.  Even if the student is capable of completing some of the traditional test tasks, much time and effort is required on the part of the evaluator to sustain their interest, effort, and attention.   

To get a better picture of a student's emerging skills, I use interactive multimedia applications during my assessments of children with autism.  Newer technologies such as interactive whiteboards, larger touch-screen monitors, and tablets have proven to be useful tools in assessment.   A significant drawback to my approach is that it is cobbled together and might be difficult to replicate by other evaluation teams.  I see a growing need for a range of technologically-enhanced tools for assessment, including applications that offer opportunities for playful engagement.  Monkey Business holds potential to fill the bill.

What next?

I'd like to share some stories about the people who make things come to life at Vectorform. During my visit, I learned that they are involved in a number of projects related to health care and are always brainstorming new ways to harness technology for their various clients.  

Over the past several years, I've followed Vectorform's journey as they've jumped off of the desktop and transformed from web-developers to Post-WIMP explorers of natural user interfaces and interaction.  The most recent area of exploration is Google Glass. 

Intrigued by Google Glass?  So am I.  

During my visit to Vectorform, I had a chance to see the world - or rather Vectorform's basement conference room - through Google Glass.  As soon as I put them on I was flooded with ideas, and will expand on my ideas, and those of others, in future posts.

In the meantime, take the time to read an excellent post by Kevin Foreman, Vectorform's Director of Product Vision.  In "The Glass Experience", Kevin provides an in-depth reflection of his experience wearing Google Glass throughout his daily routine.  He also explains the inner workings of the hardware, the strengths and limitations of the Glass system, details about the user interface, the "on-board" accessories, and a few comments about what it is like to be a new Glass-wearing celebrity.


RELATED
Here are just three of the innovators I met during my recent visit to Vectorform, left to right: Jennifer Tonio, Marketing Manager, Kevin Foreman, Director of Product Vision, and Patric Samona, Director of Health Solutions.


















Below are a few links related to the use of games for the assessment and intervention of autism, along with links to information about the use of games and emerging technologies for rehabilitation, health care and health promotion:





Microsoft Kinect and Autism (SlideShare) Susan McCarthy, Little Angel's School 2/09/13


Italian Team Uses the Kinect to Treat Autistic Children Andrea Lorini, Epoch Times, 12/13/12

Microsoft Surface Multi-touch Application for Pediatric Neuropsychology Assessment (Featuring Vectorform) Lynn Marentette, TechPsych Blog, 8/26/09   



Xbox One, Kinect 2.0 and the future of health technology Marcelo Calbucci, Mobihealth News, 5/26/13



Accessible Games for Health and K-12 Education: Lessons from the Classroom (SlideShare) Lynn Marentette, 5/9/08, Games for Health Conference Presentation

Researchers: Microsoft Kinect is a Money-Saving Telemedicine Device Gabriel Perna, Healthcare Informatics, 2/15/13

Lowes, LP., Alfano LN, Yetter BA, Worthen-CHaudhari, L, Hinchman W, Samona P, Flanigan KM, Mendell JR Proof of Concept of the Ability of the Kinect to Quantify Upper Extremity Function in Dystrophinopathy
PLoS Curr. 2013 Mar 14; 5   doi:  10.1371/currents.md.9ab5d872bbb944c6035c9f9bfd314ee2

Jul 9, 2013

The Life and Contributions of Seymour Papert: Inspiring video of a tribute panel, Interaction Design and Children Conference

Seymour Papert Tribute at #IDC13

I recently attended the Interaction Design and Children (IDC 2013) conference in NYC.  It was like a summer tech camp for grown-ups. We were busy all day and had interesting evening events scheduled, like a field trip to the New York Hall of Science and a screening of Flying Paper, an award-winning documentary. 

One of the highlights of IDC 2013 was a panel that gave tribute to the life and contributions of Seymour Papert.  Well ahead of his time, Seymour Papert imagined a world in which children would generate their own computer programs, make awesome robots, collaborate with others, create, and learn. 

I encourage you to take some time and watch the video.


Seymour Papert Tribute Panel from IDC2013 Conference on Vimeo.



The following information is from the description of the video:

"Seymour Papert was one of the key pioneers of interaction design for children, merging the constructivist ideas of Jean Piaget and cutting-edge technological advances in computer programming and cybernetics..generating well-known designs such as the Logo programming language and the Lego Mindstorms robotics kits.  This work, which in the beginning was done in collaboration with many colleagues at the MIT Artificial Intelligence Lab, Bolt, Beranek and Newman, and Atari Research Labs, has been highly influential for decades."

"Paulo Blikstein from Stanford University hosted a panel at the Interaction Design and Children (IDC 2013) conference on the impact of Seymour Papert's research on the past, present, and future of child-computer interaction.  The purpose of this pane is to investigate current trends, designs, and theoretical advances in the IDC community in light of the groundbreaking work of Papert and his close collaborators, recapitulate the history of this early work in IDC, and imagine future scenarios for IDC research."

Panelists:
Allison Druin, University of Maryland
Edith Ackermann, MIT
Mike Eisenberg, University of Colorado
Mitch Resnick, MIT
Uri Wilensky, Northwestern University

More posts to come soon!

RELATED
IDC 2013 Website - an archive of treasures
MIT Media Lab
Human-Computer Interaction Lab: Children as Design Partners






May 5, 2013

Leap Motion Update: Slow-going progress for me, at least for now!

Leap Motion Progress

My Leap Motion dev kit arrived in March. With excitement,   I installed it on my new 27-inch iMac. I decided that this would be the time to take the "leap" into Objective-C and explore the mysteries of Xcode.  I had planned to make a simple  iPad app for my 2-year-old grandson, but this inspired me to change my plans.





















Why not learn Objective-C to make a simple music/art/dance Leap Motion app for little ones?  

My progress so far?  Slow.

I updated Xcode. I installed the Leap Motion SDK.  I updated the Leap Motion SDK.  I played with the samples that came with the Leap Motion kit.   

When it came time for me to try something on my own, I thought I had everything set up in Xcode.  I got error messages that I did not understand. My attempt to figure things out led me to the Stack Overflow website, and by then, I had to get back to my paperwork in order to prepare for the next work day.

Today I realized that I missed the link about installing the Leap API docs for Objective-C in XCode.  Other things needed to be updated, so at that point, I decided to write this post....





















Reflection:
After writing some code and making repeated errors, I realized how much I had let Microsoft take root in my head.  Until 2003, the coding part of my brain was a pristine slate. It wasn't cluttered with bits and pieces previous coding languages.

Since I tend to be a knowledge junkie, my brain soaked up more than I needed when I was taking computer courses.  If you could peek inside,  you'd see C# code snippets for multi-touch and NUI, a few algorithms for A.I. and data visualization, trivia from MSDN,  and images of the Visual Studio workspace. There would be odds and ends from VB.Net, JavaScript, ActionScript, CSS, Java, C++, and pseudocode for a variety of computational thought experiments.    

A lot of stuff, and for most of it, no place to go, except for an occasional technology dream.


What's ahead?
In the short term, I'll be doing what I always do this time of year.  For many school psychologists, the last couple of months of the school year is sort of like tax season for accountants.  I have lots of students to see, lots of psychological evaluation reports to write, and meetings to attend.  The paperwork will crowd up many evenings and weekends, but  there is an end in sight.   

Summer.  This will be my summer of code.

I'll be in NYC for one week in June, attending the Interactive Design for Children conference (IDC 2013).  Many of the workshops I'd like to attend will be held at the same time.  Take a look at the program and you'll see why!  I

Decisions to be made... 
Although I am pretty good at keeping a lid on my desire to design and code during my day-to-day life as a school psychologist,  I'm finding that it is getting more difficult to ignore. I have some thinking to do. In the not too distant future, it is possible that I'll leap out of my K-12 cocoon.  

I don't think I'll leap too far, because I'd like to focus my work on projects that enhance the lives of children and families.  I will ensure sure that some of my work will benefit people of all ages who have disabilities or encounter barriers in their lives.



SOMEWHAT RELATED
Joy of Computing, 1985















My daughter, who was just two years old in the above picture, returned to school to take computer courses after working in the non-profit arts management field.  I'm happy about this, but I know that she'll face many hidden barriers when she starts working in a male-dominated environment. She is not alone.

I'm working on a future post about computer and technology-related careers.  Things have changed rapidly over the past several years and there are many new ways to learn how to code, and over time, more opportunities for creative computational thinkers - male and female, to take the lead.

In Google's Inner Circle, a Falling Number of Women
Claire Cain Miller, NYT, 8/22/13

So You Don't Want to be a Programmer After All
Jeff Attwood, Coding Horror, 4/29/13

StackExchange  (Includes StackOverflow, helpful when I troubleshoot coding problems)

An Overview of HTML 5, PhoneGap, and Mobile Apps: Understanding how web languages are used for apps and how they work with native code
Dan Bricklin