"Kinect-based Telepresence with Room Sized 3D Capture and Life Sized Display", Includes Behind-the Scene "how-to" (UNC Chapel Hill)

Jim Spadaccini, of Open Exhibits, recently told me about a project that involves the real-time, interactive 3-D capture of people in a room.  As the viewer moves around the screens, the depth-detecting feature of the Kinect is harnessed to set the stage for a realistic telepresence experience.  


Take the time to view the video, which contains some interesting views of how the system works:





Thanks, Jim, for the link!

RELATED/SOMEWHAT RELATED
Kinect Real-Time Room Telepresence
Kinecthacks, 1/3/12
From the project's website:

Maimone, A. and H. Fuchs. "A First Look at a Telepresence System with Room-Sized Real-Time 3D Capture and Large Tracked Display." The 21st International Conference on Artificial Reality and Telexistence (ICAT) (Osaka, Japan, November 28-30, 2011) [paper] [video]

Maimone, A. and H. Fuchs. "Encumbrance-free Telepresence System with Real-time 3D Capture and Display using Commodity Depth Cameras." The IEEE International Symposium on Mixed and Augmented Reality (ISMAR) 2011 (Basel, Switzerland, October 26-29, 2011) [paper] [video]

Open Exhibits

Near Field Communication in Education? Arts? Wayfinding?

A few weeks ago I posted about the use of Near Field Communication at the Museum of London, and started to slowly gather information about the potential of this technology for use in educational settings.  Below are a few links, more to follow:


Future Forecasting: Near Field Communication (NFC) in mLearning
Diane Rees, Instructional Design Fusions

Reference for Diane's article:
Miraz, G.M., Ruiz, I.L., & Gómez-Nieto, M.A. (2009). University of Things: Applications of Near Field Communication Technology in University Environments. The Journal of E-working, 3(1), 52-64. Retrieved from http://www.inderscience.com/www/info/ijwi/art/tjew3101.pdf


One of Diane's links:
A Platform for Pervasive Infrastructures (pdf)
Saros, J., Lindstrom, D., & Karin Wollbrand, Ericsson Research


RELATED/SOMEWHAT RELATED
Near Field Communication adds a new Layer to Museums
Kirsten Winkler, Big Think, 8/18/11

Ervasti, M.; Isomursu, M.; Kinnuyla, M. Experiences from NFC Supported School Attendance Supervision for Children Mobile and Ubiquitous Computing, Systems, Services and Technologies 2009.  Ubicomm '0
Internet Librarian 2011:  Next Big Trends: Near Field Communication & Interactive Books
Gretchen Caserotti, Kristen Yarmey, and Sheli McHugh, Librarian in Black, 10/17/11
"Phygital" Wayfinding and Experience Mapping
Mark VanderKlipp, Corbin Design, 9/23/11
Near Field Communication: Changing the Digital Signage Value Proposition
NFC Bootcamp
How to Have Fun with Near Field Communication on Android
Ryan Whitwam, Tested,  4/27/11


NOTE:
More posts are in the works - update from interactive multimedia, games,  and NUI companies, links to great blogs, and more.

iPads for every student in an elementary school in NC, Smartboards in the classrooms, and one awesome principal

 

The effects of technology at this Title I school resulted in increased attendance, fewer discipline problems, and  college aspirations for the students.   I would like to visit this school soon and see how the teachers integrate iPads and Smartboards.


The story about the principal of this school is inspiring.


RELATED
Buckley Report: Immigrant Principal
Montlieu Academy of Technology

Christian Bannister's Interactive Multi-touch and Gesture-based Subcycle Project. Use your hands to shape sound, create, and manipulate music. Wow!!

I came across a link to Christian Bannister's Subcycle Labs website when I was taking a look at the Creative Applications Network website.


If you have an interest in music technology and innovative gesture/multitouch applications, you'll appreciate the details that are shared on the Subcycle website.  In the meantime, take the time to watch a few of Christian's videos.  Enjoy!


Blip Shaper Walkthrough

Blip Shaper Walkthrough from christian bannister on Vimeo.
"a) creating percussive patterns with monome b) shaping the individual sounds that make up the patterns with multitouch gestures c) recording touchscreen gestures as automation d) storing, duplicating and navigation patterns e) recording the resulting audio to a dynamic buffer f) manipulating the buffer with a multitouch cut-up approach g) visualizing everything with dual screens"
Subcycle Walkthrough

Subcycle Blip Shaper from christian bannister on Vimeo.

"a) creating percussive patterns with monome b) shaping the individual sounds that make up the patterns with multitouch gestures c) recording touchscreen gestures as automation d) storing, duplicating and navigation patterns e) recording the resulting audio to a dynamic buffer f) manipulating the buffer with a multitouch cut-up approach g) visualizing everything with dual screens"


The following information describing the Blip Shaper is from Christian's Subcycle website/blog:
"For the drum sounds I have Drumaxx running for synthesized sounds and Battery running for sampled sounds.  These are running in parallel so for each voice there is a separate patch running in each VST.  The Parameters are modified with the touchscreen independently but in all cases a single touch gesture on the X-Axis will cross fade between the sampled version of the sound and the synthesized version of the sound.  I love this because I have never seen this before and I can never decide which technique I like better.  The synthesized drums are more malleable and have more interesting parameters to play with but the sampled sounds seem more substantial.  I will post a detailed list of parameters and gestures in the future."   


Christian currently uses Max for Live (ableton), and codes with Processing/Java, using Eclipse for organization.

Autopilot - Subcycle
autopilot - subcycle labs from christian bannister on Vimeo.
"sound visualization, multi-touch interface, break beat performance engine, autopilot, spacialized sound, dsp, max/MSP, fm synthesis, sonic navigation, sound storm visualization, time machine, granular, interactive sound sculpture, joystick array, more at subcycle.org"

SOMEWHAT RELATED 
Community Core Vision
NUI Group

BTW,I'm wondering if Christian or other NUI group members would like to do something with some of my ideas that incorporate interactive music. To learn more, see my post, "It must be  Voronoi: Looking for ideas for my music+art+dance+tech dream...."
...


....

Kinect in Education! (kinectEDucation)

Although I'm currently exploring the world of interactive HTML5, interactive video, etc., I think I just might make "kinecteducation" the focus of my tech-hobbies. I have some experience with game programming-one of my computer courses required a project using XNA- and I know quite a bit about gesture and multitouch, multi-user interactio, so it would'nt be too much of a stretch.


My motivation?

As a school psychologist, my main assignment is a school/program for students with disabilities, including about 40 or so who have autism spectrum disorders. Yesterday, the principal of the school attended a demonstration of the Kinect and requested that our school be considered for piloting it. One of my other assignments is a magnet high school for technology and the arts, and rumor has it that it will be offering a game programming curriculum.  I'd love to co-sponsor an after-school game club and encourage the students to program educational apps for the Kinect sometime in the near future! 


I'm also working as a client, in collaboration with come of my educator colleagues, with a team of university students who are creating a communication/social skills game suite geared for students with autism and related disabilities....


I'm inspired by the possibilities!


We have large SMARTboards in each classroom and in other locations around the building, and we have a Wii set up in the large therapy room adjacent to my office. The Wii has proven to be very useful in helping the students develop social and leisure skills that they can use in and outside of the school settings, but some of the students have difficulty manipulating the buttons on the controllers.


You can get Kinect-based apps from the Kinect Education website! Below are selected links from the website:

• 9 Excellent Programming Resources for Kinect
• Kinect Lesson Plans
• KinectEDucation Blog
• Teacher's Guide to Kinect and Gesture-Based Learning

You can also get additional information from the Microsoft in Education "Kinect in the Classroom" website.

Below are a few videos to give you an overview of how open-source applications designed for the Kinect can be used in education: 

UPDATE POST: Educational Interfaces, Software, and Technology: 2012 ACM-CHI Workshop Call for Papers/Presentations

There is still time left to submit your paper!

CALL FOR PAPERS

EDUCATIONAL INTERFACES, SOFTWARE, AND TECHNOLOGY 2012

3rd Workshop on UI Technologies and Educational Pedagogy

May 5-6 2012

in conjunction with ACM-CHI 2012, Austin, Texas

This will be our third annual workshop in conjunction with CHI 2012.

One of the primary goals of teaching is to prepare learners for life in the real world. In this ever changing world of technologies such as mobile interaction, cloud computing, natural user interfaces, and gestural interfaces like the Nintendo Wii and Microsoft Kinect, people have a greater selection of tools for the task at hand. Teachers and students can leverage these tools to improve learning outcomes. Educational interfaces and software are needed to ensure that new technologies serve a clear purpose in the classrooms and homes of the future.

Since teachers are always looking for creative ways to engage 21st century learners, there needs to be an academic venue for researchers to discuss novel educational tools and their role in improving learning outcomes. This workshop aims at filling this void: combining the pedagogical expertise of the cooperative learning, and learning sciences communities with the technical creativity of the CHI, UIST and interactive surface communities. The objective of this workshop is to become a conference within two years

We invite authors to present position papers about potential design challenges and perspectives on how the community should handle the next generation of HCI in education. 

Topics of interest include:

• Gestural input, multitouch, large displays
• Mobile Devices, response systems (clickers)
• Tangible, VR, AR & MR, Multimodal interfaces
• Console gaming, 3D input devices
• Co-located interaction, presentations
• Educational Pedagogy, learner-centric, Child Computer Interaction
• Empirical methods, case studies
• Multi-display interaction
• Wearable educational media

Submission:  The deadline for workshop paper submissions is Dec 20, 2011. Interested researchers should submit a 4-page position paper in the ACM CHI adjunct proceedings style to the workshop management system. Acceptance notifications will be sent out February 20, 2012. The workshop will be held May 5-6, 2012 in Austin, Texas. Please note that at least one author of an accepted position paper must register for the workshop and for one or more days of the CHI 2012 conference.

Website: http://smarttech.com/eist2012
Contact: Edward Tse, SMART Technologies, edwardtse@smarttech.com


RELATED
Educational Interfaces, Software, and Technology Workshop Organizers

	Edward Tse, SMART Technologies
	Lynn V. Marentette, Union County Public Schools
	Syed Ishtiaque Ahmed, Cornell University
	Alex Thayer, University of Washington
	Jochen Huber, Technische Universität Darmstadt
	Max Mühlhäuser, Technische Universität Darmstadt
	Si Jung “Jun” Kim, University of Central Florida
	Quincy Brown, Bowie State University