Dec 20, 2009

For Techies & Tech Curious: Python and PyMT developments - PyMT and speech recognition

PyMT is short for Python Multi-Touch, a project that is the work of several members of the NUI Group.  Sharath Patali experimented with speech input for PyMT and used the pocketsphinx library from CMU to integrate into PyMT. It worked out well, as you can see from his video demo below:

PyMT Speech Recognition from Sharath Patali on Vimeo.

Other people involved with the PyMT project are Nathanael Lecaude, Matthew Virbel, Thomas Hansen, and Xelapond.

Sharath Patali's Blog/Website Roll (Links to some NUI-group members)

Matthieu Virbel on Vimeo
NUI Group on Vimeo

Python and Game Programming Resources
Adaptation and Evaluation of Numpty Physics for Multi-touch Multiplayer Interaction (pdf)
(A python-based module called "numptyphysics" was created to integrate Python multi-touch cold to allow the C++ code to parse data, converting it to C structs passed to the game code using pointers.)
Python Programming Language Official Website
PythonL Game Programming Wiki, by Geoff Howland and Rene Dudfield
Lectures 1-6
Beginning Game Development with Python and Pygame -Book (Will McGugan)
Game Programming with Python - Book (Sean Riley)

The reason I'm putting together resources about Python, multi-touch, and games is that I hope to facilitate an exchange between two of the schools I serve as a school psychologist.

Both of the schools are on the same campus. One is a high school for technology and the arts, and one is a program for teens and young adults who have severe disabilities, including autism.  Next semester, one of the computer teachers will be teaching a game programming class using Python for a class of graduating seniors, and if all goes well, perhaps some of the students will create a game for the students with disabilities that would work well on a SMARTboard.

Even better:  It would be great if the pre-engineering students could build a multi-touch table or two for the students with disabilities, running games in PyMT that the computer students create!

No comments: