NodeBeat HD 1.5 Upgrade, an iOS Music Sequencer: Fun to Play on my iPad!

NodeBeat HD 1.5 - iOS Music Sequencer from AffinityBlue on Vimeo.

Below is information about NodeBeat 1.5 from the Vimeo website:


"This is a brief video showcasing some of the new features in NodeBeat HD 1.5. The same features will be coming to the iPhone/iPod Touch version of NodeBeat in the coming weeks."


"New Features Include:


- Entirely new user interface design
- Drag and drop new nodes
- Drum Generator Node
- Sine, Triangle, Sawtooth, and Square waveform selection
- Tempo and BPM controls
- Compress recording for faster e-mailing of recordings
- Create ringtones from recordings
- Sleep Timer. Now you can fall asleep to NodeBeat
- Shake to Clear Screen
- 5 Finger multitouch reset all"
----------------------------------------------
"NodeBeat is an experimental node-based audio sequencer and generative music application for the iPhone, iPod Touch and iPad."


(Just 99 cents!)


RELATED
NodeBeat website


NodeBeat iTunes Preview

Play and Experiment with Music on your iPad/Pod/Phone with NodeBeat iOS Music Sequencer by Affinity Blue by Seth Sandler and Justin Windle  (previous post)

NodeBeat: Create and View Musical Soundscapes
iPad Creative, 5/31/11

Seth Sandler     Justin Windle

Baby playing NodeBeat 1.0 -using fingers and toes:

Summer Break: Music Apps, Multimedia, Kinect, My New iPad2, Tech-reading, Google+, Dancing...

I'm on summer break, which for me, means that I spend an increased amount playing/creating music and doing all of the other fun stuff I don't have much time for during the school year. I'm still exploring what I can do with my new iPad2 - there are so many music apps!  My favorite at this moment is Garage Band. It keeps me engaged for hours, and I can take it with me anywhere I go.  I'm also exploring iPad apps for education and students with special needs, since many of the young people I work with have autism spectrum disorders.  They all really love music.


Today, I came across turntable.fm, a "social-djing" website, from a link shared by Dimitri Diakopoulos.  I think it would be fun to play with.

Turntable.FM, The Fastest-Growing Music Service You're Not Using
William Fenton, PC Magazine, 6/23/11
Social DJing with Turntable.FM
Andrew Mager, 5/28/11

I'm still plowing through technology journals and zines from previous months - I had to skip over my stack to read the cover article of the most recent Communications of the ACM:

Algorithmic Composition: Computational Thinking in Music

Michael Edwards, University of Edinburgh, 2011

I LOVE the design of this cover. It would make for a nice interactive interface for an iPad music app. Or a larger touch-screen display. Or even a SMARTBoard! (BTW, My first computer-related course was Computer Music Technology, in 2003. My undergraduate honors research (psychology), years ago, focused on constructive cognition and music recognition/memory. This topic is dear to my heart.)

I've spent some quality time with my first grand-baby this summer.  Although his "screen time" is limited, given his age of 7 1/2 months, he enjoys playing with music on my iPad.  He likes the drums found in the iPad GarageBand application.  Here he is playing with NodeBeat, an app created by Seth Sandler and Justin Windle:

Most of his time is spent off-screen:





Over the last few months, there has been a surge of interactive touch-enabled apps for education, including some for young people with special needs.  This will be the topic of a few of my future posts.

April 25th Release Date: Play and Experiment with Music on your iPad/Phone/Pod with NodeBeat iOS Music Sequencer by Affinity Blue, by Seth Sandler and Justin Windle

If you love music and have an iPad, iPhone, or iPod touch, you'll have fun exploring and experimenting with NodeBeat. As soon as I get my iPad, I plan to get this app! 


"NodeBeat is an experimental node-based audio sequencer and generative music application for the iPhone, iPod Touch and iPad. NodeBeat is designed to let you create a variety of rhythmic sequences and ambient melodies in an intuitive fashion. It is scheduled for release on April 25th." -Affinity Blue


NodeBeat - iOS Music Sequencer from AffinityBlue on Vimeo.

NodeBeat is a collaboration between Seth Sandler and Justin Windle. It was developed using openFrameworks, with PureData for audio synthesis.  According to the NodeBeat website, "Octaves and Notes make up the two types of nodes. Octaves pulse and send messages to Notes within proximity. Each Octave is assigned a random octave and each Note, a random note; therefore, a Note will play in several octaves depending on the Octave it's connected to. Pause nodes to create your own beats or let them roam free to have them generate their own." Features include adjustable node physics, node add/remove, pitch shift, adjustable pulse rate and beat sync, adjustable echo, attack, decay, and release for creative sound sculpting, and for the iPad, audio waveform display and landscape/portrait views.

RELATED
NodeBeat website
Seth Sandler's posts about music
Seth's posts and videos about AudioTouch, and interactive multi-touch interfaces for computer music exploration and collaboration.
Soulwire (Justin Windle's blog)


Cross-posted on The World Is My Interactive Interface and TechPsych blogs.

Why bother switching from GUI to NUI? - Asked and Answered by Josh Blake; My 2-cents; Stevie B’s Microsoft Research Video; Marco Silva’s NUI-HCI Presentation (and links)

In Chapter 1 of Natural User Interfaces in .NET,  Josh Blake asks and answers a question posed by many people who have been under the spell of keyboard input and GUI/ WIMP interaction: 


Why bother switching from GUI to NUI?  The answer?  Read Chapter 1 (pdf) of the book - the chapter is free.


Here are a few of my personal reasons:  
1.  I want to buy the next version of the iPad or something like it.
2.  I want to buy a new large-screen Internet HD TV.

3.  I want to buy a Kinect.

4.  I do NOT want to interact with my new TV with a Sony remote.  Too many tiny buttons!

5. I do NOT want to interact with my new TV with a keyboard,  because it reminds me of...work.

6.  Most importantly: 

I want to design apps for the people I care about, and others with similar needs:

    My mom.  

    My grandson.

Moms and dads with kids in tow.
People with special needs and/or health concerns, and the people who care and guide them.
Knowledge sharers and (life-long) learners....

RELATED

"Smart" Interactive Display Research

How Natural User Interfaces are changing Human Computer Interaction

 

View more presentations from Marco Silva

My YouTube Playlist:

Post-WIMP Explorers' Club Videos

"Natural user interfaces, gesture interaction, multi-touch, natural interaction, post WIMP examples and more... "

Interactive Multimedia Technology Post:
Interactive Touch-Screen Technology, Participatory Design, and "Getting It": Revisited

RELATED - and somewhat related   

Moms with Apps

Design for Care

SparkOn

NUI Group

UX Matters      "Why don't usability problems get fixed"

Encyclopedia:  Human Computer Interaction, Interaction Design, User Experience, Information Architecture, Usability and More (Interaction-Design.org)

Josh Blake's Blog: Deconstructing the NUI    Book: Chapter 1 (pdf)  Free!
Blake.NUI

"Blake.NUI is a collection of helpful controls, utilities, and samples useful for multi-touch and NUI development with WPF, Surface, and Silverlight."

OpenKinect Wiki

OpenKinect Community Founder Joshua Blake Comes Up With His Own Version of Win 7 Multitouch on Kinect   (Madhav K, KinectHacks 1/14/11)

Kinect SDK Could Open New Worlds for Motion-Controlled Interfaces (Mike Martin, TechNews World, 2/22/11)

Seth Sandler

Seth Sandler's Blog

Seth Sandler's  Ultimate List of Interactive Tables

Dan Saffer

Bill Buxton

Johnny Chung Lee's Procrastineering Blog
Adam Greenfield's Speedbird Blog

 (This is not an inclusive list.)


GUI to NUI Post-WIMP Manifesto:  TBA

WONG - Multi-touch Pong Rerun - Link to Updated Game and Code (via Seth Sandler)

In 2007-2008 there were a handful of multi-touch concept demo videos created, accompanied by upbeat music. The song in this video would be great for the Glee iPad/iPhone app!

Wong was created by Seth Sandler, who recently cleaned up the code.  The latest version of Wong, along with the cleaned-up code,  can be found on the TechSparked website: http://techsparked.com/application/wall-pong

YouTube Video of WONG by Falcon4ever:


Here is a plug for Seth Sandler:

More Applications by Seth

Musical Squares

Audioshape Sequencer

Multitouch Gestures

Bloom

Multi

Seth Sandler's "Slider" Dynamic Multi-player Game using Reactivision + Flash

Seth Sandler, known for his MT Mini, an inexpensive DIY interactive multi-touch pad, is looking for input and ideas that will help him improve or enhance Slider, a game he created about two years ago. Take a look at the demo:



"This game uses reactivision software, along with Flash, to detect symbol fiducial block movements. The game is played by moving these symbols on a table. Players can enter and exit the playing field at any time. The game adapts to the number of players. The lower the score the better; the first player with a score of 12 ends the game. Future plans include: Projecting directly on the surface. Implementing multitouch so users can play with their fingers and objects instead of only object symbols."

Music: Waterdrops by Yohan Shin

Bloom - Play Music with Colors: Seth Sandler's relaxing little on-line application!

Bloom: Play music with colors (link to application)

For more information about Seth Sandler's work, visit his AudioTouch website.

Here are a few pictures of his applications:








Seth integrates music into his multi-touch applications, as he has a background in both music and art. He is a member of the NUI-Group.

New multi-touch "Gravitoy" application from NUI; Multi-touch Space Invaders from Barcelona; "Open source" touch-less multi-touch SDK on CodePlex

NUI (Natural User Interface) recently unveiled Gravitoy, a multi-touch physics application that offers two modes of interaction. Below is a picture of children engaged in collaborative play on an interactive table running Gravitoy in the Sandbox mode. The children can draw objects that interact using principles of physics. (Photos are from NUI co-founder Harry van der Veen's blog)



Below are table-shots of the Sandbox mode:



See the triangle?

The second mode of Gravitoy is "Stacks". Two players play a game of stacking objects of various sizes. The difficulty level can be adjusted by changing gravity options.



This would make science lab engaging for students!

In addition, NUI developed a 3d model viewer application, which looks like it would be fun for budding architects and designers.

Visit the NUI website to learn more about the company and NUI's partners.

Take a look at Multi-touch Space Invaders from Multi-touch Barcelona. It looks like a fun game to play during a rainy recess:

Multitouch Space Invaders! from Multitouch Barcelona (NUI-Group members) on Vimeo.

If you are interested in learning more about developing multi-touch applications and systems, visit the NUI Group website for opensource resources, code, and "how-to" support forums.

Video clips and links related to the work of NUI-Group members, such as Christian Moore, Harry van der Veen, and Seth Sandler, can be found on a previous post:
More Multi-touch from Members of NUI Group!




Touchless Multi-touch...
I recently learned of another "open-source" touch-less "multi-touch" resource. The Touchless SDK was developed for a college project by a Columbia University student, Mike Wasserman.
You will need Visual Studio 2008, the code, and a webcam to get started. From what I can tell, the code will work with in the XNA development environment.

The Touchless SDK website has links to a video demonstration, demo code, FAQs, and more. The discussion list has a lot of good information.

Mike Wasserman is now working at Microsoft Labs.

More Multi-Touch from members of the NUI group!

It is always exciting to see what members of the NUI group are doing!

Here is a new video of a multi-touch creation by some of the members of the NUI group. Although this is a proof-of-concept example, it is fun to see how it is played out, using the little iPhone-like touch-pad widgets as a navigation tool for the large screen.


Read the "Multi-touch Goodness" article in Gizmodo of an interview with Christian Moore about this demo and his Lux open-source framework. (Christian is a colleague of Harry van der Veen, both members of the NUI group.)

Here is an excerpt from the interview:
"JD: Why Flash?
CM: Because it's fast to prototype in. However, the software is broken into several segments. One C++ application that tracks hands that talks to Flash... WPF... or another C++ app... and basically everything you can imagine. You can enable multitouch in any environment, like Cocoa."

High-resolution screen shots and additional information can be found on the nuiman website.

For my tech-minded readers:
I'm pretty sure that the C++ application that track hands and fingers in the video demo uses Touchlib, a library for creating multi-touch interaction. Touchlib can work with TUIO, a protocol for tabletop tangible user interfaces. Applications such as Flash and Processing support TUIO. For more information about TUIO, read "TUIO: A Protocol for Table-Top Tangible User Interfaces".
(Information from the NUI group website mentions that OpenCV, or Open Computer Vision Library, found on SourceForge, can support blog detection and tracking.)

The people behind TUIO are from the Reactable project, of the Music Technology Group at Pompeu Fabra University in Barcelona:

Here is my plug for the NUI group, once again!

"The NUI group, or Natural User Interface Group, is an interactive media group researching and creating open source machine sensing techniques to benefit artistic and educational applications.

We offer a collaborative environment for developers that are interested in learning and sharing new HCI (Human Computer Interaction) methods and concepts. This may include topics such as: voice/handwriting/gesture recognition, touch computing, computer vision, and information visualization."


FYI
I came across the Harry van der Veen of the NUI group in early 2007 when I was working on touch-screen projects for my HCI and Ubicomp classes, and I'm inspired by all of the creativity I've seen coming from this group.

If you'd like to see more demos, visit the Natural User Interface website, a commercial out-growth of Harry and his colleague's work, where you can view a reel that includes a few touch-screen games. I love the vision statement on this site:

"Technology should enable us to interact with computers, in the same way we interact with the real world; in a way which is natural to us, namely through gestures, expressions, movements, and manipulations. Our vision is to change the way people interact with computers."

Seth Sandler's "How to Make a Cheap Multitouch Pad" YouTube video is going viral...

Seth Sandler, a member of the NUI group, has worked very hard at putting together low-cost multi-touch screen surfaces. Seth has a background in music, so his projects focus on interactive music applications. Over 315,000 people watched this video within the week that it was uploaded.

Thanks Seth, for sharing this vision with the world!



Seth's AudioTouch Blog: "An Interactive Multi-user, Multi-touch Musical Table and More"

Hint for high school teachers: This sort of thing would be a great project for an after-school technology club!

Look, touch, listen, and play: Seth Sandler's Interactive Audio Touch Table Video; NUI Group and Google's Summer of Code

Seth Sandler's most recent video of the Audio Touch interactive table provides a good demonstration of how multi-touch on a table can work with music.



Seth is a member of the NUI group (Natural User Interface). He is finishing a Bachelors degree in Interdisciplinary Computing and the Arts, with an emphasis on Music, at the University of California, San Diego. His research and development work centers around multi-touch, multi-user musical interfaces.

Here is an update about the NUI group:

"Natural User Interface or ~ NUI Group is an interactive media group researching and creating open source machine sensing techniques to benefit artistic and educational applications."

"We offer a collaborative environment for developers that are interested in learning and sharing new HCI (Human Computer Interaction) methods and concepts. This may include topics such as: voice/handwriting/gesture recognition, touch computing, computer vision, and information visualization."

The NUI group has been selected for mentoring organization for Google's Summer of Code, for those of you who are interested in working on open-source code for multi-touch systems. The student application process begins Monday, March 24th, 2008, and ends Monday, March 31st, 2008.

NUI group's project ideas page outlines the requirements for the application, which includes a 7500 word project proposal. The project page has a long list of ideas to spark some thinking for potential Summer of Code applicants.

For those of you who aren't into coding, I encourage you to take a look at the NUI Groups project ideas page just to get an idea of th interesting ideas that are being explored. The page has a list of links to other good resources.

Share the word with anyone who might be interested in the NUI Group's projects for the Summer of Code. We need to get more people interested in STEM careers, and the project ideas outlined by the NUI group look enticing.

Seth Sandler's AudioTouch Multi-user Musical Table

Seth Sandler is an undergraduate student finishing a Bachelors degree in Interdisciplinary Computing and the Arts with an emphasis in Music at the University of Southern California, San Diego.

Seth has been focusing his energies on research and developing a Multi-user, Multi-touch musical interface.

Here is a video of some musical multi-touch applications:

I'm pretty sure this will have a place in the music education world.

Seth is a member of the , (Natural User Interface), an interactive media group researching and creating open source machine sensing techniques to benefit artistic and educational applications.