Air Guitar

Real-Time Spatial Music Composition System (RTSMCS) & RTSMCS based “Air Guitar” system.

The projects were supervised by Dr. Dan Feldman from the department of Computer Science and by Dr. Alon Schab from the department of Music, and were developed as part of the Musicological Lab initiative.

The Real-Time Spatial Music Composition System (RTSMCS)

The RTSMCS (Real-Time Spatial Music Composition System) is system for real-time music composing that utilizes hand movement/position data in conjunction with a database of categorized short musical segments and a predefined algorithm that can combine and restructure such segments, to produce novel musical creations.

In short, the system does the following:

• Captures the system operator’s hand positions + orientation in space

• Uses a subset of the position data to control the manner in which a semi-autonomous music composition algorithm, which makes its music up using pre-written short segments of music from a given database, will currently create its music.

• Various musical transformations are applied to the music generated by the composition algorithm, based on the rest of the hand position data.

• The real-time generated music is sent to a MIDI (Musical Instrument Digital Interface) compatible instrument to play it, and is stored in the end of the session to a MIDI file.

Furthermore, the system also provides a reusable framework which can be used to build various real-time music creation and manipulation systems.

The system was developed using the following tools:

• Development language: Python 2.7

• IDE: JetBrains PyCharm

• External python libraries: Mido, Pygame, Optirx, Nibabel

For more information, please see the RTSMCS presentation.

air-guitar-presentation

.pdf

Download PDF • 526KB

The RTSMCS based “Air Guitar” system

The RTSMCS based “Air Guitar” is an interactive musical entertainment system, that gives the user an experience similar to that of playing guitar, but doesn’t require any real guitar playing skills. It does so by taking on loose principles of guitar playing technique and removing the need for string fingering, fine motor skills, and musical knowledge.

For more information, please see the “Air Guitar” presentation.

Videos:

RTSMCS – Simple 2 loops demo:

RTSMCS – System parameters control demo:

RTSMCS Demo 2 – Musical segement DB with 3 categories:

“Air Guitar” system based on the RTSMCS framework – Demo no. 2 :

“Air Guitar” system – preps for University of Haifa “Scientists Night 2016” :