MUSTUTOR

Esprit Project 24909

Interactive Music Tuition

Keywords: Interactive structured music lessons, Music recognition, Voice recognition, Graphical representation of Notated music through interpretation of the MIDI/NIFF Standard, Optical Image recognition of printed music, Audio/Video, Multimedia

User: Music teachers, Musicians, Composers, Individual music learners, artists

Sector: Music education, Home studies

Objectives

The few Multimedia music tutors currently on the market lack the "interactive" element in their products. Due to their limitations in providing audio recognition know how, they are geared towards theory or providing a course of instruction through video without consideration to the actual progress of the student. The exceptions are products aimed solely at the keyboard/piano learning market where due to the architecture of the instrument the software is able to receive MIDI (Musical Instrument Digital interface) information through mechanical means to determine what the student has played.

The proposed project would result in a greatly improved environment for music tuition through audio recognition of non MIDI instruments such as flute, violin, saxophone including voice.....and incorporate video of real teachers demonstrating exercises. Through analysing the students performance and with the benefits of manipulating audio and MIDI in a multimedia environment the teaching system would be capable of intelligent feedback leading the student through various levels of instruction determined by the progress achieved.

The objectives of the start-up phase of Mustutor will be to demonstrate key technologies successfully interacting in a multimedia environment within the context of a interactive Structured Music Lesson.

These key technologies are:

  1. Music Recognition
  2. Voice Recognition
  3. Graphical Representation of Notated music through interpretation of the MIDI/NIFF Standard
  4. Optical Image Recognition of Printed Music
  5. Audio/Video

As a measure of the successful integration and interaction of these technologies the consortium will demonstrate the course structure of a single lesson for a beginner learning to play.

The work planned to achieve the objectives of the project is divided into eight (8) workpackages which are given below along with their description:

Contact Point

Prof. G. Carayannis
Institute for Language for Speech Processing (ILSP)
Margari 22, Athens 11525, GREECE
Tel: +30 10 6712250, Fax: +30 10 6741262
E-mail: gcara at ilsp.athena-innovation.gr

Participants Country Role

ILSP GR C
AUDIOWORKS UK P
KULEUVEN BE P
IMMISCH * BECKER & PARTNER G P

Start Date 15/10/1997
Duration 12 months