MIT Project Teaches Music With Responsive Animated Characters Walking Along A Piano

MIT’s Tangible Media Group, led by Professor Hiroshi Ishii, turned a piano into a dreamlike animated experiment.

It offer an alternative approach to learn music correctly according with an interactive score called ‘andante’.

The team believes that the system would help cultivate high levels of musicianship beyond correctness alone for students of all levels.

Drawing from their own personal experiences of learning to play the piano, they identified three skills central to musicianship – listening, embodied understanding and creative imagination.

It uses a reflective keyboard cover with a projection surface for all the animations, to offer a better understanding of music rooted in the body.

During lessons ‘andante’ helps students internalize rhythms before learning specific notes on the piano differentiating when the character walks and runs.