Transforming literature into music thanks to TransProse

TransProse "Translate" literature into music. Those responsible for this software are Hannah davis, programmer, artist and musician from New York, and the scientist Mohammad Saif, from the National Research Council of Canada.

TransProse, determine the density of 8 different emotions and also from 2 different states, positive or negative, throughout a novel based on the emotional words: joy, sadness, anger, disgust, anticipation, surprise, confidence and fear. Depending on the chronology of the story, the musical measures that help build the melody are also created. For now, TransProse has been tested with classics like "The Orange Mechanic," by Anthony Burgess, or "The Heart of Darkness," by Joseph Conrad.

the process is the following. First, it analyzes the text and creates an emotional profile, as well as a statistical compilation on the presence of words that show emotions in it. Second, based on this profile, values ​​of tempo, scales, octaves and note sequences are generated. Finally, it uses Jfugue, an open source Java API for music programming to generate the corresponding audio file.

Several sound examples have been published. For example, the one that would correspond to the work Peter Pan:

Alice in Wonderland:

Kill a Mockingbird:

TransProse has been presented at the European Chapter of the Association for Computational Linguistics (EACL) in Gothenburg (Sweden).

Official Site | TransProse

Video: Art with MI Demo. How to generate music from literature with Hannah Davis (February 2020).