On Making Music with Heartbeats

Research output: Chapter in Book/Report/Conference proceedingChapterpeer-review

3 Citations (Scopus)

Abstract

Representation and analysis of musical structures in heart signals can benefit understanding of cardiac electrophysiology aberrations such as arrhythmias, which can in turn aid in the diagnosis and treatment of cardiac arrhythmias. The typical time-frequency analysis of electrocardiographic recordings of cardiac arrhythmias yield descriptive statistics that provide useful features for classification, but fail to capture the actual rhythms of the physiological phenomena. Here, I propose to use music notation to represent beat-to-beat and morphological feature-to-feature durations of abnormal cardiac rhythms, using articulation markings when emphasis is warranted. The rhythms and articulations captured in these representations may provide cues to differentiate between individual experiences of cardiac arrhythmia, with potential impact on personalising diagnostics and treatment decisions. Music generation is presented as an application of these rhythm transcriptions. The physiological origins ensure that the music based on heart rhythms, even abnormal ones, sound natural. The two-part music creation process draws inspiration from music collage practices, and comprises of a retrieval component followed by transformation processes, which can be applied at the melody or block levels, and complex combinations thereof. The music thus created can not only be used to identify distinct heart signatures and what they mean for different cardiac conditions, they can also provide a visceral record of the experience of an arrhythmic episode. The pounding and fluttering of arrhythmia can often be physically uncomfortable. The music created from arrhythmic traces is not easy listening; it is often provocative, but potentially instructive.
Original languageEnglish
Title of host publicationHandbook of Artificial Intelligence for Music
Subtitle of host publicationFoundations, Advanced Approaches, and Developments for Creativity
Place of PublicationCham, Switzerland
PublisherSpringer, Cham
Chapter9
Pages237
Number of pages25
Edition1
ISBN (Electronic)978-3-030-72116-9
ISBN (Print)978-3-030-72115-2, 978-3-030-72118-3
Publication statusPublished - 3 Jul 2021

Keywords

  • cardiac arrhythmias
  • music transcription
  • music representation
  • electrocardiogram
  • algorithmic music
  • artificial intelligence
  • diagnostic tools

Fingerprint

Dive into the research topics of 'On Making Music with Heartbeats'. Together they form a unique fingerprint.

Cite this