Modeling and Control of Expressiveness in Music Performance
Proceedings of the IEEEPublished 30 March 2004
Sergio Canazza, Giovanni De Poli, Carlo Drioli, Antonio Rodà, Alvise Vidolin
Citations63
SJR quartileQ1
SJR score6.25
SNIP11.38
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
This paper discusses a model that applies a smooth morphing among performances with different expressive content, adapting the audio expressive character to the user's desires, and introduces an original method for the spectral processing of audio.
Abstract
Expression is an important aspect of music performance. It is the added value of a performance and is part of the reason that music is interesting to listen to and sounds alive. Understanding and modeling expressive content communication is important for many engineering applications in information technology. For example, in multimedia products, textual information is enriched by means of graphical and audio objects. In this paper, we present an original approach to modify the expressive content of a performance in a gradual way, both at the symbolic and signal levels. To this purpose, we discuss a model that applies a smooth morphing among performances with different expressive content, adapting the audio expressive character to the user’s desires. Morphing can be real- ized with a wide range of graduality (from abrupt to very smooth), allowing adaptation of the system to different situations. The sound rendering is obtained by interfacing the expressiveness model with a dedicated postprocessing environment, which allows for the transformation of the event cues. The processing is based on the organized control of basic audio effects. Among the basic effects used, an original method for the spectral processing of audio is introduced.
Keywords
Computer Science
Neural Networks: A Comprehensive Foundation
29,816 Citations1998Simon Haykin
Thorough, well-organized, and completely up to date, this book examines all the important aspects of this emerging technology, including the learning process, back-propagation learning, radial-basis function networks, self-organizing systems, modular networks, temporal processing and neurodynamics, and VLSI implementation of neural networks.
IEEE Transactions on Neural NetworksOrthogonal least squares learning algorithm for radial basis function networks
3,361 Citations1991Sheng Chen, C.F.N. Cowan +1 more
The authors propose an alternative learning procedure based on the orthogonal least-squares method, which provides a simple and efficient means for fitting radial basis function networks.
IEEE Signal Processing MagazineEmotion recognition in human-computer interaction
2,507 Citations2001Roddy Cowie, Ellen Douglas‐Cowie +5 more
Basic issues in signal processing and analysis techniques for consolidating psychological and linguistic analyses of emotion are examined, motivated by the PKYSTA project, which aims to develop a hybrid system capable of using information from faces and voices to recognize people's emotions.
IEEE Transactions on Acoustics Speech and Signal ProcessingSpeech analysis/Synthesis based on a sinusoidal representation
1,589 Citations1986R. McAulay, Thomas F. Quatieri
A sinusoidal model for the speech waveform is used to develop a new analysis/synthesis technique that is characterized by the amplitudes, frequencies, and phases of the component sine waves, which forms the basis for new approaches to the problems of speech transformations including time-scale and pitch-scale modification, and midrate speech coding.
The computer music tutorial
673 Citations1996Curtis Roads
Music And Emotion
546 Citations2001Patrik N. Juslin, John Sloboda
The Journal of the Acoustical Society of AmericaAnalytical expressions for critical-band rate and critical bandwidth as a function of frequency
540 Citations1980Eberhard Zwicker, Ernst Terhardt
Music Perception An Interdisciplinary JournalA Model of Expressive Timing in Tonal Music
429 Citations1985Neil P. McAngus Todd
The Journal of the Acoustical Society of AmericaPerceptual effects of spectral modifications on musical timbres
354 Citations1978John M. Grey, John W. Gordon
The Journal of the Acoustical Society of AmericaDiversity and commonality in music performance: An analysis of timing microstructure in Schumann’s ‘‘Träumerei’’
354 Citations1992Bruno H. Repp
The striking individuality of two legendary pianists, Alfred Cortot and Vladimir Horowitz, is objectively demonstrated here, as is the relative eccentricity of several other artists.
The Journal of the Acoustical Society of AmericaThe dynamics of dynamics: A model of musical expression
298 Citations1992Neil P. McAngus Todd
The model, implemented in the artificial intelligence language LISP, is based on the observation that a musical phrase is often indicated by a crescendo/decadescendo shape and provides a basis for a method of performance style analysis.
Musical Sound Modeling with Sinusoids plus Noise
264 Citations1997Xavier Serra
When generating musical sound on a digital computer, it is important to have a good model whose parameters provide a rich source of meaningful sound transformations.
The Journal of the Acoustical Society of AmericaPatterns of expressive timing in performances of a Beethoven minuet by nineteen famous pianists
191 Citations1990Bruno H. Repp
Computer Music JournalEmotional Coloring of Computer-Controlled Music Performances
166 Citations2000Roberto Bresin, Anders Friberg
A complex, ecological-predictive ANN was designed that was able to learn a professional pianist's performance style at the structural micro-level and listeners were able to recognize the intended emotional colorings.
The Journal of the Acoustical Society of AmericaThe kinematics of musical expression
157 Citations1995Neil P. McAngus Todd
Proceedings of the IEEEStructured audio: creation, transmission, and rendering of parametric sound representations
112 Citations1998Barry Vercoe, William G. Gardner +1 more
An overview of techniques for transmitting and synthesizing sound represented in structured format, and for creating structured representations from audio waveforms are presented.
Journal of New Music ResearchSaxex: A case‐based reasoning system for generating expressive musical performances
110 Citations1998Josep Lluís Arcos, Ramón López de Mántaras +1 more
The problem of generating expressive musical performances in the context of tenor saxophone interpretations was studied and SaxEx applies the inferred expressive transformations to the new phrase using the synthesis capabilities of Sms.
Computer Music JournalGenerating Musical Performances with Director Musices
82 Citations2000Anders Friberg, Vittorio Colombo +2 more
Director Musices is a program that transforms notated scores into musical performances and implements the performance rules emerging from research projects at the Royal Institute of Technology (KTH).
Psychomusicology Music Mind and BrainCan results from studies of perceived expression in musical performances be generalized across response formats?
82 Citations1997Patrik N. Juslin
Expressive Intention and Performance
74 Citations1995Alf Gabrielsson
Journal of New Music ResearchNote‐by‐note analysis of the influence of expressive intentions and musical structure in violin performance*
64 Citations1998Giovanni De Poli, Antonio Rodà +1 more
Journal of New Music ResearchArtificial neural networks based models for automatic performance of musical scores
64 Citations1998Roberto Bresin
The author's research on automatic performance, started at CSC (Centro di Sonologia Computazionale, University of Padua) and continued at TMH-KTH (Speech, Music Hear ...
Proceedings of the IEEETime-frequency analysis of musical signals
57 Citations1996William J. Pielemeier, Gregory H. Wakefield +1 more
The modal distribution is shown to be a linear transformation of the Wigner distribution optimized for estimating those parameters for a musical signal model, highlighting the need for further theoretical research.
Speech CommunicationSpeech spectrum conversion based on speaker interpolation and multi-functional representation with weighting by radial basis function networks
54 Citations1995Naoto Iwahashi, Yoshinori Sagisaka
A speech spectrum transformation method by interpolating multi-speakers' spectral patterns and multi-functional representation with Radial Basis Function networks to generate new spectrum patterns close to those of the target speaker.
Regularized estimation of cepstrum envelope from discrete frequency points
53 Citations2002Olivier Cappé, J. Laroche +1 more
An improved method for the estimation of a continuous frequency-envelope when the value of this envelope is specified only at discrete frequencies is presented, based on the Galas/Rodet (1990) approach.
Computer Music JournalPerformance Rules for Computer-Controlled Contemporary Keyboard Music
49 Citations1991Anders Friberg, Lars Frydén +2 more
A computer program for synthesis of music performance, originally developed for traditional tonal music by means of an analysis-by-synthesis strategy, is applied to contemporary piano music as well as other genres.
CognitionMicrostructural musical linguistics: composers' pulses are liked most by the best musicians
48 Citations1995Manfred Clynes
Results show dramatically that the greater the musical proficiency, the more marked the preference for the "right" pulse (p < .0001), and further studies suggest that longer excerpts and repeated hearing would help non-musicians also to better understand composers' pulses.
Applied IntelligenceAn Interactive Case-Based Reasoning Approach for Generating Expressive Music
46 Citations2001Josep Lluís Arcos, Ramón López de Mántaras
The necessity of user interaction during the CBR process and how this decision enhances the capabilities and the usability of the system are discussed.
Speech CommunicationHow can music be expressive?
43 Citations1993Johan Sundberg
Many striking similarities with speech and other types of human communication suggest that expressive details in music performance are not specific to music, and appear to allude to and thus become meaningful because of the listener's extramusical experiences.
Journal of New Music ResearchLearning expressive performance: The structure‐level approach
36 Citations1996Gerhard Widmer
An implemented AI program is presented that learns general rules of expressive performance from examples of human performances that leads to smoother and more balanced performances and is also more plausible from a musical point of view.
Padua Research Archive (University of Padua)Audio Morphing Different Expressive Intentions for Multimedia Systems
36 Citations2000Sergio Canazza, Giovanni De Poli +3 more
The audio authoring tool generates expressive performance of Sonatina in sol generated by the model in a symbolic way (that is, as a MIDI file) using the audio postprocessing tool.
A Case Based Approach to the Generation of Musical Expression
29 Citations1999Taizan Suzuki, Takenobu Tokunaga +1 more
This paper proposes a case-based approach to the generation of expressively modulated performance and implements the proposed case- based method in a musical performance system, and describes the system architecture and experiments performed on the system.
Lecture notes in computer sciencePerceptual analysis of the musical expressive intention in a clarinet performance
20 Citations1997Sergio Canazza, Giovanni De Poli +1 more
Factor Analysis, MultiDimensional Scaling and Cluster Analysis applied to the subjects' replies verified that groups of listeners with different cultural preparation, could recognize the performer's intentions.
Music Perception An Interdisciplinary JournalSome Guidelines for the Synthesis and Testing of Pulse Microstructure in Relation to Musical Meaning
18 Citations1990Manfred Clynes
Computers and the HumanitiesLearning performance rules in a music interpretation system
14 Citations1993Haruhiro Katayose, Seiji Inokuchi
The function of learning how to play music is described, which is the most important process in music interpretation, and expression rules are used in order to convert dynamic marks and motives into concrete performance data.
EURASIP Journal on Advances in Signal ProcessingRadial Basis Function Networks for Conversion of Sound Spectra
11 Citations2001Carlo Drioli
InterfaceMusic score interpretation using a multilevel knowledge base
8 Citations1990Giovanni De Poli, Luca Irone +1 more
An approach to build a rule system based on many sorted logic that allows to work with partial knowledge and to reply to a general query in the interpretation of computer music.