Object-based sound source modeling
No Thumbnail Available
URL
Journal Title
Journal ISSN
Volume Title
Doctoral thesis (article-based)
Checking the digitized thesis and permission for publishing
Instructions for the author
Instructions for the author
Unless otherwise stated, all rights belong to the author. You may download, display and print this publication for Your own personal use. Commercial use is prohibited.
Authors
Date
2000-10-13
Major/Subject
Mcode
Degree programme
Language
en
Pages
54, [152]
Series
Report / Helsinki University of Technology, Laboratory of Acoustics and Audio Signal Processing, Raportti / Teknillinen korkeakoulu, akustiikan ja äänenkäsittelytekniikan laboratorio, 55
Abstract
This thesis proposes techniques for object-based audio and music. The work can be divided into two parts corresponding to model-based synthesis of musical instruments and computational analysis of audio and music. The contributions of this work are in signal and auditory analysis, sound object modeling, and sound signal synthesis. The first half of the thesis considers linear and particularly nonlinear discrete-time modeling of plucked string instruments. The nonlinear tension modulation phenomenon that is present in every vibrating string has been integrated into the model. Its simulation has been developed into a computationally feasible structure and it has been demonstrated that the models produce the desired effects on the synthetic tones in the desired manner. The proposed models can reproduce accurately such phenomena as variation of the fundamental frequency and coupling of the tension modulation via the bridge to the body and to the vibrating strings. The second half of this thesis mainly concentrates on computational audio and music analysis. Methods are presented for separation of harmonic sound sources using sinusoidal modeling. A computationally efficient and auditorily motivated multi-pitch analysis model has been developed and integrated with the sinusoidal separation techniques. Nonlinear least squares (NLS) methods are proposed for signal analysis. The first NLS technique performs high-resolution sinusoidal analysis which uses a priori information of the signal components obtained from the multi-pitch analysis. Another NLS-based method is used for refining a fundamental frequency estimate. It is also applied to detection of vibrato of prominent tones. The third NLS technique is used for detection of inharmonicity of a piano tone in a three-voice chord. The analysis methods are applied to obtaining a model-based representation of two-voice guitar music. Listening experiments were conducted measuring the perception of the variation of the decay pattern in model-based plucked string synthesis. The experiment results provide perceptual thresholds for changes in overall decay and frequency-dependent decay. The results are applied to parameterization of the synthesis model as well as designing a perceptually motivated parameter estimation method.Description
Keywords
auditory modeling, digital signal processing, listening experiments, musical acoustics, nonlinear systems, plucked string instruments, signal analysis, sound synthesis
Other note
Parts
- M. Karjalainen, V. Välimäki, and T. Tolonen, Plucked-string models: from Karplus-Strong algorithm to digital waveguides and beyond, Computer Music Journal, vol. 22, no. 3, pp. 17-32, 1998. [article1.pdf] © 1998 by authors.
- V. Välimäki and T. Tolonen, Development and calibration of a guitar synthesizer, Journal of the Audio Engineering Society, vol. 46, pp. 766-778, Sept. 1998.
- T. Tolonen, V. Välimäki, and M. Karjalainen, Modeling of tension modulation nonlinearity in plucked strings, IEEE Transactions on Speech and Audio Processing, vol. 8, no. 3, pp. 300-311, May 2000. [article3.pdf] © 2000 IEEE. By permission.
- C. Erkut, T. Tolonen, M. Karjalainen, and V. Välimäki, Acoustical analysis of tanbur, a Turkish long-necked lute, in Proceedings of the 6th International Congress on Sound and Vibration, vol. 1, pp. 345-352, (Lyngby, Danmark), July, 1999. [article4.pdf] © 1999 by authors.
- T. Tolonen, C. Erkut, V. Välimäki, and M. Karjalainen, Simulation of plucked strings exhibiting tension modulation driving force, in Proceedings of the International Computer Music Conference, pp. 5-9, (Beijing, China), Oct. 1999. [article5.pdf] © 1999 by authors.
- V. Välimäki, M. Karjalainen, T. Tolonen, and C. Erkut, Nonlinear modeling and synthesis of the Kantele - a traditional Finnish string instrument, in Proceedings of the International Computer Music Conference, pp. 220-223, (Beijing, China), Oct. 1999. [article6.pdf] © 1999 by authors.
- T. Tolonen, Methods for separation of harmonic sound sources using sinusoidal modeling, in AES 106th Convention, Preprint 4958, (Munich, Germany), May 1999. [article7.pdf] © 1999 AES. By permission.
- T. Tolonen and M. Karjalainen, A computationally efficient multipitch analysis model, IEEE Transactions on Speech and Audio Processing, 2000. In press.
- T. Tolonen, Object-based sound source modeling for musical signals, in AES 109th Convention, Preprint 5174, (Los Angeles, USA), Sept. 2000. [article9.pdf] © 2000 AES. By permission.
- T. Tolonen and H. Järveläinen, Perceptual study of decay parameters in plucked string synthesis, in AES 109th Convention, Preprint 5205, (Los Angeles, USA), Sept. 2000. [article10.pdf] © 2000 AES. By permission.