Header

UZH-Logo

Maintenance Infos

Amplitude envelope kinematics of speech signal: parameter extraction and applications


He, Lei; Dellwo, Volker (2017). Amplitude envelope kinematics of speech signal: parameter extraction and applications. In: Trouvain, Jürgen; Steiner, Ingmar; Möbius, Bernd. Elektronische Sprachsignalverarbeitung 2017. Dresden: TUDpress, 1-8.

Abstract

In this paper, we model the amplitude envelope of the broadband speech signal as a kinematic system and calculate its basic parameters, including displacement, velocity and acceleration. Such system captures the smoothed amplitude fluctuation pattern over time, illustrating how energy is distributed across the signal. Although the pulmonic air pressure is the primary energy source of speech, the amplitude modulation pattern is largely determined by articulatory behaviours, especially mandible and lip movements. Therefore, there should be a correspondence between signal envelope kinematics and articulator kinematics. Previous research showed that a tremendous amount of speaker idiosyncrasies in articulation existed. Such idiosyncrasies should therefore be reflected in the envelope kinematics as well. From the signal envelope kinematics, it may be possible to infer individual articulatory behaviours. This is particularly useful for forensic phoneticians who usually have no access to articulatory data, and clinical speech pathologists who usually find it difficult to make articulatory measurement in clinical consultations. Also in this paper, we illustrate a correspondence between the amplitude envelope kinematics and the lower lip kinematics (X-ray pellet history data) of one speaker reading one sentence. For future research, more speakers are needed to record both speech and articulatory signals to build a statistical model between the kinematics data of both domains.

Abstract

In this paper, we model the amplitude envelope of the broadband speech signal as a kinematic system and calculate its basic parameters, including displacement, velocity and acceleration. Such system captures the smoothed amplitude fluctuation pattern over time, illustrating how energy is distributed across the signal. Although the pulmonic air pressure is the primary energy source of speech, the amplitude modulation pattern is largely determined by articulatory behaviours, especially mandible and lip movements. Therefore, there should be a correspondence between signal envelope kinematics and articulator kinematics. Previous research showed that a tremendous amount of speaker idiosyncrasies in articulation existed. Such idiosyncrasies should therefore be reflected in the envelope kinematics as well. From the signal envelope kinematics, it may be possible to infer individual articulatory behaviours. This is particularly useful for forensic phoneticians who usually have no access to articulatory data, and clinical speech pathologists who usually find it difficult to make articulatory measurement in clinical consultations. Also in this paper, we illustrate a correspondence between the amplitude envelope kinematics and the lower lip kinematics (X-ray pellet history data) of one speaker reading one sentence. For future research, more speakers are needed to record both speech and articulatory signals to build a statistical model between the kinematics data of both domains.

Statistics

Altmetrics

Downloads

27 downloads since deposited on 20 Mar 2017
27 downloads since 12 months
Detailed statistics

Additional indexing

Item Type:Book Section, refereed, original work
Communities & Collections:06 Faculty of Arts > Department of Comparative Linguistics
06 Faculty of Arts > Institute of Computational Linguistics
Dewey Decimal Classification:000 Computer science, knowledge & systems
490 Other languages
890 Other literatures
410 Linguistics
Language:English
Date:2017
Deposited On:20 Mar 2017 11:45
Last Modified:05 May 2017 14:53
Publisher:TUDpress
Series Name:Studientexte zur Sprachkommunikation
Number:86
ISSN:0940-6832
ISBN:978-3-95908-094-1
Additional Information:Tagungsband der 28. Konferenz, Saarbrücken, 15.-17. März 2017
Free access at:Official URL. An embargo period may apply.
Official URL:http://essv2017.coli.uni-saarland.de/pdfs/He.pdf
Related URLs:http://essv2017.coli.uni-saarland.de/program.html (Organisation)
http://essv2017.coli.uni-saarland.de/pdfs/proceedings.pdf (Publisher)

Download

Preview Icon on Download
Preview
Filetype: PDF
Size: 4MB