Prosody-based automatic segmentation of speech into sentences and topics
127 - 154
Item Usage Stats
MetadataShow full item record
A crucial step in processing speech audio data for information extraction, topic detection, or browsing/playback is to segment the input into sentence and topic units. Speech segmentation is challenging, since the cues typically present for segmenting text (headers, paragraphs, punctuation) are absent in spoken language. We investigate the use of prosody (information gleaned from the timing and melody of speech) for these tasks. Using decision tree and hidden Markov modeling techniques, we combine prosodic cues with word-based approaches, and evaluate performance on two speech corpora, Broadcast News and Switchboard. Results show that the prosodic model alone performs on par with, or better than, word-based statistical language models-for both true and automatically recognized words in news speech. The prosodic model achieves comparable performance with significantly less training data, and requires no hand-labeling of prosodic events. Across tasks and corpora, we obtain a significant improvement over word-only models using a probabilistic combination of prosodic and lexical information. Inspection reveals that the prosodic models capture language-independent boundary indicators described in the literature. Finally, cue usage is task and corpus dependent. For example, pause and pitch features are highly informative for segmenting news speech, whereas pause, duration and word-based cues dominate for natural conversation.
Hidden Markov Models (HMM)
Prosody-Based Speech Segmentation
Speech Audio Data
Word-Based Statistical Language Models
Published Version (Please cite this version)http://dx.doi.org/10.1016/S0167-6393(00)00028-5
Showing items related by title, author, creator and subject.
Turan, M. A. T.; Erzin, E. (Institute of Electrical and Electronics Engineers Inc., 2016)In this paper, we propose a new statistical enhancement system for throat microphone recordings through source and filter separation. Throat microphones (TM) are skin-attached piezoelectric sensors that can capture speech ...
Çetin, A. Enis; Yardımcı, Y.; Erzin, Engin (IEEE, 1995-05)In this paper, a new set of speech feature representations for robust speech recognition in the presence of car noise are proposed. These parameters are based on subband analysis of the speech signal. Line Spectral Frequency ...
Erzin, E.; Çetin, A. E. (IEEE, 1994)Line spectrum frequencies (LSF's) uniquely represent the linear predictive coding (LPC) filter of a speech frame. In many vocoders LSF's are used to encode the LPC parameters. In this paper, an inter-frame differential ...