TY - JOUR
T1 - Speech tasks and interrater reliability in perceptual voice evaluation
AU - Lu, Fang Ling
AU - Matteson, Samuel
N1 - Funding Information:
Equipment funding of this project was provided by the Research Infrastructure Grant from the University of North Texas for which the authors express appreciation to the university administration. The authors thank three graduate students, Megan Nieckarz, Landon Hughes, and Nurinder Singh, for their vital roles in data collection. The authors also extend their thanks to the several anonymous subjects who so willingly performed the many voice tasks.
Publisher Copyright:
© 2014 The Voice Foundation.
Copyright:
Copyright 2020 Elsevier B.V., All rights reserved.
PY - 2014/11/1
Y1 - 2014/11/1
N2 - Objective/Hypothesis The optimal selection of speech task is essential for more reliable perceptual ratings and a better understanding of the perceptual qualities of pathologic voices. Nevertheless, researchers have rarely explored this issue using the GRBAS scale. This study investigates the effect of speech task selection on interrater reliability during perceptual voice assessment. Study Design Experimental study. Methods Sixty subjects, 39 dysphonic subjects and 21 normal controls, performed 13 speech tasks including three 5-second sustained vowel sounds (/α/, /i/, and /u/) each at three pitch levels (high, habitual, and low), maximum phonation of the vowel /α/, pitch glide, counting from 1 to 10, and oral reading of the Rainbow Passage. A group of 18 graduate students in speech-language pathology served as perceptual judges and rated the dysphonic severity for the speech samples based on three parameters in the GRBAS scale - Grade, Roughness, and Breathiness. The formalism of the AC1 statistic proposed by Gwet was applied to determine relative reliability between the speech tasks and the raters. Results The counting task and sustained vowel /α/ in high, habitual, and low registers exhibited the most reproducibility and consequently the highest reliability statistic. Conclusions The counting task and sustained /α/ phonation are the optimal tasks for perceptual voice judgment in regard to interrater reliability. Future perceptional studies may benefit from this finding to determine the relationship between speech task selection and the validity of any given perceptual rating system in terms of sensitivity and specificity.
AB - Objective/Hypothesis The optimal selection of speech task is essential for more reliable perceptual ratings and a better understanding of the perceptual qualities of pathologic voices. Nevertheless, researchers have rarely explored this issue using the GRBAS scale. This study investigates the effect of speech task selection on interrater reliability during perceptual voice assessment. Study Design Experimental study. Methods Sixty subjects, 39 dysphonic subjects and 21 normal controls, performed 13 speech tasks including three 5-second sustained vowel sounds (/α/, /i/, and /u/) each at three pitch levels (high, habitual, and low), maximum phonation of the vowel /α/, pitch glide, counting from 1 to 10, and oral reading of the Rainbow Passage. A group of 18 graduate students in speech-language pathology served as perceptual judges and rated the dysphonic severity for the speech samples based on three parameters in the GRBAS scale - Grade, Roughness, and Breathiness. The formalism of the AC1 statistic proposed by Gwet was applied to determine relative reliability between the speech tasks and the raters. Results The counting task and sustained vowel /α/ in high, habitual, and low registers exhibited the most reproducibility and consequently the highest reliability statistic. Conclusions The counting task and sustained /α/ phonation are the optimal tasks for perceptual voice judgment in regard to interrater reliability. Future perceptional studies may benefit from this finding to determine the relationship between speech task selection and the validity of any given perceptual rating system in terms of sensitivity and specificity.
KW - Contextual speech
KW - GRBAS scale
KW - Interrater reliability
KW - Sustained vowel phonation
UR - http://www.scopus.com/inward/record.url?scp=84913614899&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84913614899&partnerID=8YFLogxK
U2 - 10.1016/j.jvoice.2014.01.018
DO - 10.1016/j.jvoice.2014.01.018
M3 - Article
C2 - 24841668
AN - SCOPUS:84913614899
SN - 0892-1997
VL - 28
SP - 725
EP - 732
JO - Journal of Voice
JF - Journal of Voice
IS - 6
ER -