An Exploratory Survey Questionnaire to Understand What Emotions Are Important and Difficult to Communicate for People with Dysarthria and Their Methodology of Communicating

People with speech disorders may rely on augmentative
and alternative communication (AAC) technologies to help them
communicate. However, the limitations of the current AAC
technologies act as barriers to the optimal use of these technologies in
daily communication settings. The ability to communicate effectively
relies on a number of factors that are not limited to the intelligibility
of the spoken words. In fact, non-verbal cues play a critical role in
the correct comprehension of messages and having to rely on verbal
communication only, as is the case with current AAC technology,
may contribute to problems in communication. This is especially true
for people’s ability to express their feelings and emotions, which are
communicated to a large part through non-verbal cues. This paper
focuses on understanding more about the non-verbal communication
ability of people with dysarthria, with the overarching aim of this
research being to improve AAC technology by allowing people
with dysarthria to better communicate emotions. Preliminary survey
results are presented that gives an understanding of how people with
dysarthria convey emotions, what emotions that are important for
them to get across, what emotions that are difficult for them to convey,
and whether there is a difference in communicating emotions when
speaking to familiar versus unfamiliar people.

Authors:

• Lubna Alhinti
• Heidi Christensen
• Stuart Cunningham

Keywords:

• Alternative and augmentative communication technology
• dysarthria
• speech emotion recognition
• VIVOCA.

References:

[1] M. Walshe and N. Miller, “Living with acquired dysarthria: the speaker’s
perspective,” Disability and rehabilitation, vol. 33, no. 3, pp. 195–203,
2011.
[2] J. R. Duffy, Motor Speech Disorders-E-Book: Substrates, Differential
Diagnosis, and Management. Elsevier Health Sciences, 2013.
[3] S. Steinberg, Introduction to communication course book 1: The basics.
Juta and Company Ltd, 1995, vol. 1.
[4] M. Fried-Oken, D. R. Beukelman, and K. Hux, “Current and future
aac research considerations for adults with acquired cognitive and
communication impairments,” Assistive Technology, vol. 24, no. 1, pp.
56–66, 2012.
[5] D. Mcnaughton and D. N. Bryen, “Aac technologies to enhance
participation and access to meaningful societal roles for adolescents and
adults with developmental disabilities who require aac,” Augmentative
and Alternative Communication, vol. 23, no. 3, pp. 217–229, 2007.
[6] D. J. Higginbotham, H. Shane, S. Russell, and K. Caves, “Access to aac:
Present, past, and future,” Augmentative and alternative communication,
vol. 23, no. 3, pp. 243–257, 2007.
[7] M. S. Hawley, S. P. Cunningham, P. D. Green, P. Enderby, R. Palmer,
S. Sehgal, and P. O’Neill, “A voice-input voice-output communication
aid for people with severe speech impairment,” IEEE Transactions on
neural systems and rehabilitation engineering, vol. 21, no. 1, pp. 23–31,
2013.
[8] R. Patel, “Acoustic characteristics of the question-statement contrast in
severe dysarthria due to cerebral palsy,” Journal of Speech, Language,
and Hearing Research, vol. 46, no. 6, pp. 1401–1415, 2003.
[9] F. Miller and S. J. Bachrach, Cerebral palsy: A complete guide for
caregiving. JHU Press, 2017.
[10] D. R. Beukelman, S. Fager, L. Ball, and A. Dietz, “Aac for adults
with acquired neurological conditions: A review,” Augmentative and
alternative communication, vol. 23, no. 3, pp. 230–242, 2007.
[11] G. Pullin and S. Hennig, “17 ways to say yes: Toward nuanced tone
of voice in aac and speech technology,” Augmentative and Alternative
Communication, vol. 31, no. 2, pp. 170–180, 2015.
[12] A. Karpf, The Human Voice: The Story of a Remarkable Talent.
Bloomsbury, 2007.
[13] P. B. Dasgupta, “Detection and analysis of human emotions through
voice and speech pattern processing,” arXiv preprint arXiv:1710.10198,
2017.
[14] D. A. Sauter, F. Eisner, A. J. Calder, and S. K. Scott, “Perceptual
cues in nonverbal vocal expressions of emotion,” Quarterly Journal of
Experimental Psychology, vol. 63, no. 11, pp. 2251–2272, 2010.
[15] R. Patel, “Prosodic control in severe dysarthria: Preserved ability to
mark the question-statement contrast,” Journal of Speech, Language,
and Hearing Research, vol. 45, no. 5, p. 858, 2002.
[16] R. Patel, “Phonatory control in adults with cerebral palsy and severe
dysarthria,” Augmentative and Alternative Communication, vol. 18,
no. 1, pp. 2–10, 2002.
[17] P. Ekman, E. R. Sorenson, and W. V. Friesen, “Pan-cultural elements
in facial displays of emotion,” Science, vol. 164, no. 3875, pp. 86–88,
1969.
[18] R. P. Abelson and V. Sermat, “Multidimensional scaling of facial
expressions.” Journal of experimental psychology, vol. 63, no. 6, p. 546,
1962.
[19] K. R. Scherer and G. Ceschi, “Lost luggage: a field study of
emotion–antecedent appraisal,” Motivation and emotion, vol. 21, no. 3,
pp. 211–235, 1997.
[20] I. S. Engberg, A. V. Hansen, O. Andersen, and P. Dalsgaard, “Design,
recording and verification of a danish emotional speech database,” in
Fifth European Conference on Speech Communication and Technology,
1997.
[21] F. Burkhardt, A. Paeschke, M. Rolfes, W. F. Sendlmeier, and
B. Weiss, “A database of german emotional speech,” in Ninth European
Conference on Speech Communication and Technology, 2005.
[22] O. Martin, I. Kotsia, B. Macq, and I. Pitas, “The enterface05 audio-visual
emotion database,” in Data Engineering Workshops, 2006. Proceedings.
22nd International Conference on. IEEE, 2006, pp. 8–8.
[23] P. Jackson and S. Haq, “Surrey audio-visual expressed
emotion (savee) database,” Apr 2011. [Online]. Available:
www.ee.surrey.ac.uk/Personal/P.Jackson/SAVEE/
[24] S. Yacoub, S. Simske, X. Lin, and J. Burns, “Recognition of emotions
in interactive voice response systems,” in Eighth European conference
on speech communication and technology, 2003.
[25] M. Lugger and B. Yang, “The relevance of voice quality features in
speaker independent emotion recognition,” in Acoustics, Speech and
Signal Processing, 2007. ICASSP 2007. IEEE International Conference
on, vol. 4. IEEE, 2007, pp. IV–17.