Voice Features as the Diagnostic Marker of Autism

The aim of the study is to determine the acoustic features of voice and speech of children with autism spectrum disorders (ASD) as a possible additional diagnostic criterion. The participants in the study were 95 children with ASD aged 5-16 years, 150 typically development (TD) children, and 103 adults – listening to children’s speech samples. Three types of experimental methods for speech analysis were performed: spectrographic, perceptual by listeners, and automatic recognition. In the speech of children with ASD, the pitch values, pitch range, values of frequency and intensity of the third formant (emotional) leading to the “atypical” spectrogram of vowels are higher than corresponding parameters in the speech of TD children. High values of vowel articulation index (VAI) are specific for ASD children’s speech signals. These acoustic features can be considered as diagnostic marker of autism. The ability of humans and automatic recognition of the psychoneurological state of children via their speech is determined.





References:
REFERENCES
[1] Ch. Darwin, Expression of the emotions in Man and Animals. London: John Murray, 1872.
[2] E. Lyakso, “Characteristics of infant’s vocalizations during the first year of life,” International Journal of Psychophysiology, vol. 30, p. 150, 1998.
[3] I. V. Novikova and E. E. Lyakso, “Acoustic and perceptual analysis of early vocalizations of normally developing infants and children with a burdened anamnesis,” Bulletin of the Saint Petersburg University, vol. 3, no. 2, pp. 74-87, 2004.
[4] K. Michelsson, “Cry analyses of symptomless low birth weight neonates and of asphyxiated newborn infants,” Acta Paediatrica, vol. 60, no. 216, pp. 9-45, 1971.
[5] B.R. Vohr, B. Lester, G. Rapisardi, C. O’Dea, L. Brown., M. Peucker, W. Cashore, and W. Oh, “Abnormal brain-stem function (brain-stem auditory evoked response) correlates with acoustic cry features in term infants with hyperbilirubinemia,” Journal of Pediatrics, vol. 115, no. 2, pp. 303-308, Aug. 1989.
[6] M. Koivisto, “Cry analysis in infants with Rh haemolytic disease,” Acta paediatrica Scandinavica Supplement, vol. 335, pp. 1-73, May 1987.
[7] Q. Xie, R. K. Ward, and C. A. Laszlo, “Automatic assessment of infants’ levels-of-distress from the cry signals,” IEEE Transactions on Speech and Audio Processing, vol. 4, no. 4, pp. 253-265, Jul. 1996.
[8] O. F. Reyes-Galaviz, A. Verduzco, E. Arch-Tirado, and C. A. Reyes-García, “Analysis of an infant cry recognizer for the early identification of pathologies,” Nonlinear Speech Modeling and Applications. Lecture Notes in Computer Science, vol. 3445, pp. 404-409, 2005.
[9] E Amaro-Camargo and C. A. Reyes-García, “Applying statistical vectors of acoustic characteristics for the automatic classification of infant cry,” ICIC 2007, Lecture Notes in Computer Science, vol. 4681, pp. 1078-1085, 2007.
[10] S. Vicari, “Motor development and neuropsychological patterns in persons with Down syndrome,” Behavior Genetics, vol. 36, no. 3, pp. 355-364, Feb. 2006.
[11] T. Fortunato-Tavares, C. R. Andrade, D. Befi-Lopes, S. O. Limongi, F. D. Fernandes, and R. G. Schwartz, “Syntactic comprehension and working memory in children with specific language impairment, autism or Down syndrome,” Clinical Linguistics & Phonetics, vol. 29, no. 7, pp. 499-522, Apr. 2015.
[12] D. Ververidis and C. Kotropoulos, “Emotional speech recognition: Resources, features, and methods,” Speech Communication Journal, vol. 48, no. 9, pp. 1162-1181, Sep. 2006.
[13] H. Kaya, A. A. Salah, A. Karpov, O. Frolova, A. Grigorev, and E. Lyakso, “Emotion, age, and gender classification in children’s speech by humans and machines,” Computer Speech and Language, vol. 46, pp. 268-283, Nov. 2017.
[14] N. Yirmiya and T. Charman, “The prodrome of autism: early behavioral and biological signs, regression, peri- and post-natal development and genetics,” Journal of Child Psychology and Psychiatry, vol. 51, no. 4, pp. 432-58, March, 2010.
[15] D. Bone, C-C. Lee, A. Potamianos, and Sh. S. Narayanan, “An investigation of vocal arousal dynamics in child-psychologist interactions using synchrony measures and a conversation-based model,” in Proc. Interspeech 2014, pp. 218-222.
[16] M. Mody, A. M. Shui, L. A. Nowinski, S. B. Golas, C. Ferrone, J. A. O’Rourke, and C. J. McDougle, “Communication deficits and the motor system: Exploring patterns of associations in autism spectrum disorder (ASD),” Journal of Autism and Developmental Disorders, vol. 47, no. 1, pp. 155-162, Jan. 2017.
[17] Y.S. Bonneh, Y. Levanov, O. Dean-Pardo, L. Lossos, and Y. Adini, “Abnormal speech spectrum and increased pitch variability in young autistic children,” Frontiers in Human Neuroscience, vol. 4, no. 237, pp. 1-7, Jan. 2011.
[18] L. Kanner, “Autistic disturbances of affective contact,” Nervous Child, vol. 2, pp. 217–250, 1943.
[19] L. Wing, “The definition and prevalence of autism: a Review,” European Child and Adolescent Psychiatry, vol. 2, no. 1, pp. 61–74, Jan. 1993.
[20] M. F. Casanova, A. El-Baz, M. Mott, G. Mannheim, H. Hassan, R. Fahmi, J. Giedd, J. M. Rumsey, A. E. Switala, and A. Farag, “Reduced gyral window and corpus callosum size in autism: possible macroscopic correlates of a minicolumnopathy,” Journal of Autism and Developmental Disorders, vol. 39, no. 5, pp. 751–764, Jan. 2009.
[21] E. Courchesne, “Brainstem, cerebellar and limbic neuroanatomical abnormalities in autism,” Current Opinion in Neurobiology, vol. 7, no. 2, pp. 269-278, Apr. 1997.
[22] J. Diehl and R. Paul, “Acoustic and perceptual measurements of prosody production on the profiling elements of prosodic systems by children with autism spectrum disorders,” Applied Psycholinguistics, vol. 34, no. 1, pp. 135–161, Jan. 2013.
[23] Y. Nakai, R. Takashima, T. Takiguchi, and S. Takada, “Speech intonation in children with autism spectrum disorder,” Brain and Development, vol. 36, no.6, pp. 516–522, Jun. 2014.
[24] E. López-Hurtado and J. J. Prieto, “A microscopic study of language-related cortex in autism,” American Journal of Biochemistry and Biotechnology, vol. 4, no. 2, pp. 130–145, 2008.
[25] M. A Just, V. L. Cherkassky, T. A. Keller, R. K. Kana, and N. J. Minshew, “Functional and anatomical cortical underconnectivity in autism: Evidence from an fMRI study of an executive function task and corpus callosum morphometry,” Cerebral Cortex, vol. 17, no. 4, pp. 951–961, Apr. 2007.
[26] J. R. Isler, K. M. Martien, P. G. Grieve, R. I. Stark, and M. R. Herbert, “Reduced functional connectivity in visual evoked potentials in children with autism spectrum disorder,” Clinical Neurophysiology, vol. 121, no. 12, pp. 2035–2043, Dec. 2010.
[27] C. V. Tyler, S. C. Schramm, M. Karafa, A. S. Tang, and A. K. Jain, “Chronic disease risks in young adults with autism spectrum disorder: forewarned is forearmed,” American Journal on Intellectual and Developmental Disabilities, vol. 116, no. 5, pp. 371-80, Sep. 2011.
[28] R. Taurines, C. Schwenck, E. Westerwald, M. Sachse, M. Siniatchkin, and C. Freitag, “ADHD and autism: differential diagnosis or overlapping traits? A selective review,” Attention Deficit and Hyperactivity Disorders, vol. 4, no. 3, pp. 115-39, Aug. 2012.
[29] R. B. Grossman, L. R. Edelson, and H. Tager-Flusberg, “Emotional facial and vocal expressions during story retelling by children and adolescents with high-functioning autism,” Journal of Speech, Language, and Hearing Research, vol. 56, no. 3, pp. 1035-1044, Jun 2013.
[30] S. Le Sourn-Bissaoui, M. Aguert, P. Girard, C. Chevreuil, and V. Laval, “Emotional speech comprehension in children and adolescents with autism spectrum disorders,” Journal of Communication Disorders, vol. 46, no. 4, pp. 309-20, Jul-Aug. 2013.
[31] E. M. Whyte and K. E. Nelson, “Trajectories of pragmatic and nonliteral language development in children with autism spectrum disorders,” Journal of Communication Disorders, vol. 54, pp. 2-14, Mar-Apr. 2015.
[32] M. T. Alqhazo, L. S. Hatamleh, and M. Bashtawi, “Phonological and lexical abilities of Jordanian children with autism,” Applied Neuropsychology: Child, vol. 9:2, pp. 116-124, Dec. 2018.
[33] H. Tager-Flusberg, “On the nature of linguistic functioning in early infantile autism,” Journal of Autism and Developmental Disorders, vol. 11, no. 1, pp. 45–56, March 1981.
[34] J. McCann and S. Peppé, “Prosody in autism spectrum disorders: a critical review” International Journal of Language and Communication Disorders, vol. 38, no. 4, pp. 325-350, Oct-Dec. 2003.
[35] R. Paul, A. Augustyn, A. Klin, and F. Volkmar, “Perception and production of prosody by speakers with autism spectrum disorders,” Journal of Autism and Developmental Disorders, vol. 35, no. 2, pp. 205–220, May 2005.
[36] K. Hubbard and D. A. Trauner, “Intonation and emotion in autistic spectrum disorders,” Journal of Psycholinguist Research, vol. 36, no. 2, pp. 159-173, Nov. 2007.
[37] L. D. Shriberg, R. Paul, J. L. McSweeny, A. Klin, D. J. Cohen, and F. R. Volkmar, “Speech and prosody characteristics of adolescents and adults with high functioning autism and Asperger syndrome,” Journal of Speech, Language, and Hearing Research, vol. 44, no. 5, pp. 1097–1115, Oct. 2001.
[38] R. B. Grossman, R. H. Bemis, D. P. Skwerer, and H. Tager-Flusberg, “Lexical and affective prosody in children with high-functioning autism,” Journal of Speech, Language, and Hearing Research, vol. 53, no. 3, pp. 778–793, Jun. 2010.
[39] J. J. Diehl, D. G. Watson, L. Bennetto, J. McDonough, and C. Gunlogson, “An acoustic analysis of prosody in high-functioning autism,” Applied Psycholinguistics, vol. 30, pp. 385–404, Jul. 2009.
[40] J. J. Diehl, R. Paul, “Acoustic differences in the imitation of prosodic patterns in children with autism spectrum disorders,” Research in Autism Spectrum Disorders, vol. 6, no. 1, pp. 123–134, Jan.–Mar. 2012.
[41] A. Nadig and H. Shaw, “Acoustic and perceptual measurement of expressive prosody in high-functioning autism: Increased pitch range and what it means to listeners,” Journal of Autism and Developmental Disorders, vol. 42, no. 4, pp. 499–511, Apr. 2012.
[42] A. G. Olivati, F. B. Assumpção Junior, and A. R. Misquiatti, “Acoustic analysis of speech intonation pattern of individuals with Autism Spectrum Disorders,” CoDAS, vol. 29, no. 2, e20160081, Apr. 2017.
[43] M. R. Talbott, G. S. Young, J. Munson, A. Estes, L. A. Vismara, and S. J. Rogers, “The developmental sequence and relations between gesture and spoken language in toddlers with autism spectrum disorder,” Child Development, vol. 91, no. 3, pp. 743-753, May-Jun. 2020.
[44] L. A. Scharfstein, D. C. Beidel, V. K. Sims, and L. Rendon Finnell, “Social skills deficits and vocal characteristics of children with social phobia or Asperger’s disorder: A comparative study,” Journal of abnormal child psychology, vol. 39, no. 6, pp. 865–875, Aug. 2011.
[45] M. G. Filipe, S. Frota, S. L. Castro, and S. G. Vicente, “Atypical prosody in Asperger syndrome: perceptual and acoustic measurements,” Journal of Autism and Developmental Disorders, vol. 44, no. 8, pp. 1972–1981, Mar. 2014.
[46] M. Sharda, T. P. Subhadra, S. Sahaya, Ch. Nagaraja, L. Singh, R. Mishra, A. Sen, N. Singhal, D. Erickson, and N. Singh, “Sounds of melody—Pitch patterns of speech in autism,” Neuroscience Letters, vol. 478, no. 1, pp. 42–45, Jun. 2010.
[47] E. Lyakso, O. Frolova, and A. Grigorev, “A comparison of acoustic features of speech of typically developing children and children with autism spectrum disorders,” Lecture Notes in Computer Science, vol. 9811, pp. 43-50, Aug. 2016.
[48] E. Lyakso, O. Frolova, and A. Grigorev, “Perception and acoustic features of speech of children with autism spectrum disorders,” Lecture Notes in Computer Science, vol. 10458, pp. 602–612, Aug. 2017.
[49] E. Lyakso, O. Frolova, A. Kaliyev, V. Gorodnyi, A. Grigorev, and Y. Matveev, “AD-Child.Ru: Speech corpus for Russian children with atypical development,” Lecture Notes in Computer Science, vol. 11658, pp. 299-308, Jul. 2019.
[50] E. Schopler, R. J. Reichler, R. F. DeVellis, and K. Daly, “Toward objective classification of childhood autism: Childhood Autism Rating Scale (CARS),” Journal of Autism and Developmental Disorders, vol. 10, no. 1, pp. 91-103, Mar. 1980.
[51] N. Roy, S. L. Nissen, C. Dromey, and S. Sapir, “Articulatory changes in muscle tension dysphonia: Evidence of vowel space expansion following manual circumlaryngeal therapy,” Journal of Communication Disorders, vol. 42, no. 2, pp. 124-135, Mar.-Apr. 2009.
[52] E. Barnes, J. Roberts, S. H. Long, G. E. Martin, M. C. Berni, K. C. Mandulak, and J. Sideris, “Phonological accuracy and intelligibility in connected speech of boys with fragile X syndrome or Down syndrome,” Journal of Speech, Language, and Hearing Research, vol. 52, no. 4, pp. 1048-1061, Aug. 2009.
[53] E. Lyakso and O. Frolova, “Early Development Indicators Predict Speech Features of Autistic Children,” in Companion Publication of the 2020 International Conference on Multimodal Interaction (ICMI ’20 Companion), virtual event, Netherlands. ACM, New York, NY, USA, 2020, pp.514-521, Des. 2020.
[54] D. N. Goli, F. S. Moniri, and R. Z. Wilhelm, “Intellectual disability in children; a systematic review,” International Archives of Health Science, vol. 33, no. 2, pp. 27-36, Jun. 2016.
[55] P. K. Maulik, M. N. Mascarenhas, C. D. Mathers, T. Dua, and S. Saxena, “Prevalence of intellectual disability: a meta-analysis of population-based studies,” Research in developmental disabilities, vol. 32, no. 2, pp. 419–436, Mar-Apr. 2011.
[56] H. D. Pratt and D. E. Greydanus, “Intellectual disability (mental retardation) in children and adolescents,” Primary Care: Clinics in Office Practice, vol. 34, no. 2, pp. 375-386, Jun, 2007.
[57] A. P. Kaiser, P. P. Hester, and A. S. McDuffie, “Supporting communication in young children with developmental disabilities,” Mental Retardation and Developmental Disabilities Research Reviews, vol. 7, no. 2, pp. 143–150, May 2001.
[58] B. Facon, T. Facon-Bollengier, and J. Grubar, “Chronological age, receptive vocabulary and syntax comprehension in children and adolescents with mental retardation,” American Journal of Mental Retardation, vol. 107, no. 2, pp. 91-98, Mar. 2002.
[59] A. Ypsilanti and G. Grouios, “Linguistic profile of individuals with Down syndrome: comparing the linguistic performance of three developmental disorders, Child Neuropsychology, vol. 14, no. 2, pp. 148-70, Feb. 2008.
[60] K. Polišenská, S. Kapalková, and M. Novotková, “Receptive language skills in Slovak-speaking children with intellectual disability: Understanding words, sentences, and stories,” Journal of Speech, Language, and Hearing Research, vol. 61, no. 7, pp. 1731-1742, Jul. 2018.
[61] M. van der Schuit, E. Segers, and H. van Balkom, L. Verhoeven, “How cognitive factors affect language development in children with intellectual disabilities,” Research in Developmental Disabilities, vol. 32, no. 5, pp. 1884-1894, Sep.-Oct. 2011.