Code

  • A Python implementation of Information-Bottleneck based (IB) toolkit audio speaker diarization
  • Robust and recursive speech-to-text alignment for long audio sessions (link)
  • DNN-based Automatic Speech Recognition (ASR) Models for children speech (link)


Publications

copyright notice
The documents distributed here have been provided as a means to ensure timely dissemination of scholarly and technical work on a noncommercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

2023
papers in conference proceedings
  • Rimita Lahiri, Md Nasir, Catherine Lord, So Hyun Kim, Shrikanth Narayanan, "A Context-Aware Computational Approach for Measuring Vocal Entrainment in Dyadic Conversations", ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), vol. , no. , pp. 1-5, 2023.



2022
journal articles
  • Prashanth Gurunath Shivakumar, Shrikanth Narayanan, "End-to-End Neural Systems for Automatic Children Speech Recognition: An Empirical Study", Computer Speech and Language. 72:101289, 2022.
  • Prashanth Gurunath Shivakumar, Somer Bishop, Catherine Lord, Shrikanth Narayanan, "Phone duration modeling for speaker age estimation in children", The Journal of the Acoustical Society of America, Acoustical Society of America, vol. 152, no. 5, pp. 3000-3009, 2022.
  • Elizabeth P. McKernan, Manoj Kumar, Adriana Di Martino, Lisa Shulman, Alexander Kolevzon, Catherine Lord, Shrikanth Narayanan, So Hyun Kim, "Intra-topic Latency as an Automated Behavioral Marker of Treatment Response in Autism Spectrum Disorder.", Scientific Reports, 2022.
  • Rimita Lahiri, Md Nasir, Manoj Kumar, So Hyun Kim, Somer Bishop, Catherine Lord, Shrikanth Narayanan, "Interpersonal synchrony across vocal and lexical modalities in interactions involving children with autism spectrum disorder", JASA Express Letters, 2022.
  • Zane Durante, Victor Ardulov, Manoj Kumar, Jennifer Gongola, Thomas Lyon, Shrikanth Narayanan, "Causal indicators for assessing the truthfulness of child speech in forensic interviews.", Computer Speech and Language. 71:101263, 2022.


2021
journal articles
  • Aaron Shield, Xin Wang, Daniel Bone, Shrikanth Narayanan, Ruth Grossman, "Conversational Correlates of Rapid Social Judgments of Children and Adoloscents with and without ASD.", Clinical Linguistics and Phonetics. 35(2), 172-184, 2021.
  • Monisankha Pal, Manoj Kumar, Raghuveer Peri, Tae Jin Park, So Hyun Kim, Catherine Lord, Somer Bishop, Shrikanth Narayanan, "Meta-Learning with Latent Space Clustering in Generative Adversarial Network for Speaker Diarization.", IEEE/ACM Transactions on Audio, Speech and Language Processing. 29:1204-1219, 2021.
  • Victor Ardulov, Victor R Martinez, Krishna Somandepalli, Shuting Zheng, Emma Salzman, Catherine Lord, Somer Bishop, Shrikanth Narayanan, "Robust Diagnostic Classification and Policies via Q-Learning", Scientific Reports 11, 11730 (Nature Publishing Group), 2021.
papers in conference proceedings
  • Young-Kyung Kim, Rimita Lahiri, Md Nasir, So Hyun Kim, Somer Bishop, Catherine Lord, Shrikanth Narayanan, "Analyzing short term dynamic speech features for understanding behavioral traits of children with autism spectrum disorder", In Proceedings of Interspeech, 2021.
  • Suchitra Krishnamachari, Manoj Kumar, So Hyun Kim, Catherine Lord, Shrikanth Narayanan, "Developing Neural Representations for Robust Child-Adult Diarization", In proceedings of IEEE Spoken Language Technology Workshop, 2021.
  • Gurunath Prashanth Sivakumar, Naveen Kumar, Panayiotis Georgiou, Shrikanth Narayanan, "RNN Based Incremental Online Spoken Language Understanding", In proceedings of IEEE Spoken Language Technology Workshop, 2021.


2020
journal articles
  • Manoj Kumar, So Hyun Kim, Catherine Lord, Shrikanth Narayanan, "Improving Speaker Diarization for Naturalistic Child-Adult Conversational Interactions using Contextual Information", The Journal of the Acoustical Society of America, 2020.
  • Manoj Kumar, So Hyun Kim, Catherine Lord, Thomas D Lyon, Shrikanth Narayanan, "Leveraging Linguistic Context in Dyadic Interactions to Improve Automatic Speech Recognition for Children", Computer Speech and Language. 63, 2020.
papers in conference proceedings
  • Nithin Rao Koluguri, Manoj Kumar, So Hyun Kim, Catherine Lord, Shrikanth Narayanan, "Meta-learning for Robust Child-Adult Classification from Speech", In Proceedings of ICASSP, 2020.
  • Rimita Lahiri, Manoj Kumar, Somer Bishop, Shrikanth Narayanan, "Learning Domain Invariant Representations for Child-Adult Classification from Speechbooktitle=In Proceedings of ICASSP", 2020.
  • Monisankha Pal, Manoj Kumar, Raghuveer Peri, Tae Jin Park, So Hyun Kim Kim, Catherine Lord, Somer Bishop, Shrikanth Narayanan, "Speaker Clustering using Latent Space Clustering in Generative Adversarial Network", In Proceedings of ICASSP, 2020.


2019
journal articles
  • Emily Zane, Zhaojun Yang, Lucia Pozzan, Tanaya Guha, Shrikanth Narayanan, Ruth Bergida Grossman, "Motion-Capture Patterns of Voluntarily Mimicked Dynamic Facial Expressions in Children and Adolescents With and Without ASD", Journal of Autism and Developmental Disorders, vol. 49, no. 3, pp. 1062-1079, 2019.
  • Tanner Sorensen, Emily Zane, Tiantian Feng, Shrikanth Narayanan, Ruth Grossman, "cross-Modal coordination of face-Directed Gaze and emotional Speech production in School-Aged children and Adolescents with ASD", Scientific Reports, Nature Publishing Group, vol. 9, no. 1, pp. 1-11, 2019.
papers in conference proceedings
  • Tanner Sorensen, Emily Zane, Tiantian Feng, Shrikanth Narayanan, Ruth Grossman, "Cross-Modal Coordination of Face-Directed Gaze and Emotional Speech Production in Adolescents with ASD", International Society of Autism Research (INSAR) Annual Meeting, 2019.
  • Manoj Kumar, Karan Singla, Gabrielle Gunn, Catherine Lord, So-Hyun Kim, Shrikanth Narayanan, "Robustness Analysis for Computational Speech Features during Naturalistic Clinician-Child Interactions", International Society of Autism Research (INSAR) Annual Meeting, 2019.


2018
journal articles
  • Victor Ardulov, Manoj Kumar, Shanna Williams, Thomas Lyon, Shrikanth Narayanan, "Measuring Conversational Productivity in Child Forensic Interviews", arXiv preprint arXiv:1806.03357, 2018.
papers in conference proceedings
  • Manoj Kumar, Pooja Chebolu, So Hyun Kim, Kassandra Martinez, Catherine Lord, Shrikanth Narayanan, "A Knowledge Driven Structural Segmentation Approach for Play-Talk Classification During Autism Assessment", In Proceedings of Interspeech, 2018.
  • Manoj Kumar, Pavlos Pavlos Papadopoulos, Ruchir Travadi, Daniel Bone, Shrikanth Narayanan, "IMPROVING SEMI-SUPERVISED CLASSIFICATION FOR LOW-RESOURCE SPEECH INTERACTION APPLICATIONS", In Proceedings of ICASSP, 2018.
  • Victor Ardulov, Madelyn Mendlen, Manoj Kumar, Neha Anand, Shanna Williams, Thomas Lyon, Shrikanth Narayanan, "Multimodal Interaction Modeling of Child Forensic Interviewing", Proceedings of the 2018 on International Conference on Multimodal Interaction, pp. 179-185, 2018.


2017
journal articles
  • Daniel Bone, Chi-Chun Lee, Theodora Chaspari, James Gibson, Shrikanth Narayanan, "Signal Processing and Machine Learning for Mental Health Research and Clinical Applications", IEEE Signal Processing Magazine, vol. 34, no. 5, pp. 189-196, 2017.
  • Daniel Bone, Theodora Chaspari, Shrikanth Narayanan, "Behavioral signal processing and autism", Autism Imaging and Devices, CRC Press, vol. , no. , pp. 319, 2017.
papers in conference proceedings
  • Manoj Kumar, Daniel Bone, Kelly McWilliams, Shanna Williams, Thomas Lyon, Shrikanth Narayanan, "Multi-scale Context Adaptation for Improving Child Automatic Speech Recognition in Child-Adult Spoken Interactions", In Proceedings of Interspeech, 2017.
  • Daniel Bone, Julia Mertens, Emily Zane, Sungbok Lee, Shrikanth Narayanan, Ruth Grossman, "Acoustic-Prosodic and Physiological Response to Stressful Interactions in Children with Autism Spectrum Disorder", In Proceedings of Interspeech, 2017.


2016
journal articles
  • Daniel Bone, Somer Bishop, Matthew P. Black, Matthew Goodwin, Catherine Lord, Shrikanth S. Narayanan, "Use of Machine Learning to Improve Autism Screening and Diagnostic Instruments: Effectiveness, Efficiency, and Multi-Instrument Fusion", The Journal of Child Psychology and Psychiatry, vol. 57, no. 8, pp. 927-937, 2016.
  • Clara M. Lajonchere, Barbara Y. Wheeler, Thomas W. Valente, Cary Kreutzer, Aron Munson, Shrikanth S. Narayanan, Abe Kazemzadeh, Roxana Cruz, Irene Martinez, Sheree M. Schrager, Lisa Schweitzer, Tara Chklovski, Darryl Hwang, "Strategies for Disseminating Information on Biomedical Research on Autism to Hispanic Parents", Journal of Autism and Developmental Disorders, vol. 46, no. 3, pp. 1038-1050, 2016.
  • Rahul Gupta, Daniel Bone, Sungbok Lee, Shrikanth S. Narayanan, "Analysis of engagement behavior in children during dyadic interactions using prosodic cues", Computer, Speech, and Language, vol. 37, no. 47–66, 2016.
  • Tanaya Guha, Zhaojun Yang, Ruth Grossman, Shrikanth S. Narayanan, "A Computational Study of Expressive Facial Dynamics in Children with Autism", IEEE Transactions on Affective Computing, 2016.
papers in conference proceedings
  • Manoj Kumar, Rahul Gupta, Daniel Bone, Nikolaos Malandrakis, Somer Bishop, Shrikanth S. Narayanan, "Objective Language Feature Analysis in Children with Neurodevelopmental Disorders During Autism Assessment", Proceedings of Interspeech, 2016.
  • Daniel Bone, Somer Bishop, Rahul Gupta, Sungbok Lee, Shrikanth Narayanan, "Acoustic-Prosodic and Turn-taking Features in Interactions with Children with Neurodevelopmental Disorders", 2016.
  • Daniel Bone, Somer Bishop, Rahul Gupta, Sungbok Lee, Shrikanth S. Narayanan, "Acoustic-Prosodic and Turn-Taking Features in Interactions with Children with Neurodevelopmental Disorders", Proceedings of Interspeech, 2016.


2015
journal articles
  • Daniel Bone, Matthew Goodwin, Matthew P. Black, Chi-Chun Lee, Kartik Audhkhasi, Shrikanth S. Narayanan, "Applying Machine Learning to Facilitate Autism Diagnostics: Pitfalls and promises", Journal of Autism and Developmental Disorders, vol. 45, no. 5, pp. 1121-1136, 2015.
papers in conference proceedings
  • Daniel Bone, Matthew P. Black, Anil Ramakrishna, Ruth Grossman, Shrikanth S. Narayanan, "Acoustic-Prosodic Correlates of ‘Awkward’ Prosody in Story Retellings from Adolescents with Autism", Proceedings of Interspeech, 2015.
  • Tanaya Guha, Zhaojun Yang, Anil Ramakrishna, Ruth Grossman, Darren Hedley, Sungbok Lee, Shrikanth S. Narayanan, "ON QUANTIFYING FACIAL EXPRESSION-RELATED ATYPICALITY OF CHILDREN WITH AUTISM SPECTRUM DISORDER", Proceedings of IEEE International Conference on Audio, Speech and Signal Processing (ICASSP), 2015.


2014
journal articles
  • Daniel Bone, Matthew Black, Chi-Chun Lee, Marian Williams, Pat Levitt, Sungbok Lee, Shrikanth S. Narayanan, "The Psychologist as an Interlocutor in Autism Spectrum Disorder Assessment: Insights from a Study of Spontaneous Prosody", Journal of Speech, Language, and Hearing Research, vol. 57, pp. 1162–1177, 2014.
  • Daniel Bone, Chi-Chun Lee, Shrikanth S. Narayanan, "Robust Unsupervised Arousal Rating: A rule-based framework with knowledge-inspired vocal features", IEEE Transactions on Affective Computing, 2014.
  • Daniel Bone, Matthew Goodwin, Matthew Black, Chi-Chun Lee, Kartik Audhkhasi, Shrikanth S. Narayanan, "Applying Machine Learning to Facilitate Autism Diagnostics: Pitfalls and promises", Journal of Autism and Developmental Disorders, 2014.
papers in conference proceedings
  • Daniel Bone, Chi-Chun Lee, Alexandros Potamianos, Shrikanth Narayanan, "An Investigation of Vocal Arousal Dynamics in Child-Psychologist Interactions using Synchrony Measures and a Conversation-based Model", Proceedings of Interspeech, 2014.
  • Theodora Chaspari, Matthew Goodwin, Oliver Wilder-Smith, Amanda Gulsrud, Charlotte Mucchetti, Connie Kasari, Shrikanth Narayanan, "A Non-Homogeneous Poisson Process Model of Skin Conductance Responses Integrated with Observed Regulatory Behaviors for Autism Intervention", Proceedings of IEEE International Conference on Audio, Speech and Signal Processing (ICASSP), 2014.


2013
journal articles
papers in conference proceedings
  • Daniel Bone, Chi-Chun Lee, Vikram Ramanarayanan, Shrikanth S. Narayanan, Renske S. Hoedemaker, Peter C. Gordon, "Analyzing Eye-Voice Coordination in Rapid Automatized Naming", Proceedings of InterSpeech, 2013.
  • Daniel Bone, Theodora Chaspari, Kartik Audhkhasi, James Gibson, Andreas Tsiartas, Maarten Van Segbroeck, Ming Li, Sungbok Lee, Shrikanth S. Narayanan, "Classifying Language-Related Developmental Disorders from Speech Cues: the Promise and the Potential Confounds", Proceedings of InterSpeech, 2013.
  • Daniel Bone, Chi-Chun Lee, Theodora Chaspari, Matthew P. Black, Marian Williams, Sungbok Lee, Pat Levitt, Shrikanth S. Narayanan, "Acoustic-Prosodic, Turn-taking, and Language Cues in Child-Psychologist Interactions for Varying Social Demand", Proceedings of InterSpeech, 2013.
  • Rahul Gupta, Kartik Audhkhasi, Sungbok Lee, Shrikanth S. Narayanan, "Speech paralinguistic event detection using probabilistic timeseries smoothing and masking", Proceedings of InterSpeech, 2013.
  • Theodora Chaspari, Emily Mower Provost, Shrikanth S. Narayanan, "Analyzing the structure of parent-moderated narratives from children with ASD using an entity-based approach", Proceedings of InterSpeech, 2013.
  • Angeliki Metallinou, Ruth Grossman, Shrikanth S. Narayanan, "Quantifying Atypicality In Affective Facial Expressions Of Children With Autism Spectrum Disorders", Proceedings of the IEEE International Conference on Multimedia & Expo (ICME), 2013.
  • Theodora Chaspari, Daniel Bone, James Gibson, Chi-Chun Lee, Shrikanth S. Narayanan, "Using physiology and language cues for modeling verbal response latencies of children with ASD", International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2013.


2012
papers in conference proceedings
  • Daniel Bone, Matthew P. Black, Chi-Chun Lee, Marian E. Williams, Pat Levitt, Sungbok Lee, Shrikanth S. Narayanan, "Spontaneous-Speech Acoustic-Prosodic Features of Children with Autism and the Interacting Psychologist", Proceedings of InterSpeech, 2012.
  • Theodora Chaspari, Chi-Chun Lee, Shrikanth S. Narayanan, "Interplay between verbal response latency and physiology of children with autism during ECA interactions", Proceedings of InterSpeech, 2012.
  • Daniel Bone, Chi-Chun Lee, Shrikanth S. Narayanan, "A Robust Unsupervised Arousal Rating Framework using Prosody with Cross-Corpora Evaluation", Proceedings of InterSpeech, 2012.
  • Rahul Gupta, Chi-Chun Lee, Daniel Bone, Agata Rozga, Sungbok Lee, Shrikanth S. Narayanan, "Acoustical analysis of engagement behavior in children", Proceedings of Workshop on Child, Computer and Interaction (WOCCI 2012), 2012.
  • Theodora Chaspari, Emily Mower Provost, Athanasios Katsamanis, Shrikanth S. Narayanan, "AN ACOUSTIC ANALYSIS OF SHARED ENJOYMENT IN ECA INTERACTIONS OF CHILDREN WITH AUTISM", Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2012.
  • Rahul Gupta, Chi-Chun Lee, Shrikanth S. Narayanan, "CLASSIFICATION OF EMOTIONAL CONTENT OF SIGHS IN DYADIC HUMAN INTERACTIONS", Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2012.


2011
papers in conference proceedings
  • Matthew P. Black, Daniel Bone, Marian E. Williams, Phillip Gorrindo, Pat Levitt, Shrikanth S. Narayanan, "The USC CARE Corpus: Child-Psychologist Interactions of Children with Autism Spectrum Disorders", Proceedings of Interspeech, Florence, Italy, 2011.
  • Emily Mower, Chi-Chun Lee, James Gibson, Theodora Chaspari, Marian Williams, Shrikanth S. Narayanan, "Analyzing the Nature of ECA Interactions in Children with Autism", Proceedings of Interspeech, Florence, Italy, 2011.
  • Emily Mower, Matthew Black, Elisa Flores, Marian Williams, Shrikanth S. Narayanan, "Design of an Emotionally Targeted Interactive Agent for Children with Autism", Proceedings of IEEE International Conference on Multimedia & Expo (ICME), pp. 1-6, 2011.