Alumni

Graduation: 2024
Currently: SAIL Post-Doc
Homepage

Thesis: Generative Foundation Model Assisted Privacy-Enhancing Computing in Human-Centered Machine Intelligence

Graduation: 2023
Currently: Amazon
Homepage

Thesis: Spoken Language Processing in Low Resource Scenarios with Applications in Automated Behavioral Coding

Graduation: 2023
Currently: Amazon
Homepage

Thesis: Establishing cross-modal correspondence for media understanding

Graduation: 2022
Currently: Apple
Homepage

Thesis: Extracting and Using Speaker Role Information in Speech Processing Applications

Graduation: 2022
Currently: Amazon Music
Homepage

Thesis: Creating Cross-Modal, Context-Aware Representations of Music for Downstream Tasks

Graduation: 2022
Currently: Amazon
Homepage

Thesis: Neural Representation Techniques for Robust and Fair Speaker Recognition

Graduation: 2022
Currently: Amazon
Homepage

Thesis: Modeling and Regulating Human Interaction with Control Affine Dynamical Systems

Graduation: 2021
Currently: Amazon
Homepage

Thesis: Learning Multi-Annotator Subjective Label Embeddings

Graduation: 2021
Currently: Interactions LLC
Homepage

Thesis: Improving Language Understanding and Summarization by Leveraging Auxiliary Information Through Self-Supervised or Unsupervised Learning

Graduation: 2021
Currently: Google Research
Homepage

Thesis: Learning Shared Subspaces across Multiple Views and Modalities

Graduation: 2021
Currently: Apple
Homepage

Thesis: Computational Narrative Models of Character Representations to Estimate Audience Perception

Graduation: 2021
Currently: IBM
Homepage

Thesis: Understanding Sources of Variability in Learning Robust Deep Audio Representations

Graduation: 2021
Currently: NVIDIA
Linkedin

Thesis: Multimodal and Self-guided Clustering Approaches Toward Context Aware Speaker Diarization

Graduation: 2020
Currently: Amazon

Thesis: Speech Recognition Error Modeling for Robust Speech Processing and Natural Language Understanding Applications

Graduation: 2020
Currently: Amazon
Homepage

Thesis: Context-aware Models for Understanding and Supporting Spoken Interactions with Children

Graduation: 2020
Currently: Amazon
Homepage

Thesis: Computational Modeling of Behavioral Attributes in Conversational Dyadic Interactions

Graduation: 2020
Currently: Amazon AWS AI
Homepage

Thesis: Behavior Understanding from Speech under Constrained Conditions ---- Exploring sparse networks, transfer and unsupervised learning

Graduation: 2020
Currently: Intel Labs
Homepage

Thesis: Human Behavior Understanding from Language through Unsupervised Modeling

Graduation: 2020
Currently: Post-doc at CU Boulder
Homepage

Thesis: Improving Modeling of Human Experience and Behavior: Methods for Enhancing the Quality of Human-produced Data and Annotations of Subjective Constructs

Graduation: 2020
yongwanl at usc.edu
Currently: Research Scientist at USC
Homepage

Thesis: Improved Real-Time MRI of Speech Production

Graduation: 2020
Currently: Cobalt Speech
Linkedin

Thesis: Dynamics of Speech Tasks and Articulator Synergies

Graduation: 2020
Currently: Amazon
Linkedin

Thesis: Noise Aware Methods for Robust Speech Processing Applications

Graduation: 2019
Currently: Amazon Alexa
Linkedin

Thesis: Generating Psycholinguistic Norms and Applications

Graduation: 2019
Currently: Microsoft
Homepage

Thesis: Interaction Dynamics and Coordination for Behavioral Analysis in Dyadic Conversations

Graduation: 2019
Currently: Amazon Alexa AI
Homepage

Thesis: Computational Models for Multidimensional Annotations of Affect

Graduation: 2019
Currently: Amazon
Linkedin

Thesis: Matrix Factorization for Noise-Robust Representation of Speech Data

Graduation: 2018
Currently: Apple

Thesis: Efficient Estimation and Discriminative Training for the Total Variability Model

Graduation: 2018
Currently: Amazon
Linkedin

Thesis: Toward Robust Affective Learning from Speech Signals Based on Deep Learning Techniques

Graduation: 2018
Currently: Apple
Homepage

Thesis: Weighted factor automata: A finite-state framework for spoken content retrieval

Graduation: 2018
Currently: Uniphore
Linkedin

Thesis: Machine learning paradigms for behavioral coding

Graduation: 2017
Currently: Asst. Prof. at Texas A&M
Homepage

Thesis: Knowledge-Driven Representations of Physiological Signals: Developing Measurable Indices of Non-Observable Behavior

Graduation: 2017
Currently: Facebook
Homepage

Thesis: Analysis and modeling of multi-level dynamics of multimodal behavior in affective human interactions

Graduation: 2016
Currently: Disney Research
Homepage

Thesis: Exploiting Latent Reliability Information for Classification Tasks

Graduation: 2016
Currently: Amazon Alexa
Homepage

Thesis: Computational methods for modeling nonverbal communication in human interaction

Graduation: 2016
Currently: Amazon Alexa
Linkedin

Thesis: Computational modeling of human interaction behavior towards clinical translation in autism spectrum disorder

Graduation: 2016
Currently: Amazon
Homepage

Thesis: Modeling expert assessment of empathy through multimodal signal cues

Graduation: 2015
Currently: Amazon Alexa
Homepage

Thesis: Emotional speech production: from data to computational models and applications

Graduation: 2014
Currently: Educational Testing Service (ETS) Research
Homepage

Thesis: Toward understanding speech planning by observing its execution-representations, modeling and analysis

Graduation: 2014
Currently: Stanford Research Institute (SRI)
Homepage

Thesis: Enhancing Speech to Speech translation through exploitation of bilingual resources and paralinguistic information.

Graduation: 2014
Currently: Google
Linkedin

Thesis: A computational framework for diversity in ensembles of humans and machine systems

Graduation: 2014
Currently: Worcester Polytechnic Institute
Homepage

Thesis: Structure and Function in Speech Production

Graduation: 2013
Currently: Assoc. Prof. at Duke Kunshan University
Homepage

Thesis: Representation, Classification and Information Fusion for Robust and Efficient Multimodal Human State Recognition

Graduation: 2013
Currently: Amazon
Homepage

Thesis: Multimodality, Context and Continuous Dynamics for Recognition and Analysis of Emotional States, and Applications in Healthcare

Graduation: 2013
Currently: Microsoft
Homepage

Thesis: Novel variations of sparse representation techniques with applications

Graduation: 2013
Currently: Prof. at Univeristy of St. Thomas
Homepage

Thesis: Natural Language Description of Emotion

Graduation: 2012
Currently: National Tsing Hua University
Homepage

Thesis: Behavioral Signal Processing: Computational Approaches for Modeling and Quantifying Interaction Dynamics in Dyadic Human Interactions

Graduation: 2012
Currently: Mercury Insurance
Linkedin

Thesis: Automatic Quantification and Prediction of Human Subjective Judgements in Behavaioral Signal Processing

Graduation: 2011
Currently: Amazon Alexa
Linkedin

Thesis: Statistical Inference for Dynamical, Interacting Multi-Object Sysetms with Emphasis on Human Small Group Interactions

Graduation: 2011
Currently: NASA Jet Propulsion Laboratory (JPL)
Homepage

Thesis: Recognition and Characterization of Unstructured Environmental Sounds

Graduation: 2011
Currently: Philips Research
Homepage

Thesis: Visualizing and Modeling Vocal Production Dynamics

Graduation: 2011
Currently: Assoc. Prof. at Indian Institute of Science (IISc), Bangalore
Homepage

Thesis: A computational Framework for Exploring the Role of Speech Production in Speech Processing from a Communication Perspective

Graduation: 2010
Currently: Assoc. Prof. at University of Michigan
Homepage

Thesis: Emotions in Engineering: Methods for the Interpretation of Ambiguous Emotional Content

Graduation: 2010
Currently: Hulu
Linkedin

Thesis: Concept Classification with Application to Speech-to-Speech Translation

Graduation: 2009
Currently: ASAPP
Linkedin

Thesis: Robust Speaker Clustering Under Variation in Data Characteristics

Graduation: 2009
Currently: Sensory, Inc.
Linkedin

Thesis: Hierarchical Methods in Automatic Pronunciaion Evaluation

Graduation: 2009
Currently: Facebook
Homepage

Thesis: Biologically Insipred Auditory Attention Models with Applications in Speech and Audio Processing

Graduation: 2009
Currently: Canary Speech
Linkedin

Thesis: Contextual modeling of audio signals toward information retrieval

Graduation: 2008
Currently: Prof. at University of Chile, Santiago
Homepage

Thesis: On Optimal Signal Representation for Statistical Learning and Pattern Recognition

Graduation: 2008
Currently: Google
Linkedin

Thesis: Speech Enhancement and Intelligibility Modeling in Cochlear Implants

Graduation: 2008
Currently: Prof. at University of Texas at Dallas
Homepage

Thesis: Multimodal Analysis of Expressive Human Communication: Speech and Gesture Interplay

Graduation: 2008
Currently: ASELSAN
Linkedin

Thesis: Music Information Retrieval: Robust Performance under the Effect of Uncertainty

Graduation: 2008
Currently: Amazon Alexa AI
Linkedin

Thesis: Categorical Prosody Models for Spoken Language Applications

Graduation: 2008
Currently: Amazon Lab126
Linkedin

Thesis: Data-driven methods in description-based approaches to audio information processing

Graduation: 2008
Currently: Apple
Linkedin

Thesis: Enriching Spoken Language Processing: Representation and Modeling of Spurasegmental Events

Graduation: 2007
Currently: Founder/CEO at CMSK
Linkedin

Thesis: Robust Acoustic Source Localization in Sensor Networks

Graduation: 2007
Currently: Samsung Research
Linkedin

Thesis: User Modeling for Human-Machine Spoken Interaction and Mediation Systems

Graduation: 2007
Currently: Amazon
Linkedin

Thesis: Active Data Acquisition for Building Models for language Processing

Graduation: 2007
Currently: Philips Research
Linkedin

Thesis: Emotional Speech Resynthesis

Graduation: 2006
Currently: Alert Logic
Linkedin

Thesis: A study of meta-linguistic features in spontaneous speech processing

Graduation: 2006
Currently: Prof. at Adana Science and Technology University
Linkedin

Thesis: Towards Natural Child-Computer Interaction: Recognizing Spoken Communicative Styles

Graduation: 2005
Currently: Prof. at Sejong University
Homepage

Thesis: A Study of Unsupervised Speaker Indexing

Graduation: 2005
Currently: Acer
Linkedin

Thesis: Statistical Humming Recognition and Theme Finder for Query by Humming Systems

Graduation: 2003
Currently: Qualcomm Research India
Linkedin

Thesis: Compression algorithms for distributed classification with applications to distributed speech recognition

Graduation: 2004
Currently: Daum Kakao
Linkedin

Thesis: Recognizing emotions from spoken dialogs: a signal processing approach

Scott Millward

User Interfaces

(co-advised by Krishna Nayak)
Imaging

Email: jfnielse at umich.edu
Time in SAIL: 2005 – 2007
Currently: Assistant Research Scientist
Homepage>>

Panayiotis Georgiou

Speech/Audio Processing

Email: georgiou at sipi.usc.edu
Time in SAIL: 2002-2013
Currently: Assistant Professor, USC
Homepage>>

Speech Recognition

Email: gerosa at fbk.eu
Time in SAIL: 2006 – 2007
Currently: Project Manager, FBK
Homepage>>

Carlos Busso

Multimodal Signal Processing

Email: busso at utdallas.edu
Time in SAIL: 2008-2009
Currently: University of Dallas
Homepage>>

(co-advised by Gayla Margolin)
Behavioral Signal Processing

Email: brian.baucom at psych.utah.edu
Time in SAIL: 2010 – 2012
Currently: Assistant Prof., University of Utah
Homepage>>

Speech Production

Email: michael.proctor at mq.edu.au
Time in SAIL: 2009-2012
Currently: Macquerie University
Homepage>>

Emotions Research

Email: emilykmp@umich.edu
Time in SAIL: 2010
Currently: Assistant Prof., University of Michigan
Homepage>>

(co-advised by Krishna Nayak)
Imaging Research

Email: yoonckim at usc.edu
Time in SAIL: 2010-2014
Currently: Viterbi School of Engineering
Homepage>>

Email: nkatsam@cs.ntua.gr
Time in SAIL: 2009 – 2012
Currently: National Technical University of Athens
Homepage>>

Robust Speech Processing

Email: maarten at sipi.usc.edu
Time in SAIL: 2012-2015
Currently: Qualcomm
Homepage>>

Multimodal Signal Processing/multimedia informatics

Email: tanayaguha at gmail.com
Time in SAIL: 2013 – 2015
Currently: IIT Kanpur
Homepage>>

Email: younear at gmail.com
Time in SAIL: 2015-2016
Currently: Agency for Defense Development (in Seoul)

Email: toger at usc.edu
Time in SAIL: 2015-2016

Email: dbone at usc.edu
Time in SAIL: 2009-2017

EEB 427
Phone: (213) 740-4148
toutios at sipi.usc.edu
Homepage

benjamin.girault at usc.edu
Homepage

EEB 413
michellehasan.2 at gmail.com
Homepage

RTH 320
monisankha.pal at gmail.com
Homepage

Served SAIL and USC with professionalism, love and care for 13 years since passing away in 2014. Greatly missed by all.