USC

University of Southern California

Viterbi School of Engineering

Speech Analysis And Interpretation Laboratory

Research

 

PROJECTS

DESCRIPTIONS

Human-like Speech Processing

  • New directions in speech recognition through a Multidisciplinary University Research Initiative (MURI) (project abstract)
  • Project Sponsor: Office of Naval Research (ONR)
  • Project Team:
    • University of Washington: Jeff Bilmes, Katrin Kirchoff
    • Stanford University: Dan Jurafsky, Chris Manning
    • University of Southern California: Dani Byrd, Shrikanth Narayanan

Dynamics of Vocal Tract Shaping

  • Novel methods for studying human speech production using realtime magnetic resonance imaging (project abstract)
  • Project Sponsor: National Institutes of Health/NIDCD
  • Project Team:
    • Dani Byrd, Sungbok Lee, Richard Leahy, Krishna Nayak, Shrikanth Narayanan (PI)

Training Superiority

  • Rapid Development of Mission-Oriented Communication Skills (project abstract)
  • Project Sponsor: DARPA/ONR
  • Faculty Collaborators
    • PI : Lewis Johnson
    • co-PIs : Dr. Eva Baker (UCLA CRESST), Dr. Ulf Hermjakob (USC/ISI), Dr. Edward Hovy (USC/ISI), COL Stephen LaRocca (US Military Academy), Ron Laughery (Micro Analysis and Design), Dr. Chistoph von der Malsburg (USC/LCBV), Dr. Stacy Marsella (USC/ISI), Dr. Shrikanth Narayanan (USC/IMSC), Hartmut Neven (Eyematic Interfaces), Dr. Harry O'Neil (USC Rossier School)

USC Transonic Solutions

http://sail.usc.edu/transonics

  • Enabling Human-Human Communication via Automated Two-way Speech-to-Speech Language Translation for critial domains such as medical triage (project abstract)
  • Initial Target Languages: English, Farsi
  • Project Sponsor: DARPA
  • Faculty Collaborators: Kevin Knight (ISI), Daniel Marcu (ISI), David Traum (ICT)
  • Industry Partner: HRL Labs, Malibu, CA

Content-based approach to Indexing, Query and
Retrieval of Music

http://sail.usc.edu/music

  • Through signal processing and knowledge-based methods (project abstract)
  • Project Sponsor: NSF-ITR
  • Faculty Collaborators: Elaine Chew (Industrial&Systems Engineering), C. C.  JayKuo (EE-Systems)

Toward natural child machine communication

http://sail.usc.edu/chimp

  • Spoken Language Interactions in Preschoolers: bridging linguistic, social, and technological challenges  (project abstract)
  • Project Sponsor: Zumberge Interdisciplinary Grant
  • Faculty Collaborators:  Elaine Andersen (Neuroscience/Psychology/Linguistics), Dani Byrd (Linguistics), Margaret McLaughlin (Annenberg School for Communication)

Prosody and Articulatory Dynamics in Spoken
Language

  • (project abstract)
  • Project Sponsor: NIH-R01
  • Faculty Collaborators:   Dani Byrd (Linguistics, PI), Elliot Saltzman (Boston University)

Robust Speech Processing for Immersive Interactions

  • Mission Rehearsal Exercise Project   (project abstract)
  • Project Sponsor: US Army/STRICOM
  • Faculty Collaborators:   Institute for Creative Technologies MRE Team - especially the Natural Language Processing Group:  Ed Hovy (ISI), Lewis Johnson (ISI), Kevin Knight (ISI), David Traum (ICT)

Automated Synthesis of Expressive Speech for
Military Training

  • (project abstract)
  • Project Sponsor: US Army/STRICOM
  • Faculty Collaborators:  Lewis Johnson (ISI)

Modeling and optimizing user-centric mixed-initiative
spoken dialog systems 

http://sail.usc.edu/dialog