EE519
Speech Recognition and Processing for Multimedia

Spring 2017



Time: Fridays, 9:00am - 11:50am
Location: OHE 132

Instructors: Prof. Shri Narayanan
Office: EEB 430
Office Hours: Wednesday 10:30am - 12:00pm (and upon request)
E-mail: shri@sipi.usc.edu

Teaching Assistant: Manoj Kumar
Office: RTH 318
Office Hours: Tuesday 3:00pm - 5:00pm
E-mail: prabakar@usc.edu

Midterm: Friday, March 10, 9am - 11am (location TBA)
Final: Friday, May 5, 8am - 10am (location TBA)

Course Materials: Lecture notes, additional reading materials, assignments and grades will be posted in USC DEN. Use your USC email address and password to log in.

Pre-requisites: Digital Signal Processing (EE483 or equivalent). Some knowledge of probability (EE503) desired. Familiarity with MATLAB will be useful for homework assignments.

Reference Texts: Lecture notes will be provided for most topics. In addition,
R&S: Rabiner and Schafer: Theory and Applications of Digital Speech Processing, Prentice Hall, 2010. (Required text).
HAH: Huang, Acero, and Hon: Spoken Language Processing, Prentice Hall, 2001. (Required text).
R&J: Rabiner and Juang: Fundamentals of Speech Recognition, Prentice Hall, 1993.
DHP: Deller, Hansen, and Proakis: Discrete-time Processing of Speech Signals, 2000.
TQ: T. Quatieri: Discrete-time Speech Signal Processing, Prentice Hall, 2001.

Course Timeline (approximate)(Reading from R&S):
Week 1 (Jan. 13): Course Introduction & Speech Production. (Chp 1, 2, 3)
Week 2 (Jan. 20): Acoustic Speech Models & Short-time Time Domain Processing.(Chp 5,6)
Week 3 (Jan. 27): Time Domain Processing & Short-time Fourier Transform (part 1). (Chp 6, 7)
Week 4 (Feb. 3): Short-time Fourier Transform (part 2) & Applications. (Chp 7)
Week 5 (Feb. 10): Homomorphic Signal Processing & Cepstral Analysis. (Chp 8)
Week 6 (Feb. 17): Linear Prediction (part 1) (Chp 9)
Week 7 (Feb. 24): Linear Prediction (part 2). (Chp 9)
Week 8 (Mar. 3): Auditory Models (Chp 4)
Week 9 (Mar. 10): Midterm. 9am - 11am (location TBA)
Week 10 (Mar. 17): Spring Break
Week 11 (Mar. 24): Speech Coding. (Chp 11, 12)
Week 12 (Mar. 31): Automatic Speech Recognition (ASR). (Chp 14)
Week 13 (Apr. 7): Automatic Speech Recognition (ASR). (Chp 14)
Week 14 (Apr. 14): Speech enhancement, other related pattern recognition applications (biometrics, emotion recognition, etc.)
Week 15 (Apr. 21): Text-to- Speech, Speech Synthesis. (Chp 13)
Week 16 (Apr. 28): Speech Synthesis; Course Wrap up. (Chp 13)
Week 17 (May 5): Final, 8am - 10am (location TBA)

Homework Schedule:(approximate)
Out Due Topics
HW1 Jan 13 Jan 27 Week 1,2
HW2 Jan 27 Feb 10 Week 3,4
HW3 Feb 10 Feb 24 Week 5,6 (Midterm: Mar 10)
HW4 Mar 17 Mar 31 Week 7-11 (Spring break: Mar 12-19)
HW5 Mar 31 Apr 14 Week 12,13 (Finals: May 5)

Statement for Students with Disabilities
Any student requesting academic accommodations based on a disability is required to register with Disability Services and Programs (DSP) each semester. A letter of verification for approved accommodations can be obtained from DSP. Please be sure the letter is delivered to me (or to TA) as early in the semester as possible. DSP is located in GFS 120. The phone number for DSP is (213) 740-0776.

Statement on Academic Integrity
USC seeks to maintain an optimal learning environment. General principles of academic honesty include the concept of respect for the intellectual property of others, the expectation that individual work will be submitted unless otherwise allowed by an instructor, and the obligations both to protect one's own academic work from misuse by others as well as to avoid using another's work as one's own. All students are expected to understand and abide by these principles. Scampus, the Student Guidebook, contains the Student Conduct Code:
http://scampus.usc.edu/
Students will be referred to the Office of Student Judicial Affairs and Community Standards for further review, should there be any suspicion of academic dishonesty. The Review process can be found at:
http://www.usc.edu/student-affairs/SJACS/

Emergency Preparedness/Course Continuity in a Crisis
In case of a declared emergency if travel to campus is not feasible, USC executive leadership will announce an electronic way for instructors to teach students in their residence halls or homes using a combination of Blackboard, teleconferencing, and other technologies.