1 of 14

Introduction to Speech & Natural Language Processing

Lecture 0

Introducing Course

Krishnendu Ghosh

2 of 14

Course Details

Credit: 1 (1-0-0-0-1)

​

Course: Introduction to Speech and Natural Language Processing

​

Course Type: Elective

​

​

​

3 of 14

Course Overview

​

​

This course gives a high-level introduction to Speech and NLP, focusing on applications, pipelines, and intuition. It covers how machines process speech and text, and how systems like voice assistants and chatbots work. The course emphasizes big-picture understanding with small hands-on examples, without going deep into theory.

​

​

4 of 14

Course Objectives

​

  • Understand what SNLP can do
  • Learn basic speech → text → meaning pipeline
  • Get intuition of speech & text processing
  • Know key components before building models
  • Explore common tasks & applications
  • Build small toy models for practice

​

​

5 of 14

Syllabus

Unit 1: What is SNLP (2 Hours)

​

Speech Processing vs NLP

​

Real-world systems

​

End-to-end pipelines

​

Applications

6 of 14

Syllabus

Unit 2: Basic Speech Processing (4 Hours)

​

Speech Production

​

Spoken Language Processing

​

Speech acquisition

​

Feature extraction

​

Neural speech representation

7 of 14

Syllabus

Unit 3: Basic Text Processing (3 Hours)

​

Pre-processing: Tokenization, Stopwords, Stemming vs Lemmatization

​

N-grams

​

Representations: Bag of Words, TF-IDF, Word2Vec, GloVe

8 of 14

Syllabus

Unit 4: Speech Applications (2 Hours)

​

ASR pipeline

​

Intro to Whisper / wav2vec

​

TTS pipeline

9 of 14

Syllabus

Unit 6: NLP Applications (3 Hours)

​

Text classification, Sentiment analysis

​

POS tagging, Named Entity Recognition (NER), Dependency parsing

​

Semantic ambiguity

​

LLMs

​

Challenges

10 of 14

Text books

Speech and Language Processing – Daniel Jurafsky & James H. Martin (3rd Edition, Draft Available Online)

​

Springer Handbook of Speech Processing - Jacob Benesty, M. Mohan Sondhi, Yiteng Arden Huang

11 of 14

Reference books / Material

Natural Language Processing with Python (NLTK Book) – Steven Bird, Ewan Klein, Edward Loper

​

Spoken Language Processing: A Guide to Theory, Algorithm, and System Development – Xuedong Huang, Alex Acero, Hsiao-Wuen Hon

​

Fundamentals of Speech Recognition – Lawrence Rabiner, Biing-Hwang Juang

​

​

12 of 14

Grading Policy

Theoretical Assignments (2) 20%

Quizzes (12) 36%

End-Term Exam 20%

​

Classroom Notes (12) 10%

Attendance 14% / 7%

13 of 14

Timeline

Theoretical Assignment 1 13/20 May

​

Theoretical Assignment 2 17/24 June

​

Semester Ends 15 July

​

End-Term Exam notified by Dept

14 of 14