ECE 467: Natural Language Processing

• Instructor Info
• Textbook
• Grading
• Schedule

Instructor Info

Instructor: Carl Sable
e-mail: carl.sable@cooper.edu
Office: Room 614

Textbook

"Speech and Language Processing, 3rd Edition" (draft, in-progress, on-line only)
by Daniel Jurafsky and James H. Martin

Grading

• Individual Programming Project #1: 25%
  Click here for corpora for Project #1
  Project #1 is due before midnight the night of Tuesday, March 17
• Individual Programming Project #2: 25%
  Click here for a sample grammar expressed as a general CFG
  Click here for a weakly equivalent grammar in CNF
  Click here for my Python 3 program that converts a CFG to CNF
  (NOTE: I changed the file extension to .txt to avoid server issues, you should change it back to .py)
  Project #2 is due before midnight the night of Tuesday, April 21
• Individual or group programming Project #3: 25%
  Project #3 is due before midnight the night of Tuesday, May 12
• Three quizzes: 25%

Schedule

Note 1: All dates and topics which have not yet occurred are tentative!

Note 2: All below references to chapters and sections of the Jurafsky and Martin textbook are based on a draft version of the book from October 16, 2019.

• Wednesday, January 22
  Topic 1: Course Introduction
  Topic 2: Words, Morphology, and Tokenization
  Suggested reading: Chapter 2 of Jurafsky and Martin
• Tuesday, January 28
  Topic 2 (continued)
• Wednesday, January 29
  Topic 2 (continued)
  Topic 3: N-grams and Conventional Language Models
  Suggested reading: Chapter 3 of Jurafsky and Martin
• Tuesday, February 4
  Topic 3 (continued)
• Wednesday, February 5
  Topic 4: Part-of-Speech Tagging
  Suggested reading: Chapter 8 of Jurafsky and Martin
• Tuesday, February 11
  Topic 4 (continued)
• Tuesday, February 18
  Topic 4 (continued)
  Topic 5: Vector Space Models, Information Retrieval, and Text Categorization
  Suggested reading: Chapter 4 and Sections 6.3 - 6.6 of Jurafsky and Martin
• Wednesday, February 19
  Topic 5 (continued)
• Tuesday, February 25
  Topic 5 (continued)
• Wednesday, February 26 (first half of lecture)
  Project #1 assigned
  Quiz #1

• Wednesday, February 26 (second half of lecture)
  Topic 6: Phrase Structure Grammars and Dependency Grammars
  Suggested reading: Chapter 12 and Sections 15.1 - 15.2 of Jurafsky and Martin
• Tuesday, March 3
  Topic 6 (continued)
• Wednesday, March 4
  Topic 6 (continued)
  Topic 7: Natural Languages and Psycholinguistics
• Tuesday, March 10
  Topic 7 (continued)
• Wednesday, March 11
  Topic 8: Parsing
  Suggested reading: Chapter 13 and Chapter 14 of Jurafsky and Martin
• Tuesday, March 24
  Study Week: All Lectures Cancelled due to COVID-19
• Wednesday, March 25
  Study Week: All Lectures Cancelled due to COVID-19
• Tuesday, March 31
  Topic 8 (continued)
  Project #2 assigned
• Wednesday, April 1
  Topic 9: First-Order Logic and Semantics
  Suggested reading: Chapter 16 of Jurafsky and Martin
• Tuesday, April 7
  Topic 9 (continued)
  Quiz #2 (assigned)

• Wednesday, April 8
  Topic 10: Feed-forward Neural Networks
  Suggested reading: Sections 7.1 - 7.4 of Jurafsky and Martin
• Tuesday, April 14
  Topic 11: Word Embeddings, Neural Language Models, and Word2vec
  Suggested reading: Sections 6.8 - 6.10 and Section 7.5 of Jurafsky and Martin
• Wednesday, April 15
  Topic 11 (continued)
• Tuesday, April 21
  Topic 12: Recurrent Neural Networks, LSTMs, and GRUs
  Suggested reading: Chapter 9 of Jurafsky and Martin
• Wednesday, April 22
  Topic 12 (continued)
  Project #3 assigned
• Tuesday, April 28
  Topic 12 (continued)
• Wednesday, April 29
  Topic 13: Encoder-Decoder Models, Attention, and Machine Translation
  Suggested reading: Chapter 10 of Jurafsky and Martin
• Tuesday, May 5
  Topic 13 (continued)
• Wednesday, May 6
  Topic 14: Advanced Topics (Character and Subword Embeddings, Question Answering Systems, Transformers, and Contextual Word Embeddings)
• Tuesday, May 12
  Topic 14 (continued)
• Wednesday, May 13
  Topic 14 (continued)
  Quiz #3 (assigned)