ECE 467: Natural Language Processing

• Instructor Info
• Textbook
• Grading
• Schedule

Instructor Info

Instructor: Carl Sable
e-mail: carl.sable@cooper.edu
Office: Room 614

Textbook

"Speech and Language Processing, 3rd Edition" (draft, in-progress, on-line only)
by Daniel Jurafsky and James H. Martin

Grading

• Text Categorization Project: 25%
  Click here for the corpora for the text categorization project
  Project #1 is due before midnight the night of Sunday, March 21
• Parsing Project: 25%
  Click here for a sample grammar expressed as a general CFG
  Click here for a weakly equivalent grammar in CNF
  Click here for my Python 3 program that converts a CFG to CNF
  (NOTE: I changed the file extension to .txt to avoid server issues, you should change it back to .py)
  Project #2 is due before midnight the night of Monday, April 19
• Individual or Group Open Ended Programming Project: 25%
  Project #3 is due before midnight the night of Tuesday, May 11
• 3 Problem Sets: 25%
  Click here for probem set #1
  Problem set #1 is due before the start of class on Wednesday, March 3
  Click here for probem set #2
  Problem set #2 is due before the start of class on Tuesday, April 13
  Click here for probem set #3
  Problem set #3 is due before the start of class on Wednesday, May 12

Schedule

Note 1: All dates and topics which have not yet occurred are tentative!

Note 2: All below references to chapters and sections of the Jurafsky and Martin textbook are based on a draft version of the book dated December 30, 2020.

• Wednesday, January 20
  Topic 1: Course Introduction
• Tuesday, January 26
  Topic 2: Tokenization, Words, and Morphology
  Suggested reading: Chapter 2 of Jurafsky and Martin
• Wednesday, January 27
  Topic 2 (continued)
• Tuesday, February 2
  Topic 3: N-grams and Conventional Language Models
  Suggested reading: Chapter 3 of Jurafsky and Martin
• Wednesday, February 3
  Topic 3 (continued)
• Tuesday, February 9
  Topic 4: Part-of-Speech Tagging
  Suggested reading: Chapter 8 of Jurafsky and Martin
• Tuesday, February 16
  Topic 4 (continued)
• Wednesday, February 17
  Topic 4 (continued)
  Topic 5: Vector Space Models, Information Retrieval, and Text Categorization
  Suggested reading: Chapter 4, Sections 6.3 - 6.5, and Section 23.1 of Jurafsky and Martin
• Tuesday, February 23
  Topic 5 (continued)
• Wednesday, February 24
  Topic 5 (continued)
  Project #1 assigned

• Tuesday, March 2
  Topic 6: Phrase Structure Grammars and Dependency Grammars
  Suggested reading: Chapter 12 and Sections 14.1 - 14.3 of Jurafsky and Martin
• Wednesday, March 3
  Topic 6 (continued)
• Tuesday, March 9
  Topic 6 (continued)
• Wednesday, March 10
  Topic 7: Natural Languages and Psycholinguistics
• Tuesday, March 23
  Topic 8: Parsing
  Suggested reading: Sections 13.1 - 13.2 and Appendix C of Jurafsky and Martin
• Wednesday, March 24
  Topic 8 (continued)
• Tuesday, March 30
  Project #2 assigned
  Topic 9: First-Order Logic and Semantics
  Suggested reading: Chapter 15 of Jurafsky and Martin
• Wednesday, March 31
  Topic 9 (continued)

• Tuesday, April 6
  Topic 10: Feedforward Neural Networks
  Suggested reading: Sections 7.1 - 7.4 of Jurafsky and Martin
• Wednesday, April 7
  Topic 10 (continued)
• Tuesday, April 13
  Topic 11: Word Embeddings, Neural Language Models, and Word2vec
  Suggested reading: Sections 6.8 - 6.10 and Section 7.5 of Jurafsky and Martin
• Wednesday, April 14
  Topic 11 (continued)
• Tuesday, April 20
  Topic 12: Recurrent Neural Networks, LSTMs, and GRUs
  Suggested reading: Sections 9.1 - 9.3 of Jurafsky and Martin
• Wednesday, April 21
  Topic 12 (continued)
  Project #3 assigned
• Tuesday, April 27
  Topic 13: Encoder-Decoder Models, Attention, and Machine Translation
  Suggested reading: Chapter 11 of Jurafsky and Martin
• Wednesday, April 28
  Topic 13 (continued)
• Tuesday, May 4
  Topic 14: Advanced Topics (Character and Subword Embeddings, Question Answering Systems, Transformers, Contextual Word Embeddings, Ethics and NLP)
  Suggested reading: Section 2.4.3, Section 6.8.3, Chapter 23, Section 9.4, Setion 4.10, Section 6.11, Section 9.5, Section 11.9, and Section 24.6.1 of Jurafsky and Martin
• Wednesday, May 5
  Topic 14 (continued)
• Tuesday, May 11
  Topic 14 (continued)
• Wednesday, May 12
  Topic 14 (continued)