Lesson 15: Tokenization and Parsing

Outline:

  1. Recap: Tokenization
  2. Designing a tokenizer
  3. Recap: Backus-Naur form
  4. Parsing
    • parse trees
    • ambiguous grammars
  5. Handling errors
  6. Wrap-up

What’s next

Upcoming events/assessments:

  • Assignments 6–9 (all C assignments) cannot be resubmitted after today at 5pm

What you should do now:

  • Read the assigned readings (see below)
  • Finish Interpreter Part 2: Talloc
  • Read and (barely) start Interpreter Part 3: Tokenizer
  • Finish resubmitting Assignments 6–9 with more complete functionality, style fixes, etc.
  • Look at CS Courses on Workday and fill out your Match form
  • Enjoy midterm break!

Reading assignment (to be completed by the next class):

Parsing (from today and for next time):

  • Parsing – you can access this full textbook through the library