Linguistics 567: Knowledge Engineering for NLP

An elective course in UW's Professional Master's in Computational Linguistics

Winter 2015

(Course websites from previous years: 2014 2013 2012 2010 2009 2008 2007 2006 2005)

Course Info

  • Required Text:
  • Recommended Text:
  • Software

    This software is available in the Treehouse. You can also install it on your home machines, but you'll need to be running linux. If you don't already have a linux machine, we suggest KNOPPIX+LKB.

    Instructor Info

    Links

    Syllabus

    Description

    Natural language processing (NLP) enables computers to make use of data represented in human language (including the vast quantities of data available on the web) and to interact with computers on human terms. Applications from machine translation to speech recognition and web-based information retrieval demand both precision and robustness from NLP technology. Meetings these demands will require better hand-built grammars of human languages combined with sophisticated statistical processing methods. This class focuses on the implementation of linguistic grammars, drawing on a combination of sound grammatical theory and engineering skills.

    Class meetings will alternate between lectures and discussion sessions. We will cover the implementation of constraints in morphology, syntax and semantics within a unification-based lexicalist framework of grammar. Weekly exercises will focus on building up an implemented grammar for a language of your choice (everyone must work on a different language, so be prepared to work with a language you don't know well!), based on the LinGO Grammar Matrix. At the end of the quarter, we will use the various grammars in a machine translation task.

    Prerequisites: Linguistics 566 or equivalent. No programming experience is required.

    Note: To request academic accommodations due to a disability, please contact Disabled Student Services, 448 Schmitz, 206-543-8924 (V/TTY). If you have a letter from Disabled Student Services indicating that you have a disability which requires academic accommodations, please present the letter to the instructor so we can discuss the accommodations you might need in this class.

    Requirements

    Weekly lab exercises, typically assigned on Mondays and due by Friday night. Course time on Thursdays will be used for discussion of the exercises, so please work on them ahead of time and bring questions. Lab exercises will require write-ups to explain the phenomena as manifested in your language and how you implemented your analysis. Active class participation will be viewed favorably when it comes to grading.

    Everyone will complete Lab 1 individually, but students may be expected to work in pairs starting with Lab 2, depending on the size of the class. Partners will alternate doing the write up portion of the lab, and have the grades for the labs where they did the write up weighted more heavily in their final course grade.

    Lab exercises are to be turned in via Catalyst CollectIt

    Late homework policy

    Schedule of Topics and Assignments

    Under construction---will be updated.

    All course recordings will be posted on our common view page. If I'm slow to make them available there, please ping me over GoPost.
    DatesLectureLabDue dateReading
    1/6, 1/8 Overview, Introduction
    LKB Formalism
    Lab 1: Getting to know the LKB and the Grammar Matrix; Choose language1/9 Ch 1-3
    1/13, 1/15 Testsuites, [incr tsdb()] Lab 2: Testsuites/customization I: Word order, person/number/gender, pronouns, case, the rest of the NP, basic lexicon (full form) 1/16Ch 4, 5
    Bender et al 2011 (in course CommonView)
    1/20, 1/22 The Grammar Matrix: Motivations, technical details
    Morphotactics in the Grammar Matrix
    Lab 3: Testsuites/customization II: Tense/aspect, agreement, other required affixes, negation, argument optionality, demonstratives, 1/23Bender et al 2010 (in CommonView); Goodman 2013
    1/27, 1/29 Minimal Recursion Semantics
    Information Structure
    Lab 4: Testsuites/customization III: Matrix yes-no questions, matrix wh- questions, coordination, modification, non-verbal predicates, embedded clauses; test corpora 1/30Copestake, Flickinger, Pollard, and Sag, 2005 (esp. Sec 3)
    2/3, 2/5 Modification, Discourse Status, Argument Optionality; Precision grammars and corpus data Lab 5: Test corpus, modification, demonstratives, argument optionality 2/6Borthen and Haugereid 2005, available under Files on the course CommonView (Research on Language and Computation 3(2):221-246)
    (Optional: Baldwin et al 2005)
    2/10, 2/12 Clause types, illocutionary force, non-verbal predicates Lab 6: Polar questions, embedded clauses, non-verbal predicates2/13 
    2/17, 2/19 Negation, raising, control, argument composition; wh- questions Lab 7: I can eat glass. It doesn't hurt me.
    One corpus sentence
    2/20 
    2/24, 2/26 VPM, Getting started with MT Lab 8: VPM, One more corpus sentence, First translation 2/27 
    3/3, 3/5 The LOGON MT architecture Lab 9: Grammar clean up; Transfer rules 3/6Oepen et al 2007
    3/10, 3/12 The Grammar Matrix: Future directions Machine Translation Extravaganza
    Course evals
    Nope 


    ebender at u dot washington dot edu
    Last modified: 1/6/15