Moore_slides.ppt

Two Paradigms for Natural-Language Processing Robert C. Moore Senior Researcher Microsoft Research

Why is Microsoft interested in natural-language processing? ,[object Object],[object Object]

Some of Microsoft’s near(er) term goals in NLP ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Why is Microsoft interested in machine translation? ,[object Object],[object Object],[object Object],[object Object]

Knowledge engineering vs. machine learning in NLP ,[object Object],[object Object],[object Object]

Central problems in KE-based NLP ,[object Object],[object Object],[object Object]

Simple examples of KE-based NLP notations ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Unification Grammar: the pinnacle of the NLP KE paradigm ,[object Object],[object Object],[object Object],[object Object]

Background: Question formation in English ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Question formation in English (continued) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Example of a UG grammar rule involved in who/what questions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Context-free backbone of rule ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Category subtype features ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Features for tracking long distance dependencies ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Semantic features ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Parsing algorithms for UG ,[object Object],[object Object],[object Object]

Generation algorithms for UG ,[object Object],[object Object],[object Object]

A Prolog-based UG system to play with ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

A paraphrase example ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Whatever happened to UG-based NLP? ,[object Object],[object Object],[object Object]

How machine-learning-based NLP addresses these problems ,[object Object],[object Object]

Increase in stat/ML papers at ACL conferences over 15 years

Characteristics of ML approach to NLP compared to KE approach ,[object Object],[object Object],[object Object],[object Object]

Differences in approaches to stat/ML NLP ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Statistical parsing models ,[object Object],[object Object],[object Object],[object Object],[object Object]

Probabilistic context-free grammars (PCFGs) ,[object Object],[object Object],[object Object]

Problems with simple generative probabilistic models ,[object Object],[object Object]

A currently popular technique: conditional maximum entropy models ,[object Object],[object Object],[object Object],[object Object]

Unsupervised learning in NLP ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Statistical machine translation ,[object Object],[object Object],[object Object]

Structure of stat MT models ,[object Object],[object Object]

A simple model: IBM model 1 ,[object Object],[object Object],[object Object],[object Object],[object Object]

More advanced models ,[object Object],[object Object],[object Object],[object Object],[object Object]

Examples of machine learned English/Italian word translations ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

How do KE and ML approaches to NLP compare today? ,[object Object],[object Object],[object Object],[object Object]

Do we still need linguistics in computational linguistics? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Concluding thoughts ,[object Object],[object Object],[object Object],[object Object]

Moore_slides.ppt

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

Andere mochten auch

Andere mochten auch (7)

Ähnlich wie Moore_slides.ppt

Ähnlich wie Moore_slides.ppt (20)

Mehr von butest

Mehr von butest (20)

Moore_slides.ppt