A Maximum Entropy Approach to Natural Language Processing

Small book cover: A Maximum Entropy Approach to Natural Language Processing

A Maximum Entropy Approach to Natural Language Processing

Publisher: Association for Computational Linguistics
Number of pages: 36

The authors describe a method for statistical modeling based on maximum entropy. They present a maximum-likelihood approach for automatically constructing maximum entropy models and describe how to implement this approach efficiently, using as examples several problems in natural language processing.

Download or read it online for free here:
Download link
(1.8MB, PDF)

Similar books

Book cover: Natural Language Processing with PythonNatural Language Processing with Python
by - O'Reilly Media
This book offers a highly accessible introduction to natural language processing, the field that supports a variety of language technologies. With it, you'll learn how to write Python programs that work with large collections of unstructured text.
Book cover: Computational LinguisticsComputational Linguistics
The book focuses on the basic set of ideas and facts from the fundamental science necessary for the creation of intelligent language processing tools, without going deeply into the details of specific algorithms or toy systems.
Book cover: Language, Proof and LogicLanguage, Proof and Logic
by - Center for the Study of Language
The book covers the boolean connectives, formal proof techniques, quantifiers, basic set theory, induction, proofs of soundness and completeness for propositional and predicate logic, and an accessible sketch of Godel's first incompleteness theorem.
Book cover: An Introduction to Stochastic Attribute-Value GrammarsAn Introduction to Stochastic Attribute-Value Grammars
This text provides an introduction to the maximum entropy principle and the construction of maximum entropy models for natural language processing. We investigate the implementation of maximum entropy models for attribute-value grammars.