文本分类
The Task of Text Classification
2
Is this spam?
Who wrote which Federalist papers?
• 1787-8: anonymous essays try to convince New York to ratify
U.S Constitution: Jay, Madison, Hamilton.
• Authorship of 12 of the letters in dispute
• 1963: solved by Mosteller and Wallace using Bayesian
methods
James Madison
Alexander Hamilton
Male or female author?
1. By 1925 present-day Vietnam was divided into three parts under French
colonial rule. The southern region embracing Saigon and the Mekong
delta was the colony of Cochin-China; the central area with its imperial
capital at Hue was the protectorate of Annam…
2. Clara never failed to be astonished by the extraordinary felicity of her
own name. She found it hard to trust herself to the mercy of fate, which
had managed over the years to convert her greatest shame into one of
her greatest assets…
S. Argamon, M. Koppel, J. Fine, A. R. Shimoni, 2003. “Gender, Genre, and Writing Style in Formal Written Texts,” Text, volume 23, number 3, pp.
321–346
Positive or negative movie review?
• unbelievably disappointing
• Full of zany characters and richly applied satire, and some great plot
twists
• this is the greatest screwball comedy ever filmed
• It was pathetic. The worst part about it was the boxing scenes.
6
What is the subject of this article?
MEDLINE Article
MeSH Subject Category Hierarchy
• Antogonists and Inhibitors
• Blood Supply
• Chemistry
• Drug Therapy
• Embryology
• Epidemiology
• …
?
7
Text Classification
•Assigning subject categories, topics, or genres
•Spam detection
•Authorship identification
•Age/gender identification
•Language Identification
•Sentiment analysis
•…