Mallet presentation

Mallet Demo
Hannah Alpert -Abrams, University of Texas at Austin, Fall 2014

“ A J A V A - B A S E D P A C K A G E F O R S T A T I S T I C A L
N A T U R A L L A N G U A G E P R O C E S S I N G ,
D O C U M E N T C L A S S I F I C A T I O N , C L U S T E R I N G ,
T O P I C M O D E L I N G , I N F O R M A T I O N
E X T R A C T I O N , A N D O T H E R M A C H I N E
L E A R N I N G A P P L I C A T I O N S T O T E X T . ”
What is Mallet?

W R I T T E N B Y A N D R E W M C C A L L U M E T A L . A T
U M A S S A M H E R S T
What is Mallet?

1 . D O W N L O A D M A L L E T
2 . P R E P A R E T E X T F O R I N P U T
3 . R U N M A L L E T
4 . M O D I F Y H Y P E R - P A R A M E T E R S
5 . A N A L Y Z E T O P I C S
How do you use mallet?

What is The Command Line?

1) Download Mallet

2) Import Directory into Mallet
Mallet says: “Now run this command:
bin/mallet import-dir --input sample-data/web/* --
output web.mallet

Modifying the command:
bin/mallet import-dir --input sample-data/web/* --
output web.mallet

~/downloads/mallet-2.0.7/bin/mallet import-dir --
input sample-data/web/* --output web.mallet

input ~/Desktop/Mallet-demo/Transcripts-
bulstrode
--output web.mallet

bulstrode --output web.mallet

bulstrode --output topic-input_bulstrode.mallet

bulstrode --output topic-input_bulstrode.mallet --
keep-sequence --remove-stopwords

3) Run Mallet
Mallet says, run the command:
bin/mallet train-topics --input topic-input.mallet
--num-topics 100 --output-state topic-state.gz

3) Run Mallet
Mallet says, run the command:
~/downloads/mallet-2.0.7/bin/mallet train-topics
--input topic-input_bulstrode.mallet --num-topics
100 --output-state topic-state.gz 2>
~/Desktop/Mallet-demo/bulstrode-100t.txt

3) Run Mallet

4) Modify Model
 --optimize-interval #: hyperparameter optimization
 --optimize-burn-in #: iterations before above
 --output-doc-topics doc.txt: outputs topic
composition of documents
 --output-topic-keys doc.txt: more complete data
 --inferencer-filename doc.txt: inferencer tool (?)
 --evaluator-filename doc.txt: how to get topic
proportions for new documents

5) Interpret a topic model
Background: Bulstrode Papers
 Sir Richard Bulstrode (1610-1711), English author, diplomat, soldier
 Papers were “communications made to him from this country [England?] in
the form of news-letters giving, almost daily, the most minute details of
everything going on at court and in the country.”
Research Questions, Bulstrode Papers:
 What important topics were discussed during Bulstrode’s life?
 What attitude was taken towards those topics?
 Can we identify patterns in topics or attitudes over time?

0 10 house day bill ordered made sr lords mr till morning read resolved committee
debate brought comittee bee john morrow
1 10 duke lord earle french court king de yesterday morning towne france night
monday arrived tuesday present good returne dated
2 10 ye yt wch king ld lds day order commons ym great agst st againe doe ma goe
night wth
3 10 maty dutch holland matie men pleased great haveing persons fleet mr warr
severall wee sr hear states highness sea
4 10 majestye hath sr councell soe late ambassador hee letters king majesty bee lord
great made french mr prince himselfe

010 house day bill ordered made sr lords mr till
morning read resolved committee debate brought
comittee bee john morrow
night wth
3 10 maty dutch holland matie men pleased great haveing persons fleet mr warr
severall wee sr hear states highness sea

0 10 house day bill ordered made sr lords mr till morning read resolved committee
debate brought comittee bee john morrow
night wth
310 maty dutch holland matie men pleased great
haveing persons fleet mr warr severall wee sr hear
states highness sea

Topic Three: War at Sea?
maty dutch holland
matie men pleased
great haveing
persons fleet mr warr
severall wee sr hear
states highness sea
--output-doc-topicsHannah Alpert -Abrams, University of Texas at Austin, Fall 2014

Topic Three: War at Sea?
maty dutch holland
matie men pleased
great haveing
states highness sea
File 1672-04-12
' Thursday, 4th.--His Maty has
given orders that letters be
imediately sent to all the
Collonyes and Plantacons
abroad to give them notice of his
warr with Holland, and
therefore to comand them to
seize and secure all the effects of
the people in those places, and
to be carefull in securing the
countryes. His Maty has given
orders for the makeing
commissions for another
regiment to be raysed, under the
command of my Ld Power as
Collonell.

Topic Three: Third Anglo-Dutch War
maty dutch holland
matie men pleased
great haveing
states highness sea

Topic Three: Third Anglo-Dutch War
maty dutch holland
matie men pleased
great haveing
states highness sea
File 1672-04-12
' On Satturday last the commissions for
Prince Rupert's regiment were signed by
his Majesty, being in all 12 troops of
Dragoons; his Maty was also pleased to
signe commissions for another regiment of
Foot to be now raysed, under the comand
of Coll. Fitzgerald as Collonell, Mr Henry
Butler, Lt Colonell and Sr Edward
Carleton, Major.
' Monday, 1st.--Sr John Talbot's company
in his Matie's Guards is given to Captaine
Guilliames, and Captaine Downing's
company to Captaine Henry Williams; and
Capt Downing has Sr Charles Wheler's
company, also in the Guards.
' His Maty has been pleased to give two
comissions to the Duke of Yorke, one for
impowering him to issue out his warrants
to the Court of Admiralty to give sentence
against what prizes shall be taken, and the
other for impowering him to issue his
comissions to privateers to take and
destroy the King's enemyes.

Take-Aways
 The difficulties and rewards of working on the
command line.
 How to take a collection of topics and conduct an
analysis of those topics.
 How much human intervention is necessary to
“process” the text prior to modeling.

Mallet presentation

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

Empfohlen

Empfohlen (20)

Mallet presentation