The document proposes an order independent incremental evolving fuzzy grammar fragment learner. It discusses learning the underlying grammar patterns from text fragments in an order independent manner. The method learns grammar fragments from examples and combines them using minimal rules, ensuring the extracted grammars have equal parsing coverage regardless of the order of examples. A formal proof is provided to show the approach is order independent.
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
ORDER INDEPENDENTINCREMENTAL EVOLVING FUZZY GRAMMAR FRAGMENT LEARNER
1.
2.
3. ** Source from World Incidents Tracking System Human is able to understand a class without following a strict pattern
4.
5. TEXT FRAGMENT LEARNING learn the underlying grammar patterns of similar texts ; exploiting both syntactical and semantic properties Text Fragment Examples XML Tag: Event Type - Bomb exploded - Explosion occurred - detonated a bomb -detonated a timed improvised explosive device Bombing - Attacks to occur - Attackers threw a grenade - Assailants attacked a security vehicle - Gunmen killed a member Armed Attack
6.
7.
8.
9.
10. GRAMMAR SIMILARITY Table 1: Example of string edit distance operation (*I:Insert, D:Delete, S:Substitute) Table 2: Example of Grammar Edit Distance Operation (*I:Insert, D:Delete, S:Substitute) Cost(sg ,tg) = <I D S Rs Rt>=<1 1 1 null null> I:Insert D:Delete S:Substitute Rs: remaining in Source Rt: remaining in Target Source string W E D N E S D A Y Target string T U E S D A Y Edit distance* S=1 S=1 D=1 D=1 = = = = = Source grammar, sg Number Word Word Streetending Placename Target grammar, tg Number Placename Streetending Placename Countyname Edit distance* = S=1 D=1 = = I=1
11. GRAMMAR COMBINATION Start s=new string maxMem=membership(s,TG) maxMem<1? costST=costTS=1 Y gx=Combine(sg,tg) costST=1 && costTS=0 gx=sg N Y N costST=0 && costTS=1 gx=tg Y Update TG: GTj={GTj-1-gti} union {gx} gx=sg N sg=deriveGrammar(s) tg=target grammar with maxMem costST=grammarSimilarity(sg,tg) costTS=grammarSimilarity (tg,sg) End Y N
15. Let: Ext(GS j ) = Ext(GS j-1 ) ∪ Ext(gs j ) g x =Combine(gs j ,gt i ) Ext(g x ) = Ext(gs j ) ∪ Ext (gt i ) Case1: Combine( gs j ,gt i ) if Cost(gs j ,gt i )=Cost(gt i , gs j )= 1 In this case, Ext(GT i ) = Ext(GT i-1 - {gt i }) ∪ Ext(g x ) Hence Ext(GT i ) = (Ext(GTi-1) - (Ext(gt i )) ∪ Ext(g x ) = Ext(GT x-1 ) ∪ Ext(gs j ) Case2: Combine( gs j ,gt i ) if gs j is more general than gt i i.e. Ext(gt i ) ⊆ Ext(gs j ) In this case, Ext(GT i ) = Ext(GT i-1 ) ∪ Ext(gs j ) Case3: Combine( gs j ,gt i ) if gt i is more general than gs j i.e. Ext(gs j ) ⊆ Ext (gt i ) In this case, Ext(GT i ) = Ext(GT i-1 ) Therefore Ext(GS j-1 ) = Ext(Gt j-1 ) implies Ext(GS j ) = Ext(Gt i ) Thus in all cases the inductive hypothesis is true and Ext(GSj)=Ext(Gti) ■
16.
17.
18.
19.
Hinweis der Redaktion
Minimal Combination for Incremental Grammar Fragment Learning-IFSA/EUFSLAT 2009 Minimal Combination for Incremental Grammar Fragment Learning-IFSA/EUFSLAT 2009
Minimal Combination for Incremental Grammar Fragment Learning-IFSA/EUFSLAT 2009 Minimal Combination for Incremental Grammar Fragment Learning-IFSA/EUFSLAT 2009