SlideShare ist ein Scribd-Unternehmen logo
1 von 35
Imam University
College of Computer and Information systems
Computer sciences Department
Arabic Question Answering :
by Asma Ahmad Asma alharbi
nadia AL-Mutiri
Supervised by: Dr .Amal Al seef
Second semester :1434-1435
2013
Arabic Question Answering
Overview:
O The implementation of Arabic Question-
Answering system components .
O QASAL & QARAB System components.
O Yes/No Arabic Question Answering.
ARABIQA GENERIC
ARCHITECTURE
Named Entity Recognizer
O A NER system identifies proper
names, temporal and numeric expressions .
O in this Arabic NER system is based ME
approach.
O For the proper names recognition:
O For temporal and numeric expressions: is
totally based on patterns and a small
dictionary containing the names of days and
months in Arabic, and numbers written in
letters.
The implementation of Arabic
Question-Answering system
O NooJ is a linguistic environment that
includes large-coverage dictionaries and
grammars.
O a spell-checker that corrects the most
frequent errors.
O a named entity recognition tool which is
set of rules described into local grammars
QASAL System
components
Question analysis: this step it is apply the set of
linguistic resources to the input question.
For example shows the NooJ’s text annotation
structure that gives the linguistic analysis of each
word form in our sample question
Passage retrieval: The first task of this step
could be the selection of one or more
automatically extract the answer of the
input question.
Answer Extraction: this last step uses the
displayed concordance table to
automatically extract the answer of the
input question.
Example1 :Answer Extraction for the factoid question:
Example 2:
QARAB System
f
NLB Tool
Question
Question
analyzer
IR Ranked
Documents
Passage
selection
Hypothesize
d
Answer
Al-Raya
Newspaper
Document
full IR
syste
m
Information Retrieval system .
O To search the document collection to select
documents containing information relevant to the
user’s query.
O Lundquist et al. [1999] IR system that can be
constructed using a relational database management
system (RDBMS).
O But in this paper it contain following database
relations:
1. ROOT_TABLE.
2. STEM_TABLE.
3. POSTING_TABLE.
4. DOCUMENT_TABLE.
5. PARAGRAPH_TABLE.
The NLb system
The NLB model is:
1. Tokenizer.
2. type finder.
3. feature finder.
4. proper noun phrase parser.
How to extract the Answer
Assume the user posed the following question to
QARAB:
The IR return this passage . How?!
Step1:
O performing token and remove the stop
word of question , Then tagging the word
for POS.
Step 2:
O QARAB constructs the query as a “bag of
words” and passes it to the IR system.
Example
Step 3: Determine the expected type of the answer:
Who? >>> personal name.
Step4: Generating the answer.
Yes/No Arabic
Question Answering
SYSTEM ARCHITECTURE:
Question
Analysis
module
Text
retrieval
module
Answer
Selection
module
Question Analysis
O Removing the question mark.
O Removing the interrogative particle
O Tokenizing: the tokenizer divides the user
question into its separate words .And
normalize the (Alef) letter.
O Removing the stop words.
O Removing the negation particles. (if it
exits) and set the negation property of the
question representation
Question Analysis
O Tagging: to determine the type of a
word, verb or noun and obtain its root.
O Parsing: recall that the Arabic sentence
after the interrogative particle is nominal
or verbal.
Question Analysis
In nominal sentence, we are interested with the
beginning noun “topic” ( ) which is the first
noun after the interrogative particle ( ). And the
comment noun ( ) and we can mark it as the
last noun without the article ( ).
In verbal sentence we are interested with the
verb of the sentence which occur immediately
after
the interrogative particle ( ) , and the subject
that follow the verb.
Question Analysis
Logical Representation(With Nominal Sentences)
Affirmative questions
O N (Topic, root (Comment), root
({remaining words }))
O N (Topic, root (Comment Synonyms), root
({remaining words}))
O ~N (Topic, root (Comment Antonyms), root
({remaining words}))
Question Analysis
Logical Representation(With Nominal Sentences)
O Negated questions :
O ~N (Topic, root (Comment), root
({remaining words}))
O ~N (topic, root (Comment Synonyms), root
({remaining words}))
O N (Topic, root (Comment Antonyms), root
({remaining words}))
Question Analysis
O Example
-----<synonym
O N( , root ( ),root( ))
O N( , root ( ),root( ))
Question Analysis
Logical Representation(With Verbal Sentences)
Affirmative questions :
O V (Subject noun, root (verb), root ({remaining words}))
O V (Subject noun, root (verb Synonyms), root ({remaining
words}))
O ~V (Subject noun, root (verb Antonyms), root
({remaining words}))
Question Analysis
Logical Representation(With Verbal
Sentences)
Negated questions
O ~V (Subject noun, root (verb), root
({remaining words}))
O ~ V (Subject noun, root (verb
Synonyms), root ({remaining words}))
O V (Subject noun, root (verb
Antonyms), root ({remaining words}))
Question Analysis
Example
---<Antonym
O V( , root ( ),root( ))
O ~V( , root ( ),root( ))
Text Processing & Retrieval
They are 20 documents in corpus. This module uses two
techniques to retrieve the top 5
candidate paragraphs (with variable length (that are most
relevant to the user question:
O Paragraphs technique: - Split the documents into its
built-in paragraphs and retrieve the top 5 paragraphs
regardless from which document they are, according to
some indexing scheme.
O Document technique-:Retrieve the top 5 documents
after they are ranked, then use the first indexing scheme
to retrieve the top 5 paragraphs.
Answer Selection &
generation
After the 5 paragraphs are selected using
documents technique or paragraphs
technique, we need to select the best
sentence to represent the answer, and
accordingly generates yes or no .
Answer Selection &
generation
O Split the paragraphs into their sentences .
O In normal sentences we are interested in
the exact topic ( ) not its used root, so
we omit each sentence that does not
contain it (in the original form )In verbal
sentence we are interested in the exact
subject ( ) not its used root , so we omit
each sentence that does not contain it (in
the original form )
Answer Selection &
generation
O In the result sentence , we look for the
remaining terms (in root form) that derived
from the
question in the logical representation (except
the subject or the topic ), if the they exist
, assign
those indexes according to their position in the
sentence. So each sentence will have its own
rank
as follow :
Rank =last occurrence - first occurrence
O look for ( ) negation particles in the
selected answer (if exist).
Answer Selection &
generation
O Using the selected answer and the logical
representation of the question to generate
yes ,or no a follows :
1. Yes ,if : The question and the answer
are affirmative .The question and the
answer are negated.
2. No, if :The question if affirmative and the
answer are negated.The question is
negated and the answer is affirmative.
EXPERIMENTS AND
RESULTS
69%Arabic QA system
97.3%Arabic Q-A uses
QARAB
83.3%PR system
conclusion
O We have described the generic
architecture for AQ answer
O compare with deferent system
O How presses the question and give the
answers.

Weitere ähnliche Inhalte

Was ist angesagt?

2010 PACLIC - pay attention to categories
2010 PACLIC - pay attention to categories2010 PACLIC - pay attention to categories
2010 PACLIC - pay attention to categoriesWarNik Chow
 
Practical machine learning - Part 1
Practical machine learning - Part 1Practical machine learning - Part 1
Practical machine learning - Part 1Traian Rebedea
 
ADAPT Centre and My NLP journey: MT, MTE, QE, MWE, NER, Treebanks, Parsing.
ADAPT Centre and My NLP journey: MT, MTE, QE, MWE, NER, Treebanks, Parsing.ADAPT Centre and My NLP journey: MT, MTE, QE, MWE, NER, Treebanks, Parsing.
ADAPT Centre and My NLP journey: MT, MTE, QE, MWE, NER, Treebanks, Parsing.Lifeng (Aaron) Han
 
Apply chinese radicals into neural machine translation: deeper than character...
Apply chinese radicals into neural machine translation: deeper than character...Apply chinese radicals into neural machine translation: deeper than character...
Apply chinese radicals into neural machine translation: deeper than character...Lifeng (Aaron) Han
 
Question Answering System using machine learning approach
Question Answering System using machine learning approachQuestion Answering System using machine learning approach
Question Answering System using machine learning approachGarima Nanda
 
Natural language processing for requirements engineering: ICSE 2021 Technical...
Natural language processing for requirements engineering: ICSE 2021 Technical...Natural language processing for requirements engineering: ICSE 2021 Technical...
Natural language processing for requirements engineering: ICSE 2021 Technical...alessio_ferrari
 
Word representation: SVD, LSA, Word2Vec
Word representation: SVD, LSA, Word2VecWord representation: SVD, LSA, Word2Vec
Word representation: SVD, LSA, Word2Vecananth
 
Chinese Character Decomposition for Neural MT with Multi-Word Expressions
Chinese Character Decomposition for  Neural MT with Multi-Word ExpressionsChinese Character Decomposition for  Neural MT with Multi-Word Expressions
Chinese Character Decomposition for Neural MT with Multi-Word ExpressionsLifeng (Aaron) Han
 
Vectors in Search - Towards More Semantic Matching
Vectors in Search - Towards More Semantic MatchingVectors in Search - Towards More Semantic Matching
Vectors in Search - Towards More Semantic MatchingSimon Hughes
 
Sentence representations and question answering (YerevaNN)
Sentence representations and question answering (YerevaNN)Sentence representations and question answering (YerevaNN)
Sentence representations and question answering (YerevaNN)YerevaNN research lab
 
Natural Language Processing (NLP) for Requirements Engineering (RE): an Overview
Natural Language Processing (NLP) for Requirements Engineering (RE): an OverviewNatural Language Processing (NLP) for Requirements Engineering (RE): an Overview
Natural Language Processing (NLP) for Requirements Engineering (RE): an Overviewalessio_ferrari
 
Frontiers of Natural Language Processing
Frontiers of Natural Language ProcessingFrontiers of Natural Language Processing
Frontiers of Natural Language ProcessingSebastian Ruder
 
VOC real world enterprise needs
VOC real world enterprise needsVOC real world enterprise needs
VOC real world enterprise needsIvan Berlocher
 
CUHK intern PPT. Machine Translation Evaluation: Methods and Tools
CUHK intern PPT. Machine Translation Evaluation: Methods and Tools CUHK intern PPT. Machine Translation Evaluation: Methods and Tools
CUHK intern PPT. Machine Translation Evaluation: Methods and Tools Lifeng (Aaron) Han
 
Natural Language Processing: L01 introduction
Natural Language Processing: L01 introductionNatural Language Processing: L01 introduction
Natural Language Processing: L01 introductionananth
 
Meta-evaluation of machine translation evaluation methods
Meta-evaluation of machine translation evaluation methodsMeta-evaluation of machine translation evaluation methods
Meta-evaluation of machine translation evaluation methodsLifeng (Aaron) Han
 
Incorporating Chinese Radicals Into Neural Machine Translation: Deeper Than C...
Incorporating Chinese Radicals Into Neural Machine Translation: Deeper Than C...Incorporating Chinese Radicals Into Neural Machine Translation: Deeper Than C...
Incorporating Chinese Radicals Into Neural Machine Translation: Deeper Than C...Lifeng (Aaron) Han
 
Scaling Quality on Quora Using Machine Learning
Scaling Quality on Quora Using Machine LearningScaling Quality on Quora Using Machine Learning
Scaling Quality on Quora Using Machine LearningVo Viet Anh
 

Was ist angesagt? (20)

2010 PACLIC - pay attention to categories
2010 PACLIC - pay attention to categories2010 PACLIC - pay attention to categories
2010 PACLIC - pay attention to categories
 
Practical machine learning - Part 1
Practical machine learning - Part 1Practical machine learning - Part 1
Practical machine learning - Part 1
 
1909 paclic
1909 paclic1909 paclic
1909 paclic
 
ADAPT Centre and My NLP journey: MT, MTE, QE, MWE, NER, Treebanks, Parsing.
ADAPT Centre and My NLP journey: MT, MTE, QE, MWE, NER, Treebanks, Parsing.ADAPT Centre and My NLP journey: MT, MTE, QE, MWE, NER, Treebanks, Parsing.
ADAPT Centre and My NLP journey: MT, MTE, QE, MWE, NER, Treebanks, Parsing.
 
Apply chinese radicals into neural machine translation: deeper than character...
Apply chinese radicals into neural machine translation: deeper than character...Apply chinese radicals into neural machine translation: deeper than character...
Apply chinese radicals into neural machine translation: deeper than character...
 
Question Answering System using machine learning approach
Question Answering System using machine learning approachQuestion Answering System using machine learning approach
Question Answering System using machine learning approach
 
Natural language processing for requirements engineering: ICSE 2021 Technical...
Natural language processing for requirements engineering: ICSE 2021 Technical...Natural language processing for requirements engineering: ICSE 2021 Technical...
Natural language processing for requirements engineering: ICSE 2021 Technical...
 
Word representation: SVD, LSA, Word2Vec
Word representation: SVD, LSA, Word2VecWord representation: SVD, LSA, Word2Vec
Word representation: SVD, LSA, Word2Vec
 
Chinese Character Decomposition for Neural MT with Multi-Word Expressions
Chinese Character Decomposition for  Neural MT with Multi-Word ExpressionsChinese Character Decomposition for  Neural MT with Multi-Word Expressions
Chinese Character Decomposition for Neural MT with Multi-Word Expressions
 
Question answering
Question answeringQuestion answering
Question answering
 
Vectors in Search - Towards More Semantic Matching
Vectors in Search - Towards More Semantic MatchingVectors in Search - Towards More Semantic Matching
Vectors in Search - Towards More Semantic Matching
 
Sentence representations and question answering (YerevaNN)
Sentence representations and question answering (YerevaNN)Sentence representations and question answering (YerevaNN)
Sentence representations and question answering (YerevaNN)
 
Natural Language Processing (NLP) for Requirements Engineering (RE): an Overview
Natural Language Processing (NLP) for Requirements Engineering (RE): an OverviewNatural Language Processing (NLP) for Requirements Engineering (RE): an Overview
Natural Language Processing (NLP) for Requirements Engineering (RE): an Overview
 
Frontiers of Natural Language Processing
Frontiers of Natural Language ProcessingFrontiers of Natural Language Processing
Frontiers of Natural Language Processing
 
VOC real world enterprise needs
VOC real world enterprise needsVOC real world enterprise needs
VOC real world enterprise needs
 
CUHK intern PPT. Machine Translation Evaluation: Methods and Tools
CUHK intern PPT. Machine Translation Evaluation: Methods and Tools CUHK intern PPT. Machine Translation Evaluation: Methods and Tools
CUHK intern PPT. Machine Translation Evaluation: Methods and Tools
 
Natural Language Processing: L01 introduction
Natural Language Processing: L01 introductionNatural Language Processing: L01 introduction
Natural Language Processing: L01 introduction
 
Meta-evaluation of machine translation evaluation methods
Meta-evaluation of machine translation evaluation methodsMeta-evaluation of machine translation evaluation methods
Meta-evaluation of machine translation evaluation methods
 
Incorporating Chinese Radicals Into Neural Machine Translation: Deeper Than C...
Incorporating Chinese Radicals Into Neural Machine Translation: Deeper Than C...Incorporating Chinese Radicals Into Neural Machine Translation: Deeper Than C...
Incorporating Chinese Radicals Into Neural Machine Translation: Deeper Than C...
 
Scaling Quality on Quora Using Machine Learning
Scaling Quality on Quora Using Machine LearningScaling Quality on Quora Using Machine Learning
Scaling Quality on Quora Using Machine Learning
 

Andere mochten auch

Andere mochten auch (17)

Discourse annotation for arabic 2
Discourse annotation for arabic 2Discourse annotation for arabic 2
Discourse annotation for arabic 2
 
Coreference recognition in arabic
Coreference recognition in arabicCoreference recognition in arabic
Coreference recognition in arabic
 
Syntactic parsing for arabic
Syntactic parsing for arabicSyntactic parsing for arabic
Syntactic parsing for arabic
 
Arabic speech recognition
Arabic speech recognitionArabic speech recognition
Arabic speech recognition
 
Arabic spell checkers
Arabic spell  checkersArabic spell  checkers
Arabic spell checkers
 
Automatic summaraitztion for_arabic
Automatic summaraitztion for_arabicAutomatic summaraitztion for_arabic
Automatic summaraitztion for_arabic
 
Speech recognition for arabic
Speech recognition for arabicSpeech recognition for arabic
Speech recognition for arabic
 
Discourse annotation for arabic
Discourse annotation for arabicDiscourse annotation for arabic
Discourse annotation for arabic
 
Discourse annotation for arabic 3
Discourse annotation for arabic 3Discourse annotation for arabic 3
Discourse annotation for arabic 3
 
Discourse annotation
Discourse annotationDiscourse annotation
Discourse annotation
 
Building corpus from www for arabic
Building corpus from www for arabicBuilding corpus from www for arabic
Building corpus from www for arabic
 
The named entity recognition (ner)2
The named entity recognition (ner)2The named entity recognition (ner)2
The named entity recognition (ner)2
 
Arabic to-english machine translation
Arabic to-english machine translationArabic to-english machine translation
Arabic to-english machine translation
 
Part of speech tagging for Arabic
Part of speech tagging for ArabicPart of speech tagging for Arabic
Part of speech tagging for Arabic
 
Arabic spell checking approaches
Arabic spell checking approachesArabic spell checking approaches
Arabic spell checking approaches
 
Arabic tokenization and stemming
Arabic tokenization and  stemmingArabic tokenization and  stemming
Arabic tokenization and stemming
 
Sentiment analysis of arabic,a survey
Sentiment analysis of arabic,a surveySentiment analysis of arabic,a survey
Sentiment analysis of arabic,a survey
 

Ähnlich wie Arabic question answering ‫‬

Unsupervised Software-Specific Morphological Forms Inference from Informal Di...
Unsupervised Software-Specific Morphological Forms Inference from Informal Di...Unsupervised Software-Specific Morphological Forms Inference from Informal Di...
Unsupervised Software-Specific Morphological Forms Inference from Informal Di...Chunyang Chen
 
Answer Extraction for how and why Questions in Question Answering Systems
Answer Extraction for how and why Questions in Question Answering SystemsAnswer Extraction for how and why Questions in Question Answering Systems
Answer Extraction for how and why Questions in Question Answering Systemsijceronline
 
Unknown Word 08
Unknown Word 08Unknown Word 08
Unknown Word 08Jason Yang
 
Information extraction for Free Text
Information extraction for Free TextInformation extraction for Free Text
Information extraction for Free Textbutest
 
Haystack 2018 - Algorithmic Extraction of Keywords Concepts and Vocabularies
Haystack 2018 - Algorithmic Extraction of Keywords Concepts and VocabulariesHaystack 2018 - Algorithmic Extraction of Keywords Concepts and Vocabularies
Haystack 2018 - Algorithmic Extraction of Keywords Concepts and VocabulariesMax Irwin
 
Building Smarter Search Applications Using Built-In Knowledge Graphs and Quer...
Building Smarter Search Applications Using Built-In Knowledge Graphs and Quer...Building Smarter Search Applications Using Built-In Knowledge Graphs and Quer...
Building Smarter Search Applications Using Built-In Knowledge Graphs and Quer...Lucidworks
 
Automatic multiple choice question generation system for
Automatic multiple choice question generation system forAutomatic multiple choice question generation system for
Automatic multiple choice question generation system forAlexander Decker
 
Question Answering on Romanian, English and French Languages
Question Answering on Romanian, English and French LanguagesQuestion Answering on Romanian, English and French Languages
Question Answering on Romanian, English and French LanguagesFaculty of Computer Science
 
Zouaq wole2013
Zouaq wole2013Zouaq wole2013
Zouaq wole2013Amal Zouaq
 
Moore_slides.ppt
Moore_slides.pptMoore_slides.ppt
Moore_slides.pptbutest
 
DEVELOPMENT OF ARABIC NOUN PHRASE EXTRACTOR (ANPE)
DEVELOPMENT OF ARABIC NOUN PHRASE EXTRACTOR (ANPE)DEVELOPMENT OF ARABIC NOUN PHRASE EXTRACTOR (ANPE)
DEVELOPMENT OF ARABIC NOUN PHRASE EXTRACTOR (ANPE)ijnlc
 
Question Classification using Semantic, Syntactic and Lexical features
Question Classification using Semantic, Syntactic and Lexical featuresQuestion Classification using Semantic, Syntactic and Lexical features
Question Classification using Semantic, Syntactic and Lexical featuresIJwest
 
Question Classification using Semantic, Syntactic and Lexical features
Question Classification using Semantic, Syntactic and Lexical featuresQuestion Classification using Semantic, Syntactic and Lexical features
Question Classification using Semantic, Syntactic and Lexical featuresdannyijwest
 
Computational model language and grammar bnf
Computational model language and grammar bnfComputational model language and grammar bnf
Computational model language and grammar bnfTaha Shakeel
 
Arabic grammar mobile apps
Arabic grammar mobile appsArabic grammar mobile apps
Arabic grammar mobile appsSafwan5605
 
Paper id 28201441
Paper id 28201441Paper id 28201441
Paper id 28201441IJRAT
 

Ähnlich wie Arabic question answering ‫‬ (20)

Unsupervised Software-Specific Morphological Forms Inference from Informal Di...
Unsupervised Software-Specific Morphological Forms Inference from Informal Di...Unsupervised Software-Specific Morphological Forms Inference from Informal Di...
Unsupervised Software-Specific Morphological Forms Inference from Informal Di...
 
Answer Extraction for how and why Questions in Question Answering Systems
Answer Extraction for how and why Questions in Question Answering SystemsAnswer Extraction for how and why Questions in Question Answering Systems
Answer Extraction for how and why Questions in Question Answering Systems
 
UWB semeval2016-task5
UWB semeval2016-task5UWB semeval2016-task5
UWB semeval2016-task5
 
Unknown Word 08
Unknown Word 08Unknown Word 08
Unknown Word 08
 
Information extraction for Free Text
Information extraction for Free TextInformation extraction for Free Text
Information extraction for Free Text
 
Spoken Content Retrieval
Spoken Content RetrievalSpoken Content Retrieval
Spoken Content Retrieval
 
Haystack 2018 - Algorithmic Extraction of Keywords Concepts and Vocabularies
Haystack 2018 - Algorithmic Extraction of Keywords Concepts and VocabulariesHaystack 2018 - Algorithmic Extraction of Keywords Concepts and Vocabularies
Haystack 2018 - Algorithmic Extraction of Keywords Concepts and Vocabularies
 
Building Smarter Search Applications Using Built-In Knowledge Graphs and Quer...
Building Smarter Search Applications Using Built-In Knowledge Graphs and Quer...Building Smarter Search Applications Using Built-In Knowledge Graphs and Quer...
Building Smarter Search Applications Using Built-In Knowledge Graphs and Quer...
 
Automatic multiple choice question generation system for
Automatic multiple choice question generation system forAutomatic multiple choice question generation system for
Automatic multiple choice question generation system for
 
Question Answering on Romanian, English and French Languages
Question Answering on Romanian, English and French LanguagesQuestion Answering on Romanian, English and French Languages
Question Answering on Romanian, English and French Languages
 
Zouaq wole2013
Zouaq wole2013Zouaq wole2013
Zouaq wole2013
 
Moore_slides.ppt
Moore_slides.pptMoore_slides.ppt
Moore_slides.ppt
 
DEVELOPMENT OF ARABIC NOUN PHRASE EXTRACTOR (ANPE)
DEVELOPMENT OF ARABIC NOUN PHRASE EXTRACTOR (ANPE)DEVELOPMENT OF ARABIC NOUN PHRASE EXTRACTOR (ANPE)
DEVELOPMENT OF ARABIC NOUN PHRASE EXTRACTOR (ANPE)
 
Question Classification using Semantic, Syntactic and Lexical features
Question Classification using Semantic, Syntactic and Lexical featuresQuestion Classification using Semantic, Syntactic and Lexical features
Question Classification using Semantic, Syntactic and Lexical features
 
Question Classification using Semantic, Syntactic and Lexical features
Question Classification using Semantic, Syntactic and Lexical featuresQuestion Classification using Semantic, Syntactic and Lexical features
Question Classification using Semantic, Syntactic and Lexical features
 
Nlp
NlpNlp
Nlp
 
Natural Language Processing
Natural Language ProcessingNatural Language Processing
Natural Language Processing
 
Computational model language and grammar bnf
Computational model language and grammar bnfComputational model language and grammar bnf
Computational model language and grammar bnf
 
Arabic grammar mobile apps
Arabic grammar mobile appsArabic grammar mobile apps
Arabic grammar mobile apps
 
Paper id 28201441
Paper id 28201441Paper id 28201441
Paper id 28201441
 

Kürzlich hochgeladen

presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century educationjfdjdjcjdnsjd
 
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot ModelNavi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot ModelDeepika Singh
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyKhushali Kathiriya
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...apidays
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native ApplicationsWSO2
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingEdi Saputra
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDropbox
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodJuan lago vázquez
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesrafiqahmad00786416
 
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...apidays
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAndrey Devyatkin
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...apidays
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businesspanagenda
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Zilliz
 

Kürzlich hochgeladen (20)

presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot ModelNavi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 

Arabic question answering ‫‬

  • 1. Imam University College of Computer and Information systems Computer sciences Department Arabic Question Answering : by Asma Ahmad Asma alharbi nadia AL-Mutiri Supervised by: Dr .Amal Al seef Second semester :1434-1435 2013
  • 2. Arabic Question Answering Overview: O The implementation of Arabic Question- Answering system components . O QASAL & QARAB System components. O Yes/No Arabic Question Answering.
  • 4. Named Entity Recognizer O A NER system identifies proper names, temporal and numeric expressions . O in this Arabic NER system is based ME approach. O For the proper names recognition: O For temporal and numeric expressions: is totally based on patterns and a small dictionary containing the names of days and months in Arabic, and numbers written in letters.
  • 5. The implementation of Arabic Question-Answering system O NooJ is a linguistic environment that includes large-coverage dictionaries and grammars. O a spell-checker that corrects the most frequent errors. O a named entity recognition tool which is set of rules described into local grammars
  • 7. Question analysis: this step it is apply the set of linguistic resources to the input question. For example shows the NooJ’s text annotation structure that gives the linguistic analysis of each word form in our sample question
  • 8. Passage retrieval: The first task of this step could be the selection of one or more automatically extract the answer of the input question.
  • 9. Answer Extraction: this last step uses the displayed concordance table to automatically extract the answer of the input question. Example1 :Answer Extraction for the factoid question:
  • 11. QARAB System f NLB Tool Question Question analyzer IR Ranked Documents Passage selection Hypothesize d Answer Al-Raya Newspaper Document full IR syste m
  • 12. Information Retrieval system . O To search the document collection to select documents containing information relevant to the user’s query. O Lundquist et al. [1999] IR system that can be constructed using a relational database management system (RDBMS). O But in this paper it contain following database relations: 1. ROOT_TABLE. 2. STEM_TABLE. 3. POSTING_TABLE. 4. DOCUMENT_TABLE. 5. PARAGRAPH_TABLE.
  • 13. The NLb system The NLB model is: 1. Tokenizer. 2. type finder. 3. feature finder. 4. proper noun phrase parser.
  • 14. How to extract the Answer Assume the user posed the following question to QARAB: The IR return this passage . How?!
  • 15. Step1: O performing token and remove the stop word of question , Then tagging the word for POS.
  • 16. Step 2: O QARAB constructs the query as a “bag of words” and passes it to the IR system.
  • 17. Example Step 3: Determine the expected type of the answer: Who? >>> personal name. Step4: Generating the answer.
  • 20. Question Analysis O Removing the question mark. O Removing the interrogative particle O Tokenizing: the tokenizer divides the user question into its separate words .And normalize the (Alef) letter. O Removing the stop words. O Removing the negation particles. (if it exits) and set the negation property of the question representation
  • 21. Question Analysis O Tagging: to determine the type of a word, verb or noun and obtain its root. O Parsing: recall that the Arabic sentence after the interrogative particle is nominal or verbal.
  • 22. Question Analysis In nominal sentence, we are interested with the beginning noun “topic” ( ) which is the first noun after the interrogative particle ( ). And the comment noun ( ) and we can mark it as the last noun without the article ( ). In verbal sentence we are interested with the verb of the sentence which occur immediately after the interrogative particle ( ) , and the subject that follow the verb.
  • 23. Question Analysis Logical Representation(With Nominal Sentences) Affirmative questions O N (Topic, root (Comment), root ({remaining words })) O N (Topic, root (Comment Synonyms), root ({remaining words})) O ~N (Topic, root (Comment Antonyms), root ({remaining words}))
  • 24. Question Analysis Logical Representation(With Nominal Sentences) O Negated questions : O ~N (Topic, root (Comment), root ({remaining words})) O ~N (topic, root (Comment Synonyms), root ({remaining words})) O N (Topic, root (Comment Antonyms), root ({remaining words}))
  • 25. Question Analysis O Example -----<synonym O N( , root ( ),root( )) O N( , root ( ),root( ))
  • 26. Question Analysis Logical Representation(With Verbal Sentences) Affirmative questions : O V (Subject noun, root (verb), root ({remaining words})) O V (Subject noun, root (verb Synonyms), root ({remaining words})) O ~V (Subject noun, root (verb Antonyms), root ({remaining words}))
  • 27. Question Analysis Logical Representation(With Verbal Sentences) Negated questions O ~V (Subject noun, root (verb), root ({remaining words})) O ~ V (Subject noun, root (verb Synonyms), root ({remaining words})) O V (Subject noun, root (verb Antonyms), root ({remaining words}))
  • 28. Question Analysis Example ---<Antonym O V( , root ( ),root( )) O ~V( , root ( ),root( ))
  • 29. Text Processing & Retrieval They are 20 documents in corpus. This module uses two techniques to retrieve the top 5 candidate paragraphs (with variable length (that are most relevant to the user question: O Paragraphs technique: - Split the documents into its built-in paragraphs and retrieve the top 5 paragraphs regardless from which document they are, according to some indexing scheme. O Document technique-:Retrieve the top 5 documents after they are ranked, then use the first indexing scheme to retrieve the top 5 paragraphs.
  • 30. Answer Selection & generation After the 5 paragraphs are selected using documents technique or paragraphs technique, we need to select the best sentence to represent the answer, and accordingly generates yes or no .
  • 31. Answer Selection & generation O Split the paragraphs into their sentences . O In normal sentences we are interested in the exact topic ( ) not its used root, so we omit each sentence that does not contain it (in the original form )In verbal sentence we are interested in the exact subject ( ) not its used root , so we omit each sentence that does not contain it (in the original form )
  • 32. Answer Selection & generation O In the result sentence , we look for the remaining terms (in root form) that derived from the question in the logical representation (except the subject or the topic ), if the they exist , assign those indexes according to their position in the sentence. So each sentence will have its own rank as follow : Rank =last occurrence - first occurrence O look for ( ) negation particles in the selected answer (if exist).
  • 33. Answer Selection & generation O Using the selected answer and the logical representation of the question to generate yes ,or no a follows : 1. Yes ,if : The question and the answer are affirmative .The question and the answer are negated. 2. No, if :The question if affirmative and the answer are negated.The question is negated and the answer is affirmative.
  • 34. EXPERIMENTS AND RESULTS 69%Arabic QA system 97.3%Arabic Q-A uses QARAB 83.3%PR system
  • 35. conclusion O We have described the generic architecture for AQ answer O compare with deferent system O How presses the question and give the answers.