Opinion Mining using Data Mining Techniques

1. Data Mining: Concepts and Techniques
Opinion Mining from Bangla Text
using Data Mining Techniques
Opinion Mining : Concepts and Techniques

2. Data Mining: Concepts and TechniquesOpinion Mining : Concepts and Techniques
Thesis: CSE-4000
Presented by
Zakia Afrin
Roll: 1007017
Mir Shahriar Sabuj
Roll: 1007033
Supervisor
Dr. K. M. Azharul Hasan
Professor
Dept. of CSE, KUET

3. Data Mining: Concepts and TechniquesOpinion Mining : Concepts and Techniques
Presentation Layout
 Introduction
 Objectives
 Previous works
 Mining Techniques
Naïve Bayes
Maximum Entropy
Support vector Machine
 Procedure
 Future plan

4. Data Mining: Concepts and TechniquesOpinion Mining : Concepts and Techniques
“What people think?”
What others think is always an important piece of information.
“Which car should I buy?”
“Which varsities should I apply to?”
“Which professor to work for?”
“Whom should I vote for?”

5. Data Mining: Concepts and TechniquesOpinion Mining : Concepts and Techniques
“So whom shall I ask?”
 Pre Web
Friends and Relatives
Acquaintances
Consumer Reports
 Post Web
“…I don’t know who..but apparently it’s a good product…”
Blogs
E-commerce sites
Review sites
Discussion forums

6. Data Mining: Concepts and TechniquesOpinion Mining : Concepts and Techniques
“Yes! I have the reviews I need”
Is this easy to make decision??
….Not Quite
 Searching for reviews may be difficult
 Large amount of information on one topic
 Difficult to analyze each and every review
 Reviews are expressed in different ways
 Difficult to analyze each and every review
 Reviews are expressed in different ways

7. Data Mining: Concepts and TechniquesOpinion Mining : Concepts and Techniques
Objectives
 To use data mining techniques to seek out and
understand the opinions of others.
 To develop a software system that will ease making
decisions from large amount of reviews.
 To work with Bangla texts.

8. Data Mining: Concepts and TechniquesOpinion Mining : Concepts and Techniques
Related Works
 Extract positive/negative opinion words
Hatzivassiloglou & McKeown’97, Turney’03, etc.
 Classify reviews as positive or negative
Turney’02, Pang’02, Kushal’03
 Identify feature-opinion pairs together with the
polarity of each opinion
Hu & Liu’04, Hu & Liu’05

9. Data Mining: Concepts and TechniquesOpinion Mining : Concepts and Techniques
Data Mining Techniques
 Naïve Bayes
 Maximum Entropy
 Support Vector Machines

10. Data Mining: Concepts and TechniquesOpinion Mining : Concepts and Techniques
Data Mining Techniques
 Naïve Bayes
 Maximum Entropy
 Support Vector Machines

11. Data Mining: Concepts and TechniquesOpinion Mining : Concepts and Techniques
Naïve Bayes(i)

12. Data Mining: Concepts and TechniquesOpinion Mining : Concepts and Techniques
Naïve Bayes(ii)

13. Data Mining: Concepts and TechniquesOpinion Mining : Concepts and Techniques
Naïve Bayes(iii)
here,

14. Data Mining: Concepts and TechniquesOpinion Mining : Concepts and Techniques
Data Mining Techniques
 Naïve Bayes
 Maximum Entropy
 Support Vector Machines

15. Data Mining: Concepts and TechniquesOpinion Mining : Concepts and Techniques
Maximum Entropy(i)

16. Data Mining: Concepts and TechniquesOpinion Mining : Concepts and Techniques
Maximum Entropy(ii)
Document d
Until
convergence

17. Data Mining: Concepts and TechniquesOpinion Mining : Concepts and Techniques
Data Mining Techniques
 Naïve Bayes
 Maximum Entropy
 Support Vector Machines

18. Data Mining: Concepts and TechniquesOpinion Mining : Concepts and Techniques
Support Vector Machines(i)
x
x
x
x
xx
x
x
x
x
o
o
o
o
o
o
o
 Binary Classification
problem
 The data above the red
line belongs to class ‘x’
 The data below red line
belongs to class ‘o’

19. Data Mining: Concepts and TechniquesOpinion Mining : Concepts and Techniques
Support Vector Machines(ii)
Var1
Var2
Margin
Width
Class A
Class B

20. Data Mining: Concepts and TechniquesOpinion Mining : Concepts and Techniques
Support Vector Machines(ii)
Var1
Var2
Support Vectors
Class A
Class B

21. Data Mining: Concepts and TechniquesOpinion Mining : Concepts and Techniques
Support Vector Machines(iii)
Var2
=-1
=+1
φ=Rd
→Η
=-1
=+1
Rd
Η
φ

22. Data Mining: Concepts and TechniquesOpinion Mining : Concepts and Techniques
Procedure
Var2
Data Mining
Techniques
Process of Sentiment Analysis and Opinion Mining

23. Data Mining: Concepts and TechniquesOpinion Mining : Concepts and Techniques
Future Scope
Var2
 Develop a software based system for opinion
mining from bangla language.
 Scaling techniques will be applied to make
improvements in opinion mining.

24. Data Mining: Concepts and TechniquesOpinion Mining : Concepts and Techniques
Conclusion
Var2
 Opinion search is different from general web
search
 Opinion mining is important for formulating
decisions easily
 Data mining techniques make improvements for
opinion mining

25. Data Mining: Concepts and TechniquesOpinion Mining : Concepts and Techniques Var2
Thank You.