What is KDD? What is the relationship between data mining and knowledge management? What is knowledge extraction from databases and big data?

1. ‫ﻧﺎﻋﻤﯽ‬ ‫اﻃﻬﺮ‬ :‫دﻫﻨﺪه‬ ‫اراﺋﻪ‬
Knowledge
Extraction from
Big Data

2. Data is everywhere! Big & Small
‫داده‬ ‫ﮐﻠﺎن‬ :1 ‫ﺑﺨﺶ‬

4. •
‫ﮔﻮﮔﻞ‬ ‫در‬ ‫ﺳﺮچ‬ ‫ﻣﯿﻠﯿﺎرد‬ 8.5
•
‫ﺗﻠﮕﺮام‬ ‫ﭘﯿﺎم‬ ‫ﻣﯿﻠﯿﺎرد‬ 15
•
‫واﺗﺴﺎپ‬ ‫ﭘﯿﺎم‬ ‫ﻣﯿﻠﯿﺎرد‬ 100
•
‫اﯾﻤﯿﻞ‬ ‫ﻣﯿﻠﯿﺎرد‬ 330
•
‫ﯾﻮﺗﯿﻮب‬ ‫ﺗﻤﺎﺷﺎ‬ ‫ﺳﺎﻋﺖ‬ ‫ﻣﯿﻠﯿﻮن‬ 250
•
‫ﺗﻮﯾﯿﺖ‬ ‫ﻣﯿﻠﯿﻮن‬ 500
:2022 ‫از‬ ‫روز‬ ‫ﻫﺮ‬
‫اﮔﺰاﺑﺎﯾﺖ‬ 2.5
‫ﮔﮕﺎﺑﺎﯾﺖ‬ ‫ﻣﯿﻠﯿﺎرد‬ 2.5
•
:‫ﻣﺎﺷﯿﻦ‬ ‫ﺑﻪ‬ ‫ﻣﺎﺷﯿﻦ‬
،‫ﻧﻈﺎرﺗﯽ‬ ‫ﻫﺎي‬‫دورﺑﯿﻦ‬ ،‫ﺑﺎرﮐﺪ‬ ‫اﺳﮑﻨﺮ‬ ،GPS ‫ﻫﺎي‬‫دﺳﺘﮕﺎه‬ ،‫ﺳﻨﺴﻮرﻫﺎ‬
‫ﻋﻠﻤﯽ‬ ‫ﺗﺤﻘﯿﻘﺎت‬
•
:‫ﻣﺎﺷﯿﻦ‬ ‫ﺑﻪ‬ ‫اﻧﺴﺎن‬
‫ﻫﺎي‬‫ﮐﺎرت‬ ،‫اﻟﮑﺘﺮوﻧﯿﮏ‬ ‫ﺗﺠﺎرت‬ ،TV ،‫ﭘﺰﺷﮑﯽ‬ ‫ﻫﺎي‬‫دﺳﺘﮕﺎه‬ ،‫آرﺷﯿﻮﻫﺎ‬
‫ﻫﺎ‬‫ﮔﻮﺷﯽ‬ ،‫ﮐﺎﻣﭙﯿﻮﺗﺮﻫﺎ‬ ،‫ﻫﻮﺷﻤﻨﺪ‬ ‫ﮐﺎرت‬ ،‫ﺑﺎﻧﮑﯽ‬
•
:‫اﻧﺴﺎن‬ ‫ﺑﻪ‬ ‫اﻧﺴﺎن‬
‫ﻫﺎ‬‫وﺑﻼگ‬ ،‫اﺟﺘﻤﺎﻋﯽ‬ ‫ﻫﺎي‬‫ﺷﺒﮑﻪ‬ ،‫ﻣﺠﺎزي‬ ‫ﺟﻮاﻣﻊ‬ ،Netizens
Volume Velocity Variety
‫دﯾﺘﺎ‬ ‫ﺧﻠﻖ‬ ‫ﺣﺠﻢ‬
= ‫ﻣﮕﺎﺑﺎﯾﺖ‬ 300‫ﻧﻔﺮي‬
،‫ﻫﻮاﺷﻨﺎﺳﯽ‬ ،‫آﻣﺎري‬ ،‫ﻣﺎﻟﯽ‬ ،‫ﻋﻠﻤﯽ‬ ،‫ﻓﺮﻫﻨﮕﯽ‬ ،‫ﺟﻐﺮاﻓﯿﺎﯾﯽ‬
‫ﻧﻘﻞ‬ ‫و‬ ‫ﺣﻤﻞ‬ ،‫ﻃﺒﯿﻌﯽ‬
‫ﮔﺴﺴﺘﻪ‬ ،‫ﭘﯿﻮﺳﺘﻪ‬ :‫ﮐﻤﯽ‬
‫ﺗﺮﺗﯿﺒﯽ‬ ،‫اﺳﻤﯽ‬ :‫ﮐﯿﻔﯽ‬

5. Big Data
‫داده‬ ‫کالن‬
Small Data
‫داده‬ ‫خرد‬
‫حجم‬
‫ترابایت‬ ‫از‬ ‫بزرگتر‬
(‫زتابایت‬ ،‫اگزابایت‬ ،‫)پتابایت‬
‫ترابایت‬ ‫از‬ ‫کوچکتر‬
(‫)گگابایت‬
‫دیتابیس‬ NoSQL SQL
‫سورس‬ ‫شرکت‬ ‫از‬ ‫خارج‬ ‫شرکت‬ ‫درون‬
‫تکنولوژی‬ ‫مدرن‬ ‫سنتی‬
‫سرعت‬ Real Time Near Real Time
‫مثال‬ Social Media, Sensor CRM, general ledger data
Data
aggregation
‫سریع‬ ‫کند‬

7. ‫داده‬ ‫ﺧﺮد‬ ‫از‬ ‫داﻧﺶ‬ ‫اﺳﺘﺨﺮاج‬
‫داده‬ ‫ﮐﻠﺎن‬ ‫از‬ ‫داﻧﺶ‬ ‫اﺳﺘﺨﺮاج‬

8. Data Science
Business Analytics
Data Analytics
Data Analysis
Business Analysis
Business Intelligence
‫دارﻧﺪ؟‬ ‫ﺗﻔﺎوﺗﯽ‬ ‫ﭼﻪ‬ ‫اﻣﺎ‬ ،‫دﯾﺘﺎﻣﺤﻮرﻧﺪ‬ ‫ﻫﻤﮕﯽ‬ :2 ‫ﺑﺨﺶ‬

10. Business intelligence Data science. .
BI focuses on
analyzing past events.
DS aims to
predict future trends.

11. (Multidisiplinary) ‫دﯾﺘﺎﺳﺎﯾﻨﺲ‬ ‫ﻓﯿﻠﺪﻫﺎي‬

12. (Multidisiplinary) ‫دﯾﺘﺎﺳﺎﯾﻨﺲ‬ ‫ﻓﯿﻠﺪﻫﺎي‬

13. The Data Analysis Process
Source: Google Data Analytics Degree

14. • Identify
• Create
• Store
• Share
• Apply
Process

15. statistics, and database systems.
‫داده‬ ‫ﻋﻈﯿﻢ‬ ‫ﻫﺎي‬‫ﻣﺠﻤﻮﻋﻪ‬ ‫در‬ (extracting and discovering patterns) ‫اﻟﮕﻮﻫﺎ‬ ‫اﮐﺘﺸﺎف‬ ‫و‬ ‫اﺳﺘﺨﺮاج‬ ‫ﻓﺮآﯾﻨﺪ‬
.‫ﮐﻨﺪ‬‫ﻣﯽ‬ ‫درﮔﯿﺮ‬ ‫را‬ ‫دﯾﺘﺎﺑﯿﺲ‬ ‫ﻫﺎي‬‫ﺳﯿﺴﺘﻢ‬ ‫و‬ ،‫آﻣﺎر‬ ،‫ﻣﺎﺷﯿﻦ‬ ‫ﯾﺎدﮔﯿﺮي‬ ‫ﻣﺘﻮدﻫﺎي‬ ‫ﮐﻪ‬ (large data sets)
(Data Mining) ‫ﮐﺎوي‬ ‫داده‬ : 3 ‫ﺑﺨﺶ‬

16. .‫داﻧﻨﺪ‬‫ﻣﯽ‬ KDD ‫ﻣﺘﺮادف‬ ‫را‬ ‫ﮐﺎوي‬ ‫داده‬ ،‫ﻣﺮدم‬ ‫از‬ ‫ﺑﺴﯿﺎري‬
…‫اﻣﺎ‬
.‫اﺳﺖ‬ ‫داده‬ ‫از‬ ‫ﻣﻔﯿﺪ‬ ‫داﻧﺶ‬ (Extracting) ‫اﺳﺘﺨﺮاج‬ ‫ﻓﺮاﯾﻨﺪ‬ ،‫داﻧﺶ‬ ‫ﮐﺸﻒ‬
Knowledge Discovery in Databases = ‫ﻫﺎ‬‫داده‬‫ﭘﺎﯾﮕﺎه‬ ‫در‬ ‫داﻧﺶ‬ ‫ﮐﺸﻒ‬
Knowledge Discovery and Data Mining = ‫ﮐﺎوي‬ ‫داده‬ ‫و‬ ‫داﻧﺶ‬ ‫ﮐﺸﻒ‬

18. 2
1
3
4
5
6
CRISP-DM SEMMA

19. Raw
Extracted
Patterns
Pre-
Internalization/
Interpretaion/
Evaluation
KDD

20. 2- Selection: Creating a Target Data set

21. 3- Data Cleaning and Preprocessing

22. - Pre-defined data
models like
databases
- Usually text only
- Easy to search
and filter
Examples: dates,
phone numbers,
transaction
information
- Both structured
and unstructured
qualities
- Considerably
easier to analyze
and unstructured
data
Examples: emails
CSV files, JSON
files.
- No pre-defined data models.
- Difficult to search through.
- Usually stored as different types of files.
Examples: social media data, audio files images.
4- Data Transformation
The process of converting data from one format or structure into another format or structure.

23. 5- Modeling: Choosing the Suitable Data Mining Task

24. 6- Modeling: Choosing the Suitable Data Mining Algorithm

25. The use of computers to perform tasks that rely on
complex analyses, subtle judgments, and creative problem solving.
McKinsey Global Institute
knowledge work automation : 4 ‫ﺑﺨﺶ‬

26. Workers whose main capital is knowledge.
Examples: programmers, physicians, pharmacists, architects,
engineers, scientists, design thinkers, public accountants,
lawyers, editors, and academics, whose job is to "think for a living".
Knowledge worker-‫داﻧﺸﮑﺎر‬

27. In 2025, annual

29. .‫ﺳﭙﺎﺳﮕﺰارم‬ ‫ﺷﻤﺎ‬ ‫ﺗﻮﺟﻪ‬ ‫از‬