SlideShare ist ein Scribd-Unternehmen logo
1 von 28
Mining knowledge in news
for personalization
Dung Chu and David Graus,
data scientists
FD Mediagroep
Outline
• Introduction FDMG
• AI use cases:
– FD personalized newsletter
– CompanyInfo entity linker
– Smart Radio
FD mediagroep
Het Financieele Dagblad
Het Financieele Dagblad is dé nieuws- en inspiratiebron die op elk
moment van de dag financieel-economische betekenis geeft aan
ontwikkelingen in de wereld.
Company info geeft altijd real time toegang tot actuele bedrijfs- en
prospectinformatie van 2,5 miljoen bedrijven in Nederland
FD/BNR Networks
FD/BNR Networks brengt ideeën, meningen en talentrijke
ondernemers en professionals samen door de organisatie van o.a.
forums, debatten, netwerksessies, en evenementenreeksen.
BNR Nieuwsradio
BNR Nieuwsradio is de enige radiozender in Nederland waar
ambitieuze en ondernemende mensen 24 uur per dag op de hoogte
worden gehouden van relevant nieuws.
FD Mediagroep helpt om betere beslissingen te nemen door overzicht, inzicht én
(vooruit)zicht te bieden met journalistieke merken en hoogstaande kwalitatieve producten.
FD personalized newsletter
FD personalized newsletter: goals
• Diversify content sent to readers
• Improve engagement
FD personalized newsletters
• Rich data:
– Logged-in data with unique client ID
• Recommendation model: Item-to-item collaborative
filtering
Published
last week
Older
articles
PySpark:
+ Convert reader-article matrix to IndexedRowMatrix
+ columnSimilarities(): fast compute of cosine
similarity between columns
Results: free clients
T-test
Results: paid clients (fixed 2000)
T-test
Content diversification
Popularity emails
Personalized emails
7 articles 178 articles (60 clicked)
Long tail
articles
25000
15000
CompanyInfo entity linker
Ref: https://www.slideshare.net/davidgraus/financial-news-mining-pydata-amsterdam
11
12
Situation before
• Manual process
• Not able to process many articles
Rich data
1. Knowledge Base (Company.info):
– >2.8M organization profiles
– Rich metadata: sector information, financial information,
people, buildings, etc…
2. News articles:
– >1200 sources (Dutch, online)
• From Het Financieele Dagblad to the Groninger Gezinsbode
– Around ~4k articles per day
– Multiple years of hand-labeled archive
Model
• Two stage approach:
– Named-entity recognition
– Entity Linking using binary classification
• Predict whether mention m should be linked to entity candidate c
Pipeline
16
1. 0. 1. 1. 0.
Doc
NER mention1 org1
org2
org3
…
org n
Extract
Features
1. 0. 0. 1. 0.
1. 1. 0. 0. 0.
1. 0. 1. 1. 0.
RF
1
0
mention2
mention3
0.647
…
0.873
0.780
0.342
…
Pipeline
17
1. 0. 1. 1. 0.
NER mention1 org1
org2
org3
org n
Extract
Features
1. 0. 0. 1. 0.
1. 1. 0. 0. 0.
1. 0. 1. 1. 0.
RF
1
0
mention2
mention3
0.647
0.873
0.780
0.342
…… …
Pipeline
18
1. 0. 1. 1. 0.
NER mention1 org2
org3
org1
org n
Extract
Features
1. 0. 0. 1. 0.
1. 1. 0. 0. 0.
1. 0. 1. 1. 0.
RF
1
0
mention2
mention3
0.873
0.780
0.647
0.342
…… …
org3 1. 0. 1. 1. 0. 0.780
Pipeline
19
1. 0. 1. 1. 0.
NER mention1
org1
…
org n
Extract
Features
1. 0. 0. 1. 0.
RF
1
0
mention2
mention3 0.647
0.342
…
org2 1. 1. 0. 0. 0. 0.873
…
Evaluation
• Take data, make train/test-split
– NER: ~85%
– EL: ~85%
• But: Data is noisy/biased
– + Manual inspection
20
Results
– Replace previous manual process
– Number of articles per day: approx. +160%
– Number of linked orgs: approx. +310%
– More “long tail” articles
21
Smart Radio
Smart Radio – audio personalization
• Current audio listening experience:
– Passive listening
– Long audio data with mix of topics
• New way:
– On demand and personalized listening
TV
Radio
Smart Radio - BNR app
Smart Radio – pipeline “serverless”
Take-home messages
• AI projects add values to existing businesses
• Diversify content delivered to customers: enable
“long tail” articles/audio fragments
• In combination with rich data, simple AI models work
• Our solutions are re-usable
Upcoming projects
• Fully automatic audio segmentation
• Personalized summarization of news articles
Twitter: @dungchu
Email: dung.manh.chu@fdmediagroep.nl
LinkedIn: https://www.linkedin.com/in/dungmanhchu/

Weitere ähnliche Inhalte

Ähnlich wie Mining news for personalized recommendations

Digital Transformation and the Journey to a Highly Connected Enterprise
Digital Transformation and the Journey to a Highly Connected EnterpriseDigital Transformation and the Journey to a Highly Connected Enterprise
Digital Transformation and the Journey to a Highly Connected EnterpriseNeo4j
 
Social media radar | Artur Karda
Social media radar | Artur KardaSocial media radar | Artur Karda
Social media radar | Artur KardaArtur Karda
 
Kiev congress social media radar - artur karda 2011-10-21
Kiev congress   social media radar - artur karda 2011-10-21Kiev congress   social media radar - artur karda 2011-10-21
Kiev congress social media radar - artur karda 2011-10-21Oksana Kushnir
 
Powerful Information Discovery with Big Knowledge Graphs –The Offshore Leaks ...
Powerful Information Discovery with Big Knowledge Graphs –The Offshore Leaks ...Powerful Information Discovery with Big Knowledge Graphs –The Offshore Leaks ...
Powerful Information Discovery with Big Knowledge Graphs –The Offshore Leaks ...Connected Data World
 
B.Pearson_Ten Trends Reshaping our Industry_r01
B.Pearson_Ten Trends Reshaping our Industry_r01B.Pearson_Ten Trends Reshaping our Industry_r01
B.Pearson_Ten Trends Reshaping our Industry_r01W2O Group
 
Open Data and News Analytics Demo
Open Data and News Analytics DemoOpen Data and News Analytics Demo
Open Data and News Analytics DemoOntotext
 
Predictive Analytics World Chicago 2015
Predictive Analytics World Chicago 2015Predictive Analytics World Chicago 2015
Predictive Analytics World Chicago 2015Dan Potter
 
Advanced Analytics for Any Data at Real-Time Speed
Advanced Analytics for Any Data at Real-Time SpeedAdvanced Analytics for Any Data at Real-Time Speed
Advanced Analytics for Any Data at Real-Time Speeddanpotterdwch
 
IABE Big Data information paper - An actuarial perspective
IABE Big Data information paper - An actuarial perspectiveIABE Big Data information paper - An actuarial perspective
IABE Big Data information paper - An actuarial perspectiveMateusz Maj
 
Single Cell RNA Sequencing Market.pdf
 Single Cell RNA Sequencing Market.pdf Single Cell RNA Sequencing Market.pdf
Single Cell RNA Sequencing Market.pdfBIS Research Inc.
 
Technology Planning Document V1.1
Technology Planning Document V1.1Technology Planning Document V1.1
Technology Planning Document V1.1digital.signage
 
Technology Planning Document_v1.1
Technology Planning Document_v1.1Technology Planning Document_v1.1
Technology Planning Document_v1.1Raju Nair
 
Climate change action through artificial intelligence
Climate change action through artificial intelligenceClimate change action through artificial intelligence
Climate change action through artificial intelligenceweADAPT
 
News Media Metadata - The Current Landscape
News Media Metadata - The Current LandscapeNews Media Metadata - The Current Landscape
News Media Metadata - The Current LandscapeRichard Wallis
 
Paola Mazzucchi, AIE and mEDRA Project Manager, Converging metadata for conve...
Paola Mazzucchi, AIE and mEDRA Project Manager, Converging metadata for conve...Paola Mazzucchi, AIE and mEDRA Project Manager, Converging metadata for conve...
Paola Mazzucchi, AIE and mEDRA Project Manager, Converging metadata for conve...TISP Project
 
Moving Targets: Harnessing Real-time Value from Data in Motion
Moving Targets: Harnessing Real-time Value from Data in Motion Moving Targets: Harnessing Real-time Value from Data in Motion
Moving Targets: Harnessing Real-time Value from Data in Motion Inside Analysis
 
Presentation by Ivan Schotsmans (DV Community) at the Data Vault Modelling an...
Presentation by Ivan Schotsmans (DV Community) at the Data Vault Modelling an...Presentation by Ivan Schotsmans (DV Community) at the Data Vault Modelling an...
Presentation by Ivan Schotsmans (DV Community) at the Data Vault Modelling an...Patrick Van Renterghem
 
GanttChart for ClearQuest User Guide
GanttChart for ClearQuest User GuideGanttChart for ClearQuest User Guide
GanttChart for ClearQuest User GuideAlexander Novichkov
 
Empowering the Intelligent Enterprise
Empowering the Intelligent EnterpriseEmpowering the Intelligent Enterprise
Empowering the Intelligent EnterpriseChristine Connors
 

Ähnlich wie Mining news for personalized recommendations (20)

Digital Transformation and the Journey to a Highly Connected Enterprise
Digital Transformation and the Journey to a Highly Connected EnterpriseDigital Transformation and the Journey to a Highly Connected Enterprise
Digital Transformation and the Journey to a Highly Connected Enterprise
 
Social media radar | Artur Karda
Social media radar | Artur KardaSocial media radar | Artur Karda
Social media radar | Artur Karda
 
Kiev congress social media radar - artur karda 2011-10-21
Kiev congress   social media radar - artur karda 2011-10-21Kiev congress   social media radar - artur karda 2011-10-21
Kiev congress social media radar - artur karda 2011-10-21
 
Powerful Information Discovery with Big Knowledge Graphs –The Offshore Leaks ...
Powerful Information Discovery with Big Knowledge Graphs –The Offshore Leaks ...Powerful Information Discovery with Big Knowledge Graphs –The Offshore Leaks ...
Powerful Information Discovery with Big Knowledge Graphs –The Offshore Leaks ...
 
B.Pearson_Ten Trends Reshaping our Industry_r01
B.Pearson_Ten Trends Reshaping our Industry_r01B.Pearson_Ten Trends Reshaping our Industry_r01
B.Pearson_Ten Trends Reshaping our Industry_r01
 
Open Data and News Analytics Demo
Open Data and News Analytics DemoOpen Data and News Analytics Demo
Open Data and News Analytics Demo
 
Predictive Analytics World Chicago 2015
Predictive Analytics World Chicago 2015Predictive Analytics World Chicago 2015
Predictive Analytics World Chicago 2015
 
Advanced Analytics for Any Data at Real-Time Speed
Advanced Analytics for Any Data at Real-Time SpeedAdvanced Analytics for Any Data at Real-Time Speed
Advanced Analytics for Any Data at Real-Time Speed
 
IABE Big Data information paper - An actuarial perspective
IABE Big Data information paper - An actuarial perspectiveIABE Big Data information paper - An actuarial perspective
IABE Big Data information paper - An actuarial perspective
 
Single Cell RNA Sequencing Market.pdf
 Single Cell RNA Sequencing Market.pdf Single Cell RNA Sequencing Market.pdf
Single Cell RNA Sequencing Market.pdf
 
Technology Planning Document V1.1
Technology Planning Document V1.1Technology Planning Document V1.1
Technology Planning Document V1.1
 
Technology Planning Document_v1.1
Technology Planning Document_v1.1Technology Planning Document_v1.1
Technology Planning Document_v1.1
 
Climate change action through artificial intelligence
Climate change action through artificial intelligenceClimate change action through artificial intelligence
Climate change action through artificial intelligence
 
News Media Metadata - The Current Landscape
News Media Metadata - The Current LandscapeNews Media Metadata - The Current Landscape
News Media Metadata - The Current Landscape
 
Paola Mazzucchi, AIE and mEDRA Project Manager, Converging metadata for conve...
Paola Mazzucchi, AIE and mEDRA Project Manager, Converging metadata for conve...Paola Mazzucchi, AIE and mEDRA Project Manager, Converging metadata for conve...
Paola Mazzucchi, AIE and mEDRA Project Manager, Converging metadata for conve...
 
Moving Targets: Harnessing Real-time Value from Data in Motion
Moving Targets: Harnessing Real-time Value from Data in Motion Moving Targets: Harnessing Real-time Value from Data in Motion
Moving Targets: Harnessing Real-time Value from Data in Motion
 
Presentation by Ivan Schotsmans (DV Community) at the Data Vault Modelling an...
Presentation by Ivan Schotsmans (DV Community) at the Data Vault Modelling an...Presentation by Ivan Schotsmans (DV Community) at the Data Vault Modelling an...
Presentation by Ivan Schotsmans (DV Community) at the Data Vault Modelling an...
 
2011 CBSi Overview
2011 CBSi Overview2011 CBSi Overview
2011 CBSi Overview
 
GanttChart for ClearQuest User Guide
GanttChart for ClearQuest User GuideGanttChart for ClearQuest User Guide
GanttChart for ClearQuest User Guide
 
Empowering the Intelligent Enterprise
Empowering the Intelligent EnterpriseEmpowering the Intelligent Enterprise
Empowering the Intelligent Enterprise
 

Kürzlich hochgeladen

User Guide: Capricorn FLX™ Weather Station
User Guide: Capricorn FLX™ Weather StationUser Guide: Capricorn FLX™ Weather Station
User Guide: Capricorn FLX™ Weather StationColumbia Weather Systems
 
User Guide: Orion™ Weather Station (Columbia Weather Systems)
User Guide: Orion™ Weather Station (Columbia Weather Systems)User Guide: Orion™ Weather Station (Columbia Weather Systems)
User Guide: Orion™ Weather Station (Columbia Weather Systems)Columbia Weather Systems
 
Call Girls in Majnu Ka Tilla Delhi 🔝9711014705🔝 Genuine
Call Girls in Majnu Ka Tilla Delhi 🔝9711014705🔝 GenuineCall Girls in Majnu Ka Tilla Delhi 🔝9711014705🔝 Genuine
Call Girls in Majnu Ka Tilla Delhi 🔝9711014705🔝 Genuinethapagita
 
OECD bibliometric indicators: Selected highlights, April 2024
OECD bibliometric indicators: Selected highlights, April 2024OECD bibliometric indicators: Selected highlights, April 2024
OECD bibliometric indicators: Selected highlights, April 2024innovationoecd
 
GenBio2 - Lesson 1 - Introduction to Genetics.pptx
GenBio2 - Lesson 1 - Introduction to Genetics.pptxGenBio2 - Lesson 1 - Introduction to Genetics.pptx
GenBio2 - Lesson 1 - Introduction to Genetics.pptxBerniceCayabyab1
 
FREE NURSING BUNDLE FOR NURSES.PDF by na
FREE NURSING BUNDLE FOR NURSES.PDF by naFREE NURSING BUNDLE FOR NURSES.PDF by na
FREE NURSING BUNDLE FOR NURSES.PDF by naJASISJULIANOELYNV
 
Microphone- characteristics,carbon microphone, dynamic microphone.pptx
Microphone- characteristics,carbon microphone, dynamic microphone.pptxMicrophone- characteristics,carbon microphone, dynamic microphone.pptx
Microphone- characteristics,carbon microphone, dynamic microphone.pptxpriyankatabhane
 
RESPIRATORY ADAPTATIONS TO HYPOXIA IN HUMNAS.pptx
RESPIRATORY ADAPTATIONS TO HYPOXIA IN HUMNAS.pptxRESPIRATORY ADAPTATIONS TO HYPOXIA IN HUMNAS.pptx
RESPIRATORY ADAPTATIONS TO HYPOXIA IN HUMNAS.pptxFarihaAbdulRasheed
 
BIOETHICS IN RECOMBINANT DNA TECHNOLOGY.
BIOETHICS IN RECOMBINANT DNA TECHNOLOGY.BIOETHICS IN RECOMBINANT DNA TECHNOLOGY.
BIOETHICS IN RECOMBINANT DNA TECHNOLOGY.PraveenaKalaiselvan1
 
Behavioral Disorder: Schizophrenia & it's Case Study.pdf
Behavioral Disorder: Schizophrenia & it's Case Study.pdfBehavioral Disorder: Schizophrenia & it's Case Study.pdf
Behavioral Disorder: Schizophrenia & it's Case Study.pdfSELF-EXPLANATORY
 
LIGHT-PHENOMENA-BY-CABUALDIONALDOPANOGANCADIENTE-CONDEZA (1).pptx
LIGHT-PHENOMENA-BY-CABUALDIONALDOPANOGANCADIENTE-CONDEZA (1).pptxLIGHT-PHENOMENA-BY-CABUALDIONALDOPANOGANCADIENTE-CONDEZA (1).pptx
LIGHT-PHENOMENA-BY-CABUALDIONALDOPANOGANCADIENTE-CONDEZA (1).pptxmalonesandreagweneth
 
Call Girls In Nihal Vihar Delhi ❤️8860477959 Looking Escorts In 24/7 Delhi NCR
Call Girls In Nihal Vihar Delhi ❤️8860477959 Looking Escorts In 24/7 Delhi NCRCall Girls In Nihal Vihar Delhi ❤️8860477959 Looking Escorts In 24/7 Delhi NCR
Call Girls In Nihal Vihar Delhi ❤️8860477959 Looking Escorts In 24/7 Delhi NCRlizamodels9
 
Vision and reflection on Mining Software Repositories research in 2024
Vision and reflection on Mining Software Repositories research in 2024Vision and reflection on Mining Software Repositories research in 2024
Vision and reflection on Mining Software Repositories research in 2024AyushiRastogi48
 
Topic 9- General Principles of International Law.pptx
Topic 9- General Principles of International Law.pptxTopic 9- General Principles of International Law.pptx
Topic 9- General Principles of International Law.pptxJorenAcuavera1
 
User Guide: Pulsar™ Weather Station (Columbia Weather Systems)
User Guide: Pulsar™ Weather Station (Columbia Weather Systems)User Guide: Pulsar™ Weather Station (Columbia Weather Systems)
User Guide: Pulsar™ Weather Station (Columbia Weather Systems)Columbia Weather Systems
 
Bioteknologi kelas 10 kumer smapsa .pptx
Bioteknologi kelas 10 kumer smapsa .pptxBioteknologi kelas 10 kumer smapsa .pptx
Bioteknologi kelas 10 kumer smapsa .pptx023NiWayanAnggiSriWa
 
Base editing, prime editing, Cas13 & RNA editing and organelle base editing
Base editing, prime editing, Cas13 & RNA editing and organelle base editingBase editing, prime editing, Cas13 & RNA editing and organelle base editing
Base editing, prime editing, Cas13 & RNA editing and organelle base editingNetHelix
 
Pests of soyabean_Binomics_IdentificationDr.UPR.pdf
Pests of soyabean_Binomics_IdentificationDr.UPR.pdfPests of soyabean_Binomics_IdentificationDr.UPR.pdf
Pests of soyabean_Binomics_IdentificationDr.UPR.pdfPirithiRaju
 
Pests of Bengal gram_Identification_Dr.UPR.pdf
Pests of Bengal gram_Identification_Dr.UPR.pdfPests of Bengal gram_Identification_Dr.UPR.pdf
Pests of Bengal gram_Identification_Dr.UPR.pdfPirithiRaju
 
Pests of Blackgram, greengram, cowpea_Dr.UPR.pdf
Pests of Blackgram, greengram, cowpea_Dr.UPR.pdfPests of Blackgram, greengram, cowpea_Dr.UPR.pdf
Pests of Blackgram, greengram, cowpea_Dr.UPR.pdfPirithiRaju
 

Kürzlich hochgeladen (20)

User Guide: Capricorn FLX™ Weather Station
User Guide: Capricorn FLX™ Weather StationUser Guide: Capricorn FLX™ Weather Station
User Guide: Capricorn FLX™ Weather Station
 
User Guide: Orion™ Weather Station (Columbia Weather Systems)
User Guide: Orion™ Weather Station (Columbia Weather Systems)User Guide: Orion™ Weather Station (Columbia Weather Systems)
User Guide: Orion™ Weather Station (Columbia Weather Systems)
 
Call Girls in Majnu Ka Tilla Delhi 🔝9711014705🔝 Genuine
Call Girls in Majnu Ka Tilla Delhi 🔝9711014705🔝 GenuineCall Girls in Majnu Ka Tilla Delhi 🔝9711014705🔝 Genuine
Call Girls in Majnu Ka Tilla Delhi 🔝9711014705🔝 Genuine
 
OECD bibliometric indicators: Selected highlights, April 2024
OECD bibliometric indicators: Selected highlights, April 2024OECD bibliometric indicators: Selected highlights, April 2024
OECD bibliometric indicators: Selected highlights, April 2024
 
GenBio2 - Lesson 1 - Introduction to Genetics.pptx
GenBio2 - Lesson 1 - Introduction to Genetics.pptxGenBio2 - Lesson 1 - Introduction to Genetics.pptx
GenBio2 - Lesson 1 - Introduction to Genetics.pptx
 
FREE NURSING BUNDLE FOR NURSES.PDF by na
FREE NURSING BUNDLE FOR NURSES.PDF by naFREE NURSING BUNDLE FOR NURSES.PDF by na
FREE NURSING BUNDLE FOR NURSES.PDF by na
 
Microphone- characteristics,carbon microphone, dynamic microphone.pptx
Microphone- characteristics,carbon microphone, dynamic microphone.pptxMicrophone- characteristics,carbon microphone, dynamic microphone.pptx
Microphone- characteristics,carbon microphone, dynamic microphone.pptx
 
RESPIRATORY ADAPTATIONS TO HYPOXIA IN HUMNAS.pptx
RESPIRATORY ADAPTATIONS TO HYPOXIA IN HUMNAS.pptxRESPIRATORY ADAPTATIONS TO HYPOXIA IN HUMNAS.pptx
RESPIRATORY ADAPTATIONS TO HYPOXIA IN HUMNAS.pptx
 
BIOETHICS IN RECOMBINANT DNA TECHNOLOGY.
BIOETHICS IN RECOMBINANT DNA TECHNOLOGY.BIOETHICS IN RECOMBINANT DNA TECHNOLOGY.
BIOETHICS IN RECOMBINANT DNA TECHNOLOGY.
 
Behavioral Disorder: Schizophrenia & it's Case Study.pdf
Behavioral Disorder: Schizophrenia & it's Case Study.pdfBehavioral Disorder: Schizophrenia & it's Case Study.pdf
Behavioral Disorder: Schizophrenia & it's Case Study.pdf
 
LIGHT-PHENOMENA-BY-CABUALDIONALDOPANOGANCADIENTE-CONDEZA (1).pptx
LIGHT-PHENOMENA-BY-CABUALDIONALDOPANOGANCADIENTE-CONDEZA (1).pptxLIGHT-PHENOMENA-BY-CABUALDIONALDOPANOGANCADIENTE-CONDEZA (1).pptx
LIGHT-PHENOMENA-BY-CABUALDIONALDOPANOGANCADIENTE-CONDEZA (1).pptx
 
Call Girls In Nihal Vihar Delhi ❤️8860477959 Looking Escorts In 24/7 Delhi NCR
Call Girls In Nihal Vihar Delhi ❤️8860477959 Looking Escorts In 24/7 Delhi NCRCall Girls In Nihal Vihar Delhi ❤️8860477959 Looking Escorts In 24/7 Delhi NCR
Call Girls In Nihal Vihar Delhi ❤️8860477959 Looking Escorts In 24/7 Delhi NCR
 
Vision and reflection on Mining Software Repositories research in 2024
Vision and reflection on Mining Software Repositories research in 2024Vision and reflection on Mining Software Repositories research in 2024
Vision and reflection on Mining Software Repositories research in 2024
 
Topic 9- General Principles of International Law.pptx
Topic 9- General Principles of International Law.pptxTopic 9- General Principles of International Law.pptx
Topic 9- General Principles of International Law.pptx
 
User Guide: Pulsar™ Weather Station (Columbia Weather Systems)
User Guide: Pulsar™ Weather Station (Columbia Weather Systems)User Guide: Pulsar™ Weather Station (Columbia Weather Systems)
User Guide: Pulsar™ Weather Station (Columbia Weather Systems)
 
Bioteknologi kelas 10 kumer smapsa .pptx
Bioteknologi kelas 10 kumer smapsa .pptxBioteknologi kelas 10 kumer smapsa .pptx
Bioteknologi kelas 10 kumer smapsa .pptx
 
Base editing, prime editing, Cas13 & RNA editing and organelle base editing
Base editing, prime editing, Cas13 & RNA editing and organelle base editingBase editing, prime editing, Cas13 & RNA editing and organelle base editing
Base editing, prime editing, Cas13 & RNA editing and organelle base editing
 
Pests of soyabean_Binomics_IdentificationDr.UPR.pdf
Pests of soyabean_Binomics_IdentificationDr.UPR.pdfPests of soyabean_Binomics_IdentificationDr.UPR.pdf
Pests of soyabean_Binomics_IdentificationDr.UPR.pdf
 
Pests of Bengal gram_Identification_Dr.UPR.pdf
Pests of Bengal gram_Identification_Dr.UPR.pdfPests of Bengal gram_Identification_Dr.UPR.pdf
Pests of Bengal gram_Identification_Dr.UPR.pdf
 
Pests of Blackgram, greengram, cowpea_Dr.UPR.pdf
Pests of Blackgram, greengram, cowpea_Dr.UPR.pdfPests of Blackgram, greengram, cowpea_Dr.UPR.pdf
Pests of Blackgram, greengram, cowpea_Dr.UPR.pdf
 

Mining news for personalized recommendations

  • 1. Mining knowledge in news for personalization Dung Chu and David Graus, data scientists FD Mediagroep
  • 2. Outline • Introduction FDMG • AI use cases: – FD personalized newsletter – CompanyInfo entity linker – Smart Radio
  • 3. FD mediagroep Het Financieele Dagblad Het Financieele Dagblad is dé nieuws- en inspiratiebron die op elk moment van de dag financieel-economische betekenis geeft aan ontwikkelingen in de wereld. Company info geeft altijd real time toegang tot actuele bedrijfs- en prospectinformatie van 2,5 miljoen bedrijven in Nederland FD/BNR Networks FD/BNR Networks brengt ideeën, meningen en talentrijke ondernemers en professionals samen door de organisatie van o.a. forums, debatten, netwerksessies, en evenementenreeksen. BNR Nieuwsradio BNR Nieuwsradio is de enige radiozender in Nederland waar ambitieuze en ondernemende mensen 24 uur per dag op de hoogte worden gehouden van relevant nieuws. FD Mediagroep helpt om betere beslissingen te nemen door overzicht, inzicht én (vooruit)zicht te bieden met journalistieke merken en hoogstaande kwalitatieve producten.
  • 5. FD personalized newsletter: goals • Diversify content sent to readers • Improve engagement
  • 6. FD personalized newsletters • Rich data: – Logged-in data with unique client ID • Recommendation model: Item-to-item collaborative filtering Published last week Older articles PySpark: + Convert reader-article matrix to IndexedRowMatrix + columnSimilarities(): fast compute of cosine similarity between columns
  • 8. Results: paid clients (fixed 2000) T-test
  • 9. Content diversification Popularity emails Personalized emails 7 articles 178 articles (60 clicked) Long tail articles 25000 15000
  • 10. CompanyInfo entity linker Ref: https://www.slideshare.net/davidgraus/financial-news-mining-pydata-amsterdam
  • 11. 11
  • 12. 12
  • 13. Situation before • Manual process • Not able to process many articles
  • 14. Rich data 1. Knowledge Base (Company.info): – >2.8M organization profiles – Rich metadata: sector information, financial information, people, buildings, etc… 2. News articles: – >1200 sources (Dutch, online) • From Het Financieele Dagblad to the Groninger Gezinsbode – Around ~4k articles per day – Multiple years of hand-labeled archive
  • 15. Model • Two stage approach: – Named-entity recognition – Entity Linking using binary classification • Predict whether mention m should be linked to entity candidate c
  • 16. Pipeline 16 1. 0. 1. 1. 0. Doc NER mention1 org1 org2 org3 … org n Extract Features 1. 0. 0. 1. 0. 1. 1. 0. 0. 0. 1. 0. 1. 1. 0. RF 1 0 mention2 mention3 0.647 … 0.873 0.780 0.342 …
  • 17. Pipeline 17 1. 0. 1. 1. 0. NER mention1 org1 org2 org3 org n Extract Features 1. 0. 0. 1. 0. 1. 1. 0. 0. 0. 1. 0. 1. 1. 0. RF 1 0 mention2 mention3 0.647 0.873 0.780 0.342 …… …
  • 18. Pipeline 18 1. 0. 1. 1. 0. NER mention1 org2 org3 org1 org n Extract Features 1. 0. 0. 1. 0. 1. 1. 0. 0. 0. 1. 0. 1. 1. 0. RF 1 0 mention2 mention3 0.873 0.780 0.647 0.342 …… …
  • 19. org3 1. 0. 1. 1. 0. 0.780 Pipeline 19 1. 0. 1. 1. 0. NER mention1 org1 … org n Extract Features 1. 0. 0. 1. 0. RF 1 0 mention2 mention3 0.647 0.342 … org2 1. 1. 0. 0. 0. 0.873 …
  • 20. Evaluation • Take data, make train/test-split – NER: ~85% – EL: ~85% • But: Data is noisy/biased – + Manual inspection 20
  • 21. Results – Replace previous manual process – Number of articles per day: approx. +160% – Number of linked orgs: approx. +310% – More “long tail” articles 21
  • 23. Smart Radio – audio personalization • Current audio listening experience: – Passive listening – Long audio data with mix of topics • New way: – On demand and personalized listening TV Radio
  • 24. Smart Radio - BNR app
  • 25. Smart Radio – pipeline “serverless”
  • 26. Take-home messages • AI projects add values to existing businesses • Diversify content delivered to customers: enable “long tail” articles/audio fragments • In combination with rich data, simple AI models work • Our solutions are re-usable
  • 27. Upcoming projects • Fully automatic audio segmentation • Personalized summarization of news articles
  • 28. Twitter: @dungchu Email: dung.manh.chu@fdmediagroep.nl LinkedIn: https://www.linkedin.com/in/dungmanhchu/

Hinweis der Redaktion

  1. Business related news; over 4k articles a day from over >900 sources
  2. You can go from news to profile
  3. Tying it all together
  4. Tying it all together
  5. Tying it all together
  6. Tying it all together
  7. Bias: Typically 1 or 2 orgs per article (humans). Errors. “Misses.”