Suche senden
Hochladen
8月27日pmcaff分享
•
0 gefällt mir
•
494 views
Song Hou
Folgen
姨搜大数据风控系统,原理以及如何建设,还包括两个案例,体现出姨搜是如何帮助我们的用户提升风控能力的。
Weniger lesen
Mehr lesen
Internet
Melden
Teilen
Melden
Teilen
1 von 25
Jetzt herunterladen
Downloaden Sie, um offline zu lesen
Empfohlen
APNIC Hackathon The Lord of IPv6
APNIC Hackathon The Lord of IPv6
Siena Perry
APNIC Hackathon Poke Prefix
APNIC Hackathon Poke Prefix
Siena Perry
How to build analytics for 100bn logs a month with ClickHouse. By Vadim Tkach...
How to build analytics for 100bn logs a month with ClickHouse. By Vadim Tkach...
Valery Tkachenko
Log Files
Log Files
Heinrich Hartmann
Kafka Summit NYC 2017 - Data Processing at LinkedIn with Apache Kafka
Kafka Summit NYC 2017 - Data Processing at LinkedIn with Apache Kafka
confluent
Cron in der Cloud - Die Top 10 Hitparade
Cron in der Cloud - Die Top 10 Hitparade
QAware GmbH
Strata Hadoop Hopsworks
Strata Hadoop Hopsworks
Jim Dowling
Scalable and Reliable Logging at Pinterest
Scalable and Reliable Logging at Pinterest
Krishna Gade
Empfohlen
APNIC Hackathon The Lord of IPv6
APNIC Hackathon The Lord of IPv6
Siena Perry
APNIC Hackathon Poke Prefix
APNIC Hackathon Poke Prefix
Siena Perry
How to build analytics for 100bn logs a month with ClickHouse. By Vadim Tkach...
How to build analytics for 100bn logs a month with ClickHouse. By Vadim Tkach...
Valery Tkachenko
Log Files
Log Files
Heinrich Hartmann
Kafka Summit NYC 2017 - Data Processing at LinkedIn with Apache Kafka
Kafka Summit NYC 2017 - Data Processing at LinkedIn with Apache Kafka
confluent
Cron in der Cloud - Die Top 10 Hitparade
Cron in der Cloud - Die Top 10 Hitparade
QAware GmbH
Strata Hadoop Hopsworks
Strata Hadoop Hopsworks
Jim Dowling
Scalable and Reliable Logging at Pinterest
Scalable and Reliable Logging at Pinterest
Krishna Gade
DOD 2016 - Stefan Thies - Monitoring and Log Management for Docker Swarm and...
DOD 2016 - Stefan Thies - Monitoring and Log Management for Docker Swarm and...
PROIDEA
Splunk and node
Splunk and node
Glenn Block
From my sql to postgresql using kafka+debezium
From my sql to postgresql using kafka+debezium
Clement Demonchy
Singer, Pinterest's Logging Infrastructure
Singer, Pinterest's Logging Infrastructure
Discover Pinterest
DC Spark bake off - Realtime TCP Packet Analysis using Spark and Azure Event ...
DC Spark bake off - Realtime TCP Packet Analysis using Spark and Azure Event ...
Silvio Fiorito
Real-world Streaming Architectures
Real-world Streaming Architectures
confluent
You Must Construct Additional Pipelines: Pub-Sub on Kafka at Blizzard
You Must Construct Additional Pipelines: Pub-Sub on Kafka at Blizzard
confluent
Flink Forward Berlin 2017: Steffen Hausmann - Build a Real-time Stream Proces...
Flink Forward Berlin 2017: Steffen Hausmann - Build a Real-time Stream Proces...
Flink Forward
2015 moloch recipes
2015 moloch recipes
Geoffrey Crespin
Apache Kafka and KSQL in Action: Let's Build a Streaming Data Pipeline!
Apache Kafka and KSQL in Action: Let's Build a Streaming Data Pipeline!
confluent
Kafka Summit NYC 2017 - Venice: A Distributed Database on top of Kafka
Kafka Summit NYC 2017 - Venice: A Distributed Database on top of Kafka
confluent
Kafka Summit SF 2017 - Query the Application, Not a Database: “Interactive Qu...
Kafka Summit SF 2017 - Query the Application, Not a Database: “Interactive Qu...
confluent
Kafka. seattle data science and data engineering meetup
Kafka. seattle data science and data engineering meetup
Abhishek Goswami
Kiwipycon2011 async-with-gevent-redis
Kiwipycon2011 async-with-gevent-redis
alexdong
Building Super Fast Cloud-Native Data Platforms - Yaron Haviv, KubeCon 2017 EU
Building Super Fast Cloud-Native Data Platforms - Yaron Haviv, KubeCon 2017 EU
Yaron Haviv
Hadoop World 2011: Storing and Indexing Social Media Content in the Hadoop Ec...
Hadoop World 2011: Storing and Indexing Social Media Content in the Hadoop Ec...
Cloudera, Inc.
Monitoring and scaling postgres at datadog
Monitoring and scaling postgres at datadog
Seth Rosenblum
Apache HBase at Airbnb
Apache HBase at Airbnb
HBaseCon
Upgrading from-hdp-21-to-hdp-24
Upgrading from-hdp-21-to-hdp-24
wyukawa
Presto Strata Hadoop SJ 2016 short talk
Presto Strata Hadoop SJ 2016 short talk
kbajda
How to improve ELK log pipeline performance
How to improve ELK log pipeline performance
Steven Shim
Common Sense Performance Indicators in the Cloud
Common Sense Performance Indicators in the Cloud
Nick Gerner
Weitere ähnliche Inhalte
Was ist angesagt?
DOD 2016 - Stefan Thies - Monitoring and Log Management for Docker Swarm and...
DOD 2016 - Stefan Thies - Monitoring and Log Management for Docker Swarm and...
PROIDEA
Splunk and node
Splunk and node
Glenn Block
From my sql to postgresql using kafka+debezium
From my sql to postgresql using kafka+debezium
Clement Demonchy
Singer, Pinterest's Logging Infrastructure
Singer, Pinterest's Logging Infrastructure
Discover Pinterest
DC Spark bake off - Realtime TCP Packet Analysis using Spark and Azure Event ...
DC Spark bake off - Realtime TCP Packet Analysis using Spark and Azure Event ...
Silvio Fiorito
Real-world Streaming Architectures
Real-world Streaming Architectures
confluent
You Must Construct Additional Pipelines: Pub-Sub on Kafka at Blizzard
You Must Construct Additional Pipelines: Pub-Sub on Kafka at Blizzard
confluent
Flink Forward Berlin 2017: Steffen Hausmann - Build a Real-time Stream Proces...
Flink Forward Berlin 2017: Steffen Hausmann - Build a Real-time Stream Proces...
Flink Forward
2015 moloch recipes
2015 moloch recipes
Geoffrey Crespin
Apache Kafka and KSQL in Action: Let's Build a Streaming Data Pipeline!
Apache Kafka and KSQL in Action: Let's Build a Streaming Data Pipeline!
confluent
Kafka Summit NYC 2017 - Venice: A Distributed Database on top of Kafka
Kafka Summit NYC 2017 - Venice: A Distributed Database on top of Kafka
confluent
Kafka Summit SF 2017 - Query the Application, Not a Database: “Interactive Qu...
Kafka Summit SF 2017 - Query the Application, Not a Database: “Interactive Qu...
confluent
Kafka. seattle data science and data engineering meetup
Kafka. seattle data science and data engineering meetup
Abhishek Goswami
Kiwipycon2011 async-with-gevent-redis
Kiwipycon2011 async-with-gevent-redis
alexdong
Building Super Fast Cloud-Native Data Platforms - Yaron Haviv, KubeCon 2017 EU
Building Super Fast Cloud-Native Data Platforms - Yaron Haviv, KubeCon 2017 EU
Yaron Haviv
Hadoop World 2011: Storing and Indexing Social Media Content in the Hadoop Ec...
Hadoop World 2011: Storing and Indexing Social Media Content in the Hadoop Ec...
Cloudera, Inc.
Monitoring and scaling postgres at datadog
Monitoring and scaling postgres at datadog
Seth Rosenblum
Apache HBase at Airbnb
Apache HBase at Airbnb
HBaseCon
Upgrading from-hdp-21-to-hdp-24
Upgrading from-hdp-21-to-hdp-24
wyukawa
Presto Strata Hadoop SJ 2016 short talk
Presto Strata Hadoop SJ 2016 short talk
kbajda
Was ist angesagt?
(20)
DOD 2016 - Stefan Thies - Monitoring and Log Management for Docker Swarm and...
DOD 2016 - Stefan Thies - Monitoring and Log Management for Docker Swarm and...
Splunk and node
Splunk and node
From my sql to postgresql using kafka+debezium
From my sql to postgresql using kafka+debezium
Singer, Pinterest's Logging Infrastructure
Singer, Pinterest's Logging Infrastructure
DC Spark bake off - Realtime TCP Packet Analysis using Spark and Azure Event ...
DC Spark bake off - Realtime TCP Packet Analysis using Spark and Azure Event ...
Real-world Streaming Architectures
Real-world Streaming Architectures
You Must Construct Additional Pipelines: Pub-Sub on Kafka at Blizzard
You Must Construct Additional Pipelines: Pub-Sub on Kafka at Blizzard
Flink Forward Berlin 2017: Steffen Hausmann - Build a Real-time Stream Proces...
Flink Forward Berlin 2017: Steffen Hausmann - Build a Real-time Stream Proces...
2015 moloch recipes
2015 moloch recipes
Apache Kafka and KSQL in Action: Let's Build a Streaming Data Pipeline!
Apache Kafka and KSQL in Action: Let's Build a Streaming Data Pipeline!
Kafka Summit NYC 2017 - Venice: A Distributed Database on top of Kafka
Kafka Summit NYC 2017 - Venice: A Distributed Database on top of Kafka
Kafka Summit SF 2017 - Query the Application, Not a Database: “Interactive Qu...
Kafka Summit SF 2017 - Query the Application, Not a Database: “Interactive Qu...
Kafka. seattle data science and data engineering meetup
Kafka. seattle data science and data engineering meetup
Kiwipycon2011 async-with-gevent-redis
Kiwipycon2011 async-with-gevent-redis
Building Super Fast Cloud-Native Data Platforms - Yaron Haviv, KubeCon 2017 EU
Building Super Fast Cloud-Native Data Platforms - Yaron Haviv, KubeCon 2017 EU
Hadoop World 2011: Storing and Indexing Social Media Content in the Hadoop Ec...
Hadoop World 2011: Storing and Indexing Social Media Content in the Hadoop Ec...
Monitoring and scaling postgres at datadog
Monitoring and scaling postgres at datadog
Apache HBase at Airbnb
Apache HBase at Airbnb
Upgrading from-hdp-21-to-hdp-24
Upgrading from-hdp-21-to-hdp-24
Presto Strata Hadoop SJ 2016 short talk
Presto Strata Hadoop SJ 2016 short talk
Ähnlich wie 8月27日pmcaff分享
How to improve ELK log pipeline performance
How to improve ELK log pipeline performance
Steven Shim
Common Sense Performance Indicators in the Cloud
Common Sense Performance Indicators in the Cloud
Nick Gerner
Threat hunting on the wire
Threat hunting on the wire
InfoSec Addicts
The Design, Implementation and Open Source Way of Apache Pegasus
The Design, Implementation and Open Source Way of Apache Pegasus
acelyc1112009
Stream Processing with Apache Kafka and .NET
Stream Processing with Apache Kafka and .NET
confluent
Introduction to real time big data with Apache Spark
Introduction to real time big data with Apache Spark
Taras Matyashovsky
Top 5 mistakes when writing Streaming applications
Top 5 mistakes when writing Streaming applications
hadooparchbook
The Top Five Mistakes Made When Writing Streaming Applications with Mark Grov...
The Top Five Mistakes Made When Writing Streaming Applications with Mark Grov...
Databricks
Making HTML5 Mobile Games Indistinguishable from Native Apps
Making HTML5 Mobile Games Indistinguishable from Native Apps
FITC
Serverless spark
Serverless spark
MamathaBusi
What is Apache Kafka and What is an Event Streaming Platform?
What is Apache Kafka and What is an Event Streaming Platform?
confluent
Spark Saturday: Spark SQL & DataFrame Workshop with Apache Spark 2.3
Spark Saturday: Spark SQL & DataFrame Workshop with Apache Spark 2.3
Databricks
Zero to 1 Billion+ Records: A True Story of Learning & Scaling GameChanger
Zero to 1 Billion+ Records: A True Story of Learning & Scaling GameChanger
MongoDB
Application Security Workshop
Application Security Workshop
Priyanka Aash
Ingesting hdfs intosolrusingsparktrimmed
Ingesting hdfs intosolrusingsparktrimmed
whoschek
Streaming in Practice - Putting Apache Kafka in Production
Streaming in Practice - Putting Apache Kafka in Production
confluent
GPU-Accelerating UDFs in PySpark with Numba and PyGDF
GPU-Accelerating UDFs in PySpark with Numba and PyGDF
Keith Kraus
Stage Level Scheduling Improving Big Data and AI Integration
Stage Level Scheduling Improving Big Data and AI Integration
Databricks
Seattle Spark Meetup Mobius CSharp API
Seattle Spark Meetup Mobius CSharp API
shareddatamsft
Stream processing on mobile networks
Stream processing on mobile networks
pbelko82
Ähnlich wie 8月27日pmcaff分享
(20)
How to improve ELK log pipeline performance
How to improve ELK log pipeline performance
Common Sense Performance Indicators in the Cloud
Common Sense Performance Indicators in the Cloud
Threat hunting on the wire
Threat hunting on the wire
The Design, Implementation and Open Source Way of Apache Pegasus
The Design, Implementation and Open Source Way of Apache Pegasus
Stream Processing with Apache Kafka and .NET
Stream Processing with Apache Kafka and .NET
Introduction to real time big data with Apache Spark
Introduction to real time big data with Apache Spark
Top 5 mistakes when writing Streaming applications
Top 5 mistakes when writing Streaming applications
The Top Five Mistakes Made When Writing Streaming Applications with Mark Grov...
The Top Five Mistakes Made When Writing Streaming Applications with Mark Grov...
Making HTML5 Mobile Games Indistinguishable from Native Apps
Making HTML5 Mobile Games Indistinguishable from Native Apps
Serverless spark
Serverless spark
What is Apache Kafka and What is an Event Streaming Platform?
What is Apache Kafka and What is an Event Streaming Platform?
Spark Saturday: Spark SQL & DataFrame Workshop with Apache Spark 2.3
Spark Saturday: Spark SQL & DataFrame Workshop with Apache Spark 2.3
Zero to 1 Billion+ Records: A True Story of Learning & Scaling GameChanger
Zero to 1 Billion+ Records: A True Story of Learning & Scaling GameChanger
Application Security Workshop
Application Security Workshop
Ingesting hdfs intosolrusingsparktrimmed
Ingesting hdfs intosolrusingsparktrimmed
Streaming in Practice - Putting Apache Kafka in Production
Streaming in Practice - Putting Apache Kafka in Production
GPU-Accelerating UDFs in PySpark with Numba and PyGDF
GPU-Accelerating UDFs in PySpark with Numba and PyGDF
Stage Level Scheduling Improving Big Data and AI Integration
Stage Level Scheduling Improving Big Data and AI Integration
Seattle Spark Meetup Mobius CSharp API
Seattle Spark Meetup Mobius CSharp API
Stream processing on mobile networks
Stream processing on mobile networks
Kürzlich hochgeladen
Russian Call Girls in Kolkata Ishita 🤌 8250192130 🚀 Vip Call Girls Kolkata
Russian Call Girls in Kolkata Ishita 🤌 8250192130 🚀 Vip Call Girls Kolkata
anamikaraghav4
Model Call Girl in Jamuna Vihar Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Jamuna Vihar Delhi reach out to us at 🔝9953056974🔝
9953056974 Low Rate Call Girls In Saket, Delhi NCR
Radiant Call girls in Dubai O56338O268 Dubai Call girls
Radiant Call girls in Dubai O56338O268 Dubai Call girls
stephieert
VIP Call Girls Kolkata Ananya 🤌 8250192130 🚀 Vip Call Girls Kolkata
VIP Call Girls Kolkata Ananya 🤌 8250192130 🚀 Vip Call Girls Kolkata
anamikaraghav4
AWS Community DAY Albertini-Ellan Cloud Security (1).pptx
AWS Community DAY Albertini-Ellan Cloud Security (1).pptx
ellan12
Call Girls In Saket Delhi 💯Call Us 🔝8264348440🔝
Call Girls In Saket Delhi 💯Call Us 🔝8264348440🔝
soniya singh
Gram Darshan PPT cyber rural in villages of india
Gram Darshan PPT cyber rural in villages of india
imessage0108
Enjoy Night⚡Call Girls Dlf City Phase 3 Gurgaon >༒8448380779 Escort Service
Enjoy Night⚡Call Girls Dlf City Phase 3 Gurgaon >༒8448380779 Escort Service
Delhi Call girls
VIP Kolkata Call Girl Alambazar 👉 8250192130 Available With Room
VIP Kolkata Call Girl Alambazar 👉 8250192130 Available With Room
divyansh0kumar0
FULL ENJOY Call Girls In Mayur Vihar Delhi Contact Us 8377087607
FULL ENJOY Call Girls In Mayur Vihar Delhi Contact Us 8377087607
dollysharma2066
'Future Evolution of the Internet' delivered by Geoff Huston at Everything Op...
'Future Evolution of the Internet' delivered by Geoff Huston at Everything Op...
APNIC
Call Girls In Sukhdev Vihar Delhi 💯Call Us 🔝8264348440🔝
Call Girls In Sukhdev Vihar Delhi 💯Call Us 🔝8264348440🔝
soniya singh
How is AI changing journalism? (v. April 2024)
How is AI changing journalism? (v. April 2024)
Damian Radcliffe
Rohini Sector 22 Call Girls Delhi 9999965857 @Sabina Saikh No Advance
Rohini Sector 22 Call Girls Delhi 9999965857 @Sabina Saikh No Advance
Call Girls In Delhi Whatsup 9873940964 Enjoy Unlimited Pleasure
Hot Service (+9316020077 ) Goa Call Girls Real Photos and Genuine Service
Hot Service (+9316020077 ) Goa Call Girls Real Photos and Genuine Service
sexy call girls service in goa
Russian Call girl in Ajman +971563133746 Ajman Call girl Service
Russian Call girl in Ajman +971563133746 Ajman Call girl Service
gwenoracqe6
VIP Kolkata Call Girls Salt Lake 8250192130 Available With Room
VIP Kolkata Call Girls Salt Lake 8250192130 Available With Room
girls4nights
Low Rate Call Girls Kolkata Avani 🤌 8250192130 🚀 Vip Call Girls Kolkata
Low Rate Call Girls Kolkata Avani 🤌 8250192130 🚀 Vip Call Girls Kolkata
anamikaraghav4
On Starlink, presented by Geoff Huston at NZNOG 2024
On Starlink, presented by Geoff Huston at NZNOG 2024
APNIC
Russian Call girls in Dubai +971563133746 Dubai Call girls
Russian Call girls in Dubai +971563133746 Dubai Call girls
stephieert
Kürzlich hochgeladen
(20)
Russian Call Girls in Kolkata Ishita 🤌 8250192130 🚀 Vip Call Girls Kolkata
Russian Call Girls in Kolkata Ishita 🤌 8250192130 🚀 Vip Call Girls Kolkata
Model Call Girl in Jamuna Vihar Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Jamuna Vihar Delhi reach out to us at 🔝9953056974🔝
Radiant Call girls in Dubai O56338O268 Dubai Call girls
Radiant Call girls in Dubai O56338O268 Dubai Call girls
VIP Call Girls Kolkata Ananya 🤌 8250192130 🚀 Vip Call Girls Kolkata
VIP Call Girls Kolkata Ananya 🤌 8250192130 🚀 Vip Call Girls Kolkata
AWS Community DAY Albertini-Ellan Cloud Security (1).pptx
AWS Community DAY Albertini-Ellan Cloud Security (1).pptx
Call Girls In Saket Delhi 💯Call Us 🔝8264348440🔝
Call Girls In Saket Delhi 💯Call Us 🔝8264348440🔝
Gram Darshan PPT cyber rural in villages of india
Gram Darshan PPT cyber rural in villages of india
Enjoy Night⚡Call Girls Dlf City Phase 3 Gurgaon >༒8448380779 Escort Service
Enjoy Night⚡Call Girls Dlf City Phase 3 Gurgaon >༒8448380779 Escort Service
VIP Kolkata Call Girl Alambazar 👉 8250192130 Available With Room
VIP Kolkata Call Girl Alambazar 👉 8250192130 Available With Room
FULL ENJOY Call Girls In Mayur Vihar Delhi Contact Us 8377087607
FULL ENJOY Call Girls In Mayur Vihar Delhi Contact Us 8377087607
'Future Evolution of the Internet' delivered by Geoff Huston at Everything Op...
'Future Evolution of the Internet' delivered by Geoff Huston at Everything Op...
Call Girls In Sukhdev Vihar Delhi 💯Call Us 🔝8264348440🔝
Call Girls In Sukhdev Vihar Delhi 💯Call Us 🔝8264348440🔝
How is AI changing journalism? (v. April 2024)
How is AI changing journalism? (v. April 2024)
Rohini Sector 22 Call Girls Delhi 9999965857 @Sabina Saikh No Advance
Rohini Sector 22 Call Girls Delhi 9999965857 @Sabina Saikh No Advance
Hot Service (+9316020077 ) Goa Call Girls Real Photos and Genuine Service
Hot Service (+9316020077 ) Goa Call Girls Real Photos and Genuine Service
Russian Call girl in Ajman +971563133746 Ajman Call girl Service
Russian Call girl in Ajman +971563133746 Ajman Call girl Service
VIP Kolkata Call Girls Salt Lake 8250192130 Available With Room
VIP Kolkata Call Girls Salt Lake 8250192130 Available With Room
Low Rate Call Girls Kolkata Avani 🤌 8250192130 🚀 Vip Call Girls Kolkata
Low Rate Call Girls Kolkata Avani 🤌 8250192130 🚀 Vip Call Girls Kolkata
On Starlink, presented by Geoff Huston at NZNOG 2024
On Starlink, presented by Geoff Huston at NZNOG 2024
Russian Call girls in Dubai +971563133746 Dubai Call girls
Russian Call girls in Dubai +971563133746 Dubai Call girls
8月27日pmcaff分享
1.
songhou@creditease.cn 1
2.
1. 2. 3. 4. 5. 2
3.
1. • P2P • • 3
4.
1. 2. 3. 4. 5. 4
5.
2. 1. 2. 3. 4. 5
6.
2.1 6
7.
2.2 • • • 7
8.
2.3 • • - - • - - - 8
9.
2.4 • • • -> -> •
-> -> - - - • 9
10.
1. 2. 3. 4. 5. 10
11.
3. 1. 2. 3. 4. 11
12.
3.1 12 risk model data data
13.
3.2 13 Query Engine crawler controller REST Client DB HDFS File KG web front REST Client realtime source realtime/batch extractionrealtime inserts commands web trace batch processing Web crawlers logging . . . . . . . . . . . . Kafka spark streaming web
extraction config online knowledge processing offline complex reasoning entity retrieve graph traverse full text search KG repository batch logging partners Query Engine data integration
14.
3.3 14
15.
3.4 15 Spark / MR Yarn Hadoop
16.
1. 2. 3. 4. 5. 16
17.
4. 1. 2. 17
18.
4.1 • - 3000 - 30 - • - - - - 18
19.
4.1 • NLP • • Albus • 19
20.
4.2 • - - - - • - - - 20
21.
4.2 • • • Pentaho dashboard 21
22.
1. 2. 3. 4. 5. 22
23.
5. • • • • 23
24.
• • jianmindong@creditease.cn 24
25.
Thanks Q & A 25 songhou@creditease.cn http://housong.github.io
Jetzt herunterladen