MySQL And Search At Craigslist

•Als ODP, PDF herunterladen•

28 gefällt mir•14,763 views

Jeremy Zawodny

My talk as given at the 2009 MySQL Conference and Expo in Santa Clara, CA

Technologie

MySQL and Search at Craigslist ,[object Object],[object Object],[object Object],[object Object],[object Object]

Who Am I? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

What is Craigslist? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

What is Craigslist? ,[object Object],[object Object],[object Object]

Technical and other Challenges ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Goals ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Craigslist Internals Overview Perl + memcached Apache 1.3 + mod_perl Perl + memcached MySQL 5.0.xx Sphinx ... Load Balancer Read Proxy Array Write Proxy Array Web Read Array Object Cache Read DB Cluster Not Included : - user db, image db - async tasks, email - accounting, internal tools - and more! Search Cluster

Vertical Partitioning: Roles Users Classifieds Users Classifieds Forums Stats Archive Write Read Long Trash

Vertical Partitioning ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Horizontal Partitioning: Hydra cluster_01 cluster_02 cluster_03 cluster_N ... client

Horizontal Partitioning: Hydra ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Search Evolution ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

MySQL Full-Text Problems ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Sphinx: My First CL Project ,[object Object],[object Object],[object Object],[object Object],[object Object]

Search Implementation Details ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Sphinx Incremental Indexing ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Sphinx Issues ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Search Project Results ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Sphinx Wishlist ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Data Archiving, Replication, Indexes ,[object Object],[object Object],[object Object],[object Object]

Data Archiving: OOB Replication ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Long Term Data Archiving ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Drizzle, XtraDB, Future Stuff ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

We're Hiring! ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Weitere ähnliche Inhalte

Was ist angesagt?

Webinar | Introduction to Amazon DynamoDBAmazon Web Services

Best Practices for Data Warehousing with Amazon Redshift | AWS Public Sector ...Amazon Web Services

1.4 data warehouseKrish_ver2

Cs583 info-retrievalBorseshweta

Data Mining: an IntroductionAli Abbasi

Association Rule Learning Part 1: Frequent Itemset GenerationKnoldus Inc.

IRJET - Customer Churn Analysis in Telecom IndustryIRJET Journal

Cassandra ppt 1Skillwise Group

Build a Real-time Streaming Data Visualization System with Amazon Kinesis Ana...Amazon Web Services

3 V's of Big Datasunil173422

Cassandra nice use cases and worst anti patternsDuyhai Doan

Introducing DynamoDBAmazon Web Services

Amazon Redshift Tutorial | AWS Tutorial for Beginners | AWS Certification Tra...Edureka!

Boston crime rate tableau projectsharda university

Data Warehousing with Amazon RedshiftAmazon Web Services

대용량 분산 아키텍쳐 설계 #5. restTerry Cho

Chapter 6. Mining Frequent Patterns, Associations and Correlations Basic Conc...Subrata Kumer Paul

Introduction to Amazon RedshiftAmazon Web Services

Amazon Machine Learning Case Study: Predicting Customer ChurnAmazon Web Services

Optimizing Apache Spark SQL JoinsDatabricks

Was ist angesagt? (20)

Webinar | Introduction to Amazon DynamoDB

Best Practices for Data Warehousing with Amazon Redshift | AWS Public Sector ...

1.4 data warehouse

Cs583 info-retrieval

Data Mining: an Introduction

Association Rule Learning Part 1: Frequent Itemset Generation

IRJET - Customer Churn Analysis in Telecom Industry

Cassandra ppt 1

Build a Real-time Streaming Data Visualization System with Amazon Kinesis Ana...

3 V's of Big Data

Cassandra nice use cases and worst anti patterns

Introducing DynamoDB

Amazon Redshift Tutorial | AWS Tutorial for Beginners | AWS Certification Tra...

Boston crime rate tableau project

Data Warehousing with Amazon Redshift

대용량 분산 아키텍쳐 설계 #5. rest

Chapter 6. Mining Frequent Patterns, Associations and Correlations Basic Conc...

Introduction to Amazon Redshift

Amazon Machine Learning Case Study: Predicting Customer Churn

Optimizing Apache Spark SQL Joins

Andere mochten auch

Lessons Learned Migrating 2+ Billion Documents at CraigslistJeremy Zawodny

Realtime Search Infrastructure at Craigslist (OpenWest 2014)Jeremy Zawodny

Fusion-io and MySQL at CraigslistJeremy Zawodny

Social Media Trends - Content CurationChris Mikulin

SphinxSearchPrzemyslaw Wroblewski

Managing Big Data with MySQLmwasaha mwagambo

Sphinx at Craigslist in 2012Jeremy Zawodny

Chipotle Buyer PersonaCrismerly Santibañez

Chipotle Buyer Persona Esther Khoudari

Ahlstrom Financial Statements 2016 & Interim Report Q4/2016Ahlstrom-Munksjö

Top 5 Trends in Local Advertising David Shaner

Sphinx - High performance full-text search for MySQLNguyen Van Vuong

Chipolte buyer personaCaroline Redmond

Craigee Pitch Presentationcraigee

Four Tech Trends for 2017Peter Pajor

Localyser - An Introductionsps:affinity

Nancy Kruse - Spotting Millennial Food TrendsJohn Blue

Why Your MongoDB Needs RedisItamar Haber

Mobile UX-COESatyajit Roy

Youth Trends & InsightsJason Newport

Andere mochten auch (20)

Lessons Learned Migrating 2+ Billion Documents at Craigslist

Realtime Search Infrastructure at Craigslist (OpenWest 2014)

Fusion-io and MySQL at Craigslist

Social Media Trends - Content Curation

SphinxSearch

Managing Big Data with MySQL

Sphinx at Craigslist in 2012

Chipotle Buyer Persona

Ahlstrom Financial Statements 2016 & Interim Report Q4/2016

Top 5 Trends in Local Advertising

Sphinx - High performance full-text search for MySQL

Chipolte buyer persona

Craigee Pitch Presentation

Four Tech Trends for 2017

Localyser - An Introduction

Nancy Kruse - Spotting Millennial Food Trends

Why Your MongoDB Needs Redis

Mobile UX-COE

Youth Trends & Insights

Ähnlich wie MySQL And Search At Craigslist

My Sql And Search At CraigslistMySQLConference

UnConference for Georgia Southern Computer Science March 31, 2015Christopher Curtin

Open source TechnologyAmardeep Vishwakarma

Object- Relational Persistence in SmalltalkESUG

Introduction to MongoDBJustin Smestad

Scaling your websiteAlejandro Marcu

Getting Started with Amazon RedshiftAmazon Web Services

Spark Summit EU talk by Shay Nativ and Dvir VolkSpark Summit

AWS Webcast - Build high-scale applications with Amazon DynamoDBAmazon Web Services

MinneBar 2013 - Scaling with CassandraJeff Smoley

Why databases cry at nightMichael Yarichuk

Deep Dive in Big DataAmazon Web Services

Agility and Scalability with MongoDBMongoDB

From a student to an apache committer practice of apache io tdbjixuan1989

Case Study: Elasticsearch Ingest Using StreamSets at Cisco IntercloudRick Bilodeau

Case Study: Elasticsearch Ingest Using StreamSets @ Cisco IntercloudStreamsets Inc.

Introduction to Azure DocumentDBDenny Lee

Java EE 7 with Apache Spark for the World’s Largest Credit Card Core Systems ...Hirofumi Iwasaki

Voldemort & Hadoop @ Linkedin, Hadoop User Group Jan 2010Bhupesh Bansal

Hadoop and Voldemort @ LinkedInHadoop User Group

Ähnlich wie MySQL And Search At Craigslist (20)

My Sql And Search At Craigslist

UnConference for Georgia Southern Computer Science March 31, 2015

Open source Technology

Object- Relational Persistence in Smalltalk

Introduction to MongoDB

Scaling your website

Getting Started with Amazon Redshift

Spark Summit EU talk by Shay Nativ and Dvir Volk

AWS Webcast - Build high-scale applications with Amazon DynamoDB

MinneBar 2013 - Scaling with Cassandra

Why databases cry at night

Deep Dive in Big Data

Agility and Scalability with MongoDB

From a student to an apache committer practice of apache io tdb

Case Study: Elasticsearch Ingest Using StreamSets at Cisco Intercloud

Case Study: Elasticsearch Ingest Using StreamSets @ Cisco Intercloud

Introduction to Azure DocumentDB

Java EE 7 with Apache Spark for the World’s Largest Credit Card Core Systems ...

Voldemort & Hadoop @ Linkedin, Hadoop User Group Jan 2010

Hadoop and Voldemort @ LinkedIn

Kürzlich hochgeladen

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo

Architecting Cloud Native ApplicationsWSO2

TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc

Apidays New York 2024 - The value of a flexible API Management solution for O...apidays

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software

Automating Google Workspace (GWS) & more with Apps Scriptwesley chun

Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Zilliz

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Jeffrey Haguewood

AWS Community Day CPH - Three problems of TerraformAndrey Devyatkin

MS Copilot expands with MS Graph connectorsNanddeep Nachan

Real Time Object Detection Using Open CVKhem

A Beginners Guide to Building a RAG App Using Open Source MilvusZilliz

Why Teams call analytics are critical to your entire businesspanagenda

AXA XL - Insurer Innovation Award Americas 2024The Digital Insurer

Artificial Intelligence Chap.5 : UncertaintyKhushali Kathiriya

A Year of the Servo Reboot: Where Are We Now?Igalia

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWERMadyBayot

Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun

Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2

Kürzlich hochgeladen (20)

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

Architecting Cloud Native Applications

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

Apidays New York 2024 - The value of a flexible API Management solution for O...

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Automating Google Workspace (GWS) & more with Apps Script

Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

AWS Community Day CPH - Three problems of Terraform

MS Copilot expands with MS Graph connectors

Real Time Object Detection Using Open CV

A Beginners Guide to Building a RAG App Using Open Source Milvus

Why Teams call analytics are critical to your entire business

AXA XL - Insurer Innovation Award Americas 2024

Artificial Intelligence Chap.5 : Uncertainty

A Year of the Servo Reboot: Where Are We Now?

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

Data Cloud, More than a CDP by Matt Robison

Exploring the Future Potential of AI-Enabled Smartphone Processors