How SourceForge is Using MongoDB to Scale its Platform

•Als PPT, PDF herunterladen•

4 gefällt mir•2,543 views

1. SourceForge is using MongoDB as the database for their website to improve performance and scalability over their previous CouchDB implementation. 2. They developed an object-document mapper called Ming to define schemas and perform migrations for the documents in MongoDB from their Python web application. 3. SourceForge's deployment uses load balancing with a master MongoDB database server and multiple web application servers to easily handle most of their traffic needs from a single database server.

Technologie

How SourceForge is Using MongoDB Rick Copeland @rick446 [email_address]

SF.net “BlackOps”: FossFor.us User Editable! Web 2.0! (ish) Not Ugly!

Moving to NoSQL ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Rewriting “Consume” ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Deployment Architecture Load Balancer / Proxy Gobble Server Develop Master DB Server MongoDB Master Apache mod_wsgi / TG 2.0 MongoDB Slave Apache mod_wsgi / TG 2.0 MongoDB Slave Apache mod_wsgi / TG 2.0 MongoDB Slave Apache mod_wsgi / TG 2.0 MongoDB Slave

Deployment Architecture (revised) Load Balancer / Proxy Gobble Server Develop Scalability is good Single-node performance is good, too Master DB Server MongoDB Master Apache mod_wsgi / TG 2.0 Apache mod_wsgi / TG 2.0 Apache mod_wsgi / TG 2.0 Apache mod_wsgi / TG 2.0

SF.net Downloads ,[object Object],[object Object],[object Object]

Allura (SF.net “beta” devtools) ,[object Object],[object Object],[object Object],[object Object]

What We Liked ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Pitfalls ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Ming – an “Object-Document Mapper?” ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Ming Concepts ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Ming Example from ming import schema from ming.orm import MappedClass from ming.orm import (FieldProperty, ForeignIdProperty, RelationProperty) class WikiPage (MappedClass): class __mongometa__ : session = session name = 'wiki_page' _id = FieldProperty(schema . ObjectId) title = FieldProperty( str ) text = FieldProperty( str ) comments = RelationProperty( 'WikiComment' ) MappedClass . compile_all() # Lets ming know about the mapping

Open Source ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Future Work ,[object Object],[object Object],[object Object],[object Object],[object Object]

Empfohlen

An Enterprise Architect's View of MongoDBMongoDB

MongoDB Operations for DevelopersMongoDB

Webinar: An Enterprise Architect’s View of MongoDBMongoDB

Prepare for Peak Holiday Season with MongoDBMongoDB

MongoDB and RDBMS: Using Polyglot Persistence at Equifax MongoDB

Benefits of Using MongoDB Over RDBMSsMongoDB

MongoDB San Francisco 2013: Storing eBay's Media Metadata on MongoDB present...MongoDB

MongoDB vs Mysql. A devops point of viewPierre Baillet

Empfohlen

An Enterprise Architect's View of MongoDBMongoDB

MongoDB Operations for DevelopersMongoDB

Webinar: An Enterprise Architect’s View of MongoDBMongoDB

Prepare for Peak Holiday Season with MongoDBMongoDB

MongoDB and RDBMS: Using Polyglot Persistence at Equifax MongoDB

Benefits of Using MongoDB Over RDBMSsMongoDB

MongoDB San Francisco 2013: Storing eBay's Media Metadata on MongoDB present...MongoDB

MongoDB vs Mysql. A devops point of viewPierre Baillet

When to Use MongoDB...and When You Should Not...MongoDB

Webinar: Faster Big Data Analytics with MongoDBMongoDB

How Insurance Companies Use MongoDB MongoDB

Overcoming Today's Data Challenges with MongoDBMongoDB

When to Use MongoDBMongoDB

Migrating from RDBMS to MongoDBMongoDB

Building a Scalable and Modern Infrastructure at CARFAXMongoDB

MongoDB Evenings DC: MongoDB - The New Default Database for Giant IdeasMongoDB

MongoDB in a Mainframe WorldMongoDB

Business Track: How MongoDB Helps Telefonia Digital Accelerate Time to MarketMongoDB

Big Data: Guidelines and Examples for the Enterprise Decision MakerMongoDB

Final_CloudEventFrankfurt2017 (1).pdfMongoDB

Webinar: High Performance MongoDB Applications with IBM POWER8MongoDB

MongoDB Evenings DC: Get MEAN and Lean with Docker and KubernetesMongoDB

Introduction to MongoDB EnterpriseMongoDB

Sizing Your MongoDB ClusterMongoDB

How leading financial services organisations are winning with techMongoDB

Unlocking Operational Intelligence from the Data LakeMongoDB

L’architettura di Classe Enterprise di Nuova GenerazioneMongoDB

MongoDB 3.2 Feature PreviewNorberto Leite

eBay Cloud CMS based on NOSQLXu Jiang

No sql e as vantagens na utilização do mongodbfabio perrella

Weitere ähnliche Inhalte

Was ist angesagt?

When to Use MongoDB...and When You Should Not...MongoDB

Webinar: Faster Big Data Analytics with MongoDBMongoDB

How Insurance Companies Use MongoDB MongoDB

Overcoming Today's Data Challenges with MongoDBMongoDB

When to Use MongoDBMongoDB

Migrating from RDBMS to MongoDBMongoDB

Building a Scalable and Modern Infrastructure at CARFAXMongoDB

MongoDB Evenings DC: MongoDB - The New Default Database for Giant IdeasMongoDB

MongoDB in a Mainframe WorldMongoDB

Business Track: How MongoDB Helps Telefonia Digital Accelerate Time to MarketMongoDB

Big Data: Guidelines and Examples for the Enterprise Decision MakerMongoDB

Final_CloudEventFrankfurt2017 (1).pdfMongoDB

Webinar: High Performance MongoDB Applications with IBM POWER8MongoDB

MongoDB Evenings DC: Get MEAN and Lean with Docker and KubernetesMongoDB

Introduction to MongoDB EnterpriseMongoDB

Sizing Your MongoDB ClusterMongoDB

How leading financial services organisations are winning with techMongoDB

Unlocking Operational Intelligence from the Data LakeMongoDB

L’architettura di Classe Enterprise di Nuova GenerazioneMongoDB

MongoDB 3.2 Feature PreviewNorberto Leite

Was ist angesagt? (20)

When to Use MongoDB...and When You Should Not...

Webinar: Faster Big Data Analytics with MongoDB

How Insurance Companies Use MongoDB

Overcoming Today's Data Challenges with MongoDB

When to Use MongoDB

Migrating from RDBMS to MongoDB

Building a Scalable and Modern Infrastructure at CARFAX

MongoDB Evenings DC: MongoDB - The New Default Database for Giant Ideas

MongoDB in a Mainframe World

Business Track: How MongoDB Helps Telefonia Digital Accelerate Time to Market

Big Data: Guidelines and Examples for the Enterprise Decision Maker

Final_CloudEventFrankfurt2017 (1).pdf

Webinar: High Performance MongoDB Applications with IBM POWER8

MongoDB Evenings DC: Get MEAN and Lean with Docker and Kubernetes

Introduction to MongoDB Enterprise

Sizing Your MongoDB Cluster

How leading financial services organisations are winning with tech

Unlocking Operational Intelligence from the Data Lake

L’architettura di Classe Enterprise di Nuova Generazione

MongoDB 3.2 Feature Preview

Andere mochten auch

eBay Cloud CMS based on NOSQLXu Jiang

No sql e as vantagens na utilização do mongodbfabio perrella

Ebay: DB Capacity planning at eBayDataStax Academy

An Elastic Metadata Store for eBay’s Media PlatformMongoDB

NOSQL uma breve introduçãoWise Systems

Social Data and Log Analysis Using MongoDBTakahiro Inoue

Artigo NosqlAdemir Tadeu

Scaling with MongoDBMongoDB

ebayDataWorks Summit/Hadoop Summit

Semantic Wiki: Social Semantic Web In Action: Jesse Wang

NoSQL at Twitter (NoSQL EU 2010)Kevin Weil

Building LinkedIn's Learning Platform with MongoDBMongoDB

MongoDB at eBayMongoDB

Andere mochten auch (13)

eBay Cloud CMS based on NOSQL

No sql e as vantagens na utilização do mongodb

Ebay: DB Capacity planning at eBay

An Elastic Metadata Store for eBay’s Media Platform

NOSQL uma breve introdução

Social Data and Log Analysis Using MongoDB

Artigo Nosql

Scaling with MongoDB

ebay

Semantic Wiki: Social Semantic Web In Action:

NoSQL at Twitter (NoSQL EU 2010)

Building LinkedIn's Learning Platform with MongoDB

MongoDB at eBay

Ähnlich wie How SourceForge is Using MongoDB to Scale its Platform

Rapid, Scalable Web Development with MongoDB, Ming, and PythonRick Copeland

Beginning MEAN StackRob Davarnia

Open source TechnologyAmardeep Vishwakarma

Allura - an Open Source MongoDB Based Document Oriented SourceForgeRick Copeland

Q con london2011-matthewwall-whyichosemongodbforguardiancoukRoger Xia

Building and deploying LLM applications with Apache AirflowKaxil Naik

After the LAMP, it's time to get MEANJeff Fox

Mongo db first steps with csharpSerdar Buyuktemiz

Techorama - Evolvable Application Development with MongoDBbwullems

NoSql presentationMat Wall

Spring data presentationOleksii Usyk

No SQL at The GuardianMat Wall

Node Js, AngularJs and Express Js TutorialPHP Support

Introduction to meteorNodeXperts

Onion Architecture with S#arpGary Pedretti

Mongodb at-gilt-groupe-seattle-2012-09-14-finalMongoDB

Michael stack -the state of apache h basehdhappy001

An introduction to Node.jsKasey McCurdy

No sq lv1_0Tuan Luong

Meanstack overviewAdthasid Sabmake

Ähnlich wie How SourceForge is Using MongoDB to Scale its Platform (20)

Rapid, Scalable Web Development with MongoDB, Ming, and Python

Beginning MEAN Stack

Open source Technology

Allura - an Open Source MongoDB Based Document Oriented SourceForge

Q con london2011-matthewwall-whyichosemongodbforguardiancouk

Building and deploying LLM applications with Apache Airflow

After the LAMP, it's time to get MEAN

Mongo db first steps with csharp

Techorama - Evolvable Application Development with MongoDB

NoSql presentation

Spring data presentation

No SQL at The Guardian

Node Js, AngularJs and Express Js Tutorial

Introduction to meteor

Onion Architecture with S#arp

Mongodb at-gilt-groupe-seattle-2012-09-14-final

Michael stack -the state of apache h base

An introduction to Node.js

No sq lv1_0

Meanstack overview

Mehr von Rick Copeland

Python Functions (PyAtl Beginners Night)Rick Copeland

Schema Design at ScaleRick Copeland

Building Your First MongoDB ApplicationRick Copeland

Rapid and Scalable Development with MongoDB, PyMongo, and MingRick Copeland

Chef on MongoDB and PyramidRick Copeland

Scaling with MongoDBRick Copeland

Chef on Python and MongoDBRick Copeland

Real-Time Python Web: Gevent and Socket.ioRick Copeland

Rapid and Scalable Development with MongoDB, PyMongo, and MingRick Copeland

Realtime Analytics Using MongoDB, Python, Gevent, and ZeroMQRick Copeland

Mehr von Rick Copeland (10)

Python Functions (PyAtl Beginners Night)

Schema Design at Scale

Building Your First MongoDB Application

Rapid and Scalable Development with MongoDB, PyMongo, and Ming

Chef on MongoDB and Pyramid

Scaling with MongoDB

Chef on Python and MongoDB

Real-Time Python Web: Gevent and Socket.io

Rapid and Scalable Development with MongoDB, PyMongo, and Ming

Realtime Analytics Using MongoDB, Python, Gevent, and ZeroMQ

Kürzlich hochgeladen

The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3

SAP Build Work Zone - Overview L2-L3.pptxNavinnSomaal

New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada

Gen AI in Business - Global Trends Report 2024.pdfAddepto

How to write a Business Continuity PlanDatabarracks

"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays

TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey

Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB

Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University

"ML in Production",Oleksandr BaganFwdays

Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxLoriGlavin3

Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed

Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited

DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell

The State of Passkeys with FIDO Alliance.pptxLoriGlavin3

Generative AI for Technical Writer or Information DevelopersRaghuram Pandurangan

Commit 2024 - Secret Management made easyAlfredo García Lavilla

Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada

TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc

DevEX - reference for building teams, processes, and platformsSergiu Bodiu

Kürzlich hochgeladen (20)

The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx

SAP Build Work Zone - Overview L2-L3.pptx

New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024

Gen AI in Business - Global Trends Report 2024.pdf

How to write a Business Continuity Plan

"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack

TeamStation AI System Report LATAM IT Salaries 2024

Developer Data Modeling Mistakes: From Postgres to NoSQL

Nell’iperspazio con Rocket: il Framework Web di Rust!

"ML in Production",Oleksandr Bagan

Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx

Scanning the Internet for External Cloud Exposures via SSL Certs

Ensuring Technical Readiness For Copilot in Microsoft 365

DSPy a system for AI to Write Prompts and Do Fine Tuning

The State of Passkeys with FIDO Alliance.pptx

Generative AI for Technical Writer or Information Developers

Commit 2024 - Secret Management made easy

Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024

TrustArc Webinar - How to Build Consumer Trust Through Data Privacy

DevEX - reference for building teams, processes, and platforms

How SourceForge is Using MongoDB to Scale its Platform

1. How SourceForge is Using MongoDB Rick Copeland @rick446 [email_address]

2. SF.net “BlackOps”: FossFor.us User Editable! Web 2.0! (ish) Not Ugly!

5. Deployment Architecture Load Balancer / Proxy Gobble Server Develop Master DB Server MongoDB Master Apache mod_wsgi / TG 2.0 MongoDB Slave Apache mod_wsgi / TG 2.0 MongoDB Slave Apache mod_wsgi / TG 2.0 MongoDB Slave Apache mod_wsgi / TG 2.0 MongoDB Slave

6. Deployment Architecture (revised) Load Balancer / Proxy Gobble Server Develop Scalability is good Single-node performance is good, too Master DB Server MongoDB Master Apache mod_wsgi / TG 2.0 Apache mod_wsgi / TG 2.0 Apache mod_wsgi / TG 2.0 Apache mod_wsgi / TG 2.0

10.

11.

12.

13. Ming Example from ming import schema from ming.orm import MappedClass from ming.orm import (FieldProperty, ForeignIdProperty, RelationProperty) class WikiPage (MappedClass): class __mongometa__ : session = session name = 'wiki_page' _id = FieldProperty(schema . ObjectId) title = FieldProperty( str ) text = FieldProperty( str ) comments = RelationProperty( 'WikiComment' ) MappedClass . compile_all() # Lets ming know about the mapping

14.

15.

16. Questions?

17. Rick Copeland @rick446 [email_address]