SlideShare ist ein Scribd-Unternehmen logo
1 von 52
MMS – Using MMS to Build
New Environments
MMS Technical Account Manager, MongoDB
Peter C. Gravelle
@mongodb
What you are going to get out of today’s
talk
A. What is MMS
A. Monitoring
B. Backup
B. What you can do with MMS Backup
A. Spin up secondaries with minimal impact on your
primary
B. Build a sandbox for development or analytics to play in
What is MMS?
MMS
MongoDB Management System
What can I do?
Two Deployment Models
Using MongoDB Servers: cloud version
Using my servers: on-premise
Monitoring
What does MMS Monitoring give
you?
• Server metrics
• Activity feed
• Alerts
• Hardware stats (optional)
• User management
• Logs and profiling data
Server Metrics
Cluster View
Activity Feed
Alerts
Logs and Profile data
Hardware stats (CPU, disk)
DB Stats
User Management
MMS Monitoring Setup
Cloud Version
1. Go to http://mms.mongodb.com
2. Create an account
3. Install one agent in your datacenter
4. Add hosts from the web interface
5. Enjoy!
Backups
MMS Backup
• Backup a replica set or sharded cluster
• Initial sync + incremental
• Generated snapshots every 6 hs
• Restore via HTTPS or SCP
• Restore replica sets to point-in-time (last 24hs)
• Restore sharded clusters to any 15 minute (last
24hs)
Picking a snapshot to restore
MMS Backup Setup
Cloud Version - Billing
• 12-months pre-paid:
• $50 / GB / year
• 6-hour interval snapshot stored for two days
• Weekly snapshots stored for 1 month
• Monthly snapshots stored for 1 year
• Payment method: invoiced
Cloud Version - Billing
• Pay as you go
• Oplog processing: $1 / GB / month
• Snapshot storage: $0.08 / GB / month
• Customer defines snapshot frequency and retention
policy
• Payment method: online
What kind of environments
can you create with MMS
Backup?
What kind of environments can you
create?
• Spin up a new secondary quicker at minimal
additional load
• Build a sandbox for analytics or developers
Spin up a secondary quickly
Using Backup Snapshots to Spin Up
Secondaries
Spinning up secondaries can take a long time if the
data size is large.
You can make your own data file snapshots by taking
down a secondary and copying it off.
But why? MMS Backup has your data files already!
Spinning up secondary overview
1. Prepare your new environment
2. Get your restore files
3. Extract the restores
4. Make it a secondary
Preparing to spin up the secondary
Make sure you have room for your snapshot
More preparation
Ensure that you have enough oplog window to
prevent an initial sync. Remember you have to
download the snapshot and startup a mongod
process.
Spinning up secondary overview
1. Prepare your new environment
2. Get your restore files
3. Extract the restores
4. Make it a secondary
Start the download
Choose HTTPS or SCP
Spinning up secondary overview
1. Prepare your new environment
2. Get your restore files
3. Extract the restores
4. Make it a secondary
Extract Image and Start mongod
tar –xvf backup-restore-file-name.tar.gz
mv backup-restore-file-name data
mongod --port PORT --dbpath data --logpath=data/monogdb.log
This brings up your data in a standalone.
Spinning up secondary overview
1. Prepare your new environment
2. Get your restore files
3. Extract the restores
4. Make it a secondary
Seed the standalone as a secondary
Run seedSecondary.sh with its appropriate options to
create the oplog collection with the correct timestamp.
Shut down the mongod process when this is
complete
Start up the secondary with the seeded
oplog
mongod --port=PORT --dbpath=data --logpath=data/mongodb.log --
replSet=REPLICASETNAME
This PORT can be different than the other mongod
process you started. The REPLICASETNAME should
be the same as the name of the replica set that you
will be connecting it back to.
Connect the new secondary
On the primary, connect a mongo shell and run:
rs.add(“NEWSECONDARY:PORT”)
Where NEWSECONDARY is the hostname of the
secondary you just spun up, and PORT is the port
defined in the previous examples.
Now, just wait for rs.status() for the
NEWSECONDARY to report that it’s in status
SECONDARY. (Or check MMS!)
Lets build a sandbox!
Analytics, am I right?!
The analytics people can be a bane to ops. Why?
• They want to do big queries
• They want to do slow queries
• Their queries are just infrequent enough to not
justify building indexes for them
• Never mind the performance penalty for each index
Developers, Developers,
Developers!
They also want to disrupt your nicely running system
• Try new schemas
• Change application server behavior
• Stress test things
So build them a sandbox!
They can have their own (non-customer-impacting)
DB off of your most recent snapshot.
• Keeps them off the production servers
• Lets them process the data as they wish
• New collections with generated data
• Lets them try new methods and applications
How to build a sandbox
1. Get your restore files
2. Extract them
3. Set up sharding
Get your Restore files
The same rules apply:
• Make sure you have the space
• Choose push or pull (SCP/HTTPS)
• Pick the snapshot you want
• Wait for the download to complete
How to build a sandbox
1. Get your restore files
2. Extract them
3. Set up sharding
Extract your snapshot
tar –xvf backup-restore-file-name.tar.gz
mv backup-restore-file-name data
mongod --port PORT --dbpath data --logpath=data/monogdb.log
This brings up your data in a standalone. You can
stop here (unless you’re sharding).
How to build a sandbox
1. Get your restore files
2. Extract them
3. Set up sharding
Sharding Step 1
Bring up the config server
tar –xvf backup-restore-file-name.tar.gz
mv backup-restore-file-name data
mongod --port=CONFIGSRVRPORT --dbpath=data --logpath=data/mongodb.log --
configsvr=true
Sharding step 2
Update the shard metadata: Remember, you have a
new environment here, new hosts & ports!
mongo --port=CONFIGSRVRPORT
use config
db.shards.find().pretty()
Repeat if you’re setting up multiple config servers, but
this is not necessary for this non-production
environment.
Remember, this
only tells you what
you need to update!
What you got out of today’s talk
A. What is MMS
A. Monitoring
B. Backup
B. What you can do with MMS Backup
A. Spin up secondaries with minimal impact on your
primary
B. Build a sandbox for development or analytics to play in
Thank You
MMS Technical Account Manager, MongoDB
Peter C. Gravelle
@mongodb

Weitere ähnliche Inhalte

Was ist angesagt?

Backup, Restore, and Disaster Recovery
Backup, Restore, and Disaster RecoveryBackup, Restore, and Disaster Recovery
Backup, Restore, and Disaster Recovery
MongoDB
 
4 exercises for part 1
4   exercises for part 14   exercises for part 1
4 exercises for part 1
drewz lin
 
Backup, restore and repair database in mongo db linux file
Backup, restore and repair database in mongo db linux fileBackup, restore and repair database in mongo db linux file
Backup, restore and repair database in mongo db linux file
Prem Regmi
 
Availability and scalability in mongo
Availability and scalability in mongoAvailability and scalability in mongo
Availability and scalability in mongo
Md. Khairul Anam
 

Was ist angesagt? (20)

Object Storage with Gluster
Object Storage with GlusterObject Storage with Gluster
Object Storage with Gluster
 
Backup, Restore, and Disaster Recovery
Backup, Restore, and Disaster RecoveryBackup, Restore, and Disaster Recovery
Backup, Restore, and Disaster Recovery
 
Strategies for Backing Up MongoDB
Strategies for Backing Up MongoDBStrategies for Backing Up MongoDB
Strategies for Backing Up MongoDB
 
Caching. api. http 1.1
Caching. api. http 1.1Caching. api. http 1.1
Caching. api. http 1.1
 
4 exercises for part 1
4   exercises for part 14   exercises for part 1
4 exercises for part 1
 
Nginx cheat sheet
Nginx cheat sheetNginx cheat sheet
Nginx cheat sheet
 
Replica Sets (NYC NoSQL Meetup)
Replica Sets (NYC NoSQL Meetup)Replica Sets (NYC NoSQL Meetup)
Replica Sets (NYC NoSQL Meetup)
 
Backup, restore and repair database in mongo db linux file
Backup, restore and repair database in mongo db linux fileBackup, restore and repair database in mongo db linux file
Backup, restore and repair database in mongo db linux file
 
Clug 2012 March web server optimisation
Clug 2012 March   web server optimisationClug 2012 March   web server optimisation
Clug 2012 March web server optimisation
 
Decentralized storage
Decentralized storageDecentralized storage
Decentralized storage
 
Tinydns and dnscache
Tinydns and dnscacheTinydns and dnscache
Tinydns and dnscache
 
MongoDB Shard Cluster
MongoDB Shard ClusterMongoDB Shard Cluster
MongoDB Shard Cluster
 
Monitoring MySQL with OpenTSDB
Monitoring MySQL with OpenTSDBMonitoring MySQL with OpenTSDB
Monitoring MySQL with OpenTSDB
 
Webinar: Backups and Disaster Recovery
Webinar: Backups and Disaster RecoveryWebinar: Backups and Disaster Recovery
Webinar: Backups and Disaster Recovery
 
opentsdb in a real enviroment
opentsdb in a real enviromentopentsdb in a real enviroment
opentsdb in a real enviroment
 
Availability and scalability in mongo
Availability and scalability in mongoAvailability and scalability in mongo
Availability and scalability in mongo
 
HTTP 완벽가이드- 13 다이제스트 인증
HTTP 완벽가이드- 13 다이제스트 인증HTTP 완벽가이드- 13 다이제스트 인증
HTTP 완벽가이드- 13 다이제스트 인증
 
Web scraping with nutch solr part 2
Web scraping with nutch solr part 2Web scraping with nutch solr part 2
Web scraping with nutch solr part 2
 
Hydra - Getting Started
Hydra - Getting StartedHydra - Getting Started
Hydra - Getting Started
 
Webinar: Keeping Your MongoDB Data Safe
Webinar: Keeping Your MongoDB Data SafeWebinar: Keeping Your MongoDB Data Safe
Webinar: Keeping Your MongoDB Data Safe
 

Ähnlich wie Using MMS to Build New Environments

How to become cloud backup provider
How to become cloud backup providerHow to become cloud backup provider
How to become cloud backup provider
CLOUDIAN KK
 
How to become cloud backup provider with Cloudian HyperStore and CloudBerry L...
How to become cloud backup provider with Cloudian HyperStore and CloudBerry L...How to become cloud backup provider with Cloudian HyperStore and CloudBerry L...
How to become cloud backup provider with Cloudian HyperStore and CloudBerry L...
Cloudian
 
Run MongoDB with Confidence: Backing up and Monitoring with MMS
Run MongoDB with Confidence: Backing up and Monitoring with MMSRun MongoDB with Confidence: Backing up and Monitoring with MMS
Run MongoDB with Confidence: Backing up and Monitoring with MMS
MongoDB
 
SnapVault SE presentation
SnapVault SE presentationSnapVault SE presentation
SnapVault SE presentation
Robbie Rikard
 

Ähnlich wie Using MMS to Build New Environments (20)

Backing Up Data with MMS
Backing Up Data with MMSBacking Up Data with MMS
Backing Up Data with MMS
 
Silicon Valley Code Camp 2014 - Advanced MongoDB
Silicon Valley Code Camp 2014 - Advanced MongoDBSilicon Valley Code Camp 2014 - Advanced MongoDB
Silicon Valley Code Camp 2014 - Advanced MongoDB
 
How to become cloud backup provider
How to become cloud backup providerHow to become cloud backup provider
How to become cloud backup provider
 
Storage As A Service (StAAS)
Storage As A Service (StAAS)Storage As A Service (StAAS)
Storage As A Service (StAAS)
 
How to Become Cloud Backup Provider
How to Become Cloud Backup ProviderHow to Become Cloud Backup Provider
How to Become Cloud Backup Provider
 
Prosit google-cloud
Prosit google-cloudProsit google-cloud
Prosit google-cloud
 
MMMS monitoring backup and management at a single click
MMMS monitoring backup and management at a single clickMMMS monitoring backup and management at a single click
MMMS monitoring backup and management at a single click
 
Wissbi osdc pdf
Wissbi osdc pdfWissbi osdc pdf
Wissbi osdc pdf
 
How To Install Openbravo ERP 2.50 MP43 in Ubuntu
How To Install Openbravo ERP 2.50 MP43 in UbuntuHow To Install Openbravo ERP 2.50 MP43 in Ubuntu
How To Install Openbravo ERP 2.50 MP43 in Ubuntu
 
Testing Delphix: easy data virtualization
Testing Delphix: easy data virtualizationTesting Delphix: easy data virtualization
Testing Delphix: easy data virtualization
 
Webinar: MongoDB Management Service (MMS): Session 02 - Backing up Data
Webinar: MongoDB Management Service (MMS): Session 02 - Backing up DataWebinar: MongoDB Management Service (MMS): Session 02 - Backing up Data
Webinar: MongoDB Management Service (MMS): Session 02 - Backing up Data
 
Quick-Start Guide: Deploying Your Cloudian HyperStore Hybrid Storage Service
Quick-Start Guide: Deploying Your Cloudian HyperStore Hybrid Storage ServiceQuick-Start Guide: Deploying Your Cloudian HyperStore Hybrid Storage Service
Quick-Start Guide: Deploying Your Cloudian HyperStore Hybrid Storage Service
 
MMS - Monitoring, backup and management at a single click
MMS - Monitoring, backup and management at a single clickMMS - Monitoring, backup and management at a single click
MMS - Monitoring, backup and management at a single click
 
How to become cloud backup provider with Cloudian HyperStore and CloudBerry L...
How to become cloud backup provider with Cloudian HyperStore and CloudBerry L...How to become cloud backup provider with Cloudian HyperStore and CloudBerry L...
How to become cloud backup provider with Cloudian HyperStore and CloudBerry L...
 
Run MongoDB with Confidence: Backing up and Monitoring with MMS
Run MongoDB with Confidence: Backing up and Monitoring with MMSRun MongoDB with Confidence: Backing up and Monitoring with MMS
Run MongoDB with Confidence: Backing up and Monitoring with MMS
 
Hdf installing-hdf
Hdf installing-hdfHdf installing-hdf
Hdf installing-hdf
 
Building Apache Cassandra clusters for massive scale
Building Apache Cassandra clusters for massive scaleBuilding Apache Cassandra clusters for massive scale
Building Apache Cassandra clusters for massive scale
 
Active Directory Security Assessment ADSA
Active Directory Security Assessment ADSAActive Directory Security Assessment ADSA
Active Directory Security Assessment ADSA
 
SnapVault SE presentation
SnapVault SE presentationSnapVault SE presentation
SnapVault SE presentation
 
Caching and tuning fun for high scalability
Caching and tuning fun for high scalabilityCaching and tuning fun for high scalability
Caching and tuning fun for high scalability
 

Mehr von MongoDB

Mehr von MongoDB (20)

MongoDB SoCal 2020: Migrate Anything* to MongoDB Atlas
MongoDB SoCal 2020: Migrate Anything* to MongoDB AtlasMongoDB SoCal 2020: Migrate Anything* to MongoDB Atlas
MongoDB SoCal 2020: Migrate Anything* to MongoDB Atlas
 
MongoDB SoCal 2020: Go on a Data Safari with MongoDB Charts!
MongoDB SoCal 2020: Go on a Data Safari with MongoDB Charts!MongoDB SoCal 2020: Go on a Data Safari with MongoDB Charts!
MongoDB SoCal 2020: Go on a Data Safari with MongoDB Charts!
 
MongoDB SoCal 2020: Using MongoDB Services in Kubernetes: Any Platform, Devel...
MongoDB SoCal 2020: Using MongoDB Services in Kubernetes: Any Platform, Devel...MongoDB SoCal 2020: Using MongoDB Services in Kubernetes: Any Platform, Devel...
MongoDB SoCal 2020: Using MongoDB Services in Kubernetes: Any Platform, Devel...
 
MongoDB SoCal 2020: A Complete Methodology of Data Modeling for MongoDB
MongoDB SoCal 2020: A Complete Methodology of Data Modeling for MongoDBMongoDB SoCal 2020: A Complete Methodology of Data Modeling for MongoDB
MongoDB SoCal 2020: A Complete Methodology of Data Modeling for MongoDB
 
MongoDB SoCal 2020: From Pharmacist to Analyst: Leveraging MongoDB for Real-T...
MongoDB SoCal 2020: From Pharmacist to Analyst: Leveraging MongoDB for Real-T...MongoDB SoCal 2020: From Pharmacist to Analyst: Leveraging MongoDB for Real-T...
MongoDB SoCal 2020: From Pharmacist to Analyst: Leveraging MongoDB for Real-T...
 
MongoDB SoCal 2020: Best Practices for Working with IoT and Time-series Data
MongoDB SoCal 2020: Best Practices for Working with IoT and Time-series DataMongoDB SoCal 2020: Best Practices for Working with IoT and Time-series Data
MongoDB SoCal 2020: Best Practices for Working with IoT and Time-series Data
 
MongoDB SoCal 2020: MongoDB Atlas Jump Start
 MongoDB SoCal 2020: MongoDB Atlas Jump Start MongoDB SoCal 2020: MongoDB Atlas Jump Start
MongoDB SoCal 2020: MongoDB Atlas Jump Start
 
MongoDB .local San Francisco 2020: Powering the new age data demands [Infosys]
MongoDB .local San Francisco 2020: Powering the new age data demands [Infosys]MongoDB .local San Francisco 2020: Powering the new age data demands [Infosys]
MongoDB .local San Francisco 2020: Powering the new age data demands [Infosys]
 
MongoDB .local San Francisco 2020: Using Client Side Encryption in MongoDB 4.2
MongoDB .local San Francisco 2020: Using Client Side Encryption in MongoDB 4.2MongoDB .local San Francisco 2020: Using Client Side Encryption in MongoDB 4.2
MongoDB .local San Francisco 2020: Using Client Side Encryption in MongoDB 4.2
 
MongoDB .local San Francisco 2020: Using MongoDB Services in Kubernetes: any ...
MongoDB .local San Francisco 2020: Using MongoDB Services in Kubernetes: any ...MongoDB .local San Francisco 2020: Using MongoDB Services in Kubernetes: any ...
MongoDB .local San Francisco 2020: Using MongoDB Services in Kubernetes: any ...
 
MongoDB .local San Francisco 2020: Go on a Data Safari with MongoDB Charts!
MongoDB .local San Francisco 2020: Go on a Data Safari with MongoDB Charts!MongoDB .local San Francisco 2020: Go on a Data Safari with MongoDB Charts!
MongoDB .local San Francisco 2020: Go on a Data Safari with MongoDB Charts!
 
MongoDB .local San Francisco 2020: From SQL to NoSQL -- Changing Your Mindset
MongoDB .local San Francisco 2020: From SQL to NoSQL -- Changing Your MindsetMongoDB .local San Francisco 2020: From SQL to NoSQL -- Changing Your Mindset
MongoDB .local San Francisco 2020: From SQL to NoSQL -- Changing Your Mindset
 
MongoDB .local San Francisco 2020: MongoDB Atlas Jumpstart
MongoDB .local San Francisco 2020: MongoDB Atlas JumpstartMongoDB .local San Francisco 2020: MongoDB Atlas Jumpstart
MongoDB .local San Francisco 2020: MongoDB Atlas Jumpstart
 
MongoDB .local San Francisco 2020: Tips and Tricks++ for Querying and Indexin...
MongoDB .local San Francisco 2020: Tips and Tricks++ for Querying and Indexin...MongoDB .local San Francisco 2020: Tips and Tricks++ for Querying and Indexin...
MongoDB .local San Francisco 2020: Tips and Tricks++ for Querying and Indexin...
 
MongoDB .local San Francisco 2020: Aggregation Pipeline Power++
MongoDB .local San Francisco 2020: Aggregation Pipeline Power++MongoDB .local San Francisco 2020: Aggregation Pipeline Power++
MongoDB .local San Francisco 2020: Aggregation Pipeline Power++
 
MongoDB .local San Francisco 2020: A Complete Methodology of Data Modeling fo...
MongoDB .local San Francisco 2020: A Complete Methodology of Data Modeling fo...MongoDB .local San Francisco 2020: A Complete Methodology of Data Modeling fo...
MongoDB .local San Francisco 2020: A Complete Methodology of Data Modeling fo...
 
MongoDB .local San Francisco 2020: MongoDB Atlas Data Lake Technical Deep Dive
MongoDB .local San Francisco 2020: MongoDB Atlas Data Lake Technical Deep DiveMongoDB .local San Francisco 2020: MongoDB Atlas Data Lake Technical Deep Dive
MongoDB .local San Francisco 2020: MongoDB Atlas Data Lake Technical Deep Dive
 
MongoDB .local San Francisco 2020: Developing Alexa Skills with MongoDB & Golang
MongoDB .local San Francisco 2020: Developing Alexa Skills with MongoDB & GolangMongoDB .local San Francisco 2020: Developing Alexa Skills with MongoDB & Golang
MongoDB .local San Francisco 2020: Developing Alexa Skills with MongoDB & Golang
 
MongoDB .local Paris 2020: Realm : l'ingrédient secret pour de meilleures app...
MongoDB .local Paris 2020: Realm : l'ingrédient secret pour de meilleures app...MongoDB .local Paris 2020: Realm : l'ingrédient secret pour de meilleures app...
MongoDB .local Paris 2020: Realm : l'ingrédient secret pour de meilleures app...
 
MongoDB .local Paris 2020: Upply @MongoDB : Upply : Quand le Machine Learning...
MongoDB .local Paris 2020: Upply @MongoDB : Upply : Quand le Machine Learning...MongoDB .local Paris 2020: Upply @MongoDB : Upply : Quand le Machine Learning...
MongoDB .local Paris 2020: Upply @MongoDB : Upply : Quand le Machine Learning...
 

Kürzlich hochgeladen

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Victor Rentea
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Kürzlich hochgeladen (20)

Cyberprint. Dark Pink Apt Group [EN].pdf
Cyberprint. Dark Pink Apt Group [EN].pdfCyberprint. Dark Pink Apt Group [EN].pdf
Cyberprint. Dark Pink Apt Group [EN].pdf
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
 

Using MMS to Build New Environments

  • 1. MMS – Using MMS to Build New Environments MMS Technical Account Manager, MongoDB Peter C. Gravelle @mongodb
  • 2. What you are going to get out of today’s talk A. What is MMS A. Monitoring B. Backup B. What you can do with MMS Backup A. Spin up secondaries with minimal impact on your primary B. Build a sandbox for development or analytics to play in
  • 6. Two Deployment Models Using MongoDB Servers: cloud version Using my servers: on-premise
  • 8. What does MMS Monitoring give you? • Server metrics • Activity feed • Alerts • Hardware stats (optional) • User management • Logs and profiling data
  • 18. Cloud Version 1. Go to http://mms.mongodb.com 2. Create an account 3. Install one agent in your datacenter 4. Add hosts from the web interface 5. Enjoy!
  • 20. MMS Backup • Backup a replica set or sharded cluster • Initial sync + incremental • Generated snapshots every 6 hs • Restore via HTTPS or SCP • Restore replica sets to point-in-time (last 24hs) • Restore sharded clusters to any 15 minute (last 24hs)
  • 21. Picking a snapshot to restore
  • 23. Cloud Version - Billing • 12-months pre-paid: • $50 / GB / year • 6-hour interval snapshot stored for two days • Weekly snapshots stored for 1 month • Monthly snapshots stored for 1 year • Payment method: invoiced
  • 24. Cloud Version - Billing • Pay as you go • Oplog processing: $1 / GB / month • Snapshot storage: $0.08 / GB / month • Customer defines snapshot frequency and retention policy • Payment method: online
  • 25. What kind of environments can you create with MMS Backup?
  • 26. What kind of environments can you create? • Spin up a new secondary quicker at minimal additional load • Build a sandbox for analytics or developers
  • 27. Spin up a secondary quickly
  • 28. Using Backup Snapshots to Spin Up Secondaries Spinning up secondaries can take a long time if the data size is large. You can make your own data file snapshots by taking down a secondary and copying it off. But why? MMS Backup has your data files already!
  • 29. Spinning up secondary overview 1. Prepare your new environment 2. Get your restore files 3. Extract the restores 4. Make it a secondary
  • 30. Preparing to spin up the secondary Make sure you have room for your snapshot
  • 31. More preparation Ensure that you have enough oplog window to prevent an initial sync. Remember you have to download the snapshot and startup a mongod process.
  • 32. Spinning up secondary overview 1. Prepare your new environment 2. Get your restore files 3. Extract the restores 4. Make it a secondary
  • 34. Spinning up secondary overview 1. Prepare your new environment 2. Get your restore files 3. Extract the restores 4. Make it a secondary
  • 35. Extract Image and Start mongod tar –xvf backup-restore-file-name.tar.gz mv backup-restore-file-name data mongod --port PORT --dbpath data --logpath=data/monogdb.log This brings up your data in a standalone.
  • 36. Spinning up secondary overview 1. Prepare your new environment 2. Get your restore files 3. Extract the restores 4. Make it a secondary
  • 37. Seed the standalone as a secondary Run seedSecondary.sh with its appropriate options to create the oplog collection with the correct timestamp. Shut down the mongod process when this is complete
  • 38. Start up the secondary with the seeded oplog mongod --port=PORT --dbpath=data --logpath=data/mongodb.log -- replSet=REPLICASETNAME This PORT can be different than the other mongod process you started. The REPLICASETNAME should be the same as the name of the replica set that you will be connecting it back to.
  • 39. Connect the new secondary On the primary, connect a mongo shell and run: rs.add(“NEWSECONDARY:PORT”) Where NEWSECONDARY is the hostname of the secondary you just spun up, and PORT is the port defined in the previous examples. Now, just wait for rs.status() for the NEWSECONDARY to report that it’s in status SECONDARY. (Or check MMS!)
  • 40. Lets build a sandbox!
  • 41. Analytics, am I right?! The analytics people can be a bane to ops. Why? • They want to do big queries • They want to do slow queries • Their queries are just infrequent enough to not justify building indexes for them • Never mind the performance penalty for each index
  • 42. Developers, Developers, Developers! They also want to disrupt your nicely running system • Try new schemas • Change application server behavior • Stress test things
  • 43. So build them a sandbox! They can have their own (non-customer-impacting) DB off of your most recent snapshot. • Keeps them off the production servers • Lets them process the data as they wish • New collections with generated data • Lets them try new methods and applications
  • 44. How to build a sandbox 1. Get your restore files 2. Extract them 3. Set up sharding
  • 45. Get your Restore files The same rules apply: • Make sure you have the space • Choose push or pull (SCP/HTTPS) • Pick the snapshot you want • Wait for the download to complete
  • 46. How to build a sandbox 1. Get your restore files 2. Extract them 3. Set up sharding
  • 47. Extract your snapshot tar –xvf backup-restore-file-name.tar.gz mv backup-restore-file-name data mongod --port PORT --dbpath data --logpath=data/monogdb.log This brings up your data in a standalone. You can stop here (unless you’re sharding).
  • 48. How to build a sandbox 1. Get your restore files 2. Extract them 3. Set up sharding
  • 49. Sharding Step 1 Bring up the config server tar –xvf backup-restore-file-name.tar.gz mv backup-restore-file-name data mongod --port=CONFIGSRVRPORT --dbpath=data --logpath=data/mongodb.log -- configsvr=true
  • 50. Sharding step 2 Update the shard metadata: Remember, you have a new environment here, new hosts & ports! mongo --port=CONFIGSRVRPORT use config db.shards.find().pretty() Repeat if you’re setting up multiple config servers, but this is not necessary for this non-production environment. Remember, this only tells you what you need to update!
  • 51. What you got out of today’s talk A. What is MMS A. Monitoring B. Backup B. What you can do with MMS Backup A. Spin up secondaries with minimal impact on your primary B. Build a sandbox for development or analytics to play in
  • 52. Thank You MMS Technical Account Manager, MongoDB Peter C. Gravelle @mongodb