SlideShare a Scribd company logo
1 of 32
The Cloud Is About
More Than the Tech
Hello!
I’m Jeremy Livingston
VP Engineering @ Red Ventures
2
jeremylivingston livingstn jeremylivingston
Today’s Talk
● Why companies move to the cloud
● Implications on culture, org structure, and capabilities
● Bankrate.com’s migration to the cloud
● What we’ve learned - Mistakes, wins, and our evolution
3
The Bankrate.com Story
Hop into your time machine...
Place your screenshot here
5
Bankrate
in 1996:
😱
6
Bankrate
today:
👍
Our Journey to
Modernization
7
2015
Siloed & Heroic
Separate Engineering and Ops
teams - All on-call responsibilities
fall on Ops
First AWS Workload
Small applications built from
scratch - Architected for the
cloud
2016
Organizational Iteration
Continuous learning and
iteration toward a decentralized
organizational model
2018
Self-Service
Engineering teams fully
managing their own
infrastructure
2019
2015: Not much
better than 1996
Hand-Rolled Infrastructure
All changes were made
manually by humans. Zero
scaling.
“I need a server built.”
Manual & Heroic Releases
Deployments done weekly
Releases would literally
break the site for 30
minutes.
Unbalanced Responsibilities
Ops got all of the dirty work:
● Long deployments
● Late nights
● On-call
● Frequent data center
trips
8
Engineering
● Write all new code for product
development needs
● Work with business
stakeholders to define
deliverables and timeframes
● Determine what should be
deployed and when
Team Responsibilities
Technical Operations
● Deploy code from Engineering
● Provision servers for new
systems
● Manage on-call duties for all
production issues
● Hands-on data center work
9
A Typical Deployment
1. Open deployment ticket in TFS two days in advance
2. Engineer emails compiled DLL file to Ops Team
3. Ops manually RDPs into each production server, removes
it from a load balancer, and drags/drops the DLL
○ Certain workloads required this for 35+ servers*
4. After manual verification, the server is added back to the
load balancer
* If a deployment was unsuccessful, the same process was required to rollback
the code, often times for 35+ servers again.
10
Our Journey to
Modernization
11
2015
Siloed & Heroic
Separate Engineering and Ops
teams - All on-call responsibilities
fall on Ops
First AWS Workload
Small applications built from
scratch - Architected for the
cloud
2016
Organizational Iteration
Continuous learning and
iteration toward a decentralized
organizational model
2018
Self-Service
Engineering teams provisioning
and managing their own
infrastructure
2019
2016: New Workloads
in the Cloud
Team Formalization
Limited organizational
cloud competency
Created a small team (3)
to establish foundation
Porting of New Services
Rebuild of Bankrate.com,
CMS, portal, etc.
Transitioned to more than
AWS - Fastly, Github,
DataDog, etc.
Cultural Evolution
Partnership between
Engineering and Operations
Instrumentation as a first-
class citizen
12
Key Early Decisions
● All new systems in the cloud
● Start with (and require) automation
● Start small and build expertise
● Limit service sprawl
● Use SaaS until you outgrow it
13
Team Responsibilities
Engineering
● Develop new products
& features
● Partner with business
to define deliverables
● Create CI pipelines w/
Cloud support
Data Center
● Manages data center
environment
● Limited number of new
workloads / apps
● Deploys all data center
application changes
● Manages on-call for
data center systems
Cloud Engineering
● Creates core cloud
infrastructure
● Set cloud standards
(policies, automation, etc.)
● Deploys all application &
infrastructure changes
● Manages on-call for
cloud systems
14
● High organizational risk
● Not everyone will like this evolution
● Rip off the band-aid - Live in this world for as short of a
time as possible
● Invest in training and real-world tasks
Hybrid Team Structure
Separate Data Center & Cloud Engineering
Teams
15
Pros
● Learned pain points and set
standards early
● Deep expertise in a small group
● Needed focus on our foundation
(VPC, Networking, Security
Groups, etc.)
Org Structure - Pros & Cons
Infrastructure managed by Cloud Engineering
Cons
● Limited engineering exposure to
infrastructure
● Cloud was still a bottleneck
● Monitoring and deploying
applications was still centralized
● Moved many of our problems
elsewhere
16
Our Journey to
Modernization
17
2015
Siloed & Heroic
Separate Engineering and Ops
teams - All on-call responsibilities
fall on Ops
First AWS Workload
Small applications built from
scratch - Architected for the
cloud
2016
Organizational Iteration
Continuous learning and
iteration toward a decentralized
organizational model
2018
Self-Service
Engineering teams provisioning
and managing their own
infrastructure
2019
Organizational Iteration
Embedding Cloud Eng.
● SPOF
● Temporary solution
● Train teams, then go
elsewhere
Joining Sprint Planning
● Improved visibility
● Prioritization was still a
struggle
● Neglected platform
priorities
Scrum in Cloud Eng.
● Improved planning
● Didn’t help ad-hoc
work
● Still fighting for priority
across teams
18
Didn’t
solve our
problems:
19
“
Shift infrastructure left.
20
How We Shifted Responsibilities
Fast Lanes
Incentive for engineers to
contribute to their application
infrastructure.
Pair Programming
Pair on all new tasks to
broaden knowledge.
Containerization
Put configuration in the hands
of developers.
21
Engineering Champions
Identified a point person on
each team to evangelize the
change.
Shifting On-Call
Bring on-call into the hands of
those who can fix the issues.
Shifting Deployments
Empower engineers to deploy
their own changes.
Mostly Lift & Shift
Re-architecting
applications would have
(and has) taken years
Costly to absorb upfront
The Migration
6 Months - Team of 5
Visibility Improvements
Scaled down over time as
the metrics stabilized
Costs still remained high,
but risks were significantly
decreased
Training Opportunity
Real-world, hands-on
examples
22
Our Journey to
Modernization
23
2015
Siloed & Heroic
Separate Engineering and Ops
teams - All on-call responsibilities
fall on Ops
First AWS Workload
Small applications built from
scratch - Architected for the
cloud
2016
Organizational Iteration
Continuous learning and
iteration toward a decentralized
organizational model
2018
Self-Service
Engineering teams provisioning
and managing their own
infrastructure
2019
Product Engineering
● Full-stack (FE, BE, Infra, DB, Edge)
● Develop new tools / experiences
alongside Product
● On-Call for their applications
● Stakeholders: Business Leaders,
Marketing, Content
Team Responsibilities
Platform Engineering
● Cloud Infrastructure /
Foundation
● Platforms for Engineering Teams
to Self-Service Infrastructure
● OS Configuration / Automation
● Stakeholders: Engineering,
Security, Data
24
“
What’s next?
25
Key
Takeaways
26
“
Automate
everything.
27
“Bring engineers as close
to the infrastructure as
possible.
28
“ Use SaaS until
you outgrow
it.
29
“ Not everyone will
like this change.
(That’s okay!)
30
“
Don't try to fix
everything at once.
31
32
Thanks!
Any questions?
jeremylivingston livingstn jeremylivingston

More Related Content

What's hot

When your release plan is concluded at the HR office - Hanan Zakai
When your release plan is concluded at the HR office - Hanan  ZakaiWhen your release plan is concluded at the HR office - Hanan  Zakai
When your release plan is concluded at the HR office - Hanan ZakaiCodeValue
 
devops, platforms and devops platforms
devops, platforms and devops platformsdevops, platforms and devops platforms
devops, platforms and devops platformsAndrew Shafer
 
Pivotal Digital Transformation Forum: Munich
Pivotal Digital Transformation Forum: Munich Pivotal Digital Transformation Forum: Munich
Pivotal Digital Transformation Forum: Munich VMware Tanzu
 
Why Value Stream is key to Digital Product Delivery
Why Value Stream is key to Digital Product Delivery Why Value Stream is key to Digital Product Delivery
Why Value Stream is key to Digital Product Delivery Mani Maun
 
CWIN17 Toulouse / Automation and release management j.dorgueilh-cwin17
CWIN17 Toulouse / Automation and release management j.dorgueilh-cwin17CWIN17 Toulouse / Automation and release management j.dorgueilh-cwin17
CWIN17 Toulouse / Automation and release management j.dorgueilh-cwin17Capgemini
 
QSM Mendix Benchmark Report
QSM Mendix Benchmark ReportQSM Mendix Benchmark Report
QSM Mendix Benchmark ReportMatt Haney
 
Project Management Cloud App | CONSYSA
Project Management Cloud App | CONSYSAProject Management Cloud App | CONSYSA
Project Management Cloud App | CONSYSAAccutech Services LLC
 
The Bright Ops Future - Reinventing Operations in the Age of Cloud-Native IT
The Bright Ops Future - Reinventing Operations in the Age of Cloud-Native ITThe Bright Ops Future - Reinventing Operations in the Age of Cloud-Native IT
The Bright Ops Future - Reinventing Operations in the Age of Cloud-Native ITVMware Tanzu
 
Cloud Foundry Summit 2015: A Year of Innovation: Cloud Foundry Lessons Learned
Cloud Foundry Summit 2015: A Year of Innovation: Cloud Foundry Lessons LearnedCloud Foundry Summit 2015: A Year of Innovation: Cloud Foundry Lessons Learned
Cloud Foundry Summit 2015: A Year of Innovation: Cloud Foundry Lessons LearnedVMware Tanzu
 
Rediscover Software Development Edward Hieatt Web Summit 2014
Rediscover Software Development Edward Hieatt Web Summit 2014Rediscover Software Development Edward Hieatt Web Summit 2014
Rediscover Software Development Edward Hieatt Web Summit 2014VMware Tanzu
 
Cloud Based Collaboration Presentation - Aguirre
Cloud Based Collaboration Presentation - AguirreCloud Based Collaboration Presentation - Aguirre
Cloud Based Collaboration Presentation - AguirreLisa Aguirre
 
30 days of cloud
30 days of cloud30 days of cloud
30 days of cloudDSCMESCOE
 
A use case with cloud foundry deployment
A use case with cloud foundry deploymentA use case with cloud foundry deployment
A use case with cloud foundry deploymentKrishna-Kumar
 
xPaaS – day in the life of a modern application developer
xPaaS – day in the life of a modern application developerxPaaS – day in the life of a modern application developer
xPaaS – day in the life of a modern application developerEric D. Schabell
 
Jesse Pulfer Pivotal Overview June 2018
Jesse Pulfer Pivotal Overview June 2018Jesse Pulfer Pivotal Overview June 2018
Jesse Pulfer Pivotal Overview June 2018VMware Tanzu
 
Aris 9 See the Future Today
Aris 9 See the Future TodayAris 9 See the Future Today
Aris 9 See the Future TodaySoftware AG
 
Jan 21st A360 Hangout: Collaboration for Revit Presentation
Jan 21st A360 Hangout: Collaboration for Revit PresentationJan 21st A360 Hangout: Collaboration for Revit Presentation
Jan 21st A360 Hangout: Collaboration for Revit PresentationAutodesk A360
 
Holistic approach to cloud adoption
Holistic approach to cloud adoptionHolistic approach to cloud adoption
Holistic approach to cloud adoptionThoughtworks
 
Accelerate Your Digital Transformation: How to Achieve Business Agility with ...
Accelerate Your Digital Transformation: How to Achieve Business Agility with ...Accelerate Your Digital Transformation: How to Achieve Business Agility with ...
Accelerate Your Digital Transformation: How to Achieve Business Agility with ...XebiaLabs
 
July 29: Achieve Stakeholder Alignment on Governance: Navigator by Pivotal Labs
July 29: Achieve Stakeholder Alignment on Governance: Navigator by Pivotal LabsJuly 29: Achieve Stakeholder Alignment on Governance: Navigator by Pivotal Labs
July 29: Achieve Stakeholder Alignment on Governance: Navigator by Pivotal LabsVMware Tanzu
 

What's hot (20)

When your release plan is concluded at the HR office - Hanan Zakai
When your release plan is concluded at the HR office - Hanan  ZakaiWhen your release plan is concluded at the HR office - Hanan  Zakai
When your release plan is concluded at the HR office - Hanan Zakai
 
devops, platforms and devops platforms
devops, platforms and devops platformsdevops, platforms and devops platforms
devops, platforms and devops platforms
 
Pivotal Digital Transformation Forum: Munich
Pivotal Digital Transformation Forum: Munich Pivotal Digital Transformation Forum: Munich
Pivotal Digital Transformation Forum: Munich
 
Why Value Stream is key to Digital Product Delivery
Why Value Stream is key to Digital Product Delivery Why Value Stream is key to Digital Product Delivery
Why Value Stream is key to Digital Product Delivery
 
CWIN17 Toulouse / Automation and release management j.dorgueilh-cwin17
CWIN17 Toulouse / Automation and release management j.dorgueilh-cwin17CWIN17 Toulouse / Automation and release management j.dorgueilh-cwin17
CWIN17 Toulouse / Automation and release management j.dorgueilh-cwin17
 
QSM Mendix Benchmark Report
QSM Mendix Benchmark ReportQSM Mendix Benchmark Report
QSM Mendix Benchmark Report
 
Project Management Cloud App | CONSYSA
Project Management Cloud App | CONSYSAProject Management Cloud App | CONSYSA
Project Management Cloud App | CONSYSA
 
The Bright Ops Future - Reinventing Operations in the Age of Cloud-Native IT
The Bright Ops Future - Reinventing Operations in the Age of Cloud-Native ITThe Bright Ops Future - Reinventing Operations in the Age of Cloud-Native IT
The Bright Ops Future - Reinventing Operations in the Age of Cloud-Native IT
 
Cloud Foundry Summit 2015: A Year of Innovation: Cloud Foundry Lessons Learned
Cloud Foundry Summit 2015: A Year of Innovation: Cloud Foundry Lessons LearnedCloud Foundry Summit 2015: A Year of Innovation: Cloud Foundry Lessons Learned
Cloud Foundry Summit 2015: A Year of Innovation: Cloud Foundry Lessons Learned
 
Rediscover Software Development Edward Hieatt Web Summit 2014
Rediscover Software Development Edward Hieatt Web Summit 2014Rediscover Software Development Edward Hieatt Web Summit 2014
Rediscover Software Development Edward Hieatt Web Summit 2014
 
Cloud Based Collaboration Presentation - Aguirre
Cloud Based Collaboration Presentation - AguirreCloud Based Collaboration Presentation - Aguirre
Cloud Based Collaboration Presentation - Aguirre
 
30 days of cloud
30 days of cloud30 days of cloud
30 days of cloud
 
A use case with cloud foundry deployment
A use case with cloud foundry deploymentA use case with cloud foundry deployment
A use case with cloud foundry deployment
 
xPaaS – day in the life of a modern application developer
xPaaS – day in the life of a modern application developerxPaaS – day in the life of a modern application developer
xPaaS – day in the life of a modern application developer
 
Jesse Pulfer Pivotal Overview June 2018
Jesse Pulfer Pivotal Overview June 2018Jesse Pulfer Pivotal Overview June 2018
Jesse Pulfer Pivotal Overview June 2018
 
Aris 9 See the Future Today
Aris 9 See the Future TodayAris 9 See the Future Today
Aris 9 See the Future Today
 
Jan 21st A360 Hangout: Collaboration for Revit Presentation
Jan 21st A360 Hangout: Collaboration for Revit PresentationJan 21st A360 Hangout: Collaboration for Revit Presentation
Jan 21st A360 Hangout: Collaboration for Revit Presentation
 
Holistic approach to cloud adoption
Holistic approach to cloud adoptionHolistic approach to cloud adoption
Holistic approach to cloud adoption
 
Accelerate Your Digital Transformation: How to Achieve Business Agility with ...
Accelerate Your Digital Transformation: How to Achieve Business Agility with ...Accelerate Your Digital Transformation: How to Achieve Business Agility with ...
Accelerate Your Digital Transformation: How to Achieve Business Agility with ...
 
July 29: Achieve Stakeholder Alignment on Governance: Navigator by Pivotal Labs
July 29: Achieve Stakeholder Alignment on Governance: Navigator by Pivotal LabsJuly 29: Achieve Stakeholder Alignment on Governance: Navigator by Pivotal Labs
July 29: Achieve Stakeholder Alignment on Governance: Navigator by Pivotal Labs
 

Similar to The Cloud Is About More Than the Tech

Making Your Apps Cloudy - Migrating to Microservices
Making Your Apps Cloudy - Migrating to MicroservicesMaking Your Apps Cloudy - Migrating to Microservices
Making Your Apps Cloudy - Migrating to MicroservicesCloudify Community
 
Accelerate Application Migration - August 5, 2020
Accelerate Application Migration - August 5, 2020Accelerate Application Migration - August 5, 2020
Accelerate Application Migration - August 5, 2020VMware Tanzu
 
Automation, Audits, and Apps Tour
Automation, Audits, and Apps TourAutomation, Audits, and Apps Tour
Automation, Audits, and Apps TourChef
 
Creating an Effective Roadmap for Your Cloud Journey (ENT225-R1) - AWS re:Inv...
Creating an Effective Roadmap for Your Cloud Journey (ENT225-R1) - AWS re:Inv...Creating an Effective Roadmap for Your Cloud Journey (ENT225-R1) - AWS re:Inv...
Creating an Effective Roadmap for Your Cloud Journey (ENT225-R1) - AWS re:Inv...Amazon Web Services
 
Migration to AWS: Creating a Foundation for Modernisation and Innovation - AW...
Migration to AWS: Creating a Foundation for Modernisation and Innovation - AW...Migration to AWS: Creating a Foundation for Modernisation and Innovation - AW...
Migration to AWS: Creating a Foundation for Modernisation and Innovation - AW...Amazon Web Services
 
DeveloperWeek 2020: Cloud-Native and Microservices Accelerate Process Improve...
DeveloperWeek 2020: Cloud-Native and Microservices Accelerate Process Improve...DeveloperWeek 2020: Cloud-Native and Microservices Accelerate Process Improve...
DeveloperWeek 2020: Cloud-Native and Microservices Accelerate Process Improve...Shahir Daya
 
Best Practices for Data Center Migration Planning - August 2016 Monthly Webin...
Best Practices for Data Center Migration Planning - August 2016 Monthly Webin...Best Practices for Data Center Migration Planning - August 2016 Monthly Webin...
Best Practices for Data Center Migration Planning - August 2016 Monthly Webin...Amazon Web Services
 
Achieve True Hybrid Cloud with Azure - Built for Scale, Security and Interope...
Achieve True Hybrid Cloud with Azure - Built for Scale, Security and Interope...Achieve True Hybrid Cloud with Azure - Built for Scale, Security and Interope...
Achieve True Hybrid Cloud with Azure - Built for Scale, Security and Interope...Cloudify Community
 
Cwin16 tls-s2-0945-going cloud native
Cwin16 tls-s2-0945-going cloud nativeCwin16 tls-s2-0945-going cloud native
Cwin16 tls-s2-0945-going cloud nativeCapgemini
 
Migrating to Cloud: Inhouse Hadoop to Databricks (3)
Migrating to Cloud: Inhouse Hadoop to Databricks (3)Migrating to Cloud: Inhouse Hadoop to Databricks (3)
Migrating to Cloud: Inhouse Hadoop to Databricks (3)Knoldus Inc.
 
Implementing Service Oriented Architecture
Implementing Service Oriented ArchitectureImplementing Service Oriented Architecture
Implementing Service Oriented ArchitectureAmazon Web Services
 
Implementing Service Oriented Architecture
Implementing Service Oriented ArchitectureImplementing Service Oriented Architecture
Implementing Service Oriented ArchitectureAmazon Web Services
 
Implementing Service Oriented Architecture
Implementing Service Oriented Architecture Implementing Service Oriented Architecture
Implementing Service Oriented Architecture Amazon Web Services
 
Data Center Migration to the AWS Cloud
Data Center Migration to the AWS CloudData Center Migration to the AWS Cloud
Data Center Migration to the AWS CloudTom Laszewski
 
Applying DevOps, PaaS and cloud for better citizen service outcomes - IBM Fe...
Applying DevOps, PaaS and cloud for better citizen service  outcomes - IBM Fe...Applying DevOps, PaaS and cloud for better citizen service  outcomes - IBM Fe...
Applying DevOps, PaaS and cloud for better citizen service outcomes - IBM Fe...Sanjeev Sharma
 
AWS Partner Webcast - Data Center Migration to the AWS Cloud
AWS Partner Webcast - Data Center Migration to the AWS CloudAWS Partner Webcast - Data Center Migration to the AWS Cloud
AWS Partner Webcast - Data Center Migration to the AWS CloudAmazon Web Services
 
How to Shift to a Serverless Mindset
How to Shift to a Serverless MindsetHow to Shift to a Serverless Mindset
How to Shift to a Serverless MindsetUXDXConf
 
Deloitte & Mulesoft : The Right Mix
Deloitte & Mulesoft : The Right MixDeloitte & Mulesoft : The Right Mix
Deloitte & Mulesoft : The Right MixDavid Graham
 

Similar to The Cloud Is About More Than the Tech (20)

Making Your Apps Cloudy - Migrating to Microservices
Making Your Apps Cloudy - Migrating to MicroservicesMaking Your Apps Cloudy - Migrating to Microservices
Making Your Apps Cloudy - Migrating to Microservices
 
Accelerate Application Migration - August 5, 2020
Accelerate Application Migration - August 5, 2020Accelerate Application Migration - August 5, 2020
Accelerate Application Migration - August 5, 2020
 
Automation, Audits, and Apps Tour
Automation, Audits, and Apps TourAutomation, Audits, and Apps Tour
Automation, Audits, and Apps Tour
 
Creating an Effective Roadmap for Your Cloud Journey (ENT225-R1) - AWS re:Inv...
Creating an Effective Roadmap for Your Cloud Journey (ENT225-R1) - AWS re:Inv...Creating an Effective Roadmap for Your Cloud Journey (ENT225-R1) - AWS re:Inv...
Creating an Effective Roadmap for Your Cloud Journey (ENT225-R1) - AWS re:Inv...
 
Migration to AWS: Creating a Foundation for Modernisation and Innovation - AW...
Migration to AWS: Creating a Foundation for Modernisation and Innovation - AW...Migration to AWS: Creating a Foundation for Modernisation and Innovation - AW...
Migration to AWS: Creating a Foundation for Modernisation and Innovation - AW...
 
DeveloperWeek 2020: Cloud-Native and Microservices Accelerate Process Improve...
DeveloperWeek 2020: Cloud-Native and Microservices Accelerate Process Improve...DeveloperWeek 2020: Cloud-Native and Microservices Accelerate Process Improve...
DeveloperWeek 2020: Cloud-Native and Microservices Accelerate Process Improve...
 
Slide_Deck_CloudAttack.pptx
Slide_Deck_CloudAttack.pptxSlide_Deck_CloudAttack.pptx
Slide_Deck_CloudAttack.pptx
 
Best Practices for Data Center Migration Planning - August 2016 Monthly Webin...
Best Practices for Data Center Migration Planning - August 2016 Monthly Webin...Best Practices for Data Center Migration Planning - August 2016 Monthly Webin...
Best Practices for Data Center Migration Planning - August 2016 Monthly Webin...
 
Achieve True Hybrid Cloud with Azure - Built for Scale, Security and Interope...
Achieve True Hybrid Cloud with Azure - Built for Scale, Security and Interope...Achieve True Hybrid Cloud with Azure - Built for Scale, Security and Interope...
Achieve True Hybrid Cloud with Azure - Built for Scale, Security and Interope...
 
Cwin16 tls-s2-0945-going cloud native
Cwin16 tls-s2-0945-going cloud nativeCwin16 tls-s2-0945-going cloud native
Cwin16 tls-s2-0945-going cloud native
 
Migrating to Cloud: Inhouse Hadoop to Databricks (3)
Migrating to Cloud: Inhouse Hadoop to Databricks (3)Migrating to Cloud: Inhouse Hadoop to Databricks (3)
Migrating to Cloud: Inhouse Hadoop to Databricks (3)
 
Implementing Service Oriented Architecture
Implementing Service Oriented ArchitectureImplementing Service Oriented Architecture
Implementing Service Oriented Architecture
 
Implementing Service Oriented Architecture
Implementing Service Oriented ArchitectureImplementing Service Oriented Architecture
Implementing Service Oriented Architecture
 
Implementing Service Oriented Architecture
Implementing Service Oriented Architecture Implementing Service Oriented Architecture
Implementing Service Oriented Architecture
 
Agile EcoSystem
Agile EcoSystemAgile EcoSystem
Agile EcoSystem
 
Data Center Migration to the AWS Cloud
Data Center Migration to the AWS CloudData Center Migration to the AWS Cloud
Data Center Migration to the AWS Cloud
 
Applying DevOps, PaaS and cloud for better citizen service outcomes - IBM Fe...
Applying DevOps, PaaS and cloud for better citizen service  outcomes - IBM Fe...Applying DevOps, PaaS and cloud for better citizen service  outcomes - IBM Fe...
Applying DevOps, PaaS and cloud for better citizen service outcomes - IBM Fe...
 
AWS Partner Webcast - Data Center Migration to the AWS Cloud
AWS Partner Webcast - Data Center Migration to the AWS CloudAWS Partner Webcast - Data Center Migration to the AWS Cloud
AWS Partner Webcast - Data Center Migration to the AWS Cloud
 
How to Shift to a Serverless Mindset
How to Shift to a Serverless MindsetHow to Shift to a Serverless Mindset
How to Shift to a Serverless Mindset
 
Deloitte & Mulesoft : The Right Mix
Deloitte & Mulesoft : The Right MixDeloitte & Mulesoft : The Right Mix
Deloitte & Mulesoft : The Right Mix
 

Recently uploaded

My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhisoniya singh
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Patryk Bandurski
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxOnBoard
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxKatpro Technologies
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106
 

Recently uploaded (20)

My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping Elbows
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptx
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 

The Cloud Is About More Than the Tech

  • 1. The Cloud Is About More Than the Tech
  • 2. Hello! I’m Jeremy Livingston VP Engineering @ Red Ventures 2 jeremylivingston livingstn jeremylivingston
  • 3. Today’s Talk ● Why companies move to the cloud ● Implications on culture, org structure, and capabilities ● Bankrate.com’s migration to the cloud ● What we’ve learned - Mistakes, wins, and our evolution 3
  • 4. The Bankrate.com Story Hop into your time machine...
  • 5. Place your screenshot here 5 Bankrate in 1996: 😱
  • 7. Our Journey to Modernization 7 2015 Siloed & Heroic Separate Engineering and Ops teams - All on-call responsibilities fall on Ops First AWS Workload Small applications built from scratch - Architected for the cloud 2016 Organizational Iteration Continuous learning and iteration toward a decentralized organizational model 2018 Self-Service Engineering teams fully managing their own infrastructure 2019
  • 8. 2015: Not much better than 1996 Hand-Rolled Infrastructure All changes were made manually by humans. Zero scaling. “I need a server built.” Manual & Heroic Releases Deployments done weekly Releases would literally break the site for 30 minutes. Unbalanced Responsibilities Ops got all of the dirty work: ● Long deployments ● Late nights ● On-call ● Frequent data center trips 8
  • 9. Engineering ● Write all new code for product development needs ● Work with business stakeholders to define deliverables and timeframes ● Determine what should be deployed and when Team Responsibilities Technical Operations ● Deploy code from Engineering ● Provision servers for new systems ● Manage on-call duties for all production issues ● Hands-on data center work 9
  • 10. A Typical Deployment 1. Open deployment ticket in TFS two days in advance 2. Engineer emails compiled DLL file to Ops Team 3. Ops manually RDPs into each production server, removes it from a load balancer, and drags/drops the DLL ○ Certain workloads required this for 35+ servers* 4. After manual verification, the server is added back to the load balancer * If a deployment was unsuccessful, the same process was required to rollback the code, often times for 35+ servers again. 10
  • 11. Our Journey to Modernization 11 2015 Siloed & Heroic Separate Engineering and Ops teams - All on-call responsibilities fall on Ops First AWS Workload Small applications built from scratch - Architected for the cloud 2016 Organizational Iteration Continuous learning and iteration toward a decentralized organizational model 2018 Self-Service Engineering teams provisioning and managing their own infrastructure 2019
  • 12. 2016: New Workloads in the Cloud Team Formalization Limited organizational cloud competency Created a small team (3) to establish foundation Porting of New Services Rebuild of Bankrate.com, CMS, portal, etc. Transitioned to more than AWS - Fastly, Github, DataDog, etc. Cultural Evolution Partnership between Engineering and Operations Instrumentation as a first- class citizen 12
  • 13. Key Early Decisions ● All new systems in the cloud ● Start with (and require) automation ● Start small and build expertise ● Limit service sprawl ● Use SaaS until you outgrow it 13
  • 14. Team Responsibilities Engineering ● Develop new products & features ● Partner with business to define deliverables ● Create CI pipelines w/ Cloud support Data Center ● Manages data center environment ● Limited number of new workloads / apps ● Deploys all data center application changes ● Manages on-call for data center systems Cloud Engineering ● Creates core cloud infrastructure ● Set cloud standards (policies, automation, etc.) ● Deploys all application & infrastructure changes ● Manages on-call for cloud systems 14
  • 15. ● High organizational risk ● Not everyone will like this evolution ● Rip off the band-aid - Live in this world for as short of a time as possible ● Invest in training and real-world tasks Hybrid Team Structure Separate Data Center & Cloud Engineering Teams 15
  • 16. Pros ● Learned pain points and set standards early ● Deep expertise in a small group ● Needed focus on our foundation (VPC, Networking, Security Groups, etc.) Org Structure - Pros & Cons Infrastructure managed by Cloud Engineering Cons ● Limited engineering exposure to infrastructure ● Cloud was still a bottleneck ● Monitoring and deploying applications was still centralized ● Moved many of our problems elsewhere 16
  • 17. Our Journey to Modernization 17 2015 Siloed & Heroic Separate Engineering and Ops teams - All on-call responsibilities fall on Ops First AWS Workload Small applications built from scratch - Architected for the cloud 2016 Organizational Iteration Continuous learning and iteration toward a decentralized organizational model 2018 Self-Service Engineering teams provisioning and managing their own infrastructure 2019
  • 18. Organizational Iteration Embedding Cloud Eng. ● SPOF ● Temporary solution ● Train teams, then go elsewhere Joining Sprint Planning ● Improved visibility ● Prioritization was still a struggle ● Neglected platform priorities Scrum in Cloud Eng. ● Improved planning ● Didn’t help ad-hoc work ● Still fighting for priority across teams 18
  • 21. How We Shifted Responsibilities Fast Lanes Incentive for engineers to contribute to their application infrastructure. Pair Programming Pair on all new tasks to broaden knowledge. Containerization Put configuration in the hands of developers. 21 Engineering Champions Identified a point person on each team to evangelize the change. Shifting On-Call Bring on-call into the hands of those who can fix the issues. Shifting Deployments Empower engineers to deploy their own changes.
  • 22. Mostly Lift & Shift Re-architecting applications would have (and has) taken years Costly to absorb upfront The Migration 6 Months - Team of 5 Visibility Improvements Scaled down over time as the metrics stabilized Costs still remained high, but risks were significantly decreased Training Opportunity Real-world, hands-on examples 22
  • 23. Our Journey to Modernization 23 2015 Siloed & Heroic Separate Engineering and Ops teams - All on-call responsibilities fall on Ops First AWS Workload Small applications built from scratch - Architected for the cloud 2016 Organizational Iteration Continuous learning and iteration toward a decentralized organizational model 2018 Self-Service Engineering teams provisioning and managing their own infrastructure 2019
  • 24. Product Engineering ● Full-stack (FE, BE, Infra, DB, Edge) ● Develop new tools / experiences alongside Product ● On-Call for their applications ● Stakeholders: Business Leaders, Marketing, Content Team Responsibilities Platform Engineering ● Cloud Infrastructure / Foundation ● Platforms for Engineering Teams to Self-Service Infrastructure ● OS Configuration / Automation ● Stakeholders: Engineering, Security, Data 24
  • 28. “Bring engineers as close to the infrastructure as possible. 28
  • 29. “ Use SaaS until you outgrow it. 29
  • 30. “ Not everyone will like this change. (That’s okay!) 30
  • 31. “ Don't try to fix everything at once. 31