2 years ago at DOES14, I presented “Vision Versus Execution: Implementing Continuous Delivery”. I shared how we achieved a big Continuous Delivery win – increasing software test coverage and delivery velocity and efficiency. Since then, we have been busy scaling DevOps, Continuous Delivery and Lean principles across teams and practices throughout Urban Science. This rollout included both a cultural aspect, as well as an implementation of a centralized, shared, self-service automation solution for our teams – enabling them to “opt-in” to an automated pipeline. In this talk I will present anecdotes and learnings gathered through our experience over the past two years and discuss the challenges and the value of scaling DevOps across the organization.

1. Are we there yet?
Scaling DevOps for continuous improvement
Marc Priolo, Urban Science
DevOps Enterprise Summit 2016

2. v © 2016 Urban Science Confidential
Agenda
• Introduction
• Last time I was here…
• The next step in our journey
• Results
• Remaining challenges
Presenter: Marc Priolo

3. INTRODUCTION

4. v © 2016 Urban Science Confidential
Marc Priolo, Software Configuration Manager
Focused on helping Urban Science
deliver high-quality software frequently
and reliably through implementing
“Continuous Delivery” best practices.
Over 15 years of industry experience:
• Consultant
• DBA
• Technical Support (manager)
• Release Management (manager)
Presenter: Marc Priolo

5. v © 2016 Urban Science Confidential
• As business scientists, we invent solutions for mission critical challenges –
we create powerful, prescriptive, never-been-done-before solutions
• Think Big Data “in” & client unique solutions “out”
Presenter: Marc Priolo
More than a consulting firm. More than a software company.

6. v © 2016 Urban Science Confidential
Global, proven partners
Years of operation: 40
Country Presence: 100+
Offices: 19
Expert employees: 900
Major auto customers: ALL
Dealership customers: 20K +
B2B client satisfaction Highest in industry
Presenter: Marc Priolo

7. LAST TIME I WAS HERE…

8. v © 2016 Urban Science Confidential
Why: Starting the DevOps journey
Increase Scalability
Increase Consistency
Increase Efficiency
Increase Expediency
Reduce Complexity
Presenter: Marc Priolo

9. v © 2016 Urban Science Confidential
How: Automate everything
We had a choice.
• The most visible
o Hardest to perform manual deployments & newer projects?
• Reduce human error / complexity
• Minimal speed increase
• Low adoption / high maintenance
• ROI more than ½ a year
• The most mundane
o Mature, established and repetitious deployments.
• Reduce human error / complexity
• Drastic speed increase
• High adoption / low maintenance
• ROI less than two months
• Winner!
Presenter: Marc Priolo

10. v © 2016 Urban Science Confidential
The journey
We’re just getting
started.
• 2014
o Automate 135 monthly European & USA products
• 2015 and beyond
o Automate the “most visible” & newer projects
o Implement end to end automated functional testing
• Let me tell you where we are at now…
Presenter: Marc Priolo

11. THE NEXT STEP IN OUR JOURNEY

12. v © 2016 Urban Science Confidential
Provide a pipeline catalogue
Why provide a limited
catalogue?
• Standardization
• Scalability
• Support
Presenter: Marc Priolo

13. v © 2016 Urban Science Confidential
Catalogue offering
Pipeline offerings
1. Static
a. Data
b. Data & Code
2. Dynamic
3. Self-Service/Sandbox*
Presenter: Marc Priolo

14. v © 2016 Urban Science Confidential
Static (legacy) deep dive
– Fixed deployment logic tied to
pipeline
– Fixed pipeline environments
– Static pipeline
Commit
Build, Unit Test &
Package
Deploy to
CI
Deploy to
QA
Deploy to
Staging
Deploy to
Production
Presenter: Marc Priolo

15. v © 2016 Urban Science Confidential
Dynamic deep dive
– Deployment logic checked with code
– Artifact dependency model
– Automated testing, an equal artifact
– Dynamic pipeline environments
– Artifact maturity path
• Dev → QA → RTI → RTD
Presenter: Marc Priolo
Commit
Build, Unit Test &
Package
Deploy to
CI
(Dev)
Deploy to
QA
(QA)
Deploy to
Staging
(RTI)
Deploy to
Production
(RTD)
Deploy to
Smoke
Test
Deploy to
Regression
Deploy to
Nightly
Deploy to
Dev
Deploy to
Preview
Deploy to
Load Test
Deploy to
Mirror
Deploy to
DR

16. RESULTS

17. v © 2016 Urban Science Confidential
Continuous Improvement (and how!)
2014 2016
Application
Deployments ~1K >50K
Manual Work
Avoided (hours) ~2K ~22K
Full Time Employees
“Re-deployable” ~1 >10
Presenter: Marc Priolo

18. v © 2016 Urban Science Confidential
Business Benefit: Agility and Higher Customer Satisfaction!
We used to request at least five business
days notice prior to an update to:
1) give ample time for programming
2) create deployment package, and
3) reserve deployment slot availability.
Now, our team can perform updates
within one business day from receiving
the request from the client.
Presenter: Marc Priolo
5days
1day
From
to

19. REMAINING CHALLENGES

20. v © 2016 Urban Science Confidential
Challenges
My coffee is still not Continuously Deployed!!!
Switching from reactive to proactive mindset
Rebalancing roles & expectations
My team a bottleneck…
Education
Presenter: Marc Priolo

21. v © 2016 Urban Science Confidential
Up next
• Automated functional testing
• Integration into new systems
• Operations Dashboards
• Continuously Improve!
• Enhance, evolve, reinvent
Presenter: Marc Priolo

22. v © 2016 Urban Science Confidential
Links
• Communication resources:
o Toastmasters international = https://www.toastmasters.org/
• Southern California resources (Shameless plug):
o SoCal Continuous Delivery Meetup = https://www.meetup.com/SoCal-Continuous-Delivery-Meetup
o Orange County DevOps Meetup = https://www.meetup.com/Orange-County-DevOps-Meetup
• Urban Science Job opening (Shameless recruiting):
o We’re hiring! = http://www.urbanscience.com/careers/
• DevOps Release Automation platform
o ElectricFlow = http://electric-cloud.com/products/electricflow
Presenter: Marc Priolo

23. v © 2016 Urban Science Confidential
QUESTIONS?
Presenter: Marc Priolo

24. v © 2016 Urban Science Confidential
That’s all folks!
Presenter: Marc Priolo