Better DevEx at Netflix (QCon NY 2018)

BetterDevExatNetflix
PolyglotandContainersMike McGarr
@SonOfGarr
© J. Michael McGarr, 2018

Datacenter
Monolithic Java application
Oracle database

AWS
Java microservices
NoSQL

A Java shop

JavaatNetflix© J. Michael McGarr, 2018

SupportingJava

SupportingJava
· Developer Tools

SupportingJava
· Developer Tools
· Build and CI

SupportingJava
· Developer Tools
· Build and CI
· Runtime platform

SupportingJava
· Developer Tools
· Build and CI
· Runtime platform
· Insight Engineering

SupportingJava
· Developer Tools
· Build and CI
· Runtime platform
· Cloud Security

SupportingJava
· Developer Tools
· Build and CI
· Runtime platform
· Cloud Security
· Performance Engineering

SupportingJava
· Developer Tools
· Build and CI
· Runtime platform
· Cloud Security
· Cloud Data Engineering

SupportingJava
· Developer Tools
· Build and CI
· Runtime platform
· Cloud Security
· Demand Engineering

SupportingJava
· Developer Tools
· Build and CI
· Runtime platform
· Cloud Security
· Demand Engineering
· Reliability Engineering

Build and deployment

HowdoNetflixengineerspushcode?

1. Build (w/ Gradle)

2. Bake (immutable servers)

2. Bake (immutable servers)
3. Deploy (w/ Spinnaker)

thePavedRoad

NebulaOspackage
Package your Java application
as a .deb or .rpm

Non-JavaatNetflix

Non-Javalanguagegrowthrose2014

PythonandJavaScript

Node.jsapp
produce a .deb

Thisworksright?

Really!? I have to use
Gradle for Node.js?

Yes. We are a Java shop.

tipping point

Produce
Node.js .debs
using Native tools

Nebula for Node.js

Build tool

Build tool
Developer workflow tool

Language agnostic

Native (or native-like)

reduce cognitive load

NEWT
(Netflix Workflow Toolkit)

Golang

Newt for node.js

Problem # 1:
Simplify Node.js debian packaging

newt package

Gradle/Java hidden in a Docker container

Node.js developers don't install Java/Gradle

Problem # 2:
Now I need Docker?

Install & configure
tools per execution

Provide consistency throughout

Problem # 3:
I still need to build!

newt build

Runs package.json build
script:
npm install &&
eslint src/** &&
npm test

Problem #4:
Keep NPM/Nodejs versions consistent

definetoolversions

newt exec

newt exec npmvs.npm

So now I need to type
newt exec npm
everytime?

alias npm="newt exec npm --"

Whathavewegained?

Whathavewegained?
· Simplified packaging for all languages

Whathavewegained?
· Tooling consistency

Whathavewegained?
· Tool environment isolation

Whathavewegained?
· Tool environment isolation
· Agnostic to build tools

Unlocking
Hiddenpotential© J. Michael McGarr, 2018

We want homogenous apps

app-types

app types

configurable commands

enablement through inter-sourcing

better documentation?

Developer friendly docs
newt init --app-type
doc-site

Development ecosystem complexity

Ecosystemawareness

Ecosystemawareness
· newt spinnaker start

Ecosystemawareness
· newt spinnaker browse

Ecosystemawareness
· newt ci history

Ecosystemawareness
· newt ci history
· newt ci list

Ecosystemawareness
· newt ci history
· newt ci list
· newt ci start

Ecosystemawareness
· newt ci history
· newt ci list
· newt ci start
· newt ci stop

Ecosystemawareness
· newt ci history
· newt ci list
· newt ci start
· newt ci stop
· newt ci tail

Ecosystemawareness
· newt ci history
· newt ci list
· newt ci start
· newt ci stop
· newt ci tail
· newt ci browse

oh yeah...support

$ newt report-error

Newt is a tool platform

Titus

Whatwelearned?

Whatwelearned?
· Polyglot can be expensive

Whatwelearned?
· Containers make for great tool distribution

Whatwelearned?
· Build platforms, not just tools

Whatwelearned?
· Provide native solutions (or native-like)

Whatwelearned?
· Provide native solutions (or native-like)
· Reduce cognitive load

Thankyou!Mike McGarr (@SonOfGarr)

Better DevEx at Netflix (QCon NY 2018)

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Better DevEx at Netflix (QCon NY 2018)

Similar to Better DevEx at Netflix (QCon NY 2018) (20)

More from Mike McGarr

More from Mike McGarr (13)

Recently uploaded

Recently uploaded (20)

Better DevEx at Netflix (QCon NY 2018)