Jesper Richter-Reichhelm - Continuous Evolution at Wooga - code.talks 2015

Continuous Evolution
at Wooga
Jesper Richter-Reichhelm
@jrirei

Game Evolution
Iterative improvements

Wooga team
FE Dev
BE Dev
Art
Product

“You build it, you run it.
- Werner Vogels

SQL
app
lb
SQL
Browser
sql sql
appapp

Monster World
FE Dev
BE Dev
Art
Product

DevOps
(just 2 devs involved)
Daily iterations
(sometimes faster)
Monster World
Fixes
Optimizations
Bigger DBs
More DBs

app
lb
Browser
SQL
sql
appapp
lb
app appappapp appapp
SQL
sql
SQL SQL
sql sql
SQL SQL
sql sql
SQL SQL
sql sql
SQL SQL
sql sql
SQL
sql
SQL
sql
SQL
sql
SQL
sql
SQL
sql
SQL
sql
lb

Stateless approach
1+ million users / day
10+ billion requests / month
~10 DB writes / request
> 100,000 DB writes / second

http://www.ﬂickr.com/photos/biblicone/3425903181/sizes/l/in/photostream/

Added Redis
(to MySQL)
Migrating users
(on demand)
Monster World
Tests worked ﬁne
(using their code)
Live it worked badly
(50K users corrupted)
Fixed it quickly
(and repaired the users)

SQL SQL
sql sql
SQL SQL
sql sql
SQL SQL
sql
Rd Rd
rd rd
Rd Rd
rd rd
Rd Rd
rd rd
Rd Rd
rd rd
app appapp app app app app app app app app appapp app app
SQL
EBS EBS EBS EBS
lb lblblb

EBSSQLBrowser
lb
lb
lb
lb
app
app
app
app
app
app
app app

SQL SQL
sql sql
SQL SQL
sql sql
SQL SQL
sql
Rd Rd
rd rd
Rd Rd
rd rd
Rd Rd
rd rd
Rd Rd
rd rd
SQL
EBS EBS EBS EBS
lb lblblb
38 single points of failure

ﬂickr.com/photos/qubodup/9244593352

Boyd Cycle
Col. John Boyd, USA
Korea war: F-86 won 10:1 ﬁght against MiG-15
Time competitive cycles of action
Eﬀects of faster decisions are cumulative!

Orient
Observe
Decide
Act
O
O
D
A

OODA
Independent teams
(autonomous decisions)
Experiments
(ab tests)
Agile approach
(Scrum, Kanban etc.)
Quick iterations
(4h, 1d, 7d, 14d)
OODA loop

Tech Evolution
Spreading and mutating ideas

Server Database
One Game Session

Stateful approach
1+ million users / day
4 sessions / user / day
1 DB write / session
~50 DB writes / second

Server
sessionsessionsessionsession
Server
Server
S3

http://www.ﬂickr.com/photos/aigle_dore/

ﬂickr.com/groups/bestfavoriterelayrace/
Rotating jobs

Exchanging knowledge
ﬂickr.com/photos/wili/233621595

Being transparent
ﬂickr.com/photos/marcomagrini/698692268

Company Evolution
Emergent behaviour

2009
Ruby
LAMP
stateless
BB BI
MW

Redis HH
LAMP
stateless
BB BI
Ruby MW
MW
2
Ruby MW
MW
2
2010

LAMP
stateless
BB BI
Redis HH
Ruby MW
MW
2
2010

Erlang
stateful
ML
2011
Redis
Ruby
LAMP
stateless
BB BI
MW
HH
MW
2
Erlang
stateful
ML

oﬄine
DD
Erlang
stateful
ML
2011
Redis
Ruby
Riak
Javascript
ev. Ruby
1 doc
LAMP
stateless
BB BI
MW
HH
MW
2
PI
PP
MWM

2012
Erlang
Redis
Ruby
stateful
Riak
Javascript
oﬄine
ev. Ruby
1 doc
JRuby
shared
LAMP
multiplay
stateless
BB BI
MW
HH
MW
2
ML
DD
PI
PP
MWM PV
GX
FT
KB
BI 2

2013
Erlang
Redis
Ruby
stateful
Riak
Javascript
realtime
oﬄine
ev. Ruby
1 doc
JRuby Scala
shared
LAMP
generic
multiplay
stateless
services
BB BI
MW
HH
MW
2
ML
DD
PI
PP
MWM PV
SBS
DYN
GX
FT
KB
BI 2
DIV
MA

2014
Erlang
Redis
Ruby
stateful
Riak
Javascript
realtime
oﬄine
ev. Ruby
1 doc
JRuby Scala
shared
LAMP
generic
multiplay
stateless
services
BB BI
MW
HH
MW
2
ML
DD
PI
PP
MWM PV
SBS
DYN
GX
FT
KB
BI 2
DIV
MA …

Erlang
Redis
Ruby
stateful
Riak
Javascript
realtime
oﬄine
ev. Ruby
1 doc
JRuby Scala
shared
Go
Elixir
hybrid
LAMP
generic
multiplay
stateless
services
BB BI
MW
HH
MW
2
ML
DD
PI
PP
MWM PV
SBS
DYN
GX
FT
KB
BI 2
DIV
MA …
…
…
…
2015

Erlang
Redis
Ruby
stateful
Riak
Javascript
realtime
oﬄine
ev. Ruby
1 doc
JRuby Scala
shared
Go
Elixir
hybrid
LAMP
generic
multiplay
stateless
services2015
MySQLPHP

PHP MySQL
Erlang
RedisRuby stateful
Riak
Javascript
realtime
oﬄine
ev. Ruby
1 doc
JRuby
Scala
shared
Go
Elixir
hybrid
generic
multiplay
stateless
services
Languages DBs State mngt. Misc.

PHP MySQL
Erlang
RedisRuby stateful
Riak
Javascript
realtime
oﬄine
ev. Ruby
1 doc
JRuby
Scala
shared
Go
Elixir
hybrid
generic
multiplay
stateless
services
Languages DBs State mngt. Misc.
Wooga’s
toolbox

PI
MWM PV
Switch to
Mobile HTML5
BB BI
MW
HH
MW
2
ML

DD
PI
PP
MWM PV
JS
GX
BI 2
DIV
HTML5
Obj. C
Apportable
ext. Android
BB BI
MW
HH
MW
2
ML
Switch to
Mobile

DD
PI
PP
MWM PV
JS
GX
BI 2
DIV
HTML5
Obj. C
Apportable
ext. Android
SD /
DYN
… …
…
…
…
AAUnity
BB BI
MW
HH
MW
2
ML
Switch to
Mobile

Wooga beneﬁts
The ability to quickly adapt to change
Survive disruptions and beneﬁt from them
Resiliency and robustness
Long-term perspective vs. short-term goals
To attract strong people
We give transparency and trust, we want impact

Continuous Evolution
The right approach for everyone?

Reinventing the wheel?
Knowledge sharing is the key
Transparency is mandatory
Reusing
code / SDKs
services
best practices

Erlang
Redis
Ruby
stateful
Riak
Javascript
realtime
oﬄine
ev. Ruby
1 doc
JRuby Scala
shared
Go
Elixir
hybrid
LAMP
generic
multiplay
stateless
services
BB BI
MW
HH
MW
2
ML
DD
PI
PP
MWM PV
SBS
DYN
GX
FT
KB
BI 2
DIV
MA …
…
…
…
SBS

Flexibility
Innovation
Individual Impact
Eﬃciency
Planning
Scale beneﬁts
Wooga
Autonomy Centralisation

Autonomy Centralisation
Flexibility
Innovation
Individual Impact
Eﬃciency
Planning
Scale beneﬁts
Wooga
What’s right for your company?

Questions?
Jesper Richter-Reichhelm (@jrirei)

Jesper Richter-Reichhelm - Continuous Evolution at Wooga - code.talks 2015

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Andere mochten auch

Andere mochten auch (11)

Ähnlich wie Jesper Richter-Reichhelm - Continuous Evolution at Wooga - code.talks 2015

Ähnlich wie Jesper Richter-Reichhelm - Continuous Evolution at Wooga - code.talks 2015 (20)

Mehr von AboutYouGmbH

Mehr von AboutYouGmbH (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

Jesper Richter-Reichhelm - Continuous Evolution at Wooga - code.talks 2015