Date: 13th November 2018
Location: Fast Data Theatre
Time: 14:30 - 15:00
Speaker: Robert Abraham
Organisation: Adjust
About: Adjust's business is verifying billions of advertising impressions, policing any fraudulent activity at scale. They maintain all of the data on their clients’ target user devices and their actions - unlike their competitors which discard data after 90 days.
Setting up a global, clustering system with transcontinental fibre to manage 100TB of data was not trivial.
Data correctness and low latency were important criteria.
In this session, learn:
• Why they decided to move from NoSQL incumbent Redis to Aerospike
• Why bare metal works so much better than the cloud
• How they’ve scaled while still policing fraud at speed
• Their architectural view to manage the data volume, upgrades, backups and interruptions
Vip Mumbai Call Girls Thane West Call On 9920725232 With Body to body massage...
Big Data LDN 2018: SCALING A PLATFORM FOR REAL-TIME FRAUD DETECTION WITHOUT BREAKING THE BANK
1. BERLIN • NEW YORK • SAN FRANCISCO • SÃO PAULO • PARIS • LONDON • MOSCOW • ISTANBUL
SEOUL • SHANGHAI • BEIJING • TOKYO • MUMBAI • SINGAPORE
Scaling a platform for
real-time fraud detection
3. 3
‣ Focus on idea
‣ Focus on execution is limited in time to market
‣ Underestimating importance of scalability and profitability
Startup Zeitgeist
4. 4
‣ Director of Engineering
‣ Consulted with early design decisions
‣ Joined Adjust 2012 as Head of IT Operations
Who am I?
5. Who is Adjust?
1B+
Daily active users tracked
400+ Billion
Data points tracked monthly
22K+
Apps tracked
6. 6
‣ Automatically reject fraudulent data before it gets paid
‣ Sends rejection reason callbacks to all parties
‣ Customers and their networks have full transparency
‣ Real-time statistical analysis of all ad engagements and app activity
Fraud Prevention Suite
9. 9
Bootstrapping a product
Current approach Our approach
‣ Using cloud services
‣ Base product on 3rd party IP
‣ Faster development
‣ Own infrastructure
‣ Develop own IP
‣ Slower ramp up
10. 10
Bootstrapping a product
Current approach Our approach
‣ Using cloud services
‣ Base product on 3rd party IP
‣ Faster development
‣ Potential lock in
‣ More cost efficient in the beginning
‣ Shared environment
‣ Own infrastructure
‣ Develop own IP
‣ Slower ramp up
11. 11
Bootstrapping a product
Current approach Our approach
‣ Using cloud services
‣ Base product on 3rd party IP
‣ Faster development
‣ Potential lock in
‣ More cost efficient in the beginning
‣ Shared environment
‣ Own infrastructure
‣ Develop own IP
‣ Slower ramp up
‣ Keep flexibility
‣ More cost efficient in the long run
‣ Dedicated environment
23. 23
‣ Automation is tricky
‣ Weird latency spikes
Smoke in the machine room
24. 24
‣ Automation is tricky
‣ Weird latency spikes
‣ Increased average response time
Smoke in the machine room
25. 25
‣ Automation is tricky
‣ Weird latency spikes
‣ Increased average response time
‣ Long failover times
‣ Disruptive failovers
Smoke in the machine room
32. 32
‣ Easy to scale
‣ Redis interface
‣ Online resizing
‣ All dirty work is done by Amazon
Elasticache
33. 33
Q: Can I use Amazon ElastiCache for use cases other
than caching?
A: Yes. ElastiCache for Redis can be used as a primary
in-memory key-value data store, providing fast, sub
millisecond data performance, high availability and
scalability up to 15 nodes plus up to 5 read replicas,
each of up to 9.5 TiB of in-memory data.
34. 34
“Once we are successful, we will
take care of scalability and
profitability”
37. New York
Paris
São Paulo
San Francisco
London Berlin
Istanbul
Moscow
Mumbai
Beijing
Seoul
Tokyo
Shanghai
Singapore
Robert Abraham
DIRECTOR OF ENGINEERING
robert@adjust.com
ADJUST HQ
Saarbrücker Str. 37a
10405 Berlin
Germany