Slides from Big Data Meetup. Talk introduces quite new accelerator tool called Upsolver which revolutionally speeds up development of data platforms and makes cost of change quite low. The talk demonstrates key features, live demo, describes use cases where Upsolver is most applicable.

1. UPSOLVER
WITNESSING A REVOLUTION
BORIS TROFIMOV

2. ABOUT ME
⎼⎼
■ Driving big data competence @ Sigma Software
■ 15+ years in software engineering
■ Designed and developed data platform for AOL
■ Expertise in high-load big data
■ Associate Professor at ONPU

3. REALITY FROM ENGINEER’S PERSPECTIVE
⎼⎼
И ДАЙТЕ НАМ ЕЩЕ ГОД
SPARK
AWS SCALA

4. REALITY FROM CUSTOMER’S PERSPECTIVE
⎼⎼
ВЖУХ
И ВСЕ ГОТОВО

7. COMMON VIEW
⎼⎼

8. COMMON VIEW
⎼⎼

10. DATA PLATFORM IN DEPTH
⎼⎼

11. DATA PLATFORM IN DEPTH
⎼⎼

12. DATA PLATFORM IN DEPTH
⎼⎼

13. DATA PLATFORM IN DEPTH
⎼⎼

14. DATA PLATFORM IN DEPTH
⎼⎼

15. DATA PLATFORM IN DEPTH
⎼⎼

16. AND WHAT ABOUT THIS ?
⎼⎼
■ Data profile and exploration
■ Schema evolution
■ Privacy management and PII anonymization
■ Low Cost of Change
■ Auto Reprocessing
■ Multiple sinks

17. QUICK
CHEAP
MATURE

18. UPSOLVER IS COMING UP

19. UPSOLVER IS COMING UP
⎼⎼

20. WHAT IS UPSOLVER?
⎼⎼
■ ETL + Data Lake
■ Fully managed platform
■ SQL driven transformations
■ Enterprise - enabled
■ Scalable
■ Cloud-driven

21. CONCEPTS
⎼⎼
■ Data source
■ Output
■ Lookup tables
■ Internal Data Lake to persist derivatives
■ Data partitioned by processing time

22. CONCEPTS - DATA STREAM
⎼⎼

23. CONCEPTS - STREAM REUSE
⎼⎼

24. CONCEPTS - STREAM JOINS
⎼⎼

25. CONCEPTS - DATA MESH
⎼⎼

28. MORE FEATURES
⎼⎼
■ Upserts
■ Internal data lake explorer
■ In-memory lookup tables
■ Easier to switch from batch to realtime
■ Data reprocessing
■ Easier to manage late arrivals
■ Anonymization features
■ Python UDF

29. COMPETITORS
⎼⎼

30. WHEN IT IS RELEVANT
⎼⎼
■ Short TTM and low CoC
■ SQL-like transformations
■ UI-first is OK
■ Single consistent product
■ Regular structured data formats
■ Sufficient budget for OPEX
■ Cloud-agnostic

31. INFORMATION
⎼⎼
■ Official web site and Trial account https://app.upsolver.com/login
■ Quick start within 10 min https://docs.upsolver.com/upsolver-1/getting-started/start-using-upsolver/upsolver-in-10-
minutes/upsolver-quickstart-in-10-minutes#create-a-data-source
■ Upsolver Dev Day Streaming Module https://www.upsolver.com/docs
■ More tech details on Medium https://medium.com/@orirafael/what-is-an-open-data-lakehouse-a-world-without-
monoliths-1993b966c2b7

32. THANK YOU