With the right tools, building scalable applications can be much easier than it seems. I want to show you the variety of options you get when you design applications around distributed data grids. They can become a backbone for building horizontally scalable applications, while at the same time providing flexible caching to scale up the performance vertically. Suddenly it will be possible to tweak the applications beyond what you would expect, with very little effort, often without even rebuilding the applications. We’ll analyze what’s possible and how to do it, not only in theory but also demonstrating on an application based on Java EE, Hazelcast, and Node.js. In the end, you’ll understand the power of distributed data grids and how to use them efficiently to scale the applications in various scenarios, be it high-throughput, low-latency, microservice architecture and more.

1. EASILY SCALE ENTERPRISE
APPLICATIONS USING
DISTRIBUTED DATA GRIDS
Ondrej Mihályi
@omihalyi

2. SCALABLE APPLICATIONS
What it means? Another buzzword?
@OMihalyi

3. HIGHLY SCALABLE APPLICATIONS !?
Just great. Buzzword Bingo time!
@OMihalyi

4. SERIOUSLY, WHAT ARE WE AFTER?
The main Goal:
add more resources to do the job
faster.
@OMihalyi

5. WHAT IS SCALABILITY
Ability to improve with more resources
Not straightforward
More working hours ≠ more done
More people on the job ≠ faster
@OMihalyi

6. TYPES OF SCALING
VERTICAL
easy, brute force, often works inefficient,
limited by physics
HORIZONTAL
enables granular scaling
more complexity
@OMihalyi

7. CHALLENGES OF HORIZONTAL
SCALING
distributed programming
increased communication
shared state
@OMihalyi

8. AVOIDING BOTTLENECKS
:
Speedup limited by the parts that
don't benefit from added resources
bottlenecks: sequential tasks,
synchronization, communication
AMDAHL'S LAW
@OMihalyi

9. IN-MEMORY DATAGRIDS
distributed shared state (memory)
distrib. communication (locks, messaging, ...)
simple distrib. structures (map, set, queue, ...)
sophisticated algorithms behind the scenes
data replication and even distribution
auto-discovery of nodes
@OMihalyi

10. EXAMPLES OF DATA-GRIDS
Hazelcast
JBoss Infinispan
Oracle Coherence
Terracotta
@OMihalyi

11. PAYARA SERVER
derived from GlassFish Java EE Server
embedded Hazelcast
HTTP session replication
JCache CDI integration
message bus over CDI events
@OMihalyi

12. PAYARA MICRO
shares codebase with Payara Server
can cluster with Payara Server
executable JAR or embedded
web apps in a separate file or uber JAR
Hazelcast started by default
@OMihalyi

13. SCALE UP!
Once an app is designed for flexible
clustering, it becomes elastic - easily
adaptable to increasing load.
@OMihalyi

14. DEMO TIME

15. #1 MULTIPLICATION
Additional instances
more CPUs and other resources
Simple load balancer is enough
data is shared automatically
@OMihalyi

16. #2 SCALING MEMORY
Data access is often a bottleneck
→ Keep data in memory
Additional instances with no apps
Dumb nodes carrying data
Increase available memory
Increase resilience to outages
@OMihalyi

17. #2 SCALING MEMORY
@OMihalyi

18. #3 SEPARATING DATA FROM LOGIC
more data → more heap and time in GC
run critical apps on lite nodes
slower data access but less GC cycles
tweak GC & heap for throughput
data and app nodes in pair on the same
machine
@OMihalyi

19. #3 SEPARATING DATA FROM LOGIC
@OMihalyi

20. DEMO TIME

21. #4 SCALE APP PARTS SEPARATELY
some parts of an app are bottlenecks
split those into separate services
can be scaled higher
resources assigned more granularly
small and lean services with Payara Micro
or even a standalone Hazelcast
@OMihalyi

22. #4 SCALE APP PARTS SEPARATELY
@OMihalyi

23. HAZELCAST MEMORY UTILIZATION
Replicated up to X nodes
Data evenly distributed
Lite nodes without data
Off-heap data (enterprise)
@OMihalyi

24. OTHER HAZELCAST FEATURES
Auto discovery and recovery
multicast and TCP joiners
data redistribution when nodes join/leave
Distributed cache (JCache API)
Distributed queries and ExecutorService
@OMihalyi

25. ANYTHING TO ASK?
Thank you

26. RESOURCES
source code:
Hazelcast: ,
Payara: ,
OndrejM-demonstrations/scaling-
with-datagrids
article about flexible clustering
hazelcast.com hazelcast.org
payara.fish payara.org
@OMihalyi