Weitere ähnliche Inhalte
Ähnlich wie What's New In Neo4j 3.4 & Bloom Update (20)
Kürzlich hochgeladen (20)
What's New In Neo4j 3.4 & Bloom Update
- 1. 5/23/2018
Copyright © 2018 Neo4j, Inc. 1
What’s New In Neo4j 3.4 &
Bloom Update
Jeff Morris
Philip Rathle
May 23, 2018
1
Neo4j - The Graph Company
720+
7/10
12/25
8/10
53K+
100+
270+
450+
Adoption
Top Retail Firms
Top Financial Firms
Top Software Vendors
Customers Partners
• Creator of the Neo4j Graph Platform
• ~200 employees
• HQ in Silicon Valley, other offices include
London, Munich, Paris and Malmö
(Sweden)
• $80M in funding from Fidelity, Sunstone,
Conor, Creandum, and Greenbridge
Capital
• Over 10M+ downloads
• 270+ enterprise subscription customers
with over half with >$1B in revenue
Ecosystem
Startups in program
Enterprise customers
Partners
Meet up members
Events per year
Industry’s Largest Dedicated Investment in Graphs
- 2. 5/23/2018
Copyright © 2018 Neo4j, Inc. 2
Neo4j is an enterprise-grade native graph platform that enables you to:
• Store, reveal and query data relationships
• Traverse and analyze any levels of depth in real-time
• Add context and connect new data on the fly
3
Who We Are: The Graph Platform
• Performance
• ACID Transactions
• Schema-free Agility
• Graph Algorithms
Designed, built and tested natively
for graphs from the start for:
• Developer Productivity
• Hardware Efficiency
• Global Scale
• Graph Adoption
Graph
Transactions
Graph
Analytics
Data Integration
Development
& Admin
Analytics
Tooling
Drivers & APIs Discovery & Visualization
2010 2011 2012 2013 2015 2017
Frustrated with
Gremlin, Neo
invented Cypher -
Leading language
for graph queries
First open
source GA
version of a
property graph
database
O’Reilly Graph
Database —
first definitive
book for graph
professionals
Introduced
labels to
simplify graph
modeling
openCypher.org
open sourced
Cypher query
language as de
facto standard
Industry’s
1st Graph
Platform
Graph Algorithms
for data scientists
Developer’s Neo4j
Desktop
2014
Visual Graph
Query Browser
2016
Causal
Consistency
for Graphs
Neo4j—The Graph Innovator
2018 2019
Morpheus
Graph is a
unique
paradigm
Neo4j Cloud
Neo4j Cloud EAP
Neo4j Bloom visual discovery
Cypher for Apache Spark
Cypher for Gremlin
GQL Manifesto
- 3. 5/23/2018
Copyright © 2018 Neo4j, Inc. 3
Graph
Transactions
Graph
Analytics
Data Integration
Development
& Admin
Analytics
Tooling
Drivers & APIs Discovery & Visualization
Developers
Admins
Applications Business Users
Data Analysts
Data Scientists
Enterprise Data Hub
Native Graph Platform: Tools for Many Users
Neo4j: Enabling the Connected Enterprise
Consumers of Connected Data
6
AI & Graph Analytics
• Sentiment analysis
• Customer
segmentation
• Machine learning
• Cognitive computing
• Community detection
Transactional Graphs
• Fraud detection
• Real-time recommendations
• Network and IT operations
management
• Knowledge Graphs
• Master Data Management
Discovery & Visualization
• Fraud detection
• Network and IT
operations
• Product information
management
• Risk and portfolio analysisData
Scientists
Data
Scientists
Business
Users
Business
Users
ApplicationsApplications
- 4. 5/23/2018
Copyright © 2018 Neo4j, Inc. 4
• Introduced Today: https://gql.today/
• An initiative to immediately
rally support for a unified
Graph Query Language
• Standards meetings are ongoing
• All community members are
encouraged to Vote their support
at https://gql.today/#vote
7
The GQL Manifesto: https://gql.today/
Neo4j Product Update
Latest Innovations
- 5. 5/23/2018
Copyright © 2018 Neo4j, Inc. 5
3.3
Review of
Latest GA
Release
(Oct ‘17)
`
RRRR
RRRR RRRR
RRRRRRRRRRRR
READ REPLICAS
London
`
C C
RR RR RR
RRRRRR
READ REPLICAS
New York
Multi-Data Center Clustering with Secure Transit
- 6. 5/23/2018
Copyright © 2018 Neo4j, Inc. 6
Neo4j Desktop 1.0
• Mission control for developers
• Connect to both local and remote
Neo4j servers
• Free with registration
• Includes development license for Neo4j Enterprise Edition
• Keeps you up to date with latest versions, plugins, etc.
• https://neo4j.com/download
Finds the optimal path
or evaluates route
availability and quality
• Single Source Short Path
• All-Nodes SSP
• Parallel paths
Evaluates how a
group is clustered
or partitioned
• Label Propagation
• Union Find
• Strongly Connected
Components
• Louvain
• Triangle-Count
Determines the
importance of distinct
nodes in the network
• PageRank
• Betweeness
• Closeness
• Degree
Data Science Algorithms
- 7. 5/23/2018
Copyright © 2018 Neo4j, Inc. 7
Development &
Administration
Analytics
Tooling
Graph
Analytics
Graph
Transactions
Data Integration
Discovery & VisualizationDrivers & APIs
AI
Neo4j Database 3.3
• 50% faster writes
• Real-time transactions
and traversal applications
Review: The Neo4j Graph Platform, Fall 2017
Neo4j Desktop, the developers’
mission control console
• Free, registered local license
of Enterprise Edition
• APOC library installer
• Algorithm library installer
Data Integration
• Neo4j ETL reveals RDBMS
hidden relationships upon
importing to graph
• Data Importer for fast data
ingestion
Graph Analytics
• Graph Algorithms support
Community Detection,
Centrality and Path Finding
• Cypher for Apache Spark
from openCypher.org
supports graph composition
(sub-graphs) and algorithm
chaining
Discovery & Visualization
• Integration with popular
visualization vendors
• Neo4j Browser and custom
visualizations allow graph
exploration
Bolt with GraphQL and more
• Secure, Causal Clustering
• High-speed analytic processing
• On-prem, Docker & cloud delivery
What’s Next?
3.4
- 9. 5/23/2018
Copyright © 2018 Neo4j, Inc. 9
x
y
z
“Recommend a shirt available in a store
close by in the men’s department”
Location Building
Floor
Rack
- 10. 5/23/2018
Copyright © 2018 Neo4j, Inc. 10
Scalability
Multi-Clustering Support for Global Internet Apps
Horizontally partition graph by domain (country, product, customer, data center)
20
Multi-tenancy
Geo Partitioning
Write Scaling
sa cluster
uk cluster
us_east cluster
hk cluster
- 11. 5/23/2018
Copyright © 2018 Neo4j, Inc. 11
Performance
Neo4j 3.3 Neo4j 3.4 RC1
70% Faster
250
500
0
750
1000
Neo4j 3.2
Reads – Neo4j Enterprise Cypher Runtime
10% Faster
Mixed Workload Read Benchmark
- 12. 5/23/2018
Copyright © 2018 Neo4j, Inc. 12
Supercharging Graph Writes
One Component:
80% of transactional write overhead (!!!)
?QM ,.
Index Insertion
ACID
Optimized for
graph
Fast Reads
~10x Faster Writes
Neo4j GB+ Tree
Index
Label Groupings (Neo4j 3.2)
Numerics (Neo4j 3.3)
Strings (Neo4j 3.4)
QM ,.
External Index
Provider
Native Neo4j Index
Supercharging Graph Writes
- 13. 5/23/2018
Copyright © 2018 Neo4j, Inc. 13
Writes with Native String Indexes
500%
improvement
Neo4j 3.4 RC1 Performance
Performance Tuning Summary 3.3 & 3.4
26
- 14. 5/23/2018
Copyright © 2018 Neo4j, Inc. 14
Ops & Admin
LDAP & Active
Directory
User &
Roles
Procedure
Access Controls
Security: Property Blacklisting added
Kerberos SSO
Certs
Intra-Cluster
Encryption
Security
Event Logging
TLS Wire
Encryption
SSN: “043-56-8834”
0000“043-56-8834”
Property
Blacklisting
- 15. 5/23/2018
Copyright © 2018 Neo4j, Inc. 15
Rolling Upgrades
29
3.4 3.4 3.44.0 4.0 4.0
Auto Cache Reheating
Upgrade to new versions
with zero downtime
Store upgrades
may require downtime but
can be done subsequently
For Restarts, Restores, and Cluster Expansion
30
3.4 Features By Edition Community Edition Enterprise Edition
Date / Time data types ■ ■
3D Geospatial data types ■ ■
Performance Improvements
Native String Indexes – up to 5x faster writes ■ ■
2x faster backups ■
Improved Cypher runtime Fast Faster
100B+ object bulk importer ■ Resumable
Enterprise Scaling & Administration
Multi-Clustering (partitioning of clusters) ■
Automatic cache warming ■
Rolling upgrades ■
Resumable copy/restore cluster member ■
New diagnostic metrics and support tools ■
Security: Property blacklisting by user/role ■
- 16. 5/23/2018
Copyright © 2018 Neo4j, Inc. 16
Development &
Administration
Analytics
Tooling
Graph
Analytics
Graph
Transactions
Data Integration
Discovery & VisualizationDrivers & APIs
AI
Neo4j Database 3.4
• 70% faster Cypher
• Native String Indexes
(up to 5x faster writes)
• 100B+ bulk importer
The Neo4j Graph Platform, Summer 2018
Improved Admin Experience
• Rolling upgrades
• 2X faster backups
• Cache Warming on startup
• Improved diagnostics
Morpheus for Apache Spark
• Graph analytics in the data lake
• In-memory Spark graphs from
Apache Hadoop, Hive,
Gremlin and Spark
• Save graphs into Neo4j
• High-speed data exchange
between Neo4j & data lake
• Progressive analysis using
named graphs
Graph Data Science
• High speed graph
algorithms
Neo4j Bloom
• New graph illustration and
communication tool for
non-technical users
• Explore and edit graph
• Search-based
• Create storyboards
• Foundation for graph data
discovery
• Integrated with graph platform
Multi-Cluster routing built into Bolt drivers
• Date/Time data type
• 3-D Geospatial search
• Secure, Horizontal Multi-Clustering
• Property Blacklisting Security
Introducing A Brand New
Graph Exploration Product
- 17. 5/23/2018
Copyright © 2018 Neo4j, Inc. 17
Neo4j Bloom
Neo4j Bloom
34
• High fidelity
• Scene navigation
• Property views
• Search suggestions
• Saved phrase history
• Property editor
• Schema perspectives
• Bloom chart type
• Visualize
• Communicate
• Discover
• Navigate
• Isolate
• Edit
• Share
- 18. 5/23/2018
Copyright © 2018 Neo4j, Inc. 18
35
Neo4j Bloom Features
• Prompted Search
• Property Browser &
editor
• Category icons and
color scheme
• Pan, Zoom & Select
Advancing the Platform
36
Native graph architecture extends
scale, use cases and performance
• Neo4j Database 3.4
Shipping May, 2018
New products for new users
• Neo4j Bloom visualization &
storyboard tool for business
Shipping in June, 2018