The document provides a summary of updates to Aerospike Enterprise Edition from May 2019 to December 2019, as well as planned updates through 2020. Key updates include adding compression, supporting nested data types and bitwise operations, improving scan and query performance, and adding capabilities like pagination. Planned updates focus on enhancing cross data center replication, secondary indexes, and the client-server protocol.

1. Product Update
December 2019
Andy Gooding
VP of Engineering, Aerospike

2. 2 A E R O S P I K E P r o d u c t U p d a t e | Proprietary & Confidential | |All rights reserved. © 2019 Aerospike Inc.
▪ Enterprise Edition 4.5.3 (May 14 2019)
▪ Compression for Replica Writes and Migrations
▪ Flat format storage used as the wire format
▪ Ship compressed records as-is for replica writes and migrations
▪ Compression now also applies to inter-node communication (fabric)
▪ Enterprise Edition 4.6.0 (August 9 2019)
▪ Nested CDT operations, Bitwise Blob operations
▪ CDT comparison operations speed boost
▪ Enterprise Edition 4.7.0 (September 30 2019)
▪ ADQ support. Demonstrated 15M TPS on one node
▪ Ripped out Transaction Queues
▪ Scans in parallel with RPS throttling
▪ Enterprise Edition 4.8.0 (December 12 2019)
▪ Data in Persistent Memory (PMEM)
▪ Compression for Client-Server communication
▪ Separate write buffers for masters, replica and migrations
Aerospike Enterprise Edition – Performance Improvements
“Infrastructure for Speed at Scale”

3. 3 A E R O S P I K E P r o d u c t U p d a t e | Proprietary & Confidential | |All rights reserved. © 2019 Aerospike Inc.
▪ XDR Milestone 1 – (2020 Q1)
▪ Integrate into core database and eliminate separate digest log
▪ Enable independent shipping from single source to target data centers
▪ Dynamic configuration of shipping information
▪ Improved correctness in failure situations
▪ Support for shipping from past timestamp for reliable data sync across clusters
▪ Ship non-durable deletes
▪ Replace HTTP connector into a native one for performance boost
▪ Scans – (2020 Q1)
▪ Scan correctness in the presence of node failures
▪ Concurrent and parallel scan execution
▪ Ability to restart scan from previous location (‘cursors’)
Aerospike Enterprise Edition – Core (Upcoming in Q4 '19, Q1 '20)
“Infrastructure for Speed at Scale”

4. 4 A E R O S P I K E P r o d u c t U p d a t e | Proprietary & Confidential | |All rights reserved. © 2019 Aerospike Inc.
▪ XDR Milestone 2 – (2020 Q2)
▪ Record/Bin level filters
▪ Secondary Index Milestone 1 – (2020 Q2)
▪ 3x reduction in index size
▪ 4x improvement in performance
▪ Improved garbage collection of index entries
▪ XDR Milestone 3 – (2020 Q3)
▪ Support for strong consistency in active/passive setup
▪ Optimizations to improve shipping performance (delta LUT-based shipping)
▪ Support seamless data movement across clusters
▪ Secondary Index Milestone 2 – (2020 Q3)
▪ Ability to query accurately in the presence of cluster changes
▪ Support for restarting queries from a specific point (‘cursors’)
Aerospike Enterprise Edition – Core (Upcoming in Q2 '20, Q3 '20)
“Infrastructure for Speed at Scale”

5. 5 A E R O S P I K E P r o d u c t U p d a t e | Proprietary & Confidential | |All rights reserved. © 2019 Aerospike Inc.
▪ Secondary Index Milestone 3 – (2020 Q4)
▪ SLAB style allocation
▪ Warm start for secondary indexes
▪ Store secondary indexes in Flash
▪ Store secondary indexes in Persistent Memory (PMEM)
▪ Client protocol Milestone 2 – (2020 Q4)
▪ Pipelining
▪ Security: Key Management – (Unscheduled, 2020)
▪ KMS integration – KMIP 3 and Vault
▪ Improved support for Extended Strong Consistency clusters in WAN environments – (Unscheduled, 2020)
▪ Performance improvements – (Unscheduled, 2020)
▪ async IO – non-blocking device reads
▪ Redoing fabric to run on service threads
▪ Support for changing replication factor dynamically
Aerospike Enterprise Edition – Core (Upcoming in Q4 '20, More)
“Infrastructure for Speed at Scale”

6. 6 A E R O S P I K E P r o d u c t U p d a t e | Proprietary & Confidential | |All rights reserved. © 2019 Aerospike Inc.
▪ Multi level complex data types (CDT) – Enterprise Edition 4.6.0 (August 9 2019)
▪ Extends the ability to apply map and list operations to elements nested at an arbitrarily depth
▪ Improved efficiency of all list and map operations
▪ Bitwise operations – Enterprise Edition 4.6.0 (August 9 2019)
▪ Atomic bitwise operations on the BLOB data type
▪ Modeling with BLOBs should be highly compressible
▪ Conditional key-value, batch and UDF operations – Enterprise Edition 4.7.0 (September 30 2019)
▪ Conditionally execute a put() or multi-operation transaction only if a predicate filter is satisfied
▪ Only read a single record if a predicate filter is satisfied (e.g., last updated under N seconds ago)
▪ Filter records of a batch-read using a specified predicate filter (aligns batch-reads with scan and query)
▪ Delete Record operation – Enterprise Edition 4.7.0 (September 30 2019)
▪ Let's a developer combine a read and delete in a single record transaction (multi-op)
▪ Background scans applying multi-operation transactions – Enterprise Edition 4.7.0 (September 30 2019)
▪ High performance alternative for background scan UDFs. The operate() is applied to each record scanned.
▪ Record per-second control for scans
Aerospike Enterprise Edition – Developer API Improvements
“Increase applicability to the widest possible set of use cases”

7. 7 A E R O S P I K E P r o d u c t U p d a t e | Proprietary & Confidential | |All rights reserved. © 2019 Aerospike Inc.
▪ Paginated scans – (2020 Q1)
▪ Ability to restart a scan from a previous location (‘cursors’); Enables paginated scans
▪ Fast and efficient queries – (2020 Q2)
▪ Ability to use secondary indexes more intensively due to a reduction in memory use and speed improvements
▪ Paginated queries – (2020 Q3)
▪ Ability to restart a query from a previous location (‘cursors’);
▪ XDR Conflict Resolution – (2020 Q3)
▪ Better conflict resolution using bin-level metadata
▪ Last Write Wins and potentially user-defined resolution
▪ New Client-Server protocol: Pipelining – (2020 Q4)
▪ Probabilistic Data Types – (Unscheduled, 2020)
▪ HyperLogLog and friends
Aerospike Enterprise Edition – Developer API (Upcoming)
“Increase applicability to the widest possible set of use cases”

8. 8 A E R O S P I K E P r o d u c t U p d a t e | Proprietary & Confidential | |All rights reserved. © 2019 Aerospike Inc.
▪ Native aggregate functions
▪ Ditching stream UDFs for native COUNT, SUM, MIN, MAX, AVG, etc
▪ Predicate Filters modernization
▪ Adding nested list and map operations, bitwise operations to predicate filters
▪ Indexing capability for deeply nested elements
▪ Record UDF Overhaul
▪ Exposing list, map, bitwise, integer, string operations as an API you can call from the UDF
▪ Possibly replacing Lua as a UDF language
▪ SQL support
▪ Potentially via Presto
▪ Timeseries database
Aerospike Enterprise Edition – Developer API (Upcoming)
What would you like to see in Aerospike?