NoSQL Endgame Percona Live Online 2020
•Als PPTX, PDF herunterladen•
0 gefällt mir•230 views
Slide deck for our talk with Werner Keil at Percona Live Online 2020 conference. Online, October 2020
Empfohlen
Weitere ähnliche Inhalte
Was ist angesagt?
Was ist angesagt? (20)
Ähnlich wie NoSQL Endgame Percona Live Online 2020
Ähnlich wie NoSQL Endgame Percona Live Online 2020 (20)
Mehr von Thodoris Bais
Mehr von Thodoris Bais (20)
Kürzlich hochgeladen
Kürzlich hochgeladen (20)
NoSQL Endgame Percona Live Online 2020
- 1. NoSQL Endgame Werner Keil / Thodoris Bais CATMedia / ABN Amro & Utrecht JUG @thodorisbais@wernerkeil
- 2. Werner Keil Thodoris Bais Jakarta EE Specification Committee Member Expert Group Member JSR-385 Let’s meet @thodorisbais@wernerkeil
- 3. @thodorisbais@wernerkeil ABN Amro Bank Financial sector Amsterdam Agile organization 20,000 3000+ 400+ Total number of employeesEnterprise bank Headquarters Development Teams DevOps / Hybrid cloud Applications
- 4. 4 5 trends in 2020
- 5. New digital trends create new technical challenges
- 6. • Develop with agility • Operate at any scale • Deliver the performance and availability required to meet the demands of Digital Economy businesses 6 What are the technical challenges?
- 7. 7 • Handle large volumes of data at high-speed with a scale-out architecture • Store unstructured, semi-structured, or structured data • Enable easy updates to schemas and fields • Developer-friendly • Take full advantage of the cloud to deliver zero downtime Advantages of NoSQL
- 8. Why this talk Tons of persistence frameworks Which one performs best for your case? JVM can cope with heavy loads Would normally take ages to compare
- 9. NoSQL 01 Database 02 Doesn't use structure 03 Not Transaction 04 Base Four different types05
- 10. Key-Value stores AmazonDynamo AmazonS3 Redis Hazelcast Apollo Ares Aphrodite Sun War Love Beauty
- 11. Column-Oriented Apollo Aphrodite Ares Kratos Duty Duty Duty Dead Gods Love, happy Sun War 13 Color weapon Sword Row-key ColumnsHBase Scylla SimpleDb Cassandra DynamoDB Clouddata
- 13. Graph databases Apollo Ares Kratos was killed by was killed by killed killed Neo4j InfoGrid Sones HyperGraphDB
- 14. Multi-Model 01 02 03 04 OrientDB (graph, document) Couchbase (key value, document) Elasticsearch (document, graph) ArangoDB (document, graph, key-value)
- 15. SQL vs NoSQL SQL KEY-VALUE COLUMN DOCUMENTS GRAPH Table Bucket Column family Collection Row Key/value pair Column Documents Vertex Column Key/value pair Key/value pair Vertex and Edge property Relationship Link Edge
- 16. BASE vs ACID • Basically Available • Soft state • Eventual consistency • Atomicity • Consistency • Isolation • Durability
- 17. CAP
- 19. Relational Application NoSQL Application Logic Tier Logic Tier DAO DAO JPAJPAJPAJPA JDBC JDBCJDBCJDBC Data Tier APIAPI API Data Tier
- 21. JPA problem for NoSQL 01 02 03 04 05 06 Saves Async Async Callback Time to Live (TTL) Consistency Level SQL based Diversity in NoSQL
- 22. Annotated Entities 01 02 03 Mapped Superclass Entity Column @Entity("god") public class God { @Column private String name; @Column private long age; @Column private Set<String> powers; }
- 23. Template God artemis = ...; DocumentTemplate template = … template.insert(artemis); template.update(artemis); DocumentQuery query = ... List<God> gods = template.select(query);
- 24. Repository interface GodRepository extends MongoRepository<God, String> { List<God> findByNameAndAge (String name, Integer age); }
- 25. Repository @Inject @Database(DatabaseType.COLUMN) private GodRepository godRepository; @Inject @Database(DatabaseType.KEY_VALUE) private GodRepository godRepository;
- 26. Repository with Queries interface PersonRepository extends Repository<Person, Long> { @Query("select * from Person") Optional<Person> findByQuery(); @Query("select * from Person where id = @id") Optional<Person> findByQuery(@Param("id") String id); }
- 27. Diversity @Entity("god") public class God { @Column private String name; @UDT("weapon") @Column private Weapon weapon; } interface GodRepository extends CassandraRepository<God, String> { @CQL("select * from God where name = ?") List<God> findByName(String name); }
- 28. List<Movie> movies = documentTemplate.query("select * from Movie where year > 2012"); List<Person> people = columnTemplate.query("select * from Person where age = 25"); Optional<God> god = keyValueTemplate.query("get 'Ullr'"); List<City> cities = graphTemplate.query("g.V().hasLabel('City')"); Query by Text
- 30. Repository public class AnimalRepository { List<Animal> findByType(String type) {…} public Animal insert(Animal animal) {…} }
- 31. Entity public class City { private String name; public City(String name) { this.name = name; } public void setName(String name) { this.name = name; } public String getName() { return name; } }
- 32. Query by Text public void save(City city) { try (Session s = driver.session()) { String statement = "MERGE (c:City {id:$name.id}) ON CREATE SET c+=$name"; s.writeTransaction(tx -> tx.run(statement, singletonMap("name" ,city.asMap()))); } } public Stream<City> findByName(String name) { try (Session s = driver.session()) { String statement = "MATCH (c:City) WHERE c.name contains $name RETURN c"; return s.readTransaction(tx -> tx.run(statement, singletonMap("name", name))) .list(record -> new City(record.get("c").asMap())).stream(); } }
- 33. @Document(collection = "gods") public class God { … } interface GodRepository extends MongoRepository<God, String> { … } What about the Controller? <dependency> <groupId>org.springframework.boot</groupId> <artifactId>spring-boot-starter-data- mongodb</artifactId> </dependency> spring.data.mongodb.database=mythology spring.data.mongodb.port=27017 Logistics Domain
- 34. Our example
- 36. Repository public interface MovieRepository extends ReactiveNeo4jRepository<MovieEntity, String> { Mono<MovieEntity> findOneByTitle(String title); }
- 37. Entities @Node("Person") public class PersonEntity { @Id private final String name; private final Integer born; } @Node("Movie") public class MovieEntity { @Id private final String title; @Property("tagline") private final String description; @Relationship(type = "ACTED_IN", direction = INCOMING) private Map<PersonEntity, Roles> actorsAndRoles = new HashMap<>(); @Relationship(type = "DIRECTED", direction = INCOMING) private List<PersonEntity> directors = new ArrayList<>(); }
- 38. Relationships @RelationshipProperties public class Roles { private final List<String> roles; public Roles(List<String> roles) { this.roles = roles; } }
- 40. 40 Entity @Entity(”Editor") public class Editor { @Id private String editor; private String editorName; @OneToMany(mappedBy = “editor”, cascade = PERSIST) private Set<Author> assignedAuthors = new HashSet<>(); // constructors, getters, setters… }
- 41. 41 Operations
- 43. Conclusions Still in Progress ❌ Supports a huge number of NoSQL database systems ✅ Loosely coupled code makes switching between different NoSQL vendors just a matter of configuration ✅ Removes boiler-plate code and provides a cleaner, more readable DAO ✅
- 44. Conclusions Switching between different NoSQL vendors not so easy ❌ Micronaut Data does not support NoSQL databases yet ❌ Still in Progress ❌ Often faster with a lower footprint, polyglot language support for Java, Kotlin and Groovy ✅
- 45. Conclusions Provides a cleaner and more readable DAO implementation ✅ Loosely coupled code makes switching between different NoSQL vendors just a matter of configuration ✅ Removes a lot of boiler-plate code ✅ Only half a dozen wider used NoSQL databases are supported out of the box, others require more effort or won’t work yet ❌
- 46. Conclusions Using a mapper for all scenarios is not a recommended approach ❌ Some JPA concepts are not easily mapped to the NoSQL world (e.g. transactions) ❌ Error safe way to run the query language and hydrate DTOs from the result the simplest way possible ❌ Outdated documentation ❌
- 47. Project page • http://jnosql.org GitHub repositories • https://github.com/JNOSQL/nosql-endgame @thodorisbais@wernerkeil Links
- 48. 48 • Flaticon.com • Michael Simons Credits