Event-driven Applications with Kafka, Micronaut, and AWS Lambda | Dave Klein, Confluent

•

0 gefällt mir•407 views

HostedbyConfluent

One of the great things about running applications in the cloud is that you only pay for the resources that you use. But that also makes it more important than ever for our applications to be resource-efficient. This becomes even more critical when we use serverless functions. Micronaut is an application framework that provides dependency injection, developer productivity features, and excellent support for Apache Kafka. By performing dependency injection, AOP, and other productivity-enhancing magic at compile time, Micronaut allows us to build smaller, more efficient microservices and serverless functions. In this session, we'll explore the ways that Apache Kafka and Micronaut work together to enable us to build fast, efficient, event-driven applications. Then we'll see it in action, using the AWS Lambda Sink Connector for Confluent Cloud.

@daveklein
Event-driven Applications with Kafka,
Micronaut, and AWS Lambda
#kafkasummit @confluentinc

Apache Kafka
• Event Streaming Platform
• Core of a Growing Eco-system
• Backbone of Event Driven Architectures
• Greatest Invention Since the Wheel
https://developer.confluent.io

MICRONAUT
• Polyglot Application Framework for the JVM
• Productivity features via Ahead of Time (AOT) Compilation
• Small memory footprint and faster startup time
• Familiar programming model
https://micronaut.io/guides

AWS Lambda
• Serverless Compute
• Pay Only For Function Execution
• Continuous Scaling
https://aws.amazon.com/lambda/getting-started

Kafka Connect
• Integrate with dozens of external systems
• Consume and produce data with just configuration
• AWS Lambda Sink Connector

Confluent Cloud
• Fully managed Kafka, cloud-native Kafka service
• Nothing to install, nothing to maintain
• Fastest way to get started with Apache Kafka

Our Project
Order Service
HTTP
Netty + Kafka
OrderIdLambda
Serverless
Function
OrderFulfillment
Service
Kafka
https://github.com/confluentinc/demo-scene/tree/master/micronaut-lambda

https://github.com/confluentinc/demo-scene/tree/master/micronaut-lambda
Thank You
twitter.com/daveklein
linkedin.com/in/daveklein19
dklein@confluent.io
https://developer.confluent.io
https://micronaut.io/guides
https://aws.amazon.com/lambda/getting-started

Weitere ähnliche Inhalte

Was ist angesagt?

Qlik is an industry leader across its solution stack, both on the Data Integration side of things with Qlik Replicate (real-time CDC) and Qlik Compose (data warehouse and data lake automation), and on the Analytics side with Qlik Sense. These two “sides” of Qlik are coming together more frequently these days as the need for “always fresh” data increases across organizations. When real-time streaming applications are the topic du jour, those companies are looking to Apache Kafka to provide the architectural backbone those applications require. Those same companies turn to Qlik Replicate to put the data from their enterprise database systems into motion at scale, whether that data resides in “legacy” mainframe databases; traditional relational databases such as Oracle, MySQL, or SQL Server; or applications such as SAP and SalesForce. In this session we will look in depth at how Qlik Replicate can be used to continuously stream changes from a source database into Apache Kafka. From there, we will explore how a purpose-built consumer can be used to provide the bridge between Apache Kafka and an analytics application such as Qlik Sense.

Keeping Analytics Data Fresh in a Streaming Architecture | John Neal, Qlik

Keeping Analytics Data Fresh in a Streaming Architecture | John Neal, Qlik

Keeping Analytics Data Fresh in a Streaming Architecture | John Neal, Qlik

HostedbyConfluent

Apache Kafka is taking the world by storm and is rapidly becoming the de-facto event bus for event-driven and streaming applications that respond to events and data in real time. OpenShift Streams for Apache Kafka is Red Hat's fully hosted and managed Apache Kafka service targeting development teams that want to incorporate streaming data and scalable messaging in their applications, without the burden of setting up and maintaining a Kafka cluster infrastructure. In this session you will discover how Apache Kafka can be used in an IoT scenario to ingest data from devices and make them available in real-time to other applications. More specifically you will learn how to: Simulate devices that send MQTT messages to a MQTT broker Use Apache Camel and Camel-K to bridge MQTT with Apache Kafka Use Kafka Streams in a Quarkus application to process the device messages Query the state of the devices using GraphQ

Kafka at the Edge: an IoT scenario with OpenShift Streams for Apache Kafka | ...

Kafka at the Edge: an IoT scenario with OpenShift Streams for Apache Kafka | ...

Kafka at the Edge: an IoT scenario with OpenShift Streams for Apache Kafka | ...

Red Hat Developers

A Look into the Mirror: Patterns and Best Practices for MirrorMaker2 | Cliff ...

A Look into the Mirror: Patterns and Best Practices for MirrorMaker2 | Cliff ...

A Look into the Mirror: Patterns and Best Practices for MirrorMaker2 | Cliff ...

HostedbyConfluent

Robinhood uses Kafka in every line of its business, from stock and crypto trading to clearing and data analytics. One interesting aspect of our architecture is that many of our microservices leveraging Kafka are written in Python. When you combine Python's relatively slow performance coupled, its reliance on process-based parallelism and Robinhood’s scale, the result is a massive fleet of application processes producing to and consuming from our Kafka clusters. This fleet generates an atypical workload on Kafka that warrants a deeper investment in scalability and reliability. This talk discusses our investments in Kafka infrastructure for a large-scale Python-based environment: kafkahood: our librdkafka-based client library wrapper that codifies best practices, sane defaults and deep client-side observability. kafkaproxy: a Rust-based sidecar proxy that reduces connection fan-in from Python gunicorn worker pools to our Kafka clusters. We'll also present challenges we encountered along the way and share our learnings with the audience.

Taming a massive fleet of Python-based Kafka apps at Robinhood | Chandra Kuch...

Taming a massive fleet of Python-based Kafka apps at Robinhood | Chandra Kuch...

Taming a massive fleet of Python-based Kafka apps at Robinhood | Chandra Kuch...

HostedbyConfluent

Apache Kafka is the most popular open-source stream-processing software for collecting, processing, storing, and analyzing data at scale. Most known for its excellent performance, low latency, fault tolerance, and high throughput, it's capable of handling thousands of messages per second. For mission-critical applications, how do you ensure that the performance delivered is the performance required? This is especially important as Kafka is written in Java and Scala and runs on the JVM. The JVM is a fantastic platform that delivers on an internet scale. In this session, we'll explore how making changes to the JVM design can eliminate the problems of garbage collection pauses and raise the throughput of applications. For cloud-based Kafka applications, this can deliver both lower latency and reduced infrastructure costs. All without changing a line of code!

Better Kafka Performance Without Changing Any Code | Simon Ritter, Azul

Better Kafka Performance Without Changing Any Code | Simon Ritter, Azul

Better Kafka Performance Without Changing Any Code | Simon Ritter, Azul

HostedbyConfluent

Large networks consist of a diverse range of equipment, across private, public, hybrid clouds and partner networks. A hierarchical network has layers of infrastructure, catering to access, core, or distribution roles, managed by different organizations specialized to architect the right network hardware, software, and features for that network layer. The nature of data generated by each component can vary in type and form, including logs, events, metrics, or alarms. The diversity of data generated by a large network is beyond human scale. Apache Kafka® is a critical hub in large networks, empowering AIOps to enhance decision making, improve analysis and insights by contextualizing large volumes of operational data. Kafka solved the big problem of collecting, processing, storing and normalizing data at scale, allowing us to focus on building the AIOps pipeline. Our platform connects the dots across relevant operations data and provides operations teams with simple and powerful access to insights, from within increasingly popular collaboration environments like Slack and Microsoft teams. The pipeline must also integrate with automation solutions. This session will cover how large volumes of streaming messages can be received by parallel Kafka consumers, and turned into action by network operations teams, dramatically reducing downtime and improving performance.

Kafka at the core of an AIOps pipeline | Sunanda Kommula, Selector.ai and Ala...

Kafka at the core of an AIOps pipeline | Sunanda Kommula, Selector.ai and Ala...

Kafka at the core of an AIOps pipeline | Sunanda Kommula, Selector.ai and Ala...

HostedbyConfluent

Apache Kafka fundamentally changes how organizations build and deploy a universal data pipeline that is scalable, reliable, and durable enough to meet the needs of digital-first organizations. However, as powerful as Kafka is today, it’s not an event-streaming platform - and getting it there on your own is a long, complicated, and expensive process. Earlier this year Confluent announced Project Metamorphosis - our plan to bring the best characteristics of cloud native systems to Apache Kafka. Since May we’ve begun transforming Confluent Cloud and Confluent Platform to do just that. Join two of our Product Managers, Dan Rosanova and Addison Huddy to: Learn how we’ve evolved Confluent Cloud with the first phase of Project Metamorphosis releases See how Confluent Platform 6.0 brings these transformational, cloud-like qualities to self-managed Kafka Get a sneak peak of our next Metamorphosis theme and how it impacts your Kafka and event-streaming strategy.

How Confluent Completes the Event Streaming Platform (Addison Huddy & Dan Ros...

How Confluent Completes the Event Streaming Platform (Addison Huddy & Dan Ros...

How Confluent Completes the Event Streaming Platform (Addison Huddy & Dan Ros...

HostedbyConfluent

When moving to a cloud native architecture Moogsoft knew they needed more scale than Rabbit could provide. Moogsoft moved into Kafka which is known for quick writing and driving heavy event driven workloads on top of niceties such as replayability. Choosing the tool was easy, finding a vendor that ticked all their boxes was not. They needed to ensure scalability, upgradability, builds via existing IAC pipelines, and observability via existing tools. When Moogsoft found Aiven, they were impressed with their offering and ability to scale on demand. During this presentation we will explore how Moogsoft used Aiven for Kafka to manage and scale their data in the cloud.

The Road Most Traveled: A Kafka Story | Heikki Nousiainen, Aiven

The Road Most Traveled: A Kafka Story | Heikki Nousiainen, Aiven

The Road Most Traveled: A Kafka Story | Heikki Nousiainen, Aiven

HostedbyConfluent

Whilst Kafka has the ability to encrypt data in transit, it does not have the functionality out of the box to encrypt data at rest. This places the responsibility of encryption of data placed on message queues on developers. Implementing cryptography correctly in our applications is challenging and time consuming. In this demo-driven talk, I will show you how you can use HashiCorp Vault’s API to implement a simple workflow that offsets the complexity of cryptography to Vault. In just a few lines of code, I will demonstrate how message producers will be able to encrypt its data, whilst message consumers can decrypt message payloads with minimal development effort. I will also show how to troubleshoot common errors from the API. By the end of this talk, you will learn how to implement symmetric and asymmetric encryption of your application data before placing it on Kafka message queues. You will also learn how to implement this workflow using Format Preserving Encryption (FPE).

Encrypting Kafka messages at rest to secure applications | Robert Barnes, Has...

Encrypting Kafka messages at rest to secure applications | Robert Barnes, Has...

Encrypting Kafka messages at rest to secure applications | Robert Barnes, Has...

HostedbyConfluent

At Wells-Fargo, we move 150 TB of logs data from our syslogs to Splunk forwarders that get indexed and organized for analytic queries. As we modernize and migrate our applications to our hybrid cloud the performance expectations for this infrastructure will proportionately increase. Those improvements include the resilience of the end to end infrastructure. First, we decoupled the applications from their logging interface through a loglibrary which split the streams of logs from their sources to KAFKA which routed them to two separate destinations Splunk and ELK respectively. We also used prometheus and grafana for monitoring the metrics. We also deployed KAFKA, Splunk, ELK, Prometheus and Grafana on the Kubernetes clusters. Confluent had released a version of KAFKA without Zookeeper and replaced its functionality with Quorum Controller. The Quorum-Controller version exhibited better disposability one of the 12factors that's important for Cloud-Nativeness. We packaged this version into a Kubernetes operator called Keda and deployed this for auto-scaling. We tested this to simulate the amount of logdata that we typically generate in production. Based on the above we have also implemented distributed tracing and help make it just as resilient. We will share our lessons learnt, the patterns and practices to modernize both our underlying runtime platforms and our applications with highly performing and resilient event-driven architectures.

Moving 150 TB of data resiliently on Kafka With Quorum Controller on Kubernet...

Moving 150 TB of data resiliently on Kafka With Quorum Controller on Kubernet...

Moving 150 TB of data resiliently on Kafka With Quorum Controller on Kubernet...

HostedbyConfluent

Confluent Cloud makes Devops engineers lives a lot more easier. Yet moving 1500 microservices, 10K topics and 100K partitions to a multi-cluster Confluent cloud can be a challenge. In this talk you will hear about 5 lessons that Wix has learned in order to successfully meet this challenge. These lessons include: 1. Automation, Automation, Automation - all the process has to be completely automated at such scale 2. Prefer a gradual approach - E.g. migrate topics in small chunks and not all at once. Reduces risks if things go bad 3. Cleanup first - avoid migrating unused topics or topics with too many unnecessary partitions

5 lessons learned for successful migration to Confluent cloud | Natan Silinit...

5 lessons learned for successful migration to Confluent cloud | Natan Silinit...

5 lessons learned for successful migration to Confluent cloud | Natan Silinit...

HostedbyConfluent

Apache Kafka is the de facto standard for real-time event streaming, but what do you do if you want to perform user-facing, ad-hoc, real-time analytics too? That's a hard problem. Apache Pinot solves it, and the two together are like chocolate and peanut butter, peaches and cream, and Steve Rogers and Peggy Carter. Come to this talk for an introduction to Pinot and an overview of how the Pinot Kafka Connector works. Hear the challenges unique to a user-facing realtime analytics system, and how Pinot and Kafka work harmoniously to solve them. Witness an action-packed demo, showing just how easy it is to go from events to blazing-fast analytics, and how to use powerful features of both systems that help you do this at scale.

Look how easy it is to go from events to blazing-fast analytics! | Neha Pawar...

Look how easy it is to go from events to blazing-fast analytics! | Neha Pawar...

Look how easy it is to go from events to blazing-fast analytics! | Neha Pawar...

HostedbyConfluent

Creating a Kafka Topic. Super easy? | Andrew Stevenson and Marios Andreopoulo...

Creating a Kafka Topic. Super easy? | Andrew Stevenson and Marios Andreopoulo...

Creating a Kafka Topic. Super easy? | Andrew Stevenson and Marios Andreopoulo...

HostedbyConfluent

Interacting with Apache Kafka seems straightforward at first, you “just” push and pull messages. Yet it can quickly become a source of frustration as the user encounters timeouts, vague error descriptions and disappearing messages. Experience helps a lot and I’m here to share what I know. In this talk you will learn the tips & tricks I wish I had known at the beginning of my Apache Kafka journey. We’ll discuss topics like producer acknowledgments, server and consumer parameters (auto_offset_reset anyone?) that are commonly overlooked causing lots of developer’s pain. I’ll share with you how to generate code that works as expected on the first run, making your first integration painless. These tips will kickstart your Apache Kafka experience in Python and save you hours of debugging.

Practical tips and tricks for Apache Kafka messages integration | Francesco T...

Practical tips and tricks for Apache Kafka messages integration | Francesco T...

Practical tips and tricks for Apache Kafka messages integration | Francesco T...

HostedbyConfluent

Organizations have a need to protect Personally Identifiable Information (PII). As Event Streaming Architecture (ESA) becomes ubiquitous in the enterprise, the prevalence of PII within data streams will only increase. Data architects must be cognizant of how their data pipelines can allow for potential leaks. In highly distributed systems, zero-trust networking has become an industry best practice. We can do the same with Kafka by introducing message-level security. A DevSecOps Engineer with some Kafka experience can leverage Kafka Streams to protect PII by enforcing role-based access control using Open Policy Agent. Rather than implementing a REST API to handle message-level security, Kafka Streams can filter, or even transform outgoing messages in order to redact PII data while leveraging the native capabilities of Kafka. In our proposed presentation, we will provide a live demonstration that consists of two consumers subscribing to the same Kafka topic, but receiving different messages based on the rules specified in Open Policy Agent. At the conclusion of the presentation, we will provide attendees with a GitHub repository, so that they can enjoy a sandbox environment for hands-on experimentation with message-level security.

Securing the Message Bus with Kafka Streams | Paul Otto and Ryan Salcido, Raf...

Securing the Message Bus with Kafka Streams | Paul Otto and Ryan Salcido, Raf...

Securing the Message Bus with Kafka Streams | Paul Otto and Ryan Salcido, Raf...

HostedbyConfluent

At Expedia Group, providing a customized experience for travellers is key to unlocking the best possibilities for each individual traveller and each type of trip.Contextual multi-armed bandits provide a natural approach to develop personalization of user experience and improve content relevancy. In this talk,we present the end-to-end scalable system developed to democratize the use of contextual bandits at EG.The architecture comprises of an online inference component as well as a continuous feedback loop that tracks the users’ affinity towards certain content or page layouts. Kafka is the backbone of our system, powering high-performance streaming jobs that provide bandits with real-time feedback signals to learn from over time. We describe our experience using Kafka for the user interactions events and bandit feedback messages at scale. Lastly,we look at how we plan to expand our use of Kafka to build an off policy evaluation framework to evaluate the effectiveness of new algorithms.

Building adaptive user experiences using Contextual Multi-Armed Bandits with...

Building adaptive user experiences using Contextual Multi-Armed Bandits with...

Building adaptive user experiences using Contextual Multi-Armed Bandits with...

HostedbyConfluent

In this talk we’ll describe the evolution of stream processing at Tesla and the challenges that are specific to our needs, such as large skews in message-processing latencies. We’ll describe how we built a reliable and performant ingestion platform that allows us to take an idea from a whiteboard to production in just a matter of hours. We’ll also discuss the design principles, tools, and incident response processes that have enabled a small team to support Kafka and downstream services in highly-available and multi-tenant environments at scale.

From a Million to a Trillion Events Per Day: Stream Processing in Ludicrous M...

From a Million to a Trillion Events Per Day: Stream Processing in Ludicrous M...

From a Million to a Trillion Events Per Day: Stream Processing in Ludicrous M...

The business systems of an organization are a continuous source of events. Each system also needs to know about events happening in the other systems. Exchanging these events through direct API calls creates a web of inter-dependencies, is fragile and fails to scale. We examine how this problem can be solved through the use of right integration patterns implemented as a light-weight event hub that leverages the power of Kafka and Confluent to operate at enterprise scale. We demonstrate how JavaScript with its event-driven programming model can be a good fit for implementing an event hub that ensures guaranteed message delivery in the face of failures within the individual subscriber systems. Many organizations having large engineering teams skilled in NodeJS and a multitude of NodeJs applications. We show how these teams can easily leverage the power of Kafka and scale their applications with the right architectural building blocks. We also offer insights from our own experience of building NodeJS based Kafka applications.

Guaranteed Event Delivery with Kafka and NodeJS | Amitesh Madhur, Nutanix

Guaranteed Event Delivery with Kafka and NodeJS | Amitesh Madhur, Nutanix

Guaranteed Event Delivery with Kafka and NodeJS | Amitesh Madhur, Nutanix

HostedbyConfluent

Whether you are deploying a new application in Microservices or transitioning from a monolithic database application to a cloud-ready architecture, you will inevitably face the decision of either creating a service mesh of API’s – or – using an event bus for better durability, reliability and extensibility of your application. If you choose to go the event bus route, Kafka is an excellent choice for several reasons. One key technology not to overlook is Avro Schemas. They provide a definition for your event payload, just like an API, to ensure all of the event consumers can reliably consume the events. They also handle schema evolution as requirements change and much, much more. In this talk we will discuss all the nuances and considerations around using Avro Schemas for your JSON event payloads. From developer tools, to DevOps approaches, versioning, governance and some “gotchas” we found when working with Avro Schemas and the Confluent Schema Registry.

Kafka for Microservices – You absolutely need Avro Schemas! | Gerardo Gutierr...

Kafka for Microservices – You absolutely need Avro Schemas! | Gerardo Gutierr...

Kafka for Microservices – You absolutely need Avro Schemas! | Gerardo Gutierr...

HostedbyConfluent

The auto industry is midst a data revolution that is transforming how companies do business. Once a scarce resource, data has now become abundant and cheap. What are the new technologies that change the way we produce, collect, process, store, and analyze data. What new streams of data are being created with Industry 4.0 and the Internet of Things on the horizon, is there significant value to taking a strategic approach to Fast Data. How is Porsche building the next level Data Streaming Platform with open source technologies and how we are using CI/CD pipelines amongst others in order to serve our use cases.

0-330km/h: Porsche's Data Streaming Journey | Sridhar Mamella, Porsche

0-330km/h: Porsche's Data Streaming Journey | Sridhar Mamella, Porsche

0-330km/h: Porsche's Data Streaming Journey | Sridhar Mamella, Porsche

HostedbyConfluent

Was ist angesagt? (20)

Keeping Analytics Data Fresh in a Streaming Architecture | John Neal, Qlik

Keeping Analytics Data Fresh in a Streaming Architecture | John Neal, Qlik

Keeping Analytics Data Fresh in a Streaming Architecture | John Neal, Qlik

Kafka at the Edge: an IoT scenario with OpenShift Streams for Apache Kafka | ...

Kafka at the Edge: an IoT scenario with OpenShift Streams for Apache Kafka | ...

Kafka at the Edge: an IoT scenario with OpenShift Streams for Apache Kafka | ...

A Look into the Mirror: Patterns and Best Practices for MirrorMaker2 | Cliff ...

A Look into the Mirror: Patterns and Best Practices for MirrorMaker2 | Cliff ...

A Look into the Mirror: Patterns and Best Practices for MirrorMaker2 | Cliff ...

Taming a massive fleet of Python-based Kafka apps at Robinhood | Chandra Kuch...

Taming a massive fleet of Python-based Kafka apps at Robinhood | Chandra Kuch...

Taming a massive fleet of Python-based Kafka apps at Robinhood | Chandra Kuch...

Better Kafka Performance Without Changing Any Code | Simon Ritter, Azul

Better Kafka Performance Without Changing Any Code | Simon Ritter, Azul

Better Kafka Performance Without Changing Any Code | Simon Ritter, Azul

Kafka at the core of an AIOps pipeline | Sunanda Kommula, Selector.ai and Ala...

Kafka at the core of an AIOps pipeline | Sunanda Kommula, Selector.ai and Ala...

Kafka at the core of an AIOps pipeline | Sunanda Kommula, Selector.ai and Ala...

How Confluent Completes the Event Streaming Platform (Addison Huddy & Dan Ros...

How Confluent Completes the Event Streaming Platform (Addison Huddy & Dan Ros...

How Confluent Completes the Event Streaming Platform (Addison Huddy & Dan Ros...

The Road Most Traveled: A Kafka Story | Heikki Nousiainen, Aiven

The Road Most Traveled: A Kafka Story | Heikki Nousiainen, Aiven

The Road Most Traveled: A Kafka Story | Heikki Nousiainen, Aiven

Encrypting Kafka messages at rest to secure applications | Robert Barnes, Has...

Encrypting Kafka messages at rest to secure applications | Robert Barnes, Has...

Encrypting Kafka messages at rest to secure applications | Robert Barnes, Has...

Moving 150 TB of data resiliently on Kafka With Quorum Controller on Kubernet...

Moving 150 TB of data resiliently on Kafka With Quorum Controller on Kubernet...

Moving 150 TB of data resiliently on Kafka With Quorum Controller on Kubernet...

5 lessons learned for successful migration to Confluent cloud | Natan Silinit...

5 lessons learned for successful migration to Confluent cloud | Natan Silinit...

5 lessons learned for successful migration to Confluent cloud | Natan Silinit...

Look how easy it is to go from events to blazing-fast analytics! | Neha Pawar...

Look how easy it is to go from events to blazing-fast analytics! | Neha Pawar...

Look how easy it is to go from events to blazing-fast analytics! | Neha Pawar...

Creating a Kafka Topic. Super easy? | Andrew Stevenson and Marios Andreopoulo...

Creating a Kafka Topic. Super easy? | Andrew Stevenson and Marios Andreopoulo...

Creating a Kafka Topic. Super easy? | Andrew Stevenson and Marios Andreopoulo...

Practical tips and tricks for Apache Kafka messages integration | Francesco T...

Practical tips and tricks for Apache Kafka messages integration | Francesco T...

Practical tips and tricks for Apache Kafka messages integration | Francesco T...

Securing the Message Bus with Kafka Streams | Paul Otto and Ryan Salcido, Raf...

Securing the Message Bus with Kafka Streams | Paul Otto and Ryan Salcido, Raf...

Securing the Message Bus with Kafka Streams | Paul Otto and Ryan Salcido, Raf...

Building adaptive user experiences using Contextual Multi-Armed Bandits with...

Building adaptive user experiences using Contextual Multi-Armed Bandits with...

Building adaptive user experiences using Contextual Multi-Armed Bandits with...

From a Million to a Trillion Events Per Day: Stream Processing in Ludicrous M...

From a Million to a Trillion Events Per Day: Stream Processing in Ludicrous M...

From a Million to a Trillion Events Per Day: Stream Processing in Ludicrous M...

Guaranteed Event Delivery with Kafka and NodeJS | Amitesh Madhur, Nutanix

Guaranteed Event Delivery with Kafka and NodeJS | Amitesh Madhur, Nutanix

Guaranteed Event Delivery with Kafka and NodeJS | Amitesh Madhur, Nutanix

Kafka for Microservices – You absolutely need Avro Schemas! | Gerardo Gutierr...

Kafka for Microservices – You absolutely need Avro Schemas! | Gerardo Gutierr...

Kafka for Microservices – You absolutely need Avro Schemas! | Gerardo Gutierr...

0-330km/h: Porsche's Data Streaming Journey | Sridhar Mamella, Porsche

0-330km/h: Porsche's Data Streaming Journey | Sridhar Mamella, Porsche

0-330km/h: Porsche's Data Streaming Journey | Sridhar Mamella, Porsche

Ähnlich wie Event-driven Applications with Kafka, Micronaut, and AWS Lambda | Dave Klein, Confluent

Sas 2015 event_driven

Sas 2015 event_driven

Sas 2015 event_driven

Sascha Möllering

從劍宗到氣宗－談AWS ECS與Serverless最佳實踐

從劍宗到氣宗－談AWS ECS與Serverless最佳實踐

從劍宗到氣宗－談AWS ECS與Serverless最佳實踐

Serverless Frameworks on AWS

Serverless Frameworks on AWS

Serverless Frameworks on AWS

DIMT 2023 SG - Hands-on Workshop_ Getting started with Confluent Cloud.pdf

DIMT 2023 SG - Hands-on Workshop_ Getting started with Confluent Cloud.pdf

DIMT 2023 SG - Hands-on Workshop_ Getting started with Confluent Cloud.pdf

Serverless brewbox

Serverless brewbox

Serverless brewbox

Getting Started with AWS Lambda and Serverless Computing

Getting Started with AWS Lambda and Serverless Computing

Getting Started with AWS Lambda and Serverless Computing

AWS Lambda lets you run code without provisioning or managing servers. You pay only for the compute time you consume - there is no charge when your code is not running. With Lambda, you can run code for virtually any type of application or backend service - all with zero administration. Just upload your code and Lambda takes care of everything required to run and scale your code with high availability. You can set up your code to automatically trigger from other AWS services or call it directly from any web or mobile app. In this session, we dive deep into AWS Lambda to learn about capabilities, features and benefits. Learning Objectives: • Dive deep into AWS Lambda • Learn about the capabilities, features and benefits of AWS Lambda • Learn about the different use cases • Learn how to get started using AWS Lambda

Deep Dive on AWS Lambda - January 2017 AWS Online Tech Talks

Deep Dive on AWS Lambda - January 2017 AWS Online Tech Talks

Deep Dive on AWS Lambda - January 2017 AWS Online Tech Talks

Amazon Web Services

Stephen Liedig (Amazon Web Services) is a Public Sector Solutions Architect at AWS working closely with local and state governments, educational institutions, and non-profit organisations across Australia and New Zealand to design, and deliver, highly secure, scalable, reliable and fault-tolerant architectures in the AWS Cloud while sharing best practices and current trends, with a specific focus on DevOps, messaging, and serverless technologies.

Stephen Liedig: Building Serverless Backends with AWS Lambda and API Gateway

Stephen Liedig: Building Serverless Backends with AWS Lambda and API Gateway

Stephen Liedig: Building Serverless Backends with AWS Lambda and API Gateway

Steve Androulakis

Building serverless backends - Tech talk 5 May 2017

Building serverless backends - Tech talk 5 May 2017

Building serverless backends - Tech talk 5 May 2017

Microservices are independent, encapsulated entities that produce meaningful results and business functionality in tentative collaboration. Events and pub/sub are great for allowing such decoupled interaction. Using Apache Kafka as robust, distributed, real-time, high volume event bus, this session demonstrates how microservices packaged with Docker and implemented in Java, Node, Python and SQL collaborate unknowingly. The microservices respond to social (media) events - courtesy of IFTTT - and publish results to multiple channels. The event bus operates across cloud services and on premises platforms such as Kubernetes: both the bus and the microservices can run anywhere. A microservices platform is discussed with generic capabilities. Outline: presentation summary - intro microservices objectives, focus on decoupled collaboration - demo four mservices in different technologies (Node, Java, ...) ; no direct dependencies; show the code (running on its own), show the packing into a container and the step of running the containers on a container management platform, using both Kubernetes and a Container Cloud Service (later on this will further the point of collaborating between microservices that are widely separated) - discuss generic capabilities of a microservices platform (facilities required in many microservices that should be available as microservice - such as cache, log, authenticate (and compare with Java EE application server) - demo a microservice providing a generic cache functionality (based on MongoDB) - outline the desired choreography (a four step workflow that requires participation from various microservices); briefly discuss routing slips and the Saga pattern - discuss use of events and need of event bus - intro Kafka - demo pub and sub from each mservice to Kafka - link IFTTT to Kafka (for demo: use ngrok to expose local Kafka to IFTTT cloud) - demo end-to-end Social event=>IFTTT=>Kafka=>choreographed mservices=> final result - demo: extend one of the microservices: change the code, package a new container image version and update the running version in the container platform; demonstrate that new workflows leverage the new version - demo: move a microservice from on premises to cloud - showing that the decoupled nature of the mservices mean that this move does not have any impact - demo: show a change in the logic of the routing slip; none of the mservices require any change for a changed workflow choreography to be executed - discuss cloud deployment of event bus + mservices

Event Bus as Backbone for Decoupled Microservice Choreography (JFall 2017)

Event Bus as Backbone for Decoupled Microservice Choreography (JFall 2017)

Event Bus as Backbone for Decoupled Microservice Choreography (JFall 2017)

Morning session started with a presentation on working with a micro-services API gateway in hybrid architectures, by Jean-Pierre LeGoaller, Architect at AWS. We learned how to greatly reduce coding efforts, make applications far more efficient, and decrease errors all at the same time, using small and flexible Micro-services with an API Gateway. Jean-Pierre then illustrated the benefits of AWS lambda function to run seamlessly codes as a service in AWS high-availability compute infrastructure.

2016-06 - Design your api management strategy - AWS - Microservices on AWS

2016-06 - Design your api management strategy - AWS - Microservices on AWS

2016-06 - Design your api management strategy - AWS - Microservices on AWS

Building serverless apps with Node.js

Building serverless apps with Node.js

Building serverless apps with Node.js

by Rahul Sareen, Sr. IoT Consultant, AWS Professional Services Serverless computing allows you to build and run applications without the need for provisioning or managing servers. With serverless computing, you can build web, mobile, and IoT backends; run stream processing or big data workloads; run chatbots, and more. In this session, you’ll learn how to get started with serverless computing with AWS Lambda, which lets you run code without provisioning or managing servers. We’ll introduce you to the basics of building with Lambda and how you can benefit from features such as continuous scaling, built-in high availability, integrations with AWS and third-party apps, and subsecond metering pricing. We’ll also introduce you to the broader portfolio of AWS services that help you build serverless applications with Lambda, including Amazon API Gateway, Amazon DynamoDB, AWS Step Functions, and more.

Getting Started with AWS Lambda and Serverless Computing

Getting Started with AWS Lambda and Serverless Computing

Getting Started with AWS Lambda and Serverless Computing

Amazon Web Services

Microservices are independent, encapsulated entities that produce meaningful results and business functionality in tentative collaboration. Events and pub/sub are great for allowing such decoupled interaction. Using Apache Kafka as robust, distributed, real-time, high volume event bus, this session demonstrates how microservices packaged with Docker and implemented in Java, Node, Python and SQL collaborate unknowingly. The microservices respond to social (media) events - courtesy of IFTTT - and publish results to multiple channels. The event bus operates across cloud services and on premises platforms such as Kubernetes: both the bus and the microservices can run anywhere. A microservices platform is discussed with generic capabilities. The resources for the accompanying workshop are in GitHub: https://github.com/lucasjellema/workshop-event-bus-microservice-choreography-may-2018

Event Bus as Backbone for Decoupled Microservice Choreography - Lecture and W...

Event Bus as Backbone for Decoupled Microservice Choreography - Lecture and W...

Event Bus as Backbone for Decoupled Microservice Choreography - Lecture and W...

Microservices are independent, encapsulated entities that produce meaningful results and business functionality in tentative collaboration. Events and pub/sub are great for allowing such decoupled interaction. Using Apache Kafka as robust, distributed, real-time, high volume event bus, this session demonstrates how microservices implemented in Java, Node, Python and SQL collaborate unknowingly. The microservices respond to social (media) events - courtesy of IFTTT - and publish results to multiple channels. The event bus operates across cloud services and on premises platforms: both the bus and the microservices can run anywhere.

Event Bus as Backbone for Decoupled Microservice Choreography (Oracle Code, A...

Event Bus as Backbone for Decoupled Microservice Choreography (Oracle Code, A...

Event Bus as Backbone for Decoupled Microservice Choreography (Oracle Code, A...

Join us to learn about the state of serverless computing from Dr. Tim Wagner, General Manager of AWS Lambda. Dr. Wagner discusses the latest developments from AWS Lambda and the serverless computing ecosystem. He talks about how serverless computing is becoming a core component in how companies build and run their applications and services, and he also discusses how serverless computing will continue to evolve.

AWS re:Invent 2016: The State of Serverless Computing (SVR311)

AWS re:Invent 2016: The State of Serverless Computing (SVR311)

AWS re:Invent 2016: The State of Serverless Computing (SVR311)

Amazon Web Services

Introducing to serverless computing and AWS lambda - Israel Clouds Meetup

Introducing to serverless computing and AWS lambda - Israel Clouds Meetup

Introducing to serverless computing and AWS lambda - Israel Clouds Meetup

Application Lifecycle Management on AWS

Application Lifecycle Management on AWS

Application Lifecycle Management on AWS

Serverless Pune meetup 3

Serverless Pune meetup 3

Serverless Pune meetup 3

This webinar teaches you how to use Amazon API Gateway and AWS Lambda to run your existing Express.js applications with just a few lines of code. We will introduce three new features in API Gateway: proxy integrations, greedy paths, and the ANY HTTP method. Combining these features, you can configure API Gateway in a few simple clicks via the management console and express all of your logic and API definition in code. Learning Objectives: 1. Easier migration to API Gateway and Lambda 2. New API Gateway Catch-all methods Who Should Attend: Developers

Migrate your Existing Express Apps to AWS Lambda and Amazon API Gateway

Migrate your Existing Express Apps to AWS Lambda and Amazon API Gateway

Migrate your Existing Express Apps to AWS Lambda and Amazon API Gateway

Amazon Web Services

Ähnlich wie Event-driven Applications with Kafka, Micronaut, and AWS Lambda | Dave Klein, Confluent (20)

Sas 2015 event_driven

Sas 2015 event_driven

Sas 2015 event_driven

從劍宗到氣宗－談AWS ECS與Serverless最佳實踐

從劍宗到氣宗－談AWS ECS與Serverless最佳實踐

從劍宗到氣宗－談AWS ECS與Serverless最佳實踐

Serverless Frameworks on AWS

Serverless Frameworks on AWS

Serverless Frameworks on AWS

DIMT 2023 SG - Hands-on Workshop_ Getting started with Confluent Cloud.pdf

DIMT 2023 SG - Hands-on Workshop_ Getting started with Confluent Cloud.pdf

DIMT 2023 SG - Hands-on Workshop_ Getting started with Confluent Cloud.pdf

Serverless brewbox

Serverless brewbox

Serverless brewbox

Getting Started with AWS Lambda and Serverless Computing

Getting Started with AWS Lambda and Serverless Computing

Getting Started with AWS Lambda and Serverless Computing

Deep Dive on AWS Lambda - January 2017 AWS Online Tech Talks

Deep Dive on AWS Lambda - January 2017 AWS Online Tech Talks

Deep Dive on AWS Lambda - January 2017 AWS Online Tech Talks

Stephen Liedig: Building Serverless Backends with AWS Lambda and API Gateway

Stephen Liedig: Building Serverless Backends with AWS Lambda and API Gateway

Stephen Liedig: Building Serverless Backends with AWS Lambda and API Gateway

Building serverless backends - Tech talk 5 May 2017

Building serverless backends - Tech talk 5 May 2017

Building serverless backends - Tech talk 5 May 2017

Event Bus as Backbone for Decoupled Microservice Choreography (JFall 2017)

Event Bus as Backbone for Decoupled Microservice Choreography (JFall 2017)

Event Bus as Backbone for Decoupled Microservice Choreography (JFall 2017)

2016-06 - Design your api management strategy - AWS - Microservices on AWS

2016-06 - Design your api management strategy - AWS - Microservices on AWS

2016-06 - Design your api management strategy - AWS - Microservices on AWS

Building serverless apps with Node.js

Building serverless apps with Node.js

Building serverless apps with Node.js

Getting Started with AWS Lambda and Serverless Computing

Getting Started with AWS Lambda and Serverless Computing

Getting Started with AWS Lambda and Serverless Computing

Event Bus as Backbone for Decoupled Microservice Choreography - Lecture and W...

Event Bus as Backbone for Decoupled Microservice Choreography - Lecture and W...

Event Bus as Backbone for Decoupled Microservice Choreography - Lecture and W...

Event Bus as Backbone for Decoupled Microservice Choreography (Oracle Code, A...

Event Bus as Backbone for Decoupled Microservice Choreography (Oracle Code, A...

Event Bus as Backbone for Decoupled Microservice Choreography (Oracle Code, A...

AWS re:Invent 2016: The State of Serverless Computing (SVR311)

AWS re:Invent 2016: The State of Serverless Computing (SVR311)

AWS re:Invent 2016: The State of Serverless Computing (SVR311)

Introducing to serverless computing and AWS lambda - Israel Clouds Meetup

Introducing to serverless computing and AWS lambda - Israel Clouds Meetup

Introducing to serverless computing and AWS lambda - Israel Clouds Meetup

Application Lifecycle Management on AWS

Application Lifecycle Management on AWS

Application Lifecycle Management on AWS

Serverless Pune meetup 3

Serverless Pune meetup 3

Serverless Pune meetup 3

Migrate your Existing Express Apps to AWS Lambda and Amazon API Gateway

Migrate your Existing Express Apps to AWS Lambda and Amazon API Gateway

Migrate your Existing Express Apps to AWS Lambda and Amazon API Gateway

Mehr von HostedbyConfluent

"In this talk, attendees will be provided with an introduction to Kafka Connect and the basics of Single Message Transforms (SMTs) and how they can be used to transform data streams in a simple and efficient way. SMTs are a powerful feature of Kafka Connect that allow custom logic to be applied to individual messages as they pass through the data pipeline. The session will explain how SMTs work, the types of transformations they can be used for, and how they can be applied in a modular and composable way. Further, the session will discuss where SMTs fit in with Kafka Connect and when they should be used. Examples will be provided of how SMTs can be used to solve common data integration challenges, such as data enrichment, filtering, and restructuring. Attendees will also learn about the limitations of SMTs and when it might be more appropriate to use other tools or frameworks. Additionally, an overview of the alternatives to SMTs, such as Kafka Streams and KSQL, will be provided. This will help attendees make an informed decision about which approach is best for their specific use case. Whether attendees are developers, data engineers, or data scientists, this talk will provide valuable insights into how Kafka Connect and SMTs can help streamline data processing workflows. Attendees will come away with a better understanding of how these tools work and how they can be used to solve common data integration challenges."

Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...

Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...

Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...

HostedbyConfluent

"While Apache Kafka lacks native support for topic renaming, there are scenarios where renaming topics becomes necessary. This presentation will delve into the utilization of MirrorMaker 2.0 as a solution for renaming Kafka topics. It will illustrate how MirrorMaker 2.0 can efficiently facilitate the migration of messages from the old topic to the new one and how Kafka Connect Metrics can be employed to monitor the mirroring progress. The discussion will encompass the complexity of renaming Kafka topics, addressing certain limitations, and exploring potential workarounds when using MirrorMaker 2.0 for this purpose. Despite not being originally designed for topic renaming, MirrorMaker 2.0 has a suitable solution for renaming Kafka topics. Blog Post : https://engineering.hellofresh.com/renaming-a-kafka-topic-d6ff3aaf3f03"

Renaming a Kafka Topic | Kafka Summit London

Renaming a Kafka Topic | Kafka Summit London

Renaming a Kafka Topic | Kafka Summit London

HostedbyConfluent

"Trendyol, Turkey's leading e-commerce company, is committed to positively impacting the lives of millions of customers. Our decision-making processes are entirely driven by data. As a data warehouse team, our primary goal is to provide accurate and up-to-date data, enabling the extraction of valuable business insights. We utilize the benefits provided by Kafka and Kafka Connect to facilitate the transfer of data from the source to our analytical environment. We recently transitioned our Kafka Connect clusters from on-premise VMs to Kubernetes. This shift was driven by our desire to effectively manage rapid growth(marked by a growing number of producers, consumers, and daily messages), ensuring proper monitoring and consistency. Consistency is crucial, especially in instances where we employ Single Message Transforms to manipulate records like filtering based on their keys or converting a JSON Object into a JSON string. Monitoring our cluster's health is key and we achieve this through Grafana dashboards and alerts generated through kube-state-metrics. Additionally, Kafka Connect's JMX metrics, coupled with NewRelic, are employed for comprehensive monitoring. The session will aim to explain our approach to NRT data ingestion, outlining the role of Kafka and Kafka Connect, our transition journey to K8s, and methods employed to monitor the health of our clusters."

Evolution of NRT Data Ingestion Pipeline at Trendyol

Evolution of NRT Data Ingestion Pipeline at Trendyol

Evolution of NRT Data Ingestion Pipeline at Trendyol

HostedbyConfluent

"Join our lightning talk to delve into the strategies vital for maintaining a resilient Kafka service. While proactive monitoring is key for issue prevention, failures will still occur. Rapid detection tools will enable you to identify and resolve problems before they impact end-users. This session explores the techniques employed by Kafka cloud providers for this detection, many of which are also applicable if you are managing independent Kafka clusters or applications. The talk focuses on health-checking, a powerful tool that encompasses an application and its monitoring to validate Kafka environment availability. The session navigates through Kafka health-check methods, sharing best practices, identifying common pitfalls, and highlighting the monitoring of critical performance metrics like throughput and latency for early issue detection. Attendees will gain valuable insights into the art of health-checking their Kafka environment, equipping them with the tools to identify and address issues before they escalate into critical problems. We invite all Kafka enthusiasts to join us in this talk to foster a deeper understanding of Kafka health-checking and ensure the continued smooth operation of your Kafka environment."

Ensuring Kafka Service Resilience: A Dive into Health-Checking Techniques

Ensuring Kafka Service Resilience: A Dive into Health-Checking Techniques

Ensuring Kafka Service Resilience: A Dive into Health-Checking Techniques

HostedbyConfluent

"Stream processing systems traditionally gave their users the choice between at least once processing and at most once processing: accepting duplicate data or missing data. But ideally we would provide exactly-once processing, where every event in the input data is represented exactly once in the output. Kafka provides a transaction API that enables exactly-once when using Kafka as your source and sink. But this API has turned out to not be well suited for use by high level streaming systems, requiring various work arounds to still provide transactional processing. In this talk, I’ll cover how the transaction API works, and how systems like Arroyo and Flink have used it to build exactly-once support, and how improvements to the transactional API will enable better end-to-end support for consistent stream processing."

Exactly-once Stream Processing with Arroyo and Kafka

Exactly-once Stream Processing with Arroyo and Kafka

Exactly-once Stream Processing with Arroyo and Kafka

HostedbyConfluent

"In this talk, we will explore the exciting world of IoT and computer vision by presenting a unique project: Fish Plays Pokemon. Using an ESP Eye camera connected to an ESP32 and other IoT devices, to monitor fish's movements in an aquarium. This project showcases the power of IoT and computer vision, demonstrating how even a fish can play a popular video game. We will discuss the challenges we faced during development, including real-time processing, IoT device integration, and Kafka message consumption. By the end of the talk, attendees will have a better understanding of how to combine IoT, computer vision, and the usage of a serverless cloud to create innovative projects. They will also learn how to integrate IoT devices with Kafka to simulate keyboard behavior, opening up endless possibilities for real-time interactions between the physical and digital worlds."

Fish Plays Pokemon | Kafka Summit London

Fish Plays Pokemon | Kafka Summit London

Fish Plays Pokemon | Kafka Summit London

HostedbyConfluent

Tiered Storage 101 | Kafla Summit London

Tiered Storage 101 | Kafla Summit London

Tiered Storage 101 | Kafla Summit London

HostedbyConfluent

"Real-time 24/7 monitoring and verification of massive data is challenging – even more so for the world’s second largest manufacturer of memory chips and semiconductors. Tolerance levels are incredibly small, any small defect needs to be identified and dealt with immediately. The goal of semiconductor manufacturing is to improve yield and minimize unnecessary work. However, even with real-time data collection, the data was not easy to manipulate by users and it took many days to enable stream processing requests – limiting its usefulness and value to the business. You’ll hear why SK hynix switched to Confluent and how we developed a self-service stream process portal on top of it. Now users have an easy-to-use service to manipulate the data they want. Results have been impressive, stream processing requests are available the same day – previously taking 5 days! We were also able to drive down costs by 10% as stream processing requests no longer require additional hardware. What you’ll take away from our talk: - What were the pain points in the previous environment - How we transitioned to Confluent without service downtime - Creating a self-service stream processing portal built on top of Connect and ksqlDB - Use case of stream process portal"

Building a Self-Service Stream Processing Portal: How And Why

Building a Self-Service Stream Processing Portal: How And Why

Building a Self-Service Stream Processing Portal: How And Why

HostedbyConfluent

"Discover how default configurations might impact ingestion times, especially when dealing with large files. We'll explore a real-world scenario with a 20,000,000+ line file, assessing metrics and exploring the bottleneck in the default setup. Understand the intricacies of batch size calculations and how to optimize them based on your unique data characteristics. Walk away with actionable insights as we showcase a practical example, turning a 7-hour ingestion process into a mere 30 minutes for over 30,000,000 records in a Kafka topic. Uncover metrics, configurations, and best practices to elevate the performance of your Kafka Connect CSV source connectors. Don't miss this opportunity to optimize your data pipeline and ensure smooth, efficient data flow."

From the Trenches: Improving Kafka Connect Source Connector Ingestion from 7 ...

From the Trenches: Improving Kafka Connect Source Connector Ingestion from 7 ...

From the Trenches: Improving Kafka Connect Source Connector Ingestion from 7 ...

HostedbyConfluent

"In order to meet the current and ever-increasing demand for near-zero RPO/RTO systems, a focus on resiliency is critical. While Kafka offers built-in resiliency features, a perfect blend of client and cluster resiliency is necessary in order to achieve a highly resilient Kafka client application. At Fidelity Investments, Kafka is used for a variety of event streaming needs such as core brokerage trading platforms, log aggregation, communication platforms, and data migrations. In this lightening talk, we will discuss the governance framework that has enabled producers and consumers to achieve their SLAs during unprecedented failure scenarios. We will highlight how we automated resiliency tests through chaos engineering and tightly integrated observability dashboards for Kafka clients to analyze and optimize client configurations. And finally, we will summarize the chaos test suite and the ""test, test and test"" mantra that are helping Fidelity Investments reach its goal of a future with zero down-time."

Future with Zero Down-Time: End-to-end Resiliency with Chaos Engineering and ...

Future with Zero Down-Time: End-to-end Resiliency with Chaos Engineering and ...

Future with Zero Down-Time: End-to-end Resiliency with Chaos Engineering and ...

HostedbyConfluent

"There are various strategies for securely connecting to Kafka clusters between different networks or over the public internet. Many cloud providers even offer endpoints that privately route traffic between networks and are not exposed to the internet. But, depending on your network setup and how you are running Kafka, these options ... might not be an option! In this session, we’ll discuss how you can use SSH bastions or a self managed PrivateLink endpoint to establish connectivity to your Kafka clusters without exposing brokers directly to the internet. We explain the required network configuration, and show how we at Materialize have contributed to librdkafka to simplify these scenarios and avoid fragile workarounds."

Navigating Private Network Connectivity Options for Kafka Clusters

Navigating Private Network Connectivity Options for Kafka Clusters

Navigating Private Network Connectivity Options for Kafka Clusters

HostedbyConfluent

"In my talk, we will examine all the stages of building our self-service Streaming Data Platform based on Apache Flink and Kafka Connect, from the selection of a solution for stateful streaming data processing, right up to the successful design of a robust self-service platform, covering the challenges that we’ve met. I will share our experience in providing non-Java developers with a company-wide self-service solution, which allows them to quickly and easily develop their streaming data pipelines. Additionally, I will highlight specific business use cases that would not have been implemented without our platform.0 characters0 characters"

Apache Flink: Building a Company-wide Self-service Streaming Data Platform

Apache Flink: Building a Company-wide Self-service Streaming Data Platform

Apache Flink: Building a Company-wide Self-service Streaming Data Platform

HostedbyConfluent

"Almost everyone has heard about large language models, and tens of millions of people have tried out OpenAI ChatGPT and Google Bard. However, the intricate architecture and underlying mathematics driving these remarkable systems remain elusive to many. LLM's are fascinating - so let's grab a drink and find out how these systems are built and dive deep into their inner workings. In the length of time it to enjoy a round of drinks, you'll understand the inner workings of these models. We'll take our first sip of word vectors, enjoy the refreshing taste of the transformer, and drain a glass understanding how these models are trained on phenomenally large quantities of data. Large language models for your streaming application - explained with a little maths and a lot of pub stories"

Explaining How Real-Time GenAI Works in a Noisy Pub

Explaining How Real-Time GenAI Works in a Noisy Pub

Explaining How Real-Time GenAI Works in a Noisy Pub

HostedbyConfluent

"Monitoring is a fundamental operation when running Kafka and Kafka applications in production. There are numerous metrics available when using Kafka, however the sheer number is overwhelming, making it challenging to know where to start and how to properly utilise them. This session will introduce you to some of the key metrics that should be monitored and best practices in fine tuning your monitoring. We will delve into which metrics are the indicators for cluster’s availability and performance and are the most helpful when debugging client applications."

TL;DR Kafka Metrics | Kafka Summit London

TL;DR Kafka Metrics | Kafka Summit London

TL;DR Kafka Metrics | Kafka Summit London

HostedbyConfluent

Kafka Streams relies on state restoration for maintaining standby tasks as failure recovery mechanism as well as for restoring the state after rebalance scenarios. When you are scaling up or down your application instances, it is necessary to know the current state of the restoration process for each active and standby task in order to prevent a long restoration process as much as possible. During this presentation, you will get an understanding of how KIP-869 provides valuable information about the current active task restoration after a rebalance and KIP-988 opens a window to the continuous process of standby restoration. When you encounter a situation in which you need to choose whether or not to scale up or down your application instances, both KIPs will be an invaluable ally for you.

A Window Into Your Kafka Streams Tasks | KSL

A Window Into Your Kafka Streams Tasks | KSL

A Window Into Your Kafka Streams Tasks | KSL

HostedbyConfluent

"In this talk, we will dive into the world of Kafka producer configs and explore how to understand and optimize them for better performance. We will cover the different types of configs, their impact on performance, and how to tune them to achieve the best results. Whether you're new to Kafka or a seasoned pro, this session will provide valuable insights and practical tips for improving your Kafka producer performance. - Introduction to Kafka producer internal and workflow - Understanding the producer configs like linger.ms, batch.size, buffer.memory and their impact on performance - Learning about producer configs like max.block.ms, delivery.timeout.ms, request.timeout.ms and retries to make producer more resilient. - Discuss configs like enable.idempotence, max.in.flight.requests.per.connection and transaction related configs to achieve delivery guarantees. - Q&A session with attendees to address specific questions and concerns."

Mastering Kafka Producer Configs: A Guide to Optimizing Performance

Mastering Kafka Producer Configs: A Guide to Optimizing Performance

Mastering Kafka Producer Configs: A Guide to Optimizing Performance

HostedbyConfluent

"Data contracts are one of the hottest topics in the data management community. A data contract is a formal agreement between a data producer and its consumers, aimed at reducing data downtime and improving data quality. Schemas are an important part of data contracts, but they are not the only relevant element. In this talk, we’ll: 1. see why data contracts are so important but also difficult to implement; 2. identify the characteristics of a well-designed data contract: discuss the anatomy of a data contract, its main elements and, how to formally describe them; 3. show how to manage the lifecycle of a data contract leveraging Confluent Platform's services."

Data Contracts Management: Schema Registry and Beyond

Data Contracts Management: Schema Registry and Beyond

Data Contracts Management: Schema Registry and Beyond

HostedbyConfluent

"In the realm of stateful stream processing, Apache Flink has emerged as a powerful and versatile platform. However, the conventional SQL-based approach often limits the full potential of Flink applications. We will delve into the benefits of adopting a code-first approach, which provides developers with greater control over application logic, facilitates complex transformations, and enables more efficient handling of state and time. We will also discuss how the code-first approach can lead to more maintainable and testable code, ultimately improving the overall quality of your Flink applications. Whether you're a seasoned Flink developer or just starting your journey, this talk will provide valuable insights into how a code-first approach can revolutionize your stream processing applications."

Code-First Approach: Crafting Efficient Flink Apps

Code-First Approach: Crafting Efficient Flink Apps

Code-First Approach: Crafting Efficient Flink Apps

HostedbyConfluent

"Change Data Capture (CDC) has become a commodity in data engineering, much in part due to the ever-rising success of Debezium [1]. But is that all there is? In this lightning talk, we’ll outline the current state of the CDC ecosystem, and understand why adopting a Debezium alternative is still a hard sell. If you’ve ever wondered what else is out there, but can’t keep up with the sprawling of new tools in the ecosystem; we’ll wrap it up for you! [1] https://debezium.io/"

Debezium vs. the World: An Overview of the CDC Ecosystem

Debezium vs. the World: An Overview of the CDC Ecosystem

Debezium vs. the World: An Overview of the CDC Ecosystem

HostedbyConfluent

"Separation of compute and storage has become the de-facto standard in the data industry for batch processing. The addition of tiered storage to open source Apache Kafka is the first step in bringing true separation of compute and storage to the streaming world. In this talk, we'll discuss in technical detail how to take the concept of tiered storage to its logical extreme by building an Apache Kafka protocol compatible system that has zero local disks. Eliminating all local disks in the system requires not only separating storage from compute, but also separating data from metadata. This is a monumental task that requires reimagining Kafka's architecture from the ground up, but the benefits are worth it. This approach enables a stateless, elastic, and serverless deployment model that minimizes operational overhead and also drives inter-zone networking costs to almost zero."

Beyond Tiered Storage: Serverless Kafka with No Local Disks

Beyond Tiered Storage: Serverless Kafka with No Local Disks

Beyond Tiered Storage: Serverless Kafka with No Local Disks

HostedbyConfluent

Mehr von HostedbyConfluent (20)

Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...

Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...

Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...

Renaming a Kafka Topic | Kafka Summit London

Renaming a Kafka Topic | Kafka Summit London

Renaming a Kafka Topic | Kafka Summit London

Evolution of NRT Data Ingestion Pipeline at Trendyol

Evolution of NRT Data Ingestion Pipeline at Trendyol

Evolution of NRT Data Ingestion Pipeline at Trendyol

Ensuring Kafka Service Resilience: A Dive into Health-Checking Techniques

Ensuring Kafka Service Resilience: A Dive into Health-Checking Techniques

Ensuring Kafka Service Resilience: A Dive into Health-Checking Techniques

Exactly-once Stream Processing with Arroyo and Kafka

Exactly-once Stream Processing with Arroyo and Kafka

Exactly-once Stream Processing with Arroyo and Kafka

Fish Plays Pokemon | Kafka Summit London

Fish Plays Pokemon | Kafka Summit London

Fish Plays Pokemon | Kafka Summit London

Tiered Storage 101 | Kafla Summit London

Tiered Storage 101 | Kafla Summit London

Tiered Storage 101 | Kafla Summit London

Building a Self-Service Stream Processing Portal: How And Why

Building a Self-Service Stream Processing Portal: How And Why

Building a Self-Service Stream Processing Portal: How And Why

From the Trenches: Improving Kafka Connect Source Connector Ingestion from 7 ...

From the Trenches: Improving Kafka Connect Source Connector Ingestion from 7 ...

From the Trenches: Improving Kafka Connect Source Connector Ingestion from 7 ...

Future with Zero Down-Time: End-to-end Resiliency with Chaos Engineering and ...

Future with Zero Down-Time: End-to-end Resiliency with Chaos Engineering and ...

Future with Zero Down-Time: End-to-end Resiliency with Chaos Engineering and ...

Navigating Private Network Connectivity Options for Kafka Clusters

Navigating Private Network Connectivity Options for Kafka Clusters

Navigating Private Network Connectivity Options for Kafka Clusters

Apache Flink: Building a Company-wide Self-service Streaming Data Platform

Apache Flink: Building a Company-wide Self-service Streaming Data Platform

Apache Flink: Building a Company-wide Self-service Streaming Data Platform

Explaining How Real-Time GenAI Works in a Noisy Pub

Explaining How Real-Time GenAI Works in a Noisy Pub

Explaining How Real-Time GenAI Works in a Noisy Pub

TL;DR Kafka Metrics | Kafka Summit London

TL;DR Kafka Metrics | Kafka Summit London

TL;DR Kafka Metrics | Kafka Summit London

A Window Into Your Kafka Streams Tasks | KSL

A Window Into Your Kafka Streams Tasks | KSL

A Window Into Your Kafka Streams Tasks | KSL

Mastering Kafka Producer Configs: A Guide to Optimizing Performance

Mastering Kafka Producer Configs: A Guide to Optimizing Performance

Mastering Kafka Producer Configs: A Guide to Optimizing Performance

Data Contracts Management: Schema Registry and Beyond

Data Contracts Management: Schema Registry and Beyond

Data Contracts Management: Schema Registry and Beyond

Code-First Approach: Crafting Efficient Flink Apps

Code-First Approach: Crafting Efficient Flink Apps

Code-First Approach: Crafting Efficient Flink Apps

Debezium vs. the World: An Overview of the CDC Ecosystem

Debezium vs. the World: An Overview of the CDC Ecosystem

Debezium vs. the World: An Overview of the CDC Ecosystem

Beyond Tiered Storage: Serverless Kafka with No Local Disks

Beyond Tiered Storage: Serverless Kafka with No Local Disks

Beyond Tiered Storage: Serverless Kafka with No Local Disks

Kürzlich hochgeladen

💥 You’re lucky! We’ve found two different (lead) developers that are willing to share their valuable lessons learned about using UiPath Document Understanding! Based on recent implementations in appealing use cases at Partou and SPIE. Don’t expect fancy videos or slide decks, but real and practical experiences that will help you with your own implementations. 📕 Topics that will be addressed: • Training the ML-model by humans: do or don't? • Rule-based versus AI extractors • Tips for finding use cases • How to start 👨‍🏫👨‍💻 Speakers: o Dion Morskieft, RPA Product Owner @Partou o Jack Klein-Schiphorst, Automation Developer @Tacstone Technology

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

UiPathCommunity

Vector Search -An Introduction in Oracle Database 23ai.pptx

Vector Search -An Introduction in Oracle Database 23ai.pptx

Vector Search -An Introduction in Oracle Database 23ai.pptx

Remote DBA Services

Passkeys: Developing APIs to enable passwordless authentication Cody Salas, Sr Developer Advocate | Solutions Architect - Yubico Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...

Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...

Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...

💉💊+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHABI}}+971581248768 +971581248768 Mtp-Kit (500MG) Prices » Dubai [(+971581248768**)] Abortion Pills For Sale In Dubai, UAE, Mifepristone and Misoprostol Tablets Available In Dubai, UAE CONTACT DR.Maya Whatsapp +971581248768 We Have Abortion Pills / Cytotec Tablets /Mifegest Kit Available in Dubai, Sharjah, Abudhabi, Ajman, Alain, Fujairah, Ras Al Khaimah, Umm Al Quwain, UAE, Buy cytotec in Dubai +971581248768''''Abortion Pills near me DUBAI | ABU DHABI|UAE. Price of Misoprostol, Cytotec” +971581248768' Dr.DEEM ''BUY ABORTION PILLS MIFEGEST KIT, MISOPROTONE, CYTOTEC PILLS IN DUBAI, ABU DHABI,UAE'' Contact me now via What's App…… abortion Pills Cytotec also available Oman Qatar Doha Saudi Arabia Bahrain Above all, Cytotec Abortion Pills are Available In Dubai / UAE, you will be very happy to do abortion in Dubai we are providing cytotec 200mg abortion pill in Dubai, UAE. Medication abortion offers an alternative to Surgical Abortion for women in the early weeks of pregnancy. We only offer abortion pills from 1 week-6 Months. We then advise you to use surgery if its beyond 6 months. Our Abu Dhabi, Ajman, Al Ain, Dubai, Fujairah, Ras Al Khaimah (RAK), Sharjah, Umm Al Quwain (UAQ) United Arab Emirates Abortion Clinic provides the safest and most advanced techniques for providing non-surgical, medical and surgical abortion methods for early through late second trimester, including the Abortion By Pill Procedure (RU 486, Mifeprex, Mifepristone, early options French Abortion Pill), Tamoxifen, Methotrexate and Cytotec (Misoprostol). The Abu Dhabi, United Arab Emirates Abortion Clinic performs Same Day Abortion Procedure using medications that are taken on the first day of the office visit and will cause the abortion to occur generally within 4 to 6 hours (as early as 30 minutes) for patients who are 3 to 12 weeks pregnant. When Mifepristone and Misoprostol are used, 50% of patients complete in 4 to 6 hours; 75% to 80% in 12 hours; and 90% in 24 hours. We use a regimen that allows for completion without the need for surgery 99% of the time. All advanced second trimester and late term pregnancies at our Tampa clinic (17 to 24 weeks or greater) can be completed within 24 hours or less 99% of the time without the need surgery. The procedure is completed with minimal to no complications. Our Women's Health Center located in Abu Dhabi, United Arab Emirates, uses the latest medications for medical abortions (RU-486, Mifeprex, Mifegyne, Mifepristone, early options French abortion pill), Methotrexate and Cytotec (Misoprostol). The safety standards of our Abu Dhabi, United Arab Emirates Abortion Doctors remain unparalleled. They consistently maintain the lowest complication rates throughout the nation. Our Physicians and staff are always available to answer questions and care for women in one of the most difficult times in their lives. The decision to have an abortion at the Abortion Cl

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...

?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@

How to Troubleshoot Apps for the Modern Connected Worker

How to Troubleshoot Apps for the Modern Connected Worker

How to Troubleshoot Apps for the Modern Connected Worker

Artificial Intelligence Chap.5 : Uncertainty

Artificial Intelligence Chap.5 : Uncertainty

Artificial Intelligence Chap.5 : Uncertainty

Khushali Kathiriya

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

The microservices honeymoon is over. When starting a new project or revamping a legacy monolith, teams started looking for alternatives to microservices. The Modular Monolith, or 'Modulith', is an architecture that reaps the benefits of (vertical) functional decoupling without the high costs associated with separate deployments. This talk will delve into the advantages and challenges of this progressive architecture, beginning with exploring the concept of a 'module', its internal structure, public API, and inter-module communication patterns. Supported by spring-modulith, the talk provides practical guidance on addressing the main challenges of a Modultith Architecture: finding and guarding module boundaries, data decoupling, and integration module-testing. You should not miss this talk if you are a software architect or tech lead seeking practical, scalable solutions. About the author With two decades of experience, Victor is a Java Champion working as a trainer for top companies in Europe. Five thousands developers in 120 companies attended his workshops, so he gets to debate every week the challenges that various projects struggle with. In return, Victor summarizes key points from these workshops in conference talks and online meetups for the European Software Crafters, the world’s largest developer community around architecture, refactoring, and testing. Discover how Victor can help you on victorrentea.ro : company training catalog, consultancy and YouTube playlists.

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024

[BuildWithAI] Introduction to Gemini.pdf

[BuildWithAI] Introduction to Gemini.pdf

[BuildWithAI] Introduction to Gemini.pdf

CNIC Information System with Pakdata Cf In Pakistan

CNIC Information System with Pakdata Cf In Pakistan

CNIC Information System with Pakdata Cf In Pakistan

DBX First Quarter 2024 Investor Presentation

DBX First Quarter 2024 Investor Presentation

DBX First Quarter 2024 Investor Presentation

Following the popularity of “Cloud Revolution: Exploring the New Wave of Serverless Spatial Data,” we’re thrilled to announce this much-anticipated encore webinar. In this sequel, we’ll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you’re building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Architecting Cloud Native Applications

Architecting Cloud Native Applications

Architecting Cloud Native Applications

The Good, the Bad and the Governed - Why is governance a dirty word? David O'Neill, Chief Operating Officer - APIContext Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

Exploring Multimodal Embeddings with Milvus

Exploring Multimodal Embeddings with Milvus

Exploring Multimodal Embeddings with Milvus

The value of a flexible API Management solution for Open Banking Steve Melan, Manager for IT Innovation and Architecture - State's and Saving's Bank of Luxembourg Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The value of a flexible API Management solution for O...

Apidays New York 2024 - The value of a flexible API Management solution for O...

Apidays New York 2024 - The value of a flexible API Management solution for O...

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

The presentation was made in “Web3 Fusion: Embracing AI and Beyond” is more than a conference; it's a journey into the heart of digital transformation. The conference a provided a platform where the future of technology meets practical application. This three-day hybrid event, set in the heart of innovation, served as a gateway to the latest trends and transformative discussions in AI, Blockchain, IoT, AR/VR, and their collective impact on the information space.

AI in Action: Real World Use Cases by Anitaraj

AI in Action: Real World Use Cases by Anitaraj

AI in Action: Real World Use Cases by Anitaraj

Keynote 2: APIs in 2030: The Risk of Technological Sleepwalk Paolo Malinverno, Growth Advisor - The Business of Technology Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...

Whatsapp Number Escorts Call girls 8617370543 Available 24x7 Mcleodganj Call Girls Service Offer Genuine VIP Model Escorts Call Girls in Your Budget. Mcleodganj Call Girls Service Provide Real Call Girls Number. Make Your Sexual Pleasure Memorable with Our Mcleodganj Call Girls at Affordable Price. Top VIP Escorts Call Girls, High Profile Independent Escorts Call Girls, Housewife Women Escorts Call Girl, College Girls Escorts Call Girls, Russian Escorts Call girls Service in Your Budget.

Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model

Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model

Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model

Kürzlich hochgeladen (20)

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

Vector Search -An Introduction in Oracle Database 23ai.pptx

Vector Search -An Introduction in Oracle Database 23ai.pptx

Vector Search -An Introduction in Oracle Database 23ai.pptx

Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...

Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...

Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...

How to Troubleshoot Apps for the Modern Connected Worker

How to Troubleshoot Apps for the Modern Connected Worker

How to Troubleshoot Apps for the Modern Connected Worker

Artificial Intelligence Chap.5 : Uncertainty

Artificial Intelligence Chap.5 : Uncertainty

Artificial Intelligence Chap.5 : Uncertainty

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024

[BuildWithAI] Introduction to Gemini.pdf

[BuildWithAI] Introduction to Gemini.pdf

[BuildWithAI] Introduction to Gemini.pdf

CNIC Information System with Pakdata Cf In Pakistan

CNIC Information System with Pakdata Cf In Pakistan

CNIC Information System with Pakdata Cf In Pakistan

DBX First Quarter 2024 Investor Presentation

DBX First Quarter 2024 Investor Presentation

DBX First Quarter 2024 Investor Presentation

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Architecting Cloud Native Applications

Architecting Cloud Native Applications

Architecting Cloud Native Applications

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

Exploring Multimodal Embeddings with Milvus

Exploring Multimodal Embeddings with Milvus

Exploring Multimodal Embeddings with Milvus

Apidays New York 2024 - The value of a flexible API Management solution for O...

Apidays New York 2024 - The value of a flexible API Management solution for O...

Apidays New York 2024 - The value of a flexible API Management solution for O...

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

AI in Action: Real World Use Cases by Anitaraj

AI in Action: Real World Use Cases by Anitaraj

AI in Action: Real World Use Cases by Anitaraj

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...

Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model

Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model

Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model

Event-driven Applications with Kafka, Micronaut, and AWS Lambda | Dave Klein, Confluent

1. @daveklein Event-driven Applications with Kafka, Micronaut, and AWS Lambda #kafkasummit @confluentinc

2. Apache Kafka • Event Streaming Platform • Core of a Growing Eco-system • Backbone of Event Driven Architectures • Greatest Invention Since the Wheel https://developer.confluent.io

3. MICRONAUT • Polyglot Application Framework for the JVM • Productivity features via Ahead of Time (AOT) Compilation • Small memory footprint and faster startup time • Familiar programming model https://micronaut.io/guides

4. AWS Lambda • Serverless Compute • Pay Only For Function Execution • Continuous Scaling https://aws.amazon.com/lambda/getting-started

5. Kafka Connect • Integrate with dozens of external systems • Consume and produce data with just configuration • AWS Lambda Sink Connector

6. Confluent Cloud • Fully managed Kafka, cloud-native Kafka service • Nothing to install, nothing to maintain • Fastest way to get started with Apache Kafka

7. Our Project Order Service HTTP Netty + Kafka OrderIdLambda Serverless Function OrderFulfillment Service Kafka https://github.com/confluentinc/demo-scene/tree/master/micronaut-lambda

8. https://github.com/confluentinc/demo-scene/tree/master/micronaut-lambda Thank You twitter.com/daveklein linkedin.com/in/daveklein19 dklein@confluent.io https://developer.confluent.io https://micronaut.io/guides https://aws.amazon.com/lambda/getting-started