SlideShare ist ein Scribd-Unternehmen logo
1 von 113
Downloaden Sie, um offline zu lesen
Asynchronous Epoch Commits
for
Fast & Reliable Data Stream Execution
in Apache Flink
Paris Carbone
@LADIS 2018
Apache Flink Committer
PhD Candidate @ KTH
<parisc@kth.se>
Data Stream Processing
Event Logs
Historic
Data
Event Logs
Files
Applications/Services
Long-Running
Dataflow Task
Execution
State
Example (Apache Flink)
Example (Apache Flink)
Kafka
Consumer
logical
graph
(operators)
Example (Apache Flink)
filter
keyBy
Kafka
Consumer
logical
graph
(operators)
Example (Apache Flink)
filter
keyBy
window aggregate
Kafka
Consumer
logical
graph
(operators)
Example (Apache Flink)
filter
keyBy
window aggregate
flatMap
Kafka
Consumer
logical
graph
(operators)
Example (Apache Flink)
Kafka
Producer
filter
keyBy
window aggregate
flatMap
Kafka
Consumer
logical
graph
(operators)
Kafka
Consumer filter window aggregate flatMap
Kafka
Producer
keyBy
a) Logical
Kafka
Consumer filter window aggregate flatMap
Kafka
Producer
keyBy
a) Logical
Kafka
Consumer filter
window
aggregate
flatmap
Kafka
Producer
keyBy
b) Optimised
Kafka
Consumer filter window aggregate flatMap
Kafka
Producer
keyBy
a) Logical
Kafka
Consumer filter
window
aggregate
flatmap
Kafka
Producer
keyBy
b) Optimised
Kafka
Consumer
Kafka
Consumer
filter
filter
window
aggregate
flatmap
window
aggregate
flatmap
Kafka
Producer
Kafka
Producer
……
……
……
[n]
[1] [1] [1] [1]
[n] [n] [n]
……
offsets
offsets
count
count
window
window
offsets
offsets
c) Physical
Task
Execution
message queuesmessage queues
How can we achieve reliable
processing at the presence of failures,
reconfiguration, migration etc.?
Task computation is not staged but
can go on indefinitely.
Process Model
p
Process Model
p
read/
write
sp
Process Model
p
pi
pj
Preconfigured
I/O Channels pk
pl
pm
Process Model
p
pi
pj
pk
pl
pm
Process Model
p
pi
pj
pk
pl
pm
m
Process Model
p
pi
pj
pk
pl
pm
m
Action:{ ⟨recv,m⟩}
Process Model
p
pi
pj
pk
pl
pm
m
sp→s’p
Action:{ ⟨recv,m⟩, ⟨sp→s’p⟩ }
Processing Model
p
pi
pj
pk
pl
pm
m
Action:{ ⟨recv,m⟩, ⟨sp→s’p⟩, ⟨send,mk⟩, ⟨send,ml⟩ }
s’p
mk
ml
Stream Process Graphs
Deterministic Input Streams Output Streams
sources sinks
volatile
state
DAG
Stream Process Graphs
Deterministic Input Streams Output Streams
sources sinks
volatile
state
System :{⇧, E}<latexit sha1_base64="rHJ3hHkZ/bcrazMY+bVo3k628zA=">AAAB/nicbVBNS8NAFHypX7V+RcWTl8UieJCSiKDHoggeK1hbaELZbDft0s0m7G6EEgL+FS8eFPHq7/Dmv3HT5qCtAwvDzHu82QkSzpR2nG+rsrS8srpWXa9tbG5t79i7ew8qTiWhbRLzWHYDrChngrY105x2E0lxFHDaCcbXhd95pFKxWNzrSUL9CA8FCxnB2kh9+8DLkNdip8iLsB4FQXaTIy/v23Wn4UyBFolbkjqUaPXtL28QkzSiQhOOleq5TqL9DEvNCKd5zUsVTTAZ4yHtGSpwRJWfTePn6NgoAxTG0jyh0VT9vZHhSKlJFJjJIqSa9wrxP6+X6vDSz5hIUk0FmR0KU450jIou0IBJSjSfGIKJZCYrIiMsMdGmsZopwZ3/8iJ5OGu4TsO9O683r8o6qnAIR3ACLlxAE26hBW0gkMEzvMKb9WS9WO/Wx2y0YpU7+/AH1ucP9MeU1Q==</latexit><latexit sha1_base64="rHJ3hHkZ/bcrazMY+bVo3k628zA=">AAAB/nicbVBNS8NAFHypX7V+RcWTl8UieJCSiKDHoggeK1hbaELZbDft0s0m7G6EEgL+FS8eFPHq7/Dmv3HT5qCtAwvDzHu82QkSzpR2nG+rsrS8srpWXa9tbG5t79i7ew8qTiWhbRLzWHYDrChngrY105x2E0lxFHDaCcbXhd95pFKxWNzrSUL9CA8FCxnB2kh9+8DLkNdip8iLsB4FQXaTIy/v23Wn4UyBFolbkjqUaPXtL28QkzSiQhOOleq5TqL9DEvNCKd5zUsVTTAZ4yHtGSpwRJWfTePn6NgoAxTG0jyh0VT9vZHhSKlJFJjJIqSa9wrxP6+X6vDSz5hIUk0FmR0KU450jIou0IBJSjSfGIKJZCYrIiMsMdGmsZopwZ3/8iJ5OGu4TsO9O683r8o6qnAIR3ACLlxAE26hBW0gkMEzvMKb9WS9WO/Wx2y0YpU7+/AH1ucP9MeU1Q==</latexit><latexit sha1_base64="rHJ3hHkZ/bcrazMY+bVo3k628zA=">AAAB/nicbVBNS8NAFHypX7V+RcWTl8UieJCSiKDHoggeK1hbaELZbDft0s0m7G6EEgL+FS8eFPHq7/Dmv3HT5qCtAwvDzHu82QkSzpR2nG+rsrS8srpWXa9tbG5t79i7ew8qTiWhbRLzWHYDrChngrY105x2E0lxFHDaCcbXhd95pFKxWNzrSUL9CA8FCxnB2kh9+8DLkNdip8iLsB4FQXaTIy/v23Wn4UyBFolbkjqUaPXtL28QkzSiQhOOleq5TqL9DEvNCKd5zUsVTTAZ4yHtGSpwRJWfTePn6NgoAxTG0jyh0VT9vZHhSKlJFJjJIqSa9wrxP6+X6vDSz5hIUk0FmR0KU450jIou0IBJSjSfGIKJZCYrIiMsMdGmsZopwZ3/8iJ5OGu4TsO9O683r8o6qnAIR3ACLlxAE26hBW0gkMEzvMKb9WS9WO/Wx2y0YpU7+/AH1ucP9MeU1Q==</latexit><latexit sha1_base64="rHJ3hHkZ/bcrazMY+bVo3k628zA=">AAAB/nicbVBNS8NAFHypX7V+RcWTl8UieJCSiKDHoggeK1hbaELZbDft0s0m7G6EEgL+FS8eFPHq7/Dmv3HT5qCtAwvDzHu82QkSzpR2nG+rsrS8srpWXa9tbG5t79i7ew8qTiWhbRLzWHYDrChngrY105x2E0lxFHDaCcbXhd95pFKxWNzrSUL9CA8FCxnB2kh9+8DLkNdip8iLsB4FQXaTIy/v23Wn4UyBFolbkjqUaPXtL28QkzSiQhOOleq5TqL9DEvNCKd5zUsVTTAZ4yHtGSpwRJWfTePn6NgoAxTG0jyh0VT9vZHhSKlJFJjJIqSa9wrxP6+X6vDSz5hIUk0FmR0KU450jIou0IBJSjSfGIKJZCYrIiMsMdGmsZopwZ3/8iJ5OGu4TsO9O683r8o6qnAIR3ACLlxAE26hBW0gkMEzvMKb9WS9WO/Wx2y0YpU7+/AH1ucP9MeU1Q==</latexit>
tasks channels
DAG
Stream Process Graphs
Deterministic Input Streams Output Streams
sources sinks
volatile
state
System :{⇧, E}<latexit sha1_base64="rHJ3hHkZ/bcrazMY+bVo3k628zA=">AAAB/nicbVBNS8NAFHypX7V+RcWTl8UieJCSiKDHoggeK1hbaELZbDft0s0m7G6EEgL+FS8eFPHq7/Dmv3HT5qCtAwvDzHu82QkSzpR2nG+rsrS8srpWXa9tbG5t79i7ew8qTiWhbRLzWHYDrChngrY105x2E0lxFHDaCcbXhd95pFKxWNzrSUL9CA8FCxnB2kh9+8DLkNdip8iLsB4FQXaTIy/v23Wn4UyBFolbkjqUaPXtL28QkzSiQhOOleq5TqL9DEvNCKd5zUsVTTAZ4yHtGSpwRJWfTePn6NgoAxTG0jyh0VT9vZHhSKlJFJjJIqSa9wrxP6+X6vDSz5hIUk0FmR0KU450jIou0IBJSjSfGIKJZCYrIiMsMdGmsZopwZ3/8iJ5OGu4TsO9O683r8o6qnAIR3ACLlxAE26hBW0gkMEzvMKb9WS9WO/Wx2y0YpU7+/AH1ucP9MeU1Q==</latexit><latexit sha1_base64="rHJ3hHkZ/bcrazMY+bVo3k628zA=">AAAB/nicbVBNS8NAFHypX7V+RcWTl8UieJCSiKDHoggeK1hbaELZbDft0s0m7G6EEgL+FS8eFPHq7/Dmv3HT5qCtAwvDzHu82QkSzpR2nG+rsrS8srpWXa9tbG5t79i7ew8qTiWhbRLzWHYDrChngrY105x2E0lxFHDaCcbXhd95pFKxWNzrSUL9CA8FCxnB2kh9+8DLkNdip8iLsB4FQXaTIy/v23Wn4UyBFolbkjqUaPXtL28QkzSiQhOOleq5TqL9DEvNCKd5zUsVTTAZ4yHtGSpwRJWfTePn6NgoAxTG0jyh0VT9vZHhSKlJFJjJIqSa9wrxP6+X6vDSz5hIUk0FmR0KU450jIou0IBJSjSfGIKJZCYrIiMsMdGmsZopwZ3/8iJ5OGu4TsO9O683r8o6qnAIR3ACLlxAE26hBW0gkMEzvMKb9WS9WO/Wx2y0YpU7+/AH1ucP9MeU1Q==</latexit><latexit sha1_base64="rHJ3hHkZ/bcrazMY+bVo3k628zA=">AAAB/nicbVBNS8NAFHypX7V+RcWTl8UieJCSiKDHoggeK1hbaELZbDft0s0m7G6EEgL+FS8eFPHq7/Dmv3HT5qCtAwvDzHu82QkSzpR2nG+rsrS8srpWXa9tbG5t79i7ew8qTiWhbRLzWHYDrChngrY105x2E0lxFHDaCcbXhd95pFKxWNzrSUL9CA8FCxnB2kh9+8DLkNdip8iLsB4FQXaTIy/v23Wn4UyBFolbkjqUaPXtL28QkzSiQhOOleq5TqL9DEvNCKd5zUsVTTAZ4yHtGSpwRJWfTePn6NgoAxTG0jyh0VT9vZHhSKlJFJjJIqSa9wrxP6+X6vDSz5hIUk0FmR0KU450jIou0IBJSjSfGIKJZCYrIiMsMdGmsZopwZ3/8iJ5OGu4TsO9O683r8o6qnAIR3ACLlxAE26hBW0gkMEzvMKb9WS9WO/Wx2y0YpU7+/AH1ucP9MeU1Q==</latexit><latexit sha1_base64="rHJ3hHkZ/bcrazMY+bVo3k628zA=">AAAB/nicbVBNS8NAFHypX7V+RcWTl8UieJCSiKDHoggeK1hbaELZbDft0s0m7G6EEgL+FS8eFPHq7/Dmv3HT5qCtAwvDzHu82QkSzpR2nG+rsrS8srpWXa9tbG5t79i7ew8qTiWhbRLzWHYDrChngrY105x2E0lxFHDaCcbXhd95pFKxWNzrSUL9CA8FCxnB2kh9+8DLkNdip8iLsB4FQXaTIy/v23Wn4UyBFolbkjqUaPXtL28QkzSiQhOOleq5TqL9DEvNCKd5zUsVTTAZ4yHtGSpwRJWfTePn6NgoAxTG0jyh0VT9vZHhSKlJFJjJIqSa9wrxP6+X6vDSz5hIUk0FmR0KU450jIou0IBJSjSfGIKJZCYrIiMsMdGmsZopwZ3/8iJ5OGu4TsO9O683r8o6qnAIR3ACLlxAE26hBW0gkMEzvMKb9WS9WO/Wx2y0YpU7+/AH1ucP9MeU1Q==</latexit>
tasks channels
DAG
System Execution : . . . ! {⇧⇤, M} ! {⇧0
⇤, M0
} ! . . .<latexit sha1_base64="Q2rqyrBQGVbgx8zAfIbupgkdkkQ=">AAACOnicbZDLSgMxFIYzXmu9jbp0EyxSESkzIuiy6MaN0IK9QKeUTJq2oZnJkJxRytDncuNTuHPhxoUibn0A0+kstO2BwM//nZPk/H4kuAbHebWWlldW19ZzG/nNre2dXXtvv65lrCirUSmkavpEM8FDVgMOgjUjxUjgC9bwhzcT3nhgSnMZ3sMoYu2A9EPe45SAsTp21RNdCRp7ivcHQJSSj9hLsFfhndMzfIe98QJUTFlxDqZXdeyCU3LSwvPCzUQBZVXp2C9eV9I4YCFQQbRuuU4E7YQo4FSwcd6LNYsIHZI+axkZkoDpdpKuPsbHxuninlTmhIBT9+9EQgKtR4FvOgMCAz3LJuYi1oqhd9VOeBjFwEI6fagXCwwST3LEXa4YBTEyglDFzV8xHRBFKJi08yYEd3bleVE/L7lOya1eFMrXWRw5dIiO0Aly0SUqo1tUQTVE0RN6Qx/o03q23q0v63vaumRlMwfoX1k/v6x6rCQ=</latexit><latexit sha1_base64="Q2rqyrBQGVbgx8zAfIbupgkdkkQ=">AAACOnicbZDLSgMxFIYzXmu9jbp0EyxSESkzIuiy6MaN0IK9QKeUTJq2oZnJkJxRytDncuNTuHPhxoUibn0A0+kstO2BwM//nZPk/H4kuAbHebWWlldW19ZzG/nNre2dXXtvv65lrCirUSmkavpEM8FDVgMOgjUjxUjgC9bwhzcT3nhgSnMZ3sMoYu2A9EPe45SAsTp21RNdCRp7ivcHQJSSj9hLsFfhndMzfIe98QJUTFlxDqZXdeyCU3LSwvPCzUQBZVXp2C9eV9I4YCFQQbRuuU4E7YQo4FSwcd6LNYsIHZI+axkZkoDpdpKuPsbHxuninlTmhIBT9+9EQgKtR4FvOgMCAz3LJuYi1oqhd9VOeBjFwEI6fagXCwwST3LEXa4YBTEyglDFzV8xHRBFKJi08yYEd3bleVE/L7lOya1eFMrXWRw5dIiO0Aly0SUqo1tUQTVE0RN6Qx/o03q23q0v63vaumRlMwfoX1k/v6x6rCQ=</latexit><latexit sha1_base64="Q2rqyrBQGVbgx8zAfIbupgkdkkQ=">AAACOnicbZDLSgMxFIYzXmu9jbp0EyxSESkzIuiy6MaN0IK9QKeUTJq2oZnJkJxRytDncuNTuHPhxoUibn0A0+kstO2BwM//nZPk/H4kuAbHebWWlldW19ZzG/nNre2dXXtvv65lrCirUSmkavpEM8FDVgMOgjUjxUjgC9bwhzcT3nhgSnMZ3sMoYu2A9EPe45SAsTp21RNdCRp7ivcHQJSSj9hLsFfhndMzfIe98QJUTFlxDqZXdeyCU3LSwvPCzUQBZVXp2C9eV9I4YCFQQbRuuU4E7YQo4FSwcd6LNYsIHZI+axkZkoDpdpKuPsbHxuninlTmhIBT9+9EQgKtR4FvOgMCAz3LJuYi1oqhd9VOeBjFwEI6fagXCwwST3LEXa4YBTEyglDFzV8xHRBFKJi08yYEd3bleVE/L7lOya1eFMrXWRw5dIiO0Aly0SUqo1tUQTVE0RN6Qx/o03q23q0v63vaumRlMwfoX1k/v6x6rCQ=</latexit><latexit sha1_base64="Q2rqyrBQGVbgx8zAfIbupgkdkkQ=">AAACOnicbZDLSgMxFIYzXmu9jbp0EyxSESkzIuiy6MaN0IK9QKeUTJq2oZnJkJxRytDncuNTuHPhxoUibn0A0+kstO2BwM//nZPk/H4kuAbHebWWlldW19ZzG/nNre2dXXtvv65lrCirUSmkavpEM8FDVgMOgjUjxUjgC9bwhzcT3nhgSnMZ3sMoYu2A9EPe45SAsTp21RNdCRp7ivcHQJSSj9hLsFfhndMzfIe98QJUTFlxDqZXdeyCU3LSwvPCzUQBZVXp2C9eV9I4YCFQQbRuuU4E7YQo4FSwcd6LNYsIHZI+axkZkoDpdpKuPsbHxuninlTmhIBT9+9EQgKtR4FvOgMCAz3LJuYi1oqhd9VOeBjFwEI6fagXCwwST3LEXa4YBTEyglDFzV8xHRBFKJi08yYEd3bleVE/L7lOya1eFMrXWRw5dIiO0Aly0SUqo1tUQTVE0RN6Qx/o03q23q0v63vaumRlMwfoX1k/v6x6rCQ=</latexit>
Stream Process Graphs
Deterministic Input Streams Output Streams
sources sinks
volatile
state
System :{⇧, E}<latexit sha1_base64="rHJ3hHkZ/bcrazMY+bVo3k628zA=">AAAB/nicbVBNS8NAFHypX7V+RcWTl8UieJCSiKDHoggeK1hbaELZbDft0s0m7G6EEgL+FS8eFPHq7/Dmv3HT5qCtAwvDzHu82QkSzpR2nG+rsrS8srpWXa9tbG5t79i7ew8qTiWhbRLzWHYDrChngrY105x2E0lxFHDaCcbXhd95pFKxWNzrSUL9CA8FCxnB2kh9+8DLkNdip8iLsB4FQXaTIy/v23Wn4UyBFolbkjqUaPXtL28QkzSiQhOOleq5TqL9DEvNCKd5zUsVTTAZ4yHtGSpwRJWfTePn6NgoAxTG0jyh0VT9vZHhSKlJFJjJIqSa9wrxP6+X6vDSz5hIUk0FmR0KU450jIou0IBJSjSfGIKJZCYrIiMsMdGmsZopwZ3/8iJ5OGu4TsO9O683r8o6qnAIR3ACLlxAE26hBW0gkMEzvMKb9WS9WO/Wx2y0YpU7+/AH1ucP9MeU1Q==</latexit><latexit sha1_base64="rHJ3hHkZ/bcrazMY+bVo3k628zA=">AAAB/nicbVBNS8NAFHypX7V+RcWTl8UieJCSiKDHoggeK1hbaELZbDft0s0m7G6EEgL+FS8eFPHq7/Dmv3HT5qCtAwvDzHu82QkSzpR2nG+rsrS8srpWXa9tbG5t79i7ew8qTiWhbRLzWHYDrChngrY105x2E0lxFHDaCcbXhd95pFKxWNzrSUL9CA8FCxnB2kh9+8DLkNdip8iLsB4FQXaTIy/v23Wn4UyBFolbkjqUaPXtL28QkzSiQhOOleq5TqL9DEvNCKd5zUsVTTAZ4yHtGSpwRJWfTePn6NgoAxTG0jyh0VT9vZHhSKlJFJjJIqSa9wrxP6+X6vDSz5hIUk0FmR0KU450jIou0IBJSjSfGIKJZCYrIiMsMdGmsZopwZ3/8iJ5OGu4TsO9O683r8o6qnAIR3ACLlxAE26hBW0gkMEzvMKb9WS9WO/Wx2y0YpU7+/AH1ucP9MeU1Q==</latexit><latexit sha1_base64="rHJ3hHkZ/bcrazMY+bVo3k628zA=">AAAB/nicbVBNS8NAFHypX7V+RcWTl8UieJCSiKDHoggeK1hbaELZbDft0s0m7G6EEgL+FS8eFPHq7/Dmv3HT5qCtAwvDzHu82QkSzpR2nG+rsrS8srpWXa9tbG5t79i7ew8qTiWhbRLzWHYDrChngrY105x2E0lxFHDaCcbXhd95pFKxWNzrSUL9CA8FCxnB2kh9+8DLkNdip8iLsB4FQXaTIy/v23Wn4UyBFolbkjqUaPXtL28QkzSiQhOOleq5TqL9DEvNCKd5zUsVTTAZ4yHtGSpwRJWfTePn6NgoAxTG0jyh0VT9vZHhSKlJFJjJIqSa9wrxP6+X6vDSz5hIUk0FmR0KU450jIou0IBJSjSfGIKJZCYrIiMsMdGmsZopwZ3/8iJ5OGu4TsO9O683r8o6qnAIR3ACLlxAE26hBW0gkMEzvMKb9WS9WO/Wx2y0YpU7+/AH1ucP9MeU1Q==</latexit><latexit sha1_base64="rHJ3hHkZ/bcrazMY+bVo3k628zA=">AAAB/nicbVBNS8NAFHypX7V+RcWTl8UieJCSiKDHoggeK1hbaELZbDft0s0m7G6EEgL+FS8eFPHq7/Dmv3HT5qCtAwvDzHu82QkSzpR2nG+rsrS8srpWXa9tbG5t79i7ew8qTiWhbRLzWHYDrChngrY105x2E0lxFHDaCcbXhd95pFKxWNzrSUL9CA8FCxnB2kh9+8DLkNdip8iLsB4FQXaTIy/v23Wn4UyBFolbkjqUaPXtL28QkzSiQhOOleq5TqL9DEvNCKd5zUsVTTAZ4yHtGSpwRJWfTePn6NgoAxTG0jyh0VT9vZHhSKlJFJjJIqSa9wrxP6+X6vDSz5hIUk0FmR0KU450jIou0IBJSjSfGIKJZCYrIiMsMdGmsZopwZ3/8iJ5OGu4TsO9O683r8o6qnAIR3ACLlxAE26hBW0gkMEzvMKb9WS9WO/Wx2y0YpU7+/AH1ucP9MeU1Q==</latexit>
tasks channels
DAG
System Execution : . . . ! {⇧⇤, M} ! {⇧0
⇤, M0
} ! . . .<latexit sha1_base64="Q2rqyrBQGVbgx8zAfIbupgkdkkQ=">AAACOnicbZDLSgMxFIYzXmu9jbp0EyxSESkzIuiy6MaN0IK9QKeUTJq2oZnJkJxRytDncuNTuHPhxoUibn0A0+kstO2BwM//nZPk/H4kuAbHebWWlldW19ZzG/nNre2dXXtvv65lrCirUSmkavpEM8FDVgMOgjUjxUjgC9bwhzcT3nhgSnMZ3sMoYu2A9EPe45SAsTp21RNdCRp7ivcHQJSSj9hLsFfhndMzfIe98QJUTFlxDqZXdeyCU3LSwvPCzUQBZVXp2C9eV9I4YCFQQbRuuU4E7YQo4FSwcd6LNYsIHZI+axkZkoDpdpKuPsbHxuninlTmhIBT9+9EQgKtR4FvOgMCAz3LJuYi1oqhd9VOeBjFwEI6fagXCwwST3LEXa4YBTEyglDFzV8xHRBFKJi08yYEd3bleVE/L7lOya1eFMrXWRw5dIiO0Aly0SUqo1tUQTVE0RN6Qx/o03q23q0v63vaumRlMwfoX1k/v6x6rCQ=</latexit><latexit sha1_base64="Q2rqyrBQGVbgx8zAfIbupgkdkkQ=">AAACOnicbZDLSgMxFIYzXmu9jbp0EyxSESkzIuiy6MaN0IK9QKeUTJq2oZnJkJxRytDncuNTuHPhxoUibn0A0+kstO2BwM//nZPk/H4kuAbHebWWlldW19ZzG/nNre2dXXtvv65lrCirUSmkavpEM8FDVgMOgjUjxUjgC9bwhzcT3nhgSnMZ3sMoYu2A9EPe45SAsTp21RNdCRp7ivcHQJSSj9hLsFfhndMzfIe98QJUTFlxDqZXdeyCU3LSwvPCzUQBZVXp2C9eV9I4YCFQQbRuuU4E7YQo4FSwcd6LNYsIHZI+axkZkoDpdpKuPsbHxuninlTmhIBT9+9EQgKtR4FvOgMCAz3LJuYi1oqhd9VOeBjFwEI6fagXCwwST3LEXa4YBTEyglDFzV8xHRBFKJi08yYEd3bleVE/L7lOya1eFMrXWRw5dIiO0Aly0SUqo1tUQTVE0RN6Qx/o03q23q0v63vaumRlMwfoX1k/v6x6rCQ=</latexit><latexit sha1_base64="Q2rqyrBQGVbgx8zAfIbupgkdkkQ=">AAACOnicbZDLSgMxFIYzXmu9jbp0EyxSESkzIuiy6MaN0IK9QKeUTJq2oZnJkJxRytDncuNTuHPhxoUibn0A0+kstO2BwM//nZPk/H4kuAbHebWWlldW19ZzG/nNre2dXXtvv65lrCirUSmkavpEM8FDVgMOgjUjxUjgC9bwhzcT3nhgSnMZ3sMoYu2A9EPe45SAsTp21RNdCRp7ivcHQJSSj9hLsFfhndMzfIe98QJUTFlxDqZXdeyCU3LSwvPCzUQBZVXp2C9eV9I4YCFQQbRuuU4E7YQo4FSwcd6LNYsIHZI+axkZkoDpdpKuPsbHxuninlTmhIBT9+9EQgKtR4FvOgMCAz3LJuYi1oqhd9VOeBjFwEI6fagXCwwST3LEXa4YBTEyglDFzV8xHRBFKJi08yYEd3bleVE/L7lOya1eFMrXWRw5dIiO0Aly0SUqo1tUQTVE0RN6Qx/o03q23q0v63vaumRlMwfoX1k/v6x6rCQ=</latexit><latexit sha1_base64="Q2rqyrBQGVbgx8zAfIbupgkdkkQ=">AAACOnicbZDLSgMxFIYzXmu9jbp0EyxSESkzIuiy6MaN0IK9QKeUTJq2oZnJkJxRytDncuNTuHPhxoUibn0A0+kstO2BwM//nZPk/H4kuAbHebWWlldW19ZzG/nNre2dXXtvv65lrCirUSmkavpEM8FDVgMOgjUjxUjgC9bwhzcT3nhgSnMZ3sMoYu2A9EPe45SAsTp21RNdCRp7ivcHQJSSj9hLsFfhndMzfIe98QJUTFlxDqZXdeyCU3LSwvPCzUQBZVXp2C9eV9I4YCFQQbRuuU4E7YQo4FSwcd6LNYsIHZI+axkZkoDpdpKuPsbHxuninlTmhIBT9+9EQgKtR4FvOgMCAz3LJuYi1oqhd9VOeBjFwEI6fagXCwwST3LEXa4YBTEyglDFzV8xHRBFKJi08yYEd3bleVE/L7lOya1eFMrXWRw5dIiO0Aly0SUqo1tUQTVE0RN6Qx/o03q23q0v63vaumRlMwfoX1k/v6x6rCQ=</latexit>
Task Actions
Stream Process Graphs
Deterministic Input Streams Output Streams
sources sinks
volatile
state
System :{⇧, E}<latexit sha1_base64="rHJ3hHkZ/bcrazMY+bVo3k628zA=">AAAB/nicbVBNS8NAFHypX7V+RcWTl8UieJCSiKDHoggeK1hbaELZbDft0s0m7G6EEgL+FS8eFPHq7/Dmv3HT5qCtAwvDzHu82QkSzpR2nG+rsrS8srpWXa9tbG5t79i7ew8qTiWhbRLzWHYDrChngrY105x2E0lxFHDaCcbXhd95pFKxWNzrSUL9CA8FCxnB2kh9+8DLkNdip8iLsB4FQXaTIy/v23Wn4UyBFolbkjqUaPXtL28QkzSiQhOOleq5TqL9DEvNCKd5zUsVTTAZ4yHtGSpwRJWfTePn6NgoAxTG0jyh0VT9vZHhSKlJFJjJIqSa9wrxP6+X6vDSz5hIUk0FmR0KU450jIou0IBJSjSfGIKJZCYrIiMsMdGmsZopwZ3/8iJ5OGu4TsO9O683r8o6qnAIR3ACLlxAE26hBW0gkMEzvMKb9WS9WO/Wx2y0YpU7+/AH1ucP9MeU1Q==</latexit><latexit sha1_base64="rHJ3hHkZ/bcrazMY+bVo3k628zA=">AAAB/nicbVBNS8NAFHypX7V+RcWTl8UieJCSiKDHoggeK1hbaELZbDft0s0m7G6EEgL+FS8eFPHq7/Dmv3HT5qCtAwvDzHu82QkSzpR2nG+rsrS8srpWXa9tbG5t79i7ew8qTiWhbRLzWHYDrChngrY105x2E0lxFHDaCcbXhd95pFKxWNzrSUL9CA8FCxnB2kh9+8DLkNdip8iLsB4FQXaTIy/v23Wn4UyBFolbkjqUaPXtL28QkzSiQhOOleq5TqL9DEvNCKd5zUsVTTAZ4yHtGSpwRJWfTePn6NgoAxTG0jyh0VT9vZHhSKlJFJjJIqSa9wrxP6+X6vDSz5hIUk0FmR0KU450jIou0IBJSjSfGIKJZCYrIiMsMdGmsZopwZ3/8iJ5OGu4TsO9O683r8o6qnAIR3ACLlxAE26hBW0gkMEzvMKb9WS9WO/Wx2y0YpU7+/AH1ucP9MeU1Q==</latexit><latexit sha1_base64="rHJ3hHkZ/bcrazMY+bVo3k628zA=">AAAB/nicbVBNS8NAFHypX7V+RcWTl8UieJCSiKDHoggeK1hbaELZbDft0s0m7G6EEgL+FS8eFPHq7/Dmv3HT5qCtAwvDzHu82QkSzpR2nG+rsrS8srpWXa9tbG5t79i7ew8qTiWhbRLzWHYDrChngrY105x2E0lxFHDaCcbXhd95pFKxWNzrSUL9CA8FCxnB2kh9+8DLkNdip8iLsB4FQXaTIy/v23Wn4UyBFolbkjqUaPXtL28QkzSiQhOOleq5TqL9DEvNCKd5zUsVTTAZ4yHtGSpwRJWfTePn6NgoAxTG0jyh0VT9vZHhSKlJFJjJIqSa9wrxP6+X6vDSz5hIUk0FmR0KU450jIou0IBJSjSfGIKJZCYrIiMsMdGmsZopwZ3/8iJ5OGu4TsO9O683r8o6qnAIR3ACLlxAE26hBW0gkMEzvMKb9WS9WO/Wx2y0YpU7+/AH1ucP9MeU1Q==</latexit><latexit sha1_base64="rHJ3hHkZ/bcrazMY+bVo3k628zA=">AAAB/nicbVBNS8NAFHypX7V+RcWTl8UieJCSiKDHoggeK1hbaELZbDft0s0m7G6EEgL+FS8eFPHq7/Dmv3HT5qCtAwvDzHu82QkSzpR2nG+rsrS8srpWXa9tbG5t79i7ew8qTiWhbRLzWHYDrChngrY105x2E0lxFHDaCcbXhd95pFKxWNzrSUL9CA8FCxnB2kh9+8DLkNdip8iLsB4FQXaTIy/v23Wn4UyBFolbkjqUaPXtL28QkzSiQhOOleq5TqL9DEvNCKd5zUsVTTAZ4yHtGSpwRJWfTePn6NgoAxTG0jyh0VT9vZHhSKlJFJjJIqSa9wrxP6+X6vDSz5hIUk0FmR0KU450jIou0IBJSjSfGIKJZCYrIiMsMdGmsZopwZ3/8iJ5OGu4TsO9O683r8o6qnAIR3ACLlxAE26hBW0gkMEzvMKb9WS9WO/Wx2y0YpU7+/AH1ucP9MeU1Q==</latexit>
tasks channels
DAG
System Execution : . . . ! {⇧⇤, M} ! {⇧0
⇤, M0
} ! . . .<latexit sha1_base64="Q2rqyrBQGVbgx8zAfIbupgkdkkQ=">AAACOnicbZDLSgMxFIYzXmu9jbp0EyxSESkzIuiy6MaN0IK9QKeUTJq2oZnJkJxRytDncuNTuHPhxoUibn0A0+kstO2BwM//nZPk/H4kuAbHebWWlldW19ZzG/nNre2dXXtvv65lrCirUSmkavpEM8FDVgMOgjUjxUjgC9bwhzcT3nhgSnMZ3sMoYu2A9EPe45SAsTp21RNdCRp7ivcHQJSSj9hLsFfhndMzfIe98QJUTFlxDqZXdeyCU3LSwvPCzUQBZVXp2C9eV9I4YCFQQbRuuU4E7YQo4FSwcd6LNYsIHZI+axkZkoDpdpKuPsbHxuninlTmhIBT9+9EQgKtR4FvOgMCAz3LJuYi1oqhd9VOeBjFwEI6fagXCwwST3LEXa4YBTEyglDFzV8xHRBFKJi08yYEd3bleVE/L7lOya1eFMrXWRw5dIiO0Aly0SUqo1tUQTVE0RN6Qx/o03q23q0v63vaumRlMwfoX1k/v6x6rCQ=</latexit><latexit sha1_base64="Q2rqyrBQGVbgx8zAfIbupgkdkkQ=">AAACOnicbZDLSgMxFIYzXmu9jbp0EyxSESkzIuiy6MaN0IK9QKeUTJq2oZnJkJxRytDncuNTuHPhxoUibn0A0+kstO2BwM//nZPk/H4kuAbHebWWlldW19ZzG/nNre2dXXtvv65lrCirUSmkavpEM8FDVgMOgjUjxUjgC9bwhzcT3nhgSnMZ3sMoYu2A9EPe45SAsTp21RNdCRp7ivcHQJSSj9hLsFfhndMzfIe98QJUTFlxDqZXdeyCU3LSwvPCzUQBZVXp2C9eV9I4YCFQQbRuuU4E7YQo4FSwcd6LNYsIHZI+axkZkoDpdpKuPsbHxuninlTmhIBT9+9EQgKtR4FvOgMCAz3LJuYi1oqhd9VOeBjFwEI6fagXCwwST3LEXa4YBTEyglDFzV8xHRBFKJi08yYEd3bleVE/L7lOya1eFMrXWRw5dIiO0Aly0SUqo1tUQTVE0RN6Qx/o03q23q0v63vaumRlMwfoX1k/v6x6rCQ=</latexit><latexit sha1_base64="Q2rqyrBQGVbgx8zAfIbupgkdkkQ=">AAACOnicbZDLSgMxFIYzXmu9jbp0EyxSESkzIuiy6MaN0IK9QKeUTJq2oZnJkJxRytDncuNTuHPhxoUibn0A0+kstO2BwM//nZPk/H4kuAbHebWWlldW19ZzG/nNre2dXXtvv65lrCirUSmkavpEM8FDVgMOgjUjxUjgC9bwhzcT3nhgSnMZ3sMoYu2A9EPe45SAsTp21RNdCRp7ivcHQJSSj9hLsFfhndMzfIe98QJUTFlxDqZXdeyCU3LSwvPCzUQBZVXp2C9eV9I4YCFQQbRuuU4E7YQo4FSwcd6LNYsIHZI+axkZkoDpdpKuPsbHxuninlTmhIBT9+9EQgKtR4FvOgMCAz3LJuYi1oqhd9VOeBjFwEI6fagXCwwST3LEXa4YBTEyglDFzV8xHRBFKJi08yYEd3bleVE/L7lOya1eFMrXWRw5dIiO0Aly0SUqo1tUQTVE0RN6Qx/o03q23q0v63vaumRlMwfoX1k/v6x6rCQ=</latexit><latexit sha1_base64="Q2rqyrBQGVbgx8zAfIbupgkdkkQ=">AAACOnicbZDLSgMxFIYzXmu9jbp0EyxSESkzIuiy6MaN0IK9QKeUTJq2oZnJkJxRytDncuNTuHPhxoUibn0A0+kstO2BwM//nZPk/H4kuAbHebWWlldW19ZzG/nNre2dXXtvv65lrCirUSmkavpEM8FDVgMOgjUjxUjgC9bwhzcT3nhgSnMZ3sMoYu2A9EPe45SAsTp21RNdCRp7ivcHQJSSj9hLsFfhndMzfIe98QJUTFlxDqZXdeyCU3LSwvPCzUQBZVXp2C9eV9I4YCFQQbRuuU4E7YQo4FSwcd6LNYsIHZI+axkZkoDpdpKuPsbHxuninlTmhIBT9+9EQgKtR4FvOgMCAz3LJuYi1oqhd9VOeBjFwEI6fagXCwwST3LEXa4YBTEyglDFzV8xHRBFKJi08yYEd3bleVE/L7lOya1eFMrXWRw5dIiO0Aly0SUqo1tUQTVE0RN6Qx/o03q23q0v63vaumRlMwfoX1k/v6x6rCQ=</latexit>
System Configurations (states, messages in-transit)
Fault Tolerance
p
pi
pj
pk
pl
pm
m
s’p
mk
ml
Fault Tolerance
p
pi
pj
pk
pl
pm
mk
ml
fail
Fail Recovery
p
pi
pj
pk
pl
pm
mk
ml
recover
• Has m been fully processed?
• Have mk and ml been delivered?
??
Reliable Stream Processing
• Existing approaches* typically adopt a fail recovery model to amend
individual task execution and reproduce computations that were possibly lost
• Complex Workarounds (e.g., duplicate elimination, input logging, acks)
• Strong Assumptions (idempotent operations, key vs task level causal order)
• External State Management (transactional external commits per action)
*MillWheel: Fault- tolerant stream processing at internet scale,” in VLDB, 2013.
Integrating scale out and fault tolerance in stream processing using operator state management. in SIGMOD 2013
Fault-tolerance and high availability in data stream management systems. in Encyclopedia of Database Systems 2009
Fault-tolerance in the Borealis distributed stream processing system, in SIGMOD 2005

Fault Tolerance is not enough
• Are output and states always correct?
• Can we reconfigure the system without losing computation?
• Can applications migrate without loss?
• Is external state access isolation possible?
Fault Tolerance is not enough
• Are output and states always correct?
• Can we reconfigure the system without losing computation?
• Can applications migrate without loss?
• Is external state access isolation possible?
• We need a system-wide coarse-grained commit mechanism.
Epoch-Based Stream Execution
The Intuition
task
statesdeterministic
input streams
Epoch-Based Stream Execution
The Intuition
task
statesdeterministic
input streams
stream
processing
system
Epoch-Based Stream Execution
The Intuition
task
statesdeterministic
input streams
divide computation
into epochs
stream
processing
system
Epoch-Based Stream Execution
The Intuition
task
statesdeterministic
input streams
system
configuration
(states) after
completing an
epoch
divide computation
into epochs
stream
processing
system
Epoch-Based Stream Execution
The Intuition
task
statesdeterministic
input streams
system
configuration
(states) after
completing an
epoch
divide computation
into epochs
stream
processing
system success: commit system configuration
failure: abort and start from previous epoch
Epoch-Based Stream Execution
The Intuition
Epoch-Based Stream Execution
Logged Input Committed Output
Stable
Storage
⇧epi<latexit sha1_base64="Xl8x16xSZsKgLM7knEkWZX4JtTU=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCyohNm1G94bbcOdAq8UrSgBLdqP4VDDKSp1QYwrHWfc+VJiywMoxwOq0FuaYSkzEe0r6lAqdUh8X85ik6s8oAJZmyJQyaq78nCpxqPUlj25liM9LL3kz8z+vnJrkMCyZkbqggi0VJzpHJ0CwANGCKEsMnlmCimL0VkRFWmBgbU82G4C2/vEr8duuq5d21G53rMo0qnMApnIMHF9CBW+iCDwQkPMMrvDm58+K8Ox+L1opTzhzDHzifP9J+kRU=</latexit><latexit sha1_base64="Xl8x16xSZsKgLM7knEkWZX4JtTU=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCyohNm1G94bbcOdAq8UrSgBLdqP4VDDKSp1QYwrHWfc+VJiywMoxwOq0FuaYSkzEe0r6lAqdUh8X85ik6s8oAJZmyJQyaq78nCpxqPUlj25liM9LL3kz8z+vnJrkMCyZkbqggi0VJzpHJ0CwANGCKEsMnlmCimL0VkRFWmBgbU82G4C2/vEr8duuq5d21G53rMo0qnMApnIMHF9CBW+iCDwQkPMMrvDm58+K8Ox+L1opTzhzDHzifP9J+kRU=</latexit><latexit sha1_base64="Xl8x16xSZsKgLM7knEkWZX4JtTU=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCyohNm1G94bbcOdAq8UrSgBLdqP4VDDKSp1QYwrHWfc+VJiywMoxwOq0FuaYSkzEe0r6lAqdUh8X85ik6s8oAJZmyJQyaq78nCpxqPUlj25liM9LL3kz8z+vnJrkMCyZkbqggi0VJzpHJ0CwANGCKEsMnlmCimL0VkRFWmBgbU82G4C2/vEr8duuq5d21G53rMo0qnMApnIMHF9CBW+iCDwQkPMMrvDm58+K8Ox+L1opTzhzDHzifP9J+kRU=</latexit><latexit sha1_base64="Xl8x16xSZsKgLM7knEkWZX4JtTU=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCyohNm1G94bbcOdAq8UrSgBLdqP4VDDKSp1QYwrHWfc+VJiywMoxwOq0FuaYSkzEe0r6lAqdUh8X85ik6s8oAJZmyJQyaq78nCpxqPUlj25liM9LL3kz8z+vnJrkMCyZkbqggi0VJzpHJ0CwANGCKEsMnlmCimL0VkRFWmBgbU82G4C2/vEr8duuq5d21G53rMo0qnMApnIMHF9CBW+iCDwQkPMMrvDm58+K8Ox+L1opTzhzDHzifP9J+kRU=</latexit>
⇧ep1<latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit><latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit><latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit><latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit>
⇧ep2<latexit sha1_base64="vzNrz845O3CFc8UPEV9DQuQriPs=">AAAB8nicbVA9T8MwEHXKVylfBUYWixaJqUq6AFsFC2ORCFRqoshxL61Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuKPg045nqxUQDZwJ8wwyHnlRA0pjDYzy+mfmPT6A0y8S9mUgIUzIULGGUGCsFzaDLogJk1J42o3rDbblz4FXilaSBSnSj+lcwyGiegjCUE637nitNWBBlGOUwrQW5BknomAyhb6kgKeiwmN88xWdWGeAkU7aEwXP190RBUq0naWw7U2JGetmbif95/dwkl2HBhMwNCLpYlOQcmwzPAsADpoAaPrGEUMXsrZiOiCLU2JhqNgRv+eVV4rdbVy3vrt3oXJdpVNEJOkXnyEMXqINuURf5iCKJntErenNy58V5dz4WrRWnnDlGf+B8/gB+65De</latexit><latexit sha1_base64="vzNrz845O3CFc8UPEV9DQuQriPs=">AAAB8nicbVA9T8MwEHXKVylfBUYWixaJqUq6AFsFC2ORCFRqoshxL61Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuKPg045nqxUQDZwJ8wwyHnlRA0pjDYzy+mfmPT6A0y8S9mUgIUzIULGGUGCsFzaDLogJk1J42o3rDbblz4FXilaSBSnSj+lcwyGiegjCUE637nitNWBBlGOUwrQW5BknomAyhb6kgKeiwmN88xWdWGeAkU7aEwXP190RBUq0naWw7U2JGetmbif95/dwkl2HBhMwNCLpYlOQcmwzPAsADpoAaPrGEUMXsrZiOiCLU2JhqNgRv+eVV4rdbVy3vrt3oXJdpVNEJOkXnyEMXqINuURf5iCKJntErenNy58V5dz4WrRWnnDlGf+B8/gB+65De</latexit><latexit sha1_base64="vzNrz845O3CFc8UPEV9DQuQriPs=">AAAB8nicbVA9T8MwEHXKVylfBUYWixaJqUq6AFsFC2ORCFRqoshxL61Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuKPg045nqxUQDZwJ8wwyHnlRA0pjDYzy+mfmPT6A0y8S9mUgIUzIULGGUGCsFzaDLogJk1J42o3rDbblz4FXilaSBSnSj+lcwyGiegjCUE637nitNWBBlGOUwrQW5BknomAyhb6kgKeiwmN88xWdWGeAkU7aEwXP190RBUq0naWw7U2JGetmbif95/dwkl2HBhMwNCLpYlOQcmwzPAsADpoAaPrGEUMXsrZiOiCLU2JhqNgRv+eVV4rdbVy3vrt3oXJdpVNEJOkXnyEMXqINuURf5iCKJntErenNy58V5dz4WrRWnnDlGf+B8/gB+65De</latexit><latexit sha1_base64="vzNrz845O3CFc8UPEV9DQuQriPs=">AAAB8nicbVA9T8MwEHXKVylfBUYWixaJqUq6AFsFC2ORCFRqoshxL61Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuKPg045nqxUQDZwJ8wwyHnlRA0pjDYzy+mfmPT6A0y8S9mUgIUzIULGGUGCsFzaDLogJk1J42o3rDbblz4FXilaSBSnSj+lcwyGiegjCUE637nitNWBBlGOUwrQW5BknomAyhb6kgKeiwmN88xWdWGeAkU7aEwXP190RBUq0naWw7U2JGetmbif95/dwkl2HBhMwNCLpYlOQcmwzPAsADpoAaPrGEUMXsrZiOiCLU2JhqNgRv+eVV4rdbVy3vrt3oXJdpVNEJOkXnyEMXqINuURf5iCKJntErenNy58V5dz4WrRWnnDlGf+B8/gB+65De</latexit>
⇧ep3<latexit sha1_base64="7blVEvKqOiPeUWxaUZ2eNhSg02g=">AAAB8nicbVBNT8JAEJ3iF+IX6tHLRjDxRFo8qDeiF4+YWCGhTbNdFtiw3W52tyak4W948aDGq7/Gm//GBXpQ8CWTvLw3k5l5seRMG9f9dkpr6xubW+Xtys7u3v5B9fDoUaeZItQnKU9VN8aaciaob5jhtCsVxUnMaSce3878zhNVmqXiwUwkDRM8FGzACDZWCupBm0U5ldHFtB5Va27DnQOtEq8gNSjQjqpfQT8lWUKFIRxr3fNcacIcK8MIp9NKkGkqMRnjIe1ZKnBCdZjPb56iM6v00SBVtoRBc/X3RI4TrSdJbDsTbEZ62ZuJ/3m9zAyuwpwJmRkqyGLRIOPIpGgWAOozRYnhE0swUczeisgIK0yMjaliQ/CWX14lfrNx3fDum7XWTZFGGU7gFM7Bg0towR20wQcCEp7hFd6czHlx3p2PRWvJKWaO4Q+czx+AcJDf</latexit><latexit sha1_base64="7blVEvKqOiPeUWxaUZ2eNhSg02g=">AAAB8nicbVBNT8JAEJ3iF+IX6tHLRjDxRFo8qDeiF4+YWCGhTbNdFtiw3W52tyak4W948aDGq7/Gm//GBXpQ8CWTvLw3k5l5seRMG9f9dkpr6xubW+Xtys7u3v5B9fDoUaeZItQnKU9VN8aaciaob5jhtCsVxUnMaSce3878zhNVmqXiwUwkDRM8FGzACDZWCupBm0U5ldHFtB5Va27DnQOtEq8gNSjQjqpfQT8lWUKFIRxr3fNcacIcK8MIp9NKkGkqMRnjIe1ZKnBCdZjPb56iM6v00SBVtoRBc/X3RI4TrSdJbDsTbEZ62ZuJ/3m9zAyuwpwJmRkqyGLRIOPIpGgWAOozRYnhE0swUczeisgIK0yMjaliQ/CWX14lfrNx3fDum7XWTZFGGU7gFM7Bg0towR20wQcCEp7hFd6czHlx3p2PRWvJKWaO4Q+czx+AcJDf</latexit><latexit sha1_base64="7blVEvKqOiPeUWxaUZ2eNhSg02g=">AAAB8nicbVBNT8JAEJ3iF+IX6tHLRjDxRFo8qDeiF4+YWCGhTbNdFtiw3W52tyak4W948aDGq7/Gm//GBXpQ8CWTvLw3k5l5seRMG9f9dkpr6xubW+Xtys7u3v5B9fDoUaeZItQnKU9VN8aaciaob5jhtCsVxUnMaSce3878zhNVmqXiwUwkDRM8FGzACDZWCupBm0U5ldHFtB5Va27DnQOtEq8gNSjQjqpfQT8lWUKFIRxr3fNcacIcK8MIp9NKkGkqMRnjIe1ZKnBCdZjPb56iM6v00SBVtoRBc/X3RI4TrSdJbDsTbEZ62ZuJ/3m9zAyuwpwJmRkqyGLRIOPIpGgWAOozRYnhE0swUczeisgIK0yMjaliQ/CWX14lfrNx3fDum7XWTZFGGU7gFM7Bg0towR20wQcCEp7hFd6czHlx3p2PRWvJKWaO4Q+czx+AcJDf</latexit><latexit sha1_base64="7blVEvKqOiPeUWxaUZ2eNhSg02g=">AAAB8nicbVBNT8JAEJ3iF+IX6tHLRjDxRFo8qDeiF4+YWCGhTbNdFtiw3W52tyak4W948aDGq7/Gm//GBXpQ8CWTvLw3k5l5seRMG9f9dkpr6xubW+Xtys7u3v5B9fDoUaeZItQnKU9VN8aaciaob5jhtCsVxUnMaSce3878zhNVmqXiwUwkDRM8FGzACDZWCupBm0U5ldHFtB5Va27DnQOtEq8gNSjQjqpfQT8lWUKFIRxr3fNcacIcK8MIp9NKkGkqMRnjIe1ZKnBCdZjPb56iM6v00SBVtoRBc/X3RI4TrSdJbDsTbEZ62ZuJ/3m9zAyuwpwJmRkqyGLRIOPIpGgWAOozRYnhE0swUczeisgIK0yMjaliQ/CWX14lfrNx3fDum7XWTZFGGU7gFM7Bg0towR20wQcCEp7hFd6czHlx3p2PRWvJKWaO4Q+czx+AcJDf</latexit>
ep1<latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit>
ep2<latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit><latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit><latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit><latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit>
ep3<latexit sha1_base64="CaMgem4iJdX/WSpcPmWVDNfHtLQ=">AAAB7HicbVA9TwJBEN3DL8Qv1NJmI5hYkTss1I5oY4mJByRwIXvLHKzs7V5290zIhf9gY6HG1h9k579xgSsUfMkkL+/NZGZemHCmjet+O4W19Y3NreJ2aWd3b/+gfHjU0jJVFHwquVSdkGjgTIBvmOHQSRSQOOTQDse3M7/9BEozKR7MJIEgJkPBIkaJsVKrCkn/otovV9yaOwdeJV5OKihHs1/+6g0kTWMQhnKidddzExNkRBlGOUxLvVRDQuiYDKFrqSAx6CCbXzvFZ1YZ4EgqW8Lgufp7IiOx1pM4tJ0xMSO97M3E/7xuaqKrIGMiSQ0IulgUpRwbiWev4wFTQA2fWEKoYvZWTEdEEWpsQCUbgrf88irx67XrmndfrzRu8jSK6ASdonPkoUvUQHeoiXxE0SN6Rq/ozZHOi/PufCxaC04+c4z+wPn8AedOjjc=</latexit><latexit sha1_base64="CaMgem4iJdX/WSpcPmWVDNfHtLQ=">AAAB7HicbVA9TwJBEN3DL8Qv1NJmI5hYkTss1I5oY4mJByRwIXvLHKzs7V5290zIhf9gY6HG1h9k579xgSsUfMkkL+/NZGZemHCmjet+O4W19Y3NreJ2aWd3b/+gfHjU0jJVFHwquVSdkGjgTIBvmOHQSRSQOOTQDse3M7/9BEozKR7MJIEgJkPBIkaJsVKrCkn/otovV9yaOwdeJV5OKihHs1/+6g0kTWMQhnKidddzExNkRBlGOUxLvVRDQuiYDKFrqSAx6CCbXzvFZ1YZ4EgqW8Lgufp7IiOx1pM4tJ0xMSO97M3E/7xuaqKrIGMiSQ0IulgUpRwbiWev4wFTQA2fWEKoYvZWTEdEEWpsQCUbgrf88irx67XrmndfrzRu8jSK6ASdonPkoUvUQHeoiXxE0SN6Rq/ozZHOi/PufCxaC04+c4z+wPn8AedOjjc=</latexit><latexit sha1_base64="CaMgem4iJdX/WSpcPmWVDNfHtLQ=">AAAB7HicbVA9TwJBEN3DL8Qv1NJmI5hYkTss1I5oY4mJByRwIXvLHKzs7V5290zIhf9gY6HG1h9k579xgSsUfMkkL+/NZGZemHCmjet+O4W19Y3NreJ2aWd3b/+gfHjU0jJVFHwquVSdkGjgTIBvmOHQSRSQOOTQDse3M7/9BEozKR7MJIEgJkPBIkaJsVKrCkn/otovV9yaOwdeJV5OKihHs1/+6g0kTWMQhnKidddzExNkRBlGOUxLvVRDQuiYDKFrqSAx6CCbXzvFZ1YZ4EgqW8Lgufp7IiOx1pM4tJ0xMSO97M3E/7xuaqKrIGMiSQ0IulgUpRwbiWev4wFTQA2fWEKoYvZWTEdEEWpsQCUbgrf88irx67XrmndfrzRu8jSK6ASdonPkoUvUQHeoiXxE0SN6Rq/ozZHOi/PufCxaC04+c4z+wPn8AedOjjc=</latexit><latexit sha1_base64="CaMgem4iJdX/WSpcPmWVDNfHtLQ=">AAAB7HicbVA9TwJBEN3DL8Qv1NJmI5hYkTss1I5oY4mJByRwIXvLHKzs7V5290zIhf9gY6HG1h9k579xgSsUfMkkL+/NZGZemHCmjet+O4W19Y3NreJ2aWd3b/+gfHjU0jJVFHwquVSdkGjgTIBvmOHQSRSQOOTQDse3M7/9BEozKR7MJIEgJkPBIkaJsVKrCkn/otovV9yaOwdeJV5OKihHs1/+6g0kTWMQhnKidddzExNkRBlGOUxLvVRDQuiYDKFrqSAx6CCbXzvFZ1YZ4EgqW8Lgufp7IiOx1pM4tJ0xMSO97M3E/7xuaqKrIGMiSQ0IulgUpRwbiWev4wFTQA2fWEKoYvZWTEdEEWpsQCUbgrf88irx67XrmndfrzRu8jSK6ASdonPkoUvUQHeoiXxE0SN6Rq/ozZHOi/PufCxaC04+c4z+wPn8AedOjjc=</latexit>
ep1<latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit>
ep2<latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit><latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit><latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit><latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit>
ep3<latexit sha1_base64="CaMgem4iJdX/WSpcPmWVDNfHtLQ=">AAAB7HicbVA9TwJBEN3DL8Qv1NJmI5hYkTss1I5oY4mJByRwIXvLHKzs7V5290zIhf9gY6HG1h9k579xgSsUfMkkL+/NZGZemHCmjet+O4W19Y3NreJ2aWd3b/+gfHjU0jJVFHwquVSdkGjgTIBvmOHQSRSQOOTQDse3M7/9BEozKR7MJIEgJkPBIkaJsVKrCkn/otovV9yaOwdeJV5OKihHs1/+6g0kTWMQhnKidddzExNkRBlGOUxLvVRDQuiYDKFrqSAx6CCbXzvFZ1YZ4EgqW8Lgufp7IiOx1pM4tJ0xMSO97M3E/7xuaqKrIGMiSQ0IulgUpRwbiWev4wFTQA2fWEKoYvZWTEdEEWpsQCUbgrf88irx67XrmndfrzRu8jSK6ASdonPkoUvUQHeoiXxE0SN6Rq/ozZHOi/PufCxaC04+c4z+wPn8AedOjjc=</latexit><latexit sha1_base64="CaMgem4iJdX/WSpcPmWVDNfHtLQ=">AAAB7HicbVA9TwJBEN3DL8Qv1NJmI5hYkTss1I5oY4mJByRwIXvLHKzs7V5290zIhf9gY6HG1h9k579xgSsUfMkkL+/NZGZemHCmjet+O4W19Y3NreJ2aWd3b/+gfHjU0jJVFHwquVSdkGjgTIBvmOHQSRSQOOTQDse3M7/9BEozKR7MJIEgJkPBIkaJsVKrCkn/otovV9yaOwdeJV5OKihHs1/+6g0kTWMQhnKidddzExNkRBlGOUxLvVRDQuiYDKFrqSAx6CCbXzvFZ1YZ4EgqW8Lgufp7IiOx1pM4tJ0xMSO97M3E/7xuaqKrIGMiSQ0IulgUpRwbiWev4wFTQA2fWEKoYvZWTEdEEWpsQCUbgrf88irx67XrmndfrzRu8jSK6ASdonPkoUvUQHeoiXxE0SN6Rq/ozZHOi/PufCxaC04+c4z+wPn8AedOjjc=</latexit><latexit sha1_base64="CaMgem4iJdX/WSpcPmWVDNfHtLQ=">AAAB7HicbVA9TwJBEN3DL8Qv1NJmI5hYkTss1I5oY4mJByRwIXvLHKzs7V5290zIhf9gY6HG1h9k579xgSsUfMkkL+/NZGZemHCmjet+O4W19Y3NreJ2aWd3b/+gfHjU0jJVFHwquVSdkGjgTIBvmOHQSRSQOOTQDse3M7/9BEozKR7MJIEgJkPBIkaJsVKrCkn/otovV9yaOwdeJV5OKihHs1/+6g0kTWMQhnKidddzExNkRBlGOUxLvVRDQuiYDKFrqSAx6CCbXzvFZ1YZ4EgqW8Lgufp7IiOx1pM4tJ0xMSO97M3E/7xuaqKrIGMiSQ0IulgUpRwbiWev4wFTQA2fWEKoYvZWTEdEEWpsQCUbgrf88irx67XrmndfrzRu8jSK6ASdonPkoUvUQHeoiXxE0SN6Rq/ozZHOi/PufCxaC04+c4z+wPn8AedOjjc=</latexit><latexit sha1_base64="CaMgem4iJdX/WSpcPmWVDNfHtLQ=">AAAB7HicbVA9TwJBEN3DL8Qv1NJmI5hYkTss1I5oY4mJByRwIXvLHKzs7V5290zIhf9gY6HG1h9k579xgSsUfMkkL+/NZGZemHCmjet+O4W19Y3NreJ2aWd3b/+gfHjU0jJVFHwquVSdkGjgTIBvmOHQSRSQOOTQDse3M7/9BEozKR7MJIEgJkPBIkaJsVKrCkn/otovV9yaOwdeJV5OKihHs1/+6g0kTWMQhnKidddzExNkRBlGOUxLvVRDQuiYDKFrqSAx6CCbXzvFZ1YZ4EgqW8Lgufp7IiOx1pM4tJ0xMSO97M3E/7xuaqKrIGMiSQ0IulgUpRwbiWev4wFTQA2fWEKoYvZWTEdEEWpsQCUbgrf88irx67XrmndfrzRu8jSK6ASdonPkoUvUQHeoiXxE0SN6Rq/ozZHOi/PufCxaC04+c4z+wPn8AedOjjc=</latexit>
Committed
System
States
volatile
state
Synchronous Epoch Commits
Coordinator Tasks computation
idle
Synchronous Epoch Commits
Coordinator Tasks
prepare ep1
ep1 prepared
ep1<latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit>
computation
idle
Synchronous Epoch Commits
Coordinator Tasks
prepare ep1
ep1 prepared
ep1<latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit>
computation
idle
Stable
Storage
commit ep1
ep1 committed
ep1<latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit>
⇧ep1<latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit><latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit><latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit><latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit>
Synchronous Epoch Commits
Coordinator Tasks
prepare ep1
ep1 prepared
ep1<latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit>
prepare ep2
ep2 prepared
ep2<latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit><latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit><latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit><latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit>
computation
idle
Stable
Storage
commit ep1
ep1 committed
ep1<latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit>
⇧ep1<latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit><latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit><latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit><latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit>
Synchronous Epoch Commits
• Suitable for short-lived, stateless task execution (e.g., micro-batching on Spark)
• A natural approach for reusing Map-Reduce technology for continuous processing.
• Problem: Unnecessary high latency in long-running task execution
• Cause: Blocking synchronisation (idle time) - coordination & epoch scheduling.
Asynchronous Epoch Commits
Coordinator Tasks
prepare ep1
prepare ep2
Stable
Storage
ep1 prepared
ep2 prepared
⇧ep2<latexit sha1_base64="vzNrz845O3CFc8UPEV9DQuQriPs=">AAAB8nicbVA9T8MwEHXKVylfBUYWixaJqUq6AFsFC2ORCFRqoshxL61Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuKPg045nqxUQDZwJ8wwyHnlRA0pjDYzy+mfmPT6A0y8S9mUgIUzIULGGUGCsFzaDLogJk1J42o3rDbblz4FXilaSBSnSj+lcwyGiegjCUE637nitNWBBlGOUwrQW5BknomAyhb6kgKeiwmN88xWdWGeAkU7aEwXP190RBUq0naWw7U2JGetmbif95/dwkl2HBhMwNCLpYlOQcmwzPAsADpoAaPrGEUMXsrZiOiCLU2JhqNgRv+eVV4rdbVy3vrt3oXJdpVNEJOkXnyEMXqINuURf5iCKJntErenNy58V5dz4WrRWnnDlGf+B8/gB+65De</latexit><latexit sha1_base64="vzNrz845O3CFc8UPEV9DQuQriPs=">AAAB8nicbVA9T8MwEHXKVylfBUYWixaJqUq6AFsFC2ORCFRqoshxL61Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuKPg045nqxUQDZwJ8wwyHnlRA0pjDYzy+mfmPT6A0y8S9mUgIUzIULGGUGCsFzaDLogJk1J42o3rDbblz4FXilaSBSnSj+lcwyGiegjCUE637nitNWBBlGOUwrQW5BknomAyhb6kgKeiwmN88xWdWGeAkU7aEwXP190RBUq0naWw7U2JGetmbif95/dwkl2HBhMwNCLpYlOQcmwzPAsADpoAaPrGEUMXsrZiOiCLU2JhqNgRv+eVV4rdbVy3vrt3oXJdpVNEJOkXnyEMXqINuURf5iCKJntErenNy58V5dz4WrRWnnDlGf+B8/gB+65De</latexit><latexit sha1_base64="vzNrz845O3CFc8UPEV9DQuQriPs=">AAAB8nicbVA9T8MwEHXKVylfBUYWixaJqUq6AFsFC2ORCFRqoshxL61Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuKPg045nqxUQDZwJ8wwyHnlRA0pjDYzy+mfmPT6A0y8S9mUgIUzIULGGUGCsFzaDLogJk1J42o3rDbblz4FXilaSBSnSj+lcwyGiegjCUE637nitNWBBlGOUwrQW5BknomAyhb6kgKeiwmN88xWdWGeAkU7aEwXP190RBUq0naWw7U2JGetmbif95/dwkl2HBhMwNCLpYlOQcmwzPAsADpoAaPrGEUMXsrZiOiCLU2JhqNgRv+eVV4rdbVy3vrt3oXJdpVNEJOkXnyEMXqINuURf5iCKJntErenNy58V5dz4WrRWnnDlGf+B8/gB+65De</latexit><latexit sha1_base64="vzNrz845O3CFc8UPEV9DQuQriPs=">AAAB8nicbVA9T8MwEHXKVylfBUYWixaJqUq6AFsFC2ORCFRqoshxL61Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuKPg045nqxUQDZwJ8wwyHnlRA0pjDYzy+mfmPT6A0y8S9mUgIUzIULGGUGCsFzaDLogJk1J42o3rDbblz4FXilaSBSnSj+lcwyGiegjCUE637nitNWBBlGOUwrQW5BknomAyhb6kgKeiwmN88xWdWGeAkU7aEwXP190RBUq0naWw7U2JGetmbif95/dwkl2HBhMwNCLpYlOQcmwzPAsADpoAaPrGEUMXsrZiOiCLU2JhqNgRv+eVV4rdbVy3vrt3oXJdpVNEJOkXnyEMXqINuURf5iCKJntErenNy58V5dz4WrRWnnDlGf+B8/gB+65De</latexit>
commit ep1
commit ep1
⇧ep1<latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit><latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit><latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit><latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit>
ep1<latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit>
ep2<latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit><latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit><latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit><latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit>
Asynchronous Epoch Commits
Coordinator Tasks
prepare ep1
prepare ep2
Stable
Storage
ep1 prepared
ep2 prepared
⇧ep2<latexit sha1_base64="vzNrz845O3CFc8UPEV9DQuQriPs=">AAAB8nicbVA9T8MwEHXKVylfBUYWixaJqUq6AFsFC2ORCFRqoshxL61Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuKPg045nqxUQDZwJ8wwyHnlRA0pjDYzy+mfmPT6A0y8S9mUgIUzIULGGUGCsFzaDLogJk1J42o3rDbblz4FXilaSBSnSj+lcwyGiegjCUE637nitNWBBlGOUwrQW5BknomAyhb6kgKeiwmN88xWdWGeAkU7aEwXP190RBUq0naWw7U2JGetmbif95/dwkl2HBhMwNCLpYlOQcmwzPAsADpoAaPrGEUMXsrZiOiCLU2JhqNgRv+eVV4rdbVy3vrt3oXJdpVNEJOkXnyEMXqINuURf5iCKJntErenNy58V5dz4WrRWnnDlGf+B8/gB+65De</latexit><latexit sha1_base64="vzNrz845O3CFc8UPEV9DQuQriPs=">AAAB8nicbVA9T8MwEHXKVylfBUYWixaJqUq6AFsFC2ORCFRqoshxL61Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuKPg045nqxUQDZwJ8wwyHnlRA0pjDYzy+mfmPT6A0y8S9mUgIUzIULGGUGCsFzaDLogJk1J42o3rDbblz4FXilaSBSnSj+lcwyGiegjCUE637nitNWBBlGOUwrQW5BknomAyhb6kgKeiwmN88xWdWGeAkU7aEwXP190RBUq0naWw7U2JGetmbif95/dwkl2HBhMwNCLpYlOQcmwzPAsADpoAaPrGEUMXsrZiOiCLU2JhqNgRv+eVV4rdbVy3vrt3oXJdpVNEJOkXnyEMXqINuURf5iCKJntErenNy58V5dz4WrRWnnDlGf+B8/gB+65De</latexit><latexit sha1_base64="vzNrz845O3CFc8UPEV9DQuQriPs=">AAAB8nicbVA9T8MwEHXKVylfBUYWixaJqUq6AFsFC2ORCFRqoshxL61Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuKPg045nqxUQDZwJ8wwyHnlRA0pjDYzy+mfmPT6A0y8S9mUgIUzIULGGUGCsFzaDLogJk1J42o3rDbblz4FXilaSBSnSj+lcwyGiegjCUE637nitNWBBlGOUwrQW5BknomAyhb6kgKeiwmN88xWdWGeAkU7aEwXP190RBUq0naWw7U2JGetmbif95/dwkl2HBhMwNCLpYlOQcmwzPAsADpoAaPrGEUMXsrZiOiCLU2JhqNgRv+eVV4rdbVy3vrt3oXJdpVNEJOkXnyEMXqINuURf5iCKJntErenNy58V5dz4WrRWnnDlGf+B8/gB+65De</latexit><latexit sha1_base64="vzNrz845O3CFc8UPEV9DQuQriPs=">AAAB8nicbVA9T8MwEHXKVylfBUYWixaJqUq6AFsFC2ORCFRqoshxL61Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuKPg045nqxUQDZwJ8wwyHnlRA0pjDYzy+mfmPT6A0y8S9mUgIUzIULGGUGCsFzaDLogJk1J42o3rDbblz4FXilaSBSnSj+lcwyGiegjCUE637nitNWBBlGOUwrQW5BknomAyhb6kgKeiwmN88xWdWGeAkU7aEwXP190RBUq0naWw7U2JGetmbif95/dwkl2HBhMwNCLpYlOQcmwzPAsADpoAaPrGEUMXsrZiOiCLU2JhqNgRv+eVV4rdbVy3vrt3oXJdpVNEJOkXnyEMXqINuURf5iCKJntErenNy58V5dz4WrRWnnDlGf+B8/gB+65De</latexit>
How? Using Snapshots
commit ep1
commit ep1
⇧ep1<latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit><latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit><latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit><latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit>
ep1<latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit>
ep2<latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit><latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit><latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit><latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit>
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink
Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink

Weitere ähnliche Inhalte

Was ist angesagt?

Introduction to Stream Processing with Apache Flink (2019-11-02 Bengaluru Mee...
Introduction to Stream Processing with Apache Flink (2019-11-02 Bengaluru Mee...Introduction to Stream Processing with Apache Flink (2019-11-02 Bengaluru Mee...
Introduction to Stream Processing with Apache Flink (2019-11-02 Bengaluru Mee...Timo Walther
 
Flink Forward San Francisco 2018: Fabian Hueske & Timo Walther - "Why and how...
Flink Forward San Francisco 2018: Fabian Hueske & Timo Walther - "Why and how...Flink Forward San Francisco 2018: Fabian Hueske & Timo Walther - "Why and how...
Flink Forward San Francisco 2018: Fabian Hueske & Timo Walther - "Why and how...Flink Forward
 
apidays LIVE Singapore 2021 - REST the Events - REST APIs for Event-Driven Ar...
apidays LIVE Singapore 2021 - REST the Events - REST APIs for Event-Driven Ar...apidays LIVE Singapore 2021 - REST the Events - REST APIs for Event-Driven Ar...
apidays LIVE Singapore 2021 - REST the Events - REST APIs for Event-Driven Ar...apidays
 
Flink Forward Berlin 2018: Xiaowei Jiang - Keynote: "Unified Engine for Data ...
Flink Forward Berlin 2018: Xiaowei Jiang - Keynote: "Unified Engine for Data ...Flink Forward Berlin 2018: Xiaowei Jiang - Keynote: "Unified Engine for Data ...
Flink Forward Berlin 2018: Xiaowei Jiang - Keynote: "Unified Engine for Data ...Flink Forward
 
Virtual Flink Forward 2020: Production-Ready Flink and Hive Integration - wha...
Virtual Flink Forward 2020: Production-Ready Flink and Hive Integration - wha...Virtual Flink Forward 2020: Production-Ready Flink and Hive Integration - wha...
Virtual Flink Forward 2020: Production-Ready Flink and Hive Integration - wha...Flink Forward
 
How to Build an Apache Kafka® Connector
How to Build an Apache Kafka® ConnectorHow to Build an Apache Kafka® Connector
How to Build an Apache Kafka® Connectorconfluent
 
Flink Forward Berlin 2018: Xingcan Cui - "Stream Join in Flink: from Discrete...
Flink Forward Berlin 2018: Xingcan Cui - "Stream Join in Flink: from Discrete...Flink Forward Berlin 2018: Xingcan Cui - "Stream Join in Flink: from Discrete...
Flink Forward Berlin 2018: Xingcan Cui - "Stream Join in Flink: from Discrete...Flink Forward
 
Tuning Flink For Robustness And Performance
Tuning Flink For Robustness And PerformanceTuning Flink For Robustness And Performance
Tuning Flink For Robustness And PerformanceStefan Richter
 
Flink Forward Berlin 2017: Mihail Vieru - A Materialization Engine for Data I...
Flink Forward Berlin 2017: Mihail Vieru - A Materialization Engine for Data I...Flink Forward Berlin 2017: Mihail Vieru - A Materialization Engine for Data I...
Flink Forward Berlin 2017: Mihail Vieru - A Materialization Engine for Data I...Flink Forward
 
Monitoring Flink with Prometheus
Monitoring Flink with PrometheusMonitoring Flink with Prometheus
Monitoring Flink with PrometheusMaximilian Bode
 
Introduction to Streaming with Apache Flink
Introduction to Streaming with Apache FlinkIntroduction to Streaming with Apache Flink
Introduction to Streaming with Apache FlinkTugdual Grall
 
Flink Forward San Francisco 2018: - Jinkui Shi and Radu Tudoran "Flink real-t...
Flink Forward San Francisco 2018: - Jinkui Shi and Radu Tudoran "Flink real-t...Flink Forward San Francisco 2018: - Jinkui Shi and Radu Tudoran "Flink real-t...
Flink Forward San Francisco 2018: - Jinkui Shi and Radu Tudoran "Flink real-t...Flink Forward
 
Realizing the promise of portability with Apache Beam
Realizing the promise of portability with Apache BeamRealizing the promise of portability with Apache Beam
Realizing the promise of portability with Apache BeamJ On The Beach
 
New Approaches for Fraud Detection on Apache Kafka and KSQL
New Approaches for Fraud Detection on Apache Kafka and KSQLNew Approaches for Fraud Detection on Apache Kafka and KSQL
New Approaches for Fraud Detection on Apache Kafka and KSQLconfluent
 
Scaling stream data pipelines with Pravega and Apache Flink
Scaling stream data pipelines with Pravega and Apache FlinkScaling stream data pipelines with Pravega and Apache Flink
Scaling stream data pipelines with Pravega and Apache FlinkTill Rohrmann
 
Running Flink in Production: The good, The bad and The in Between - Lakshmi ...
Running Flink in Production:  The good, The bad and The in Between - Lakshmi ...Running Flink in Production:  The good, The bad and The in Between - Lakshmi ...
Running Flink in Production: The good, The bad and The in Between - Lakshmi ...Flink Forward
 
Flink Forward San Francisco 2018: Xu Yang - "Alibaba’s common algorithm platf...
Flink Forward San Francisco 2018: Xu Yang - "Alibaba’s common algorithm platf...Flink Forward San Francisco 2018: Xu Yang - "Alibaba’s common algorithm platf...
Flink Forward San Francisco 2018: Xu Yang - "Alibaba’s common algorithm platf...Flink Forward
 
End to-end large messages processing with Kafka Streams & Kafka Connect
End to-end large messages processing with Kafka Streams & Kafka ConnectEnd to-end large messages processing with Kafka Streams & Kafka Connect
End to-end large messages processing with Kafka Streams & Kafka Connectconfluent
 
Introduction to the Processor API
Introduction to the Processor APIIntroduction to the Processor API
Introduction to the Processor APIconfluent
 
Overview of Apache Flink: Next-Gen Big Data Analytics Framework
Overview of Apache Flink: Next-Gen Big Data Analytics FrameworkOverview of Apache Flink: Next-Gen Big Data Analytics Framework
Overview of Apache Flink: Next-Gen Big Data Analytics FrameworkSlim Baltagi
 

Was ist angesagt? (20)

Introduction to Stream Processing with Apache Flink (2019-11-02 Bengaluru Mee...
Introduction to Stream Processing with Apache Flink (2019-11-02 Bengaluru Mee...Introduction to Stream Processing with Apache Flink (2019-11-02 Bengaluru Mee...
Introduction to Stream Processing with Apache Flink (2019-11-02 Bengaluru Mee...
 
Flink Forward San Francisco 2018: Fabian Hueske & Timo Walther - "Why and how...
Flink Forward San Francisco 2018: Fabian Hueske & Timo Walther - "Why and how...Flink Forward San Francisco 2018: Fabian Hueske & Timo Walther - "Why and how...
Flink Forward San Francisco 2018: Fabian Hueske & Timo Walther - "Why and how...
 
apidays LIVE Singapore 2021 - REST the Events - REST APIs for Event-Driven Ar...
apidays LIVE Singapore 2021 - REST the Events - REST APIs for Event-Driven Ar...apidays LIVE Singapore 2021 - REST the Events - REST APIs for Event-Driven Ar...
apidays LIVE Singapore 2021 - REST the Events - REST APIs for Event-Driven Ar...
 
Flink Forward Berlin 2018: Xiaowei Jiang - Keynote: "Unified Engine for Data ...
Flink Forward Berlin 2018: Xiaowei Jiang - Keynote: "Unified Engine for Data ...Flink Forward Berlin 2018: Xiaowei Jiang - Keynote: "Unified Engine for Data ...
Flink Forward Berlin 2018: Xiaowei Jiang - Keynote: "Unified Engine for Data ...
 
Virtual Flink Forward 2020: Production-Ready Flink and Hive Integration - wha...
Virtual Flink Forward 2020: Production-Ready Flink and Hive Integration - wha...Virtual Flink Forward 2020: Production-Ready Flink and Hive Integration - wha...
Virtual Flink Forward 2020: Production-Ready Flink and Hive Integration - wha...
 
How to Build an Apache Kafka® Connector
How to Build an Apache Kafka® ConnectorHow to Build an Apache Kafka® Connector
How to Build an Apache Kafka® Connector
 
Flink Forward Berlin 2018: Xingcan Cui - "Stream Join in Flink: from Discrete...
Flink Forward Berlin 2018: Xingcan Cui - "Stream Join in Flink: from Discrete...Flink Forward Berlin 2018: Xingcan Cui - "Stream Join in Flink: from Discrete...
Flink Forward Berlin 2018: Xingcan Cui - "Stream Join in Flink: from Discrete...
 
Tuning Flink For Robustness And Performance
Tuning Flink For Robustness And PerformanceTuning Flink For Robustness And Performance
Tuning Flink For Robustness And Performance
 
Flink Forward Berlin 2017: Mihail Vieru - A Materialization Engine for Data I...
Flink Forward Berlin 2017: Mihail Vieru - A Materialization Engine for Data I...Flink Forward Berlin 2017: Mihail Vieru - A Materialization Engine for Data I...
Flink Forward Berlin 2017: Mihail Vieru - A Materialization Engine for Data I...
 
Monitoring Flink with Prometheus
Monitoring Flink with PrometheusMonitoring Flink with Prometheus
Monitoring Flink with Prometheus
 
Introduction to Streaming with Apache Flink
Introduction to Streaming with Apache FlinkIntroduction to Streaming with Apache Flink
Introduction to Streaming with Apache Flink
 
Flink Forward San Francisco 2018: - Jinkui Shi and Radu Tudoran "Flink real-t...
Flink Forward San Francisco 2018: - Jinkui Shi and Radu Tudoran "Flink real-t...Flink Forward San Francisco 2018: - Jinkui Shi and Radu Tudoran "Flink real-t...
Flink Forward San Francisco 2018: - Jinkui Shi and Radu Tudoran "Flink real-t...
 
Realizing the promise of portability with Apache Beam
Realizing the promise of portability with Apache BeamRealizing the promise of portability with Apache Beam
Realizing the promise of portability with Apache Beam
 
New Approaches for Fraud Detection on Apache Kafka and KSQL
New Approaches for Fraud Detection on Apache Kafka and KSQLNew Approaches for Fraud Detection on Apache Kafka and KSQL
New Approaches for Fraud Detection on Apache Kafka and KSQL
 
Scaling stream data pipelines with Pravega and Apache Flink
Scaling stream data pipelines with Pravega and Apache FlinkScaling stream data pipelines with Pravega and Apache Flink
Scaling stream data pipelines with Pravega and Apache Flink
 
Running Flink in Production: The good, The bad and The in Between - Lakshmi ...
Running Flink in Production:  The good, The bad and The in Between - Lakshmi ...Running Flink in Production:  The good, The bad and The in Between - Lakshmi ...
Running Flink in Production: The good, The bad and The in Between - Lakshmi ...
 
Flink Forward San Francisco 2018: Xu Yang - "Alibaba’s common algorithm platf...
Flink Forward San Francisco 2018: Xu Yang - "Alibaba’s common algorithm platf...Flink Forward San Francisco 2018: Xu Yang - "Alibaba’s common algorithm platf...
Flink Forward San Francisco 2018: Xu Yang - "Alibaba’s common algorithm platf...
 
End to-end large messages processing with Kafka Streams & Kafka Connect
End to-end large messages processing with Kafka Streams & Kafka ConnectEnd to-end large messages processing with Kafka Streams & Kafka Connect
End to-end large messages processing with Kafka Streams & Kafka Connect
 
Introduction to the Processor API
Introduction to the Processor APIIntroduction to the Processor API
Introduction to the Processor API
 
Overview of Apache Flink: Next-Gen Big Data Analytics Framework
Overview of Apache Flink: Next-Gen Big Data Analytics FrameworkOverview of Apache Flink: Next-Gen Big Data Analytics Framework
Overview of Apache Flink: Next-Gen Big Data Analytics Framework
 

Ähnlich wie Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink

LWA 2015: The Apache Flink Platform for Parallel Batch and Stream Analysis
LWA 2015: The Apache Flink Platform for Parallel Batch and Stream AnalysisLWA 2015: The Apache Flink Platform for Parallel Batch and Stream Analysis
LWA 2015: The Apache Flink Platform for Parallel Batch and Stream AnalysisJonas Traub
 
Flink history, roadmap and vision
Flink history, roadmap and visionFlink history, roadmap and vision
Flink history, roadmap and visionStephan Ewen
 
Data pipeline with kafka
Data pipeline with kafkaData pipeline with kafka
Data pipeline with kafkaMole Wong
 
IMC Summit 2016 Breakout - Roman Shtykh - Apache Ignite as a Data Processing Hub
IMC Summit 2016 Breakout - Roman Shtykh - Apache Ignite as a Data Processing HubIMC Summit 2016 Breakout - Roman Shtykh - Apache Ignite as a Data Processing Hub
IMC Summit 2016 Breakout - Roman Shtykh - Apache Ignite as a Data Processing HubIn-Memory Computing Summit
 
Kafka streams - From pub/sub to a complete stream processing platform
Kafka streams - From pub/sub to a complete stream processing platformKafka streams - From pub/sub to a complete stream processing platform
Kafka streams - From pub/sub to a complete stream processing platformPaolo Castagna
 
Robust stream processing with Apache Flink
Robust stream processing with Apache FlinkRobust stream processing with Apache Flink
Robust stream processing with Apache FlinkAljoscha Krettek
 
K. Tzoumas & S. Ewen – Flink Forward Keynote
K. Tzoumas & S. Ewen – Flink Forward KeynoteK. Tzoumas & S. Ewen – Flink Forward Keynote
K. Tzoumas & S. Ewen – Flink Forward KeynoteFlink Forward
 
Why apache Flink is the 4G of Big Data Analytics Frameworks
Why apache Flink is the 4G of Big Data Analytics FrameworksWhy apache Flink is the 4G of Big Data Analytics Frameworks
Why apache Flink is the 4G of Big Data Analytics FrameworksSlim Baltagi
 
Building Stream Processing as a Service
Building Stream Processing as a ServiceBuilding Stream Processing as a Service
Building Stream Processing as a ServiceSteven Wu
 
KFServing Payload Logging for Trusted AI
KFServing Payload Logging for Trusted AIKFServing Payload Logging for Trusted AI
KFServing Payload Logging for Trusted AIAnimesh Singh
 
Apache Flink Meetup Munich (November 2015): Flink Overview, Architecture, Int...
Apache Flink Meetup Munich (November 2015): Flink Overview, Architecture, Int...Apache Flink Meetup Munich (November 2015): Flink Overview, Architecture, Int...
Apache Flink Meetup Munich (November 2015): Flink Overview, Architecture, Int...Robert Metzger
 
Apache Kafka and KSQL in Action: Let's Build a Streaming Data Pipeline!
Apache Kafka and KSQL in Action: Let's Build a Streaming Data Pipeline!Apache Kafka and KSQL in Action: Let's Build a Streaming Data Pipeline!
Apache Kafka and KSQL in Action: Let's Build a Streaming Data Pipeline!confluent
 
Apache Flink - Overview and Use cases of a Distributed Dataflow System (at pr...
Apache Flink - Overview and Use cases of a Distributed Dataflow System (at pr...Apache Flink - Overview and Use cases of a Distributed Dataflow System (at pr...
Apache Flink - Overview and Use cases of a Distributed Dataflow System (at pr...Stephan Ewen
 
Apache StreamPipes – Flexible Industrial IoT Management
Apache StreamPipes – Flexible Industrial IoT ManagementApache StreamPipes – Flexible Industrial IoT Management
Apache StreamPipes – Flexible Industrial IoT ManagementApache StreamPipes
 
Down the event-driven road: Experiences of integrating streaming into analyti...
Down the event-driven road: Experiences of integrating streaming into analyti...Down the event-driven road: Experiences of integrating streaming into analyti...
Down the event-driven road: Experiences of integrating streaming into analyti...inovex GmbH
 
Streaming etl in practice with postgre sql, apache kafka, and ksql mic
Streaming etl in practice with postgre sql, apache kafka, and ksql micStreaming etl in practice with postgre sql, apache kafka, and ksql mic
Streaming etl in practice with postgre sql, apache kafka, and ksql micBas van Oudenaarde
 
Real-Life Use Cases & Architectures for Event Streaming with Apache Kafka
Real-Life Use Cases & Architectures for Event Streaming with Apache KafkaReal-Life Use Cases & Architectures for Event Streaming with Apache Kafka
Real-Life Use Cases & Architectures for Event Streaming with Apache KafkaKai Wähner
 
Counting Elements in Streams
Counting Elements in StreamsCounting Elements in Streams
Counting Elements in StreamsJamie Grier
 
apidays LIVE India - REST the Events - REST APIs for Event-Driven Architectur...
apidays LIVE India - REST the Events - REST APIs for Event-Driven Architectur...apidays LIVE India - REST the Events - REST APIs for Event-Driven Architectur...
apidays LIVE India - REST the Events - REST APIs for Event-Driven Architectur...apidays
 

Ähnlich wie Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink (20)

LWA 2015: The Apache Flink Platform for Parallel Batch and Stream Analysis
LWA 2015: The Apache Flink Platform for Parallel Batch and Stream AnalysisLWA 2015: The Apache Flink Platform for Parallel Batch and Stream Analysis
LWA 2015: The Apache Flink Platform for Parallel Batch and Stream Analysis
 
Flink history, roadmap and vision
Flink history, roadmap and visionFlink history, roadmap and vision
Flink history, roadmap and vision
 
Data pipeline with kafka
Data pipeline with kafkaData pipeline with kafka
Data pipeline with kafka
 
IMC Summit 2016 Breakout - Roman Shtykh - Apache Ignite as a Data Processing Hub
IMC Summit 2016 Breakout - Roman Shtykh - Apache Ignite as a Data Processing HubIMC Summit 2016 Breakout - Roman Shtykh - Apache Ignite as a Data Processing Hub
IMC Summit 2016 Breakout - Roman Shtykh - Apache Ignite as a Data Processing Hub
 
Kafka streams - From pub/sub to a complete stream processing platform
Kafka streams - From pub/sub to a complete stream processing platformKafka streams - From pub/sub to a complete stream processing platform
Kafka streams - From pub/sub to a complete stream processing platform
 
Robust stream processing with Apache Flink
Robust stream processing with Apache FlinkRobust stream processing with Apache Flink
Robust stream processing with Apache Flink
 
Flink in action
Flink in actionFlink in action
Flink in action
 
K. Tzoumas & S. Ewen – Flink Forward Keynote
K. Tzoumas & S. Ewen – Flink Forward KeynoteK. Tzoumas & S. Ewen – Flink Forward Keynote
K. Tzoumas & S. Ewen – Flink Forward Keynote
 
Why apache Flink is the 4G of Big Data Analytics Frameworks
Why apache Flink is the 4G of Big Data Analytics FrameworksWhy apache Flink is the 4G of Big Data Analytics Frameworks
Why apache Flink is the 4G of Big Data Analytics Frameworks
 
Building Stream Processing as a Service
Building Stream Processing as a ServiceBuilding Stream Processing as a Service
Building Stream Processing as a Service
 
KFServing Payload Logging for Trusted AI
KFServing Payload Logging for Trusted AIKFServing Payload Logging for Trusted AI
KFServing Payload Logging for Trusted AI
 
Apache Flink Meetup Munich (November 2015): Flink Overview, Architecture, Int...
Apache Flink Meetup Munich (November 2015): Flink Overview, Architecture, Int...Apache Flink Meetup Munich (November 2015): Flink Overview, Architecture, Int...
Apache Flink Meetup Munich (November 2015): Flink Overview, Architecture, Int...
 
Apache Kafka and KSQL in Action: Let's Build a Streaming Data Pipeline!
Apache Kafka and KSQL in Action: Let's Build a Streaming Data Pipeline!Apache Kafka and KSQL in Action: Let's Build a Streaming Data Pipeline!
Apache Kafka and KSQL in Action: Let's Build a Streaming Data Pipeline!
 
Apache Flink - Overview and Use cases of a Distributed Dataflow System (at pr...
Apache Flink - Overview and Use cases of a Distributed Dataflow System (at pr...Apache Flink - Overview and Use cases of a Distributed Dataflow System (at pr...
Apache Flink - Overview and Use cases of a Distributed Dataflow System (at pr...
 
Apache StreamPipes – Flexible Industrial IoT Management
Apache StreamPipes – Flexible Industrial IoT ManagementApache StreamPipes – Flexible Industrial IoT Management
Apache StreamPipes – Flexible Industrial IoT Management
 
Down the event-driven road: Experiences of integrating streaming into analyti...
Down the event-driven road: Experiences of integrating streaming into analyti...Down the event-driven road: Experiences of integrating streaming into analyti...
Down the event-driven road: Experiences of integrating streaming into analyti...
 
Streaming etl in practice with postgre sql, apache kafka, and ksql mic
Streaming etl in practice with postgre sql, apache kafka, and ksql micStreaming etl in practice with postgre sql, apache kafka, and ksql mic
Streaming etl in practice with postgre sql, apache kafka, and ksql mic
 
Real-Life Use Cases & Architectures for Event Streaming with Apache Kafka
Real-Life Use Cases & Architectures for Event Streaming with Apache KafkaReal-Life Use Cases & Architectures for Event Streaming with Apache Kafka
Real-Life Use Cases & Architectures for Event Streaming with Apache Kafka
 
Counting Elements in Streams
Counting Elements in StreamsCounting Elements in Streams
Counting Elements in Streams
 
apidays LIVE India - REST the Events - REST APIs for Event-Driven Architectur...
apidays LIVE India - REST the Events - REST APIs for Event-Driven Architectur...apidays LIVE India - REST the Events - REST APIs for Event-Driven Architectur...
apidays LIVE India - REST the Events - REST APIs for Event-Driven Architectur...
 

Mehr von Paris Carbone

Continuous Intelligence - Intersecting Event-Based Business Logic and ML
Continuous Intelligence - Intersecting Event-Based Business Logic and MLContinuous Intelligence - Intersecting Event-Based Business Logic and ML
Continuous Intelligence - Intersecting Event-Based Business Logic and MLParis Carbone
 
Scalable and Reliable Data Stream Processing - Doctorate Seminar
Scalable and Reliable Data Stream Processing - Doctorate SeminarScalable and Reliable Data Stream Processing - Doctorate Seminar
Scalable and Reliable Data Stream Processing - Doctorate SeminarParis Carbone
 
Stream Loops on Flink - Reinventing the wheel for the streaming era
Stream Loops on Flink - Reinventing the wheel for the streaming eraStream Loops on Flink - Reinventing the wheel for the streaming era
Stream Loops on Flink - Reinventing the wheel for the streaming eraParis Carbone
 
A Future Look of Data Stream Processing as an Architecture for AI
A Future Look of Data Stream Processing as an Architecture for AIA Future Look of Data Stream Processing as an Architecture for AI
A Future Look of Data Stream Processing as an Architecture for AIParis Carbone
 
Continuous Deep Analytics
Continuous Deep AnalyticsContinuous Deep Analytics
Continuous Deep AnalyticsParis Carbone
 
State Management in Apache Flink : Consistent Stateful Distributed Stream Pro...
State Management in Apache Flink : Consistent Stateful Distributed Stream Pro...State Management in Apache Flink : Consistent Stateful Distributed Stream Pro...
State Management in Apache Flink : Consistent Stateful Distributed Stream Pro...Paris Carbone
 
Reintroducing the Stream Processor: A universal tool for continuous data anal...
Reintroducing the Stream Processor: A universal tool for continuous data anal...Reintroducing the Stream Processor: A universal tool for continuous data anal...
Reintroducing the Stream Processor: A universal tool for continuous data anal...Paris Carbone
 
Not Less, Not More: Exactly Once, Large-Scale Stream Processing in Action
Not Less, Not More: Exactly Once, Large-Scale Stream Processing in ActionNot Less, Not More: Exactly Once, Large-Scale Stream Processing in Action
Not Less, Not More: Exactly Once, Large-Scale Stream Processing in ActionParis Carbone
 
Graph Stream Processing : spinning fast, large scale, complex analytics
Graph Stream Processing : spinning fast, large scale, complex analyticsGraph Stream Processing : spinning fast, large scale, complex analytics
Graph Stream Processing : spinning fast, large scale, complex analyticsParis Carbone
 
Data Stream Analytics - Why they are important
Data Stream Analytics - Why they are importantData Stream Analytics - Why they are important
Data Stream Analytics - Why they are importantParis Carbone
 
Single-Pass Graph Stream Analytics with Apache Flink
Single-Pass Graph Stream Analytics with Apache FlinkSingle-Pass Graph Stream Analytics with Apache Flink
Single-Pass Graph Stream Analytics with Apache FlinkParis Carbone
 
Aggregate Sharing for User-Define Data Stream Windows
Aggregate Sharing for User-Define Data Stream WindowsAggregate Sharing for User-Define Data Stream Windows
Aggregate Sharing for User-Define Data Stream WindowsParis Carbone
 
An Introduction to Distributed Data Streaming
An Introduction to Distributed Data StreamingAn Introduction to Distributed Data Streaming
An Introduction to Distributed Data StreamingParis Carbone
 
Tech Talk @ Google on Flink Fault Tolerance and HA
Tech Talk @ Google on Flink Fault Tolerance and HATech Talk @ Google on Flink Fault Tolerance and HA
Tech Talk @ Google on Flink Fault Tolerance and HAParis Carbone
 

Mehr von Paris Carbone (14)

Continuous Intelligence - Intersecting Event-Based Business Logic and ML
Continuous Intelligence - Intersecting Event-Based Business Logic and MLContinuous Intelligence - Intersecting Event-Based Business Logic and ML
Continuous Intelligence - Intersecting Event-Based Business Logic and ML
 
Scalable and Reliable Data Stream Processing - Doctorate Seminar
Scalable and Reliable Data Stream Processing - Doctorate SeminarScalable and Reliable Data Stream Processing - Doctorate Seminar
Scalable and Reliable Data Stream Processing - Doctorate Seminar
 
Stream Loops on Flink - Reinventing the wheel for the streaming era
Stream Loops on Flink - Reinventing the wheel for the streaming eraStream Loops on Flink - Reinventing the wheel for the streaming era
Stream Loops on Flink - Reinventing the wheel for the streaming era
 
A Future Look of Data Stream Processing as an Architecture for AI
A Future Look of Data Stream Processing as an Architecture for AIA Future Look of Data Stream Processing as an Architecture for AI
A Future Look of Data Stream Processing as an Architecture for AI
 
Continuous Deep Analytics
Continuous Deep AnalyticsContinuous Deep Analytics
Continuous Deep Analytics
 
State Management in Apache Flink : Consistent Stateful Distributed Stream Pro...
State Management in Apache Flink : Consistent Stateful Distributed Stream Pro...State Management in Apache Flink : Consistent Stateful Distributed Stream Pro...
State Management in Apache Flink : Consistent Stateful Distributed Stream Pro...
 
Reintroducing the Stream Processor: A universal tool for continuous data anal...
Reintroducing the Stream Processor: A universal tool for continuous data anal...Reintroducing the Stream Processor: A universal tool for continuous data anal...
Reintroducing the Stream Processor: A universal tool for continuous data anal...
 
Not Less, Not More: Exactly Once, Large-Scale Stream Processing in Action
Not Less, Not More: Exactly Once, Large-Scale Stream Processing in ActionNot Less, Not More: Exactly Once, Large-Scale Stream Processing in Action
Not Less, Not More: Exactly Once, Large-Scale Stream Processing in Action
 
Graph Stream Processing : spinning fast, large scale, complex analytics
Graph Stream Processing : spinning fast, large scale, complex analyticsGraph Stream Processing : spinning fast, large scale, complex analytics
Graph Stream Processing : spinning fast, large scale, complex analytics
 
Data Stream Analytics - Why they are important
Data Stream Analytics - Why they are importantData Stream Analytics - Why they are important
Data Stream Analytics - Why they are important
 
Single-Pass Graph Stream Analytics with Apache Flink
Single-Pass Graph Stream Analytics with Apache FlinkSingle-Pass Graph Stream Analytics with Apache Flink
Single-Pass Graph Stream Analytics with Apache Flink
 
Aggregate Sharing for User-Define Data Stream Windows
Aggregate Sharing for User-Define Data Stream WindowsAggregate Sharing for User-Define Data Stream Windows
Aggregate Sharing for User-Define Data Stream Windows
 
An Introduction to Distributed Data Streaming
An Introduction to Distributed Data StreamingAn Introduction to Distributed Data Streaming
An Introduction to Distributed Data Streaming
 
Tech Talk @ Google on Flink Fault Tolerance and HA
Tech Talk @ Google on Flink Fault Tolerance and HATech Talk @ Google on Flink Fault Tolerance and HA
Tech Talk @ Google on Flink Fault Tolerance and HA
 

Kürzlich hochgeladen

Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...amitlee9823
 
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...amitlee9823
 
➥🔝 7737669865 🔝▻ malwa Call-girls in Women Seeking Men 🔝malwa🔝 Escorts Ser...
➥🔝 7737669865 🔝▻ malwa Call-girls in Women Seeking Men  🔝malwa🔝   Escorts Ser...➥🔝 7737669865 🔝▻ malwa Call-girls in Women Seeking Men  🔝malwa🔝   Escorts Ser...
➥🔝 7737669865 🔝▻ malwa Call-girls in Women Seeking Men 🔝malwa🔝 Escorts Ser...amitlee9823
 
Call me @ 9892124323 Cheap Rate Call Girls in Vashi with Real Photo 100% Secure
Call me @ 9892124323  Cheap Rate Call Girls in Vashi with Real Photo 100% SecureCall me @ 9892124323  Cheap Rate Call Girls in Vashi with Real Photo 100% Secure
Call me @ 9892124323 Cheap Rate Call Girls in Vashi with Real Photo 100% SecurePooja Nehwal
 
FESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdfFESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdfMarinCaroMartnezBerg
 
Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...
Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...
Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...amitlee9823
 
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...ZurliaSoop
 
Invezz.com - Grow your wealth with trading signals
Invezz.com - Grow your wealth with trading signalsInvezz.com - Grow your wealth with trading signals
Invezz.com - Grow your wealth with trading signalsInvezz1
 
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...SUHANI PANDEY
 
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al BarshaAl Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al BarshaAroojKhan71
 
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteedamy56318795
 
BigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptxBigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptxolyaivanovalion
 
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...amitlee9823
 
➥🔝 7737669865 🔝▻ Bangalore Call-girls in Women Seeking Men 🔝Bangalore🔝 Esc...
➥🔝 7737669865 🔝▻ Bangalore Call-girls in Women Seeking Men  🔝Bangalore🔝   Esc...➥🔝 7737669865 🔝▻ Bangalore Call-girls in Women Seeking Men  🔝Bangalore🔝   Esc...
➥🔝 7737669865 🔝▻ Bangalore Call-girls in Women Seeking Men 🔝Bangalore🔝 Esc...amitlee9823
 
April 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's AnalysisApril 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's Analysismanisha194592
 
BDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort Service
BDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort ServiceBDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort Service
BDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort ServiceDelhi Call girls
 
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...amitlee9823
 
Vip Mumbai Call Girls Marol Naka Call On 9920725232 With Body to body massage...
Vip Mumbai Call Girls Marol Naka Call On 9920725232 With Body to body massage...Vip Mumbai Call Girls Marol Naka Call On 9920725232 With Body to body massage...
Vip Mumbai Call Girls Marol Naka Call On 9920725232 With Body to body massage...amitlee9823
 
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...Valters Lauzums
 
Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...only4webmaster01
 

Kürzlich hochgeladen (20)

Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
 
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
 
➥🔝 7737669865 🔝▻ malwa Call-girls in Women Seeking Men 🔝malwa🔝 Escorts Ser...
➥🔝 7737669865 🔝▻ malwa Call-girls in Women Seeking Men  🔝malwa🔝   Escorts Ser...➥🔝 7737669865 🔝▻ malwa Call-girls in Women Seeking Men  🔝malwa🔝   Escorts Ser...
➥🔝 7737669865 🔝▻ malwa Call-girls in Women Seeking Men 🔝malwa🔝 Escorts Ser...
 
Call me @ 9892124323 Cheap Rate Call Girls in Vashi with Real Photo 100% Secure
Call me @ 9892124323  Cheap Rate Call Girls in Vashi with Real Photo 100% SecureCall me @ 9892124323  Cheap Rate Call Girls in Vashi with Real Photo 100% Secure
Call me @ 9892124323 Cheap Rate Call Girls in Vashi with Real Photo 100% Secure
 
FESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdfFESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdf
 
Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...
Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...
Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...
 
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
 
Invezz.com - Grow your wealth with trading signals
Invezz.com - Grow your wealth with trading signalsInvezz.com - Grow your wealth with trading signals
Invezz.com - Grow your wealth with trading signals
 
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
 
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al BarshaAl Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
 
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed
 
BigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptxBigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptx
 
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
 
➥🔝 7737669865 🔝▻ Bangalore Call-girls in Women Seeking Men 🔝Bangalore🔝 Esc...
➥🔝 7737669865 🔝▻ Bangalore Call-girls in Women Seeking Men  🔝Bangalore🔝   Esc...➥🔝 7737669865 🔝▻ Bangalore Call-girls in Women Seeking Men  🔝Bangalore🔝   Esc...
➥🔝 7737669865 🔝▻ Bangalore Call-girls in Women Seeking Men 🔝Bangalore🔝 Esc...
 
April 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's AnalysisApril 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's Analysis
 
BDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort Service
BDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort ServiceBDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort Service
BDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort Service
 
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
 
Vip Mumbai Call Girls Marol Naka Call On 9920725232 With Body to body massage...
Vip Mumbai Call Girls Marol Naka Call On 9920725232 With Body to body massage...Vip Mumbai Call Girls Marol Naka Call On 9920725232 With Body to body massage...
Vip Mumbai Call Girls Marol Naka Call On 9920725232 With Body to body massage...
 
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
 
Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...
 

Asynchronous Epoch Commits for Fast and Reliable Data Stream Execution in Apache Flink

  • 1. Asynchronous Epoch Commits for Fast & Reliable Data Stream Execution in Apache Flink Paris Carbone @LADIS 2018 Apache Flink Committer PhD Candidate @ KTH <parisc@kth.se>
  • 2. Data Stream Processing Event Logs Historic Data Event Logs Files Applications/Services Long-Running Dataflow Task Execution State
  • 6. Example (Apache Flink) filter keyBy window aggregate Kafka Consumer logical graph (operators)
  • 7. Example (Apache Flink) filter keyBy window aggregate flatMap Kafka Consumer logical graph (operators)
  • 8. Example (Apache Flink) Kafka Producer filter keyBy window aggregate flatMap Kafka Consumer logical graph (operators)
  • 9. Kafka Consumer filter window aggregate flatMap Kafka Producer keyBy a) Logical
  • 10. Kafka Consumer filter window aggregate flatMap Kafka Producer keyBy a) Logical Kafka Consumer filter window aggregate flatmap Kafka Producer keyBy b) Optimised
  • 11. Kafka Consumer filter window aggregate flatMap Kafka Producer keyBy a) Logical Kafka Consumer filter window aggregate flatmap Kafka Producer keyBy b) Optimised Kafka Consumer Kafka Consumer filter filter window aggregate flatmap window aggregate flatmap Kafka Producer Kafka Producer …… …… …… [n] [1] [1] [1] [1] [n] [n] [n] …… offsets offsets count count window window offsets offsets c) Physical Task Execution message queuesmessage queues
  • 12. How can we achieve reliable processing at the presence of failures, reconfiguration, migration etc.? Task computation is not staged but can go on indefinitely.
  • 20. Processing Model p pi pj pk pl pm m Action:{ ⟨recv,m⟩, ⟨sp→s’p⟩, ⟨send,mk⟩, ⟨send,ml⟩ } s’p mk ml
  • 21. Stream Process Graphs Deterministic Input Streams Output Streams sources sinks volatile state DAG
  • 22. Stream Process Graphs Deterministic Input Streams Output Streams sources sinks volatile state System :{⇧, E}<latexit sha1_base64="rHJ3hHkZ/bcrazMY+bVo3k628zA=">AAAB/nicbVBNS8NAFHypX7V+RcWTl8UieJCSiKDHoggeK1hbaELZbDft0s0m7G6EEgL+FS8eFPHq7/Dmv3HT5qCtAwvDzHu82QkSzpR2nG+rsrS8srpWXa9tbG5t79i7ew8qTiWhbRLzWHYDrChngrY105x2E0lxFHDaCcbXhd95pFKxWNzrSUL9CA8FCxnB2kh9+8DLkNdip8iLsB4FQXaTIy/v23Wn4UyBFolbkjqUaPXtL28QkzSiQhOOleq5TqL9DEvNCKd5zUsVTTAZ4yHtGSpwRJWfTePn6NgoAxTG0jyh0VT9vZHhSKlJFJjJIqSa9wrxP6+X6vDSz5hIUk0FmR0KU450jIou0IBJSjSfGIKJZCYrIiMsMdGmsZopwZ3/8iJ5OGu4TsO9O683r8o6qnAIR3ACLlxAE26hBW0gkMEzvMKb9WS9WO/Wx2y0YpU7+/AH1ucP9MeU1Q==</latexit><latexit sha1_base64="rHJ3hHkZ/bcrazMY+bVo3k628zA=">AAAB/nicbVBNS8NAFHypX7V+RcWTl8UieJCSiKDHoggeK1hbaELZbDft0s0m7G6EEgL+FS8eFPHq7/Dmv3HT5qCtAwvDzHu82QkSzpR2nG+rsrS8srpWXa9tbG5t79i7ew8qTiWhbRLzWHYDrChngrY105x2E0lxFHDaCcbXhd95pFKxWNzrSUL9CA8FCxnB2kh9+8DLkNdip8iLsB4FQXaTIy/v23Wn4UyBFolbkjqUaPXtL28QkzSiQhOOleq5TqL9DEvNCKd5zUsVTTAZ4yHtGSpwRJWfTePn6NgoAxTG0jyh0VT9vZHhSKlJFJjJIqSa9wrxP6+X6vDSz5hIUk0FmR0KU450jIou0IBJSjSfGIKJZCYrIiMsMdGmsZopwZ3/8iJ5OGu4TsO9O683r8o6qnAIR3ACLlxAE26hBW0gkMEzvMKb9WS9WO/Wx2y0YpU7+/AH1ucP9MeU1Q==</latexit><latexit sha1_base64="rHJ3hHkZ/bcrazMY+bVo3k628zA=">AAAB/nicbVBNS8NAFHypX7V+RcWTl8UieJCSiKDHoggeK1hbaELZbDft0s0m7G6EEgL+FS8eFPHq7/Dmv3HT5qCtAwvDzHu82QkSzpR2nG+rsrS8srpWXa9tbG5t79i7ew8qTiWhbRLzWHYDrChngrY105x2E0lxFHDaCcbXhd95pFKxWNzrSUL9CA8FCxnB2kh9+8DLkNdip8iLsB4FQXaTIy/v23Wn4UyBFolbkjqUaPXtL28QkzSiQhOOleq5TqL9DEvNCKd5zUsVTTAZ4yHtGSpwRJWfTePn6NgoAxTG0jyh0VT9vZHhSKlJFJjJIqSa9wrxP6+X6vDSz5hIUk0FmR0KU450jIou0IBJSjSfGIKJZCYrIiMsMdGmsZopwZ3/8iJ5OGu4TsO9O683r8o6qnAIR3ACLlxAE26hBW0gkMEzvMKb9WS9WO/Wx2y0YpU7+/AH1ucP9MeU1Q==</latexit><latexit sha1_base64="rHJ3hHkZ/bcrazMY+bVo3k628zA=">AAAB/nicbVBNS8NAFHypX7V+RcWTl8UieJCSiKDHoggeK1hbaELZbDft0s0m7G6EEgL+FS8eFPHq7/Dmv3HT5qCtAwvDzHu82QkSzpR2nG+rsrS8srpWXa9tbG5t79i7ew8qTiWhbRLzWHYDrChngrY105x2E0lxFHDaCcbXhd95pFKxWNzrSUL9CA8FCxnB2kh9+8DLkNdip8iLsB4FQXaTIy/v23Wn4UyBFolbkjqUaPXtL28QkzSiQhOOleq5TqL9DEvNCKd5zUsVTTAZ4yHtGSpwRJWfTePn6NgoAxTG0jyh0VT9vZHhSKlJFJjJIqSa9wrxP6+X6vDSz5hIUk0FmR0KU450jIou0IBJSjSfGIKJZCYrIiMsMdGmsZopwZ3/8iJ5OGu4TsO9O683r8o6qnAIR3ACLlxAE26hBW0gkMEzvMKb9WS9WO/Wx2y0YpU7+/AH1ucP9MeU1Q==</latexit> tasks channels DAG
  • 23. Stream Process Graphs Deterministic Input Streams Output Streams sources sinks volatile state System :{⇧, E}<latexit sha1_base64="rHJ3hHkZ/bcrazMY+bVo3k628zA=">AAAB/nicbVBNS8NAFHypX7V+RcWTl8UieJCSiKDHoggeK1hbaELZbDft0s0m7G6EEgL+FS8eFPHq7/Dmv3HT5qCtAwvDzHu82QkSzpR2nG+rsrS8srpWXa9tbG5t79i7ew8qTiWhbRLzWHYDrChngrY105x2E0lxFHDaCcbXhd95pFKxWNzrSUL9CA8FCxnB2kh9+8DLkNdip8iLsB4FQXaTIy/v23Wn4UyBFolbkjqUaPXtL28QkzSiQhOOleq5TqL9DEvNCKd5zUsVTTAZ4yHtGSpwRJWfTePn6NgoAxTG0jyh0VT9vZHhSKlJFJjJIqSa9wrxP6+X6vDSz5hIUk0FmR0KU450jIou0IBJSjSfGIKJZCYrIiMsMdGmsZopwZ3/8iJ5OGu4TsO9O683r8o6qnAIR3ACLlxAE26hBW0gkMEzvMKb9WS9WO/Wx2y0YpU7+/AH1ucP9MeU1Q==</latexit><latexit sha1_base64="rHJ3hHkZ/bcrazMY+bVo3k628zA=">AAAB/nicbVBNS8NAFHypX7V+RcWTl8UieJCSiKDHoggeK1hbaELZbDft0s0m7G6EEgL+FS8eFPHq7/Dmv3HT5qCtAwvDzHu82QkSzpR2nG+rsrS8srpWXa9tbG5t79i7ew8qTiWhbRLzWHYDrChngrY105x2E0lxFHDaCcbXhd95pFKxWNzrSUL9CA8FCxnB2kh9+8DLkNdip8iLsB4FQXaTIy/v23Wn4UyBFolbkjqUaPXtL28QkzSiQhOOleq5TqL9DEvNCKd5zUsVTTAZ4yHtGSpwRJWfTePn6NgoAxTG0jyh0VT9vZHhSKlJFJjJIqSa9wrxP6+X6vDSz5hIUk0FmR0KU450jIou0IBJSjSfGIKJZCYrIiMsMdGmsZopwZ3/8iJ5OGu4TsO9O683r8o6qnAIR3ACLlxAE26hBW0gkMEzvMKb9WS9WO/Wx2y0YpU7+/AH1ucP9MeU1Q==</latexit><latexit sha1_base64="rHJ3hHkZ/bcrazMY+bVo3k628zA=">AAAB/nicbVBNS8NAFHypX7V+RcWTl8UieJCSiKDHoggeK1hbaELZbDft0s0m7G6EEgL+FS8eFPHq7/Dmv3HT5qCtAwvDzHu82QkSzpR2nG+rsrS8srpWXa9tbG5t79i7ew8qTiWhbRLzWHYDrChngrY105x2E0lxFHDaCcbXhd95pFKxWNzrSUL9CA8FCxnB2kh9+8DLkNdip8iLsB4FQXaTIy/v23Wn4UyBFolbkjqUaPXtL28QkzSiQhOOleq5TqL9DEvNCKd5zUsVTTAZ4yHtGSpwRJWfTePn6NgoAxTG0jyh0VT9vZHhSKlJFJjJIqSa9wrxP6+X6vDSz5hIUk0FmR0KU450jIou0IBJSjSfGIKJZCYrIiMsMdGmsZopwZ3/8iJ5OGu4TsO9O683r8o6qnAIR3ACLlxAE26hBW0gkMEzvMKb9WS9WO/Wx2y0YpU7+/AH1ucP9MeU1Q==</latexit><latexit sha1_base64="rHJ3hHkZ/bcrazMY+bVo3k628zA=">AAAB/nicbVBNS8NAFHypX7V+RcWTl8UieJCSiKDHoggeK1hbaELZbDft0s0m7G6EEgL+FS8eFPHq7/Dmv3HT5qCtAwvDzHu82QkSzpR2nG+rsrS8srpWXa9tbG5t79i7ew8qTiWhbRLzWHYDrChngrY105x2E0lxFHDaCcbXhd95pFKxWNzrSUL9CA8FCxnB2kh9+8DLkNdip8iLsB4FQXaTIy/v23Wn4UyBFolbkjqUaPXtL28QkzSiQhOOleq5TqL9DEvNCKd5zUsVTTAZ4yHtGSpwRJWfTePn6NgoAxTG0jyh0VT9vZHhSKlJFJjJIqSa9wrxP6+X6vDSz5hIUk0FmR0KU450jIou0IBJSjSfGIKJZCYrIiMsMdGmsZopwZ3/8iJ5OGu4TsO9O683r8o6qnAIR3ACLlxAE26hBW0gkMEzvMKb9WS9WO/Wx2y0YpU7+/AH1ucP9MeU1Q==</latexit> tasks channels DAG System Execution : . . . ! {⇧⇤, M} ! {⇧0 ⇤, M0 } ! . . .<latexit sha1_base64="Q2rqyrBQGVbgx8zAfIbupgkdkkQ=">AAACOnicbZDLSgMxFIYzXmu9jbp0EyxSESkzIuiy6MaN0IK9QKeUTJq2oZnJkJxRytDncuNTuHPhxoUibn0A0+kstO2BwM//nZPk/H4kuAbHebWWlldW19ZzG/nNre2dXXtvv65lrCirUSmkavpEM8FDVgMOgjUjxUjgC9bwhzcT3nhgSnMZ3sMoYu2A9EPe45SAsTp21RNdCRp7ivcHQJSSj9hLsFfhndMzfIe98QJUTFlxDqZXdeyCU3LSwvPCzUQBZVXp2C9eV9I4YCFQQbRuuU4E7YQo4FSwcd6LNYsIHZI+axkZkoDpdpKuPsbHxuninlTmhIBT9+9EQgKtR4FvOgMCAz3LJuYi1oqhd9VOeBjFwEI6fagXCwwST3LEXa4YBTEyglDFzV8xHRBFKJi08yYEd3bleVE/L7lOya1eFMrXWRw5dIiO0Aly0SUqo1tUQTVE0RN6Qx/o03q23q0v63vaumRlMwfoX1k/v6x6rCQ=</latexit><latexit sha1_base64="Q2rqyrBQGVbgx8zAfIbupgkdkkQ=">AAACOnicbZDLSgMxFIYzXmu9jbp0EyxSESkzIuiy6MaN0IK9QKeUTJq2oZnJkJxRytDncuNTuHPhxoUibn0A0+kstO2BwM//nZPk/H4kuAbHebWWlldW19ZzG/nNre2dXXtvv65lrCirUSmkavpEM8FDVgMOgjUjxUjgC9bwhzcT3nhgSnMZ3sMoYu2A9EPe45SAsTp21RNdCRp7ivcHQJSSj9hLsFfhndMzfIe98QJUTFlxDqZXdeyCU3LSwvPCzUQBZVXp2C9eV9I4YCFQQbRuuU4E7YQo4FSwcd6LNYsIHZI+axkZkoDpdpKuPsbHxuninlTmhIBT9+9EQgKtR4FvOgMCAz3LJuYi1oqhd9VOeBjFwEI6fagXCwwST3LEXa4YBTEyglDFzV8xHRBFKJi08yYEd3bleVE/L7lOya1eFMrXWRw5dIiO0Aly0SUqo1tUQTVE0RN6Qx/o03q23q0v63vaumRlMwfoX1k/v6x6rCQ=</latexit><latexit sha1_base64="Q2rqyrBQGVbgx8zAfIbupgkdkkQ=">AAACOnicbZDLSgMxFIYzXmu9jbp0EyxSESkzIuiy6MaN0IK9QKeUTJq2oZnJkJxRytDncuNTuHPhxoUibn0A0+kstO2BwM//nZPk/H4kuAbHebWWlldW19ZzG/nNre2dXXtvv65lrCirUSmkavpEM8FDVgMOgjUjxUjgC9bwhzcT3nhgSnMZ3sMoYu2A9EPe45SAsTp21RNdCRp7ivcHQJSSj9hLsFfhndMzfIe98QJUTFlxDqZXdeyCU3LSwvPCzUQBZVXp2C9eV9I4YCFQQbRuuU4E7YQo4FSwcd6LNYsIHZI+axkZkoDpdpKuPsbHxuninlTmhIBT9+9EQgKtR4FvOgMCAz3LJuYi1oqhd9VOeBjFwEI6fagXCwwST3LEXa4YBTEyglDFzV8xHRBFKJi08yYEd3bleVE/L7lOya1eFMrXWRw5dIiO0Aly0SUqo1tUQTVE0RN6Qx/o03q23q0v63vaumRlMwfoX1k/v6x6rCQ=</latexit><latexit sha1_base64="Q2rqyrBQGVbgx8zAfIbupgkdkkQ=">AAACOnicbZDLSgMxFIYzXmu9jbp0EyxSESkzIuiy6MaN0IK9QKeUTJq2oZnJkJxRytDncuNTuHPhxoUibn0A0+kstO2BwM//nZPk/H4kuAbHebWWlldW19ZzG/nNre2dXXtvv65lrCirUSmkavpEM8FDVgMOgjUjxUjgC9bwhzcT3nhgSnMZ3sMoYu2A9EPe45SAsTp21RNdCRp7ivcHQJSSj9hLsFfhndMzfIe98QJUTFlxDqZXdeyCU3LSwvPCzUQBZVXp2C9eV9I4YCFQQbRuuU4E7YQo4FSwcd6LNYsIHZI+axkZkoDpdpKuPsbHxuninlTmhIBT9+9EQgKtR4FvOgMCAz3LJuYi1oqhd9VOeBjFwEI6fagXCwwST3LEXa4YBTEyglDFzV8xHRBFKJi08yYEd3bleVE/L7lOya1eFMrXWRw5dIiO0Aly0SUqo1tUQTVE0RN6Qx/o03q23q0v63vaumRlMwfoX1k/v6x6rCQ=</latexit>
  • 24. Stream Process Graphs Deterministic Input Streams Output Streams sources sinks volatile state System :{⇧, E}<latexit sha1_base64="rHJ3hHkZ/bcrazMY+bVo3k628zA=">AAAB/nicbVBNS8NAFHypX7V+RcWTl8UieJCSiKDHoggeK1hbaELZbDft0s0m7G6EEgL+FS8eFPHq7/Dmv3HT5qCtAwvDzHu82QkSzpR2nG+rsrS8srpWXa9tbG5t79i7ew8qTiWhbRLzWHYDrChngrY105x2E0lxFHDaCcbXhd95pFKxWNzrSUL9CA8FCxnB2kh9+8DLkNdip8iLsB4FQXaTIy/v23Wn4UyBFolbkjqUaPXtL28QkzSiQhOOleq5TqL9DEvNCKd5zUsVTTAZ4yHtGSpwRJWfTePn6NgoAxTG0jyh0VT9vZHhSKlJFJjJIqSa9wrxP6+X6vDSz5hIUk0FmR0KU450jIou0IBJSjSfGIKJZCYrIiMsMdGmsZopwZ3/8iJ5OGu4TsO9O683r8o6qnAIR3ACLlxAE26hBW0gkMEzvMKb9WS9WO/Wx2y0YpU7+/AH1ucP9MeU1Q==</latexit><latexit sha1_base64="rHJ3hHkZ/bcrazMY+bVo3k628zA=">AAAB/nicbVBNS8NAFHypX7V+RcWTl8UieJCSiKDHoggeK1hbaELZbDft0s0m7G6EEgL+FS8eFPHq7/Dmv3HT5qCtAwvDzHu82QkSzpR2nG+rsrS8srpWXa9tbG5t79i7ew8qTiWhbRLzWHYDrChngrY105x2E0lxFHDaCcbXhd95pFKxWNzrSUL9CA8FCxnB2kh9+8DLkNdip8iLsB4FQXaTIy/v23Wn4UyBFolbkjqUaPXtL28QkzSiQhOOleq5TqL9DEvNCKd5zUsVTTAZ4yHtGSpwRJWfTePn6NgoAxTG0jyh0VT9vZHhSKlJFJjJIqSa9wrxP6+X6vDSz5hIUk0FmR0KU450jIou0IBJSjSfGIKJZCYrIiMsMdGmsZopwZ3/8iJ5OGu4TsO9O683r8o6qnAIR3ACLlxAE26hBW0gkMEzvMKb9WS9WO/Wx2y0YpU7+/AH1ucP9MeU1Q==</latexit><latexit sha1_base64="rHJ3hHkZ/bcrazMY+bVo3k628zA=">AAAB/nicbVBNS8NAFHypX7V+RcWTl8UieJCSiKDHoggeK1hbaELZbDft0s0m7G6EEgL+FS8eFPHq7/Dmv3HT5qCtAwvDzHu82QkSzpR2nG+rsrS8srpWXa9tbG5t79i7ew8qTiWhbRLzWHYDrChngrY105x2E0lxFHDaCcbXhd95pFKxWNzrSUL9CA8FCxnB2kh9+8DLkNdip8iLsB4FQXaTIy/v23Wn4UyBFolbkjqUaPXtL28QkzSiQhOOleq5TqL9DEvNCKd5zUsVTTAZ4yHtGSpwRJWfTePn6NgoAxTG0jyh0VT9vZHhSKlJFJjJIqSa9wrxP6+X6vDSz5hIUk0FmR0KU450jIou0IBJSjSfGIKJZCYrIiMsMdGmsZopwZ3/8iJ5OGu4TsO9O683r8o6qnAIR3ACLlxAE26hBW0gkMEzvMKb9WS9WO/Wx2y0YpU7+/AH1ucP9MeU1Q==</latexit><latexit sha1_base64="rHJ3hHkZ/bcrazMY+bVo3k628zA=">AAAB/nicbVBNS8NAFHypX7V+RcWTl8UieJCSiKDHoggeK1hbaELZbDft0s0m7G6EEgL+FS8eFPHq7/Dmv3HT5qCtAwvDzHu82QkSzpR2nG+rsrS8srpWXa9tbG5t79i7ew8qTiWhbRLzWHYDrChngrY105x2E0lxFHDaCcbXhd95pFKxWNzrSUL9CA8FCxnB2kh9+8DLkNdip8iLsB4FQXaTIy/v23Wn4UyBFolbkjqUaPXtL28QkzSiQhOOleq5TqL9DEvNCKd5zUsVTTAZ4yHtGSpwRJWfTePn6NgoAxTG0jyh0VT9vZHhSKlJFJjJIqSa9wrxP6+X6vDSz5hIUk0FmR0KU450jIou0IBJSjSfGIKJZCYrIiMsMdGmsZopwZ3/8iJ5OGu4TsO9O683r8o6qnAIR3ACLlxAE26hBW0gkMEzvMKb9WS9WO/Wx2y0YpU7+/AH1ucP9MeU1Q==</latexit> tasks channels DAG System Execution : . . . ! {⇧⇤, M} ! {⇧0 ⇤, M0 } ! . . .<latexit sha1_base64="Q2rqyrBQGVbgx8zAfIbupgkdkkQ=">AAACOnicbZDLSgMxFIYzXmu9jbp0EyxSESkzIuiy6MaN0IK9QKeUTJq2oZnJkJxRytDncuNTuHPhxoUibn0A0+kstO2BwM//nZPk/H4kuAbHebWWlldW19ZzG/nNre2dXXtvv65lrCirUSmkavpEM8FDVgMOgjUjxUjgC9bwhzcT3nhgSnMZ3sMoYu2A9EPe45SAsTp21RNdCRp7ivcHQJSSj9hLsFfhndMzfIe98QJUTFlxDqZXdeyCU3LSwvPCzUQBZVXp2C9eV9I4YCFQQbRuuU4E7YQo4FSwcd6LNYsIHZI+axkZkoDpdpKuPsbHxuninlTmhIBT9+9EQgKtR4FvOgMCAz3LJuYi1oqhd9VOeBjFwEI6fagXCwwST3LEXa4YBTEyglDFzV8xHRBFKJi08yYEd3bleVE/L7lOya1eFMrXWRw5dIiO0Aly0SUqo1tUQTVE0RN6Qx/o03q23q0v63vaumRlMwfoX1k/v6x6rCQ=</latexit><latexit sha1_base64="Q2rqyrBQGVbgx8zAfIbupgkdkkQ=">AAACOnicbZDLSgMxFIYzXmu9jbp0EyxSESkzIuiy6MaN0IK9QKeUTJq2oZnJkJxRytDncuNTuHPhxoUibn0A0+kstO2BwM//nZPk/H4kuAbHebWWlldW19ZzG/nNre2dXXtvv65lrCirUSmkavpEM8FDVgMOgjUjxUjgC9bwhzcT3nhgSnMZ3sMoYu2A9EPe45SAsTp21RNdCRp7ivcHQJSSj9hLsFfhndMzfIe98QJUTFlxDqZXdeyCU3LSwvPCzUQBZVXp2C9eV9I4YCFQQbRuuU4E7YQo4FSwcd6LNYsIHZI+axkZkoDpdpKuPsbHxuninlTmhIBT9+9EQgKtR4FvOgMCAz3LJuYi1oqhd9VOeBjFwEI6fagXCwwST3LEXa4YBTEyglDFzV8xHRBFKJi08yYEd3bleVE/L7lOya1eFMrXWRw5dIiO0Aly0SUqo1tUQTVE0RN6Qx/o03q23q0v63vaumRlMwfoX1k/v6x6rCQ=</latexit><latexit sha1_base64="Q2rqyrBQGVbgx8zAfIbupgkdkkQ=">AAACOnicbZDLSgMxFIYzXmu9jbp0EyxSESkzIuiy6MaN0IK9QKeUTJq2oZnJkJxRytDncuNTuHPhxoUibn0A0+kstO2BwM//nZPk/H4kuAbHebWWlldW19ZzG/nNre2dXXtvv65lrCirUSmkavpEM8FDVgMOgjUjxUjgC9bwhzcT3nhgSnMZ3sMoYu2A9EPe45SAsTp21RNdCRp7ivcHQJSSj9hLsFfhndMzfIe98QJUTFlxDqZXdeyCU3LSwvPCzUQBZVXp2C9eV9I4YCFQQbRuuU4E7YQo4FSwcd6LNYsIHZI+axkZkoDpdpKuPsbHxuninlTmhIBT9+9EQgKtR4FvOgMCAz3LJuYi1oqhd9VOeBjFwEI6fagXCwwST3LEXa4YBTEyglDFzV8xHRBFKJi08yYEd3bleVE/L7lOya1eFMrXWRw5dIiO0Aly0SUqo1tUQTVE0RN6Qx/o03q23q0v63vaumRlMwfoX1k/v6x6rCQ=</latexit><latexit sha1_base64="Q2rqyrBQGVbgx8zAfIbupgkdkkQ=">AAACOnicbZDLSgMxFIYzXmu9jbp0EyxSESkzIuiy6MaN0IK9QKeUTJq2oZnJkJxRytDncuNTuHPhxoUibn0A0+kstO2BwM//nZPk/H4kuAbHebWWlldW19ZzG/nNre2dXXtvv65lrCirUSmkavpEM8FDVgMOgjUjxUjgC9bwhzcT3nhgSnMZ3sMoYu2A9EPe45SAsTp21RNdCRp7ivcHQJSSj9hLsFfhndMzfIe98QJUTFlxDqZXdeyCU3LSwvPCzUQBZVXp2C9eV9I4YCFQQbRuuU4E7YQo4FSwcd6LNYsIHZI+axkZkoDpdpKuPsbHxuninlTmhIBT9+9EQgKtR4FvOgMCAz3LJuYi1oqhd9VOeBjFwEI6fagXCwwST3LEXa4YBTEyglDFzV8xHRBFKJi08yYEd3bleVE/L7lOya1eFMrXWRw5dIiO0Aly0SUqo1tUQTVE0RN6Qx/o03q23q0v63vaumRlMwfoX1k/v6x6rCQ=</latexit> Task Actions
  • 25. Stream Process Graphs Deterministic Input Streams Output Streams sources sinks volatile state System :{⇧, E}<latexit sha1_base64="rHJ3hHkZ/bcrazMY+bVo3k628zA=">AAAB/nicbVBNS8NAFHypX7V+RcWTl8UieJCSiKDHoggeK1hbaELZbDft0s0m7G6EEgL+FS8eFPHq7/Dmv3HT5qCtAwvDzHu82QkSzpR2nG+rsrS8srpWXa9tbG5t79i7ew8qTiWhbRLzWHYDrChngrY105x2E0lxFHDaCcbXhd95pFKxWNzrSUL9CA8FCxnB2kh9+8DLkNdip8iLsB4FQXaTIy/v23Wn4UyBFolbkjqUaPXtL28QkzSiQhOOleq5TqL9DEvNCKd5zUsVTTAZ4yHtGSpwRJWfTePn6NgoAxTG0jyh0VT9vZHhSKlJFJjJIqSa9wrxP6+X6vDSz5hIUk0FmR0KU450jIou0IBJSjSfGIKJZCYrIiMsMdGmsZopwZ3/8iJ5OGu4TsO9O683r8o6qnAIR3ACLlxAE26hBW0gkMEzvMKb9WS9WO/Wx2y0YpU7+/AH1ucP9MeU1Q==</latexit><latexit sha1_base64="rHJ3hHkZ/bcrazMY+bVo3k628zA=">AAAB/nicbVBNS8NAFHypX7V+RcWTl8UieJCSiKDHoggeK1hbaELZbDft0s0m7G6EEgL+FS8eFPHq7/Dmv3HT5qCtAwvDzHu82QkSzpR2nG+rsrS8srpWXa9tbG5t79i7ew8qTiWhbRLzWHYDrChngrY105x2E0lxFHDaCcbXhd95pFKxWNzrSUL9CA8FCxnB2kh9+8DLkNdip8iLsB4FQXaTIy/v23Wn4UyBFolbkjqUaPXtL28QkzSiQhOOleq5TqL9DEvNCKd5zUsVTTAZ4yHtGSpwRJWfTePn6NgoAxTG0jyh0VT9vZHhSKlJFJjJIqSa9wrxP6+X6vDSz5hIUk0FmR0KU450jIou0IBJSjSfGIKJZCYrIiMsMdGmsZopwZ3/8iJ5OGu4TsO9O683r8o6qnAIR3ACLlxAE26hBW0gkMEzvMKb9WS9WO/Wx2y0YpU7+/AH1ucP9MeU1Q==</latexit><latexit sha1_base64="rHJ3hHkZ/bcrazMY+bVo3k628zA=">AAAB/nicbVBNS8NAFHypX7V+RcWTl8UieJCSiKDHoggeK1hbaELZbDft0s0m7G6EEgL+FS8eFPHq7/Dmv3HT5qCtAwvDzHu82QkSzpR2nG+rsrS8srpWXa9tbG5t79i7ew8qTiWhbRLzWHYDrChngrY105x2E0lxFHDaCcbXhd95pFKxWNzrSUL9CA8FCxnB2kh9+8DLkNdip8iLsB4FQXaTIy/v23Wn4UyBFolbkjqUaPXtL28QkzSiQhOOleq5TqL9DEvNCKd5zUsVTTAZ4yHtGSpwRJWfTePn6NgoAxTG0jyh0VT9vZHhSKlJFJjJIqSa9wrxP6+X6vDSz5hIUk0FmR0KU450jIou0IBJSjSfGIKJZCYrIiMsMdGmsZopwZ3/8iJ5OGu4TsO9O683r8o6qnAIR3ACLlxAE26hBW0gkMEzvMKb9WS9WO/Wx2y0YpU7+/AH1ucP9MeU1Q==</latexit><latexit sha1_base64="rHJ3hHkZ/bcrazMY+bVo3k628zA=">AAAB/nicbVBNS8NAFHypX7V+RcWTl8UieJCSiKDHoggeK1hbaELZbDft0s0m7G6EEgL+FS8eFPHq7/Dmv3HT5qCtAwvDzHu82QkSzpR2nG+rsrS8srpWXa9tbG5t79i7ew8qTiWhbRLzWHYDrChngrY105x2E0lxFHDaCcbXhd95pFKxWNzrSUL9CA8FCxnB2kh9+8DLkNdip8iLsB4FQXaTIy/v23Wn4UyBFolbkjqUaPXtL28QkzSiQhOOleq5TqL9DEvNCKd5zUsVTTAZ4yHtGSpwRJWfTePn6NgoAxTG0jyh0VT9vZHhSKlJFJjJIqSa9wrxP6+X6vDSz5hIUk0FmR0KU450jIou0IBJSjSfGIKJZCYrIiMsMdGmsZopwZ3/8iJ5OGu4TsO9O683r8o6qnAIR3ACLlxAE26hBW0gkMEzvMKb9WS9WO/Wx2y0YpU7+/AH1ucP9MeU1Q==</latexit> tasks channels DAG System Execution : . . . ! {⇧⇤, M} ! {⇧0 ⇤, M0 } ! . . .<latexit sha1_base64="Q2rqyrBQGVbgx8zAfIbupgkdkkQ=">AAACOnicbZDLSgMxFIYzXmu9jbp0EyxSESkzIuiy6MaN0IK9QKeUTJq2oZnJkJxRytDncuNTuHPhxoUibn0A0+kstO2BwM//nZPk/H4kuAbHebWWlldW19ZzG/nNre2dXXtvv65lrCirUSmkavpEM8FDVgMOgjUjxUjgC9bwhzcT3nhgSnMZ3sMoYu2A9EPe45SAsTp21RNdCRp7ivcHQJSSj9hLsFfhndMzfIe98QJUTFlxDqZXdeyCU3LSwvPCzUQBZVXp2C9eV9I4YCFQQbRuuU4E7YQo4FSwcd6LNYsIHZI+axkZkoDpdpKuPsbHxuninlTmhIBT9+9EQgKtR4FvOgMCAz3LJuYi1oqhd9VOeBjFwEI6fagXCwwST3LEXa4YBTEyglDFzV8xHRBFKJi08yYEd3bleVE/L7lOya1eFMrXWRw5dIiO0Aly0SUqo1tUQTVE0RN6Qx/o03q23q0v63vaumRlMwfoX1k/v6x6rCQ=</latexit><latexit sha1_base64="Q2rqyrBQGVbgx8zAfIbupgkdkkQ=">AAACOnicbZDLSgMxFIYzXmu9jbp0EyxSESkzIuiy6MaN0IK9QKeUTJq2oZnJkJxRytDncuNTuHPhxoUibn0A0+kstO2BwM//nZPk/H4kuAbHebWWlldW19ZzG/nNre2dXXtvv65lrCirUSmkavpEM8FDVgMOgjUjxUjgC9bwhzcT3nhgSnMZ3sMoYu2A9EPe45SAsTp21RNdCRp7ivcHQJSSj9hLsFfhndMzfIe98QJUTFlxDqZXdeyCU3LSwvPCzUQBZVXp2C9eV9I4YCFQQbRuuU4E7YQo4FSwcd6LNYsIHZI+axkZkoDpdpKuPsbHxuninlTmhIBT9+9EQgKtR4FvOgMCAz3LJuYi1oqhd9VOeBjFwEI6fagXCwwST3LEXa4YBTEyglDFzV8xHRBFKJi08yYEd3bleVE/L7lOya1eFMrXWRw5dIiO0Aly0SUqo1tUQTVE0RN6Qx/o03q23q0v63vaumRlMwfoX1k/v6x6rCQ=</latexit><latexit sha1_base64="Q2rqyrBQGVbgx8zAfIbupgkdkkQ=">AAACOnicbZDLSgMxFIYzXmu9jbp0EyxSESkzIuiy6MaN0IK9QKeUTJq2oZnJkJxRytDncuNTuHPhxoUibn0A0+kstO2BwM//nZPk/H4kuAbHebWWlldW19ZzG/nNre2dXXtvv65lrCirUSmkavpEM8FDVgMOgjUjxUjgC9bwhzcT3nhgSnMZ3sMoYu2A9EPe45SAsTp21RNdCRp7ivcHQJSSj9hLsFfhndMzfIe98QJUTFlxDqZXdeyCU3LSwvPCzUQBZVXp2C9eV9I4YCFQQbRuuU4E7YQo4FSwcd6LNYsIHZI+axkZkoDpdpKuPsbHxuninlTmhIBT9+9EQgKtR4FvOgMCAz3LJuYi1oqhd9VOeBjFwEI6fagXCwwST3LEXa4YBTEyglDFzV8xHRBFKJi08yYEd3bleVE/L7lOya1eFMrXWRw5dIiO0Aly0SUqo1tUQTVE0RN6Qx/o03q23q0v63vaumRlMwfoX1k/v6x6rCQ=</latexit><latexit sha1_base64="Q2rqyrBQGVbgx8zAfIbupgkdkkQ=">AAACOnicbZDLSgMxFIYzXmu9jbp0EyxSESkzIuiy6MaN0IK9QKeUTJq2oZnJkJxRytDncuNTuHPhxoUibn0A0+kstO2BwM//nZPk/H4kuAbHebWWlldW19ZzG/nNre2dXXtvv65lrCirUSmkavpEM8FDVgMOgjUjxUjgC9bwhzcT3nhgSnMZ3sMoYu2A9EPe45SAsTp21RNdCRp7ivcHQJSSj9hLsFfhndMzfIe98QJUTFlxDqZXdeyCU3LSwvPCzUQBZVXp2C9eV9I4YCFQQbRuuU4E7YQo4FSwcd6LNYsIHZI+axkZkoDpdpKuPsbHxuninlTmhIBT9+9EQgKtR4FvOgMCAz3LJuYi1oqhd9VOeBjFwEI6fagXCwwST3LEXa4YBTEyglDFzV8xHRBFKJi08yYEd3bleVE/L7lOya1eFMrXWRw5dIiO0Aly0SUqo1tUQTVE0RN6Qx/o03q23q0v63vaumRlMwfoX1k/v6x6rCQ=</latexit> System Configurations (states, messages in-transit)
  • 28. Fail Recovery p pi pj pk pl pm mk ml recover • Has m been fully processed? • Have mk and ml been delivered? ??
  • 29. Reliable Stream Processing • Existing approaches* typically adopt a fail recovery model to amend individual task execution and reproduce computations that were possibly lost • Complex Workarounds (e.g., duplicate elimination, input logging, acks) • Strong Assumptions (idempotent operations, key vs task level causal order) • External State Management (transactional external commits per action) *MillWheel: Fault- tolerant stream processing at internet scale,” in VLDB, 2013. Integrating scale out and fault tolerance in stream processing using operator state management. in SIGMOD 2013 Fault-tolerance and high availability in data stream management systems. in Encyclopedia of Database Systems 2009 Fault-tolerance in the Borealis distributed stream processing system, in SIGMOD 2005

  • 30. Fault Tolerance is not enough • Are output and states always correct? • Can we reconfigure the system without losing computation? • Can applications migrate without loss? • Is external state access isolation possible?
  • 31. Fault Tolerance is not enough • Are output and states always correct? • Can we reconfigure the system without losing computation? • Can applications migrate without loss? • Is external state access isolation possible? • We need a system-wide coarse-grained commit mechanism.
  • 35. task statesdeterministic input streams divide computation into epochs stream processing system Epoch-Based Stream Execution The Intuition
  • 36. task statesdeterministic input streams system configuration (states) after completing an epoch divide computation into epochs stream processing system Epoch-Based Stream Execution The Intuition
  • 37. task statesdeterministic input streams system configuration (states) after completing an epoch divide computation into epochs stream processing system success: commit system configuration failure: abort and start from previous epoch Epoch-Based Stream Execution The Intuition
  • 38. Epoch-Based Stream Execution Logged Input Committed Output Stable Storage ⇧epi<latexit sha1_base64="Xl8x16xSZsKgLM7knEkWZX4JtTU=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCyohNm1G94bbcOdAq8UrSgBLdqP4VDDKSp1QYwrHWfc+VJiywMoxwOq0FuaYSkzEe0r6lAqdUh8X85ik6s8oAJZmyJQyaq78nCpxqPUlj25liM9LL3kz8z+vnJrkMCyZkbqggi0VJzpHJ0CwANGCKEsMnlmCimL0VkRFWmBgbU82G4C2/vEr8duuq5d21G53rMo0qnMApnIMHF9CBW+iCDwQkPMMrvDm58+K8Ox+L1opTzhzDHzifP9J+kRU=</latexit><latexit sha1_base64="Xl8x16xSZsKgLM7knEkWZX4JtTU=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCyohNm1G94bbcOdAq8UrSgBLdqP4VDDKSp1QYwrHWfc+VJiywMoxwOq0FuaYSkzEe0r6lAqdUh8X85ik6s8oAJZmyJQyaq78nCpxqPUlj25liM9LL3kz8z+vnJrkMCyZkbqggi0VJzpHJ0CwANGCKEsMnlmCimL0VkRFWmBgbU82G4C2/vEr8duuq5d21G53rMo0qnMApnIMHF9CBW+iCDwQkPMMrvDm58+K8Ox+L1opTzhzDHzifP9J+kRU=</latexit><latexit sha1_base64="Xl8x16xSZsKgLM7knEkWZX4JtTU=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCyohNm1G94bbcOdAq8UrSgBLdqP4VDDKSp1QYwrHWfc+VJiywMoxwOq0FuaYSkzEe0r6lAqdUh8X85ik6s8oAJZmyJQyaq78nCpxqPUlj25liM9LL3kz8z+vnJrkMCyZkbqggi0VJzpHJ0CwANGCKEsMnlmCimL0VkRFWmBgbU82G4C2/vEr8duuq5d21G53rMo0qnMApnIMHF9CBW+iCDwQkPMMrvDm58+K8Ox+L1opTzhzDHzifP9J+kRU=</latexit><latexit sha1_base64="Xl8x16xSZsKgLM7knEkWZX4JtTU=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCyohNm1G94bbcOdAq8UrSgBLdqP4VDDKSp1QYwrHWfc+VJiywMoxwOq0FuaYSkzEe0r6lAqdUh8X85ik6s8oAJZmyJQyaq78nCpxqPUlj25liM9LL3kz8z+vnJrkMCyZkbqggi0VJzpHJ0CwANGCKEsMnlmCimL0VkRFWmBgbU82G4C2/vEr8duuq5d21G53rMo0qnMApnIMHF9CBW+iCDwQkPMMrvDm58+K8Ox+L1opTzhzDHzifP9J+kRU=</latexit> ⇧ep1<latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit><latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit><latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit><latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit> ⇧ep2<latexit sha1_base64="vzNrz845O3CFc8UPEV9DQuQriPs=">AAAB8nicbVA9T8MwEHXKVylfBUYWixaJqUq6AFsFC2ORCFRqoshxL61Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuKPg045nqxUQDZwJ8wwyHnlRA0pjDYzy+mfmPT6A0y8S9mUgIUzIULGGUGCsFzaDLogJk1J42o3rDbblz4FXilaSBSnSj+lcwyGiegjCUE637nitNWBBlGOUwrQW5BknomAyhb6kgKeiwmN88xWdWGeAkU7aEwXP190RBUq0naWw7U2JGetmbif95/dwkl2HBhMwNCLpYlOQcmwzPAsADpoAaPrGEUMXsrZiOiCLU2JhqNgRv+eVV4rdbVy3vrt3oXJdpVNEJOkXnyEMXqINuURf5iCKJntErenNy58V5dz4WrRWnnDlGf+B8/gB+65De</latexit><latexit sha1_base64="vzNrz845O3CFc8UPEV9DQuQriPs=">AAAB8nicbVA9T8MwEHXKVylfBUYWixaJqUq6AFsFC2ORCFRqoshxL61Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuKPg045nqxUQDZwJ8wwyHnlRA0pjDYzy+mfmPT6A0y8S9mUgIUzIULGGUGCsFzaDLogJk1J42o3rDbblz4FXilaSBSnSj+lcwyGiegjCUE637nitNWBBlGOUwrQW5BknomAyhb6kgKeiwmN88xWdWGeAkU7aEwXP190RBUq0naWw7U2JGetmbif95/dwkl2HBhMwNCLpYlOQcmwzPAsADpoAaPrGEUMXsrZiOiCLU2JhqNgRv+eVV4rdbVy3vrt3oXJdpVNEJOkXnyEMXqINuURf5iCKJntErenNy58V5dz4WrRWnnDlGf+B8/gB+65De</latexit><latexit sha1_base64="vzNrz845O3CFc8UPEV9DQuQriPs=">AAAB8nicbVA9T8MwEHXKVylfBUYWixaJqUq6AFsFC2ORCFRqoshxL61Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuKPg045nqxUQDZwJ8wwyHnlRA0pjDYzy+mfmPT6A0y8S9mUgIUzIULGGUGCsFzaDLogJk1J42o3rDbblz4FXilaSBSnSj+lcwyGiegjCUE637nitNWBBlGOUwrQW5BknomAyhb6kgKeiwmN88xWdWGeAkU7aEwXP190RBUq0naWw7U2JGetmbif95/dwkl2HBhMwNCLpYlOQcmwzPAsADpoAaPrGEUMXsrZiOiCLU2JhqNgRv+eVV4rdbVy3vrt3oXJdpVNEJOkXnyEMXqINuURf5iCKJntErenNy58V5dz4WrRWnnDlGf+B8/gB+65De</latexit><latexit sha1_base64="vzNrz845O3CFc8UPEV9DQuQriPs=">AAAB8nicbVA9T8MwEHXKVylfBUYWixaJqUq6AFsFC2ORCFRqoshxL61Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuKPg045nqxUQDZwJ8wwyHnlRA0pjDYzy+mfmPT6A0y8S9mUgIUzIULGGUGCsFzaDLogJk1J42o3rDbblz4FXilaSBSnSj+lcwyGiegjCUE637nitNWBBlGOUwrQW5BknomAyhb6kgKeiwmN88xWdWGeAkU7aEwXP190RBUq0naWw7U2JGetmbif95/dwkl2HBhMwNCLpYlOQcmwzPAsADpoAaPrGEUMXsrZiOiCLU2JhqNgRv+eVV4rdbVy3vrt3oXJdpVNEJOkXnyEMXqINuURf5iCKJntErenNy58V5dz4WrRWnnDlGf+B8/gB+65De</latexit> ⇧ep3<latexit sha1_base64="7blVEvKqOiPeUWxaUZ2eNhSg02g=">AAAB8nicbVBNT8JAEJ3iF+IX6tHLRjDxRFo8qDeiF4+YWCGhTbNdFtiw3W52tyak4W948aDGq7/Gm//GBXpQ8CWTvLw3k5l5seRMG9f9dkpr6xubW+Xtys7u3v5B9fDoUaeZItQnKU9VN8aaciaob5jhtCsVxUnMaSce3878zhNVmqXiwUwkDRM8FGzACDZWCupBm0U5ldHFtB5Va27DnQOtEq8gNSjQjqpfQT8lWUKFIRxr3fNcacIcK8MIp9NKkGkqMRnjIe1ZKnBCdZjPb56iM6v00SBVtoRBc/X3RI4TrSdJbDsTbEZ62ZuJ/3m9zAyuwpwJmRkqyGLRIOPIpGgWAOozRYnhE0swUczeisgIK0yMjaliQ/CWX14lfrNx3fDum7XWTZFGGU7gFM7Bg0towR20wQcCEp7hFd6czHlx3p2PRWvJKWaO4Q+czx+AcJDf</latexit><latexit sha1_base64="7blVEvKqOiPeUWxaUZ2eNhSg02g=">AAAB8nicbVBNT8JAEJ3iF+IX6tHLRjDxRFo8qDeiF4+YWCGhTbNdFtiw3W52tyak4W948aDGq7/Gm//GBXpQ8CWTvLw3k5l5seRMG9f9dkpr6xubW+Xtys7u3v5B9fDoUaeZItQnKU9VN8aaciaob5jhtCsVxUnMaSce3878zhNVmqXiwUwkDRM8FGzACDZWCupBm0U5ldHFtB5Va27DnQOtEq8gNSjQjqpfQT8lWUKFIRxr3fNcacIcK8MIp9NKkGkqMRnjIe1ZKnBCdZjPb56iM6v00SBVtoRBc/X3RI4TrSdJbDsTbEZ62ZuJ/3m9zAyuwpwJmRkqyGLRIOPIpGgWAOozRYnhE0swUczeisgIK0yMjaliQ/CWX14lfrNx3fDum7XWTZFGGU7gFM7Bg0towR20wQcCEp7hFd6czHlx3p2PRWvJKWaO4Q+czx+AcJDf</latexit><latexit sha1_base64="7blVEvKqOiPeUWxaUZ2eNhSg02g=">AAAB8nicbVBNT8JAEJ3iF+IX6tHLRjDxRFo8qDeiF4+YWCGhTbNdFtiw3W52tyak4W948aDGq7/Gm//GBXpQ8CWTvLw3k5l5seRMG9f9dkpr6xubW+Xtys7u3v5B9fDoUaeZItQnKU9VN8aaciaob5jhtCsVxUnMaSce3878zhNVmqXiwUwkDRM8FGzACDZWCupBm0U5ldHFtB5Va27DnQOtEq8gNSjQjqpfQT8lWUKFIRxr3fNcacIcK8MIp9NKkGkqMRnjIe1ZKnBCdZjPb56iM6v00SBVtoRBc/X3RI4TrSdJbDsTbEZ62ZuJ/3m9zAyuwpwJmRkqyGLRIOPIpGgWAOozRYnhE0swUczeisgIK0yMjaliQ/CWX14lfrNx3fDum7XWTZFGGU7gFM7Bg0towR20wQcCEp7hFd6czHlx3p2PRWvJKWaO4Q+czx+AcJDf</latexit><latexit sha1_base64="7blVEvKqOiPeUWxaUZ2eNhSg02g=">AAAB8nicbVBNT8JAEJ3iF+IX6tHLRjDxRFo8qDeiF4+YWCGhTbNdFtiw3W52tyak4W948aDGq7/Gm//GBXpQ8CWTvLw3k5l5seRMG9f9dkpr6xubW+Xtys7u3v5B9fDoUaeZItQnKU9VN8aaciaob5jhtCsVxUnMaSce3878zhNVmqXiwUwkDRM8FGzACDZWCupBm0U5ldHFtB5Va27DnQOtEq8gNSjQjqpfQT8lWUKFIRxr3fNcacIcK8MIp9NKkGkqMRnjIe1ZKnBCdZjPb56iM6v00SBVtoRBc/X3RI4TrSdJbDsTbEZ62ZuJ/3m9zAyuwpwJmRkqyGLRIOPIpGgWAOozRYnhE0swUczeisgIK0yMjaliQ/CWX14lfrNx3fDum7XWTZFGGU7gFM7Bg0towR20wQcCEp7hFd6czHlx3p2PRWvJKWaO4Q+czx+AcJDf</latexit> ep1<latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit> ep2<latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit><latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit><latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit><latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit> ep3<latexit sha1_base64="CaMgem4iJdX/WSpcPmWVDNfHtLQ=">AAAB7HicbVA9TwJBEN3DL8Qv1NJmI5hYkTss1I5oY4mJByRwIXvLHKzs7V5290zIhf9gY6HG1h9k579xgSsUfMkkL+/NZGZemHCmjet+O4W19Y3NreJ2aWd3b/+gfHjU0jJVFHwquVSdkGjgTIBvmOHQSRSQOOTQDse3M7/9BEozKR7MJIEgJkPBIkaJsVKrCkn/otovV9yaOwdeJV5OKihHs1/+6g0kTWMQhnKidddzExNkRBlGOUxLvVRDQuiYDKFrqSAx6CCbXzvFZ1YZ4EgqW8Lgufp7IiOx1pM4tJ0xMSO97M3E/7xuaqKrIGMiSQ0IulgUpRwbiWev4wFTQA2fWEKoYvZWTEdEEWpsQCUbgrf88irx67XrmndfrzRu8jSK6ASdonPkoUvUQHeoiXxE0SN6Rq/ozZHOi/PufCxaC04+c4z+wPn8AedOjjc=</latexit><latexit sha1_base64="CaMgem4iJdX/WSpcPmWVDNfHtLQ=">AAAB7HicbVA9TwJBEN3DL8Qv1NJmI5hYkTss1I5oY4mJByRwIXvLHKzs7V5290zIhf9gY6HG1h9k579xgSsUfMkkL+/NZGZemHCmjet+O4W19Y3NreJ2aWd3b/+gfHjU0jJVFHwquVSdkGjgTIBvmOHQSRSQOOTQDse3M7/9BEozKR7MJIEgJkPBIkaJsVKrCkn/otovV9yaOwdeJV5OKihHs1/+6g0kTWMQhnKidddzExNkRBlGOUxLvVRDQuiYDKFrqSAx6CCbXzvFZ1YZ4EgqW8Lgufp7IiOx1pM4tJ0xMSO97M3E/7xuaqKrIGMiSQ0IulgUpRwbiWev4wFTQA2fWEKoYvZWTEdEEWpsQCUbgrf88irx67XrmndfrzRu8jSK6ASdonPkoUvUQHeoiXxE0SN6Rq/ozZHOi/PufCxaC04+c4z+wPn8AedOjjc=</latexit><latexit sha1_base64="CaMgem4iJdX/WSpcPmWVDNfHtLQ=">AAAB7HicbVA9TwJBEN3DL8Qv1NJmI5hYkTss1I5oY4mJByRwIXvLHKzs7V5290zIhf9gY6HG1h9k579xgSsUfMkkL+/NZGZemHCmjet+O4W19Y3NreJ2aWd3b/+gfHjU0jJVFHwquVSdkGjgTIBvmOHQSRSQOOTQDse3M7/9BEozKR7MJIEgJkPBIkaJsVKrCkn/otovV9yaOwdeJV5OKihHs1/+6g0kTWMQhnKidddzExNkRBlGOUxLvVRDQuiYDKFrqSAx6CCbXzvFZ1YZ4EgqW8Lgufp7IiOx1pM4tJ0xMSO97M3E/7xuaqKrIGMiSQ0IulgUpRwbiWev4wFTQA2fWEKoYvZWTEdEEWpsQCUbgrf88irx67XrmndfrzRu8jSK6ASdonPkoUvUQHeoiXxE0SN6Rq/ozZHOi/PufCxaC04+c4z+wPn8AedOjjc=</latexit><latexit sha1_base64="CaMgem4iJdX/WSpcPmWVDNfHtLQ=">AAAB7HicbVA9TwJBEN3DL8Qv1NJmI5hYkTss1I5oY4mJByRwIXvLHKzs7V5290zIhf9gY6HG1h9k579xgSsUfMkkL+/NZGZemHCmjet+O4W19Y3NreJ2aWd3b/+gfHjU0jJVFHwquVSdkGjgTIBvmOHQSRSQOOTQDse3M7/9BEozKR7MJIEgJkPBIkaJsVKrCkn/otovV9yaOwdeJV5OKihHs1/+6g0kTWMQhnKidddzExNkRBlGOUxLvVRDQuiYDKFrqSAx6CCbXzvFZ1YZ4EgqW8Lgufp7IiOx1pM4tJ0xMSO97M3E/7xuaqKrIGMiSQ0IulgUpRwbiWev4wFTQA2fWEKoYvZWTEdEEWpsQCUbgrf88irx67XrmndfrzRu8jSK6ASdonPkoUvUQHeoiXxE0SN6Rq/ozZHOi/PufCxaC04+c4z+wPn8AedOjjc=</latexit> ep1<latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit> ep2<latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit><latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit><latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit><latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit> ep3<latexit sha1_base64="CaMgem4iJdX/WSpcPmWVDNfHtLQ=">AAAB7HicbVA9TwJBEN3DL8Qv1NJmI5hYkTss1I5oY4mJByRwIXvLHKzs7V5290zIhf9gY6HG1h9k579xgSsUfMkkL+/NZGZemHCmjet+O4W19Y3NreJ2aWd3b/+gfHjU0jJVFHwquVSdkGjgTIBvmOHQSRSQOOTQDse3M7/9BEozKR7MJIEgJkPBIkaJsVKrCkn/otovV9yaOwdeJV5OKihHs1/+6g0kTWMQhnKidddzExNkRBlGOUxLvVRDQuiYDKFrqSAx6CCbXzvFZ1YZ4EgqW8Lgufp7IiOx1pM4tJ0xMSO97M3E/7xuaqKrIGMiSQ0IulgUpRwbiWev4wFTQA2fWEKoYvZWTEdEEWpsQCUbgrf88irx67XrmndfrzRu8jSK6ASdonPkoUvUQHeoiXxE0SN6Rq/ozZHOi/PufCxaC04+c4z+wPn8AedOjjc=</latexit><latexit sha1_base64="CaMgem4iJdX/WSpcPmWVDNfHtLQ=">AAAB7HicbVA9TwJBEN3DL8Qv1NJmI5hYkTss1I5oY4mJByRwIXvLHKzs7V5290zIhf9gY6HG1h9k579xgSsUfMkkL+/NZGZemHCmjet+O4W19Y3NreJ2aWd3b/+gfHjU0jJVFHwquVSdkGjgTIBvmOHQSRSQOOTQDse3M7/9BEozKR7MJIEgJkPBIkaJsVKrCkn/otovV9yaOwdeJV5OKihHs1/+6g0kTWMQhnKidddzExNkRBlGOUxLvVRDQuiYDKFrqSAx6CCbXzvFZ1YZ4EgqW8Lgufp7IiOx1pM4tJ0xMSO97M3E/7xuaqKrIGMiSQ0IulgUpRwbiWev4wFTQA2fWEKoYvZWTEdEEWpsQCUbgrf88irx67XrmndfrzRu8jSK6ASdonPkoUvUQHeoiXxE0SN6Rq/ozZHOi/PufCxaC04+c4z+wPn8AedOjjc=</latexit><latexit sha1_base64="CaMgem4iJdX/WSpcPmWVDNfHtLQ=">AAAB7HicbVA9TwJBEN3DL8Qv1NJmI5hYkTss1I5oY4mJByRwIXvLHKzs7V5290zIhf9gY6HG1h9k579xgSsUfMkkL+/NZGZemHCmjet+O4W19Y3NreJ2aWd3b/+gfHjU0jJVFHwquVSdkGjgTIBvmOHQSRSQOOTQDse3M7/9BEozKR7MJIEgJkPBIkaJsVKrCkn/otovV9yaOwdeJV5OKihHs1/+6g0kTWMQhnKidddzExNkRBlGOUxLvVRDQuiYDKFrqSAx6CCbXzvFZ1YZ4EgqW8Lgufp7IiOx1pM4tJ0xMSO97M3E/7xuaqKrIGMiSQ0IulgUpRwbiWev4wFTQA2fWEKoYvZWTEdEEWpsQCUbgrf88irx67XrmndfrzRu8jSK6ASdonPkoUvUQHeoiXxE0SN6Rq/ozZHOi/PufCxaC04+c4z+wPn8AedOjjc=</latexit><latexit sha1_base64="CaMgem4iJdX/WSpcPmWVDNfHtLQ=">AAAB7HicbVA9TwJBEN3DL8Qv1NJmI5hYkTss1I5oY4mJByRwIXvLHKzs7V5290zIhf9gY6HG1h9k579xgSsUfMkkL+/NZGZemHCmjet+O4W19Y3NreJ2aWd3b/+gfHjU0jJVFHwquVSdkGjgTIBvmOHQSRSQOOTQDse3M7/9BEozKR7MJIEgJkPBIkaJsVKrCkn/otovV9yaOwdeJV5OKihHs1/+6g0kTWMQhnKidddzExNkRBlGOUxLvVRDQuiYDKFrqSAx6CCbXzvFZ1YZ4EgqW8Lgufp7IiOx1pM4tJ0xMSO97M3E/7xuaqKrIGMiSQ0IulgUpRwbiWev4wFTQA2fWEKoYvZWTEdEEWpsQCUbgrf88irx67XrmndfrzRu8jSK6ASdonPkoUvUQHeoiXxE0SN6Rq/ozZHOi/PufCxaC04+c4z+wPn8AedOjjc=</latexit> Committed System States volatile state
  • 39. Synchronous Epoch Commits Coordinator Tasks computation idle
  • 40. Synchronous Epoch Commits Coordinator Tasks prepare ep1 ep1 prepared ep1<latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit> computation idle
  • 41. Synchronous Epoch Commits Coordinator Tasks prepare ep1 ep1 prepared ep1<latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit> computation idle Stable Storage commit ep1 ep1 committed ep1<latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit> ⇧ep1<latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit><latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit><latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit><latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit>
  • 42. Synchronous Epoch Commits Coordinator Tasks prepare ep1 ep1 prepared ep1<latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit> prepare ep2 ep2 prepared ep2<latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit><latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit><latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit><latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit> computation idle Stable Storage commit ep1 ep1 committed ep1<latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit> ⇧ep1<latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit><latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit><latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit><latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit>
  • 43. Synchronous Epoch Commits • Suitable for short-lived, stateless task execution (e.g., micro-batching on Spark) • A natural approach for reusing Map-Reduce technology for continuous processing. • Problem: Unnecessary high latency in long-running task execution • Cause: Blocking synchronisation (idle time) - coordination & epoch scheduling.
  • 44. Asynchronous Epoch Commits Coordinator Tasks prepare ep1 prepare ep2 Stable Storage ep1 prepared ep2 prepared ⇧ep2<latexit sha1_base64="vzNrz845O3CFc8UPEV9DQuQriPs=">AAAB8nicbVA9T8MwEHXKVylfBUYWixaJqUq6AFsFC2ORCFRqoshxL61Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuKPg045nqxUQDZwJ8wwyHnlRA0pjDYzy+mfmPT6A0y8S9mUgIUzIULGGUGCsFzaDLogJk1J42o3rDbblz4FXilaSBSnSj+lcwyGiegjCUE637nitNWBBlGOUwrQW5BknomAyhb6kgKeiwmN88xWdWGeAkU7aEwXP190RBUq0naWw7U2JGetmbif95/dwkl2HBhMwNCLpYlOQcmwzPAsADpoAaPrGEUMXsrZiOiCLU2JhqNgRv+eVV4rdbVy3vrt3oXJdpVNEJOkXnyEMXqINuURf5iCKJntErenNy58V5dz4WrRWnnDlGf+B8/gB+65De</latexit><latexit sha1_base64="vzNrz845O3CFc8UPEV9DQuQriPs=">AAAB8nicbVA9T8MwEHXKVylfBUYWixaJqUq6AFsFC2ORCFRqoshxL61Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuKPg045nqxUQDZwJ8wwyHnlRA0pjDYzy+mfmPT6A0y8S9mUgIUzIULGGUGCsFzaDLogJk1J42o3rDbblz4FXilaSBSnSj+lcwyGiegjCUE637nitNWBBlGOUwrQW5BknomAyhb6kgKeiwmN88xWdWGeAkU7aEwXP190RBUq0naWw7U2JGetmbif95/dwkl2HBhMwNCLpYlOQcmwzPAsADpoAaPrGEUMXsrZiOiCLU2JhqNgRv+eVV4rdbVy3vrt3oXJdpVNEJOkXnyEMXqINuURf5iCKJntErenNy58V5dz4WrRWnnDlGf+B8/gB+65De</latexit><latexit sha1_base64="vzNrz845O3CFc8UPEV9DQuQriPs=">AAAB8nicbVA9T8MwEHXKVylfBUYWixaJqUq6AFsFC2ORCFRqoshxL61Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuKPg045nqxUQDZwJ8wwyHnlRA0pjDYzy+mfmPT6A0y8S9mUgIUzIULGGUGCsFzaDLogJk1J42o3rDbblz4FXilaSBSnSj+lcwyGiegjCUE637nitNWBBlGOUwrQW5BknomAyhb6kgKeiwmN88xWdWGeAkU7aEwXP190RBUq0naWw7U2JGetmbif95/dwkl2HBhMwNCLpYlOQcmwzPAsADpoAaPrGEUMXsrZiOiCLU2JhqNgRv+eVV4rdbVy3vrt3oXJdpVNEJOkXnyEMXqINuURf5iCKJntErenNy58V5dz4WrRWnnDlGf+B8/gB+65De</latexit><latexit sha1_base64="vzNrz845O3CFc8UPEV9DQuQriPs=">AAAB8nicbVA9T8MwEHXKVylfBUYWixaJqUq6AFsFC2ORCFRqoshxL61Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuKPg045nqxUQDZwJ8wwyHnlRA0pjDYzy+mfmPT6A0y8S9mUgIUzIULGGUGCsFzaDLogJk1J42o3rDbblz4FXilaSBSnSj+lcwyGiegjCUE637nitNWBBlGOUwrQW5BknomAyhb6kgKeiwmN88xWdWGeAkU7aEwXP190RBUq0naWw7U2JGetmbif95/dwkl2HBhMwNCLpYlOQcmwzPAsADpoAaPrGEUMXsrZiOiCLU2JhqNgRv+eVV4rdbVy3vrt3oXJdpVNEJOkXnyEMXqINuURf5iCKJntErenNy58V5dz4WrRWnnDlGf+B8/gB+65De</latexit> commit ep1 commit ep1 ⇧ep1<latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit><latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit><latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit><latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit> ep1<latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit> ep2<latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit><latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit><latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit><latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit>
  • 45. Asynchronous Epoch Commits Coordinator Tasks prepare ep1 prepare ep2 Stable Storage ep1 prepared ep2 prepared ⇧ep2<latexit sha1_base64="vzNrz845O3CFc8UPEV9DQuQriPs=">AAAB8nicbVA9T8MwEHXKVylfBUYWixaJqUq6AFsFC2ORCFRqoshxL61Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuKPg045nqxUQDZwJ8wwyHnlRA0pjDYzy+mfmPT6A0y8S9mUgIUzIULGGUGCsFzaDLogJk1J42o3rDbblz4FXilaSBSnSj+lcwyGiegjCUE637nitNWBBlGOUwrQW5BknomAyhb6kgKeiwmN88xWdWGeAkU7aEwXP190RBUq0naWw7U2JGetmbif95/dwkl2HBhMwNCLpYlOQcmwzPAsADpoAaPrGEUMXsrZiOiCLU2JhqNgRv+eVV4rdbVy3vrt3oXJdpVNEJOkXnyEMXqINuURf5iCKJntErenNy58V5dz4WrRWnnDlGf+B8/gB+65De</latexit><latexit sha1_base64="vzNrz845O3CFc8UPEV9DQuQriPs=">AAAB8nicbVA9T8MwEHXKVylfBUYWixaJqUq6AFsFC2ORCFRqoshxL61Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuKPg045nqxUQDZwJ8wwyHnlRA0pjDYzy+mfmPT6A0y8S9mUgIUzIULGGUGCsFzaDLogJk1J42o3rDbblz4FXilaSBSnSj+lcwyGiegjCUE637nitNWBBlGOUwrQW5BknomAyhb6kgKeiwmN88xWdWGeAkU7aEwXP190RBUq0naWw7U2JGetmbif95/dwkl2HBhMwNCLpYlOQcmwzPAsADpoAaPrGEUMXsrZiOiCLU2JhqNgRv+eVV4rdbVy3vrt3oXJdpVNEJOkXnyEMXqINuURf5iCKJntErenNy58V5dz4WrRWnnDlGf+B8/gB+65De</latexit><latexit sha1_base64="vzNrz845O3CFc8UPEV9DQuQriPs=">AAAB8nicbVA9T8MwEHXKVylfBUYWixaJqUq6AFsFC2ORCFRqoshxL61Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuKPg045nqxUQDZwJ8wwyHnlRA0pjDYzy+mfmPT6A0y8S9mUgIUzIULGGUGCsFzaDLogJk1J42o3rDbblz4FXilaSBSnSj+lcwyGiegjCUE637nitNWBBlGOUwrQW5BknomAyhb6kgKeiwmN88xWdWGeAkU7aEwXP190RBUq0naWw7U2JGetmbif95/dwkl2HBhMwNCLpYlOQcmwzPAsADpoAaPrGEUMXsrZiOiCLU2JhqNgRv+eVV4rdbVy3vrt3oXJdpVNEJOkXnyEMXqINuURf5iCKJntErenNy58V5dz4WrRWnnDlGf+B8/gB+65De</latexit><latexit sha1_base64="vzNrz845O3CFc8UPEV9DQuQriPs=">AAAB8nicbVA9T8MwEHXKVylfBUYWixaJqUq6AFsFC2ORCFRqoshxL61Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuKPg045nqxUQDZwJ8wwyHnlRA0pjDYzy+mfmPT6A0y8S9mUgIUzIULGGUGCsFzaDLogJk1J42o3rDbblz4FXilaSBSnSj+lcwyGiegjCUE637nitNWBBlGOUwrQW5BknomAyhb6kgKeiwmN88xWdWGeAkU7aEwXP190RBUq0naWw7U2JGetmbif95/dwkl2HBhMwNCLpYlOQcmwzPAsADpoAaPrGEUMXsrZiOiCLU2JhqNgRv+eVV4rdbVy3vrt3oXJdpVNEJOkXnyEMXqINuURf5iCKJntErenNy58V5dz4WrRWnnDlGf+B8/gB+65De</latexit> How? Using Snapshots commit ep1 commit ep1 ⇧ep1<latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit><latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit><latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit><latexit sha1_base64="13X43LlxALZO4plvf4mQ9wmgz9Y=">AAAB8nicbVA9T8MwEL2Ur1K+CowsFi0SU5V0AbYKFsYiEajURJHjOq1Vx7FsB6mK+jdYGACx8mvY+De4bQZoedJJT+/d6e5eLDnTxnW/ncra+sbmVnW7trO7t39QPzx60FmuCPVJxjPVi7GmnAnqG2Y47UlFcRpz+hiPb2b+4xNVmmXi3kwkDVM8FCxhBBsrBc2gy6KCysibNqN6w225c6BV4pWkASW6Uf0rGGQkT6kwhGOt+54rTVhgZRjhdFoLck0lJmM8pH1LBU6pDov5zVN0ZpUBSjJlSxg0V39PFDjVepLGtjPFZqSXvZn4n9fPTXIZFkzI3FBBFouSnCOToVkAaMAUJYZPLMFEMXsrIiOsMDE2ppoNwVt+eZX47dZVy7trNzrXZRpVOIFTOAcPLqADt9AFHwhIeIZXeHNy58V5dz4WrRWnnDmGP3A+fwB9ZpDd</latexit> ep1<latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit><latexit sha1_base64="v65U5OrQoaYDLtbrHtJwUMc3exA=">AAAB7HicbVA9TwJBEJ3zE/ELtbTZCCZW5I5G7Yg2lph4QAIXsrcMsLJ3e9ndMyEX/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlhIrg2rvvtrK1vbG5tF3aKu3v7B4elo+Omlqli6DMppGqHVKPgMfqGG4HtRCGNQoGtcHw781tPqDSX8YOZJBhEdBjzAWfUWKlZwaTnVXqlslt15yCrxMtJGXI0eqWvbl+yNMLYMEG17nhuYoKMKsOZwGmxm2pMKBvTIXYsjWmEOsjm107JuVX6ZCCVrdiQufp7IqOR1pMotJ0RNSO97M3E/7xOagZXQcbjJDUYs8WiQSqIkWT2OulzhcyIiSWUKW5vJWxEFWXGBlS0IXjLL68Sv1a9rnr3tXL9Jk+jAKdwBhfgwSXU4Q4a4AODR3iGV3hzpPPivDsfi9Y1J585gT9wPn8A5EaONQ==</latexit> ep2<latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit><latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit><latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit><latexit sha1_base64="z9CVsa1AwNEQL3Y4wGwyBT8FqxM=">AAAB7HicbVA9TwJBEJ3zE/ELtbS5CCZW5I5G7Yg2lph4QAIXsrfMwcre7mV3z4QQ/oONhRpbf5Cd/8YFrlDwJZO8vDeTmXlRypk2nvftrK1vbG5tF3aKu3v7B4elo+OmlpmiGFDJpWpHRCNnAgPDDMd2qpAkEcdWNLqd+a0nVJpJ8WDGKYYJGQgWM0qMlZoVTHu1Sq9U9qreHO4q8XNShhyNXumr25c0S1AYyonWHd9LTTghyjDKcVrsZhpTQkdkgB1LBUlQh5P5tVP33Cp9N5bKljDuXP09MSGJ1uMksp0JMUO97M3E/7xOZuKrcMJEmhkUdLEozrhrpDt73e0zhdTwsSWEKmZvdemQKEKNDahoQ/CXX14lQa16XfXva+X6TZ5GAU7hDC7Ah0uowx00IAAKj/AMr/DmSOfFeXc+Fq1rTj5zAn/gfP4A5cqONg==</latexit>