Dryad Paper Review and System Analysis

Dryad: Distributed Data-Parallel Programs from Sequential Building Blocks EuroSys'07 by Microsoft Research https://twitter.com/nourlcn

What's Dryad? ,[object Object],[object Object],[object Object],[object Object]

Outline ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

motivation ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Why Dryad ？ ,[object Object],[object Object],[object Object]

Dryad 假设前提 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

系统结构 ,[object Object],[object Object],[object Object],[object Object]

Dryad Details Outline ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Dryad Responsibility ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Dryad Application ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Job Manager ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Name Server ,[object Object],[object Object]

Vertices ,[object Object],[object Object],[object Object],[object Object],[object Object]

Channel 1. 定义 edges 时，可以定义适用的 protocol 2. 使用 TCP pipe 可能会发生死锁，原因： TCP pipe 需要 Vertics 同步执行，一方可能失效。

Vertices Program ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Run-time graph refinement ,[object Object]

[object Object],[object Object],[object Object],[object Object]

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

[object Object],对大部分应用来说，存在一类等价的 Graph 计算后结果相同

Fault Tolerance ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

SQL Query ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Evaluation ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Evaluation ,[object Object],共同： 1.Node S to Node Y ，使用 in-memory 方式进行 communication 2. 程序几乎相同

忽略的地方 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Contribution ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

评价 - 优点 ,[object Object],[object Object],[object Object],[object Object],[object Object]

评价 - 缺点 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

[object Object],[object Object]

Dryad Paper Review and System Analysis

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

Andere mochten auch

Andere mochten auch (17)

Ähnlich wie Dryad Paper Review and System Analysis

Ähnlich wie Dryad Paper Review and System Analysis (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

Dryad Paper Review and System Analysis