HW09 Hadoop Vaidya

Hadoop Vaidya Viraj Bhat ( [email_address] ) Suhas Gogate ( [email_address] ) Milind Bhandarkar ( [email_address] ) Cloud Computing & Data Infrastructure Group, Yahoo! Inc. Hadoop World October 2, 2009

Hadoop & Job Optimization: Why ? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Hadoop Vaidya -- Rule based performance diagnostics Tool ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Vaidya : An expert (versed in his own profession , esp. in medical science) , skilled in the art of healing , a physician

Hadoop Vaidya : Status ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Diagnostic Test Rule ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Diagnostic Report Element ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Hadoop Vaidya Rules - Examples ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Performance Analysis for sample set of Jobs Vaidya Rules Total jobs analyzed = 794

Future Enhancements ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Results of Hadoop Vaidya ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

HW09 Hadoop Vaidya

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

Andere mochten auch

Andere mochten auch (19)

Ähnlich wie HW09 Hadoop Vaidya

Ähnlich wie HW09 Hadoop Vaidya (20)

Mehr von Cloudera, Inc.

Mehr von Cloudera, Inc. (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

HW09 Hadoop Vaidya