Diese Präsentation wurde erfolgreich gemeldet.
Wir verwenden Ihre LinkedIn Profilangaben und Informationen zu Ihren Aktivitäten, um Anzeigen zu personalisieren und Ihnen relevantere Inhalte anzuzeigen. Sie können Ihre Anzeigeneinstellungen jederzeit ändern.

Crap. Your Big Data Kitchen Is Broken.

283 Aufrufe

Veröffentlicht am

These slides look into handling massive of unstructured data in a cloud-native manner.

Veröffentlicht in: Technologie
  • Als Erste(r) kommentieren

  • Gehören Sie zu den Ersten, denen das gefällt!

Crap. Your Big Data Kitchen Is Broken.

  1. 1. @renatc 4 Levels of IoT Maturity Cloud Foundry IoT Case Study Open Source App Samples With Renat Khasanshyn CEO, Altoros @renatco Crap. Your Big Data Kitchen is Broken A tale of raw data becoming a gourmet meal, served restaurant-style. Did I say Cloud Foundry?
  2. 2. @renatc So, why am I here? You all know how to store and access data at scale
  3. 3. @renatco Problem #1 Unstructured and structured data are colliding at an accelerating pace. Your company will perish in 15 years or less, if the amount of time it takes in your company to “refine” data into APIs, APIs into apps, and apps into decisions is slower than 80% of your competitors.
  4. 4. @renatco "Your major competitor in 10 years - if you survive that long - probably does not exist today” Steve Prentice Vice President and Gartner Fellow
  5. 5. @renatco Company-wide discovery & real-time provisioning of data, APIs and web services do not exist in 95% of companies. Problem #2: this isn’t helpful to end users
  6. 6. @renatco “The hard part isn't crunching the data; it's connecting all the systems needed to paint a complete data picture.” Richard Soley CEO at OMG & Director of the Industrial Internet Consortium
  7. 7. @renatco Too many devices. Too few developers. Connected devicesSoftware developers • 2013: 6 billion • 2018: 20 billion • 333% increase • 2013: 18 million • 2019: 26 million • 45% increase Source: Evans Data Corporation - Global Developer Population and Demographic Study 2013 Source: Business Insider Intelligence - The Internet Of Everything: 2014
  8. 8. @renatco IT & Security groups at organizations often control and sometimes block company-wide data/API sharing Problem #3: good news - they gave us “a cloud” for real-time provisioning of VMs!!!
  9. 9. @renatco ”Sensor-based diagnostic and predictive analytics, the biggest technology opportunity for the next 10 or 15 years, is not moving as fast as I would like” Lynden Tennison, CIO Union Pacific
  10. 10. Production releases take months!
  11. 11. @renatco How can we fix the kitchen?
  12. 12. @renatco Part 1. Why should I believe you? ❑ Who is Altoros? ❑ Where is this coming from? Part 2. Four levels of IoT maturity in organizations ❑ Raw data becoming a gourmet meal Part 3. The Fourth Level Platform ❑ What makes Cloud Foundry unique? ❑ Application examples: – Node Red Where I will take you today
  13. 13. Part 1 Why should I believe you?
  14. 14. * Buenos Aires Oslo London Zurich Sunnyvale, CA Copenhagen Minsk Santa Fe Boston 30%Female 70%Male +5Join us on an average month Full Time Enablers DevOps Software Engineers 256+ FACTS ON ALTOROS
  15. 15. * WHAT WE DO We bring “software assembly lines” into organizations through deployment and integration of solutions offered by the Cloud Foundry ecosystem Training Managed ServicesConsulting Integration Delivered by Altoros Delivered by Pivotal & Pivotal Ecosystem
  16. 16. @renatco * Customers We highly recommend Altoros to rapidly build complex applications using cutting edge technologies. Again, great job! Christopher Adorna, Sony Design Center, LA “ Enablement of X-as-Service Cloud Foundry training and integration Enablement of X-as-Service Integration with Cloud Foundry & IaaS Enterprises Software Companies
  17. 17. Part 2 Raw data becoming a gourmet meal. Restaurant-style.
  18. 18. @renatco Tale of raw data
  19. 19. @renatco
  20. 20. STORING/ACCESSING RAW DATA (NoSQL, Hadoop) = COST OF COMPUTE Cost of storing and accessing raw data at scale
  21. 21. @renatco Raw data in your database
  22. 22. @renatco Data aggregates
  23. 23. @renatco APIs just like home- cooked meals
  24. 24. @renatco API discovery & provisioning. Restaurant-style.
  25. 25. RAW FOOD FROZEN MEALS KITCHEN RESTAURANT-STYLE From raw data to serving it in style AGGREGATES APIs API DISCOVERY, PROVISIONING & POLICY ENFORCEMENT RAW DATA IN A DATABASE
  26. 26. RAW FOOD FROZEN MEALS RAW DATA AGGREGATES Cloud Foundry means KITCHEN RESTAURANT-STYLE APIs API DISCOVERY, PROVISIONING & POLICY ENFORCEMENT
  27. 27. Back-end of IoT: IaaS vs Cloud Foundry PaaS IaaS Cloud Foundry PaaSFeatures Days Centralized service by PaaS, for any app Use a simple CLI: $ cf bind service Restful API Weeks or months Architects link each app to IaaS APIs Dev-ops requests None. Build your own? None. Build your own? IoT apps, APIs go live IoT apps, APIs Scalability & HA Effort to provision access to APIs Metering of API usage Policy enforcement via API? Restful API
  28. 28. Part 3 Cloud Foundry + IoT Case Study
  29. 29. Cloud Foundry to Save Lives? 15,000 employees, $4B revenue, member of S&P 500 Technical challenge: 300,000 devices in 800+ hospitals across 4500+ locations #1 liquid intravenous drug & medical device (IV pump) company
  30. 30. @renatco *
  31. 31. @renatco * The problem: Human is still required to manually operate and monitor 14 infusion pumps due to high cost of making monitoring applications redundant AND highly available AND scalable AND portable AND secure
  32. 32. @renatco * People who died or got injured under IV procedure YESTERDAY and every day in the last 5 years: due to wrong drug, wrong IV pump, wrong quantity 300
  33. 33. @renatco * Problem: a redundant AND highly available, AND scalable, AND portable, AND secure big data apps & “micro cloud” hardware appliance + systems integration used to cost each hospital $5,000,000… that’s why only 2 hospital networks can afford it $$$
  34. 34. @renatco * Opportunity Save lives. Every day.
  35. 35. @renatco * Becoming a software company with Software-defined Drug Delivery ~300,000 IV pumps Daily Data Intake 7TB
  36. 36. @renatco * *Can we change economics by 15x? How can we deliver a redundant AND highly available, AND scalable, AND portable, AND secure big data apps & “micro cloud” hardware appliance + systems integration for $30k instead of $5,000,000, per hospital?
  37. 37. @renatco * Single architecture, one micro-cloud appliance for all deployment locations Cloud Foundry RabbitMQ Cassandra MariaDB Regional Data Center1 Hospital 1Regional Data Center2 Hospital n Deployment map - 1000 hospitals? Hosted *aaS for hospitals with redundant Internet/power $30k 3U appliance for hospitals that can’t use *aaS
  38. 38. * Result: First to market. First order. Potential net new revenue - $0.5B
  39. 39. *
  40. 40. @renatco * Good story... What is next? Predict pump failure. Save even more people.
  41. 41. ”Sensor-based diagnostic and predictive analytics, the biggest technology opportunity for the next 10 or 15 years, is not moving as fast as I would like” Lynden Tennison, CIO Union Pacific
  42. 42. Part 3: A few open-source apps for your next IoT project
  43. 43. Check out: http://www.nodered.org
  44. 44. © 2014 Apigee Confidential – All Rights Reserved Check out: http://www.zettajs.org/ Follow on Twitter: @zettajs Check out: http://www.zettajs.org
  45. 45. @renatc With Renat Khasanshyn CEO, Altoros @renatco Questions? Suggestions? Need advice with POC? renat.k@altoros.com Tel. (650) 395-7002

×