Putting Hadoop on any Cloud. NATI SHALOM at Big Data Spain 2012

•Als PPTX, PDF herunterladen•

0 gefällt mir•627 views

Session presented at Big Data Spain 2012 Conference 16th Nov 2012 ETSI Telecomunicacion UPM Madrid www.bigdataspain.org More info: http://www.bigdataspain.org/es-2012/conference/putting-hadoop-cloud/nati-shalom

Technologie

http://code.zynga.com/2012/02/the-evolution-of-zcloud/

http://code.mixpanel.com/2010/11/08/amazon-vs-rackspace/

Realization:
What You
Really Care
about Is
App
Portability

http://techblog.netflix.com/2012/07/benchmarking-high-performance-io-with.html

• Auto start VMs
• Install and configure
app components
• Monitor
• Repair
• (Auto) Scale
• Burst…

Making the
deployment,
installation, scaling, fail-
over looks the same
through the entire stack

Running Bare-Metal for
high I/O workload, Public
cloud for sporadic
workloads ..

• Available under
different distributions
• Cloudera
• IBM BigInsights
• MapR
• Hortonworks

• Run on Any Cloud
Putting • Consistent MGT
• Dynamic Scaling
Cloudify and
• Auto Recovery
Hadoop • Auto Scaling
Together • Role Assignments
• Monitoring
• Simple maintenance

http://www.cloudifysource.org
http://github.com/CloudifySource
https://github.com/CloudifySource/cloudify-
recipes/tree/master/services/biginsights

Weitere ähnliche Inhalte

Was ist angesagt?

Building 3D Models with Skycatch & Autodesk Recap API's

Christopher Bumgardner

Mainframe to Serverless Architectures

Maksim Djackov

Next-Generation Server Architecture

RightScale

San Diego VMUG Oct 2009

Carter Shanklin

Deploying, Scaling, and Managing Many Instances of SugarCRM in the Cloud

Tobias Kunze Briseño

Everybody is talking about the Cloud, how it offers infinite scalability and storage and makes it trivial to run hundreds of load balanced servers. Those of us who are not Zynga or Netflix are generally concerned with more down-to-earth issues such as how to maintain up to date backups, keep an eye on monitoring and minimizing the costs of running our applications in the cloud. This presentation will walk attendees through the tools and services available from the Amazon Cloud and how they can be leveraged to host and manage SugarCRM in the Cloud. It will draw from our experience packaging BitNami stacks, which have been deployed millions of times and power the leading commercial open source companies, including SugarCRM. Presented by Daniel Lopez, Founder and CTO, BitRock, at SugarCon 2011.

Sweet! Running SugarCRM on the Amazon Cloud | SugarCon 2011

SugarCRM

The idea of building and running applications without thinking about the servers (aka serverless computing) is a developer's dream come true. AWS expert Rich Morrow shared this slide deck during his webinar "How to Build a Web Server with AWS Lambda”. He discussed the benefits of using serverless computing: Different architectures that use serverless computing. How AWS services, like Lambda, S3, API Gateway and DynamoDB work together to enable faster and more flexible application deployment and management. Advantages of SAM (Serverless Application Model) Lambda, S3, API Gateway overview Sample architectures (review 2-3 architectures involving those services)

How to Build a Web Server with AWS Lambda

Global Knowledge Training

Microsoft Azure Developer Camp - Modern Computing in Azure

Lukasz Kaluzny

VMs containers and serverless

Rishidot Research

Build A Cloud Day London - Introduction

ShapeBlue

WebCL

Tomi Aarnio

Building Clouds with Apache CloudStack - the business use-cases

ShapeBlue

Microservices without servers

99X Technology

While building and training Machine Learning models, many of us face this question of "Which of the algorithm or library fits well with my model?". To answer this you will create multiple estimators and then come to a conclusion. How about finding the right FIT for your data in one go? and also save the compute as well with Serverless Cloud Functions. This interactive session walks you through the process of building a predictive machine learning model, deploying it as an API to be used in applications, testing the model. All of this happening in an integrated and unified self-service experience on IBM Cloud. Also, You will create multiple python serverless actions using different ML libraries and algorithms which will be invoked in one go, saving the results for you to chose the BEST FIT. In short, Machine Learning models exposed as APIs with serverless python action acting as a middleware to invoke the action.Thus bringing the best of Containers through Serverless and Machine learning together.

Serverless + Machine Learning – Bringing the best of two worlds together

Vidyasagar Machupalli

How NYTimes.com uses Amazon Web Services - AWS Summit 2011

Vadim Jelezniakov

Continuous Delivery: How RightScale Releases Weekly

RightScale

Creating autocomplete with elastic search on google cloud

Zareef Ahmed

Serverless Architecture - introduction + AWS demo

Jan van Zoggel

Was ist angesagt? (18)

Building 3D Models with Skycatch & Autodesk Recap API's

Mainframe to Serverless Architectures

Next-Generation Server Architecture

San Diego VMUG Oct 2009

Deploying, Scaling, and Managing Many Instances of SugarCRM in the Cloud

Sweet! Running SugarCRM on the Amazon Cloud | SugarCon 2011

How to Build a Web Server with AWS Lambda

Microsoft Azure Developer Camp - Modern Computing in Azure

VMs containers and serverless

Build A Cloud Day London - Introduction

WebCL

Building Clouds with Apache CloudStack - the business use-cases

Microservices without servers

Serverless + Machine Learning – Bringing the best of two worlds together

How NYTimes.com uses Amazon Web Services - AWS Summit 2011

Continuous Delivery: How RightScale Releases Weekly

Creating autocomplete with elastic search on google cloud

Serverless Architecture - introduction + AWS demo

Andere mochten auch

Ec2009 Templates

Ulrich Krause

Kelompok ekonomi

Natalewi Fransiska

Sermon Notes Creation Care

P4X

Building a plugin for the Notes client is hard and you need to be a rocket scientist to write a simple menu extension. This is exactly, what I thought, when I first heard of plugin development. In this session, you will learn, how to setup an Eclipse environment, connect it to your Notes Client for debugging and testing, and finally deploy your plugin to your users. Become familiar with the basics, and you will no longer be scared.

Dr. Strangelove, or how I learned to love plugin development

Ulrich Krause

Jahresbericht 2014 - BIMS e.V.

BIMS e.V.

Jahrensbericht 2012 - BIMS e.V.

BIMS e.V.

CloudMC: A cloud computing map-reduce implementation for radiotherapy. RUBEN ...

Big Data Spain

Intro to the Big Data Spain 2014 conference

Big Data Spain

The workshop will illustrate a number of techniques for data modelling that help us extend our small data capabilities to the world of big data: sampling, resampling, parallelization where possible, etc. We will leverage the functional architecture of R and its statistical analysis prowess in small data environments using the mapreduce technique embedded in Hadoop to tackle large data analysis problems. Particular attention will be paid to the ubiquitous --but non-scalable-- logistic regression technique and its big data alternatives.

Workshop - Hadoop + R by CARLOS GIL BELLOSTA at Big Data Spain 2013

Big Data Spain

Memory efficient applications. FRANCESC ALTED at Big Data Spain 2012

Big Data Spain

Architecture to Scale. DONN ROCHETTE at Big Data Spain 2012

Big Data Spain

Crunching Data with Google BigQuery. JORDAN TIGANI at Big Data Spain 2012

Big Data Spain

Health Insurance Predictive Analysis with Hadoop and Machine Learning. JULIEN...

Big Data Spain

Andere mochten auch (13)

Ec2009 Templates

Kelompok ekonomi

Sermon Notes Creation Care

Dr. Strangelove, or how I learned to love plugin development

Jahresbericht 2014 - BIMS e.V.

Jahrensbericht 2012 - BIMS e.V.

CloudMC: A cloud computing map-reduce implementation for radiotherapy. RUBEN ...

Intro to the Big Data Spain 2014 conference

Workshop - Hadoop + R by CARLOS GIL BELLOSTA at Big Data Spain 2013

Memory efficient applications. FRANCESC ALTED at Big Data Spain 2012

Architecture to Scale. DONN ROCHETTE at Big Data Spain 2012

Crunching Data with Google BigQuery. JORDAN TIGANI at Big Data Spain 2012

Health Insurance Predictive Analysis with Hadoop and Machine Learning. JULIEN...

Ähnlich wie Putting Hadoop on any Cloud. NATI SHALOM at Big Data Spain 2012

Cassandra summit - Big Data Apps on the cloud

Uri Cohen

Whether you are launching a simple website or a scaled application, time to go live is a key consideration for your business. Amazon Lightsail is the easiest way to get started on AWS, letting you build and scale your infrastructure faster. In this session, we will walk you through how to use Lightsail to launch your application with a few clicks and scale it as needed for redundancy, traffic spikes, or intergalactic attack. With in-browser SSH and RDP access, easy server management, and in-console guidance, Lightsail provides all the tools needed for builders of all levels – no prior AWS experience required.

Simple Cloud with Amazon Lightsail - Mike Coleman

Amazon Web Services

The Elephant in the Cloud: Bring True Cloud Economics to Hadoop/BigInsights The massive computing and storage resources that are needed to support big data deployments in general and Hadoop in particular make cloud environments, public and private, an ideal fit. Managing your big data app, however, is no walk in the park - especially if your considering the fact that these systems and application stacks often include other services beyond Hadoop such as: relational databases, other NoSQL databases and more, where each framework comes with its own management, installation, configuration, and scaling solutions. This is where Cloudify fits in. Cloudify provides consistent management that makes the provisioning, deployment, scaling of your Hadoop system simple and consistent with the rest of your stack and cloud portability between bare-metal and public cloud offering for Hadoop/BigInsights making it possible to run Hadoop on the right cloud for the Job: public/virtualized environment for on-demand workloads and bare-metal for I/O intensive operations.

The Elephant in the Cloud: Bring True Cloud Economics to Hadoop/BigInsights

Nati Shalom

Cloud, Docker, Bluemix, and DevOps. You feel the pressure of a hyper-competitive marketplace, and you want to win. Your goal is to deliver apps to that make your users happy and excited about your brand and products, but how do you do that? In this talk, we'll provide a technical briefing for how you can use a DevOps-enabled toolchain to deliver your apps with speed and reliability to the cloud platform of your choice. We'll review how UrbanCode Deploy can deliver your applications to OpenStack, IBM SoftLayer, Amazon, and VMWare with a consistent and portable Infrastructure-as-a-Service approach; or how you can use Containers and Cloud Foundry for app tiers that change potentially many times a day. Come take a look and ask your questions, and hopefully come away with a game plan to improve your delivery process today.

How do you deliver your applications to the cloud?

Michael Elder

Ed Burns brings his seventeen years of server side Java experience to bear on the topic of Enterprise Java on Microsoft Azure. Before the advent of cloud infrastructure, the stack was the main thing. This gave rise to many entertaining platform wars, and even personality feuds among the principals. Spring or J2EE? Spring MVC or JSF (or Struts/Wicket/Tapestry/WebWork...)? Spring REST or JAX-RS? Spring DI orCDI? Spring Boot or MicroProfile? Single-vendor proprietary de-facto standard or multi-vendor community developed standard? Ed has seen these "wars" come and go, and even fought in some of them. While "wars" make for great conference talks, blog posts, and articles, at the end of the day creating business value is the whole point of enterprise Java. Ed contends that nowadays, the cloud vendor is the main thing, and the best cloud vendor is one that best supports "all of the above", from lift and shift of existing workloads, to lift and improve, on through to turn-key PaaS solutions. This session will briefly survey the history of enterprise Java to establish the need for an "all of the above" enterprise cloud platform, examine some ways enterprises can use the current offerings from Microsoft Azure, and give a peek into what's in store in the near future.

Wars I’ve SeenFrom Java EE to Spring and more, Azure has you covered

Edward Burns

Gorillas in the mist

Sriram Subramanian

Digital transformation includes replatforming applications to streamline release cycles, improve availability, and manage apps and services at scale. But many enterprises are afraid to take the first step because they don’t know where to start. In this webinar, Rohit will provide a step-by-step guide that covers: ● How to find high-value modernization projects within your application portfolio ● Easy tools and techniques to minimally change applications in preparation for replatforming ● How to choose the platform with the right level of abstraction for your app ● Examples that show how Java EE Websphere applications can be deployed to Pivotal Cloud Foundry Speaker: Rohit Kelapure, Pivotal Consulting Practice Lead

Tools and Recipes to Replatform Monolithic Apps to Modern Cloud Environments

VMware Tanzu

Stay productive while slicing up the monolith

Markus Eisele

"Google's ability to build, organize, and operate a huge network of servers and fiber-optic cables with an efficiency and speed that rocks physics on its heels. This is what makes Google Google: its physical network, its thousands of fiber miles, and those many thousands of servers that, in aggregate, add up to the mother of all clouds.” - Wired --- Well, Wired hit the nail on the head with this quote about our platform. In this presentation we cover most of the new interesting features that will give you the ability to scale with (a big) smile!

Google Cloud - Scale With A Smile (Dec 2014)

Ido Green

FLUX - Crash Course in Cloud 2.0

Mark Hinkle

Getting Started with MariaDB with Docker

MariaDB plc

Combining Docker, cloud infrastructure, and continuous integration and delivery practices can create a highly automated and efficient way to get new applications and features to market. The RightScale development team has been using Docker from development to continuous integration, and now the operations team has taken Docker into the production environment. The Docker in Production: How RightScale Delivers Cloud Applications webinar will cover: Approach and use case for adopting Docker How RightScale has adopted Docker for development, CI, and production Overcoming technical and process challenges The RightScale process before and after Docker Benefits for both developers and operations teams

Docker in Production: How RightScale Delivers Cloud Applications

RightScale

Stay productive while slicing up the monolith

Markus Eisele

Ed Burns brings his seventeen years of server side Java experience to bear on the topic of Enterprise Java on Microsoft Azure. Before the advent of cloud infrastructure, the stack was the main thing. This gave rise to many entertaining platform wars, and even personality feuds among the principals. Spring or J2EE? Spring MVC or JSF (or Struts/Wicket/Tapestry/WebWork...)? Spring REST or JAX-RS? Spring DI or CDI? Spring Boot or MicroProfile? Single-vendor proprietary de-facto standard or multi-vendor community developed standard? Ed has seen these "wars" come and go, and even fought in some of them. While "wars" make for great conference talks, blog posts, and articles, at the end of the day creating business value is the whole point of enterprise Java. Ed contends that nowadays, the cloud vendor is the main thing, and the best cloud vendor is one that best supports "all of the above", from lift and shift of existing workloads, to lift and modernize, on through to turn-key PaaS solutions. This session will briefly survey the history of enterprise Java to establish the need for an "all of the above" enterprise cloud platform, examine some ways enterprises can use the current offerings from Microsoft Azure, and give a peek into what's in store in the near future.

Enterprise Java on Azure: From Java EE to Spring, we have you covered

Ed Burns

Ed Burns brings his seventeen years of server side Java experience to bear on the topic of Enterprise Java on Microsoft Azure. Before the advent of cloud infrastructure, the stack was the main thing. This gave rise to many entertaining platform wars, and even personality feuds among the principals. Spring or J2EE? Spring MVC or JSF (or Struts/Wicket/Tapestry/WebWork...)? Spring REST or JAX-RS? Spring DI or CDI? Spring Boot or MicroProfile? Single-vendor proprietary de-facto standard or multi-vendor community developed standard? Ed has seen these "wars" come and go, and even fought in some of them. While "wars" make for great conference talks, blog posts, and articles, at the end of the day creating business value is the whole point of enterprise Java. Ed contends that nowadays, the cloud vendor is the main thing, and the best cloud vendor is one that best supports "all of the above", from lift and shift of existing workloads, to lift and modernize, on through to turn-key PaaS solutions. This session will briefly survey the history of enterprise Java to establish the need for an "all of the above" enterprise cloud platform, examine some ways enterprises can use the current offerings from Microsoft Azure, and give a peek into what's in store in the near future.

Enterprise Java on Microsoft Azure: From Java EE to Spring, we’ve got you cov...

Ed Burns

InterConnect 2015: 3962 Docking DevOps

Daniel Berg

IBM Bluemix Tech Meetup 18-02-2015

gjuljo

An introduction to Node.js

Kasey McCurdy

Platform as a Service - Cloud Foundry and IBM Bluemix

David Currie

The goal of Serverless is to focus on writing the code that delivers business value and offload everything else to your trusted partners (like Cloud providers or SaaS vendors). You want to iterate quickly and today’s code quickly becomes tomorrow’s technical debt. In this talk we will show why Serverless adoption increases the developer productivity and how to measure it. We will also go through AWS Serverless architectures where you only glue together different Serverless managed services relying solely on configuration, minimizing the amount of the code written.

Measure and Increase Developer Productivity with Help of Serverless at AWS Co...

Vadym Kazulkin

Ähnlich wie Putting Hadoop on any Cloud. NATI SHALOM at Big Data Spain 2012 (20)

Cassandra summit - Big Data Apps on the cloud

Simple Cloud with Amazon Lightsail - Mike Coleman

The Elephant in the Cloud: Bring True Cloud Economics to Hadoop/BigInsights

How do you deliver your applications to the cloud?

Wars I’ve SeenFrom Java EE to Spring and more, Azure has you covered

Gorillas in the mist

Tools and Recipes to Replatform Monolithic Apps to Modern Cloud Environments

Stay productive while slicing up the monolith

Google Cloud - Scale With A Smile (Dec 2014)

FLUX - Crash Course in Cloud 2.0

Getting Started with MariaDB with Docker

Docker in Production: How RightScale Delivers Cloud Applications

Stay productive while slicing up the monolith

Enterprise Java on Azure: From Java EE to Spring, we have you covered

Enterprise Java on Microsoft Azure: From Java EE to Spring, we’ve got you cov...

InterConnect 2015: 3962 Docking DevOps

IBM Bluemix Tech Meetup 18-02-2015

An introduction to Node.js

Platform as a Service - Cloud Foundry and IBM Bluemix

Measure and Increase Developer Productivity with Help of Serverless at AWS Co...

Mehr von Big Data Spain

Big Data, Big Quality? by Irene Gonzálvez at Big Data Spain 2017

Big Data Spain

Scaling a backend for a big data and blockchain environment by Rafael Ríos at...

Big Data Spain

AI: The next frontier by Amparo Alonso at Big Data Spain 2017

Big Data Spain

Disaster Recovery for Big Data by Carlos Izquierdo at Big Data Spain 2017

Big Data Spain

Presentation: Boost Hadoop and Spark with in-memory technologies by Akmal Cha...

Big Data Spain

Data science for lazy people, Automated Machine Learning by Diego Hueltes at ...

Big Data Spain

Training Deep Learning Models on Multiple GPUs in the Cloud by Enrique Otero ...

Big Data Spain

Unbalanced data: Same algorithms different techniques by Eric Martín at Big D...

Big Data Spain

State of the art time-series analysis with deep learning by Javier Ordóñez at...

Big Data Spain

Trading at market speed with the latest Kafka features by Iñigo González at B...

Big Data Spain

Unified Stream Processing at Scale with Apache Samza by Jake Maes at Big Data...

Big Data Spain

The Analytic Platform behind IBM’s Watson Data Platform by Luciano Resende a...

Big Data Spain

Artificial Intelligence and Data-centric businesses by Óscar Méndez at Big Da...

Big Data Spain

Why big data didn’t end causal inference by Totte Harinen at Big Data Spain 2017

Big Data Spain

Meme Index. Analyzing fads and sensations on the Internet by Miguel Romero at...

Big Data Spain

Vehicle Big Data that Drives Smart City Advancement by Mike Branch at Big Dat...

Big Data Spain

End of the Myth: Ultra-Scalable Transactional Management by Ricardo Jiménez-P...

Big Data Spain

Attacking Machine Learning used in AntiVirus with Reinforcement by Rubén Mart...

Big Data Spain

More people, less banking: Blockchain by Salvador Casquero at Big Data Spain ...

Big Data Spain

Make the elephant fly, once again by Sourygna Luangsay at Big Data Spain 2017

Big Data Spain

Mehr von Big Data Spain (20)