SlideShare a Scribd company logo
1 of 6
Download to read offline
White Paper

The ABCs of Big Data –
Analytics, Bandwidth and Content
Richard Treadway and Ingo Fuchs, NetApp
March 2012 | WP-7147

EXECUTIVE SUMMARY
Enterprises are entering a new era of scale, where the amount of data processed and stored
is breaking down every architectural construct in the storage industry. NetApp delivers
solutions that address big data scale through the “Big Data ABCs” – analytics, bandwidth and
content – enabling customers to gain insight into massive datasets, move data quickly, and
store important content for long periods of time without increasing operational complexity.
TABLE OF CONTENTS
1

ENTERING A NEW ERA OF BIG SCALE ............................................................................................. 3

2

SOURCES OF BIG SCALE ................................................................................................................... 3

3

SHORTCOMINGS OF CURRENT APPROACHES ............................................................................... 3

4

INFRASTRUCTURE BREAKING POINTS ............................................................................................ 4

5

THE ABCS OF DATA AT SCALE ......................................................................................................... 5

6

SUMMARY ............................................................................................................................................. 5

LIST OF FIGURES
Figure 1) Where is your infrastructure breaking? ......................................................................................... 4
Figure 2) The NetApp Big Data ABCs: Analytics, Bandwidth, and Content ................................................. 5

2

The ABCs of Big Data – Analytics, Bandwidth and Content
1 ENTERING A NEW ERA OF BIG SCALE
In the 1990s, IT teams were focused on obtaining optimal performance from the key applications and
infrastructure of their enterprises. These siloed “systems of record” typically did a good job of keeping
track of vital information, but they were very expensive and did not offer sufficient drill-down insight into
the data to drive business advantage. In the 2000s, the IT focus shifted to efficiency how to do more
with less. Technologies like virtualization, sharing, and consolidation of the enterprise’s existing
infrastructure became the key drivers for IT.
We are now entering a new era of big scale, where the amount of data processed and stored by
enterprises is breaking down every architectural construct in the storage industry today. As a result, IT
teams are trying to convert these existing systems of record, built back in the 1990s and 2000s, into
“systems of engagement” – systems that can efficiently deliver the necessary information, to the right
people, in real time, to help them perform more sophisticated analyses and make better business
decisions.
Evolving from Systems of Record to Systems of Engagement
Data by itself has no value. Value comes from using the data to drive business results, offer services to
customers, and increase revenue. The challenge for scalable storage is to enable these business
outcomes from dramatically larger datasets.

2 SOURCES OF BIG SCALE
This massive increase in scale is occurring for a number of reasons. Because of cost pressures, many
companies are consolidating their data centers they can no longer afford for every business unit to have
its own IT infrastructure distributed around the globe. The move to cloud computing also contributes to
increased scale, aggregating the demand of hundreds of thousands of users onto fewer, centralized
systems.
Another source of the increase in scale is the massive growth in machine-generated and user-generated
data. Digital technologies are moving to denser media, photos have all gone digital, videos are using
higher resolution, and advanced analytics require more storage. Furthermore, machine-generated data
from sensor networks, buyer behavior tracking, and other sources contribute to much larger datasets that
need to be understood and commercialized. In short, the amount of data is increasing and the data
objects themselves are getting bigger. All of these forces together put an enormous amount of scale
pressure on existing infrastructures, especially the storage platform. This is what NetApp refers to as the
Big Data Challenge.
Where is Big Data Coming From?
Although human-generated data, such as Facebook pictures and Tweets, is getting the most attention
in the media, the biggest data growth comes from machine-generated datasets, such as consumer
behavior tracking and financial market analyses.

3 SHORTCOMINGS OF CURRENT APPROACHES
Today’s enterprises are finding it difficult to manage the exponential growth in big data. Traditional
approaches can’t scale to the level needed to be able to ingest all of the data, analyze it at the speed at
3

The ABCs of Big Data – Analytics, Bandwidth and Content
which it arrives, and store the relevant datasets efficiently for extended periods of time. The industry as a
whole has started to get a handle on how to manage the increased infrastructure complexity in a virtual
world, but handling infrastructure in a scalable world presents some very serious challenges.
Time-to-information is critical for enterprises to derive maximum value from their data. If it takes weeks or
months to run an analysis, it won’t be timely enough to detect a pattern that may affect the business in an
instant. Compliance is also a significant challenge for many enterprises. Regulated organizations may
have to keep data for very long periods of time – or forever. And they are required to find the data quickly
when needed for reporting or during industry audits.
In summary, the Big Data Challenge is all about gaining business advantage – how to obtain the most
value for the enterprise from this immense digital universe of information.

4 INFRASTRUCTURE BREAKING POINTS
Big data is breaking today’s storage infrastructure along three major axes, as illustrated in Figure 1.
Complexity. Data is no longer just about text and numbers; it's about real-time events and shared
infrastructure. The information is now linked, it is high fidelity, and it consists of multiple data types.
Applying normal algorithms for search, storage, and categorization is becoming much more complex
and inefficient.
Speed. How fast is the data coming in? High-definition video, streaming media over the Internet to
player devices, slow-motion video for surveillance – all of these have very high ingestion rates.
Businesses have to keep up with the data flow to make the information useful. They also have to
keep up with ingestion rates to drive faster business outcomes – or in the military, to save lives.
Volume. All collected data must be stored in a location that is secure and always available. With such
high volumes of data, IT teams have to make decisions about what is “too much data.” For example,
they might flush all data each week and start all over the following week. But for many applications
this is not an option, so more data must be stored longer – without increasing the operational
complexity. This can cause the infrastructure to quickly break on the axis of volume.
Figure 1) Where is your infrastructure breaking?

4

The ABCs of Big Data – Analytics, Bandwidth and Content
5 THE ABCS OF DATA AT SCALE
NetApp has divided the solution sets for managing data at scale into three main areas, called the “Big
Data ABCs” – analytics, bandwidth, and content. As shown in Figure 2, each area has its own specific
challenges and unique infrastructure requirements.
Analytics. This solution area focuses on providing efficient analytics for extremely large datasets.
Analytics is all about gaining insight, taking advantage of the digital universe, and turning data
into high-quality information, providing deeper insights about the business to enable better
decisions.
Bandwidth. This solution area focuses on obtaining better performance for very fast workloads.
High-bandwidth applications include high-performance computing: the ability to perform complex
analyses at extremely high speeds; high-performance video streaming for surveillance and
mission planning; and as video editing and play-out in media and entertainment.
Content. This solution area focuses on the need to provide boundless secure scalable data
storage. Content solutions must enable storing virtually unlimited amounts of data, so that
enterprises can store as much data as they want, find it when they need it, and never lose it.

Figure 2) The NetApp Big Data ABCs: Analytics, Bandwidth, and Content

6 SUMMARY
The new era of scale is breaking existing storage architectures. Enterprises need to ask the following
questions: Are there any opportunities for us to take better advantage of our data? What insights can
really help our business? Where could we use our data to competitive advantage? What if we could link
the trends in buying patterns to people's physical location at a point in time to give them a better

5

The ABCs of Big Data – Analytics, Bandwidth and Content
experience? What if we could detect when fraud is about to happen? Can we identify the likely hotspots
for failure before it happens?
The list of questions is unlimited. But the answer is always the same. NetApp offers the storage solutions
that enable enterprises to take advantage of big data and transform it into greater business value. The
universe of data can be an information gold mine. NetApp helps enterprises find the value of this data and
turn it into real business advantage.

Your Big Data innovation is basd on NetApp
NtApp’s Big Data offerings provide a foundation to spark innovation, make better decisions and drive
successful business outcomes at the speed of today’s business.

NetApp provides no representations or warranties regarding the accuracy, reliability or serviceability of any
information or recommendations provided in this publication, or with respect to any results that may be
obtained by the use of the information or observance of any recommendations provided herein. The
information in this document is distributed AS IS, and the use of this information or the implementation of
any recommendations or techniques herein is a customer’s responsibility and depends on the customer’s
ability to evaluate and integrate them into the customer’s operational environment. This document and
the information contained herein may be used solely in connection with the NetApp products discussed
in this document.

Go further, faster®
6

© 2012 NetApp, Inc. All rights reserved. No portions of this document may be reproduced without prior written consent of NetApp, Inc.

The ABCs of Big Data – Analytics, Bandwidth and Content NetApp logo, Go further, faster, are trademarks or registered trademarks
Specifications are subject to change without notice. NetApp, the
of NetApp, Inc. in the United States and/or other countries. All other brands or products are trademarks or registered trademarks of their
respective holders and should be treated as such. WP-7147-0312

More Related Content

What's hot

Big Data, Analytics and Data Science
Big Data, Analytics and Data ScienceBig Data, Analytics and Data Science
Big Data, Analytics and Data Sciencedlamb3244
 
Whitepaper - Simplifying Analytics Adoption in Enterprise
Whitepaper - Simplifying Analytics Adoption in EnterpriseWhitepaper - Simplifying Analytics Adoption in Enterprise
Whitepaper - Simplifying Analytics Adoption in EnterpriseBRIDGEi2i Analytics Solutions
 
Business Intelligence for kids (example project)
Business Intelligence for kids (example project)Business Intelligence for kids (example project)
Business Intelligence for kids (example project)Enrique Benito
 
Gartner eBook on Big Data
Gartner eBook on Big DataGartner eBook on Big Data
Gartner eBook on Big DataJyrki Määttä
 
Understanding the Information Architecture, Data Management, and Analysis Cha...
Understanding the Information Architecture, Data Management, and Analysis Cha...Understanding the Information Architecture, Data Management, and Analysis Cha...
Understanding the Information Architecture, Data Management, and Analysis Cha...Cognizant
 
Big-Data-The-Case-for-Customer-Experience
Big-Data-The-Case-for-Customer-ExperienceBig-Data-The-Case-for-Customer-Experience
Big-Data-The-Case-for-Customer-ExperienceAndrew Smith
 
Operationalizing the Buzz: Big Data 2013
Operationalizing the Buzz: Big Data 2013Operationalizing the Buzz: Big Data 2013
Operationalizing the Buzz: Big Data 2013VMware Tanzu
 
Analytics Service Framework
Analytics Service Framework Analytics Service Framework
Analytics Service Framework Vishwanath Ramdas
 
The Big Returns from Big Data
The Big Returns from Big Data The Big Returns from Big Data
The Big Returns from Big Data EMC
 
Augmented Data Management
Augmented Data ManagementAugmented Data Management
Augmented Data ManagementFORMCEPT
 
Application Architecture, Development & Integration Summit London 2012 - ...
Application Architecture, Development & Integration Summit London 2012 - ...Application Architecture, Development & Integration Summit London 2012 - ...
Application Architecture, Development & Integration Summit London 2012 - ...Pascal Winckel
 
Loving_HowToDrive-ValuA7A3B4
Loving_HowToDrive-ValuA7A3B4Loving_HowToDrive-ValuA7A3B4
Loving_HowToDrive-ValuA7A3B4Steven Loving
 
Social Marketing: Insight and Response
Social Marketing: Insight and ResponseSocial Marketing: Insight and Response
Social Marketing: Insight and ResponseTeradata
 
AGILONE-ACADEMY_The-State-of-Big-Customer-Data-2015-FINAL3
AGILONE-ACADEMY_The-State-of-Big-Customer-Data-2015-FINAL3AGILONE-ACADEMY_The-State-of-Big-Customer-Data-2015-FINAL3
AGILONE-ACADEMY_The-State-of-Big-Customer-Data-2015-FINAL3Angela Sanfilippo
 
Transforming Product Design and Energizing Innovation with Digital PLM
Transforming Product Design and Energizing Innovation with Digital PLMTransforming Product Design and Energizing Innovation with Digital PLM
Transforming Product Design and Energizing Innovation with Digital PLMCognizant
 
Mejorar la toma de decisiones con Big Data
Mejorar la toma de decisiones con Big DataMejorar la toma de decisiones con Big Data
Mejorar la toma de decisiones con Big DataMiguel Ángel Gómez
 
Digital Transformation - Is Your Enterprise Prepared
Digital Transformation - Is Your Enterprise PreparedDigital Transformation - Is Your Enterprise Prepared
Digital Transformation - Is Your Enterprise Prepared☁Jake Weaver ☁
 
The Big Deal About Big Data For Customer Engagement
The Big Deal About Big Data For Customer EngagementThe Big Deal About Big Data For Customer Engagement
The Big Deal About Big Data For Customer EngagementIBM India Smarter Computing
 

What's hot (20)

Big Data, Analytics and Data Science
Big Data, Analytics and Data ScienceBig Data, Analytics and Data Science
Big Data, Analytics and Data Science
 
Whitepaper - Simplifying Analytics Adoption in Enterprise
Whitepaper - Simplifying Analytics Adoption in EnterpriseWhitepaper - Simplifying Analytics Adoption in Enterprise
Whitepaper - Simplifying Analytics Adoption in Enterprise
 
Business Intelligence for kids (example project)
Business Intelligence for kids (example project)Business Intelligence for kids (example project)
Business Intelligence for kids (example project)
 
Gartner eBook on Big Data
Gartner eBook on Big DataGartner eBook on Big Data
Gartner eBook on Big Data
 
Understanding the Information Architecture, Data Management, and Analysis Cha...
Understanding the Information Architecture, Data Management, and Analysis Cha...Understanding the Information Architecture, Data Management, and Analysis Cha...
Understanding the Information Architecture, Data Management, and Analysis Cha...
 
Big-Data-The-Case-for-Customer-Experience
Big-Data-The-Case-for-Customer-ExperienceBig-Data-The-Case-for-Customer-Experience
Big-Data-The-Case-for-Customer-Experience
 
Operationalizing the Buzz: Big Data 2013
Operationalizing the Buzz: Big Data 2013Operationalizing the Buzz: Big Data 2013
Operationalizing the Buzz: Big Data 2013
 
Analytics Service Framework
Analytics Service Framework Analytics Service Framework
Analytics Service Framework
 
The Big Returns from Big Data
The Big Returns from Big Data The Big Returns from Big Data
The Big Returns from Big Data
 
Augmented Data Management
Augmented Data ManagementAugmented Data Management
Augmented Data Management
 
Big Data: Where is the Real Opportunity?
Big Data: Where is the Real Opportunity?Big Data: Where is the Real Opportunity?
Big Data: Where is the Real Opportunity?
 
Application Architecture, Development & Integration Summit London 2012 - ...
Application Architecture, Development & Integration Summit London 2012 - ...Application Architecture, Development & Integration Summit London 2012 - ...
Application Architecture, Development & Integration Summit London 2012 - ...
 
Loving_HowToDrive-ValuA7A3B4
Loving_HowToDrive-ValuA7A3B4Loving_HowToDrive-ValuA7A3B4
Loving_HowToDrive-ValuA7A3B4
 
Bidata
BidataBidata
Bidata
 
Social Marketing: Insight and Response
Social Marketing: Insight and ResponseSocial Marketing: Insight and Response
Social Marketing: Insight and Response
 
AGILONE-ACADEMY_The-State-of-Big-Customer-Data-2015-FINAL3
AGILONE-ACADEMY_The-State-of-Big-Customer-Data-2015-FINAL3AGILONE-ACADEMY_The-State-of-Big-Customer-Data-2015-FINAL3
AGILONE-ACADEMY_The-State-of-Big-Customer-Data-2015-FINAL3
 
Transforming Product Design and Energizing Innovation with Digital PLM
Transforming Product Design and Energizing Innovation with Digital PLMTransforming Product Design and Energizing Innovation with Digital PLM
Transforming Product Design and Energizing Innovation with Digital PLM
 
Mejorar la toma de decisiones con Big Data
Mejorar la toma de decisiones con Big DataMejorar la toma de decisiones con Big Data
Mejorar la toma de decisiones con Big Data
 
Digital Transformation - Is Your Enterprise Prepared
Digital Transformation - Is Your Enterprise PreparedDigital Transformation - Is Your Enterprise Prepared
Digital Transformation - Is Your Enterprise Prepared
 
The Big Deal About Big Data For Customer Engagement
The Big Deal About Big Data For Customer EngagementThe Big Deal About Big Data For Customer Engagement
The Big Deal About Big Data For Customer Engagement
 

Similar to The ABCs of Big Data

Ab cs of big data
Ab cs of big dataAb cs of big data
Ab cs of big dataDigimark
 
Nuestar "Big Data Cloud" Major Data Center Technology nuestarmobilemarketing...
Nuestar "Big Data Cloud" Major Data Center Technology  nuestarmobilemarketing...Nuestar "Big Data Cloud" Major Data Center Technology  nuestarmobilemarketing...
Nuestar "Big Data Cloud" Major Data Center Technology nuestarmobilemarketing...IT Support Engineer
 
Analytics big data ibm
Analytics big data ibmAnalytics big data ibm
Analytics big data ibmAccenture
 
IBM-Infoworld Big Data deep dive
IBM-Infoworld Big Data deep diveIBM-Infoworld Big Data deep dive
IBM-Infoworld Big Data deep diveKun Le
 
Analysis of Big Data
Analysis of Big DataAnalysis of Big Data
Analysis of Big DataIRJET Journal
 
Big data – A Review
Big data – A ReviewBig data – A Review
Big data – A ReviewIRJET Journal
 
An Encyclopedic Overview Of Big Data Analytics
An Encyclopedic Overview Of Big Data AnalyticsAn Encyclopedic Overview Of Big Data Analytics
An Encyclopedic Overview Of Big Data AnalyticsAudrey Britton
 
Snowball Group Whitepaper - Spotlight on Big Data
Snowball Group Whitepaper - Spotlight on Big DataSnowball Group Whitepaper - Spotlight on Big Data
Snowball Group Whitepaper - Spotlight on Big DataSnowball Group
 
How In-memory Computing Drives IT Simplification
How In-memory Computing Drives IT SimplificationHow In-memory Computing Drives IT Simplification
How In-memory Computing Drives IT SimplificationSAP Technology
 
Getting down to business on Big Data analytics
Getting down to business on Big Data analyticsGetting down to business on Big Data analytics
Getting down to business on Big Data analyticsThe Marketing Distillery
 
Creating the Foundations for the Internet of Things
Creating the Foundations for the Internet of ThingsCreating the Foundations for the Internet of Things
Creating the Foundations for the Internet of ThingsCapgemini
 
Big data document (basic concepts,3vs,Bigdata vs Smalldata,importance,storage...
Big data document (basic concepts,3vs,Bigdata vs Smalldata,importance,storage...Big data document (basic concepts,3vs,Bigdata vs Smalldata,importance,storage...
Big data document (basic concepts,3vs,Bigdata vs Smalldata,importance,storage...Taniya Fansupkar
 
Accelerating Time to Success for Your Big Data Initiatives
Accelerating Time to Success for Your Big Data InitiativesAccelerating Time to Success for Your Big Data Initiatives
Accelerating Time to Success for Your Big Data Initiatives☁Jake Weaver ☁
 
IRJET- A Scrutiny on Research Analysis of Big Data Analytical Method and Clou...
IRJET- A Scrutiny on Research Analysis of Big Data Analytical Method and Clou...IRJET- A Scrutiny on Research Analysis of Big Data Analytical Method and Clou...
IRJET- A Scrutiny on Research Analysis of Big Data Analytical Method and Clou...IRJET Journal
 
Project 3 – Hollywood and IT· Find 10 incidents of Hollywood p.docx
Project 3 – Hollywood and IT· Find 10 incidents of Hollywood p.docxProject 3 – Hollywood and IT· Find 10 incidents of Hollywood p.docx
Project 3 – Hollywood and IT· Find 10 incidents of Hollywood p.docxstilliegeorgiana
 
Introduction to big data – convergences.
Introduction to big data – convergences.Introduction to big data – convergences.
Introduction to big data – convergences.saranya270513
 

Similar to The ABCs of Big Data (20)

Ab cs of big data
Ab cs of big dataAb cs of big data
Ab cs of big data
 
Nuestar "Big Data Cloud" Major Data Center Technology nuestarmobilemarketing...
Nuestar "Big Data Cloud" Major Data Center Technology  nuestarmobilemarketing...Nuestar "Big Data Cloud" Major Data Center Technology  nuestarmobilemarketing...
Nuestar "Big Data Cloud" Major Data Center Technology nuestarmobilemarketing...
 
Big Data at a Glance
Big Data at a GlanceBig Data at a Glance
Big Data at a Glance
 
Analytics big data ibm
Analytics big data ibmAnalytics big data ibm
Analytics big data ibm
 
IBM-Infoworld Big Data deep dive
IBM-Infoworld Big Data deep diveIBM-Infoworld Big Data deep dive
IBM-Infoworld Big Data deep dive
 
Analysis of Big Data
Analysis of Big DataAnalysis of Big Data
Analysis of Big Data
 
Big data – A Review
Big data – A ReviewBig data – A Review
Big data – A Review
 
An Encyclopedic Overview Of Big Data Analytics
An Encyclopedic Overview Of Big Data AnalyticsAn Encyclopedic Overview Of Big Data Analytics
An Encyclopedic Overview Of Big Data Analytics
 
Snowball Group Whitepaper - Spotlight on Big Data
Snowball Group Whitepaper - Spotlight on Big DataSnowball Group Whitepaper - Spotlight on Big Data
Snowball Group Whitepaper - Spotlight on Big Data
 
How In-memory Computing Drives IT Simplification
How In-memory Computing Drives IT SimplificationHow In-memory Computing Drives IT Simplification
How In-memory Computing Drives IT Simplification
 
Getting down to business on Big Data analytics
Getting down to business on Big Data analyticsGetting down to business on Big Data analytics
Getting down to business on Big Data analytics
 
Creating the Foundations for the Internet of Things
Creating the Foundations for the Internet of ThingsCreating the Foundations for the Internet of Things
Creating the Foundations for the Internet of Things
 
Big data document (basic concepts,3vs,Bigdata vs Smalldata,importance,storage...
Big data document (basic concepts,3vs,Bigdata vs Smalldata,importance,storage...Big data document (basic concepts,3vs,Bigdata vs Smalldata,importance,storage...
Big data document (basic concepts,3vs,Bigdata vs Smalldata,importance,storage...
 
Accelerating Time to Success for Your Big Data Initiatives
Accelerating Time to Success for Your Big Data InitiativesAccelerating Time to Success for Your Big Data Initiatives
Accelerating Time to Success for Your Big Data Initiatives
 
Using Big Data Smarter Decision Making
Using Big Data Smarter Decision MakingUsing Big Data Smarter Decision Making
Using Big Data Smarter Decision Making
 
IRJET- A Scrutiny on Research Analysis of Big Data Analytical Method and Clou...
IRJET- A Scrutiny on Research Analysis of Big Data Analytical Method and Clou...IRJET- A Scrutiny on Research Analysis of Big Data Analytical Method and Clou...
IRJET- A Scrutiny on Research Analysis of Big Data Analytical Method and Clou...
 
Project 3 – Hollywood and IT· Find 10 incidents of Hollywood p.docx
Project 3 – Hollywood and IT· Find 10 incidents of Hollywood p.docxProject 3 – Hollywood and IT· Find 10 incidents of Hollywood p.docx
Project 3 – Hollywood and IT· Find 10 incidents of Hollywood p.docx
 
6 Reasons to Use Data Analytics
6 Reasons to Use Data Analytics6 Reasons to Use Data Analytics
6 Reasons to Use Data Analytics
 
Introduction to big data – convergences.
Introduction to big data – convergences.Introduction to big data – convergences.
Introduction to big data – convergences.
 
Big data
Big dataBig data
Big data
 

More from The Marketing Distillery

Internet of Things: manage the complexity, seize the opportunity
Internet of Things: manage the complexity, seize the opportunityInternet of Things: manage the complexity, seize the opportunity
Internet of Things: manage the complexity, seize the opportunityThe Marketing Distillery
 
7 steps to business success on the Internet of Things
7 steps to business success on the Internet of Things7 steps to business success on the Internet of Things
7 steps to business success on the Internet of ThingsThe Marketing Distillery
 
Capitalizing on the Internet of Things: a primer
Capitalizing on the Internet of Things: a primerCapitalizing on the Internet of Things: a primer
Capitalizing on the Internet of Things: a primerThe Marketing Distillery
 
From the Internet of Computers to the Internet of Things
From the Internet of Computers to the Internet of ThingsFrom the Internet of Computers to the Internet of Things
From the Internet of Computers to the Internet of ThingsThe Marketing Distillery
 
Smart networked objects and the Internet of Things
Smart networked objects and the Internet of ThingsSmart networked objects and the Internet of Things
Smart networked objects and the Internet of ThingsThe Marketing Distillery
 
Enhancing intelligence with the Internet of Things
Enhancing intelligence with the Internet of ThingsEnhancing intelligence with the Internet of Things
Enhancing intelligence with the Internet of ThingsThe Marketing Distillery
 
M2M innovations invigorate warehouse management
M2M innovations invigorate warehouse managementM2M innovations invigorate warehouse management
M2M innovations invigorate warehouse managementThe Marketing Distillery
 
How Big Data can help optimize business marketing efforts
How Big Data can help optimize business marketing effortsHow Big Data can help optimize business marketing efforts
How Big Data can help optimize business marketing effortsThe Marketing Distillery
 

More from The Marketing Distillery (20)

Big Data 2.0
Big Data 2.0Big Data 2.0
Big Data 2.0
 
The M2M platform for a connected world
The M2M platform for a connected worldThe M2M platform for a connected world
The M2M platform for a connected world
 
Internet of Things: manage the complexity, seize the opportunity
Internet of Things: manage the complexity, seize the opportunityInternet of Things: manage the complexity, seize the opportunity
Internet of Things: manage the complexity, seize the opportunity
 
7 steps to business success on the Internet of Things
7 steps to business success on the Internet of Things7 steps to business success on the Internet of Things
7 steps to business success on the Internet of Things
 
Capitalizing on the Internet of Things: a primer
Capitalizing on the Internet of Things: a primerCapitalizing on the Internet of Things: a primer
Capitalizing on the Internet of Things: a primer
 
Capitalizing on the Internet of Things
Capitalizing on the Internet of ThingsCapitalizing on the Internet of Things
Capitalizing on the Internet of Things
 
Managing the Internet of Things
Managing the Internet of ThingsManaging the Internet of Things
Managing the Internet of Things
 
From the Internet of Computers to the Internet of Things
From the Internet of Computers to the Internet of ThingsFrom the Internet of Computers to the Internet of Things
From the Internet of Computers to the Internet of Things
 
Getting started in Big Data
Getting started in Big DataGetting started in Big Data
Getting started in Big Data
 
Smart networked objects and the Internet of Things
Smart networked objects and the Internet of ThingsSmart networked objects and the Internet of Things
Smart networked objects and the Internet of Things
 
Enhancing intelligence with the Internet of Things
Enhancing intelligence with the Internet of ThingsEnhancing intelligence with the Internet of Things
Enhancing intelligence with the Internet of Things
 
Internet of Things application platforms
Internet of Things application platformsInternet of Things application platforms
Internet of Things application platforms
 
Internet of Things building blocks
Internet of Things building blocksInternet of Things building blocks
Internet of Things building blocks
 
Smart cities and the Internet of Things
Smart cities and the Internet of ThingsSmart cities and the Internet of Things
Smart cities and the Internet of Things
 
M2M innovations invigorate warehouse management
M2M innovations invigorate warehouse managementM2M innovations invigorate warehouse management
M2M innovations invigorate warehouse management
 
Big Data: 8 facts and 8 fictions
Big Data: 8 facts and 8 fictionsBig Data: 8 facts and 8 fictions
Big Data: 8 facts and 8 fictions
 
How Big Data can help optimize business marketing efforts
How Big Data can help optimize business marketing effortsHow Big Data can help optimize business marketing efforts
How Big Data can help optimize business marketing efforts
 
Big Data analytics
Big Data analyticsBig Data analytics
Big Data analytics
 
The Business Analyst as a leader
The Business Analyst as a leaderThe Business Analyst as a leader
The Business Analyst as a leader
 
Big Data strategy components
Big Data strategy componentsBig Data strategy components
Big Data strategy components
 

Recently uploaded

Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CVKhem
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessPixlogix Infotech
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)wesley chun
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024Results
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong
 

Recently uploaded (20)

Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 

The ABCs of Big Data

  • 1. White Paper The ABCs of Big Data – Analytics, Bandwidth and Content Richard Treadway and Ingo Fuchs, NetApp March 2012 | WP-7147 EXECUTIVE SUMMARY Enterprises are entering a new era of scale, where the amount of data processed and stored is breaking down every architectural construct in the storage industry. NetApp delivers solutions that address big data scale through the “Big Data ABCs” – analytics, bandwidth and content – enabling customers to gain insight into massive datasets, move data quickly, and store important content for long periods of time without increasing operational complexity.
  • 2. TABLE OF CONTENTS 1 ENTERING A NEW ERA OF BIG SCALE ............................................................................................. 3 2 SOURCES OF BIG SCALE ................................................................................................................... 3 3 SHORTCOMINGS OF CURRENT APPROACHES ............................................................................... 3 4 INFRASTRUCTURE BREAKING POINTS ............................................................................................ 4 5 THE ABCS OF DATA AT SCALE ......................................................................................................... 5 6 SUMMARY ............................................................................................................................................. 5 LIST OF FIGURES Figure 1) Where is your infrastructure breaking? ......................................................................................... 4 Figure 2) The NetApp Big Data ABCs: Analytics, Bandwidth, and Content ................................................. 5 2 The ABCs of Big Data – Analytics, Bandwidth and Content
  • 3. 1 ENTERING A NEW ERA OF BIG SCALE In the 1990s, IT teams were focused on obtaining optimal performance from the key applications and infrastructure of their enterprises. These siloed “systems of record” typically did a good job of keeping track of vital information, but they were very expensive and did not offer sufficient drill-down insight into the data to drive business advantage. In the 2000s, the IT focus shifted to efficiency how to do more with less. Technologies like virtualization, sharing, and consolidation of the enterprise’s existing infrastructure became the key drivers for IT. We are now entering a new era of big scale, where the amount of data processed and stored by enterprises is breaking down every architectural construct in the storage industry today. As a result, IT teams are trying to convert these existing systems of record, built back in the 1990s and 2000s, into “systems of engagement” – systems that can efficiently deliver the necessary information, to the right people, in real time, to help them perform more sophisticated analyses and make better business decisions. Evolving from Systems of Record to Systems of Engagement Data by itself has no value. Value comes from using the data to drive business results, offer services to customers, and increase revenue. The challenge for scalable storage is to enable these business outcomes from dramatically larger datasets. 2 SOURCES OF BIG SCALE This massive increase in scale is occurring for a number of reasons. Because of cost pressures, many companies are consolidating their data centers they can no longer afford for every business unit to have its own IT infrastructure distributed around the globe. The move to cloud computing also contributes to increased scale, aggregating the demand of hundreds of thousands of users onto fewer, centralized systems. Another source of the increase in scale is the massive growth in machine-generated and user-generated data. Digital technologies are moving to denser media, photos have all gone digital, videos are using higher resolution, and advanced analytics require more storage. Furthermore, machine-generated data from sensor networks, buyer behavior tracking, and other sources contribute to much larger datasets that need to be understood and commercialized. In short, the amount of data is increasing and the data objects themselves are getting bigger. All of these forces together put an enormous amount of scale pressure on existing infrastructures, especially the storage platform. This is what NetApp refers to as the Big Data Challenge. Where is Big Data Coming From? Although human-generated data, such as Facebook pictures and Tweets, is getting the most attention in the media, the biggest data growth comes from machine-generated datasets, such as consumer behavior tracking and financial market analyses. 3 SHORTCOMINGS OF CURRENT APPROACHES Today’s enterprises are finding it difficult to manage the exponential growth in big data. Traditional approaches can’t scale to the level needed to be able to ingest all of the data, analyze it at the speed at 3 The ABCs of Big Data – Analytics, Bandwidth and Content
  • 4. which it arrives, and store the relevant datasets efficiently for extended periods of time. The industry as a whole has started to get a handle on how to manage the increased infrastructure complexity in a virtual world, but handling infrastructure in a scalable world presents some very serious challenges. Time-to-information is critical for enterprises to derive maximum value from their data. If it takes weeks or months to run an analysis, it won’t be timely enough to detect a pattern that may affect the business in an instant. Compliance is also a significant challenge for many enterprises. Regulated organizations may have to keep data for very long periods of time – or forever. And they are required to find the data quickly when needed for reporting or during industry audits. In summary, the Big Data Challenge is all about gaining business advantage – how to obtain the most value for the enterprise from this immense digital universe of information. 4 INFRASTRUCTURE BREAKING POINTS Big data is breaking today’s storage infrastructure along three major axes, as illustrated in Figure 1. Complexity. Data is no longer just about text and numbers; it's about real-time events and shared infrastructure. The information is now linked, it is high fidelity, and it consists of multiple data types. Applying normal algorithms for search, storage, and categorization is becoming much more complex and inefficient. Speed. How fast is the data coming in? High-definition video, streaming media over the Internet to player devices, slow-motion video for surveillance – all of these have very high ingestion rates. Businesses have to keep up with the data flow to make the information useful. They also have to keep up with ingestion rates to drive faster business outcomes – or in the military, to save lives. Volume. All collected data must be stored in a location that is secure and always available. With such high volumes of data, IT teams have to make decisions about what is “too much data.” For example, they might flush all data each week and start all over the following week. But for many applications this is not an option, so more data must be stored longer – without increasing the operational complexity. This can cause the infrastructure to quickly break on the axis of volume. Figure 1) Where is your infrastructure breaking? 4 The ABCs of Big Data – Analytics, Bandwidth and Content
  • 5. 5 THE ABCS OF DATA AT SCALE NetApp has divided the solution sets for managing data at scale into three main areas, called the “Big Data ABCs” – analytics, bandwidth, and content. As shown in Figure 2, each area has its own specific challenges and unique infrastructure requirements. Analytics. This solution area focuses on providing efficient analytics for extremely large datasets. Analytics is all about gaining insight, taking advantage of the digital universe, and turning data into high-quality information, providing deeper insights about the business to enable better decisions. Bandwidth. This solution area focuses on obtaining better performance for very fast workloads. High-bandwidth applications include high-performance computing: the ability to perform complex analyses at extremely high speeds; high-performance video streaming for surveillance and mission planning; and as video editing and play-out in media and entertainment. Content. This solution area focuses on the need to provide boundless secure scalable data storage. Content solutions must enable storing virtually unlimited amounts of data, so that enterprises can store as much data as they want, find it when they need it, and never lose it. Figure 2) The NetApp Big Data ABCs: Analytics, Bandwidth, and Content 6 SUMMARY The new era of scale is breaking existing storage architectures. Enterprises need to ask the following questions: Are there any opportunities for us to take better advantage of our data? What insights can really help our business? Where could we use our data to competitive advantage? What if we could link the trends in buying patterns to people's physical location at a point in time to give them a better 5 The ABCs of Big Data – Analytics, Bandwidth and Content
  • 6. experience? What if we could detect when fraud is about to happen? Can we identify the likely hotspots for failure before it happens? The list of questions is unlimited. But the answer is always the same. NetApp offers the storage solutions that enable enterprises to take advantage of big data and transform it into greater business value. The universe of data can be an information gold mine. NetApp helps enterprises find the value of this data and turn it into real business advantage. Your Big Data innovation is basd on NetApp NtApp’s Big Data offerings provide a foundation to spark innovation, make better decisions and drive successful business outcomes at the speed of today’s business. NetApp provides no representations or warranties regarding the accuracy, reliability or serviceability of any information or recommendations provided in this publication, or with respect to any results that may be obtained by the use of the information or observance of any recommendations provided herein. The information in this document is distributed AS IS, and the use of this information or the implementation of any recommendations or techniques herein is a customer’s responsibility and depends on the customer’s ability to evaluate and integrate them into the customer’s operational environment. This document and the information contained herein may be used solely in connection with the NetApp products discussed in this document. Go further, faster® 6 © 2012 NetApp, Inc. All rights reserved. No portions of this document may be reproduced without prior written consent of NetApp, Inc. The ABCs of Big Data – Analytics, Bandwidth and Content NetApp logo, Go further, faster, are trademarks or registered trademarks Specifications are subject to change without notice. NetApp, the of NetApp, Inc. in the United States and/or other countries. All other brands or products are trademarks or registered trademarks of their respective holders and should be treated as such. WP-7147-0312