BIG DATA

1. Presenting By
XXXXXX
12XXXXX
Under the guidance of
XXXX

2.  Big data is a broad term for data sets so large or complex
that traditional data processing applications are inadequate.
Challenges include analysis, capture, data curtain, search,
sharing, storage, transfer, visualization, and information
privacy. The term often refers simply to the use of predictive
analytics or other certain advanced methods to extract value
from data, and seldom to a particular size of data set.
Accuracy in big data may lead to more confident decision
making. And better decisions can mean greater operational
efficiency, cost reductions and reduced risk.
JAVA CARD 2

3.  No single standard definition…
“Big Data” is data whose scale, diversity, and
complexity require new architecture,
techniques, algorithms, and analytics to
manage it and extract value and hidden
knowledge from it…
JAVA CARD 3

4. What is data?
Types of data
1. Relational Data
2. Text Data
3. Semi-structured Data
4. Graph Data
5. Streaming Data

5. 640K ought to be
enough for
anybody.

6.  Lots of data is being collected
and warehoused
◦ Web data, e-commerce
◦ purchases at department/
grocery stores
◦ Bank/Credit Card
transactions
◦ Social Network

7. Maximilien Brice, © CERN

8.  The Model of Generating/Consuming Data
has Changed
Old Model: Few companies are generating data, all others are consumi
New Model: all of us are generating data, and all of
us are consuming data

9. Social media
and
networks
Scientific
instruments
Mobile
devices Sensor
technology
and networks

11. •Big Volume
•Big Velocity
•Big Variety

12.  Data Volume
◦ 44x increase from 2009 2020
◦ From 0.8 zettabytes to 35zb
 Data volume is increasing
exponentially

13.  Consider closing price on all trading days for the
last 5 years for two stocks A and B
 What is the covariance between the two time-
series?
(1/N) * sum (Ai - mean(A)) * (Bi - mean (B))

14.  Ignoring the (1/N) and subtracting off the
means ….
Stock * StockT
 Now try it for companies headquartered in
Charlotte!

15.  Trading volume on Wall Street going through
the roof
 Breaking all their infrastructure
 And it will just get worse

16.  Data is begin generated fast and need to be
processed fast
 Online Data Analytics
 Late decisions
Examples:
◦ E-Promotions
◦ Healthcare monitoring

18. There are three forms of variety:
1. Structured
2. Semi structured
3. unstructured

20. enterprise text
data warehouse
the rest of your data

22. What is hadoop?
 Apache hadoop is a framework that allows for the
distributed processing of large data
 It is an open-source data management

25. Advantages of big data
Disadvantages of dig data

26.  The biggest challenge for any big application
 Choose wisely and move forward otherwise it cant
get the value of data

27.  http://www.edureka.in/blog/the-hype-
behind-big-data/
 http://en.wikipedia.org/wiki/big-data