Big data refers to large volumes of high velocity, variety and veracity information that require advanced methods to enable analysis and insights. It is data produced from many sources, including social media interactions, website activity, photos, videos and more. Companies and governments collect and analyze big data to improve services, facilitate operations, seek new business models and boost effectiveness. However, big data also raises privacy and surveillance concerns when collected by governments. The future will see big data continue growing rapidly in size and analytical capabilities, while also facing increasing debates around security, privacy and the environmental impacts of data processing.
2. Wh- is big data?
•What
•Who
•When
•Where
•Why
•How
3. What is big data?
Gartner Group definition:
"Big data is high volume, high velocity, and/or
high variety information assets that require
new forms of processing to enable enhanced
decision making, insight discovery and process
optimization."
Plus, high veracity suggested by other experts
4. High Volume?
KBMBGBTBPBEBZB
Google NC data center
Approximate Data Volume in the world 2013:
up to 3.6 ZB (zettabytes)
400billion feature length HD movies
5. High Velocity?
Every 60 seconds on Facebook there are:
• 510,000 posted comments
• 293,000 status updates
• 136,000 uploaded photos
30 billion pieces of content are shared each month
20 million Facebook apps are installed per day
From 2012 statistic,
7. High variety?
Any type of data, meaningful data & meaningless data (if you think so…)
Images
Documents
Browserhistory
GPS location
Browsing habitMedical history
Transaction record
Opendata
Wi-Fi signal
Share Logistic
8. High veracity?
How do you trust on the data?
Does it simply mean a like?
Or… it actually means
VS
12. Who benefit from big data?
YOU & I
Service providers improve
their service through
collecting more data.
13. Who can make use of big data?
• ISPs
• Utilities
• Government
• Corporations
• Academic
• Everyone
who can collect and access to data
With more than 1,000 universities
15. Why do they use big data?
• Provide better consumer experience
• Facilitate corporate operation
• Seek for a new business model
• Risk and financial management
• Boosting effectiveness
• Government Surveillance
16. Why do they use big data?
Win an election
Obama did it in 2012
17. How to make use of Big Data?
• 2008: Social Media
• 2012: Add big data
• Decide how to approach voters
• Top targets: unsubscribed list back in 2008
• Different message scripts for different demographic groups
• Phone call & email
• Predict turnout
• Simulating election 66,000 times result per night
• Reallocating resource in each states
18. How does it work?
• Visualizing Big Data
• Concept on how to analyze data
• Power BI for Office 365 Demo
19. WhenOpenData meets Big Data–DoNo Evil
Do No Evil (起你底)
• HK ICT Award 2013:
• Best Lifestyle Silver Award
• Over 2 million local litigation records from the courts of Hong
Kong dating as far back as 1990 for civil cases and 2004 for
criminal cases.
20. • Comment from judge panel:
• This mobile application integrates an extensive database with a
highly user-friendly search engine, allowing users to easily
conduct legal background search of companies or targeted
persons in an instant and economical way. This demonstrates a
good combination of mobile technology and ICT technology.
WhenOpenData meets Big Data–Do No Evil
21. • One-station background analysis on
• Potential employee
• Business partner
• Future son in law
• Government Officials??
WhenOpenData meets Big Data–Do No Evil
22. Abuse of Big Data?
Example: NSA /CIA surveillance
programs
Privacy?
Right to know?
Big brother of the new era?
Beyond commercial abuses,
also by governments
Ongoing debate:
Negative impact to U.S. cloud vendors
23. Future of Big Data
• Keep growing: in size and analytical power
• Growing security concerns
• More conflicts in privacy issues
• Data processing requires more electricity than lighting
network all over the world in 2035
24. THE END
Facebook: Charles Mok B / page: Charles Mok 2012
Twitter: Charlesmok
Linkedin: Charlesmok
Website:charlesmok.hk
Email: charlesmok@charlesmok.hk