Today, businesses are grappling with huge volumes of data. Building capabilities to process/analyze data and generate insights, through Big Data solutions, is becoming a key differentiator for them. And developing such a competitive advantage using traditional models takes time and defeats its purpose.
Leveraging Cloud infrastructure and Agile development methodologies, businesses can develop and deploy their Big Data solutions rapidly and cost efficiently.
Join us for an engaging and interactive webinar on “Deploy Big Data solutions Rapidly in Cloud through Harbinger’s ABC model (Agile-Big Data-Cloud)” on 15th Jan 2014.This webinar will present Harbinger’s ABC model that can help organizations in overcoming some of the challenges they face in building Big Data solutions.
The webinar will discuss:
> The rising business need for Big Data solutions
> Key considerations in designing Big Data solutions (V3: Volume-Variety-Velocity)
> Harbinger’s ABC model and its relevance in the current context
> Real world business scenarios and solutions though ABC model
5. Manageable Data
Variety
Velocity
RDBMS system for data storage
Implementation of Business
logic by Application server
Business features are rendered
by Request/Response model
Volume
5
11. Case 1 - Volume Space : Business Challenges
• Data maintained by Legacy system is not queriable
• Searching for information is becoming pain area as the data size
is growing
• Business wants to connect operational, clinical and financial
properties of each record
• App should support interoperability from multiple platforms
(mobile devices, desktop OS …)
11
12. Case 1 – ABC in Volume Space
Data Volume
ETL
Hadoop DFS
Search
Multiple Business
needs evolving over
time
AWS EMR
12
13. Case 1 - Volume Space
ETL
Flat Files, Feeds
Name Node
Secondary
Name Node
Data Nodes
Hadoop API
Map
Reduce
Results
13
14. Case 1 – Volume Space
Scaling
Hadoop distributed File System
• Map Reduce Jobs for each type of query
Search
Solr based indexing
• De-identification of sensitive information (HIPAA compliance)
• Relevance search
ETL
Data migration from Legacy system
• Custom ETL, Cleaning and Validation of records
14
16. Case 2 - Velocity Space: Business Challenges
Users Bet or Bid on Certain Resources
Sport Events
Live Show on TV…
Application Should Synchronize
Thousands of Users in Real-Time
Application Usage Spikes with Popular Events
16
17. ABC in Velocity Space
Transaction Velocity
Mongo DB
Redis
Evolving Business
Requirements
Tech POCs
AWS EC2
Real time resource
scale up/down
17
18. Case 2 - Velocity Space
Notifications Node JS, Socket IO
• Dynamic Synchronization
• Cross browser (HTML 5-based)
Extensibility
Grails, MVC, REST
• Efficient Development
• Support for Mobile
18
20. Case 3 - Variety Space: Business Challenges
Relationships:
Structured and un-structured attributes
Recommendations:
Connections and preferences and Discovery
Data Variety: Traditional design approach could be extremely complex
20
21. Case 3 – Variety Space
Data Variety
Orient DB, PostgreSQL
Graph Structures and
Recommendation Engine
Weekly Builds
Synchronization with
Business
AWS EC2
Scalability, Multi-tenancy
Auto-Scaling, Separate
Schema for accounts
21
22. Case 3 – Variety Space
Multi-tenancy Cloud + PostgreSQL
• Supports Schemas for Multi-tenancy
Productivity
RoR, Phusion Passenger Server
• Developer Productivity
• Resources exposed with REST APIs
Responsive
D3, SVG, VivaGraph
• Renders scalable vector images in modern browsers
22
24. Solution Space
Variety
Key Value Store
(NoSQL)
Document based or
Graph database
Velocity
In memory Database
Push (WebSocket)
Volume
Map Reduce
(Hadoop)
24
25. A-B-C Model Review
Structured,
Unstructured Data
Volume, Velocity,
Variety Analytics
Frequent Builds
Validations/POCs
Re-alignment with business
App Complexity
Resource Scale-up/down
Platform Services
(Security, Backup, Metering)
25