The document discusses an end-to-end big data framework using various Amazon Web Services including Amazon Kinesis for ingestion, Amazon S3 and Redshift for storage, and Amazon EMR with tools like Impala and Hive for processing. It provides comparisons of Redshift and other databases and tools for analytics and highlights use cases like sensors that can benefit from streaming analytics.

1. Big Data and Analytics
End to End on AWS
Russell Nash, Solutions Architect, APAC
Amazon Web Services

2. Business
101 Technical
201 Technical
301 Technical
401 Technical
Session Grading

3. Agenda
Customer Case Study

4. Agenda
End to End Framework
Customer Case Study

5. Agenda
End to End Framework
Use Cases
Customer Case Study

6. Agenda
End to End Framework
Use Cases
Customer Case Study

7. Agenda
End to End Framework
Use Cases
Customer Case Study
Religion
Greater
Good
FOMO

8. Big Data
End to End Framework

10. Greater
Good

14. Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Amazon
Machine
Learning
Amazon
EMR
Amazon
Glacier
Amazon
DynamoDB

15. Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Apache
Storm
PIG
Amazon
Machine
Learning
Amazon
EMR
Amazon
Glacier
Amazon
DynamoDB

16. Ingest Store Process Analyse
Data Answers
Simplify Big Data Processing

18. “I got kicked out of the bookshop last week,
because I moved all of the Big Data books
into the Religion section”

20. INGEST

21. Databases
Database
Flat Files Database
Data
INGEST

22. Databases
Database
Flat Files Database
Data
Sales Data
Customer Data
INGEST

23. Databases
Database
Flat Files Database
Data
File Data
Sales Data
Customer Data
INGEST

24. Databases
Database
Flat Files Database
Data
File Data
Sales Data
Customer Data
Web Logs
Server Logs
INGEST

25. Databases
Database
Flat Files Database
Data
File Data
Kinesis
Producer
Android
iOS
Streaming
Data
Sales Data
Customer Data
Web Logs
Server Logs
INGEST

26. Databases
Database
Flat Files Database
Data
File Data
Kinesis
Producer
Android
iOS
Streaming
Data
Sales Data
Customer Data
Web Logs
Server Logs
Clickstream Data
Sensor Data
INGEST

27. Databases
Database
Flat Files Database
Data
File Data
Kinesis
Producer
Android
iOS
Streaming
Data
Sales Data
Customer Data
Web Logs
Server Logs
Clickstream Data
Sensor Data
INGEST STORE

28. Databases
Database
Flat Files Database
Data
File Data
Kinesis
Producer
Android
iOS
Streaming
Data
Sales Data
Customer Data
Web Logs
Server Logs
Clickstream Data
Sensor Data
Database
INGEST STORE

29. Databases
Database
Flat Files Database
Data
File Data
Kinesis
Producer
Android
iOS
Streaming
Data
Sales Data
Customer Data
Web Logs
Server Logs
Clickstream Data
Sensor Data
Database
INGEST STORE

30. Databases
Database
Flat Files Database
Data
File Data
Kinesis
Producer
Android
iOS
Streaming
Data
Sales Data
Customer Data
Web Logs
Server Logs
Clickstream Data
Sensor Data
INGEST
Amazon
Redshift
Amazon
RDS
STORE

31. Databases
Database
Flat Files Database
Data
File Data
Kinesis
Producer
Android
iOS
Streaming
Data
Sales Data
Customer Data
Web Logs
Server Logs
Clickstream Data
Sensor Data
INGEST
Amazon
Redshift
Amazon
RDS
STORE

32. Traditional Relational Database

33. Logging
Analytics
Webscale
Transactions
Rich Search Hot Reads
Complex Queries
and Transactions
Traditional Relational Database

34. Data Tier
Search Cache Object Store
RDBMSNoSQL Data Warehouse
Logging
Analytics
Webscale
Transactions
Rich Search Hot Reads
Complex Queries
and Transactions

35. Data Tier
Search Cache Object Store
RDBMSNoSQL Data Warehouse
Logging
Analytics
Webscale
Transactions
Rich Search Hot Reads
Complex Queries
and Transactions

36. Data Tier
Search Cache Object Store
RDBMSNoSQL Data Warehouse
Logging
Analytics
Webscale
Transactions
Rich Search Hot Reads
Complex Queries
and Transactions
Data Tier
Amazon
DynamoDB
Amazon
RDS
Amazon
ElastiCache
Amazon
S3
Amazon
Redshift
Amazon
CloudSearch

37. Amazon
Redshift
Amazon
RDS

38. Amazon
Redshift
Amazon
RDS
Scaling
Storage
Workload
Architecture
Type

39. Amazon
Redshift
Amazon
RDS
Scaling
Storage
Workload
Architecture
TypeSQL Relational SQL Relational

40. Amazon
Redshift
Amazon
RDS
Scaling
Storage
Workload
ArchitectureSMP MPP
TypeSQL Relational SQL Relational

41. Amazon
Redshift
Amazon
RDS
ScalingVertical Horizontal
Storage
Workload
ArchitectureSMP MPP
TypeSQL Relational SQL Relational

42. Amazon
Redshift
Amazon
RDS
ScalingVertical Horizontal
StorageRow Column
Workload
ArchitectureSMP MPP
TypeSQL Relational SQL Relational

43. Amazon
Redshift
Amazon
RDS
ScalingVertical Horizontal
StorageRow Column
WorkloadTransactional Analytical
ArchitectureSMP MPP
TypeSQL Relational SQL Relational

45. “Some of the queries we’re running are 98
percent faster, and most things are running 90
percent faster”
- FT CTO John O’Donovan

46. Databases
Database
Flat Files Database
Data
File Data
Kinesis
Producer
Android
iOS
Streaming
Data
Sales Data
Customer Data
Web Logs
Server Logs
Clickstream Data
Sensor Data
INGEST
Amazon
Redshift
Amazon
RDS
STORE

47. Databases
Database
Flat Files Database
Data
File Data
Kinesis
Producer
Android
iOS
Streaming
Data
Sales Data
Customer Data
Web Logs
Server Logs
Clickstream Data
Sensor Data
Storage
INGEST
Amazon
Redshift
Amazon
RDS
Application
STORE

48. Databases
Database
Flat Files Database
Data
File Data
Kinesis
Producer
Android
iOS
Streaming
Data
Sales Data
Customer Data
Web Logs
Server Logs
Clickstream Data
Sensor Data
Storage
INGEST
Amazon
Redshift
Amazon
RDS
STORE

49. Databases
Database
Flat Files Database
Data
File Data
Kinesis
Producer
Android
iOS
Streaming
Data
Sales Data
Customer Data
Web Logs
Server Logs
Clickstream Data
Sensor Data
INGEST
Amazon
Redshift
Amazon
RDS
Amazon
S3
STORE

50. Amazon
EMR

51. Amazon
EMR

52. Amazon
EMR

53. Amazon
EMR

54. Amazon
EMR

55. Impala PIG
Amazon
EMR

56. Amazon
S3

57. Amazon
S3
Amazon
Redshift
Amazon
EMR Amazon
DynamoDB
Amazon
Machine
Learning
Applications

58. Amazon
S3
Amazon
Redshift
Amazon
EMR
Glacier
Amazon
DynamoDB
Amazon
Machine
Learning
Applications

59. Amazon
S3

60. Scaling
Speed
Cost
Durability
Amazon
S3

61. Scaling
Speed
Cost
DurabilityConfigurable Built-in
Amazon
S3

62. Scaling
Speed
CostHigher Lower
DurabilityConfigurable Built-in
Amazon
S3

63. ScalingAdd nodes Automatic
Speed
CostHigher Lower
DurabilityConfigurable Built-in
Amazon
S3

64. ScalingAdd nodes Automatic
SpeedFastest Fast
CostHigher Lower
DurabilityConfigurable Built-in
Amazon
S3

65. Databases
Database
Flat Files Database
Data
File Data
Kinesis
Producer
Android
iOS
Streaming
Data
Sales Data
Customer Data
Web Logs
Server Logs
Clickstream Data
Sensor Data
INGEST
Amazon
Redshift
Amazon
RDS
Amazon
S3
STORE

66. Databases
Database
Flat Files Database
Data
File Data
Kinesis
Producer
Android
iOS
Streaming
Data
Sales Data
Customer Data
Web Logs
Server Logs
Clickstream Data
Sensor Data
Stream
Processor
INGEST
Amazon
Redshift
Amazon
RDS
Amazon
S3
STORE

67. Databases
Database
Flat Files Database
Data
File Data
Kinesis
Producer
Android
iOS
Streaming
Data
Sales Data
Customer Data
Web Logs
Server Logs
Clickstream Data
Sensor Data
INGEST
Amazon
Redshift
Amazon
RDS
Amazon
S3
Amazon
Kinesis
STORE

68. Why Stream Storage?
Sensors

69. Why Stream Storage?
Sensors

70. Why Stream Storage?
Sensors

71. Why Stream Storage?
Sensors
Amazon
Kinesis
Apache
Kafka

72. Data
Sources
Data
Sources
Data
Sources
Data
Sources
Data
Sources

73. Availability
Zone
Availability
Zone
Availability
Zone
Data
Sources
Data
Sources
Data
Sources
Data
Sources
Data
Sources
Amazon Kinesis

74. Availability
Zone
Availability
Zone
Availability
Zone
Data
Sources
Data
Sources
Data
Sources
Data
Sources
Data
Sources
Amazon Kinesis
Stream

75. Availability
Zone
Availability
Zone
Availability
Zone
Data
Sources
Data
Sources
Data
Sources
Data
Sources
Data
Sources
Amazon Kinesis
Stream

76. Availability
Zone
Availability
Zone
Availability
Zone
Data
Sources
Data
Sources
Data
Sources
Data
Sources
Data
Sources
Amazon Kinesis
Stream

77. Availability
Zone
Availability
Zone
Availability
Zone
Data
Sources
Data
Sources
Data
Sources
Data
Sources
Data
Sources
Logging
Amazon Kinesis
Stream

78. Availability
Zone
Availability
Zone
Availability
Zone
Data
Sources
Data
Sources
Data
Sources
Data
Sources
Data
Sources
Logging
S3
Amazon Kinesis
Stream

79. Availability
Zone
Availability
Zone
Availability
Zone
Data
Sources
Data
Sources
Data
Sources
Data
Sources
Data
Sources
Logging
Metrics
S3
Amazon Kinesis
Stream

80. Availability
Zone
Availability
Zone
Availability
Zone
Data
Sources
Data
Sources
Data
Sources
Data
Sources
Data
Sources
Logging
Metrics
S3
DynamoDB
Amazon Kinesis
Stream

81. Availability
Zone
Availability
Zone
Availability
Zone
Data
Sources
Data
Sources
Data
Sources
Data
Sources
Data
Sources
Logging
Metrics
Analysis
S3
DynamoDB
Amazon Kinesis
Stream

82. Availability
Zone
Availability
Zone
Availability
Zone
Data
Sources
Data
Sources
Data
Sources
Data
Sources
Data
Sources
Logging
Metrics
Analysis
S3
DynamoDB
Redshift
Amazon Kinesis
Stream

83. Availability
Zone
Availability
Zone
Availability
Zone
Data
Sources
Data
Sources
Data
Sources
Data
Sources
Data
Sources
Logging
Metrics
Analysis
Complex
Processing
S3
DynamoDB
Redshift
Apache
Storm
Amazon Kinesis
Stream

84. Amazon
Redshift
Amazon
Kinesis

85. Amazon
Redshift
Ordering
Persistence
Size
Scaling
Latency
Managed
Amazon
Kinesis

86. Amazon
Redshift
Ordering
Persistence
Size
Scaling
LatencyLow Low
Managed
Amazon
Kinesis

87. Amazon
Redshift
Ordering
Persistence
Size
ScalingHigh High
LatencyLow Low
Managed
Amazon
Kinesis

88. Amazon
Redshift
OrderingYes Yes
Persistence
Size
ScalingHigh High
LatencyLow Low
Managed
Amazon
Kinesis

89. Amazon
Redshift
OrderingYes Yes
Persistence24 Hours Configurable
Size
ScalingHigh High
LatencyLow Low
Managed
Amazon
Kinesis

90. Amazon
Redshift
OrderingYes Yes
Persistence24 Hours Configurable
Size50 KB Configurable
ScalingHigh High
LatencyLow Low
Managed
Amazon
Kinesis

91. Amazon
Redshift
OrderingYes Yes
Persistence24 Hours Configurable
Size50 KB Configurable
ScalingHigh High
LatencyLow Low
ManagedYes No
Amazon
Kinesis

92. INGEST STORE
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDSFlat Files
Database
Data
Event
Data
Streaming
Data

93. INGEST STORE PROCESS
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDSFlat Files
Database
Data
Event
Data
Streaming
Data

94. INGEST STORE PROCESS
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDSFlat Files
Database
Data
Event
Data
Streaming
Data
Interactive

95. INGEST STORE PROCESS
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDSFlat Files
Database
Data
Event
Data
Streaming
Data
InteractiveBatch

96. INGEST STORE PROCESS
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDSFlat Files
Database
Data
Event
Data
Streaming
Data
InteractiveBatchStreaming

97. INGEST STORE PROCESS
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Amazon
Redshift
Flat Files
Database
Data
Event
Data
Streaming
Data
InteractiveBatchStreaming

98. INGEST STORE PROCESS
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Flat Files
Database
Data
Event
Data
Streaming
Data
InteractiveBatchStreaming

99. INGEST STORE PROCESS
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Amazon
EMR
Flat Files
Database
Data
Event
Data
Streaming
Data
InteractiveBatchStreaming
Hadoop

100. Amazon
Redshift
Amazon
Redshift
Amazon
Redshift
Impala

101. Amazon
Redshift
Scaling
Storage
BI Tools
Durability
Latency
Managed
Amazon
Redshift
Amazon
Redshift
Impala

102. Amazon
Redshift
Scaling
Storage
BI Tools
Durability
LatencyLow Low
Managed
Amazon
Redshift
Low
Amazon
Redshift
Impala

103. Amazon
Redshift
Scaling
Storage
BI Tools
DurabilityHigh High
LatencyLow Low
Managed
Amazon
Redshift
High
Low
Amazon
Redshift
Impala

104. Amazon
Redshift
Scaling2 PB+ Nodes
Storage
BI Tools
DurabilityHigh High
LatencyLow Low
Managed
Amazon
Redshift
Nodes
High
Low
Amazon
Redshift
Impala

105. Amazon
Redshift
Scaling2 PB+ Nodes
StorageNative HDFS/S3
BI Tools
DurabilityHigh High
LatencyLow Low
Managed
Amazon
Redshift
Nodes
HDFS
High
Low
Amazon
Redshift
Impala

106. Amazon
Redshift
Scaling2 PB+ Nodes
StorageNative HDFS/S3
BI ToolsHigh Medium
DurabilityHigh High
LatencyLow Low
Managed
Amazon
Redshift
Nodes
HDFS
Medium
High
Low
Amazon
Redshift
Impala

107. Amazon
Redshift
Scaling2 PB+ Nodes
StorageNative HDFS/S3
BI ToolsHigh Medium
DurabilityHigh High
LatencyLow Low
ManagedFully Semi (EMR)
Amazon
Redshift
Nodes
HDFS
Medium
High
Low
Semi (EMR)
Amazon
Redshift
Impala

108. INGEST STORE PROCESS
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Flat Files
Database
Data
Event
Data
Streaming
Data
InteractiveBatchStreaming
Amazon
EMR
Hadoop

109. INGEST STORE PROCESS
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Flat Files
Database
Data
Event
Data
Streaming
Data
InteractiveBatch
PIG
Streaming
Amazon
EMR
Hadoop

111. New Processing Engine

112. SQL on Hadoop
New Processing Engine

113. PIG
SQL on Hadoop
Eats anything
New Processing Engine

114. Amplab Big Data Benchmark
Scan query Aggregate query Join query
https://amplab.cs.berkeley.edu/benchmark/

115. INGEST STORE PROCESS
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Flat Files
Database
Data
Event
Data
Streaming
Data
InteractiveBatchStreaming
PIG
Amazon
EMR
Hadoop

116. INGEST STORE PROCESS
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Flat Files
Database
Data
Event
Data
Streaming
Data
InteractiveBatchStreaming
PIG
Amazon
EMR
Hadoop

117. INGEST STORE PROCESS
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Kinesis
Consumers
Flat Files
Database
Data
Event
Data
Streaming
Data
InteractiveBatchStreaming
PIG
Amazon
EMR
Hadoop

118. INGEST STORE PROCESS
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Kinesis
Consumers
Flat Files
Database
Data
Event
Data
Streaming
Data
InteractiveBatchStreaming
PIG
Amazon
EMR
Hadoop

119. INGEST STORE PROCESS
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Kinesis
Consumers
Flat Files
Database
Data
Event
Data
Streaming
Data
InteractiveBatchStreaming
PIG
ANALYSE
Amazon
EMR
Hadoop

120. INGEST STORE PROCESS
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Kinesis
Consumers
Flat Files
Database
Data
Event
Data
Streaming
Data
InteractiveBatchStreaming
PIG
ANALYSE
Amazon
EMR
Hadoop

121. INGEST STORE PROCESS
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Kinesis
Consumers
Flat Files
Database
Data
Event
Data
Streaming
Data
InteractiveBatchStreaming
PIG
ANALYSE
Amazon
EMR
Hadoop

122. INGEST STORE PROCESS
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Kinesis
Consumers
Flat Files
Database
Data
Event
Data
Streaming
Data
InteractiveBatchStreaming
PIG
ANALYSE
Amazon
Machine
Learning
L
Amazon
EMR
Hadoop

123. Use Cases

125. FOMO

126. Amazon
EMR
Hadoop
Amazon
Machine
Learning
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Kinesis
Consumer
Flat Files
Database
Data
Event
Data
Streaming
Data
SQL Analytics

127. Amazon
EMR
Hadoop
Amazon
Machine
Learning
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Kinesis
Consumer
Flat Files
Database
Data
Event
Data
Streaming
Data
SQL Analytics

128. Amazon
EMR
Hadoop
Amazon
Machine
Learning
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Kinesis
Consumer
Flat Files
Database
Data
Event
Data
Streaming
Data
Databases
Database
Data
SQL Analytics

129. Amazon
EMR
Hadoop
Amazon
Machine
Learning
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Kinesis
Consumer
Flat Files
Database
Data
Event
Data
Streaming
Data
Databases
Amazon
Redshift
Amazon
Redshift
Database
Data
SQL Analytics

130. Amazon
EMR
Hadoop
Amazon
Machine
Learning
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Kinesis
Consumer
Flat Files
Database
Data
Event
Data
Streaming
Data
Databases
Amazon
Redshift
Amazon
Redshift
Database
Data
SQL Analytics

131. Amazon
Machine
Learning
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Kinesis
Consumer
AmazonElasticMapReduce
Flat Files
Database
Data
Event
Data
Streaming
Data
Clickstream Analysis – Batch

132. Amazon
Machine
Learning
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Kinesis
Consumer
AmazonElasticMapReduce
Flat Files
Database
Data
Event
Data
Streaming
Data
Event
Data
Clickstream Analysis – Batch

133. Amazon
Machine
Learning
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Kinesis
Consumer
AmazonElasticMapReduce
Flat Files
Database
Data
Event
Data
Streaming
Data
Event
Data
Clickstream Analysis – Batch

134. Amazon
Machine
Learning
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Kinesis
Consumer
AmazonElasticMapReduce
Flat Files
Database
Data
Event
Data
Streaming
Data
Event
Data
Amazon
EMR
Hadoop
Clickstream Analysis – Batch

135. Amazon
Machine
Learning
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Kinesis
Consumer
AmazonElasticMapReduce
Flat Files
Database
Data
Event
Data
Streaming
Data
AmazonElasticMapReduce
Event
Data
Amazon
EMR
Hadoop
Clickstream Analysis – Batch

136. Amazon
Machine
Learning
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Kinesis
Consumer
AmazonElasticMapReduce
Flat Files
Database
Data
Event
Data
Streaming
Data
AmazonElasticMapReduce
Event
Data
Amazon
EMR
Hadoop
Clickstream Analysis – Batch

137. Clickstream Analysis – Near Real Time
Amazon
Machine
Learning
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Kinesis
Consumer
AmazonElasticMapReduce
Flat Files
Database
Data
Event
Data
Streaming
Data

138. Clickstream Analysis – Near Real Time
Amazon
Machine
Learning
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Kinesis
Consumer
AmazonElasticMapReduce
Flat Files
Database
Data
Event
Data
Streaming
Data
Kinesis
Producer
Streaming
Data

139. Clickstream Analysis – Near Real Time
Amazon
Machine
Learning
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Kinesis
Consumer
AmazonElasticMapReduce
Flat Files
Database
Data
Event
Data
Streaming
Data
Kinesis
Producer
Amazon
Kinesis
Streaming
Data

140. Clickstream Analysis – Near Real Time
Amazon
Machine
Learning
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Kinesis
Consumer
AmazonElasticMapReduce
Flat Files
Database
Data
Event
Data
Streaming
Data
Kinesis
Producer
Amazon
Kinesis Kinesis
Consumers
Streaming
Data

141. Clickstream Analysis – Near Real Time
Amazon
Machine
Learning
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Kinesis
Consumer
AmazonElasticMapReduce
Flat Files
Database
Data
Event
Data
Streaming
Data
Kinesis
Producer
Amazon
Kinesis
Amazon
S3
Kinesis
Consumers
Streaming
Data

142. Clickstream Analysis – Near Real Time
Amazon
Machine
Learning
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Kinesis
Consumer
AmazonElasticMapReduce
Flat Files
Database
Data
Event
Data
Streaming
Data
Kinesis
Producer
Amazon
Kinesis
Amazon
S3
Amazon
Redshift
Kinesis
Consumers
Streaming
Data

143. Clickstream Analysis – Near Real Time
Amazon
Machine
Learning
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Kinesis
Consumer
AmazonElasticMapReduce
Flat Files
Database
Data
Event
Data
Streaming
Data
Kinesis
Producer
Amazon
Kinesis
Amazon
S3
Amazon
Redshift
Kinesis
Consumers
Streaming
Data

144. Clickstream Analysis – Near Real Time
Amazon
Machine
Learning
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Kinesis
Consumer
AmazonElasticMapReduce
Flat Files
Database
Data
Event
Data
Streaming
Data
Kinesis
Producer
Amazon
Kinesis
Amazon
S3
Amazon
Redshift
Kinesis
Consumers
Streaming
Data

145. Amazon
Machine
Learning
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Kinesis
Consumer
AmazonElasticMapReduce
Flat Files
Database
Data
Event
Data
Streaming
Data
Data Lake – Self Service Analysis

146. Amazon
Machine
Learning
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Kinesis
Consumer
AmazonElasticMapReduce
Flat Files
Database
Data
Event
Data
Streaming
Data
Databases
Database
Data
Data Lake – Self Service Analysis

147. Amazon
Machine
Learning
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Kinesis
Consumer
AmazonElasticMapReduce
Flat Files
Database
Data
Event
Data
Streaming
Data
Databases
Database
Data
Event
Data
Data Lake – Self Service Analysis

148. Amazon
Machine
Learning
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Kinesis
Consumer
AmazonElasticMapReduce
Flat Files
Database
Data
Event
Data
Streaming
Data
Databases
Database
Data
Event
Data
Streaming
DataAndroid
iOS
Data Lake – Self Service Analysis

149. Amazon
Machine
Learning
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Kinesis
Consumer
AmazonElasticMapReduce
Flat Files
Database
Data
Event
Data
Streaming
Data
Databases
Amazon
S3
Database
Data
Event
Data
Streaming
DataAndroid
iOS
Data Lake – Self Service Analysis

150. Amazon
Machine
Learning
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Kinesis
Consumer
AmazonElasticMapReduce
Flat Files
Database
Data
Event
Data
Streaming
Data
Databases
Amazon
S3
Database
Data
Event
Data
Streaming
DataAndroid
iOS
Data Lake – Self Service Analysis

151. Amazon
Machine
Learning
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Kinesis
Consumer
AmazonElasticMapReduce
Flat Files
Database
Data
Event
Data
Streaming
Data
Databases
Amazon
S3
Database
Data
Event
Data
Streaming
DataAndroid
iOS
Impala
Amazon
EMR
Hadoop
Data Lake – Self Service Analysis

152. Amazon
Machine
Learning
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Kinesis
Consumer
AmazonElasticMapReduce
Flat Files
Database
Data
Event
Data
Streaming
Data
Databases
Amazon
S3
Database
Data
Event
Data
Streaming
DataAndroid
iOS
Impala
Amazon
Redshift
Amazon
EMR
Hadoop
Data Lake – Self Service Analysis

153. Amazon
Machine
Learning
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Kinesis
Consumer
AmazonElasticMapReduce
Flat Files
Database
Data
Event
Data
Streaming
Data
Databases
Amazon
S3
Database
Data
Event
Data
Streaming
DataAndroid
iOS
Impala
Amazon
Redshift
Amazon
Machine
Learning
Amazon
EMR
Hadoop
Data Lake – Self Service Analysis

154. Customer Case Study

155. Amazon
Machine
Learning
Kinesis
Producer
Android
iOS
Databases
Amazon
Redshift
Amazon
Kinesis
Amazon
S3
Amazon
RDS
Impala
Amazon
Redshift
Apache
Storm
Kinesis
Consumer
AmazonElasticMapReduce
Flat Files
Database
Data
Event
Data
Streaming
Data
Kinesis
Producer
Amazon
Kinesis
Amazon
S3
Amazon
Redshift
Kinesis
Consumers
Streaming
Data
AmazonElasticMapReduce
Amazon
EMR
Hadoop
ABC Use Case