This document summarizes an Alluxio office hour on accelerating Hive with Alluxio on AWS S3. It discusses why S3 is popular but has performance limitations for analytics. Alluxio provides data orchestration to add caching and improve performance. The office hour demonstrated creating an EMR cluster with Alluxio using bootstrap actions, querying and writing Hive tables located in Alluxio on S3, and Alluxio's architecture. Upcoming Alluxio 2.1 features including a Presto connector were also mentioned.

1. 2019/10/01 Office Hour
Website | www.alluxio.io
Q&A | https://alluxio.io/slack
Accelerating Hive with Alluxio on S3
Bin Fan (binfan@alluxio.com)

2. Why we Love AWS S3
▪ Cheap Storage
▪ Highly available
▪ Fully managed
▪ Really large scale

3. I/O Challenges to Migrate Data-Intensive Analytics
Directly
▪ Slow object listing
▪ Expensive rename
▪ Tput throttling
▪ Eventual consistency
▪ Variable performance
▪ No data locality on computation
▪ No user-managed cache
https://www.alluxio.io/blog/effective-analytical-pipelines-on-aws-using-emr-alluxio-and-s3/

4. Alluxio is Open-Source Data Orchestration
Data Orchestration for the Cloud
Java File API HDFS Interface S3 Interface REST APIPOSIX Interface
HDFS Driver GCS Driver S3 Driver Azure Driver

5. Benefit to put Alluxio in AWS
▪ Provide better or consistent performance
▪ Add a data caching tier to S3: cache Hot data/Metadata
▪ Familiar FS semantics: listing, rename
▪ Keep data local to applications like Spark/Hive
▪ Compatible with other existing services like Hadoop, Hive, Presto
▪ Mount multiple data sources into the namespace
▪ Files/Objects in different storage GCS, Azure, HDFS
▪ Objects in other S3 buckets

6. The Alluxio Story
Originated as Tachyon project, at UC Berkley AMPLab by
Ph.D. student Haoyuan (H.Y.) Li - now Alluxio CTO2013
2015
Open Source project established & company to
commercialize Alluxio founded
Goal: Orchestrate Data at Memory Speed for the Cloud
for data driven apps such as Big Data Analytics, ML and AI.
20192018
2019
Top 10 Big Data
2019
Top 10 Cloud Software

7. Fast-growing Open Source Community
4000+ Github Stars1000+ Contributors
Join the community on Slack
(FAQ for this office hour)
alluxio.io/slack
Apache 2.0 Licensed
Contribute to source code
github.com/alluxio/alluxio

8. Data Locality via Intelligent Multi-tiering
▪ Local performance from remote data using multi-tier storage
RAM SSD HDD
Hot Warm Cold
Read & Write
Buffering
Transparent to App
Policies for pinning,
promotion/demotion, TTL
8/20/19 8

9. Spark
Presto
Bash
Tensorflow
Java
~$ cat /mnt/alluxio/myInput
Data Accessibility via popular APIs
> rdd = sc.textFile(“alluxio://master:19998/myInput”)
> CREATE SCHEMA hive.web
> WITH (location = 'alluxio://master:19998/my-table/')
~$ python classify_image.py --model_dir /mnt/fuse/imagenet/
FileSystem fs = FileSystem.Factory.get();
FileInStream in = fs.openFile(new AlluxioURI("/myInput"));

10. Data Abstraction via Unified Namespace
Enables effective data management across different Under Store
$ ./bin/alluxio fs mount /Data s3://bucket/directory

11. Typical Alluxio Use Cases
• Cloud Analytics Caching
Get in-memory data access for Spark, Presto,
or any analytics framework on Cloud storage
• Hybrid Cloud Analytics
Get in-memory data access for Spark, Presto,
or any analytics framework on Cloud storage

12. Spark
Alluxio
AWS S3
Co-locate Alluxio Workers with Spark for
optimal I/O performance
Deployment Approaches
Same instance
Spark
Alluxio
AWS S3
Deploy Alluxio as standalone cluster
between Spark and Storage
Same data
center / region
Presto

13. Alluxio-EMR Prerequisites and Design Considerations
▪ IAM Account with the default EMR Roles
▪ S3 Bucket to host Bootstrap script and to act as a UFS
▪ Key Pair for EC2
▪ AWS CLI
▪ Leverage AWS Glue/RDS to persist Hive Metastore State
▪ Bootstrap Scripts
13

14. Alluxio EMR Service Integration: Bootstrap Actions
▪ EMR provides hooks into the main configuration files for Hadoop
Services:
▪ hive-site.xml, core-site.xml, hadoop-env.sh, hive.properties
▪ Bootstrap Actions
▪ Up to 10 shell scripts specified by the user
▪ Runs before Hadoop service installation
▪ Offering for shutdown actions as well

15. DATA ORCHESTRATION SUMMIT
November 7, 2019 | Computer History Museum | Mountain View, CA
Organized by
Register Here!

16. Demo

17. Create an EMR Cluster with Alluxio
$ aws emr create-cluster
--release-label emr-5.25.0
--instance-count 3
--instance-type m4.xlarge
--applications Name=Hive
--name 'Test Cluster'
--bootstrap-actions
Path=s3://alluxio-public/emr/2.0.1/alluxio-emr.sh,
Args=[s3://alluxio-quick-start/data/]
--configurations file://alluxio-emr.json
--ec2-attributes KeyName=alluxio-aws-east
https://www.alluxio.io/products/aws/aws-emr-integration/

18. Query a Hive Table
> CREATE EXTERNAL TABLE u_user (
userid INT,
age INT,
gender CHAR(1),
occupation STRING,
zipcode STRING)
ROW FORMAT DELIMITED
FIELDS TERMINATED BY '|'
LOCATION
'alluxio://ip-172-31-14-87.ec2.internal:19998/emr/ml-100k';
> SELECT * FROM u_user;

19. Write a Hive Table
> CREATE EXTERNAL TABLE new_u_user (
userid INT,
age INT,
gender CHAR(1),
occupation STRING,
zipcode STRING)
LOCATION
'alluxio://ip-172-31-14-87.ec2.internal:19998/emr/output/';
> INSERT OVERWRITE TABLE new_u_user
SELECT * from u_user;

20. Alluxio
MasterZookeeper
/ RAFT
Standby
Master
Alluxio
Worker
Alluxio
Worker
Alluxio Reference Architecture
…
…
Application
Application
Under Store 1
Under Store 2

21. Read data in Alluxio, on same node as client
Alluxio
Worker
RAM / SSD / HDD
Memory Speed Read of Data
Application
Alluxio
Client
Alluxio
Master

22. Read data not in Alluxio
RAM / SSD / HDD
Network / Disk Speed Read of
Data
Application
Alluxio
Client
Alluxio
Master
Alluxio
WorkerUnder Store

23. Write data only to Alluxio on same node as client
Alluxio
Worker
RAM / SSD / HDD
Memory Speed Write of Data
Application
Alluxio
Client
Alluxio
Master

24. Write data to Alluxio and Under Store synchronously
RAM / SSD / HDD
Network / Disk Speed Write of
Data
Application
Alluxio
Client
Alluxio
Master
Alluxio
Worker
Under Store

25. Alluxio 2.0 & Coming in 2.1 Release
▪ Alluxio 2.0: Released in July
▪ Metadata scales to 1 bln file or more (based on rocksdb)
▪ Self-managed Metadata service based on Quorum
▪ Async writes, distributed load
▪ Many more: https://www.alluxio.io/download/releases/alluxio-2-0-0-release/
▪ Alluxio 2.1: Scheduled in Sept
▪ A Presto-Alluxio Connector with Iceberg Integration
▪ Use Alluxio as a caching layer without modifying HMS

26. Next steps - Try it out!
• Getting Started
• Spark Performance Tuning Tips
• Accelerate Spark and Hive Jobs on AWS S3: Use case from Bazaarvoic
• Spark + Alluxio: Tencent Use Case
Questions or Suggestions? Engage with us at alluxio.io/slack!

27. Questions
Slides will be available at slack channel (https://alluxio.io/slack)