Personal Information
Unternehmen/Arbeitsplatz
Taipei City, Taiwan, 0 Taiwan
Beruf
VP of Apache Bigtop, Big Data Engineer at Yahoo!
Branche
Technology / Software / Internet
Info
I’m an Apache Bigtop Project Committer and PMC member. The feature I developed in virtualization and containerization helps the community reinforce its automation and continuous integration pipeline for Hadoop ecosystem which yields better software quality with faster release cycles.
At Trend Micro, we built our own Hadoop Distribution to serve our own needs. My responsibilities was to build up an in-house Hadoop distribution(TMH) based on Apache Bigtop and develop a system that deploys and manages Hadoop cluster across 100+ nodes in Production.
Another achievement I have at Trend Micro was to develop a high-throughput, fault-tolerant distributed data streaming system that scales. The ...
Tags
docker
apache bigtop
apache hadoop
hadoop deployment
career
open source
apache spark
apache
big data
devops
software
asf
software industry
apache software foundation
distributed deep learning
tensorflow
optimization
sql
apache calcite
packaging
cassandra
akka
vagrant
bigtop
impala
apache flume
apache thrift
apache hbase
puppet
hdfs
hadoop
quorum journal
ha
Mehr anzeigen
- Präsentationen
- Dokumente
- Infografiken
Deep Dive into the New Features of Apache Spark 3.0
Databricks
•
Vor 3 Jahren
Scaling out Tensorflow-as-a-Service on Spark and Commodity GPUs
Jim Dowling
•
Vor 6 Jahren
Marvin Platform - Artificial Intelligence Platform
Daniel Takabayashi, MSc
•
Vor 6 Jahren
Observe Changes of Taiwan Big Data Communities with Small Data (Updated)
Jazz Yao-Tsung Wang
•
Vor 5 Jahren
Apache flink 1.7 and Beyond
Till Rohrmann
•
Vor 5 Jahren
Introduction to Apache Calcite
Jordan Halterman
•
Vor 7 Jahren
Beyond EXPLAIN: Query Optimization From Theory To Code
Yuto Hayamizu
•
Vor 7 Jahren
The Apache Way
DataWorks Summit
•
Vor 6 Jahren
Introduction to Apache Kafka
Shiao-An Yuan
•
Vor 6 Jahren
A Developer's View Into Spark's Memory Model with Wenchen Fan
Databricks
•
Vor 6 Jahren
Performance Optimizations in Apache Impala
Cloudera, Inc.
•
Vor 6 Jahren
Top 5 Mistakes to Avoid When Writing Apache Spark Applications
Cloudera, Inc.
•
Vor 8 Jahren
Data Pipeline Matters
Jazz Yao-Tsung Wang
•
Vor 6 Jahren
Easy, Scalable, Fault-tolerant stream processing with Structured Streaming in Apache Spark
DataWorks Summit
•
Vor 6 Jahren
Easy, scalable, fault tolerant stream processing with structured streaming - spark summit 2017
Databricks
•
Vor 6 Jahren
Robert Metzger - Connecting Apache Flink to the World - Reviewing the streaming connectors
Flink Forward
•
Vor 7 Jahren
Meet HBase 2.0 and Phoenix 5.0
DataWorks Summit
•
Vor 6 Jahren
Achieving HBase Multi-Tenancy with RegionServer Groups and Favored Nodes
DataWorks Summit
•
Vor 6 Jahren
Apache Hadoop 3.0 Community Update
DataWorks Summit
•
Vor 6 Jahren
Introducing Exactly Once Semantics in Apache Kafka with Matthias J. Sax
Databricks
•
Vor 6 Jahren