Personal Information
Unternehmen/Arbeitsplatz
Taipei City, Taiwan, 0 Taiwan
Beruf
VP of Apache Bigtop, Big Data Engineer at Yahoo!
Branche
Technology / Software / Internet
Info
I’m an Apache Bigtop Project Committer and PMC member. The feature I developed in virtualization and containerization helps the community reinforce its automation and continuous integration pipeline for Hadoop ecosystem which yields better software quality with faster release cycles.
At Trend Micro, we built our own Hadoop Distribution to serve our own needs. My responsibilities was to build up an in-house Hadoop distribution(TMH) based on Apache Bigtop and develop a system that deploys and manages Hadoop cluster across 100+ nodes in Production.
Another achievement I have at Trend Micro was to develop a high-throughput, fault-tolerant distributed data streaming system that scales. The ...
Tags
docker
apache bigtop
apache hadoop
hadoop deployment
career
open source
apache spark
apache
big data
devops
software
asf
software industry
apache software foundation
distributed deep learning
tensorflow
optimization
sql
apache calcite
packaging
cassandra
akka
vagrant
bigtop
impala
apache flume
apache thrift
apache hbase
puppet
hdfs
hadoop
quorum journal
ha
Mehr anzeigen
- Präsentationen
- Dokumente
- Infografiken