Panel Discussion, Agile, Big Data, and Globalization
1. Panel Discussions
James Chen (Executive Officer/Vice
Managing Director of Development Unit/Manager
of Rakuten Ichiba Service Development &
Operation Department, Rakuten, Inc.)
Terje Marthinussen (Executive Officer /
Vice Managing Director of Development Unit /
Chief Architect of Next Generation Search,
Rakuten, Inc.)
Hirotaka Yoshioka (Technical Managing
Officer, Rakuten Inc.)
1
2. James Chen
Title: Executive Officer
Mission: To build the Rakuten global
ecommerce platform and ecosystem
– Leverage the best skills and background from
around the world
mitnerd – Leverage the latest technology trends (PaaS,
100% API based systems)
twitter @mitnerd – Build out a globally distributed development
process/teams.
http://www.mitnerd
.com/ Joined Rakuten since September 2009,
CTO of multiple internet service related
companies. Both startups and large
companies
Still enjoys hands-on coding!!!
2
3. Terje Marthinussen
Title: Executive Office/Search Architect
Mission: Improve search and other large
scale data processing problems.
– Development, scaling, operations
Joined Rakuten February 2010 (but
Terje worked with Rakuten since 2003)
11 years of large scale search experience.
(Fast Search & Microsoft)
19 years in large scale IT environments
Worked in 4 countries on 3 continents
3
4. Hiro Yoshioka
Title: Technical Managing Officer
Mission: Lead the technical direction of
Rakuten
– Improve software development productivity
(introducing Agile software development).
Yoshioka – Build Scalable computer
– Build developers community in Rakuten and
twitter @hyoshiok promote OSS strategy
Joined Rakuten since August 2009,
before it, he was a founding member
and CTO of Miracle Linux since 2000.
More than 25 years experience in the IT.
OSS activist
DEBUG HACKS (in Japanese),
O’reilly Japan 4
6. Big Data – Not a linear growth problem
Gartner: 3 dimensional problem:
– Volume
• 13 Exabyte global data growth expected in 2010
• Annual growth 70%.
– Variety
• Complexity and types and sources
– Velocity
• Speed/frequency of data access
• Cisco: Avg. annual Internet traffic +32% next 5 years
6
7. Rakuten Ichiba – Multi Dimensional Scaling
Velocity
Variety
queries/sec
Behaviour analytics
Mixing with other data
(reviews/social+++)
Query Complexity
Volume
Products
7
8. Commoditized through OSS?
Even Microsoft Joining?!?!??
(MS) HPC Pack 2008 R2 Service Pack 3
“In line with our announcement in October
at the PASS conference we will focus our
effort on bringing Apache Hadoop to both
Windows Server and Windows Azure.
Hadoop has emerged as a great platform
for analyzing unstructured data or large
volumes of data at low cost…”
8
9. Big Data – Why you may want to be interested
“By 2018, the United States alone could
face a shortage of 140,000 to 190,000
people with deep analytical skills as well
as 1.5 million managers and analysts with
the know-how to use the analysis of big
data to make effective decisions.”
“McKinsey - Big data: The next frontier for innovation, competition, and productivity “
9