In the emerging era of Internet of things and Big data I will try to look at the Drupal's perspective. All web thrives over bigger and bigger data. Latest Startup trends reveal tendency of applications to work around the idea of data - how to better manage or display them. So being a Drupal professional you could ask for yourself is this platform ready or even is it a correct one to be applied? Drupal has its immense advantages of being a great CMS to manage content and data for display, but can it actually handle huge amounts of it? So this presentation covers; What's in the box for Big Data Analysis Drupal for huge amounts of data - pros and cons Is it ready as a platform Technology stack on what's needed to plug in Drupal into the subject of Big data Provide an analysis of the tools available, to set up Drupal for Big Data processing I will also demonstrate few Startup cases using Drupal as a part of their big data stack and look at their experiences

1. Drupal for big data
- is it ready?
Janis Janovskis
Passive Management Ltd
London, April 16th, 2015

2. Janis
Janovskis
@passivus
Tech Entrepreneur
English, Russian, Latvian,
PHP, Javascript, Python, Go
> 100 Frameworks
Biggest team size 55
Smallest 2
Runer, chef, photographer

4. Drupal - Big?

9. Big Data???
Big data is a broad term for data sets so large or
complex that traditional data processing
applications are inadequate. Challenges include
analysis, capture, curation, search, sharing,
storage, transfer, visualisation, and information
privacy. The term often refers simply to the use of
predictive analytics or other certain advanced
methods to extract value from data, and seldom
to a particular size of data set.
@Wikipedia

10. Volume

11. Velocity

12. Variety

13. Hang on…. What is
Drupal?

17. DataBase

18. Web server

19. Structure

21. Big Data???
Big data is a broad term for data sets so large or
complex that traditional data processing applications are
inadequate. Challenges include analysis, capture,
curation, search, sharing, storage, transfer, visualisation,
and information privacy. The term often refers simply to
the use of predictive analytics or other certain advanced
methods to extract value from data, and seldom to a
particular size of data set.

22. Unstructured data

23. Can We parse
unstructured data
with Drupal???

24. function my_analysis_external_views_plugins() {
$plugin = array();
$plugin['query']
['my_analysis_master_plugin_query'] = array();
…..
}
Views???

25. Views???
public function query($get_count = FALSE){
}

26. function execute(&$view){
$data = drupal_http_request(“what so ever”);
crazy_learn(&$data);
return drupal_render(what_so_ever($data));
}
Views???

27. https://www.lullabot.com/blog/article/building-views-query-
plugins-part-2

29. https://www.drupal.org/project/feeds_crawler

31. Pros
• Great community
• Support
• Reputation
• Myriad of vendors

32. Cons
• Too robust
• Slow
• No lazy loading
• Single threaded
• Heavy
• Structured

33. Case Studies

39. Tracked search results with nodes???

41. Visualizing Big Data In Drupal: Using Data
Visualizations to Drive Knowledge
Discovery

46. https://www.drupal.org/sandbox/cilefen/
1858412

47. Drupal for big data
- is it … ?

48. Acknowledgements
• Nicolas Roberts - niccolo.roberts@gmail.com
• http://www.westridge.com/media/series/out-of-the-box
• Florian Loretan
• My Wife
• Drupal Community
• Organisers

49. Thank You
@PassiveManage
passivemanagement.net/contact