Enterprise IIoT Edge Processing with Apache NiFi

2. 2 © Hortonworks Inc. 2011–2018. All rights reserved. © Hortonworks, Inc. 2011-2018. All rights reserved. | Hortonworks confidential and proprietary information. Enterprise IIoT Edge Processing Timothy Spann, Solutions Engineer Hortonworks @PaaSDev

3. 3 © Hortonworks Inc. 2011–2018. All rights reserved. Disclaimer • This document may contain product features and technology directions that are under development, may be under development in the future or may ultimately not be developed. • Technical feasibility, market demand, user feedback, and the Apache Software Foundation community development process can all effect timing and final delivery. • This document’s description of these features and technology directions does not represent a contractual commitment, promise or obligation from Hortonworks to deliver these features in any generally available product. • Product features and technology directions are subject to change, and must not be included in contracts, purchase orders, or sales agreements of any kind. • Since this document contains an outline of general product development plans, customers should not rely upon it when making a purchase decision.

4. 4 © Hortonworks Inc. 2011–2018. All rights reserved. Agenda • Overview • Architecture • Ingest • Deep Learning • Examples • Questions https://community.hortonworks.com/articles/183151/enterprise-iiot-edge-processing-with-apache-nifi-m.html

5. 5 © Hortonworks Inc. 2011–2018. All rights reserved. IIoT Multiple devices, protocols, frameworks, languages, data types, sensors and networks Protocols • MQTT • HTTPS / SSL (REST/JSON) • OPC UA • CoAP • AMQP • LoRA • Cellular • JSON • XML • CSV • Raw Text • Images (JPEG, PNG) • Raw Data Streams • PDF Data Types Sensors • Cameras • Temperature/Humidity • IR • Proximity • Motion Sensors • GPS Protocols • NVidia Jetson TX1 • Raspberry Pi • Arduino • TS-7800 V2 • ESP8266 • DragonBoard 410c • BeagleBone Black • NanoPi Duo

7. 7 © Hortonworks Inc. 2011–2018. All rights reserved. Hortonworks DataFlow Manages Data in Motion Core InfrastructureSources Ã Constrained Ã High-latency Ã Localized context Ã Hybrid – cloud / on-premises Ã Low-latency Ã Global context Regional Infrastructure

8. 8 © Hortonworks Inc. 2011–2018. All rights reserved. What do we want to do? q MiniFi ingests camera images and sensor data q MiniFi executes Apache MXNet and TensorFlow at the edge q Run Apache MXNet and TensorFlow for Object Detection and Image Recognition q Apache NiFi stores images, metadata and enriched data in Hadoop q Apache OpenNLP and Apache Tika for textual data

9. © Hortonworks Inc. 2011 – 2018. All Rights Reserved Data in Motion Data at Rest Deep Historical Analysis DATA C E NTE R Stream Analytics Edge Data Data in Motion Deep Learning C LO UD Edge Data Edge Analytics Data at Rest Transformational Applications Require Connected Data

10. 10 © Hortonworks Inc. 2011–2018. All rights reserved. The New Way of Business Is Fueled by Data • Connected customers, vehicles, devices • Socially crowd-sourced requirements • Digital design and analysis • Digital prototypes and tests • Connected factories, sensors, devices • Human-robotic interaction • 3D-printing on demand • Connected trucks, inventory • Location, traffic, weather-aware distribution • Real-time inventory visibility • Dynamic rerouting • Connected customers, devices • Omni- channel demand sensing • Real-time recommendations • Connected assets • Remote service monitoring & delivery • Predictive maintenance • OTA updates MANUFACTURING DISTRIBUTION MARKETING/SALES SERVICEDEVELOPMENT

11. 11 © Hortonworks Inc. 2011–2018. All rights reserved. Aggregate all data from sensors, drones, logs, geo-location devices, images, machines and social feeds. Collect: Bring Together Mediate point-to-point and bi-directional data flows, delivering data reliably to Apache HBase, Apache Hive, HDFS, Slack and Email. Conduct: Mediate the Data Flow Parse, filter, join, transform, fork, query, sort, dissect; enrich with weather, location, Apache OpenNLP, TensorFlow and Apache MXNet. Curate: Gain Insights

12. 12 © Hortonworks Inc. 2011–2018. All rights reserved. “Innovation happens best not in isolation but in collaboration” T H E I N N O V A T I O N A D V A N T A G E P R O P R I E T A R Y A P P R O A C H T I M E INNOVATION O P E N C O M M U N I T Y

13. 13 © Hortonworks Inc. 2011–2018. All rights reserved. IIoT Processing Data Acquisition Edge Processing Real Time Stream Analytics Rapid Application Development IoT ANALYTICS CLOUD Acquire Move Routing & Filtering Deliver Parse Analysis Aggregation Modeling

14. 14 © Hortonworks Inc. 2011–2018. All rights reserved. Streaming Analytics Manager Part of MiniFi C++ Agent Detect metadata and data Extract metadata and data Content Analysis Deep Learning Framework Complex Event Processing Joining DataSets for Streaming Analytics Open Source Components Enabling Record Processing Schema Management

15. 15 © Hortonworks Inc. 2011–2018. All rights reserved. Streaming Analytics Manager Run everywhere Orchestration Queueing Simple Event Processing Deep Learning Framework Entity Resolution Natural Language Processing Open Source Components Edge Ingest Data Buffering Device Integration

17. 17 © Hortonworks Inc. 2011–2018. All rights reserved. HDF 3.1 for Big Data Engineers Multiple users, frameworks, languages, data sources & clusters BIG DATA ENGINEER • Experience in ETL • Coding skills in Scala, Python, Java • Experience with Apache Hadoop • Knowledge of tools such Hive, Flume or Pig • Knowledge of SQL • Expert in ETL (Eating, Ties and Laziness) • Social Media Maven • Deep SME in Buzzwords • No Coding skills • Interest in Pig and Falcon CAT AI • Will Drive your Car • Will Fix Your Code • Will Not Be Discussed Today • Will Not Finish This Talk For Me, This Time

18. 18 © Hortonworks Inc. 2011–2018. All rights reserved. Edge Intelligence with Apache MiNiFi Ã Guaranteed delivery Ã Data buffering ‒ Backpressure ‒ Pressure release Ã Prioritized queuing Ã Flow specific QoS ‒ Latency vs. throughput ‒ Loss tolerance Ã Data provenance Ã Recovery / recording a rolling log of fine-grained history Ã Designed for extension Different from Apache NiFi Ã Design and Deploy Ã Warm re-deploys Key Features

19. 19 © Hortonworks Inc. 2011–2018. All rights reserved. NiFi Site-to-Site (S2S) • Guaranteed delivery • 2-way SSL Encryption • Built-in proxy capabilities NiFi JVM REST API NiFi Framework Proc CS Report TaskS2S API Extension API NiFi/MiNiFi/App JVM S2S Client Libraries Proxy Socket protocol: TCP HTTP(S) protocol

20. 20 © Hortonworks Inc. 2011–2018. All rights reserved. Improved Operational Efficiency MiNiFi C++ Agent C++ Agent C++ Agent C++ Agent There are many configuration options for MiNiFi C++, all dependent on the use case, they may help with: • Minimizing memory footprint • Lowering CPU consumption • Reducing size on disk • Battery monitoring • USB Camera, PCAP, Kafka, MQTT, and TensorFlow processors and extensions https://community.hortonworks.com/articles/167193/building-and- running-minifi-cpp-in-orangepi-zero.html https://www.parisi.io/index.php/2018/01/19/batteries-not- included/

21. 21 © Hortonworks Inc. 2011–2018. All rights reserved. Why Apache NiFi? • Guaranteed delivery • Data buffering - Backpressure - Pressure release • Prioritized queuing • Flow specific QoS - Latency vs. throughput - Loss tolerance • Data provenance • Supports push and pull models • Hundreds of processors • Visual command and control • Over a fifty sources • Flow templates • Pluggable/multi-role security • Designed for extension • Clustering • Version Control

22. 22 © Hortonworks Inc. 2011–2018. All rights reserved. FlowFiles are like HTTP data HTTP Data FlowFile HTTP/1.1 200 OK Date: Sun, 10 Oct 2010 23:26:07 GMT Server: Apache/2.2.8 (CentOS) OpenSSL/0.9.8g Last-Modified: Sun, 26 Sep 2010 22:04:35 GMT ETag: "45b6-834-49130cc1182c0" Accept-Ranges: bytes Content-Length: 13 Connection: close Content-Type: text/html Hello world! Standard FlowFile Attributes Key: 'entryDate’ Value: 'Fri Jun 17 17:15:04 EDT 2016' Key: 'lineageStartDate’ Value: 'Fri Jun 17 17:15:04 EDT 2016' Key: 'fileSize’ Value: '23609' FlowFile Attribute Map Content Key: 'filename’ Value: '15650246997242' Key: 'path’ Value: './’ Binary Content * Header Content

23. 23 © Hortonworks Inc. 2011–2018. All rights reserved. Visual Command and Control • Drag and drop processors to build a flow • Start, stop, and configure components in real time • View errors and corresponding error messages • View statistics and health of data flow • Create templates of common processor & connections

25. 25 © Hortonworks Inc. 2011–2018. All rights reserved. Increased Developer Productivity Apache NiFi Registry NiFi (PROD) MiNiFi MiNiFi MiNiFi MiNiFi MiNiFi MiNiFi MiNiFi NiFi Registry API Persistence Other services Other services NiFi (QA) NiFi (Dev) Register DeployDeploy Ã NiFi Registry • Repository of versioned flows • Portability • Support multiple registries and interactions between them • Design and deploy mechanism

26. 26 © Hortonworks Inc. 2011–2018. All rights reserved. http://mxnet.incubator.apache.org/ • Cloud ready • Experienced team (XGBoost) • AWS, Microsoft, NVIDIA, Baidu, Intel backing • Apache Incubator Project • Run distributed on YARN • In my early tests, faster than TensorFlow. • Runs on Raspberry PI, Nvidia Jetson TX1 and other constrained devices • Great documentation • Gluon • Great Python Interaction • Model Server Available • ONNX Support • Now in Version 1.1! • Great Model Zoo https://mxnet.incubator.apache.org/how_to/cloud.html https://github.com/apache/incubator-mxnet/tree/1.1.0/example https://community.hortonworks.com/articles/176932/apache-deep-learning-101-using-apache-mxnet-on-the.html

27. 27 © Hortonworks Inc. 2011–2018. All rights reserved. Deep Learning Architecture HDP Node X Node Manager Datanode HBase Region HDP Node Y Node Manager Datanode HBase Region HDF Node Apache NiFi Zookeeper Apache Spark MLib Apache Spark MLib GPU Node Neural Network Apache Spark MLib Apache Spark MLib Pipeline GPU Node Neural Network Pipeline MiNiFi Java Agent MiNiFi C++ Agent HDF Node Apache NiFi Zookeeper Apache Livy

28. 28 © Hortonworks Inc. 2011–2018. All rights reserved. Why TensorFlow? • Google • Multiple platform support • Hadoop integration • Spark integration • Keras • Large Community • Python and Java APIs • GPU Support • Mobile Support • Inception v3 • Clustering • Fully functional demos • Open Source • Apache Licensed • Large Model Library • Buzz • Extensive Documentation • Raspberry Pi Support

30. 30 © Hortonworks Inc. 2011–2018. All rights reserved. TensorFlow Java Processor in Apache NiFi https://community.hortonworks.com/content/kbentry/116803/building-a-custom-processor-in- apache-nifi-12-for.html https://github.com/tspannhw/nifi-tensorflow-processor https://community.hortonworks.com/articles/178498/integrating-tensorflow-16- image-labelling-with-hdf.html

31. 31 © Hortonworks Inc. 2011–2018. All rights reserved. Apache MXNet Running on Edge Nodes (MiniFi) https://community.hortonworks.com/articles/176932/apache- deep-learning-101-using-apache-mxnet-on-the.html https://github.com/tspannhw/rpi-mxnet-movidius-minifi https://community.hortonworks.com/articles/183151/enterprise-iiot-edge-processing-with- apache-nifi-m.html

32. 32 © Hortonworks Inc. 2011–2018. All rights reserved. Edge Analytics with NVidia Jetson TX1 Running Apache MXNet (MiniFi) https://community.hortonworks.com/articles/146704/edge-analytics-with-nvidia-jetson-tx1-running-apac.html

33. 33 © Hortonworks Inc. 2011–2018. All rights reserved. Using Apache MXNet on The Edge with Sensors and Intel Movidius (MiniFi) https://community.hortonworks.com/articles/176932/apache-deep-learning-101-using-apache-mxnet-on- the.html

35. 35 © Hortonworks Inc. 2011–2018. All rights reserved. Contact https://github.com/tspannhw/ApacheDeepLearning101 https://community.hortonworks.com/users/9304/tspann.html https://dzone.com/users/297029/bunkertor.html https://www.meetup.com/futureofdata-princeton/ https://twitter.com/PaaSDev https://community.hortonworks.com/articles/155435/using-the-new-mxnet-model-server.html • https://github.com/tspannhw/IoTFusion2018Talk

36. 36 © Hortonworks Inc. 2011–2018. All rights reserved. Hortonworks Community Connection Read access for everyone, join to participate and be recognized • Full Q&A Platform (like StackOverflow) • Knowledge Base Articles • Code Samples and Repositories

37. 37 © Hortonworks Inc. 2011–2018. All rights reserved. Community Engagement Participate now at: community.hortonworks.com© Hortonworks Inc. 2011 – 2015. All Rights Reserved 4,000+ Registered Users 10,000+ Answers 15,000+ Technical Assets One Website!

38. 38 © Hortonworks Inc. 2011–2018. All rights reserved. https://community.hortonworks.com/articles/161761/new-features-in-apache-nifi- 15-apache-nifi-registr.html https://community.hortonworks.com/articles/171787/hdf-31-executing-apache- spark-via-executesparkinte.html https://community.hortonworks.com/articles/171960/using-apache-mxnet-on-an- apache-nifi-15-instance-w.html https://community.hortonworks.com/articles/171893/hdf-31-executing-apache- spark-via-executesparkinte-1.html Resources