Presentation by Deepak Kumar Gupta (General Manager, NEC Technologies India Pvt Ltd.) and Anand Sahu (Senior Technical Manager, NEC Technologies India Pvt Ltd.) FIWARE Global Summit 23-24 October 2019 - Berlin, Germany

1. © NEC Corporation 20191
Factory Shop Floor Digitalization using FIWARE
FogFlow
Deepak Gupta, Anand Sahu
NEC Technologies India

2. Contents
1. NEC and Manufacturing Industry
2. Voice Recognition (Human Operation Navigation)
3. Integrating Human Operation Navigation with FIWARE
4. Demo (Integration of NEC technologies and FIWARE)

3. © NEC Corporation 20193
NEC contributes manufacturing industry
NEC is leading the ecosystem with the Japanese manufacturing industries
PLM
SCM
CRM
IoT
Maintenance
Designing
Logistics
Engineering
Production
Control
Sales
Procurement
Manufacturing
Collaboration
Craftsmanship
Connection
Leverage
NEC has a great potential to
contribute FIWARE at Smart Industry section

4. © NEC Corporation 20194
NEC’s Cutting-edge AI Technology Suites “NEC the WISE”
NEC the WISE consists of 27 technologies that are No.1 or only 1 in the world.
Visualization
Digitalization,
Improvement
of data quality
Learning based
super-resolution
Multi-modal
image fusion
Analysis
Understanding
of meaning &
intent
Analysis with
interpretation
High-precision
analysis
Invariant analysis
Heterogeneous
mixture learning
RAPID machine learning
Textual entailment
recognition
Profiling across
spatio-temporal data
Crowd behavior
analysis
Customer profile
estimation
Prescription
Planning &
optimization
Autonomous and
adaptive control
Predictive robust
optimization
framework
Acoustic situation
awareness
Automated
Security Intelligence
Predictive analytics
automation technology
Image clarification
Recognition &
identification using
the five senses
Face recognition
Speech, emotion
recognition
Object fingerprint
recognition
Optical vibration
sensing
Ear Acoustics
Authentication
No.1※1
Only1
Only1
Only1
Only1
Only1
Only1
Only1
Only1
Only1
Only1
Only1
Only1
Only1Fingerprint
recognition
Only1
No.1※2
No.1※4
No.1※5
Micro-size ID
as a dot
Only1
*1：Ranked 1st four consecutive times in task assessment sponsored by NIST, *2：Ranked 1st five times in task assessment sponsored by NIST, *3：Ranked 1st in task assessment sponsored by NIST（2018） *4：Ranked 1st in task assessment sponsored by NIST
（2012）, *5：Ranked 1st in task assessment sponsored by IEEE AASP Challenge DCASE2016
Log pattern analysisOnly1
Iris
recognition
No.1※3
Discovery of
rare critical events
Only1
Graph-based
relation learning
Data Understanding
with Semantic
Only1

5. © NEC Corporation 20195
NEC Biometric Technologies
NEC Biometric authentication technologies contributes Smart Industry
Iris
Ear acoustic
Fingerprint
/Palm printFinger
vein
Voice
Face

6. © NEC Corporation 20196
Voice work instruction
Voice input work result
NEC Human Operation Navigation

7. © NEC Corporation 20197
Application effect of Human Operation Navigation
Work instruction by earphone and confirmation by voice increases productivity
Application Effect
Training period of standard
work
Decreased by 25%
Application Case: NEC Platforms Ltd.
Work Instruction by
sound
Input work result by
voice
Improvement Cycle
40times
（1time a month → 2times a day）
While Ensuring quality,
Productivity improved
by16%

8. © NEC Corporation 20198
Application Scene #1
Realization Image
“Improve productivity by parallel working.”
 Report with hands-free and eyes-free while working.
Reduce data input time.
Expected Result
Attach the cover.
Fix with 4 screws.
Voice Guide
OK♪
Voice
Recognition
Direct work productivity
increased by 16%
Work time of assembly process
Before
After
Reduction of check sheet
input.(9.6%)
parallel work about check
process.(6.4%)
16%
Reduced

9. © NEC Corporation 20199
Application Scene #2
“Promote improvement cycle
by getting manual operation
data regularly”
Report operation results by voice at the same time
operation time is registered.
Detect work that has large variation of operation
time and wasteful work from accumulated data, and
make improvements on operation.
Start
Start Report Report Report Report Report End
End
Before
After
Improvement cycle became
40 times faster
Realization Image Expected Result
Improvement
Improvement cycle frequency

10. Integrating Human Operations Navigation with FIWARE

11. © NEC Corporation 201911
Our Solution Focus
▌Integration with recognition technologies (Image + Voice)
Recognition
Manufacturing Machine
PictureVoice
Serial Data
Digitalization
Binary
Data
0,1,2,・・・・
0,1,2,・・・・
Worker
Factory Shop Floor
Main Focus

12. © NEC Corporation 201912
Use case (Human Work Analysis)
Process 1 OK
Assembly Lines
Analysis
Process 2 OK
Process 3 OK
▌Report work results with voice and its contents will be digitalized.
▌Picture is taken simultaneously with voice report.
▌Upload voice and picture and also its digital data to cloud. Utilize for improvement
activities of the manufacturing site.

13. © NEC Corporation 201913
System Architecture
Improved operations productivity by visualizing human work in real time
Human Work Analysis UI
FIWARE Context Broker / FogFlow
FogFlow
Human Operation
Navigation AP
Factory Pictures
Take Picture
Send Picture
View Work
Result
Get/View Picture
Factory Pictures
(azure blob service)
Factory PC
Human Work
Assembly
Result
Android
Human Operation
Navigation
OK
Done
FIWARE DB
(MongoDB)

14. © NEC Corporation 201914
FogFlow
What is FogFlow?
▌FogFlow is an Edge Computing GE in FIWARE
Ecosystem.
▌FogFlow is a distributed execution framework to
dynamically orchestrate IoT services over cloud
and edges, in order to reduce internal bandwidth
consumption and offer low latency.
▌FogFlow provides a standard-based and data-
centric edge programming model to easily and
fast realize IoT services for various business
demands.

15. © NEC Corporation 201915
Edge Programming Model (FogFunction & Service Topology)
What is FogFunction
▌FogFunction is very simple topology with only one operator and is triggered when its
input data become available.
▌FogFunction defines an operator to handle a given type of information.

16. © NEC Corporation 201916
FogFlow Benefits (Observed during evaluation)
FIWARE Advantages
▌Its open source technology and not bound to any cloud
service provider.
▌Integration of FogFlow with Orion is easy and smooth. (it
works on pub/sub model)
▌FogFlow and Orion installation and deployment is easy and
quite fast.
▌FogFlow’s FogFunction can be use at both cloud and edge
side. (capture images was done at edge side, and alert
functions was done at cloud side)
UNLOCK
EASY&
SMOOTH
AWS
Azure
FogFlow
ORION
AI
BOTH SIDE
Function Function

17. Demo

18. © NEC Corporation 201918
Benefits - Solution Perspective
▌Work process improvement by real time visualization of the work process and its
completion status by voice and image.
▌Worker skill improvement by checking the picture of worker’s work and improve.
▌Root cause analysis of defective product, which has cause on the worker side.
Root cause analysis
Work process
improvement
Improvement Cycle
Worker skill
improvement

19. © NEC Corporation 201919
Benefits – OSS Perspective
▌FIWARE/FogFlow benefits.
No Vendor Locking
FIWARE components/FogFlow
can be integrated with NEC recognition solutions
easily in a loosely coupled-way.

20. © NEC Corporation 201920
Thank You
www.nec.com/en/global/solutions/enterprise/iot/ @NEC_corp
www.linkedin.com/company/nec/ @nec.global
Hiroyuki Yamamoto
Product Manager
yamamoto@cw.jp.nec.com
Takaki Masumoto
Solution Engineer
t-masumoto@ah.jp.nec.com
Deepak Gupta
General Manager
deepak.gupta@india.nec.com
Anand Sahu
Senior Technical Manager
anand.sahu@india.nec.com

21. © NEC Corporation 201921
Appendix

22. © NEC Corporation 201922
Demo Scenario Case
1 2
3 4
Parwinder
Senior
Operator
Takaki
Associate
Operator
Deepak
Factory
Line
Leader
Jaspreet
Factory
Director
Assemble
time
30 sec
Process 1 OK
Process 2 OK
Process 3 OK
Assemble
time
1 min
Process 1 OK
Process 2
……… O...OK
Process 3 OK
Takaki
Process 1
10 sec
Process 2
40 sec
Process 3
10sec
What happen?
Process 2

23. © NEC Corporation 201923
Demo Scenario Case
Thanks to
Human Work Analysis
7
5
Get
this work photos
From factory pc
I Got it
Procedure was wrong
Remember correct procedure
Process 3
6
Process 1 Process 2
Found the cause
Process 1,2 order is wrong
B
A
B
A
B
C

24. © NEC Corporation 201924
Correct

25. © NEC Corporation 201925
Correct

26. © NEC Corporation 201926
Correct

27. © NEC Corporation 201927
Wrong

28. © NEC Corporation 201928
Wrong

29. © NEC Corporation 201929
Correct

30. © NEC Corporation 201930
Screen (Human Work Analysis)