SlideShare a Scribd company logo
1 of 17
The 2012 International Conference on Mechatronics and Control Engineering(ICMCE 2012)




  Decentralized Data Fusion Algorithm using Factor Analysis Model




     S.A.Quadri and Othman Sidek
     Collaborative µ-electronic Design Excellence Centre
     Universiti Sains Malaysia
Presentation overview

 Introduction to data fusion

 Decentralized data fusion

 Inertial measurement unit (IMU)

 Factor analysis

Decentralized data fusion algorithm

 Conclusion and future work
DATA FUSION
•Data-fusion is process of combining inputs from various sensors to provide a
robust and complete description of an environment or process of interest.

•It is multilevel, multifaceted process dealing with the automatic detection,
association, correlation , estimation, and combination of data and information
from single and multiple sources.
•Data fusion plays a pivotal role to achieve reasonable accuracy and precision.
• An appropriate fusion process can reduce imprecision, uncertainties and
incompleteness, thus increasing the robustness and reliability of identification.
•To achieve the great benefits of fusion, one of the important steps is
Identification of the optimal fusion architecture. Basically, there are three
fusion architectures:
 Independent (autonomous) fusion architecture
 Centralized fusion architecture
 Decentralized fusion architecture
Independent fusion architecture: It is the      Centralized fusion architecture:
simplest fashion in which signal features are   Extracts a generic set of features with
extracted and recognition (recognition is to    commonness from pre-processed signals
establish the posterior consensus) is carried   provided by individual sensors in
out independently by individual sensors.        parallel for subsequent recognition. This
                                                is distinct from other architectures where
                                                different      sensors    may      provide
                                                uncorrelated or irrelevant features.
Decentralized fusion architecture:
•It executes feature extraction &
selection for each sensor
independently.
•The features can be in common or
irrelevant from sensor to sensor. All
the extracted features are then fused
for recognition.

•A decentralized system is characterized by being modular, scalable and survivable.

• By the virtue of scalability and modularity, decentralized fusion algorithms have significant role
in data fusion systems.

•Decentralised data fusion algorithms communicate information rather than states & probabilities.
Advantages of Decentralized fusion architecture

Decentralised algorithms offer a uniquely powerful method of mathematically modeling large-
scale systems of systems.

Decentralised methods allow information gathering and decision making systems to be described
in a mathematically rigorous and modular manner.

Decentralised methods provide an ability to analyze and reason about a system and its
information gathering or decision making role.

Decentralised methods also provide a compelling ability to compose mathematical descriptions
of larger systems from descriptions of component sub-systems. That is the inherent modularity and
scalability of decentralized system algorithms.

Decentralised methods provide a natural and powerful ability to reason about composite systems
and in particular to study, a priori, system pay-offs.
Decentralized Data Fusion Algorithm using Factor Analysis Model



Here we presents fusion of estimates from gyroscope and accelerometer in an IMU
employing Factor analysis model.


Exploiting factor analysis as a tool, a Decentralized data fusion algorithm is proposed,
that extracts features (factors) from the raw data and fuse them to obtain global
estimates.


After a brief description of IMU and Factor analysis model , detail working of algorithm
is shown in following flow chart.
Inertial measurement unit (IMU)
  An inertial measurement unit (IMU) is an electronic device that measures & reports on a craft's
  velocity, orientation, & gravitational forces, using a combination of accelerometers and gyroscopes [1]




      IMU works by detecting changes in pitch, roll, and yaw.
[1] A.D. King: ‘Inertial Navigation-40 Years of Evolution’, GEC Review,13(3),(1998), p.140.
Factor analysis
•Factor analysis is a statistical method used to describe variability among observed,
correlated variables in terms of a potentially lower number of unobserved, uncorrelated
variables called factors.


•Factor analysis is a collection of methods used to examine how underlying constructs
influence the responses on a number of measured variables also used to assess the
reliability and validity of measurement scales.


•Factor analysis is used to uncover the latent structure (dimensions) of a set of variables.


•Mostly used when need to reduce a large number of variables to a smaller number of
factors for modeling purpose.
Factor analysis is related to principal component analysis (PCA), but the two are not identical.
 The difference is:
 • Diagonal of the relationships matrix is replaced with communalities in Factor analysis.
 •The variance is accounted for more than one variable in Factor analysis.




Factor Analysis Equations:
Considering each object or record has p features, so Xij is the value of feature j for object i.

We will center all the observations (subtract off their mean).
We postulate that there are q factor variables, and each observation is a linear combination of
factor scores Fir plus noise:

Xij= εij + Firwrj     (1)

The weights wrj are called the factor loadings of the observable features; how much feature j
changes, on average, in response to a one-unit change in factor score r.
Here εij is as usual the noise term for feature j on object i. We will assume this has mean zero

and variance ψj     that is, different features has differently sized noise terms. The ψ j are known as
the specific variances, because they are specific to individual features. We will further assume
that E[εij εlm] = 0, unless i = l, j = m, that is, each object and each feature has uncorrelated noise.
We can also re-write the model in vector form,


                                                    (2)


  With w being a q x p matrix. If we stack the vectors into a matrix, we get
  X= ε + Fw                 (3) [2]
  This is the factor analysis model.
  In a factor analysis model, the measured variables depend on a smaller number of unobserved (latent) factors.
  Because each factor might affect several variables in common, they are known as common factors.
  Each variable is assumed dependent on a linear combination of the common factors, and the coefficients are known as
  loadings.
  Each measured variable also includes a component due to independent random variability, known as specific variance
  because it is specific to one variable.
  Specifically, factor analysis assumes that the covariance matrix of data is of the form
  ∑x = ΛΛT + Ψ     (4)

  Where Λ is the matrix of loadings and the elements of the diagonal matrix Ψ are the specific variances.
  The function factoran fits the factor analysis model using maximum likelihood.
  Where Λ is the matrix of loadings and the elements of the diagonal matrix Ψ are the specific variances.
  Factor analysis assumes that the covariance matrix of data is of the form.
  SigmaX = Lambda*Lambda' + Psi             (5)
  Where Lambda is the matrix of loadings and the elements of the diagonal matrix Psi are the specific variances.

[2] Jing, T , An Algorithm for estimating signals using factor analysis model,
China 1991 Int. Con. Circuits and Systems, 1991, China , pp. 358-360
Decentralized Data Fusion Algorithm - Flowchart
Data is obtained from the SparkFun IMU that has noise variance of 0.07701688 for
   accelerometer & 0.00025556 for gyroscope [3].

   Factor analysis is carried using the Matlab Statistics Toolbox™.

   The flow of data and various steps of the algorithm are shown in flowchart.

   Two set of maximum likelihood estimates are obtained:

   Case1) With noise variance.

   Case 2) Without noise variance.

   In the final step of algorithm, Maximum likelihood estimates (MLE) incorporating noise
   in gyroscope and accelerometer (case1) and ML estimates without noise (case2) are
   fused and global estimates are obtained.




[3] http://home.comcast.net/~michael.p.thompson/kalman/kalman_test2.c
Simulation is carried on Matlab
platform.
The algorithm is executed by
feeding raw data from gyroscope and
accelerometer.
The estimates of gyroscope and
accelerometer incorporated with noise
variance are fused, simultaneously
estimates of the same with zero noise
variance are also fused in order to
obtain two set of global estimates.
The output result of both cases are
shown in graph.
Conclusion and future work


  The paper presents development of decentralized data fusion algorithm to fuse
data in an IMU, utilizing factor analysis model.

  One of the main concerns in data fusion technique is the risk of producing fused
estimates that are worse and lead to discontentment. Noise variance could be one of
the responsible factors for poor performance of data fusion system.

  The decentralised architecture of algorithm allows studying exclusively effect of
noise parameter associated with individual sensors.

  The future work is to study and analyze estimation error and effect of noise
variances and finally, comparison of the proposed method with other existing
algorithms.
Any Questions
Decentralized Data Fusion Algorithm using Factor Analysis Model

More Related Content

What's hot

A Novel Methodology to Implement Optimization Algorithms in Machine Learning
A Novel Methodology to Implement Optimization Algorithms in Machine LearningA Novel Methodology to Implement Optimization Algorithms in Machine Learning
A Novel Methodology to Implement Optimization Algorithms in Machine LearningVenkata Karthik Gullapalli
 
DOTNET 2013 IEEE CLOUDCOMPUTING PROJECT A fast clustering based feature subse...
DOTNET 2013 IEEE CLOUDCOMPUTING PROJECT A fast clustering based feature subse...DOTNET 2013 IEEE CLOUDCOMPUTING PROJECT A fast clustering based feature subse...
DOTNET 2013 IEEE CLOUDCOMPUTING PROJECT A fast clustering based feature subse...IEEEGLOBALSOFTTECHNOLOGIES
 
Hybridization of Meta-heuristics for Optimizing Routing protocol in VANETs
Hybridization of Meta-heuristics for Optimizing Routing protocol in VANETsHybridization of Meta-heuristics for Optimizing Routing protocol in VANETs
Hybridization of Meta-heuristics for Optimizing Routing protocol in VANETsIJERA Editor
 
IEEE 2014 JAVA DATA MINING PROJECTS A fast clustering based feature subset se...
IEEE 2014 JAVA DATA MINING PROJECTS A fast clustering based feature subset se...IEEE 2014 JAVA DATA MINING PROJECTS A fast clustering based feature subset se...
IEEE 2014 JAVA DATA MINING PROJECTS A fast clustering based feature subset se...IEEEFINALYEARSTUDENTPROJECTS
 
A fast clustering based feature subset selection algorithm for high-dimension...
A fast clustering based feature subset selection algorithm for high-dimension...A fast clustering based feature subset selection algorithm for high-dimension...
A fast clustering based feature subset selection algorithm for high-dimension...IEEEFINALYEARPROJECTS
 
Multi-Dimensional Features Reduction of Consistency Subset Evaluator on Unsup...
Multi-Dimensional Features Reduction of Consistency Subset Evaluator on Unsup...Multi-Dimensional Features Reduction of Consistency Subset Evaluator on Unsup...
Multi-Dimensional Features Reduction of Consistency Subset Evaluator on Unsup...CSCJournals
 
Inference of the JAK-STAT Gene Network via Graphical Models
Inference of the JAK-STAT Gene Network via Graphical ModelsInference of the JAK-STAT Gene Network via Graphical Models
Inference of the JAK-STAT Gene Network via Graphical ModelsSSA KPI
 
A FLOATING POINT DIVISION UNIT BASED ON TAYLOR-SERIES EXPANSION ALGORITHM AND...
A FLOATING POINT DIVISION UNIT BASED ON TAYLOR-SERIES EXPANSION ALGORITHM AND...A FLOATING POINT DIVISION UNIT BASED ON TAYLOR-SERIES EXPANSION ALGORITHM AND...
A FLOATING POINT DIVISION UNIT BASED ON TAYLOR-SERIES EXPANSION ALGORITHM AND...csandit
 
DCT AND DFT BASED BIOMETRIC RECOGNITION AND MULTIMODAL BIOMETRIC SECURITY
DCT AND DFT BASED BIOMETRIC RECOGNITION AND MULTIMODAL BIOMETRIC SECURITYDCT AND DFT BASED BIOMETRIC RECOGNITION AND MULTIMODAL BIOMETRIC SECURITY
DCT AND DFT BASED BIOMETRIC RECOGNITION AND MULTIMODAL BIOMETRIC SECURITYIAEME Publication
 
A fast clustering based feature subset selection algorithm for high-dimension...
A fast clustering based feature subset selection algorithm for high-dimension...A fast clustering based feature subset selection algorithm for high-dimension...
A fast clustering based feature subset selection algorithm for high-dimension...JPINFOTECH JAYAPRAKASH
 
Activity Recognition From IR Images Using Fuzzy Clustering Techniques
Activity Recognition From IR Images Using Fuzzy Clustering TechniquesActivity Recognition From IR Images Using Fuzzy Clustering Techniques
Activity Recognition From IR Images Using Fuzzy Clustering TechniquesIJTET Journal
 
An Adaptive Masker for the Differential Evolution Algorithm
An Adaptive Masker for the Differential Evolution AlgorithmAn Adaptive Masker for the Differential Evolution Algorithm
An Adaptive Masker for the Differential Evolution AlgorithmIOSR Journals
 
Markov Cluster Algorithm & real world application
Markov Cluster Algorithm & real world applicationMarkov Cluster Algorithm & real world application
Markov Cluster Algorithm & real world applicationAndjela Todorovic
 
Optimal feature selection from v mware esxi 5.1 feature set
Optimal feature selection from v mware esxi 5.1 feature setOptimal feature selection from v mware esxi 5.1 feature set
Optimal feature selection from v mware esxi 5.1 feature setijccmsjournal
 
CORRELATION OF EIGENVECTOR CENTRALITY TO OTHER CENTRALITY MEASURES: RANDOM, S...
CORRELATION OF EIGENVECTOR CENTRALITY TO OTHER CENTRALITY MEASURES: RANDOM, S...CORRELATION OF EIGENVECTOR CENTRALITY TO OTHER CENTRALITY MEASURES: RANDOM, S...
CORRELATION OF EIGENVECTOR CENTRALITY TO OTHER CENTRALITY MEASURES: RANDOM, S...csandit
 

What's hot (15)

A Novel Methodology to Implement Optimization Algorithms in Machine Learning
A Novel Methodology to Implement Optimization Algorithms in Machine LearningA Novel Methodology to Implement Optimization Algorithms in Machine Learning
A Novel Methodology to Implement Optimization Algorithms in Machine Learning
 
DOTNET 2013 IEEE CLOUDCOMPUTING PROJECT A fast clustering based feature subse...
DOTNET 2013 IEEE CLOUDCOMPUTING PROJECT A fast clustering based feature subse...DOTNET 2013 IEEE CLOUDCOMPUTING PROJECT A fast clustering based feature subse...
DOTNET 2013 IEEE CLOUDCOMPUTING PROJECT A fast clustering based feature subse...
 
Hybridization of Meta-heuristics for Optimizing Routing protocol in VANETs
Hybridization of Meta-heuristics for Optimizing Routing protocol in VANETsHybridization of Meta-heuristics for Optimizing Routing protocol in VANETs
Hybridization of Meta-heuristics for Optimizing Routing protocol in VANETs
 
IEEE 2014 JAVA DATA MINING PROJECTS A fast clustering based feature subset se...
IEEE 2014 JAVA DATA MINING PROJECTS A fast clustering based feature subset se...IEEE 2014 JAVA DATA MINING PROJECTS A fast clustering based feature subset se...
IEEE 2014 JAVA DATA MINING PROJECTS A fast clustering based feature subset se...
 
A fast clustering based feature subset selection algorithm for high-dimension...
A fast clustering based feature subset selection algorithm for high-dimension...A fast clustering based feature subset selection algorithm for high-dimension...
A fast clustering based feature subset selection algorithm for high-dimension...
 
Multi-Dimensional Features Reduction of Consistency Subset Evaluator on Unsup...
Multi-Dimensional Features Reduction of Consistency Subset Evaluator on Unsup...Multi-Dimensional Features Reduction of Consistency Subset Evaluator on Unsup...
Multi-Dimensional Features Reduction of Consistency Subset Evaluator on Unsup...
 
Inference of the JAK-STAT Gene Network via Graphical Models
Inference of the JAK-STAT Gene Network via Graphical ModelsInference of the JAK-STAT Gene Network via Graphical Models
Inference of the JAK-STAT Gene Network via Graphical Models
 
A FLOATING POINT DIVISION UNIT BASED ON TAYLOR-SERIES EXPANSION ALGORITHM AND...
A FLOATING POINT DIVISION UNIT BASED ON TAYLOR-SERIES EXPANSION ALGORITHM AND...A FLOATING POINT DIVISION UNIT BASED ON TAYLOR-SERIES EXPANSION ALGORITHM AND...
A FLOATING POINT DIVISION UNIT BASED ON TAYLOR-SERIES EXPANSION ALGORITHM AND...
 
DCT AND DFT BASED BIOMETRIC RECOGNITION AND MULTIMODAL BIOMETRIC SECURITY
DCT AND DFT BASED BIOMETRIC RECOGNITION AND MULTIMODAL BIOMETRIC SECURITYDCT AND DFT BASED BIOMETRIC RECOGNITION AND MULTIMODAL BIOMETRIC SECURITY
DCT AND DFT BASED BIOMETRIC RECOGNITION AND MULTIMODAL BIOMETRIC SECURITY
 
A fast clustering based feature subset selection algorithm for high-dimension...
A fast clustering based feature subset selection algorithm for high-dimension...A fast clustering based feature subset selection algorithm for high-dimension...
A fast clustering based feature subset selection algorithm for high-dimension...
 
Activity Recognition From IR Images Using Fuzzy Clustering Techniques
Activity Recognition From IR Images Using Fuzzy Clustering TechniquesActivity Recognition From IR Images Using Fuzzy Clustering Techniques
Activity Recognition From IR Images Using Fuzzy Clustering Techniques
 
An Adaptive Masker for the Differential Evolution Algorithm
An Adaptive Masker for the Differential Evolution AlgorithmAn Adaptive Masker for the Differential Evolution Algorithm
An Adaptive Masker for the Differential Evolution Algorithm
 
Markov Cluster Algorithm & real world application
Markov Cluster Algorithm & real world applicationMarkov Cluster Algorithm & real world application
Markov Cluster Algorithm & real world application
 
Optimal feature selection from v mware esxi 5.1 feature set
Optimal feature selection from v mware esxi 5.1 feature setOptimal feature selection from v mware esxi 5.1 feature set
Optimal feature selection from v mware esxi 5.1 feature set
 
CORRELATION OF EIGENVECTOR CENTRALITY TO OTHER CENTRALITY MEASURES: RANDOM, S...
CORRELATION OF EIGENVECTOR CENTRALITY TO OTHER CENTRALITY MEASURES: RANDOM, S...CORRELATION OF EIGENVECTOR CENTRALITY TO OTHER CENTRALITY MEASURES: RANDOM, S...
CORRELATION OF EIGENVECTOR CENTRALITY TO OTHER CENTRALITY MEASURES: RANDOM, S...
 

Similar to Decentralized Data Fusion Algorithm using Factor Analysis Model

A Combined Approach for Feature Subset Selection and Size Reduction for High ...
A Combined Approach for Feature Subset Selection and Size Reduction for High ...A Combined Approach for Feature Subset Selection and Size Reduction for High ...
A Combined Approach for Feature Subset Selection and Size Reduction for High ...IJERA Editor
 
Estimating project development effort using clustered regression approach
Estimating project development effort using clustered regression approachEstimating project development effort using clustered regression approach
Estimating project development effort using clustered regression approachcsandit
 
ESTIMATING PROJECT DEVELOPMENT EFFORT USING CLUSTERED REGRESSION APPROACH
ESTIMATING PROJECT DEVELOPMENT EFFORT USING CLUSTERED REGRESSION APPROACHESTIMATING PROJECT DEVELOPMENT EFFORT USING CLUSTERED REGRESSION APPROACH
ESTIMATING PROJECT DEVELOPMENT EFFORT USING CLUSTERED REGRESSION APPROACHcscpconf
 
Knowledge extraction from numerical data an abc
Knowledge extraction from numerical data an abcKnowledge extraction from numerical data an abc
Knowledge extraction from numerical data an abcIAEME Publication
 
Comparison Between Clustering Algorithms for Microarray Data Analysis
Comparison Between Clustering Algorithms for Microarray Data AnalysisComparison Between Clustering Algorithms for Microarray Data Analysis
Comparison Between Clustering Algorithms for Microarray Data AnalysisIOSR Journals
 
Machine Learning.pdf
Machine Learning.pdfMachine Learning.pdf
Machine Learning.pdfBeyaNasr1
 
Predicting electricity consumption using hidden parameters
Predicting electricity consumption using hidden parametersPredicting electricity consumption using hidden parameters
Predicting electricity consumption using hidden parametersIJLT EMAS
 
An integrated mechanism for feature selection
An integrated mechanism for feature selectionAn integrated mechanism for feature selection
An integrated mechanism for feature selectionsai kumar
 
A comparative study of clustering and biclustering of microarray data
A comparative study of clustering and biclustering of microarray dataA comparative study of clustering and biclustering of microarray data
A comparative study of clustering and biclustering of microarray dataijcsit
 
Information Spread in the Context of Evacuation Optimization
Information Spread in the Context of Evacuation OptimizationInformation Spread in the Context of Evacuation Optimization
Information Spread in the Context of Evacuation OptimizationDr. Mirko Kämpf
 
Survey on Artificial Neural Network Learning Technique Algorithms
Survey on Artificial Neural Network Learning Technique AlgorithmsSurvey on Artificial Neural Network Learning Technique Algorithms
Survey on Artificial Neural Network Learning Technique AlgorithmsIRJET Journal
 
Image-Based Multi-Sensor Data Representation and Fusion Via 2D Non-Linear Con...
Image-Based Multi-Sensor Data Representation and Fusion Via 2D Non-Linear Con...Image-Based Multi-Sensor Data Representation and Fusion Via 2D Non-Linear Con...
Image-Based Multi-Sensor Data Representation and Fusion Via 2D Non-Linear Con...CSCJournals
 
A Modified KS-test for Feature Selection
A Modified KS-test for Feature SelectionA Modified KS-test for Feature Selection
A Modified KS-test for Feature SelectionIOSR Journals
 
IRJET- Analyzing Voting Results using Influence Matrix
IRJET- Analyzing Voting Results using Influence MatrixIRJET- Analyzing Voting Results using Influence Matrix
IRJET- Analyzing Voting Results using Influence MatrixIRJET Journal
 
Performance Comparision of Machine Learning Algorithms
Performance Comparision of Machine Learning AlgorithmsPerformance Comparision of Machine Learning Algorithms
Performance Comparision of Machine Learning AlgorithmsDinusha Dilanka
 

Similar to Decentralized Data Fusion Algorithm using Factor Analysis Model (20)

Unit 3
Unit 3Unit 3
Unit 3
 
A Combined Approach for Feature Subset Selection and Size Reduction for High ...
A Combined Approach for Feature Subset Selection and Size Reduction for High ...A Combined Approach for Feature Subset Selection and Size Reduction for High ...
A Combined Approach for Feature Subset Selection and Size Reduction for High ...
 
Estimating project development effort using clustered regression approach
Estimating project development effort using clustered regression approachEstimating project development effort using clustered regression approach
Estimating project development effort using clustered regression approach
 
ESTIMATING PROJECT DEVELOPMENT EFFORT USING CLUSTERED REGRESSION APPROACH
ESTIMATING PROJECT DEVELOPMENT EFFORT USING CLUSTERED REGRESSION APPROACHESTIMATING PROJECT DEVELOPMENT EFFORT USING CLUSTERED REGRESSION APPROACH
ESTIMATING PROJECT DEVELOPMENT EFFORT USING CLUSTERED REGRESSION APPROACH
 
Knowledge extraction from numerical data an abc
Knowledge extraction from numerical data an abcKnowledge extraction from numerical data an abc
Knowledge extraction from numerical data an abc
 
Comparison Between Clustering Algorithms for Microarray Data Analysis
Comparison Between Clustering Algorithms for Microarray Data AnalysisComparison Between Clustering Algorithms for Microarray Data Analysis
Comparison Between Clustering Algorithms for Microarray Data Analysis
 
C054
C054C054
C054
 
Sensitivity Analysis
Sensitivity AnalysisSensitivity Analysis
Sensitivity Analysis
 
Machine Learning.pdf
Machine Learning.pdfMachine Learning.pdf
Machine Learning.pdf
 
Predicting electricity consumption using hidden parameters
Predicting electricity consumption using hidden parametersPredicting electricity consumption using hidden parameters
Predicting electricity consumption using hidden parameters
 
An integrated mechanism for feature selection
An integrated mechanism for feature selectionAn integrated mechanism for feature selection
An integrated mechanism for feature selection
 
A comparative study of clustering and biclustering of microarray data
A comparative study of clustering and biclustering of microarray dataA comparative study of clustering and biclustering of microarray data
A comparative study of clustering and biclustering of microarray data
 
Information Spread in the Context of Evacuation Optimization
Information Spread in the Context of Evacuation OptimizationInformation Spread in the Context of Evacuation Optimization
Information Spread in the Context of Evacuation Optimization
 
Survey on Artificial Neural Network Learning Technique Algorithms
Survey on Artificial Neural Network Learning Technique AlgorithmsSurvey on Artificial Neural Network Learning Technique Algorithms
Survey on Artificial Neural Network Learning Technique Algorithms
 
Image-Based Multi-Sensor Data Representation and Fusion Via 2D Non-Linear Con...
Image-Based Multi-Sensor Data Representation and Fusion Via 2D Non-Linear Con...Image-Based Multi-Sensor Data Representation and Fusion Via 2D Non-Linear Con...
Image-Based Multi-Sensor Data Representation and Fusion Via 2D Non-Linear Con...
 
A Modified KS-test for Feature Selection
A Modified KS-test for Feature SelectionA Modified KS-test for Feature Selection
A Modified KS-test for Feature Selection
 
M033059064
M033059064M033059064
M033059064
 
IRJET- Analyzing Voting Results using Influence Matrix
IRJET- Analyzing Voting Results using Influence MatrixIRJET- Analyzing Voting Results using Influence Matrix
IRJET- Analyzing Voting Results using Influence Matrix
 
Performance Comparision of Machine Learning Algorithms
Performance Comparision of Machine Learning AlgorithmsPerformance Comparision of Machine Learning Algorithms
Performance Comparision of Machine Learning Algorithms
 
Unit-3 Data Analytics.pdf
Unit-3 Data Analytics.pdfUnit-3 Data Analytics.pdf
Unit-3 Data Analytics.pdf
 

More from Sayed Abulhasan Quadri

Image quality improvement of Low-resolution camera using Data fusion technique
Image quality improvement of Low-resolution camera using Data fusion techniqueImage quality improvement of Low-resolution camera using Data fusion technique
Image quality improvement of Low-resolution camera using Data fusion techniqueSayed Abulhasan Quadri
 
Feature Extraction and Principal Component Analysis
Feature Extraction and Principal Component AnalysisFeature Extraction and Principal Component Analysis
Feature Extraction and Principal Component AnalysisSayed Abulhasan Quadri
 
Multi sensor data fusion system for enhanced analysis of deterioration in con...
Multi sensor data fusion system for enhanced analysis of deterioration in con...Multi sensor data fusion system for enhanced analysis of deterioration in con...
Multi sensor data fusion system for enhanced analysis of deterioration in con...Sayed Abulhasan Quadri
 
Multisensor data fusion for defense application
Multisensor data fusion for defense applicationMultisensor data fusion for defense application
Multisensor data fusion for defense applicationSayed Abulhasan Quadri
 
Sensor based structural health monitoring of concrete structures
Sensor based structural health monitoring of concrete structuresSensor based structural health monitoring of concrete structures
Sensor based structural health monitoring of concrete structuresSayed Abulhasan Quadri
 
Multi agent system to monitor structures
Multi agent system to monitor structuresMulti agent system to monitor structures
Multi agent system to monitor structuresSayed Abulhasan Quadri
 
Multisensor data fusion in object tracking applications
Multisensor data fusion in object tracking applicationsMultisensor data fusion in object tracking applications
Multisensor data fusion in object tracking applicationsSayed Abulhasan Quadri
 

More from Sayed Abulhasan Quadri (9)

What is over-the-air programming
What is over-the-air programmingWhat is over-the-air programming
What is over-the-air programming
 
Image quality improvement of Low-resolution camera using Data fusion technique
Image quality improvement of Low-resolution camera using Data fusion techniqueImage quality improvement of Low-resolution camera using Data fusion technique
Image quality improvement of Low-resolution camera using Data fusion technique
 
What is spatial Resolution
What is spatial ResolutionWhat is spatial Resolution
What is spatial Resolution
 
Feature Extraction and Principal Component Analysis
Feature Extraction and Principal Component AnalysisFeature Extraction and Principal Component Analysis
Feature Extraction and Principal Component Analysis
 
Multi sensor data fusion system for enhanced analysis of deterioration in con...
Multi sensor data fusion system for enhanced analysis of deterioration in con...Multi sensor data fusion system for enhanced analysis of deterioration in con...
Multi sensor data fusion system for enhanced analysis of deterioration in con...
 
Multisensor data fusion for defense application
Multisensor data fusion for defense applicationMultisensor data fusion for defense application
Multisensor data fusion for defense application
 
Sensor based structural health monitoring of concrete structures
Sensor based structural health monitoring of concrete structuresSensor based structural health monitoring of concrete structures
Sensor based structural health monitoring of concrete structures
 
Multi agent system to monitor structures
Multi agent system to monitor structuresMulti agent system to monitor structures
Multi agent system to monitor structures
 
Multisensor data fusion in object tracking applications
Multisensor data fusion in object tracking applicationsMultisensor data fusion in object tracking applications
Multisensor data fusion in object tracking applications
 

Recently uploaded

My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024The Digital Insurer
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embeddingZilliz
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
The Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfThe Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfSeasiaInfotech2
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostZilliz
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr LapshynFwdays
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 

Recently uploaded (20)

My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embedding
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
The Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfThe Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdf
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxE-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 

Decentralized Data Fusion Algorithm using Factor Analysis Model

  • 1. The 2012 International Conference on Mechatronics and Control Engineering(ICMCE 2012) Decentralized Data Fusion Algorithm using Factor Analysis Model S.A.Quadri and Othman Sidek Collaborative µ-electronic Design Excellence Centre Universiti Sains Malaysia
  • 2. Presentation overview  Introduction to data fusion  Decentralized data fusion  Inertial measurement unit (IMU)  Factor analysis Decentralized data fusion algorithm  Conclusion and future work
  • 3. DATA FUSION •Data-fusion is process of combining inputs from various sensors to provide a robust and complete description of an environment or process of interest. •It is multilevel, multifaceted process dealing with the automatic detection, association, correlation , estimation, and combination of data and information from single and multiple sources. •Data fusion plays a pivotal role to achieve reasonable accuracy and precision. • An appropriate fusion process can reduce imprecision, uncertainties and incompleteness, thus increasing the robustness and reliability of identification. •To achieve the great benefits of fusion, one of the important steps is Identification of the optimal fusion architecture. Basically, there are three fusion architectures:  Independent (autonomous) fusion architecture  Centralized fusion architecture  Decentralized fusion architecture
  • 4. Independent fusion architecture: It is the Centralized fusion architecture: simplest fashion in which signal features are Extracts a generic set of features with extracted and recognition (recognition is to commonness from pre-processed signals establish the posterior consensus) is carried provided by individual sensors in out independently by individual sensors. parallel for subsequent recognition. This is distinct from other architectures where different sensors may provide uncorrelated or irrelevant features.
  • 5. Decentralized fusion architecture: •It executes feature extraction & selection for each sensor independently. •The features can be in common or irrelevant from sensor to sensor. All the extracted features are then fused for recognition. •A decentralized system is characterized by being modular, scalable and survivable. • By the virtue of scalability and modularity, decentralized fusion algorithms have significant role in data fusion systems. •Decentralised data fusion algorithms communicate information rather than states & probabilities.
  • 6. Advantages of Decentralized fusion architecture Decentralised algorithms offer a uniquely powerful method of mathematically modeling large- scale systems of systems. Decentralised methods allow information gathering and decision making systems to be described in a mathematically rigorous and modular manner. Decentralised methods provide an ability to analyze and reason about a system and its information gathering or decision making role. Decentralised methods also provide a compelling ability to compose mathematical descriptions of larger systems from descriptions of component sub-systems. That is the inherent modularity and scalability of decentralized system algorithms. Decentralised methods provide a natural and powerful ability to reason about composite systems and in particular to study, a priori, system pay-offs.
  • 7. Decentralized Data Fusion Algorithm using Factor Analysis Model Here we presents fusion of estimates from gyroscope and accelerometer in an IMU employing Factor analysis model. Exploiting factor analysis as a tool, a Decentralized data fusion algorithm is proposed, that extracts features (factors) from the raw data and fuse them to obtain global estimates. After a brief description of IMU and Factor analysis model , detail working of algorithm is shown in following flow chart.
  • 8. Inertial measurement unit (IMU) An inertial measurement unit (IMU) is an electronic device that measures & reports on a craft's velocity, orientation, & gravitational forces, using a combination of accelerometers and gyroscopes [1] IMU works by detecting changes in pitch, roll, and yaw. [1] A.D. King: ‘Inertial Navigation-40 Years of Evolution’, GEC Review,13(3),(1998), p.140.
  • 9. Factor analysis •Factor analysis is a statistical method used to describe variability among observed, correlated variables in terms of a potentially lower number of unobserved, uncorrelated variables called factors. •Factor analysis is a collection of methods used to examine how underlying constructs influence the responses on a number of measured variables also used to assess the reliability and validity of measurement scales. •Factor analysis is used to uncover the latent structure (dimensions) of a set of variables. •Mostly used when need to reduce a large number of variables to a smaller number of factors for modeling purpose.
  • 10. Factor analysis is related to principal component analysis (PCA), but the two are not identical. The difference is: • Diagonal of the relationships matrix is replaced with communalities in Factor analysis. •The variance is accounted for more than one variable in Factor analysis. Factor Analysis Equations: Considering each object or record has p features, so Xij is the value of feature j for object i. We will center all the observations (subtract off their mean). We postulate that there are q factor variables, and each observation is a linear combination of factor scores Fir plus noise: Xij= εij + Firwrj (1) The weights wrj are called the factor loadings of the observable features; how much feature j changes, on average, in response to a one-unit change in factor score r. Here εij is as usual the noise term for feature j on object i. We will assume this has mean zero and variance ψj that is, different features has differently sized noise terms. The ψ j are known as the specific variances, because they are specific to individual features. We will further assume that E[εij εlm] = 0, unless i = l, j = m, that is, each object and each feature has uncorrelated noise.
  • 11. We can also re-write the model in vector form, (2) With w being a q x p matrix. If we stack the vectors into a matrix, we get X= ε + Fw (3) [2] This is the factor analysis model. In a factor analysis model, the measured variables depend on a smaller number of unobserved (latent) factors. Because each factor might affect several variables in common, they are known as common factors. Each variable is assumed dependent on a linear combination of the common factors, and the coefficients are known as loadings. Each measured variable also includes a component due to independent random variability, known as specific variance because it is specific to one variable. Specifically, factor analysis assumes that the covariance matrix of data is of the form ∑x = ΛΛT + Ψ (4) Where Λ is the matrix of loadings and the elements of the diagonal matrix Ψ are the specific variances. The function factoran fits the factor analysis model using maximum likelihood. Where Λ is the matrix of loadings and the elements of the diagonal matrix Ψ are the specific variances. Factor analysis assumes that the covariance matrix of data is of the form. SigmaX = Lambda*Lambda' + Psi (5) Where Lambda is the matrix of loadings and the elements of the diagonal matrix Psi are the specific variances. [2] Jing, T , An Algorithm for estimating signals using factor analysis model, China 1991 Int. Con. Circuits and Systems, 1991, China , pp. 358-360
  • 12. Decentralized Data Fusion Algorithm - Flowchart
  • 13. Data is obtained from the SparkFun IMU that has noise variance of 0.07701688 for accelerometer & 0.00025556 for gyroscope [3]. Factor analysis is carried using the Matlab Statistics Toolbox™. The flow of data and various steps of the algorithm are shown in flowchart. Two set of maximum likelihood estimates are obtained: Case1) With noise variance. Case 2) Without noise variance. In the final step of algorithm, Maximum likelihood estimates (MLE) incorporating noise in gyroscope and accelerometer (case1) and ML estimates without noise (case2) are fused and global estimates are obtained. [3] http://home.comcast.net/~michael.p.thompson/kalman/kalman_test2.c
  • 14. Simulation is carried on Matlab platform. The algorithm is executed by feeding raw data from gyroscope and accelerometer. The estimates of gyroscope and accelerometer incorporated with noise variance are fused, simultaneously estimates of the same with zero noise variance are also fused in order to obtain two set of global estimates. The output result of both cases are shown in graph.
  • 15. Conclusion and future work The paper presents development of decentralized data fusion algorithm to fuse data in an IMU, utilizing factor analysis model. One of the main concerns in data fusion technique is the risk of producing fused estimates that are worse and lead to discontentment. Noise variance could be one of the responsible factors for poor performance of data fusion system. The decentralised architecture of algorithm allows studying exclusively effect of noise parameter associated with individual sensors. The future work is to study and analyze estimation error and effect of noise variances and finally, comparison of the proposed method with other existing algorithms.