SlideShare ist ein Scribd-Unternehmen logo
1 von 19
Downloaden Sie, um offline zu lesen
Uncertainty-aware Multidimensional
Ensemble Data Visualization and Exploration
-- Haidong Chen (Zhejiang University), Song Zhang (Mississippi State
University), Wei Chen, Honghui Mei, Jiawei Zhang (Zhejiang University),
Andrew Mercer (Mississippi State University), Ronghua Liang (Zhejiang
University) and Huamin Qu (Hong Kong University of Science and Technology).
~Presented By:
Subhashis Hazarika (The Ohio State University)
Goal
• Come up with a projection scheme for multi(/high)-dimensional data which are
uncertain( in this case ensemble of data).
• Naïve Approach involves getting the ensemble means and projecting it in low-
dimensional space. But it involves loss of distributional information for ensemble
objects.
• Applying MDS techniques with the dissimilarity matrix created from distributional
distance field is computational intensive for large datasets.
• This work wants to strike a balance between the accuracy and efficiency of
projection for large multidimensional ensemble data.
Motivation
Key Contributions
• A novel uncertainty-aware multidimensional projection approach, key factor:
– A new dissimilarity measure for the ensemble data objects.
– An enhanced Laplacian-based projection scheme.
• Augment the users’ ability to visually study the ensemble dataset with a suite of
visual exploration widgets.
Problem Formulation
• n ensemble data objects
• Each object has m d-dimensional ensemble members
• Goal is to build an l-dimensional representation preserving the relationships
among the data-objects in terms of both the ensemble mean and ensemble
distribution
Approach Overview
• 2 –step multidimensional projection:
– A small set of control points are selected from U and projected to a 2D space using conventional
MDS method.
– Next all the other objects in U are projected to the 2D space with an enhanced Laplacian system that
combines the influences from both the control points and the other points.
• To find the distance between two data objects they use both Euclidean distance
between the ensemble means as well as the JSD between the ensemble
distribution of the 2 objects.
• Overall Steps:
Create Prob. Distributions for Ensemble
Data Objects
Dissimilarity Estimate
Enhanced Projection Scheme
Ensemble Data Objects & Prob. Distribution
• To reconstruct the continuous ensemble distribution for each data object, a
multidimensional Kernel Density Estimate (KDE) method that considers the
dimensional correlations is employed.
• Used a normal kernel, moreover the selection of the kernel K(.) is less important
than the bandwidth matrix H in terms of influences on the estimation.
• Choices for H:
– Scaled Identity Matrix :
– Diagonal Matrix:
– Generic Symmetric Positive Definite Matrix.
• Silverman’s rule of thumb:
Ensemble Data Objects & Prob. Distribution
• To take advantage of the simplicity offered by the diagonal matrix while preserving
correlations among dimensions , KDE is performed not in the usual data space but
in a space defined by the principal component transformation.
• Space transformation:
– Mean centering approach:
– Then apply PCA to that yields a transformation matrix
– Lastly transform each ensemble member into a new set by:
– Because the bases of the new space are eigenvectors that are orthogonal to each other(i.e
independent) we can go ahead and use the diagonal bandwidth matrix created using eq (2) for our
KDE.
Dissimilarity Estimation
• Jensen Shannon Divergence:
• Dissimilarity between two distributions:
Enhanced Laplacian Based Projection
• Inspired by Least Square Projection. It is a 2-step local technique. Basic Idea:
– First a subset of data objects are projected to the visual space.
– Then, rest of the data objects are interpolated according to the K-nearest neighborhood graph.
• Approach:
– Select the initial control points using “K-center algorithm”. If we don’t
have any prior information about the data then we select points.
– We then calculate a set of K - nearest neighbors Ni for each ensemble object Ui. To avoid pairwise
distributional difference calculation we select the control points and the nearest neighbors only
based on the ensemble mean.
– Apparently Ni might not hold the true K-nearest neighbors of Ui because only the ensemble mean
information is utilized. During the second step of projection we will identify those values and assign
them to a random set Ri, which is an extension of Ni.
Enhanced Laplacian Based Projection
• Now project the control points using an iterative majorization algorithm called
Scaling by Majorizing a Convex Function (SMACOF) (a kind of MDS technique). Let
the low-dimensional control points be
• Laplacian-based projection schemes relies on the theory of convex combination. It
says that the low dimensional representation for each high-dimensional data
object can be regarded as a linear combination of its neighborhoods in the visual
space.
– Let be the projection of ensemble data object Ui, according to the convex combination theory
Vi can be written as:
Enhanced Laplacian Based Projection
Uncertainty Quantification
• Overall uncertainty Oi of the ensemble data object Ui is sum of standard deviation
in all dimensions:
• Deviation of the t-th ensemble member of Ui is defined as its Euclidean distance to
the ensemble mean:
From Quantification to Visualization
• Ensemble Bar: a color bar based representation to depict the uncertainty of each
data object.
Visual Exploration and Interaction
Synthetic Data
NBA Players’ Statistics
Numerical Weather Simulation Dataset
Thank You

Weitere ähnliche Inhalte

Was ist angesagt?

Pca(principal components analysis)
Pca(principal components analysis)Pca(principal components analysis)
Pca(principal components analysis)kalung0313
 
Principal component analysis, Code and Time Complexity
Principal component analysis, Code and Time ComplexityPrincipal component analysis, Code and Time Complexity
Principal component analysis, Code and Time ComplexityYounesCharfaoui
 
EfficientNet
EfficientNetEfficientNet
EfficientNetChangjin Lee
 
T. Yoon, et. al., ICLR 2021, MLILAB, KAIST AI
T. Yoon, et. al., ICLR 2021, MLILAB, KAIST AIT. Yoon, et. al., ICLR 2021, MLILAB, KAIST AI
T. Yoon, et. al., ICLR 2021, MLILAB, KAIST AIMLILAB
 
Application of Principal Components Analysis in Quality Control Problem
Application of Principal Components Analysisin Quality Control ProblemApplication of Principal Components Analysisin Quality Control Problem
Application of Principal Components Analysis in Quality Control ProblemMaxwellWiesler
 
Lecture6 pca
Lecture6 pcaLecture6 pca
Lecture6 pcaAzahel Vera
 
Principal Component Analysis and Clustering
Principal Component Analysis and ClusteringPrincipal Component Analysis and Clustering
Principal Component Analysis and ClusteringUsha Vijay
 
Probabilistic data structures
Probabilistic data structuresProbabilistic data structures
Probabilistic data structuresYoav chernobroda
 
presentation 2019 04_09_rev1
presentation 2019 04_09_rev1presentation 2019 04_09_rev1
presentation 2019 04_09_rev1Hyun Wong Choi
 
Principal component analysis - application in finance
Principal component analysis - application in financePrincipal component analysis - application in finance
Principal component analysis - application in financeIgor Hlivka
 
Lect4 principal component analysis-I
Lect4 principal component analysis-ILect4 principal component analysis-I
Lect4 principal component analysis-Ihktripathy
 
Lect5 principal component analysis
Lect5 principal component analysisLect5 principal component analysis
Lect5 principal component analysishktripathy
 
Unsupervised Learning
Unsupervised LearningUnsupervised Learning
Unsupervised LearningSAHEEL FAL DESAI
 
KNN Algorithm using C++
KNN Algorithm using C++KNN Algorithm using C++
KNN Algorithm using C++Afraz Khan
 
Principal component analysis and lda
Principal component analysis and ldaPrincipal component analysis and lda
Principal component analysis and ldaSuresh Pokharel
 
Regularized Principal Component Analysis for Spatial Data
Regularized Principal Component Analysis for Spatial DataRegularized Principal Component Analysis for Spatial Data
Regularized Principal Component Analysis for Spatial DataWen-Ting Wang
 
Visual Search
Visual SearchVisual Search
Visual SearchLov Loothra
 
Predict the Average Temperatures of Baghdad City by Used Artificial Neural Ne...
Predict the Average Temperatures of Baghdad City by Used Artificial Neural Ne...Predict the Average Temperatures of Baghdad City by Used Artificial Neural Ne...
Predict the Average Temperatures of Baghdad City by Used Artificial Neural Ne...IJERA Editor
 

Was ist angesagt? (20)

Pca(principal components analysis)
Pca(principal components analysis)Pca(principal components analysis)
Pca(principal components analysis)
 
Principal component analysis, Code and Time Complexity
Principal component analysis, Code and Time ComplexityPrincipal component analysis, Code and Time Complexity
Principal component analysis, Code and Time Complexity
 
EfficientNet
EfficientNetEfficientNet
EfficientNet
 
T. Yoon, et. al., ICLR 2021, MLILAB, KAIST AI
T. Yoon, et. al., ICLR 2021, MLILAB, KAIST AIT. Yoon, et. al., ICLR 2021, MLILAB, KAIST AI
T. Yoon, et. al., ICLR 2021, MLILAB, KAIST AI
 
Application of Principal Components Analysis in Quality Control Problem
Application of Principal Components Analysisin Quality Control ProblemApplication of Principal Components Analysisin Quality Control Problem
Application of Principal Components Analysis in Quality Control Problem
 
Lecture6 pca
Lecture6 pcaLecture6 pca
Lecture6 pca
 
Principal Component Analysis and Clustering
Principal Component Analysis and ClusteringPrincipal Component Analysis and Clustering
Principal Component Analysis and Clustering
 
Presentation
PresentationPresentation
Presentation
 
Probabilistic data structures
Probabilistic data structuresProbabilistic data structures
Probabilistic data structures
 
presentation 2019 04_09_rev1
presentation 2019 04_09_rev1presentation 2019 04_09_rev1
presentation 2019 04_09_rev1
 
Principal component analysis - application in finance
Principal component analysis - application in financePrincipal component analysis - application in finance
Principal component analysis - application in finance
 
Lect4 principal component analysis-I
Lect4 principal component analysis-ILect4 principal component analysis-I
Lect4 principal component analysis-I
 
Lect5 principal component analysis
Lect5 principal component analysisLect5 principal component analysis
Lect5 principal component analysis
 
Unsupervised Learning
Unsupervised LearningUnsupervised Learning
Unsupervised Learning
 
KNN Algorithm using C++
KNN Algorithm using C++KNN Algorithm using C++
KNN Algorithm using C++
 
Principal component analysis and lda
Principal component analysis and ldaPrincipal component analysis and lda
Principal component analysis and lda
 
Regularized Principal Component Analysis for Spatial Data
Regularized Principal Component Analysis for Spatial DataRegularized Principal Component Analysis for Spatial Data
Regularized Principal Component Analysis for Spatial Data
 
Knn
KnnKnn
Knn
 
Visual Search
Visual SearchVisual Search
Visual Search
 
Predict the Average Temperatures of Baghdad City by Used Artificial Neural Ne...
Predict the Average Temperatures of Baghdad City by Used Artificial Neural Ne...Predict the Average Temperatures of Baghdad City by Used Artificial Neural Ne...
Predict the Average Temperatures of Baghdad City by Used Artificial Neural Ne...
 

Andere mochten auch

2009_12_04_ChemRes_Presentation_Final_ver
2009_12_04_ChemRes_Presentation_Final_ver2009_12_04_ChemRes_Presentation_Final_ver
2009_12_04_ChemRes_Presentation_Final_verJoe Yee Wong
 
Shaun Barrer C-V
Shaun Barrer C-VShaun Barrer C-V
Shaun Barrer C-VShaun Barrer
 
Matts New Resume (1)
Matts New Resume (1)Matts New Resume (1)
Matts New Resume (1)Matthew Mock
 
Ofimatica gubernamenta expo
Ofimatica gubernamenta expoOfimatica gubernamenta expo
Ofimatica gubernamenta expoedmenpinares
 
Minerals, Krebs Cycle and Hair Analysis
Minerals, Krebs Cycle and Hair AnalysisMinerals, Krebs Cycle and Hair Analysis
Minerals, Krebs Cycle and Hair AnalysisDr William Barnes
 
Tipografía básica y Familias
Tipografía básica y FamiliasTipografía básica y Familias
Tipografía básica y Familiaspercy
 
Scaffold And Aerial Lift Training by KTA
Scaffold And Aerial Lift Training by KTAScaffold And Aerial Lift Training by KTA
Scaffold And Aerial Lift Training by KTAAtlantic Training, LLC.
 
Aerial Lift Safety Training by The Center to Protect Workers' Rights
Aerial Lift Safety Training by The Center to Protect Workers' RightsAerial Lift Safety Training by The Center to Protect Workers' Rights
Aerial Lift Safety Training by The Center to Protect Workers' RightsAtlantic Training, LLC.
 

Andere mochten auch (12)

Luis
LuisLuis
Luis
 
2009_12_04_ChemRes_Presentation_Final_ver
2009_12_04_ChemRes_Presentation_Final_ver2009_12_04_ChemRes_Presentation_Final_ver
2009_12_04_ChemRes_Presentation_Final_ver
 
Shaun Barrer C-V
Shaun Barrer C-VShaun Barrer C-V
Shaun Barrer C-V
 
arunsai pc
arunsai pcarunsai pc
arunsai pc
 
Matts New Resume (1)
Matts New Resume (1)Matts New Resume (1)
Matts New Resume (1)
 
Ofimatica gubernamenta expo
Ofimatica gubernamenta expoOfimatica gubernamenta expo
Ofimatica gubernamenta expo
 
Events Overview
Events OverviewEvents Overview
Events Overview
 
Ensayo tipografia
Ensayo tipografiaEnsayo tipografia
Ensayo tipografia
 
Minerals, Krebs Cycle and Hair Analysis
Minerals, Krebs Cycle and Hair AnalysisMinerals, Krebs Cycle and Hair Analysis
Minerals, Krebs Cycle and Hair Analysis
 
Tipografía básica y Familias
Tipografía básica y FamiliasTipografía básica y Familias
Tipografía básica y Familias
 
Scaffold And Aerial Lift Training by KTA
Scaffold And Aerial Lift Training by KTAScaffold And Aerial Lift Training by KTA
Scaffold And Aerial Lift Training by KTA
 
Aerial Lift Safety Training by The Center to Protect Workers' Rights
Aerial Lift Safety Training by The Center to Protect Workers' RightsAerial Lift Safety Training by The Center to Protect Workers' Rights
Aerial Lift Safety Training by The Center to Protect Workers' Rights
 

Ă„hnlich wie Uncertainty aware multidimensional ensemble data visualization and exploration

CSA 3702 machine learning module 3
CSA 3702 machine learning module 3CSA 3702 machine learning module 3
CSA 3702 machine learning module 3Nandhini S
 
Unsupervised learning Algorithms and Assumptions
Unsupervised learning Algorithms and AssumptionsUnsupervised learning Algorithms and Assumptions
Unsupervised learning Algorithms and Assumptionsrefedey275
 
Lecture 11 - KNN and Clustering, a lecture in subject module Statistical & Ma...
Lecture 11 - KNN and Clustering, a lecture in subject module Statistical & Ma...Lecture 11 - KNN and Clustering, a lecture in subject module Statistical & Ma...
Lecture 11 - KNN and Clustering, a lecture in subject module Statistical & Ma...Maninda Edirisooriya
 
Machine Learning Foundations for Professional Managers
Machine Learning Foundations for Professional ManagersMachine Learning Foundations for Professional Managers
Machine Learning Foundations for Professional ManagersAlbert Y. C. Chen
 
Supervised and unsupervised learning
Supervised and unsupervised learningSupervised and unsupervised learning
Supervised and unsupervised learningAmAn Singh
 
Machine learning clustering
Machine learning clusteringMachine learning clustering
Machine learning clusteringCosmoAIMS Bassett
 
DS9 - Clustering.pptx
DS9 - Clustering.pptxDS9 - Clustering.pptx
DS9 - Clustering.pptxJK970901
 
Image Segmentation Using Deep Learning : A survey
Image Segmentation Using Deep Learning : A surveyImage Segmentation Using Deep Learning : A survey
Image Segmentation Using Deep Learning : A surveyNUPUR YADAV
 
UNIT_V_Cluster Analysis.pptx
UNIT_V_Cluster Analysis.pptxUNIT_V_Cluster Analysis.pptx
UNIT_V_Cluster Analysis.pptxsandeepsandy494692
 
Nonlinear dimension reduction
Nonlinear dimension reductionNonlinear dimension reduction
Nonlinear dimension reductionYan Xu
 
Machine learning clustering
Machine learning clusteringMachine learning clustering
Machine learning clusteringNadeem Oozeer
 
Algorithm explanations
Algorithm explanationsAlgorithm explanations
Algorithm explanationsnikita kapil
 
Parallel KNN for Big Data using Adaptive Indexing
Parallel KNN for Big Data using Adaptive IndexingParallel KNN for Big Data using Adaptive Indexing
Parallel KNN for Big Data using Adaptive IndexingIRJET Journal
 
Could a Data Science Program use Data Science Insights?
Could a Data Science Program use Data Science Insights?Could a Data Science Program use Data Science Insights?
Could a Data Science Program use Data Science Insights?Zachary Thomas
 
Deep Semi-supervised Learning methods
Deep Semi-supervised Learning methodsDeep Semi-supervised Learning methods
Deep Semi-supervised Learning methodsPrincy Joy
 
NS-CUK Seminar: H.B.Kim, Review on "Sequential Recommendation with Graph Neu...
NS-CUK Seminar: H.B.Kim,  Review on "Sequential Recommendation with Graph Neu...NS-CUK Seminar: H.B.Kim,  Review on "Sequential Recommendation with Graph Neu...
NS-CUK Seminar: H.B.Kim, Review on "Sequential Recommendation with Graph Neu...ssuser4b1f48
 
A survey on Efficient Enhanced K-Means Clustering Algorithm
 A survey on Efficient Enhanced K-Means Clustering Algorithm A survey on Efficient Enhanced K-Means Clustering Algorithm
A survey on Efficient Enhanced K-Means Clustering Algorithmijsrd.com
 

Ă„hnlich wie Uncertainty aware multidimensional ensemble data visualization and exploration (20)

CSA 3702 machine learning module 3
CSA 3702 machine learning module 3CSA 3702 machine learning module 3
CSA 3702 machine learning module 3
 
Unsupervised learning Algorithms and Assumptions
Unsupervised learning Algorithms and AssumptionsUnsupervised learning Algorithms and Assumptions
Unsupervised learning Algorithms and Assumptions
 
DM_clustering.ppt
DM_clustering.pptDM_clustering.ppt
DM_clustering.ppt
 
Lecture 11 - KNN and Clustering, a lecture in subject module Statistical & Ma...
Lecture 11 - KNN and Clustering, a lecture in subject module Statistical & Ma...Lecture 11 - KNN and Clustering, a lecture in subject module Statistical & Ma...
Lecture 11 - KNN and Clustering, a lecture in subject module Statistical & Ma...
 
Machine Learning Foundations for Professional Managers
Machine Learning Foundations for Professional ManagersMachine Learning Foundations for Professional Managers
Machine Learning Foundations for Professional Managers
 
Supervised and unsupervised learning
Supervised and unsupervised learningSupervised and unsupervised learning
Supervised and unsupervised learning
 
Machine learning clustering
Machine learning clusteringMachine learning clustering
Machine learning clustering
 
230727_HB_JointJournalClub.pptx
230727_HB_JointJournalClub.pptx230727_HB_JointJournalClub.pptx
230727_HB_JointJournalClub.pptx
 
DS9 - Clustering.pptx
DS9 - Clustering.pptxDS9 - Clustering.pptx
DS9 - Clustering.pptx
 
Image Segmentation Using Deep Learning : A survey
Image Segmentation Using Deep Learning : A surveyImage Segmentation Using Deep Learning : A survey
Image Segmentation Using Deep Learning : A survey
 
UNIT_V_Cluster Analysis.pptx
UNIT_V_Cluster Analysis.pptxUNIT_V_Cluster Analysis.pptx
UNIT_V_Cluster Analysis.pptx
 
Nonlinear dimension reduction
Nonlinear dimension reductionNonlinear dimension reduction
Nonlinear dimension reduction
 
Machine learning clustering
Machine learning clusteringMachine learning clustering
Machine learning clustering
 
Algorithm explanations
Algorithm explanationsAlgorithm explanations
Algorithm explanations
 
Parallel KNN for Big Data using Adaptive Indexing
Parallel KNN for Big Data using Adaptive IndexingParallel KNN for Big Data using Adaptive Indexing
Parallel KNN for Big Data using Adaptive Indexing
 
Could a Data Science Program use Data Science Insights?
Could a Data Science Program use Data Science Insights?Could a Data Science Program use Data Science Insights?
Could a Data Science Program use Data Science Insights?
 
Deep Semi-supervised Learning methods
Deep Semi-supervised Learning methodsDeep Semi-supervised Learning methods
Deep Semi-supervised Learning methods
 
NS-CUK Seminar: H.B.Kim, Review on "Sequential Recommendation with Graph Neu...
NS-CUK Seminar: H.B.Kim,  Review on "Sequential Recommendation with Graph Neu...NS-CUK Seminar: H.B.Kim,  Review on "Sequential Recommendation with Graph Neu...
NS-CUK Seminar: H.B.Kim, Review on "Sequential Recommendation with Graph Neu...
 
Lalal
LalalLalal
Lalal
 
A survey on Efficient Enhanced K-Means Clustering Algorithm
 A survey on Efficient Enhanced K-Means Clustering Algorithm A survey on Efficient Enhanced K-Means Clustering Algorithm
A survey on Efficient Enhanced K-Means Clustering Algorithm
 

Mehr von Subhashis Hazarika

DNN Model Interpretability
DNN Model InterpretabilityDNN Model Interpretability
DNN Model InterpretabilitySubhashis Hazarika
 
Deep_Learning_Frameworks_CNTK_PyTorch
Deep_Learning_Frameworks_CNTK_PyTorchDeep_Learning_Frameworks_CNTK_PyTorch
Deep_Learning_Frameworks_CNTK_PyTorchSubhashis Hazarika
 
Word2Vec Network Structure Explained
Word2Vec Network Structure ExplainedWord2Vec Network Structure Explained
Word2Vec Network Structure ExplainedSubhashis Hazarika
 
Probabilistic Graph Layout for Uncertain Network Visualization
Probabilistic Graph Layout for Uncertain Network VisualizationProbabilistic Graph Layout for Uncertain Network Visualization
Probabilistic Graph Layout for Uncertain Network VisualizationSubhashis Hazarika
 
An analysis of_machine_and_human_analytics_in_classification
An analysis of_machine_and_human_analytics_in_classificationAn analysis of_machine_and_human_analytics_in_classification
An analysis of_machine_and_human_analytics_in_classificationSubhashis Hazarika
 
CSE5559::Visualizing the Life and Anatomy of Cosmic Particles
CSE5559::Visualizing the Life and Anatomy of Cosmic ParticlesCSE5559::Visualizing the Life and Anatomy of Cosmic Particles
CSE5559::Visualizing the Life and Anatomy of Cosmic ParticlesSubhashis Hazarika
 
Visualizing the variability of gradient in uncertain 2d scalarfield
Visualizing the variability of gradient in uncertain 2d scalarfieldVisualizing the variability of gradient in uncertain 2d scalarfield
Visualizing the variability of gradient in uncertain 2d scalarfieldSubhashis Hazarika
 
Sparse PDF Volumes for Consistent Multi-resolution Volume Rendering
Sparse PDF Volumes for Consistent Multi-resolution Volume RenderingSparse PDF Volumes for Consistent Multi-resolution Volume Rendering
Sparse PDF Volumes for Consistent Multi-resolution Volume RenderingSubhashis Hazarika
 
Visualization of uncertainty_without_a_mean
Visualization of uncertainty_without_a_meanVisualization of uncertainty_without_a_mean
Visualization of uncertainty_without_a_meanSubhashis Hazarika
 
Semi automatic vortex extraction in 4 d pc-mri cardiac blood flow data using ...
Semi automatic vortex extraction in 4 d pc-mri cardiac blood flow data using ...Semi automatic vortex extraction in 4 d pc-mri cardiac blood flow data using ...
Semi automatic vortex extraction in 4 d pc-mri cardiac blood flow data using ...Subhashis Hazarika
 
Graph cluster randomization
Graph cluster randomizationGraph cluster randomization
Graph cluster randomizationSubhashis Hazarika
 
Linear programming in computational geometry
Linear programming in computational geometryLinear programming in computational geometry
Linear programming in computational geometrySubhashis Hazarika
 
CERN summer presentation
CERN summer presentationCERN summer presentation
CERN summer presentationSubhashis Hazarika
 

Mehr von Subhashis Hazarika (13)

DNN Model Interpretability
DNN Model InterpretabilityDNN Model Interpretability
DNN Model Interpretability
 
Deep_Learning_Frameworks_CNTK_PyTorch
Deep_Learning_Frameworks_CNTK_PyTorchDeep_Learning_Frameworks_CNTK_PyTorch
Deep_Learning_Frameworks_CNTK_PyTorch
 
Word2Vec Network Structure Explained
Word2Vec Network Structure ExplainedWord2Vec Network Structure Explained
Word2Vec Network Structure Explained
 
Probabilistic Graph Layout for Uncertain Network Visualization
Probabilistic Graph Layout for Uncertain Network VisualizationProbabilistic Graph Layout for Uncertain Network Visualization
Probabilistic Graph Layout for Uncertain Network Visualization
 
An analysis of_machine_and_human_analytics_in_classification
An analysis of_machine_and_human_analytics_in_classificationAn analysis of_machine_and_human_analytics_in_classification
An analysis of_machine_and_human_analytics_in_classification
 
CSE5559::Visualizing the Life and Anatomy of Cosmic Particles
CSE5559::Visualizing the Life and Anatomy of Cosmic ParticlesCSE5559::Visualizing the Life and Anatomy of Cosmic Particles
CSE5559::Visualizing the Life and Anatomy of Cosmic Particles
 
Visualizing the variability of gradient in uncertain 2d scalarfield
Visualizing the variability of gradient in uncertain 2d scalarfieldVisualizing the variability of gradient in uncertain 2d scalarfield
Visualizing the variability of gradient in uncertain 2d scalarfield
 
Sparse PDF Volumes for Consistent Multi-resolution Volume Rendering
Sparse PDF Volumes for Consistent Multi-resolution Volume RenderingSparse PDF Volumes for Consistent Multi-resolution Volume Rendering
Sparse PDF Volumes for Consistent Multi-resolution Volume Rendering
 
Visualization of uncertainty_without_a_mean
Visualization of uncertainty_without_a_meanVisualization of uncertainty_without_a_mean
Visualization of uncertainty_without_a_mean
 
Semi automatic vortex extraction in 4 d pc-mri cardiac blood flow data using ...
Semi automatic vortex extraction in 4 d pc-mri cardiac blood flow data using ...Semi automatic vortex extraction in 4 d pc-mri cardiac blood flow data using ...
Semi automatic vortex extraction in 4 d pc-mri cardiac blood flow data using ...
 
Graph cluster randomization
Graph cluster randomizationGraph cluster randomization
Graph cluster randomization
 
Linear programming in computational geometry
Linear programming in computational geometryLinear programming in computational geometry
Linear programming in computational geometry
 
CERN summer presentation
CERN summer presentationCERN summer presentation
CERN summer presentation
 

KĂĽrzlich hochgeladen

Software and Systems Engineering Standards: Verification and Validation of Sy...
Software and Systems Engineering Standards: Verification and Validation of Sy...Software and Systems Engineering Standards: Verification and Validation of Sy...
Software and Systems Engineering Standards: Verification and Validation of Sy...VICTOR MAESTRE RAMIREZ
 
Sachpazis Costas: Geotechnical Engineering: A student's Perspective Introduction
Sachpazis Costas: Geotechnical Engineering: A student's Perspective IntroductionSachpazis Costas: Geotechnical Engineering: A student's Perspective Introduction
Sachpazis Costas: Geotechnical Engineering: A student's Perspective IntroductionDr.Costas Sachpazis
 
computer application and construction management
computer application and construction managementcomputer application and construction management
computer application and construction managementMariconPadriquez1
 
Vishratwadi & Ghorpadi Bridge Tender documents
Vishratwadi & Ghorpadi Bridge Tender documentsVishratwadi & Ghorpadi Bridge Tender documents
Vishratwadi & Ghorpadi Bridge Tender documentsSachinPawar510423
 
Introduction-To-Agricultural-Surveillance-Rover.pptx
Introduction-To-Agricultural-Surveillance-Rover.pptxIntroduction-To-Agricultural-Surveillance-Rover.pptx
Introduction-To-Agricultural-Surveillance-Rover.pptxk795866
 
Why does (not) Kafka need fsync: Eliminating tail latency spikes caused by fsync
Why does (not) Kafka need fsync: Eliminating tail latency spikes caused by fsyncWhy does (not) Kafka need fsync: Eliminating tail latency spikes caused by fsync
Why does (not) Kafka need fsync: Eliminating tail latency spikes caused by fsyncssuser2ae721
 
IVE Industry Focused Event - Defence Sector 2024
IVE Industry Focused Event - Defence Sector 2024IVE Industry Focused Event - Defence Sector 2024
IVE Industry Focused Event - Defence Sector 2024Mark Billinghurst
 
Application of Residue Theorem to evaluate real integrations.pptx
Application of Residue Theorem to evaluate real integrations.pptxApplication of Residue Theorem to evaluate real integrations.pptx
Application of Residue Theorem to evaluate real integrations.pptx959SahilShah
 
Earthing details of Electrical Substation
Earthing details of Electrical SubstationEarthing details of Electrical Substation
Earthing details of Electrical Substationstephanwindworld
 
Correctly Loading Incremental Data at Scale
Correctly Loading Incremental Data at ScaleCorrectly Loading Incremental Data at Scale
Correctly Loading Incremental Data at ScaleAlluxio, Inc.
 
CCS355 Neural Network & Deep Learning Unit II Notes with Question bank .pdf
CCS355 Neural Network & Deep Learning Unit II Notes with Question bank .pdfCCS355 Neural Network & Deep Learning Unit II Notes with Question bank .pdf
CCS355 Neural Network & Deep Learning Unit II Notes with Question bank .pdfAsst.prof M.Gokilavani
 
Arduino_CSE ece ppt for working and principal of arduino.ppt
Arduino_CSE ece ppt for working and principal of arduino.pptArduino_CSE ece ppt for working and principal of arduino.ppt
Arduino_CSE ece ppt for working and principal of arduino.pptSAURABHKUMAR892774
 
Unit7-DC_Motors nkkjnsdkfnfcdfknfdgfggfg
Unit7-DC_Motors nkkjnsdkfnfcdfknfdgfggfgUnit7-DC_Motors nkkjnsdkfnfcdfknfdgfggfg
Unit7-DC_Motors nkkjnsdkfnfcdfknfdgfggfgsaravananr517913
 
Call Girls Narol 7397865700 Independent Call Girls
Call Girls Narol 7397865700 Independent Call GirlsCall Girls Narol 7397865700 Independent Call Girls
Call Girls Narol 7397865700 Independent Call Girlsssuser7cb4ff
 
US Department of Education FAFSA Week of Action
US Department of Education FAFSA Week of ActionUS Department of Education FAFSA Week of Action
US Department of Education FAFSA Week of ActionMebane Rash
 
CCS355 Neural Networks & Deep Learning Unit 1 PDF notes with Question bank .pdf
CCS355 Neural Networks & Deep Learning Unit 1 PDF notes with Question bank .pdfCCS355 Neural Networks & Deep Learning Unit 1 PDF notes with Question bank .pdf
CCS355 Neural Networks & Deep Learning Unit 1 PDF notes with Question bank .pdfAsst.prof M.Gokilavani
 
welding defects observed during the welding
welding defects observed during the weldingwelding defects observed during the welding
welding defects observed during the weldingMuhammadUzairLiaqat
 

KĂĽrzlich hochgeladen (20)

young call girls in Green Park🔝 9953056974 🔝 escort Service
young call girls in Green Park🔝 9953056974 🔝 escort Serviceyoung call girls in Green Park🔝 9953056974 🔝 escort Service
young call girls in Green Park🔝 9953056974 🔝 escort Service
 
Software and Systems Engineering Standards: Verification and Validation of Sy...
Software and Systems Engineering Standards: Verification and Validation of Sy...Software and Systems Engineering Standards: Verification and Validation of Sy...
Software and Systems Engineering Standards: Verification and Validation of Sy...
 
Sachpazis Costas: Geotechnical Engineering: A student's Perspective Introduction
Sachpazis Costas: Geotechnical Engineering: A student's Perspective IntroductionSachpazis Costas: Geotechnical Engineering: A student's Perspective Introduction
Sachpazis Costas: Geotechnical Engineering: A student's Perspective Introduction
 
computer application and construction management
computer application and construction managementcomputer application and construction management
computer application and construction management
 
Exploring_Network_Security_with_JA3_by_Rakesh Seal.pptx
Exploring_Network_Security_with_JA3_by_Rakesh Seal.pptxExploring_Network_Security_with_JA3_by_Rakesh Seal.pptx
Exploring_Network_Security_with_JA3_by_Rakesh Seal.pptx
 
Vishratwadi & Ghorpadi Bridge Tender documents
Vishratwadi & Ghorpadi Bridge Tender documentsVishratwadi & Ghorpadi Bridge Tender documents
Vishratwadi & Ghorpadi Bridge Tender documents
 
Introduction-To-Agricultural-Surveillance-Rover.pptx
Introduction-To-Agricultural-Surveillance-Rover.pptxIntroduction-To-Agricultural-Surveillance-Rover.pptx
Introduction-To-Agricultural-Surveillance-Rover.pptx
 
Why does (not) Kafka need fsync: Eliminating tail latency spikes caused by fsync
Why does (not) Kafka need fsync: Eliminating tail latency spikes caused by fsyncWhy does (not) Kafka need fsync: Eliminating tail latency spikes caused by fsync
Why does (not) Kafka need fsync: Eliminating tail latency spikes caused by fsync
 
IVE Industry Focused Event - Defence Sector 2024
IVE Industry Focused Event - Defence Sector 2024IVE Industry Focused Event - Defence Sector 2024
IVE Industry Focused Event - Defence Sector 2024
 
Application of Residue Theorem to evaluate real integrations.pptx
Application of Residue Theorem to evaluate real integrations.pptxApplication of Residue Theorem to evaluate real integrations.pptx
Application of Residue Theorem to evaluate real integrations.pptx
 
Earthing details of Electrical Substation
Earthing details of Electrical SubstationEarthing details of Electrical Substation
Earthing details of Electrical Substation
 
Correctly Loading Incremental Data at Scale
Correctly Loading Incremental Data at ScaleCorrectly Loading Incremental Data at Scale
Correctly Loading Incremental Data at Scale
 
CCS355 Neural Network & Deep Learning Unit II Notes with Question bank .pdf
CCS355 Neural Network & Deep Learning Unit II Notes with Question bank .pdfCCS355 Neural Network & Deep Learning Unit II Notes with Question bank .pdf
CCS355 Neural Network & Deep Learning Unit II Notes with Question bank .pdf
 
Arduino_CSE ece ppt for working and principal of arduino.ppt
Arduino_CSE ece ppt for working and principal of arduino.pptArduino_CSE ece ppt for working and principal of arduino.ppt
Arduino_CSE ece ppt for working and principal of arduino.ppt
 
Unit7-DC_Motors nkkjnsdkfnfcdfknfdgfggfg
Unit7-DC_Motors nkkjnsdkfnfcdfknfdgfggfgUnit7-DC_Motors nkkjnsdkfnfcdfknfdgfggfg
Unit7-DC_Motors nkkjnsdkfnfcdfknfdgfggfg
 
Call Girls Narol 7397865700 Independent Call Girls
Call Girls Narol 7397865700 Independent Call GirlsCall Girls Narol 7397865700 Independent Call Girls
Call Girls Narol 7397865700 Independent Call Girls
 
US Department of Education FAFSA Week of Action
US Department of Education FAFSA Week of ActionUS Department of Education FAFSA Week of Action
US Department of Education FAFSA Week of Action
 
young call girls in Rajiv Chowk🔝 9953056974 🔝 Delhi escort Service
young call girls in Rajiv Chowk🔝 9953056974 🔝 Delhi escort Serviceyoung call girls in Rajiv Chowk🔝 9953056974 🔝 Delhi escort Service
young call girls in Rajiv Chowk🔝 9953056974 🔝 Delhi escort Service
 
CCS355 Neural Networks & Deep Learning Unit 1 PDF notes with Question bank .pdf
CCS355 Neural Networks & Deep Learning Unit 1 PDF notes with Question bank .pdfCCS355 Neural Networks & Deep Learning Unit 1 PDF notes with Question bank .pdf
CCS355 Neural Networks & Deep Learning Unit 1 PDF notes with Question bank .pdf
 
welding defects observed during the welding
welding defects observed during the weldingwelding defects observed during the welding
welding defects observed during the welding
 

Uncertainty aware multidimensional ensemble data visualization and exploration

  • 1. Uncertainty-aware Multidimensional Ensemble Data Visualization and Exploration -- Haidong Chen (Zhejiang University), Song Zhang (Mississippi State University), Wei Chen, Honghui Mei, Jiawei Zhang (Zhejiang University), Andrew Mercer (Mississippi State University), Ronghua Liang (Zhejiang University) and Huamin Qu (Hong Kong University of Science and Technology). ~Presented By: Subhashis Hazarika (The Ohio State University)
  • 2. Goal • Come up with a projection scheme for multi(/high)-dimensional data which are uncertain( in this case ensemble of data). • NaĂŻve Approach involves getting the ensemble means and projecting it in low- dimensional space. But it involves loss of distributional information for ensemble objects. • Applying MDS techniques with the dissimilarity matrix created from distributional distance field is computational intensive for large datasets. • This work wants to strike a balance between the accuracy and efficiency of projection for large multidimensional ensemble data.
  • 4. Key Contributions • A novel uncertainty-aware multidimensional projection approach, key factor: – A new dissimilarity measure for the ensemble data objects. – An enhanced Laplacian-based projection scheme. • Augment the users’ ability to visually study the ensemble dataset with a suite of visual exploration widgets.
  • 5. Problem Formulation • n ensemble data objects • Each object has m d-dimensional ensemble members • Goal is to build an l-dimensional representation preserving the relationships among the data-objects in terms of both the ensemble mean and ensemble distribution
  • 6. Approach Overview • 2 –step multidimensional projection: – A small set of control points are selected from U and projected to a 2D space using conventional MDS method. – Next all the other objects in U are projected to the 2D space with an enhanced Laplacian system that combines the influences from both the control points and the other points. • To find the distance between two data objects they use both Euclidean distance between the ensemble means as well as the JSD between the ensemble distribution of the 2 objects. • Overall Steps: Create Prob. Distributions for Ensemble Data Objects Dissimilarity Estimate Enhanced Projection Scheme
  • 7. Ensemble Data Objects & Prob. Distribution • To reconstruct the continuous ensemble distribution for each data object, a multidimensional Kernel Density Estimate (KDE) method that considers the dimensional correlations is employed. • Used a normal kernel, moreover the selection of the kernel K(.) is less important than the bandwidth matrix H in terms of influences on the estimation. • Choices for H: – Scaled Identity Matrix : – Diagonal Matrix: – Generic Symmetric Positive Definite Matrix. • Silverman’s rule of thumb:
  • 8. Ensemble Data Objects & Prob. Distribution • To take advantage of the simplicity offered by the diagonal matrix while preserving correlations among dimensions , KDE is performed not in the usual data space but in a space defined by the principal component transformation. • Space transformation: – Mean centering approach: – Then apply PCA to that yields a transformation matrix – Lastly transform each ensemble member into a new set by: – Because the bases of the new space are eigenvectors that are orthogonal to each other(i.e independent) we can go ahead and use the diagonal bandwidth matrix created using eq (2) for our KDE.
  • 9. Dissimilarity Estimation • Jensen Shannon Divergence: • Dissimilarity between two distributions:
  • 10. Enhanced Laplacian Based Projection • Inspired by Least Square Projection. It is a 2-step local technique. Basic Idea: – First a subset of data objects are projected to the visual space. – Then, rest of the data objects are interpolated according to the K-nearest neighborhood graph. • Approach: – Select the initial control points using “K-center algorithm”. If we don’t have any prior information about the data then we select points. – We then calculate a set of K - nearest neighbors Ni for each ensemble object Ui. To avoid pairwise distributional difference calculation we select the control points and the nearest neighbors only based on the ensemble mean. – Apparently Ni might not hold the true K-nearest neighbors of Ui because only the ensemble mean information is utilized. During the second step of projection we will identify those values and assign them to a random set Ri, which is an extension of Ni.
  • 11. Enhanced Laplacian Based Projection • Now project the control points using an iterative majorization algorithm called Scaling by Majorizing a Convex Function (SMACOF) (a kind of MDS technique). Let the low-dimensional control points be • Laplacian-based projection schemes relies on the theory of convex combination. It says that the low dimensional representation for each high-dimensional data object can be regarded as a linear combination of its neighborhoods in the visual space. – Let be the projection of ensemble data object Ui, according to the convex combination theory Vi can be written as:
  • 13. Uncertainty Quantification • Overall uncertainty Oi of the ensemble data object Ui is sum of standard deviation in all dimensions: • Deviation of the t-th ensemble member of Ui is defined as its Euclidean distance to the ensemble mean:
  • 14. From Quantification to Visualization • Ensemble Bar: a color bar based representation to depict the uncertainty of each data object.
  • 15. Visual Exploration and Interaction