SlideShare ist ein Scribd-Unternehmen logo
1 von 21
MANUAL SEGMENTATION AND  SEMANTIC-BASED HIERARCHICAL  TAGGING OF 3D MODELS Laura Papaleo*^, Leila De Floriani^ * ICT Department, Province of Genova ^Department of Information and Computer Science University of Genova
OUTLINE ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],November, 2009 EGIT2010 - Laura Papaleo
INTRODUCTION ,[object Object],[object Object],[object Object],[object Object],November, 2009 EGIT2010 - Laura Papaleo ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
SEMANTIC WEB ,[object Object],[object Object],[object Object],[object Object],November, 2009 EGIT2010 - Laura Papaleo
GOAL ,[object Object],[object Object],[object Object],[object Object],[object Object],November, 2009 EGIT2010 - Laura Papaleo object perception recognition object segmentation classification
ADVANTAGES ,[object Object],November, 2009 EGIT2010 - Laura Papaleo Info on the persons, the events, hyper-dimensional connections about concepts 2D Info on models, their geometry, the procedure of creation… hyper-dimensional connections about concepts 3D
BE-SMART: GRAPH-BASED REASONING ,[object Object],November, 2009 EGIT2010 - Laura Papaleo Semantic-oriented decomposition  into manifold parts(*) Manifold Decomposition  into meaningful parts Non-manifold  segmentation graph Manifold  segmentation graph Ontology-driven annotation Digital shape (*) De Floriani, Papaleo, Huang, Hendler.  A semantic web environment for digital shapes understanding. LNCS, SAMT 2007. Ontology-driven processes
SEGMENTATION TECHNIQUES ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],November, 2009 EGIT2010 - Laura Papaleo
MANUAL SEGMENTATION TECHNIQUES ,[object Object],[object Object],[object Object],[object Object],[object Object],November, 2009 EGIT2010 - Laura Papaleo SHARF et al.: Snappaste: an interactive technique for easy mesh composition. The Visual Computer (2006) WU  et al.  sketch-based interactive framework for real-time mesh segmentation. Computer Graphics International  (2007).
PREVIOUS APPROACH  (AND LIMITATIONS) (1/2) ,[object Object],[object Object],[object Object],November, 2009 EGIT2010 - Laura Papaleo DE FLORIANI L., PAPALEO L., CARISSIMI N.:  A  java3d framework for inspecting and segmenting 3d models. In Web3D (2008) ACM Segmentation into  planar regions Region clustering Manual  editing
PREVIOUS APPROACH  (AND LIMITATIONS) (2/2) ,[object Object],[object Object],[object Object],November, 2009 EGIT2010 - Laura Papaleo
MANUAL SEGMENTATION BY STROKE PAINTING ,[object Object],[object Object],[object Object],[object Object],November, 2009 EGIT2010 - Laura Papaleo ,[object Object]
PROPERTIES (1/2) ,[object Object],[object Object],[object Object],November, 2009 EGIT2010 - Laura Papaleo Set the viewpoint Draw the cut Compute  the cut
PROPERTIES (2/2) ,[object Object],[object Object],[object Object],[object Object],November, 2009 EGIT2010 - Laura Papaleo
MANIFOLD SEGMENTATION GRAPH ,[object Object],[object Object],[object Object],[object Object],November, 2009 EGIT2010 - Laura Papaleo
HIERARCHICAL SEMANTIC TAGGING ,[object Object],[object Object],[object Object],November, 2009 EGIT2010 - Laura Papaleo horse::head::leftEar
INTERFACE November, 2009 EGIT2010 - Laura Papaleo Xj3D browser Manifold segmentation graph ,[object Object],[object Object],[object Object],[object Object]
INSPECTING THE SEGMENTATION GRAPH ,[object Object],[object Object],[object Object],[object Object],[object Object],November, 2009 EGIT2010 - Laura Papaleo
SUMMARY ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],November, 2009 EGIT2010 - Laura Papaleo
FUTURE WORK ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],November, 2009 EGIT2010 - Laura Papaleo HCI!
ACKNOWLEDGEMENTS ,[object Object],[object Object],November, 2009 EGIT2010 - Laura Papaleo www.mindingtheplanet.net The Semantic Web will lower the cost of processing knowledge to the same degree as the printing press lowered the cost of distributing knowledge.

Weitere ähnliche Inhalte

Andere mochten auch

Copyright + social media + archival collections
Copyright + social media + archival collectionsCopyright + social media + archival collections
Copyright + social media + archival collections
Katie Hannan
 
Topic 3 The Glourious Revolution
Topic 3 The Glourious RevolutionTopic 3 The Glourious Revolution
Topic 3 The Glourious Revolution
wesleybatcheller
 
Elements of Plot
Elements of PlotElements of Plot
Elements of Plot
emaleismith
 

Andere mochten auch (20)

Logical Detection of Invalid SameAs Statements in RDF Data
Logical Detection of Invalid SameAs Statements in RDF DataLogical Detection of Invalid SameAs Statements in RDF Data
Logical Detection of Invalid SameAs Statements in RDF Data
 
TopMesh A Tool for Extracting Topological Information From Non-Manifold Objects
TopMeshA Tool for Extracting Topological Information From Non-Manifold ObjectsTopMeshA Tool for Extracting Topological Information From Non-Manifold Objects
TopMesh A Tool for Extracting Topological Information From Non-Manifold Objects
 
Engaging Students with PBL and Technology
Engaging Students with PBL and TechnologyEngaging Students with PBL and Technology
Engaging Students with PBL and Technology
 
FTCC On Ground Faculty Track
FTCC On Ground Faculty TrackFTCC On Ground Faculty Track
FTCC On Ground Faculty Track
 
Ainoa's hobby
Ainoa's hobbyAinoa's hobby
Ainoa's hobby
 
Brainstorming in an Agile World, present- Esri UC 2015
Brainstorming in an Agile World, present- Esri UC 2015Brainstorming in an Agile World, present- Esri UC 2015
Brainstorming in an Agile World, present- Esri UC 2015
 
Webinar Expense Management 1 december 2010
Webinar Expense Management 1 december 2010Webinar Expense Management 1 december 2010
Webinar Expense Management 1 december 2010
 
Memoria Anesvad 2011
Memoria Anesvad 2011Memoria Anesvad 2011
Memoria Anesvad 2011
 
2.10 Example Presentation
2.10 Example Presentation2.10 Example Presentation
2.10 Example Presentation
 
Iván my hobby
Iván my hobbyIván my hobby
Iván my hobby
 
Copyright + social media + archival collections
Copyright + social media + archival collectionsCopyright + social media + archival collections
Copyright + social media + archival collections
 
Social Entrepreneurship in Action in Spanish Libraries
Social Entrepreneurship in Action in Spanish LibrariesSocial Entrepreneurship in Action in Spanish Libraries
Social Entrepreneurship in Action in Spanish Libraries
 
The War Years Notes 3
The War Years Notes 3The War Years Notes 3
The War Years Notes 3
 
Topic 3 The Glourious Revolution
Topic 3 The Glourious RevolutionTopic 3 The Glourious Revolution
Topic 3 The Glourious Revolution
 
Bridging Semantic Web and Digital Shapes
Bridging Semantic Web and Digital ShapesBridging Semantic Web and Digital Shapes
Bridging Semantic Web and Digital Shapes
 
Elements of Plot
Elements of PlotElements of Plot
Elements of Plot
 
Strategic User Experience
Strategic User ExperienceStrategic User Experience
Strategic User Experience
 
Waltinho de iroko ingorossi
Waltinho de iroko   ingorossiWaltinho de iroko   ingorossi
Waltinho de iroko ingorossi
 
Chris Cakebread: Using Data Positvely
Chris Cakebread: Using Data PositvelyChris Cakebread: Using Data Positvely
Chris Cakebread: Using Data Positvely
 
Pearson cbe playbook for sxsw 7 16
Pearson cbe playbook for sxsw 7 16Pearson cbe playbook for sxsw 7 16
Pearson cbe playbook for sxsw 7 16
 

Ähnlich wie Manual Segmentation and semantic-based hierarchical tagginf od 3d models

Text region extraction from low resolution display board ima
Text region extraction from low resolution display board imaText region extraction from low resolution display board ima
Text region extraction from low resolution display board ima
IAEME Publication
 
Integrating GIS utility data in the UK
Integrating GIS utility data in the UKIntegrating GIS utility data in the UK
Integrating GIS utility data in the UK
AntArch
 
MPEG-7 Services in Community Engines
MPEG-7 Services in Community EnginesMPEG-7 Services in Community Engines
MPEG-7 Services in Community Engines
Ralf Klamma
 
3D Generalization Lenses (IV 2008)
3D Generalization Lenses (IV 2008)3D Generalization Lenses (IV 2008)
3D Generalization Lenses (IV 2008)
Matthias Trapp
 

Ähnlich wie Manual Segmentation and semantic-based hierarchical tagginf od 3d models (20)

Text region extraction from low resolution display board ima
Text region extraction from low resolution display board imaText region extraction from low resolution display board ima
Text region extraction from low resolution display board ima
 
A Uniform Specification Of Mixed Reality Interface Components
A Uniform Specification Of Mixed Reality Interface ComponentsA Uniform Specification Of Mixed Reality Interface Components
A Uniform Specification Of Mixed Reality Interface Components
 
Geotagging Photographs By Sanjay Rana
Geotagging Photographs By Sanjay RanaGeotagging Photographs By Sanjay Rana
Geotagging Photographs By Sanjay Rana
 
Model Based Development For 3 D User Interfaces
Model Based Development For 3 D User InterfacesModel Based Development For 3 D User Interfaces
Model Based Development For 3 D User Interfaces
 
isprsarchives-XL-3-381-2014
isprsarchives-XL-3-381-2014isprsarchives-XL-3-381-2014
isprsarchives-XL-3-381-2014
 
Analysis and Visualization of Network Data Using JUNG
Analysis and Visualization of Network Data Using JUNGAnalysis and Visualization of Network Data Using JUNG
Analysis and Visualization of Network Data Using JUNG
 
IRJET- Photo Optical Character Recognition Model
IRJET- Photo Optical Character Recognition ModelIRJET- Photo Optical Character Recognition Model
IRJET- Photo Optical Character Recognition Model
 
Integrating GIS utility data in the UK
Integrating GIS utility data in the UKIntegrating GIS utility data in the UK
Integrating GIS utility data in the UK
 
MPEG-7 Services in Community Engines
MPEG-7 Services in Community EnginesMPEG-7 Services in Community Engines
MPEG-7 Services in Community Engines
 
A semantic-based framework for managing, searching and retrieving 3D resource...
A semantic-based framework for managing, searching and retrieving 3D resource...A semantic-based framework for managing, searching and retrieving 3D resource...
A semantic-based framework for managing, searching and retrieving 3D resource...
 
Introduction to mago3D, an Open Source Based Digital Twin Platform
Introduction to mago3D, an Open Source Based Digital Twin PlatformIntroduction to mago3D, an Open Source Based Digital Twin Platform
Introduction to mago3D, an Open Source Based Digital Twin Platform
 
SD-miner System to Retrieve Probabilistic Neighborhood Points in Spatial Dat...
SD-miner System to Retrieve Probabilistic Neighborhood Points  in Spatial Dat...SD-miner System to Retrieve Probabilistic Neighborhood Points  in Spatial Dat...
SD-miner System to Retrieve Probabilistic Neighborhood Points in Spatial Dat...
 
IRJET- Object Detection using Hausdorff Distance
IRJET-  	  Object Detection using Hausdorff DistanceIRJET-  	  Object Detection using Hausdorff Distance
IRJET- Object Detection using Hausdorff Distance
 
Paper Dec 2016
Paper Dec 2016Paper Dec 2016
Paper Dec 2016
 
IRJET - Object Detection using Hausdorff Distance
IRJET -  	  Object Detection using Hausdorff DistanceIRJET -  	  Object Detection using Hausdorff Distance
IRJET - Object Detection using Hausdorff Distance
 
CNN MODEL FOR TRAFFIC SIGN RECOGNITION
CNN MODEL FOR TRAFFIC SIGN RECOGNITIONCNN MODEL FOR TRAFFIC SIGN RECOGNITION
CNN MODEL FOR TRAFFIC SIGN RECOGNITION
 
SEMANCO - Integrating multiple data sources, domains and tools in urban ener...
SEMANCO - Integrating multiple data sources, domains and tools in  urban ener...SEMANCO - Integrating multiple data sources, domains and tools in  urban ener...
SEMANCO - Integrating multiple data sources, domains and tools in urban ener...
 
The Future is Big Graphs: A Community View on Graph Processing Systems
The Future is Big Graphs: A Community View on Graph Processing SystemsThe Future is Big Graphs: A Community View on Graph Processing Systems
The Future is Big Graphs: A Community View on Graph Processing Systems
 
3D Generalization Lenses (IV 2008)
3D Generalization Lenses (IV 2008)3D Generalization Lenses (IV 2008)
3D Generalization Lenses (IV 2008)
 
An interactive image segmentation using multiple user input’s
An interactive image segmentation using multiple user input’sAn interactive image segmentation using multiple user input’s
An interactive image segmentation using multiple user input’s
 

Manual Segmentation and semantic-based hierarchical tagginf od 3d models

  • 1. MANUAL SEGMENTATION AND SEMANTIC-BASED HIERARCHICAL TAGGING OF 3D MODELS Laura Papaleo*^, Leila De Floriani^ * ICT Department, Province of Genova ^Department of Information and Computer Science University of Genova
  • 2.
  • 3.
  • 4.
  • 5.
  • 6.
  • 7.
  • 8.
  • 9.
  • 10.
  • 11.
  • 12.
  • 13.
  • 14.
  • 15.
  • 16.
  • 17.
  • 18.
  • 19.
  • 20.
  • 21.

Hinweis der Redaktion

  1. In this presentation I’m going to present the results in the development of a semantic web system for 3D shape understanding and annotation. The system can be located in a more wide framework of research that research group I belong to has established with the RPI Department of Cognitive Science leaded by Prof J. Hendler. this slide is just to remind that the activity we are working on in this paper is related to digital representations of 3D object and 3D objects are becoming widely available on the net and used in many disciplines. There is so a general need of organizing these representations in an intelligent way. One of the first project in this sense was a NSF project in 2002 which concentrated mainly on medical 3D objects and the way in which this objects can be analyzed and organized… to be searched well. In any case the key in this framework is to extract knowledge from digital representations and maintain that in order also to efficiently search and retrieve and eventually reason on them.
  2. Semantic Web proposes annotating document content using semantic information. The result is multimedia content with machine interpretable mark-up that provide the source material with which agents and SemanticWeb services operate, thus creating annotations with well-defined semantics.
  3. Qui diciamo che tutto il ragionamento relativo all’oggetto (o alla scena) viene fatto basandosi su una rappresentazione a grafo Il grafo si chiama segmentation graph ed è un two-level segmentation graph. Il primo livello (attivo nel caso di modelli non-manifold) etc Il secondo livello si chiama manifodl segmentation graph Le informazioni semantiche verranno associate ai nodi del grafo (o eventualmente, se necessario anche agli archi) e quindi alle porzioni di oggetto…
  4. In our case, since X3D allows to define shapes using vertices and not edges, the use of an implementation of the original approach would have been computationally expensive. Every time the user would draw the stroke, the system should compute the intersection between a circle of radius r and all the edges present in the scene and projected on the viewplane.We decided to apply the algorithm on the vertices of the model. This change does not modify the general methodology, but it allows us to reduce the number of operations to be performed.With our choice, in fact, we do not have to compute intersections (solving linear systems) but only euclidean distances. Additionally, we have been able to extend the procedure to surface meshes which are not represented only by triangles, using in this way all the faces types defined by the X3D standard. Furthermore, we extended the method to special cases: we can treat the case in which, given a stroke (as a set of circles) there is no vertex inside it connecting the initial and final vertex of the stroke: each time we cannot find a connection inside the stroke, we search for the nearest point in the surface model and we let the path passing from it. This procedure solves also the case in which, given the stroke, the system cannot find an initial and/or final vertex. For automatic computation of the cut in the not visible part of the model, we improved the original method restricting the search of the connections to a subset of vertices. For doing this we compute the visibility of each vertex before performing the cut.
  5. In our case, since X3D allows to define shapes using vertices and not edges, the use of an implementation of the original approach would have been computationally expensive. Every time the user would draw the stroke, the system should compute the intersection between a circle of radius r and all the edges present in the scene and projected on the viewplane.We decided to apply the algorithm on the vertices of the model. This change does not modify the general methodology, but it allows us to reduce the number of operations to be performed.With our choice, in fact, we do not have to compute intersections (solving linear systems) but only euclidean distances. Additionally, we have been able to extend the procedure to surface meshes which are not represented only by triangles, using in this way all the faces types defined by the X3D standard. Furthermore, we extended the method to special cases: we can treat the case in which, given a stroke (as a set of circles) there is no vertex inside it connecting the initial and final vertex of the stroke: each time we cannot find a connection inside the stroke, we search for the nearest point in the surface model and we let the path passing from it. This procedure solves also the case in which, given the stroke, the system cannot find an initial and/or final vertex. For automatic computation of the cut in the not visible part of the model, we improved the original method restricting the search of the connections to a subset of vertices. For doing this we compute the visibility of each vertex before performing the cut.
  6. In our case, since X3D allows to define shapes using vertices and not edges, the use of an implementation of the original approach would have been computationally expensive. Every time the user would draw the stroke, the system should compute the intersection between a circle of radius r and all the edges present in the scene and projected on the viewplane.We decided to apply the algorithm on the vertices of the model. This change does not modify the general methodology, but it allows us to reduce the number of operations to be performed.With our choice, in fact, we do not have to compute intersections (solving linear systems) but only euclidean distances. Additionally, we have been able to extend the procedure to surface meshes which are not represented only by triangles, using in this way all the faces types defined by the X3D standard. Furthermore, we extended the method to special cases: we can treat the case in which, given a stroke (as a set of circles) there is no vertex inside it connecting the initial and final vertex of the stroke: each time we cannot find a connection inside the stroke, we search for the nearest point in the surface model and we let the path passing from it. This procedure solves also the case in which, given the stroke, the system cannot find an initial and/or final vertex. For automatic computation of the cut in the not visible part of the model, we improved the original method restricting the search of the connections to a subset of vertices. For doing this we compute the visibility of each vertex before performing the cut.
  7. Some notes: using our tags - organized hierarchically - we are able to re-merge the segmented regions simply by checking the names of the regions and by merging their faces and vertices. looking at the name of a given region C we can access immediately to its history.
  8. one tab collects the geometrical information, automatically extracted (geometry); another tab (adjacency) describes the adjacency information, again automatically extracted. The last working tab (semantic) is, instead, devoted to the userdefined semantic annotation.
  9. La visualizzazione del grafo per adesso è per modelli manifold