2009.06.09 chris poppe - public PhD defense

Detectie en representatie van bewegende objecten voor videobewaking Detection and Representation of Moving Objects for Video Surveillance Chris Poppe Multimedia Lab Department of Electronics and Information Systems Faculty of Engineering Ghent University Supervisor: prof. dr. ir. Rik Van de Walle

Outline ,[object Object],[object Object],[object Object],[object Object],[object Object],Detection and Representation of Moving Objects for Video Surveillance Chris Poppe Ghent, Belgium – June 9 2009

Introduction: Video Surveillance ,[object Object],[object Object],[object Object],[object Object],[object Object],Detection and Representation of Moving Objects for Video Surveillance Chris Poppe Ghent, Belgium – June 9 2009

Introduction: Intelligent Video Surveillance System Detection and Representation of Moving Objects for Video Surveillance Chris Poppe Ghent, Belgium – June 9 2009 video video + metadata encoding analytics storage visualization

Introduction: Video Surveillance ,[object Object],Detection and Representation of Moving Objects for Video Surveillance Chris Poppe Ghent, Belgium – June 9 2009 Detection and Representation of Moving Objects for Video Surveillance Chris Poppe Ghent, Belgium – June 9 2009 person1 person2 intruder alert!!! ,[object Object],[object Object],[object Object],[object Object],[object Object],analytics

Introduction: Moving Object Detection ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Detection and Representation of Moving Objects for Video Surveillance Chris Poppe Ghent, Belgium – June 9 2009 analytics

Introduction: Moving Object Representation ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Detection and Representation of Moving Objects for Video Surveillance Chris Poppe Ghent, Belgium – June 9 2009 metadata standard analytics information

Moving Object Detection in the Pixel Domain ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Detection and Representation of Moving Objects for Video Surveillance Chris Poppe Ghent, Belgium – June 9 2009 background model new image result - =

Moving Object Detection in the Pixel Domain ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Detection and Representation of Moving Objects for Video Surveillance Chris Poppe Ghent, Belgium – June 9 2009 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Multimodal Background Subtraction model 2 Detection and Representation of Moving Objects for Video Surveillance Chris Poppe Ghent, Belgium – June 9 2009 model 1 model 3 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Multimodal Background Subtraction ,[object Object],[object Object],[object Object],[object Object],Detection and Representation of Moving Objects for Video Surveillance Chris Poppe Ghent, Belgium – June 9 2009

Spatio-Temporal Multimodal Background Subtraction ,[object Object],[object Object],[object Object],[object Object],Detection and Representation of Moving Objects for Video Surveillance Chris Poppe Ghent, Belgium – June 9 2009

Spatio-Temporal Multimodal Background Subtraction ,[object Object],[object Object],Detection and Representation of Moving Objects for Video Surveillance Chris Poppe Ghent, Belgium – June 9 2009 spatio-temporal temporal spatial

Evaluation: Objective Results ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Detection and Representation of Moving Objects for Video Surveillance Chris Poppe Ghent, Belgium – June 9 2009

Evaluation: Objective Results ,[object Object],[object Object],Detection and Representation of Moving Objects for Video Surveillance Chris Poppe Ghent, Belgium – June 9 2009

Evaluation: Subjective Results ,[object Object],input image ground truth Stauffer ‘01 Shan ‘06 proposed

[object Object],[object Object],[object Object],Evaluation: Execution Times Detection and Representation of Moving Objects for Video Surveillance Chris Poppe Ghent, Belgium – June 9 2009 Sequence Stauffer’01(fps) proposed (fps) temporal (fps) spatial (fps) PetsD2TeC2 (384x288) 8.33 10 29.4 18.2 Indoor (340x240) 9.5 15.4 45.5 30 Ismail (320x240) 9.7 14.9 71.4 29.4 ThirdView (720x576) 1.1 2.3 3.6 7.7

Moving Object Detection in the Compressed Domain ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Detection and Representation of Moving Objects for Video Surveillance Chris Poppe Ghent, Belgium – June 9 2009 encoding analytics

H.264/AVC ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],motion vectors

Observations ,[object Object],[object Object],[object Object],Detection and Representation of Moving Objects for Video Surveillance Chris Poppe Ghent, Belgium – June 9 2009

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],MB-based Background Subtraction Detection and Representation of Moving Objects for Video Surveillance Chris Poppe Ghent, Belgium – June 9 2009 T

(sub)MB-based Background Subtraction ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Evaluation: Objective comparison Detection and Representation of Moving Objects for Video Surveillance Chris Poppe Ghent, Belgium – June 9 2009 ,[object Object],[object Object],[object Object]

Evaluation: Execution Times ,[object Object],[object Object],Detection and Representation of Moving Objects for Video Surveillance Chris Poppe Ghent, Belgium – June 9 2009 Sequence Zeng’05 (fps) proposed (fps) Etri od A (352x240) 28 662 PetsD2TeC2 (384x288) 22 448 Indoor (340x240) 31 751

Evaluation: Subjective Results ,[object Object],Detection and Representation of Moving Objects for Video Surveillance Chris Poppe Ghent, Belgium – June 9 2009

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Metadata: Representing Moving Objects Detection and Representation of Moving Objects for Video Surveillance Chris Poppe Ghent, Belgium – June 9 2009 metadata metadata standard A metadata metadata standard B analytics1 analytics2 metadata metadata standard B

Metadata: Representing Moving Objects ,[object Object],[object Object],[object Object],[object Object],[object Object],Detection and Representation of Moving Objects for Video Surveillance Chris Poppe Ghent, Belgium – June 9 2009 < object id=“ 0 ” > < box xc=“ 77 ” yc=“ 73 ” w=“ 21 ” h=“ 16 ” /> </ object > Box: “Coordinates of the centre and the dimensions of the bounding box of a detected object in pixels.” metadata example 1 CVML (Computer Vision Markup Language) < LLID =“ LLID1 ” >< Mask > < BB mp7:dim = “ 4 ” > 67 65 88 91 </ BB > </ Mask > </ LLID > BB: “Coordinates of a rectangular segment.” metadata example 2 VS7 (Video Surveillance Schema)

Metadata: Representing Moving Objects ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Detection and Representation of Moving Objects for Video Surveillance Chris Poppe Ghent, Belgium – June 9 2009

Metadata: Representing Moving Objects ,[object Object],Detection and Representation of Moving Objects for Video Surveillance Chris Poppe Ghent, Belgium – June 9 2009 subClassOf birth date DatatypeProperty Person Class: Person Class: Scientist Scientist Individual birth date “ 14/10/1801” ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],“ Joseph Plateau”

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Metadata: Representing Moving Objects Detection and Representation of Moving Objects for Video Surveillance Chris Poppe Ghent, Belgium – June 9 2009 OWL ontology CVML OWL ontology VS7 OWL ontology MPEG7 …

[object Object],[object Object],[object Object],[object Object],Metadata: Representing Moving Objects upper layer lower layer Detection and Representation of Moving Objects for Video Surveillance Chris Poppe Ghent, Belgium – June 9 2009 OWL ontology Video Surveillance OWL ontology CVML OWL ontology VS7 OWL ontology MPEG7 …

Evaluation: Practical Use Case Scenario ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Detection and Representation of Moving Objects for Video Surveillance Chris Poppe Ghent, Belgium – June 9 2009

Conclusions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Detection and Representation of Moving Objects for Video Surveillance Chris Poppe Ghent, Belgium – June 9 2009

Conclusions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Detection and Representation of Moving Objects for Video Surveillance Chris Poppe Ghent, Belgium – June 9 2009

Publications ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Detection and Representation of Moving Objects for Video Surveillance Chris Poppe Ghent, Belgium – June 9 2009

2009.06.09 chris poppe - public PhD defense

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Ähnlich wie 2009.06.09 chris poppe - public PhD defense

Ähnlich wie 2009.06.09 chris poppe - public PhD defense (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

2009.06.09 chris poppe - public PhD defense

Hinweis der Redaktion