SlideShare ist ein Scribd-Unternehmen logo
1 von 1
Downloaden Sie, um offline zu lesen
Experiments and Evaluation
Note: Depth Input: [train]/[test]. i.e. O/Noisy: sparse (~7%
available) depth without depth as train input and sparse &
noisy depth as test input.
KITTI Dataset                                                unit: [mm]
TUM  SLAM Dataset                                     unit: [mm]
DFineNet: Ego-Motion Estimation and Depth Refinement from Sparse, Noisy
Depth Input with RGB Guidance
Yilun	Zhang,	Ty	Nguyen,	Ian	D	Miller,	Shreyas	Shivakumar,	Steven	Chen,	Camillo	J	Taylor,	Vijay	Kumar
University	of	Pennsylvania
Method Depth Input RMSE MAE iRMSE iMAE
Sfmlearner O/O 3436.53 2839.16  2659.01 2577.77
Ma et al. O/O 119.53 60.01 15.23 8.97
DFineNet(rgbd) O/O 118.34  59.82 14.77 8.88
Method ATE[m] RE Photometric Loss
Sfmlearner 0.0179±0.0110 0.0018±0.0009 0.1843
Ma et al. 0.0105±0.0082 0.0011±0.0006  0.1052
Ground truth 0.±0. 0.±0. 0.1921
DFineNet(rgbd) 0.0170±0.0094  0.0046±0.0031 0.0726
Method Depth Input
Sfmlearner O/O
Ma et al. O/O
DFineNet(rgbd) O/O
Method
Sfmlearner
Ma et al.
Ground truth
DFineNet(rgbd)
Method Depth Input RMSE MAE iRMSE iMAE
Sfmlearner Noisy/Noisy 3574.98 2943.25  2712.34 2645.31
Ma et al. Noisy/Noisy 209.81 122.24 60.75 27.05
DFineNet(rgbd) O/Noisy 779.582   579.18 116.95 83.81
DFineNet(rgbd) Noisy/Noisy 180.63 100.20 45.54 21.08
Method ATE[m] RE Photometric Loss
Sfmlearner 0.0152±0.0092 0.0033±0.0021 0.1043
Ma et al. 0.0116±0.0067 0.0025±0.0022  0.0820
Ground truth 0.±0. 0.±0. 0.0533
DFineNet(rgbd) 0.0101±0.0051 0.0021±0.0015  0.0369
Method Depth Input
Sfmlearner Noisy/Noisy
Ma et al. Noisy/Noisy
DFineNet(rgbd) O/Noisy
DFineNet(rgbd) Noisy/Noisy
Method
Sfmlearner
Ma et al.
Ground truth
DFineNet(rgbd)
Summary
Experiment setting:
System Input: 
Sparse (~7%) & noisy (error up to 50%) depth measurement
RGB
System Output: 
refined dense depth
relative camera ego-motion
Training and inference with Nvidia Tesla DGX-1 V100:
Training takes ~2.5h on single Nvidia Tesla DGX-1 V100;
Inference at ~20 fps on single Nvidia Tesla DGX-1 V100;
Impelementated with Pytorch 1.0.0
Conclusions:
An end-to-end network capable of refining sparse & noisy depth measurement as well
as producing camera ego-motion
Demonstrated to work with multiple types of depth sensors (i.e. Lidar, stereo-camera)
DFineNet GuideNet [1st] Ma et al. [19th]
Dense depth estimation is essential for self-driving cars,
autonomous robots and augmented reality. 
Sensors providing with dense depth are often expensive and bulky. 
We provide with a fusion mechanisim that takes sparse, noisy depth
from Lidar or stereo cameras, and produces dense depth with RGB
guidance.  
Our end-to-end network model is capable of using noisy, as
sparse as ~7% depth measurement, and producing a refined
dense depth. It also produces ego-motion of the camera
simultineously. 
Motivation & Overview 
Estimation with Sparse&Noisy Depth Measurement on NVIDIA Tesla V100
Estimation with Sparse Depth Measurement on NVIDIA Tesla V100
DeFineNet (Output)
GroundTruth Sparse depth
RGB + Sparse & noisy depth (Input)RGB (Input)
Sparse depth
Sparse & noisy depth (Input)
DFineNet (Output)

Weitere ähnliche Inhalte

Was ist angesagt?

Introduction to wavelet transform with applications to dsp
Introduction to wavelet transform with applications to dspIntroduction to wavelet transform with applications to dsp
Introduction to wavelet transform with applications to dspJamal Jamali
 
Environmentally robust ASR front end for DNN-based acoustic models
Environmentally robust ASR front end for DNN-based acoustic modelsEnvironmentally robust ASR front end for DNN-based acoustic models
Environmentally robust ASR front end for DNN-based acoustic modelsTakuya Yoshioka
 
DIGITAL SIGNAL PROCESSING: Sampling and Reconstruction on MATLAB
DIGITAL SIGNAL PROCESSING: Sampling and Reconstruction on MATLABDIGITAL SIGNAL PROCESSING: Sampling and Reconstruction on MATLAB
DIGITAL SIGNAL PROCESSING: Sampling and Reconstruction on MATLABMartin Wachiye Wafula
 
Short Spec Optoplex Iii P
Short Spec Optoplex Iii PShort Spec Optoplex Iii P
Short Spec Optoplex Iii Pjferic
 
EC8562 DSP Viva Questions
EC8562 DSP Viva Questions EC8562 DSP Viva Questions
EC8562 DSP Viva Questions ssuser2797e4
 
CHI'16 Full Paper "Modelling Error Rates in Temporal Pointing"
CHI'16 Full Paper "Modelling Error Rates in Temporal Pointing"CHI'16 Full Paper "Modelling Error Rates in Temporal Pointing"
CHI'16 Full Paper "Modelling Error Rates in Temporal Pointing"Byungjoo Lee
 
Acoustic echo cancellation using nlms adaptive algorithm ranbeer
Acoustic echo cancellation using nlms adaptive algorithm ranbeerAcoustic echo cancellation using nlms adaptive algorithm ranbeer
Acoustic echo cancellation using nlms adaptive algorithm ranbeerRanbeer Tyagi
 
Wavelet transform and its applications in data analysis and signal and image ...
Wavelet transform and its applications in data analysis and signal and image ...Wavelet transform and its applications in data analysis and signal and image ...
Wavelet transform and its applications in data analysis and signal and image ...Sourjya Dutta
 
A seminar on INTRODUCTION TO MULTI-RESOLUTION AND WAVELET TRANSFORM
A seminar on INTRODUCTION TO MULTI-RESOLUTION AND WAVELET TRANSFORMA seminar on INTRODUCTION TO MULTI-RESOLUTION AND WAVELET TRANSFORM
A seminar on INTRODUCTION TO MULTI-RESOLUTION AND WAVELET TRANSFORMमनीष राठौर
 
A Review on Image Denoising using Wavelet Transform
A Review on Image Denoising using Wavelet TransformA Review on Image Denoising using Wavelet Transform
A Review on Image Denoising using Wavelet Transformijsrd.com
 
Sampling and Reconstruction of Signal using Aliasing
Sampling and Reconstruction of Signal using AliasingSampling and Reconstruction of Signal using Aliasing
Sampling and Reconstruction of Signal using Aliasingj naga sai
 
Wavelets AND counterlets
Wavelets  AND  counterletsWavelets  AND  counterlets
Wavelets AND counterletsAvichal Sharma
 
Signal & systems
Signal & systemsSignal & systems
Signal & systemsAJAL A J
 
Curved Wavelet Transform For Image Denoising using MATLAB.
Curved Wavelet Transform For Image Denoising using MATLAB.Curved Wavelet Transform For Image Denoising using MATLAB.
Curved Wavelet Transform For Image Denoising using MATLAB.Nikhil Kumar
 
Time reversed acoustics - Mathias Fink
Time reversed acoustics - Mathias FinkTime reversed acoustics - Mathias Fink
Time reversed acoustics - Mathias FinkSébastien Popoff
 
Simulation and hardware implementation of Adaptive algorithms on tms320 c6713...
Simulation and hardware implementation of Adaptive algorithms on tms320 c6713...Simulation and hardware implementation of Adaptive algorithms on tms320 c6713...
Simulation and hardware implementation of Adaptive algorithms on tms320 c6713...Raj Kumar Thenua
 

Was ist angesagt? (20)

Introduction to wavelet transform with applications to dsp
Introduction to wavelet transform with applications to dspIntroduction to wavelet transform with applications to dsp
Introduction to wavelet transform with applications to dsp
 
Environmentally robust ASR front end for DNN-based acoustic models
Environmentally robust ASR front end for DNN-based acoustic modelsEnvironmentally robust ASR front end for DNN-based acoustic models
Environmentally robust ASR front end for DNN-based acoustic models
 
DIGITAL SIGNAL PROCESSING: Sampling and Reconstruction on MATLAB
DIGITAL SIGNAL PROCESSING: Sampling and Reconstruction on MATLABDIGITAL SIGNAL PROCESSING: Sampling and Reconstruction on MATLAB
DIGITAL SIGNAL PROCESSING: Sampling and Reconstruction on MATLAB
 
Short Spec Optoplex Iii P
Short Spec Optoplex Iii PShort Spec Optoplex Iii P
Short Spec Optoplex Iii P
 
EC8562 DSP Viva Questions
EC8562 DSP Viva Questions EC8562 DSP Viva Questions
EC8562 DSP Viva Questions
 
CHI'16 Full Paper "Modelling Error Rates in Temporal Pointing"
CHI'16 Full Paper "Modelling Error Rates in Temporal Pointing"CHI'16 Full Paper "Modelling Error Rates in Temporal Pointing"
CHI'16 Full Paper "Modelling Error Rates in Temporal Pointing"
 
Acoustic echo cancellation using nlms adaptive algorithm ranbeer
Acoustic echo cancellation using nlms adaptive algorithm ranbeerAcoustic echo cancellation using nlms adaptive algorithm ranbeer
Acoustic echo cancellation using nlms adaptive algorithm ranbeer
 
WAVELET TRANSFORM
WAVELET TRANSFORMWAVELET TRANSFORM
WAVELET TRANSFORM
 
Wavelet transform and its applications in data analysis and signal and image ...
Wavelet transform and its applications in data analysis and signal and image ...Wavelet transform and its applications in data analysis and signal and image ...
Wavelet transform and its applications in data analysis and signal and image ...
 
A seminar on INTRODUCTION TO MULTI-RESOLUTION AND WAVELET TRANSFORM
A seminar on INTRODUCTION TO MULTI-RESOLUTION AND WAVELET TRANSFORMA seminar on INTRODUCTION TO MULTI-RESOLUTION AND WAVELET TRANSFORM
A seminar on INTRODUCTION TO MULTI-RESOLUTION AND WAVELET TRANSFORM
 
A Review on Image Denoising using Wavelet Transform
A Review on Image Denoising using Wavelet TransformA Review on Image Denoising using Wavelet Transform
A Review on Image Denoising using Wavelet Transform
 
Sampling theorem
Sampling theoremSampling theorem
Sampling theorem
 
Sampling and Reconstruction of Signal using Aliasing
Sampling and Reconstruction of Signal using AliasingSampling and Reconstruction of Signal using Aliasing
Sampling and Reconstruction of Signal using Aliasing
 
Wavelets AND counterlets
Wavelets  AND  counterletsWavelets  AND  counterlets
Wavelets AND counterlets
 
Signal & systems
Signal & systemsSignal & systems
Signal & systems
 
Curved Wavelet Transform For Image Denoising using MATLAB.
Curved Wavelet Transform For Image Denoising using MATLAB.Curved Wavelet Transform For Image Denoising using MATLAB.
Curved Wavelet Transform For Image Denoising using MATLAB.
 
Time reversed acoustics - Mathias Fink
Time reversed acoustics - Mathias FinkTime reversed acoustics - Mathias Fink
Time reversed acoustics - Mathias Fink
 
Simulation and hardware implementation of Adaptive algorithms on tms320 c6713...
Simulation and hardware implementation of Adaptive algorithms on tms320 c6713...Simulation and hardware implementation of Adaptive algorithms on tms320 c6713...
Simulation and hardware implementation of Adaptive algorithms on tms320 c6713...
 
IIR filter
IIR filterIIR filter
IIR filter
 
Noise
NoiseNoise
Noise
 

Ähnlich wie Poster dfinenet

The super resolution technology 2016
The super resolution technology 2016The super resolution technology 2016
The super resolution technology 2016Testo Viet Nam
 
Computed radiography &digital radiography
Computed radiography &digital radiographyComputed radiography &digital radiography
Computed radiography &digital radiographyRad Tech
 
International Journal of Engineering Research and Development (IJERD)
International Journal of Engineering Research and Development (IJERD)International Journal of Engineering Research and Development (IJERD)
International Journal of Engineering Research and Development (IJERD)IJERD Editor
 
International Journal of Engineering Research and Development (IJERD)
International Journal of Engineering Research and Development (IJERD)International Journal of Engineering Research and Development (IJERD)
International Journal of Engineering Research and Development (IJERD)IJERD Editor
 
International Montoro Res. Conductivity 2 d ztem inversion start model test ...
International Montoro Res. Conductivity  2 d ztem inversion start model test ...International Montoro Res. Conductivity  2 d ztem inversion start model test ...
International Montoro Res. Conductivity 2 d ztem inversion start model test ...Follow me on Twitter @Stockshaman
 
A Survey on Implementation of Discrete Wavelet Transform for Image Denoising
A Survey on Implementation of Discrete Wavelet Transform for Image DenoisingA Survey on Implementation of Discrete Wavelet Transform for Image Denoising
A Survey on Implementation of Discrete Wavelet Transform for Image Denoisingijbuiiir1
 
Introduction of SG-A CMOS Image Sensor Tester
Introduction of SG-A CMOS Image Sensor TesterIntroduction of SG-A CMOS Image Sensor Tester
Introduction of SG-A CMOS Image Sensor TesterEnlitech
 
Automatic vehicle license plate detection using VEDA
Automatic vehicle license plate detection using VEDAAutomatic vehicle license plate detection using VEDA
Automatic vehicle license plate detection using VEDARojith Thomas
 
International Montoro Resources Inc. (IMTFF- USA) (IMT -TSXV) (O4T1-Frankfurt...
International Montoro Resources Inc. (IMTFF- USA) (IMT -TSXV) (O4T1-Frankfurt...International Montoro Resources Inc. (IMTFF- USA) (IMT -TSXV) (O4T1-Frankfurt...
International Montoro Resources Inc. (IMTFF- USA) (IMT -TSXV) (O4T1-Frankfurt...Follow me on Twitter @Stockshaman
 
Trends in Future CommunicationsInternational Workshop - Renato Rabelo
Trends in Future CommunicationsInternational Workshop - Renato RabeloTrends in Future CommunicationsInternational Workshop - Renato Rabelo
Trends in Future CommunicationsInternational Workshop - Renato RabeloCPqD
 
Comparative analysis of filters and wavelet based thresholding methods for im...
Comparative analysis of filters and wavelet based thresholding methods for im...Comparative analysis of filters and wavelet based thresholding methods for im...
Comparative analysis of filters and wavelet based thresholding methods for im...csandit
 
Hioki series im7580_e6-99m Impedance analyzer 1.3GHz
Hioki series im7580_e6-99m Impedance analyzer 1.3GHzHioki series im7580_e6-99m Impedance analyzer 1.3GHz
Hioki series im7580_e6-99m Impedance analyzer 1.3GHzNIHON DENKEI SINGAPORE
 
Use of Discrete Sine Transform for A Novel Image Denoising Technique
Use of Discrete Sine Transform for A Novel Image Denoising TechniqueUse of Discrete Sine Transform for A Novel Image Denoising Technique
Use of Discrete Sine Transform for A Novel Image Denoising TechniqueCSCJournals
 
Satellite image compression algorithm based on the fft
Satellite image compression algorithm based on the fftSatellite image compression algorithm based on the fft
Satellite image compression algorithm based on the fftijma
 
Satellite Image Compression Algorithm Based on the FFT
Satellite Image Compression Algorithm Based on the FFTSatellite Image Compression Algorithm Based on the FFT
Satellite Image Compression Algorithm Based on the FFTijma
 
ADAPTIVE FILTER FOR DENOISING 3D DATA CAPTURED BY DEPTH SENSORS
ADAPTIVE FILTER FOR DENOISING 3D DATA CAPTURED BY DEPTH SENSORSADAPTIVE FILTER FOR DENOISING 3D DATA CAPTURED BY DEPTH SENSORS
ADAPTIVE FILTER FOR DENOISING 3D DATA CAPTURED BY DEPTH SENSORSSoma Boubou
 

Ähnlich wie Poster dfinenet (20)

Cg36496501
Cg36496501Cg36496501
Cg36496501
 
Lc3618931897
Lc3618931897Lc3618931897
Lc3618931897
 
The super resolution technology 2016
The super resolution technology 2016The super resolution technology 2016
The super resolution technology 2016
 
Computed radiography &digital radiography
Computed radiography &digital radiographyComputed radiography &digital radiography
Computed radiography &digital radiography
 
International Journal of Engineering Research and Development (IJERD)
International Journal of Engineering Research and Development (IJERD)International Journal of Engineering Research and Development (IJERD)
International Journal of Engineering Research and Development (IJERD)
 
International Journal of Engineering Research and Development (IJERD)
International Journal of Engineering Research and Development (IJERD)International Journal of Engineering Research and Development (IJERD)
International Journal of Engineering Research and Development (IJERD)
 
International Montoro Res. Conductivity 2 d ztem inversion start model test ...
International Montoro Res. Conductivity  2 d ztem inversion start model test ...International Montoro Res. Conductivity  2 d ztem inversion start model test ...
International Montoro Res. Conductivity 2 d ztem inversion start model test ...
 
A Survey on Implementation of Discrete Wavelet Transform for Image Denoising
A Survey on Implementation of Discrete Wavelet Transform for Image DenoisingA Survey on Implementation of Discrete Wavelet Transform for Image Denoising
A Survey on Implementation of Discrete Wavelet Transform for Image Denoising
 
Introduction of SG-A CMOS Image Sensor Tester
Introduction of SG-A CMOS Image Sensor TesterIntroduction of SG-A CMOS Image Sensor Tester
Introduction of SG-A CMOS Image Sensor Tester
 
Automatic vehicle license plate detection using VEDA
Automatic vehicle license plate detection using VEDAAutomatic vehicle license plate detection using VEDA
Automatic vehicle license plate detection using VEDA
 
International Montoro Resources Inc. (IMTFF- USA) (IMT -TSXV) (O4T1-Frankfurt...
International Montoro Resources Inc. (IMTFF- USA) (IMT -TSXV) (O4T1-Frankfurt...International Montoro Resources Inc. (IMTFF- USA) (IMT -TSXV) (O4T1-Frankfurt...
International Montoro Resources Inc. (IMTFF- USA) (IMT -TSXV) (O4T1-Frankfurt...
 
Trends in Future CommunicationsInternational Workshop - Renato Rabelo
Trends in Future CommunicationsInternational Workshop - Renato RabeloTrends in Future CommunicationsInternational Workshop - Renato Rabelo
Trends in Future CommunicationsInternational Workshop - Renato Rabelo
 
Antenna
AntennaAntenna
Antenna
 
Comparative analysis of filters and wavelet based thresholding methods for im...
Comparative analysis of filters and wavelet based thresholding methods for im...Comparative analysis of filters and wavelet based thresholding methods for im...
Comparative analysis of filters and wavelet based thresholding methods for im...
 
Hioki series im7580_e6-99m Impedance analyzer 1.3GHz
Hioki series im7580_e6-99m Impedance analyzer 1.3GHzHioki series im7580_e6-99m Impedance analyzer 1.3GHz
Hioki series im7580_e6-99m Impedance analyzer 1.3GHz
 
Multi-constellation GNSS Simulator
Multi-constellation GNSS SimulatorMulti-constellation GNSS Simulator
Multi-constellation GNSS Simulator
 
Use of Discrete Sine Transform for A Novel Image Denoising Technique
Use of Discrete Sine Transform for A Novel Image Denoising TechniqueUse of Discrete Sine Transform for A Novel Image Denoising Technique
Use of Discrete Sine Transform for A Novel Image Denoising Technique
 
Satellite image compression algorithm based on the fft
Satellite image compression algorithm based on the fftSatellite image compression algorithm based on the fft
Satellite image compression algorithm based on the fft
 
Satellite Image Compression Algorithm Based on the FFT
Satellite Image Compression Algorithm Based on the FFTSatellite Image Compression Algorithm Based on the FFT
Satellite Image Compression Algorithm Based on the FFT
 
ADAPTIVE FILTER FOR DENOISING 3D DATA CAPTURED BY DEPTH SENSORS
ADAPTIVE FILTER FOR DENOISING 3D DATA CAPTURED BY DEPTH SENSORSADAPTIVE FILTER FOR DENOISING 3D DATA CAPTURED BY DEPTH SENSORS
ADAPTIVE FILTER FOR DENOISING 3D DATA CAPTURED BY DEPTH SENSORS
 

Kürzlich hochgeladen

Lecture 1: Basics of trigonometry (surveying)
Lecture 1: Basics of trigonometry (surveying)Lecture 1: Basics of trigonometry (surveying)
Lecture 1: Basics of trigonometry (surveying)Bahzad5
 
Basic Principle of Electrochemical Sensor
Basic Principle of  Electrochemical SensorBasic Principle of  Electrochemical Sensor
Basic Principle of Electrochemical SensorTanvir Moin
 
Vertical- Machining - Center - VMC -LMW-Machine-Tool-Division.pptx
Vertical- Machining - Center - VMC -LMW-Machine-Tool-Division.pptxVertical- Machining - Center - VMC -LMW-Machine-Tool-Division.pptx
Vertical- Machining - Center - VMC -LMW-Machine-Tool-Division.pptxLMW Machine Tool Division
 
Popular-NO1 Kala Jadu Expert Specialist In Germany Kala Jadu Expert Specialis...
Popular-NO1 Kala Jadu Expert Specialist In Germany Kala Jadu Expert Specialis...Popular-NO1 Kala Jadu Expert Specialist In Germany Kala Jadu Expert Specialis...
Popular-NO1 Kala Jadu Expert Specialist In Germany Kala Jadu Expert Specialis...Amil baba
 
Summer training report on BUILDING CONSTRUCTION for DIPLOMA Students.pdf
Summer training report on BUILDING CONSTRUCTION for DIPLOMA Students.pdfSummer training report on BUILDING CONSTRUCTION for DIPLOMA Students.pdf
Summer training report on BUILDING CONSTRUCTION for DIPLOMA Students.pdfNaveenVerma126
 
Quasi-Stochastic Approximation: Algorithm Design Principles with Applications...
Quasi-Stochastic Approximation: Algorithm Design Principles with Applications...Quasi-Stochastic Approximation: Algorithm Design Principles with Applications...
Quasi-Stochastic Approximation: Algorithm Design Principles with Applications...Sean Meyn
 
Graphics Primitives and CG Display Devices
Graphics Primitives and CG Display DevicesGraphics Primitives and CG Display Devices
Graphics Primitives and CG Display DevicesDIPIKA83
 
sdfsadopkjpiosufoiasdoifjasldkjfl a asldkjflaskdjflkjsdsdf
sdfsadopkjpiosufoiasdoifjasldkjfl a asldkjflaskdjflkjsdsdfsdfsadopkjpiosufoiasdoifjasldkjfl a asldkjflaskdjflkjsdsdf
sdfsadopkjpiosufoiasdoifjasldkjfl a asldkjflaskdjflkjsdsdfJulia Kaye
 
EPE3163_Hydro power stations_Unit2_Lect2.pptx
EPE3163_Hydro power stations_Unit2_Lect2.pptxEPE3163_Hydro power stations_Unit2_Lect2.pptx
EPE3163_Hydro power stations_Unit2_Lect2.pptxJoseeMusabyimana
 
The relationship between iot and communication technology
The relationship between iot and communication technologyThe relationship between iot and communication technology
The relationship between iot and communication technologyabdulkadirmukarram03
 
Engineering Mechanics Chapter 5 Equilibrium of a Rigid Body
Engineering Mechanics  Chapter 5  Equilibrium of a Rigid BodyEngineering Mechanics  Chapter 5  Equilibrium of a Rigid Body
Engineering Mechanics Chapter 5 Equilibrium of a Rigid BodyAhmadHajasad2
 
Landsman converter for power factor improvement
Landsman converter for power factor improvementLandsman converter for power factor improvement
Landsman converter for power factor improvementVijayMuni2
 
Guardians and Glitches: Navigating the Duality of Gen AI in AppSec
Guardians and Glitches: Navigating the Duality of Gen AI in AppSecGuardians and Glitches: Navigating the Duality of Gen AI in AppSec
Guardians and Glitches: Navigating the Duality of Gen AI in AppSecTrupti Shiralkar, CISSP
 
Best-NO1 Best Rohani Amil In Lahore Kala Ilam In Lahore Kala Jadu Amil In Lah...
Best-NO1 Best Rohani Amil In Lahore Kala Ilam In Lahore Kala Jadu Amil In Lah...Best-NO1 Best Rohani Amil In Lahore Kala Ilam In Lahore Kala Jadu Amil In Lah...
Best-NO1 Best Rohani Amil In Lahore Kala Ilam In Lahore Kala Jadu Amil In Lah...Amil baba
 
Design of Clutches and Brakes in Design of Machine Elements.pptx
Design of Clutches and Brakes in Design of Machine Elements.pptxDesign of Clutches and Brakes in Design of Machine Elements.pptx
Design of Clutches and Brakes in Design of Machine Elements.pptxYogeshKumarKJMIT
 
Nodal seismic construction requirements.pptx
Nodal seismic construction requirements.pptxNodal seismic construction requirements.pptx
Nodal seismic construction requirements.pptxwendy cai
 
Renewable Energy & Entrepreneurship Workshop_21Feb2024.pdf
Renewable Energy & Entrepreneurship Workshop_21Feb2024.pdfRenewable Energy & Entrepreneurship Workshop_21Feb2024.pdf
Renewable Energy & Entrepreneurship Workshop_21Feb2024.pdfodunowoeminence2019
 
Technology Features of Apollo HDD Machine, Its Technical Specification with C...
Technology Features of Apollo HDD Machine, Its Technical Specification with C...Technology Features of Apollo HDD Machine, Its Technical Specification with C...
Technology Features of Apollo HDD Machine, Its Technical Specification with C...Apollo Techno Industries Pvt Ltd
 
UNIT4_ESD_wfffffggggggggggggith_ARM.pptx
UNIT4_ESD_wfffffggggggggggggith_ARM.pptxUNIT4_ESD_wfffffggggggggggggith_ARM.pptx
UNIT4_ESD_wfffffggggggggggggith_ARM.pptxrealme6igamerr
 

Kürzlich hochgeladen (20)

計劃趕得上變化
計劃趕得上變化計劃趕得上變化
計劃趕得上變化
 
Lecture 1: Basics of trigonometry (surveying)
Lecture 1: Basics of trigonometry (surveying)Lecture 1: Basics of trigonometry (surveying)
Lecture 1: Basics of trigonometry (surveying)
 
Basic Principle of Electrochemical Sensor
Basic Principle of  Electrochemical SensorBasic Principle of  Electrochemical Sensor
Basic Principle of Electrochemical Sensor
 
Vertical- Machining - Center - VMC -LMW-Machine-Tool-Division.pptx
Vertical- Machining - Center - VMC -LMW-Machine-Tool-Division.pptxVertical- Machining - Center - VMC -LMW-Machine-Tool-Division.pptx
Vertical- Machining - Center - VMC -LMW-Machine-Tool-Division.pptx
 
Popular-NO1 Kala Jadu Expert Specialist In Germany Kala Jadu Expert Specialis...
Popular-NO1 Kala Jadu Expert Specialist In Germany Kala Jadu Expert Specialis...Popular-NO1 Kala Jadu Expert Specialist In Germany Kala Jadu Expert Specialis...
Popular-NO1 Kala Jadu Expert Specialist In Germany Kala Jadu Expert Specialis...
 
Summer training report on BUILDING CONSTRUCTION for DIPLOMA Students.pdf
Summer training report on BUILDING CONSTRUCTION for DIPLOMA Students.pdfSummer training report on BUILDING CONSTRUCTION for DIPLOMA Students.pdf
Summer training report on BUILDING CONSTRUCTION for DIPLOMA Students.pdf
 
Quasi-Stochastic Approximation: Algorithm Design Principles with Applications...
Quasi-Stochastic Approximation: Algorithm Design Principles with Applications...Quasi-Stochastic Approximation: Algorithm Design Principles with Applications...
Quasi-Stochastic Approximation: Algorithm Design Principles with Applications...
 
Graphics Primitives and CG Display Devices
Graphics Primitives and CG Display DevicesGraphics Primitives and CG Display Devices
Graphics Primitives and CG Display Devices
 
sdfsadopkjpiosufoiasdoifjasldkjfl a asldkjflaskdjflkjsdsdf
sdfsadopkjpiosufoiasdoifjasldkjfl a asldkjflaskdjflkjsdsdfsdfsadopkjpiosufoiasdoifjasldkjfl a asldkjflaskdjflkjsdsdf
sdfsadopkjpiosufoiasdoifjasldkjfl a asldkjflaskdjflkjsdsdf
 
EPE3163_Hydro power stations_Unit2_Lect2.pptx
EPE3163_Hydro power stations_Unit2_Lect2.pptxEPE3163_Hydro power stations_Unit2_Lect2.pptx
EPE3163_Hydro power stations_Unit2_Lect2.pptx
 
The relationship between iot and communication technology
The relationship between iot and communication technologyThe relationship between iot and communication technology
The relationship between iot and communication technology
 
Engineering Mechanics Chapter 5 Equilibrium of a Rigid Body
Engineering Mechanics  Chapter 5  Equilibrium of a Rigid BodyEngineering Mechanics  Chapter 5  Equilibrium of a Rigid Body
Engineering Mechanics Chapter 5 Equilibrium of a Rigid Body
 
Landsman converter for power factor improvement
Landsman converter for power factor improvementLandsman converter for power factor improvement
Landsman converter for power factor improvement
 
Guardians and Glitches: Navigating the Duality of Gen AI in AppSec
Guardians and Glitches: Navigating the Duality of Gen AI in AppSecGuardians and Glitches: Navigating the Duality of Gen AI in AppSec
Guardians and Glitches: Navigating the Duality of Gen AI in AppSec
 
Best-NO1 Best Rohani Amil In Lahore Kala Ilam In Lahore Kala Jadu Amil In Lah...
Best-NO1 Best Rohani Amil In Lahore Kala Ilam In Lahore Kala Jadu Amil In Lah...Best-NO1 Best Rohani Amil In Lahore Kala Ilam In Lahore Kala Jadu Amil In Lah...
Best-NO1 Best Rohani Amil In Lahore Kala Ilam In Lahore Kala Jadu Amil In Lah...
 
Design of Clutches and Brakes in Design of Machine Elements.pptx
Design of Clutches and Brakes in Design of Machine Elements.pptxDesign of Clutches and Brakes in Design of Machine Elements.pptx
Design of Clutches and Brakes in Design of Machine Elements.pptx
 
Nodal seismic construction requirements.pptx
Nodal seismic construction requirements.pptxNodal seismic construction requirements.pptx
Nodal seismic construction requirements.pptx
 
Renewable Energy & Entrepreneurship Workshop_21Feb2024.pdf
Renewable Energy & Entrepreneurship Workshop_21Feb2024.pdfRenewable Energy & Entrepreneurship Workshop_21Feb2024.pdf
Renewable Energy & Entrepreneurship Workshop_21Feb2024.pdf
 
Technology Features of Apollo HDD Machine, Its Technical Specification with C...
Technology Features of Apollo HDD Machine, Its Technical Specification with C...Technology Features of Apollo HDD Machine, Its Technical Specification with C...
Technology Features of Apollo HDD Machine, Its Technical Specification with C...
 
UNIT4_ESD_wfffffggggggggggggith_ARM.pptx
UNIT4_ESD_wfffffggggggggggggith_ARM.pptxUNIT4_ESD_wfffffggggggggggggith_ARM.pptx
UNIT4_ESD_wfffffggggggggggggith_ARM.pptx
 

Poster dfinenet

  • 1. Experiments and Evaluation Note: Depth Input: [train]/[test]. i.e. O/Noisy: sparse (~7% available) depth without depth as train input and sparse & noisy depth as test input. KITTI Dataset                                                unit: [mm] TUM  SLAM Dataset                                     unit: [mm] DFineNet: Ego-Motion Estimation and Depth Refinement from Sparse, Noisy Depth Input with RGB Guidance Yilun Zhang, Ty Nguyen, Ian D Miller, Shreyas Shivakumar, Steven Chen, Camillo J Taylor, Vijay Kumar University of Pennsylvania Method Depth Input RMSE MAE iRMSE iMAE Sfmlearner O/O 3436.53 2839.16  2659.01 2577.77 Ma et al. O/O 119.53 60.01 15.23 8.97 DFineNet(rgbd) O/O 118.34  59.82 14.77 8.88 Method ATE[m] RE Photometric Loss Sfmlearner 0.0179±0.0110 0.0018±0.0009 0.1843 Ma et al. 0.0105±0.0082 0.0011±0.0006  0.1052 Ground truth 0.±0. 0.±0. 0.1921 DFineNet(rgbd) 0.0170±0.0094  0.0046±0.0031 0.0726 Method Depth Input Sfmlearner O/O Ma et al. O/O DFineNet(rgbd) O/O Method Sfmlearner Ma et al. Ground truth DFineNet(rgbd) Method Depth Input RMSE MAE iRMSE iMAE Sfmlearner Noisy/Noisy 3574.98 2943.25  2712.34 2645.31 Ma et al. Noisy/Noisy 209.81 122.24 60.75 27.05 DFineNet(rgbd) O/Noisy 779.582   579.18 116.95 83.81 DFineNet(rgbd) Noisy/Noisy 180.63 100.20 45.54 21.08 Method ATE[m] RE Photometric Loss Sfmlearner 0.0152±0.0092 0.0033±0.0021 0.1043 Ma et al. 0.0116±0.0067 0.0025±0.0022  0.0820 Ground truth 0.±0. 0.±0. 0.0533 DFineNet(rgbd) 0.0101±0.0051 0.0021±0.0015  0.0369 Method Depth Input Sfmlearner Noisy/Noisy Ma et al. Noisy/Noisy DFineNet(rgbd) O/Noisy DFineNet(rgbd) Noisy/Noisy Method Sfmlearner Ma et al. Ground truth DFineNet(rgbd) Summary Experiment setting: System Input:  Sparse (~7%) & noisy (error up to 50%) depth measurement RGB System Output:  refined dense depth relative camera ego-motion Training and inference with Nvidia Tesla DGX-1 V100: Training takes ~2.5h on single Nvidia Tesla DGX-1 V100; Inference at ~20 fps on single Nvidia Tesla DGX-1 V100; Impelementated with Pytorch 1.0.0 Conclusions: An end-to-end network capable of refining sparse & noisy depth measurement as well as producing camera ego-motion Demonstrated to work with multiple types of depth sensors (i.e. Lidar, stereo-camera) DFineNet GuideNet [1st] Ma et al. [19th] Dense depth estimation is essential for self-driving cars, autonomous robots and augmented reality.  Sensors providing with dense depth are often expensive and bulky.  We provide with a fusion mechanisim that takes sparse, noisy depth from Lidar or stereo cameras, and produces dense depth with RGB guidance.   Our end-to-end network model is capable of using noisy, as sparse as ~7% depth measurement, and producing a refined dense depth. It also produces ego-motion of the camera simultineously.  Motivation & Overview  Estimation with Sparse&Noisy Depth Measurement on NVIDIA Tesla V100 Estimation with Sparse Depth Measurement on NVIDIA Tesla V100 DeFineNet (Output) GroundTruth Sparse depth RGB + Sparse & noisy depth (Input)RGB (Input) Sparse depth Sparse & noisy depth (Input) DFineNet (Output)