SlideShare ist ein Scribd-Unternehmen logo
1 von 1
Min filtered
Max filtered
Input signal
Kernel
Nearest value output
Comparing
difference
max
min
3. output
1. Input
2. max/min
#Limitation: Only one edge in a Kernel window
Removing Depth Map Coding Distortion
by Using Post Filter Set
Norishige Fukushima*, Tomohiko Inoue, Yutaka Ishibashi
Graduate School of Engineering, Nagoya Institute of Technology
Introduction and Overview Experimental Results
Proposed Method
Various codec, JPEG, JPEG2000, JPEG-
LS, H.264/AVC, can encode depth map and
these codecs have coding distortion.
Objective of this paper is removing
distortions by using post filter set.
Problem and OverviewBackground
Median Filter
R-D curve of various image codecs
1 1 1 1 1
1 1 1 1 1
1 1 1 1 1
1 1 1 1 1
1 1 1 1 1
1 1 1 1 1
1 1 1 1 1
1 1 1 1 0
1 1 1 0 0
1 1 0 0 0
Box Filter
Binary Weighted Range Filter (BWRF)
Box Filter
BWRFInput
Profile
curve
position
Min-max Blur Remove Filter
Binary Weighted Range Filter
3D scene
2cm
8cm
Source
view
Virtual
views
RAW Image
RAW depth
map
RAW Image
Coded/filtered
depth map
comparecompare
Experimental Setup
Depth map and image captured
from Kinect. Depth maps are
coded by various codecs.
#Image is not compressed.
[1]K. Lai, L .Bo, X. Ren, and D. Fox, “A large-scale
hierarchical multi-view rgb-d object dataset.,” in
Proc. ICRA, pp. 1817–1824, May 2011.
[2] K.-J. Oh, A. Vetro, and Y.-S. Ho, “Depth coding
using a boundary reconstruction filter for 3-d video
systems,” IEEE Trans. CSVT, vol. 21, no. 3, pp. 350 –
359, Mar. 2011.
Trans
mission
Encode Decode
Post
filtering
View
synthesis
Depth
Map
Image
Median
Filter
Min-Max
Blur Remove
Filter
Weighted
Range Filter
Over quantization
is recovered
Boundary blur
is removed
Spike noise
is removed
Gaussian
Filter
Gaussian noise
is removed
Project site/Source code: http://nma.web.nitech.ac.jp/fukushima/research/depthmap_postfilter.html
Reference
Computational Time
15 ms
Intel Core i7 2.93GHz (4core HT)
Parallelization: SSE4, Intel TBB
Language:C++
IEEE International Conference on Multimedia & Expo (ICME), July 2013

Weitere ähnliche Inhalte

Andere mochten auch

ガイデットフィルタとその周辺
ガイデットフィルタとその周辺ガイデットフィルタとその周辺
ガイデットフィルタとその周辺
Norishige Fukushima
 
組み込み関数(intrinsic)によるSIMD入門
組み込み関数(intrinsic)によるSIMD入門組み込み関数(intrinsic)によるSIMD入門
組み込み関数(intrinsic)によるSIMD入門
Norishige Fukushima
 
OpenCVをAndroidで動かしてみた
OpenCVをAndroidで動かしてみたOpenCVをAndroidで動かしてみた
OpenCVをAndroidで動かしてみた
徹 上野山
 
複数台のKinectV2の使い方
複数台のKinectV2の使い方複数台のKinectV2の使い方
複数台のKinectV2の使い方
Norishige Fukushima
 

Andere mochten auch (7)

Popcntによるハミング距離計算
Popcntによるハミング距離計算Popcntによるハミング距離計算
Popcntによるハミング距離計算
 
ガイデットフィルタとその周辺
ガイデットフィルタとその周辺ガイデットフィルタとその周辺
ガイデットフィルタとその周辺
 
組み込み関数(intrinsic)によるSIMD入門
組み込み関数(intrinsic)によるSIMD入門組み込み関数(intrinsic)によるSIMD入門
組み込み関数(intrinsic)によるSIMD入門
 
OpenCVをAndroidで動かしてみた
OpenCVをAndroidで動かしてみたOpenCVをAndroidで動かしてみた
OpenCVをAndroidで動かしてみた
 
マルチコアを用いた画像処理
マルチコアを用いた画像処理マルチコアを用いた画像処理
マルチコアを用いた画像処理
 
複数台のKinectV2の使い方
複数台のKinectV2の使い方複数台のKinectV2の使い方
複数台のKinectV2の使い方
 
画像処理ライブラリ OpenCV で 出来ること・出来ないこと
画像処理ライブラリ OpenCV で 出来ること・出来ないこと画像処理ライブラリ OpenCV で 出来ること・出来ないこと
画像処理ライブラリ OpenCV で 出来ること・出来ないこと
 

Mehr von Norishige Fukushima

Mehr von Norishige Fukushima (6)

画像処理の高性能計算
画像処理の高性能計算画像処理の高性能計算
画像処理の高性能計算
 
計算スケジューリングの効果~もし,Halideがなかったら?~
計算スケジューリングの効果~もし,Halideがなかったら?~計算スケジューリングの効果~もし,Halideがなかったら?~
計算スケジューリングの効果~もし,Halideがなかったら?~
 
多チャンネルバイラテラルフィルタの高速化
多チャンネルバイラテラルフィルタの高速化多チャンネルバイラテラルフィルタの高速化
多チャンネルバイラテラルフィルタの高速化
 
計算機アーキテクチャを考慮した高能率画像処理プログラミング
計算機アーキテクチャを考慮した高能率画像処理プログラミング計算機アーキテクチャを考慮した高能率画像処理プログラミング
計算機アーキテクチャを考慮した高能率画像処理プログラミング
 
3次元計測とフィルタリング
3次元計測とフィルタリング3次元計測とフィルタリング
3次元計測とフィルタリング
 
デプスセンサとその応用
デプスセンサとその応用デプスセンサとその応用
デプスセンサとその応用
 

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot ModelNavi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 

Removing depth map coding distortion by using post filter set

  • 1. Min filtered Max filtered Input signal Kernel Nearest value output Comparing difference max min 3. output 1. Input 2. max/min #Limitation: Only one edge in a Kernel window Removing Depth Map Coding Distortion by Using Post Filter Set Norishige Fukushima*, Tomohiko Inoue, Yutaka Ishibashi Graduate School of Engineering, Nagoya Institute of Technology Introduction and Overview Experimental Results Proposed Method Various codec, JPEG, JPEG2000, JPEG- LS, H.264/AVC, can encode depth map and these codecs have coding distortion. Objective of this paper is removing distortions by using post filter set. Problem and OverviewBackground Median Filter R-D curve of various image codecs 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 0 0 1 1 0 0 0 Box Filter Binary Weighted Range Filter (BWRF) Box Filter BWRFInput Profile curve position Min-max Blur Remove Filter Binary Weighted Range Filter 3D scene 2cm 8cm Source view Virtual views RAW Image RAW depth map RAW Image Coded/filtered depth map comparecompare Experimental Setup Depth map and image captured from Kinect. Depth maps are coded by various codecs. #Image is not compressed. [1]K. Lai, L .Bo, X. Ren, and D. Fox, “A large-scale hierarchical multi-view rgb-d object dataset.,” in Proc. ICRA, pp. 1817–1824, May 2011. [2] K.-J. Oh, A. Vetro, and Y.-S. Ho, “Depth coding using a boundary reconstruction filter for 3-d video systems,” IEEE Trans. CSVT, vol. 21, no. 3, pp. 350 – 359, Mar. 2011. Trans mission Encode Decode Post filtering View synthesis Depth Map Image Median Filter Min-Max Blur Remove Filter Weighted Range Filter Over quantization is recovered Boundary blur is removed Spike noise is removed Gaussian Filter Gaussian noise is removed Project site/Source code: http://nma.web.nitech.ac.jp/fukushima/research/depthmap_postfilter.html Reference Computational Time 15 ms Intel Core i7 2.93GHz (4core HT) Parallelization: SSE4, Intel TBB Language:C++ IEEE International Conference on Multimedia & Expo (ICME), July 2013