SlideShare ist ein Scribd-Unternehmen logo
1 von 72
Downloaden Sie, um offline zu lesen
1
MOHIEDDIN MORADI
mohieddinmoradi@gmail.com
DREAM
IDEA
PLAN
IMPLEMENTATION
OUTLINE
– Elements of High-Quality Image Production
– Color Gamut Conversion (Gamut Mapping and Inverse Gamut Mapping)
– Gamma, OETF, EOTF, OOTF, PQ and HLG HDR
– HDR & SDR Mastering, Mapping, Tone Mapping and Inverse Tone Mapping
– Static and Dynamic Tone Mapping
– Backwards Compatibility
– HDR and WCG Production Equipment
– DVB UHD Phases
– HDR Metadata and HDR Standards
– PQ10 and HLG10 Distribution Standards
– Different Distribution Scenarios
– HDR Ecosystem (Open Standard and Dolby Vision)
2
Elements of High-Quality Image Production
Q1 Spatial Resolution (HD, UHD)
Q2 Temporal Resolution (Frame Rate) (HFR)
Q3 Dynamic Range (SDR, HDR)
Q4 Color Gamut (BT. 709, BT. 2020)
Q5 Coding (Quantization, Bit Depth)
Q6 Compression Artifacts
.
.
.
3
Not only more pixels, but better pixels
𝑻𝒐𝒕𝒂𝒍 𝑸𝒖𝒂𝒍𝒊𝒕𝒚 𝒐𝒇 𝑬𝒙𝒑𝒆𝒓𝒆𝒏𝒄𝒆 𝑸𝒐𝑬 𝒐𝒓 𝑸𝒐𝑿 = 𝒇(𝑸 𝟏, 𝑸 𝟐, 𝑸 𝟑,….)
UHDTV 1
3840 x 2160
8.3 MPs
Digital Cinema 2K
2048 x 1080
2.21 MPs
4K
4096 x 2160
8.84 MPs
SD (PAL)
720 x 576
0.414MPs
HDTV 720P
1280 x 720
0.922 MPs
HDTV 1920 x 1080
2.027 MPs
UHDTV 2
7680 x 4320
33.18 MPs 8K
8192×4320
35.39 MPs
Wider viewing angle
More immersive
Q1:
Spatial Resolution
4
Motion Blur
Motion Judder
Conventional Frame Rate High Frame Rate
Wider viewing angle
Increased perceived
motion artifacts
Higher frame rates needed
50fps minimum (100fps being vetted)
5
Q2:
High Frame Rate (HFR)
– Deeper Colors
– More Realistic Pictures
– More Colorful
6
Wide Color Space (ITU-R Rec. BT.2020)
75.8%, of CIE 1931
Color Space (ITU-R Rec. BT.709)
35.9%, of CIE 1931
Q3:
Wide Color Gamut
WCG
CIE 1931 Color Space
Images : Dolby Laboratories
Standard Dynamic Range
High Dynamic Range
(More Vivid, More Detail)
Q4:
High Dynamic Range
7
Chasing the Human Vision System with HDR
8
Q4:
High Dynamic Range
9
Q3+Q4:
Wide Color Gamut + High Dynamic Range
SDR
SDR
HDR
HDR+WCG
More vivid, More details
More real, More colorful
10 bits 1024 Levels
8 bits 256 Levels
10
– More colours
– More bits (10-bit)
– Banding, Contouring
Q5:
Quantization (Bit Depth)
Spatial Resolution (Pixels)
HD, FHD, UHD1, UHD2
Temporal Resolution (Frame rate)
24fps, 30fps, 60fps, 120fps …
Dynamic Range (Contrast)
From 100 nits to HDR
Color Space (Gamut)
From BT 709 to Rec. 2020
Quantization (Bit Depth)
8 bits, 10 bits, 12 bits …
11
Major Elements of High-Quality Image Production
AcquisitionandProduction
PostProduction
Contribution
Distribution
12
Carrying HDR and WCG to Home
Brief Summary of ITU-R BT.709, BT.2020, and BT.2100
– ITU-R BT.709, BT.2020 and BT.2100 address transfer function, color space, matrix coefficients, and more. The
following table is a summary comparison of those three documents.
13
ITU-R BT.709 ITU-R BT.2020 ITU-R BT.2100
Spatial Resolution HD UHD, 8K HD, UHD, 8K
Framerates 24, 25, 30, 50, 60
24, 25, 30, 50, 60,
100, 120
24, 25, 30, 50, 60,
100, 120
Interlace/Progressive
Interlace,
Progressive
Progressive Progressive
Color Space BT.709 BT.2020 BT.2020
Dynamic Range SDR (BT.1886) SDR (BT.1886) HDR (PQ, HLG)
Bit Depth 8, 10 10, 12 10, 12
Color Representation RGB, YCBCR RGB, YCBCR RGB, YCBCR, ICTCP
HDR & SDR End-to-End Production Workflows
14
Color Gamut Conversion (Gamut Mapping and Inverse Mapping)
15
Wide Color Space (ITU-R Rec. BT.2020)
75.8%, of CIE 1931
Color Space (ITU-R Rec. BT.709)
35.9%, of CIE 1931
A
1
B C
2
D
3
RGB
100% Color Bar
Rec. 709
Rec. 2020
CIE 1931 Color Space
(ITU-R Rec. BT.2020)
(ITU-R Rec. BT.709)
Transformation from a Wider Gamut Space to a Smaller One
– Without any corrections (gamut mapping), the image appear less saturated.
16
BT.2020 Signal BT.709
Munsell Chart
A
1
Three Approaches:
I. Clipping the RGB (clipping distortions)
II. Perceptual gamut mapping (more computations and possibly
changing the ‘creative intent’)
III. Leaving the RGB values as they are and let the screen think that they
relate to primaries of ITU-R BT.709.
– Without any corrections color saturation will be increased.
Smaller Gamut Space in a Wide Gamut Display
17
Munsell Chart
BT.709 Signal BT.2020
(ITU-R Rec. BT.2020)
(ITU-R Rec. BT.709)
D
3
– Opto-Electronic Transfer Function (OETF): Scene light to electrical signal
– Electro-Optical Transfer Function (EOTF): Electrical signal to scene light
Gamma, EOTF, OETF
18
– Opto-Electronic Transfer Function (OETF): Scene light to electrical signal
– Electro-Optical Transfer Function (EOTF): Electrical signal to scene light
Gamma, EOTF, OETF
The CRT EOTF is commonly
known as gamma
19
– Adjustment or Artistic Intent (Non-Linear Overall Transfer Function)
– System (total) gamma to adjust the final look of displayed images (Actual scene light to display luminance Transfer function)
– The “reference OOTF” compensates for difference in tonal perception between the environment of the camera and that of
the display specification (OOTF varies according to viewing environment and display brightness)
20
OOTF (Opto-Optical Transfer Function)
OOTF
Same Look
– On a flat screen display (LCD,
Plasa,..) without OOTF, it appears
as if the black level is elevated a
little.
– To compensate the black level
elevation and to make images
look closer to CRT, a display
gamma = 2.4 has been defined
under BT.1886.
– As a result, OOTF = 1.2
21
Display EOTF
gamma 2.4
Camera OETF
1/2.2
OOTF = 1.2
OOTF (Overall System Gamma, Artistic Rendering Intent)
Opto-Optical Transfer Function (OOTF)
Non-Linear Overall Transfer Function
OOTF Position
– Perceptual Quantization (PQ) (Optional Metadata)
– Hybrid Log-Gamma (HLG)
22
For viewing in the end-user consumer TV, a display mapping should be performed to adjust the reference OOTF on
the basis of mastering peak luminance metadata of professional display
OOTF is implemented within the display and is aware of its peak luminance and environment (No metadata)
Scene-Referred and Display-Referred
23
Scene-Referred:
– The HLG signal describes the relative light in the scene
– Every pixel in the image represents the light intensity in the captured scene
– The signal produced by the camera is independent of the display
– The signal is specified by the camera OETF characteristic
Display-Referred:
– The PQ signal describes the absolute output light from the mastering display
– The signal is specified by the display EOTF
Code Levels Distribution in HDR
24
Uniform CodeWords for Perceived Brightness
Barten Ramp
Human eye’s sensitivity to contrast in different levels
25
100MinimumDetectableContrast(%)
MinimumContrastStep(%)
Luminance (nit)
Contouring
Banding
∆𝐿
𝐿
×100
∆𝐿 & L are Large,Less bits are required,Larger quantize step size∆𝐿 & L are small,More bits are required,Smaller quantize step size
Minimum detectable contrast (%) =
𝐌𝐢𝐧𝐢𝐦𝐮𝐦 𝐝𝐞𝐭𝐞𝐜𝐭𝐚𝐛𝐥𝐞 𝐝𝐢𝐟𝐟𝐞𝐫𝐞𝐧𝐜𝐞 𝐢𝐧 𝐥𝐮𝐦𝐢𝐧𝐚𝐧𝐜𝐞
𝐋𝐮𝐦𝐢𝐧𝐮𝐧𝐜𝐞
× 𝟏𝟎𝟎 =
∆𝑳
𝑳
×100
2
L
∆𝑳
𝑳
×100
∆𝑳
𝑳
×100
 The threshold of visibility for quantization error (Minimum
detectable contrast) (banding or contouring) becomes higher
as the image gets darker.
 The threshold for perceiving quantization error (banding or
contouring) is approximately constant in the brighter parts
and highlights of an image.
PQ EOTF
26
Code words are equally spaced in perceived brightness over this range nits.
BrightnessCodeWords
Minimum Detectable Contrast (%) =
𝐌𝐢𝐧𝐢𝐦𝐮𝐦 𝐃𝐞𝐭𝐞𝐜𝐭𝐚𝐛𝐥𝐞 𝐃𝐢𝐟𝐟𝐞𝐫𝐞𝐧𝐜𝐞 𝐢𝐧 𝐋𝐮𝐦𝐢𝐧𝐚𝐧𝐜𝐞
𝐋𝐮𝐦𝐢𝐧𝐮𝐧𝐜𝐞
× 𝟏𝟎𝟎 =
∆𝑳
𝑳
×100
2
L
Code Words Utilization by Luminance Range in PQ
27
– PQ headroom from 5000 to 10,000
nits = 7% of code space
– 100 nits is near the midpoint of the
code range
0
0.2
0.4
0.6
0.8
1
1.2
0 0.2 0.4 0.6 0.8 1
SignalValue
Linear light
SDR gamma curve
SDR with Knee
HDR HLG
Hybrid Log-Gamma (HLG) HDR-TV
28
E : The signal for each color component {RS, GS, BS} proportional to scene linear light and scaled by camera exposure,
normalized to the range [0:12].
E′ :The resulting non-linear HLG coded signal {R',G',B'} in the range [0:1].
a = 0.17883277, b = 0.28466892, c = 0.55991073
More CodeWords for Dark Area
 
 





112ln
03
OETF
12
1
12
1
EcbEa
EE
EE
Less CodeWords for BrightArea
ITU-R Application 2 ,ARIB B67 (Association of Radio Industries and Businesses)
HDR & SDR Mastering
29
HDR
BT.2020
SDR
BT.709
HDR & SDR Mastering Example
Tone Mapping and Inverse Tone Mapping
Tone Mapping (Down-conversion)
Limiting Luminance Range
Inverse Tone Mapping (Up-conversion)
Expanding Luminance Range
31
HDR
BT.2020
SDR Signal
(BT.709 or BT.2020) HDR
HDR Signal
(BT.2020)
SDR Signal
(BT.709 or BT.2020)
SDR
(BT.709 or BT.2020)
HDR Signal
(BT.2020) SDR
Static Tone Mapping (HDR10)
32
– Optimized only for the brightest scene in the contents
– This avoids hard clipping of detail in the highlights
– It is not invariant under blind multiple round-trip conversions.
Static and Dynamic Tone Mapping
200 1500
Dynamic Tone Mapping
33
– Optimized for each scene in the contents
– Ex: frame-by-frame, or scene-by-scene basis (Varying the EETF based on statistics of the image).
– This approach could survive multiple round-trip conversions
Static and Dynamic Tone Mapping
Clipping
Clipping
No additional limiting/clipping in the event of multiple round-trip conversions (i.e. PQ->HLG->PQ- >HLG).
34
Static and Dynamic Metadata in HDR
Static Metadata
– Mastering Display Color Volume (MDCV) Metadata (SMPTE ST2086)
– The chromaticity of the red, green, and blue display primaries
– White point of the mastering display
– Black level and peak luminance level of the mastering display
– Content Light Levels Metadata (The Blu-ray Disc Association and DECE groups):
– MaxCLL (Maximum Content Light Level): Largest individual pixel light value of any video
frame in the program
– MaxFALL (Maximum Frame-Average Light Level): Largest average pixel light value of any
video frame in the program
(The maximum value of frame-average maxRGB for all frames in the content)
(The frame-average maxRGB : The average luminance of all pixels in each frame)
– They could be generated by the color grading software or other video analysis software.
Dynamic Metadata
– Content-dependent Metadata (SMPTE ST2094 (pending))
– Frame-by-frame or scene-by-scene Color Remapping Information (CRI)
– Variable color transformation along the content timeline.
35
Mapping
– During the transition from SDR to HDR production (More SDR Display) or due to content owner preference
– To preserve the “look” of the SDR content on HDR Display
– Display-referred mapping
To preserve the colors and relative tones of SDR on HDR Display
– Scene-referred mapping
To match the colors and lowlights and mid-tones of SDR camera with HDR camera.
36
SDR camera output
(BT.709 or BT.2020)
HDR Signal HDR
BT.2020
Preserved SDR Look
in HDR Program (Ex: 20%)
(Without Expanded
Luminance Range)
HDR Signal
HDR
BT.2020
SDR Content
(BT.709 or BT.2020)
(Without Expanded
Luminance Range)
Preserved SDR Look
in HDR Program (Ex:20%)
Backwards Compatibility
– Most of encoder/decoder and TVs are SDR (encoders/decoders replacement !!?? )
– Dolby Vision, Technicolor, Philips and BBC/NHK are all backwards compatible.
– Backwards compatibility is less of an issue in over-the-top (OTT).
37
HDR Signal
SDR UHDTV
ITU-R BT.709 color space HDR metadata simply is ignored
(Limited compatibility)
(Color Signal)
(B & W Display)
HLG and PQ Backwards Compatibility with SDR Displays
38
HLG
BT.2020
SDR
BT.2020 color space
− It has a degree of compatibility.
− Hue changes can be perceptible in bright areas of highly
saturated color or very high code values (Specular)
− Both PQ and HLG provide limited compatibility
HLG/PQ
BT.2020
SDR
BT.709 color space
There is no Metadata other than Video Payload Identifier (VPID) in the SDI feed.
– Camera
– Lens (Performance Improvement)
– Monitor (Especially Reference Monitor)
– Waveform Monitor
– Pattern Generator
– CG and Graphic System
– Playout and Ingest, Recorder and Player (HDMI Ports (HDMI 2.b))
– Cross Converters, SDI to HDMI Converter, HDMI to SDI Converter (HDMI 2.b)
– HDMI Ports (HDMI 2.b) (Multi viewer, Scan Converter,…)
– Video Production Switcher
– Digital Glues, Embedder and De-Embedder
– Lighting
39
HDR and WCG Production Equipment
Ex: Benefit of 4K Lens for WCG and HDR
– Both HD and 4K lens covers BT.2020.
– Improve the transparency of Blue in 4K lens
– Better S/N ratio.
40
– 4K lens can cut the flare and reduce black floating even in
a backlit conditions.
– Black floating is more noticeable in HDR.
– Same object and same white level, but black level of
– HD: 21.9% (HD lens reduces dynamic range!)
– Full 4K:11.6%
Same object and
same white level, but
different black level
Ex: Color Bar Test Pattern for HDR TV Systems
41BT.2111-07
(40%)
(75%)
(0%)(75%)(0%)
(0%)
(75%)
(40%)
(75% colour bars)
(100% colour bars)
(–2%) (+2%) (+4%)
BT. 709 colour bars
Ramp (–7% - 109%)
Stair (–7%, 0%, 10%, 20%, ..., 90%, 100%, 109%HLG)
Ex: HDR Heat-map Tool in Waveform Monitor
– User presets for SDR & HDR modes
– Selectable background grey /color
– Identify shadows, mid-tones or specular highlights
42
HDR & HDMI
43
HDMI 2.0a supports ST2084 (PQ) and ST2086 (Mastering Display Color Volume Metadata)
HDMI 2.0b followed up on HDMI 2.0a and added support for HLG and the HDR10
The HDMI 2.1 Specification will supersede 2.0b will support dynamic metadata and High Frame Rate
AcquisitionandProduction
PostProduction
Contribution
Distribution
44
Carrying HDR and WCG to Home
Specifications for UHDTV Broadcasting
45
Items ITU Text Specification
Video signal
Spatial format
Rec. ITU-R BT.2020
Rec. ITU-R BT.2100
7680×4320, 3840×2160
Frame frequency
24/1.001, 24, 25, 30/1.001, 30, 50, 60/1.001,
60, 100, 120/1.001, 120 Hz
Colorimetry Wide colour gamut
Transfer function
Rec. ITU-R BT.2100 PQ, HLG
Rec. ITU-R BT.2020 SDR
Coding
Rec. ITU-T H.265
Rec. ITU-R BT.1870
Rec. ITU-R BT.2073
MPEG-H HEVC
Audio
signal
Speaker configuration Rec. ITU-R BS.2051
Channel-based (0+2+0 – 9+10+3), object-
based
Coding Rec. ITU-R BS.1196
MPEG-2 AAC,
MPEG-4 AAC,
MPEG-4 ALS
Multimedia
Rec. ITU-R BT.2075 IBB, HTML5
Rep. ITU-R BT.2342 Closed captions
Transport
Rec. ITU-T H.222.0 MPEG-2 TS
Rec. ITU-R BT.2074
Rec. ITU-R BT.1869
MMT/TLV
CAS Rec. ITU-R BT.1852
Satellite transmission
Rec. ITU-R BO.1784 DVB-S2
Rec. ITU-R BO.2098 ISDB-S3
World’s First: HDR Trial with Sky Germany (2015)
46
HDR Ecosystem
47
HDR Ecosystem and Technologies (Open Standard)
48
HDR10 Static Metadata: SMPTE. 2086, MaxFALL, MaxCLL
HDR Ecosystem and Technologies (Dolby Vision with License Fee)
49
50% bitrate saving – Direct-to-home
30% bitrate saving – Contribution
50% bitrate saving – Direct-to-home
30% bitrate saving – Contribution
50
2020
VVC
2020
(JVET)
≈50% bitrate saving – Direct-to-home
≈30% bitrate saving – Contribution
HDR and WCG in Versatile Video Coding (VVC) for Contribution and Distribution
HDR Standards
– 4K Ultra Blu-ray
– Netflix
– Amazon
– VUDU
– YouTube Red
– UltraFlix
– PlayStation Video
– ULTRA
– Fandango
– Google play
– DirecTV
– Dish
– Xfinity
51
HDR Support Status
IFA 2017
HDR Standards
Dynamic Metadata for Color Transform (DMCVT)
Dolby Vision, HDR10+ (License-free Dynamic Metadata), SL-HDR1, Technicolor (PQ)
Static Metadata (Mastering Display Color Volume (MDCV) Metadata+ MaxCLL+ MaxFALL)
HDR10 (PQ + static metadata)
PQ10 (+ Optional static metadata)
No Metadata
HLG10, PQ10 (without metadata)
52
StandoutExperienceSimplicity
HDR Metadata and HDR/SDR Signal ID
53
8 -
54
12bit, HFR, BT.2020, HDR, 4:2:2, 4:4:4,
Abject based audio
Resolution, 14bit, Scalability
DVB UHD Phases and HDR Delivery
PQ10 & HLG10 HDR Systems in DVB Phase 2
55
– PQ10: PQ OETF, BT.2020,10-bit, non-constant luminance YCbCr, narrow range
– HLG10: HLG OETF, BT.2020, 10-bit, non-constant luminance YCbCr, narrow range
HDR information in HEVC Main 10 Profile (or H.264/MPEG-4 AVC)
56
[3] High Dynamic Range and/or High Frame Rates Bit streams are not intended to be used with BT. 709 color primaries.
– VUI: Video Usability Information
– SEI: Supplemental Enhancement Information
– Alternative transfer characteristics: In order to serve both SDR and HDR receivers with a single stream in
the case of HLG
The SEI
message is
ignored by
legacy SDR
receivers
It applies correct EOTF
(Backward compatibility)
(14) SDR ITU-R BT.2020 OETF
SDRT.F indicator is sent over HDMI
(14 in theVUI )
Two Methods of Signaling the HLG Transfer Function
57
HDRT.F indicator is sent over HDMI
(18 in the SEI )
Video Stream
HEVC
HLG Aware
STB or Decoder
SDR
Display
HLG HDR
Support
SDRT.F indicator is signaled in theVUI
(transfer_characteristics=14)
HLGT.F indicator is signaled in the SEI
(preferred_transfer_characteristics=18)
HDRT.F indicator is sent over HDMI
(18 in theVUI )
Video Stream
HEVC
HLG Aware
STB or Decoder
SDR
Display
HLG HDR
Support
HDRT.F indicator is signaled in theVUI
(transfer_characteristics=18)
It may produce acceptable
results on SDR displays
14 ≠18 From “preferred_transfer_characteristic=18” it recognize
that the bit stream is coded with HLG
(actual transfer characteristics is HLG)
It applies correct EOTF and gives
backward compatibility feature of HLG.
“Viewable SDR Pictures”
Signaling Transfer Function, Color Space and Matrix Coefficients
58
*Note that both “1” and “14” are valid values to signal SDR transfer function; for example, DVB documents require “1” when the color container
is BT.709 and “14” when the color container is BT.2020.
Different Distribution Scenarios
Single-layer
– HDR video coding using HEVC Main 10
– HDR-to-SDR mapping at the receiver side (real-time)
59
HDRVideo
HEVC Main 10
Encoding
HEVC Main 10
Decoding
Tone/Color
Mapping
HDR
Display
SDR
Display
Different Distribution Scenarios
Single-layer
– HDR video coding using HEVC Main 10
– HDR-to-SDR mapping at the receiver side (real-time)
– Metadata from SDR master video to improve tone/color mapping and preserve artistic intent
60
HDRVideo
HEVC Main 10
Encoding
HEVC Main 10
Decoding
Tone/Color
Mapping
HDR
Display
SDR
DisplaySDRVideo
Metadata
Different Distribution Scenarios
Single-layer
– SDR video coding using HEVC
– SDR-to-HDR mapping at the receiver side (real-time)
61
SDRVideo
HEVC Main
Encoding
HEVC Main
Decoding
Inverse
Tone/Color
Mapping
HDR
Display
SDR
Display
Different Distribution Scenarios
Single-layer
– SDR video coding using HEVC
– SDR-to-HDR mapping at the receiver side (real-time)
– Metadata from HDR master video to improve inverse tone/color mapping and preserve artistic intent
62
SDRVideo
HEVC Main
Encoding
HEVC Main
Decoding
Inverse
Tone/Color
Mapping
HDR
Display
SDR
Display
HDRVideo
Metadata
Different Distribution Scenarios
Single-layer
– SDR video obtained by HDR-to-SDR tone/color mapping
– SDR video coding using HEVC
– SDR-to-HDR mapping at the receiver side (real-time)
63
SDRVideo
HEVC Main
Encoding
HEVC Main
Decoding
Inverse
Tone/Color
Mapping
HDR
Display
SDR
Display
Tone/Color
Mapping
HDRVideo
Metadata
Different Distribution Scenarios
Dual-layer, Simulcast
– Simulcast (independent coding) of SDR and HDR video sequences
– Not optimal in terms of bandwidth
64
HDRVideo
HEVC Main 10
Encoding
HEVC Main 10
Decoding
HDR
Display
SDR
DisplaySDRVideo HEVC Encoding HEVC Decoding
Dual-layer, Scalable coding
− Dual-layer, scalable coding
− Quality can be Dynamic Range and WCG (PSNR or Quality Scalability in Encoder)
65
Base Layer Encoder
(Low Quality Encoding)
Base Layer Decoder
Enhancement layer
Encoder
(Distortion Encoding)
MULTIPLEXER
−
+
InputVideo
(HDR,WCG)
E.L Bit Stream
B.L Bit Stream
Output Bit Stream
Low QualityVide (SDR)
BL Bit Stream
High QualityVideo
(HDR,WCG)
BL + E.L Bit Streams
Distortion of
Low Quality Encoding
Different Distribution Scenarios
Tone/Color
Mapping
(SDR, BT.709)
(SDR, BT.709)
Different Distribution Scenarios
Dual-layer, Scalable Coding
– Joint coding of SDR and HDR video sequences using SHVC (Scalable HEVC)
– Exploit better data redundancies
66
HDRVideo
Scalable
HEVC Main 10
Decoding
HDR
Display
SDR
Display
SDRVideo
Scalable
HEVC
Main 10
Encoding
HEVC
Decoding
One
Bit Stream
(MDCV+SL-HDR1 Metadata)
MDCV
Metadata
(e.g. ST 2086)
(MDCV
+ SL-HDR1
Metadata)
(e.g. SEI
message)
MDCV
Metadata
MDCV: Mastering Display Color Volume
67
Example of Single-layer Distribution
Technicolor-Philips SL-HDR1 (Advanced HDR)
Example of Dual-layer Distribution
Dolby Vision
68
(FIFA World Cup 2018)
69
Global Picture of Sony “SR Live” for Live Productions (FIFA World Cup 2018)
70
– 8 Cameras Dual output UHD/HDR and HD/SDR
– 11 Cameras Dual output HD/HDR and HD/SDR
– 21 Cameras Single output HD/SDR
– All Replays HD/SDR
Shading of all cameras is done
on the HD/SDR (BT. 709)
Global Picture of “HLG-Live” for Live Productions
71
Shading of all cameras is done
on the HD/SDR (BT. 709)
Questions?
Suggestions ?
Discussion?
72

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

VIDEO QUALITY ENHANCEMENT IN BROADCAST CHAIN, OPPORTUNITIES & CHALLENGES
VIDEO QUALITY ENHANCEMENT IN BROADCAST CHAIN,   OPPORTUNITIES & CHALLENGESVIDEO QUALITY ENHANCEMENT IN BROADCAST CHAIN,   OPPORTUNITIES & CHALLENGES
VIDEO QUALITY ENHANCEMENT IN BROADCAST CHAIN, OPPORTUNITIES & CHALLENGES
 
Video Quality Control
Video Quality ControlVideo Quality Control
Video Quality Control
 
HDR and WCG Principles-Part 6
HDR and WCG Principles-Part 6HDR and WCG Principles-Part 6
HDR and WCG Principles-Part 6
 
High-Dynamic Range (HDR) Demystified
High-Dynamic Range (HDR) DemystifiedHigh-Dynamic Range (HDR) Demystified
High-Dynamic Range (HDR) Demystified
 
Latest Technologies in Production & Broadcasting
Latest  Technologies in Production & BroadcastingLatest  Technologies in Production & Broadcasting
Latest Technologies in Production & Broadcasting
 
Broadcast Camera Technology, Part 2
Broadcast Camera Technology, Part 2Broadcast Camera Technology, Part 2
Broadcast Camera Technology, Part 2
 
HDR and WCG Principles-Part 4
HDR and WCG Principles-Part 4HDR and WCG Principles-Part 4
HDR and WCG Principles-Part 4
 
An Introduction to Video Principles-Part 2
An Introduction to Video Principles-Part 2An Introduction to Video Principles-Part 2
An Introduction to Video Principles-Part 2
 
Video Compression, Part 3-Section 2, Some Standard Video Codecs
Video Compression, Part 3-Section 2, Some Standard Video CodecsVideo Compression, Part 3-Section 2, Some Standard Video Codecs
Video Compression, Part 3-Section 2, Some Standard Video Codecs
 
Video Compression, Part 2-Section 1, Video Coding Concepts
Video Compression, Part 2-Section 1, Video Coding Concepts Video Compression, Part 2-Section 1, Video Coding Concepts
Video Compression, Part 2-Section 1, Video Coding Concepts
 
Video Compression, Part 3-Section 1, Some Standard Video Codecs
Video Compression, Part 3-Section 1, Some Standard Video CodecsVideo Compression, Part 3-Section 1, Some Standard Video Codecs
Video Compression, Part 3-Section 1, Some Standard Video Codecs
 
An Introduction to HDTV Principles-Part 4
An Introduction to HDTV Principles-Part 4An Introduction to HDTV Principles-Part 4
An Introduction to HDTV Principles-Part 4
 
Video Compression Part 1 Video Principles
Video Compression Part 1 Video Principles Video Compression Part 1 Video Principles
Video Compression Part 1 Video Principles
 
Broadcast Lens Technology Part 1
Broadcast Lens Technology Part 1Broadcast Lens Technology Part 1
Broadcast Lens Technology Part 1
 
Broadcast Lens Technology Part 3
Broadcast Lens Technology Part 3Broadcast Lens Technology Part 3
Broadcast Lens Technology Part 3
 
Thinking about IP migration
Thinking about IP migration Thinking about IP migration
Thinking about IP migration
 
SDI to IP 2110 Transition Part 1
SDI to IP 2110 Transition Part 1SDI to IP 2110 Transition Part 1
SDI to IP 2110 Transition Part 1
 
Designing an 4K/UHD1 HDR OB Truck as 12G-SDI or IP-based
Designing an 4K/UHD1 HDR OB Truck as 12G-SDI or IP-basedDesigning an 4K/UHD1 HDR OB Truck as 12G-SDI or IP-based
Designing an 4K/UHD1 HDR OB Truck as 12G-SDI or IP-based
 
Broadcast Camera Technology, Part 3
Broadcast Camera Technology, Part 3Broadcast Camera Technology, Part 3
Broadcast Camera Technology, Part 3
 
An Introduction to HDTV Principles-Part 2
An Introduction to HDTV Principles-Part 2An Introduction to HDTV Principles-Part 2
An Introduction to HDTV Principles-Part 2
 

Ähnlich wie HDR and WCG Video Broadcasting Considerations

“CMOS Image Sensors: A Guide to Building the Eyes of a Vision System,” a Pres...
“CMOS Image Sensors: A Guide to Building the Eyes of a Vision System,” a Pres...“CMOS Image Sensors: A Guide to Building the Eyes of a Vision System,” a Pres...
“CMOS Image Sensors: A Guide to Building the Eyes of a Vision System,” a Pres...
Edge AI and Vision Alliance
 
DT-V17G1
DT-V17G1DT-V17G1
DT-V17G1
AVNed
 
Compression presentation 415 (1)
Compression presentation 415 (1)Compression presentation 415 (1)
Compression presentation 415 (1)
Godo Dodo
 
2 _CRT Display Design_A_
2   _CRT Display Design_A_2   _CRT Display Design_A_
2 _CRT Display Design_A_
James Webb
 

Ähnlich wie HDR and WCG Video Broadcasting Considerations (20)

HDR and WCG Video Broadcasting Considerations.pdf
HDR and WCG Video Broadcasting Considerations.pdfHDR and WCG Video Broadcasting Considerations.pdf
HDR and WCG Video Broadcasting Considerations.pdf
 
HDR Insights Article 2 : PQ and HLG transfer functions for HDR
HDR Insights Article 2 : PQ and HLG transfer functions for HDRHDR Insights Article 2 : PQ and HLG transfer functions for HDR
HDR Insights Article 2 : PQ and HLG transfer functions for HDR
 
HDR Insights Article 3: Understanding HDR Tone Mapping
HDR Insights Article 3: Understanding HDR Tone MappingHDR Insights Article 3: Understanding HDR Tone Mapping
HDR Insights Article 3: Understanding HDR Tone Mapping
 
High Dynamic Range: An Introduction
High Dynamic Range: An IntroductionHigh Dynamic Range: An Introduction
High Dynamic Range: An Introduction
 
4K Display Technology
4K Display Technology4K Display Technology
4K Display Technology
 
Hdr Meets Black And White 2
Hdr Meets Black And White 2 Hdr Meets Black And White 2
Hdr Meets Black And White 2
 
“CMOS Image Sensors: A Guide to Building the Eyes of a Vision System,” a Pres...
“CMOS Image Sensors: A Guide to Building the Eyes of a Vision System,” a Pres...“CMOS Image Sensors: A Guide to Building the Eyes of a Vision System,” a Pres...
“CMOS Image Sensors: A Guide to Building the Eyes of a Vision System,” a Pres...
 
JVC DT-V17G1 Monitor Brochure
JVC DT-V17G1 Monitor BrochureJVC DT-V17G1 Monitor Brochure
JVC DT-V17G1 Monitor Brochure
 
DT-V17G1
DT-V17G1DT-V17G1
DT-V17G1
 
Compression presentation 415 (1)
Compression presentation 415 (1)Compression presentation 415 (1)
Compression presentation 415 (1)
 
JVC DT-V24G1 Monitor Brochure
JVC DT-V24G1 Monitor BrochureJVC DT-V24G1 Monitor Brochure
JVC DT-V24G1 Monitor Brochure
 
Freedom in Lighting Design by Tuning the CCT with LEDs, LpS 2015, Bregenz
Freedom in Lighting Design by Tuning the CCT with LEDs, LpS 2015, BregenzFreedom in Lighting Design by Tuning the CCT with LEDs, LpS 2015, Bregenz
Freedom in Lighting Design by Tuning the CCT with LEDs, LpS 2015, Bregenz
 
Serial Digital Interface (SDI), From SD-SDI to 24G-SDI, Part 2
Serial Digital Interface (SDI), From SD-SDI to 24G-SDI, Part 2Serial Digital Interface (SDI), From SD-SDI to 24G-SDI, Part 2
Serial Digital Interface (SDI), From SD-SDI to 24G-SDI, Part 2
 
Sony LMD 2341W
Sony LMD 2341WSony LMD 2341W
Sony LMD 2341W
 
Sony LMD-2341W
Sony LMD-2341WSony LMD-2341W
Sony LMD-2341W
 
Survey of HDR & Tone Mapping Task
Survey of HDR & Tone Mapping TaskSurvey of HDR & Tone Mapping Task
Survey of HDR & Tone Mapping Task
 
Tc ub6000-specification- www.ttbvs.com
Tc ub6000-specification- www.ttbvs.comTc ub6000-specification- www.ttbvs.com
Tc ub6000-specification- www.ttbvs.com
 
Canon eos c300 cinema camera body ef mount
Canon  eos c300 cinema camera body ef mountCanon  eos c300 cinema camera body ef mount
Canon eos c300 cinema camera body ef mount
 
Analog TV Systems/Digital TV Systems/3DTV
Analog TV Systems/Digital TV Systems/3DTVAnalog TV Systems/Digital TV Systems/3DTV
Analog TV Systems/Digital TV Systems/3DTV
 
2 _CRT Display Design_A_
2   _CRT Display Design_A_2   _CRT Display Design_A_
2 _CRT Display Design_A_
 

Mehr von Dr. Mohieddin Moradi (8)

SDI to IP 2110 Transition Part 2
SDI to IP 2110 Transition Part 2SDI to IP 2110 Transition Part 2
SDI to IP 2110 Transition Part 2
 
An Introduction to HDTV Principles-Part 3
An Introduction to HDTV Principles-Part 3An Introduction to HDTV Principles-Part 3
An Introduction to HDTV Principles-Part 3
 
An Introduction to HDTV Principles-Part 1
An Introduction to HDTV Principles-Part 1    An Introduction to HDTV Principles-Part 1
An Introduction to HDTV Principles-Part 1
 
Serial Digital Interface (SDI), From SD-SDI to 24G-SDI, Part 1
Serial Digital Interface (SDI), From SD-SDI to 24G-SDI, Part 1Serial Digital Interface (SDI), From SD-SDI to 24G-SDI, Part 1
Serial Digital Interface (SDI), From SD-SDI to 24G-SDI, Part 1
 
An Introduction to Audio Principles
An Introduction to Audio Principles An Introduction to Audio Principles
An Introduction to Audio Principles
 
Video Compression, Part 4 Section 1, Video Quality Assessment
Video Compression, Part 4 Section 1,  Video Quality Assessment Video Compression, Part 4 Section 1,  Video Quality Assessment
Video Compression, Part 4 Section 1, Video Quality Assessment
 
Video Compression, Part 4 Section 2, Video Quality Assessment
Video Compression, Part 4 Section 2,  Video Quality Assessment Video Compression, Part 4 Section 2,  Video Quality Assessment
Video Compression, Part 4 Section 2, Video Quality Assessment
 
Video Compression, Part 2-Section 2, Video Coding Concepts
Video Compression, Part 2-Section 2, Video Coding Concepts Video Compression, Part 2-Section 2, Video Coding Concepts
Video Compression, Part 2-Section 2, Video Coding Concepts
 

Kürzlich hochgeladen

Integrated Test Rig For HTFE-25 - Neometrix
Integrated Test Rig For HTFE-25 - NeometrixIntegrated Test Rig For HTFE-25 - Neometrix
Integrated Test Rig For HTFE-25 - Neometrix
Neometrix_Engineering_Pvt_Ltd
 
Standard vs Custom Battery Packs - Decoding the Power Play
Standard vs Custom Battery Packs - Decoding the Power PlayStandard vs Custom Battery Packs - Decoding the Power Play
Standard vs Custom Battery Packs - Decoding the Power Play
Epec Engineered Technologies
 
Verification of thevenin's theorem for BEEE Lab (1).pptx
Verification of thevenin's theorem for BEEE Lab (1).pptxVerification of thevenin's theorem for BEEE Lab (1).pptx
Verification of thevenin's theorem for BEEE Lab (1).pptx
chumtiyababu
 
Hospital management system project report.pdf
Hospital management system project report.pdfHospital management system project report.pdf
Hospital management system project report.pdf
Kamal Acharya
 
"Lesotho Leaps Forward: A Chronicle of Transformative Developments"
"Lesotho Leaps Forward: A Chronicle of Transformative Developments""Lesotho Leaps Forward: A Chronicle of Transformative Developments"
"Lesotho Leaps Forward: A Chronicle of Transformative Developments"
mphochane1998
 

Kürzlich hochgeladen (20)

Integrated Test Rig For HTFE-25 - Neometrix
Integrated Test Rig For HTFE-25 - NeometrixIntegrated Test Rig For HTFE-25 - Neometrix
Integrated Test Rig For HTFE-25 - Neometrix
 
Computer Networks Basics of Network Devices
Computer Networks  Basics of Network DevicesComputer Networks  Basics of Network Devices
Computer Networks Basics of Network Devices
 
Double Revolving field theory-how the rotor develops torque
Double Revolving field theory-how the rotor develops torqueDouble Revolving field theory-how the rotor develops torque
Double Revolving field theory-how the rotor develops torque
 
Wadi Rum luxhotel lodge Analysis case study.pptx
Wadi Rum luxhotel lodge Analysis case study.pptxWadi Rum luxhotel lodge Analysis case study.pptx
Wadi Rum luxhotel lodge Analysis case study.pptx
 
Unleashing the Power of the SORA AI lastest leap
Unleashing the Power of the SORA AI lastest leapUnleashing the Power of the SORA AI lastest leap
Unleashing the Power of the SORA AI lastest leap
 
Standard vs Custom Battery Packs - Decoding the Power Play
Standard vs Custom Battery Packs - Decoding the Power PlayStandard vs Custom Battery Packs - Decoding the Power Play
Standard vs Custom Battery Packs - Decoding the Power Play
 
HAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKAR
HAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKARHAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKAR
HAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKAR
 
School management system project Report.pdf
School management system project Report.pdfSchool management system project Report.pdf
School management system project Report.pdf
 
A CASE STUDY ON CERAMIC INDUSTRY OF BANGLADESH.pptx
A CASE STUDY ON CERAMIC INDUSTRY OF BANGLADESH.pptxA CASE STUDY ON CERAMIC INDUSTRY OF BANGLADESH.pptx
A CASE STUDY ON CERAMIC INDUSTRY OF BANGLADESH.pptx
 
Online electricity billing project report..pdf
Online electricity billing project report..pdfOnline electricity billing project report..pdf
Online electricity billing project report..pdf
 
Block diagram reduction techniques in control systems.ppt
Block diagram reduction techniques in control systems.pptBlock diagram reduction techniques in control systems.ppt
Block diagram reduction techniques in control systems.ppt
 
HOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptx
HOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptxHOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptx
HOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptx
 
Verification of thevenin's theorem for BEEE Lab (1).pptx
Verification of thevenin's theorem for BEEE Lab (1).pptxVerification of thevenin's theorem for BEEE Lab (1).pptx
Verification of thevenin's theorem for BEEE Lab (1).pptx
 
Hospital management system project report.pdf
Hospital management system project report.pdfHospital management system project report.pdf
Hospital management system project report.pdf
 
Thermal Engineering -unit - III & IV.ppt
Thermal Engineering -unit - III & IV.pptThermal Engineering -unit - III & IV.ppt
Thermal Engineering -unit - III & IV.ppt
 
data_management_and _data_science_cheat_sheet.pdf
data_management_and _data_science_cheat_sheet.pdfdata_management_and _data_science_cheat_sheet.pdf
data_management_and _data_science_cheat_sheet.pdf
 
DC MACHINE-Motoring and generation, Armature circuit equation
DC MACHINE-Motoring and generation, Armature circuit equationDC MACHINE-Motoring and generation, Armature circuit equation
DC MACHINE-Motoring and generation, Armature circuit equation
 
"Lesotho Leaps Forward: A Chronicle of Transformative Developments"
"Lesotho Leaps Forward: A Chronicle of Transformative Developments""Lesotho Leaps Forward: A Chronicle of Transformative Developments"
"Lesotho Leaps Forward: A Chronicle of Transformative Developments"
 
Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...
Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...
Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...
 
Navigating Complexity: The Role of Trusted Partners and VIAS3D in Dassault Sy...
Navigating Complexity: The Role of Trusted Partners and VIAS3D in Dassault Sy...Navigating Complexity: The Role of Trusted Partners and VIAS3D in Dassault Sy...
Navigating Complexity: The Role of Trusted Partners and VIAS3D in Dassault Sy...
 

HDR and WCG Video Broadcasting Considerations

  • 2. OUTLINE – Elements of High-Quality Image Production – Color Gamut Conversion (Gamut Mapping and Inverse Gamut Mapping) – Gamma, OETF, EOTF, OOTF, PQ and HLG HDR – HDR & SDR Mastering, Mapping, Tone Mapping and Inverse Tone Mapping – Static and Dynamic Tone Mapping – Backwards Compatibility – HDR and WCG Production Equipment – DVB UHD Phases – HDR Metadata and HDR Standards – PQ10 and HLG10 Distribution Standards – Different Distribution Scenarios – HDR Ecosystem (Open Standard and Dolby Vision) 2
  • 3. Elements of High-Quality Image Production Q1 Spatial Resolution (HD, UHD) Q2 Temporal Resolution (Frame Rate) (HFR) Q3 Dynamic Range (SDR, HDR) Q4 Color Gamut (BT. 709, BT. 2020) Q5 Coding (Quantization, Bit Depth) Q6 Compression Artifacts . . . 3 Not only more pixels, but better pixels 𝑻𝒐𝒕𝒂𝒍 𝑸𝒖𝒂𝒍𝒊𝒕𝒚 𝒐𝒇 𝑬𝒙𝒑𝒆𝒓𝒆𝒏𝒄𝒆 𝑸𝒐𝑬 𝒐𝒓 𝑸𝒐𝑿 = 𝒇(𝑸 𝟏, 𝑸 𝟐, 𝑸 𝟑,….)
  • 4. UHDTV 1 3840 x 2160 8.3 MPs Digital Cinema 2K 2048 x 1080 2.21 MPs 4K 4096 x 2160 8.84 MPs SD (PAL) 720 x 576 0.414MPs HDTV 720P 1280 x 720 0.922 MPs HDTV 1920 x 1080 2.027 MPs UHDTV 2 7680 x 4320 33.18 MPs 8K 8192×4320 35.39 MPs Wider viewing angle More immersive Q1: Spatial Resolution 4
  • 5. Motion Blur Motion Judder Conventional Frame Rate High Frame Rate Wider viewing angle Increased perceived motion artifacts Higher frame rates needed 50fps minimum (100fps being vetted) 5 Q2: High Frame Rate (HFR)
  • 6. – Deeper Colors – More Realistic Pictures – More Colorful 6 Wide Color Space (ITU-R Rec. BT.2020) 75.8%, of CIE 1931 Color Space (ITU-R Rec. BT.709) 35.9%, of CIE 1931 Q3: Wide Color Gamut WCG CIE 1931 Color Space
  • 7. Images : Dolby Laboratories Standard Dynamic Range High Dynamic Range (More Vivid, More Detail) Q4: High Dynamic Range 7
  • 8. Chasing the Human Vision System with HDR 8 Q4: High Dynamic Range
  • 9. 9 Q3+Q4: Wide Color Gamut + High Dynamic Range SDR SDR HDR HDR+WCG More vivid, More details More real, More colorful
  • 10. 10 bits 1024 Levels 8 bits 256 Levels 10 – More colours – More bits (10-bit) – Banding, Contouring Q5: Quantization (Bit Depth)
  • 11. Spatial Resolution (Pixels) HD, FHD, UHD1, UHD2 Temporal Resolution (Frame rate) 24fps, 30fps, 60fps, 120fps … Dynamic Range (Contrast) From 100 nits to HDR Color Space (Gamut) From BT 709 to Rec. 2020 Quantization (Bit Depth) 8 bits, 10 bits, 12 bits … 11 Major Elements of High-Quality Image Production
  • 13. Brief Summary of ITU-R BT.709, BT.2020, and BT.2100 – ITU-R BT.709, BT.2020 and BT.2100 address transfer function, color space, matrix coefficients, and more. The following table is a summary comparison of those three documents. 13 ITU-R BT.709 ITU-R BT.2020 ITU-R BT.2100 Spatial Resolution HD UHD, 8K HD, UHD, 8K Framerates 24, 25, 30, 50, 60 24, 25, 30, 50, 60, 100, 120 24, 25, 30, 50, 60, 100, 120 Interlace/Progressive Interlace, Progressive Progressive Progressive Color Space BT.709 BT.2020 BT.2020 Dynamic Range SDR (BT.1886) SDR (BT.1886) HDR (PQ, HLG) Bit Depth 8, 10 10, 12 10, 12 Color Representation RGB, YCBCR RGB, YCBCR RGB, YCBCR, ICTCP
  • 14. HDR & SDR End-to-End Production Workflows 14
  • 15. Color Gamut Conversion (Gamut Mapping and Inverse Mapping) 15 Wide Color Space (ITU-R Rec. BT.2020) 75.8%, of CIE 1931 Color Space (ITU-R Rec. BT.709) 35.9%, of CIE 1931 A 1 B C 2 D 3 RGB 100% Color Bar Rec. 709 Rec. 2020 CIE 1931 Color Space
  • 16. (ITU-R Rec. BT.2020) (ITU-R Rec. BT.709) Transformation from a Wider Gamut Space to a Smaller One – Without any corrections (gamut mapping), the image appear less saturated. 16 BT.2020 Signal BT.709 Munsell Chart A 1 Three Approaches: I. Clipping the RGB (clipping distortions) II. Perceptual gamut mapping (more computations and possibly changing the ‘creative intent’) III. Leaving the RGB values as they are and let the screen think that they relate to primaries of ITU-R BT.709.
  • 17. – Without any corrections color saturation will be increased. Smaller Gamut Space in a Wide Gamut Display 17 Munsell Chart BT.709 Signal BT.2020 (ITU-R Rec. BT.2020) (ITU-R Rec. BT.709) D 3
  • 18. – Opto-Electronic Transfer Function (OETF): Scene light to electrical signal – Electro-Optical Transfer Function (EOTF): Electrical signal to scene light Gamma, EOTF, OETF 18
  • 19. – Opto-Electronic Transfer Function (OETF): Scene light to electrical signal – Electro-Optical Transfer Function (EOTF): Electrical signal to scene light Gamma, EOTF, OETF The CRT EOTF is commonly known as gamma 19
  • 20. – Adjustment or Artistic Intent (Non-Linear Overall Transfer Function) – System (total) gamma to adjust the final look of displayed images (Actual scene light to display luminance Transfer function) – The “reference OOTF” compensates for difference in tonal perception between the environment of the camera and that of the display specification (OOTF varies according to viewing environment and display brightness) 20 OOTF (Opto-Optical Transfer Function) OOTF Same Look
  • 21. – On a flat screen display (LCD, Plasa,..) without OOTF, it appears as if the black level is elevated a little. – To compensate the black level elevation and to make images look closer to CRT, a display gamma = 2.4 has been defined under BT.1886. – As a result, OOTF = 1.2 21 Display EOTF gamma 2.4 Camera OETF 1/2.2 OOTF = 1.2 OOTF (Overall System Gamma, Artistic Rendering Intent) Opto-Optical Transfer Function (OOTF) Non-Linear Overall Transfer Function
  • 22. OOTF Position – Perceptual Quantization (PQ) (Optional Metadata) – Hybrid Log-Gamma (HLG) 22 For viewing in the end-user consumer TV, a display mapping should be performed to adjust the reference OOTF on the basis of mastering peak luminance metadata of professional display OOTF is implemented within the display and is aware of its peak luminance and environment (No metadata)
  • 23. Scene-Referred and Display-Referred 23 Scene-Referred: – The HLG signal describes the relative light in the scene – Every pixel in the image represents the light intensity in the captured scene – The signal produced by the camera is independent of the display – The signal is specified by the camera OETF characteristic Display-Referred: – The PQ signal describes the absolute output light from the mastering display – The signal is specified by the display EOTF
  • 24. Code Levels Distribution in HDR 24 Uniform CodeWords for Perceived Brightness
  • 25. Barten Ramp Human eye’s sensitivity to contrast in different levels 25 100MinimumDetectableContrast(%) MinimumContrastStep(%) Luminance (nit) Contouring Banding ∆𝐿 𝐿 ×100 ∆𝐿 & L are Large,Less bits are required,Larger quantize step size∆𝐿 & L are small,More bits are required,Smaller quantize step size Minimum detectable contrast (%) = 𝐌𝐢𝐧𝐢𝐦𝐮𝐦 𝐝𝐞𝐭𝐞𝐜𝐭𝐚𝐛𝐥𝐞 𝐝𝐢𝐟𝐟𝐞𝐫𝐞𝐧𝐜𝐞 𝐢𝐧 𝐥𝐮𝐦𝐢𝐧𝐚𝐧𝐜𝐞 𝐋𝐮𝐦𝐢𝐧𝐮𝐧𝐜𝐞 × 𝟏𝟎𝟎 = ∆𝑳 𝑳 ×100 2 L ∆𝑳 𝑳 ×100 ∆𝑳 𝑳 ×100  The threshold of visibility for quantization error (Minimum detectable contrast) (banding or contouring) becomes higher as the image gets darker.  The threshold for perceiving quantization error (banding or contouring) is approximately constant in the brighter parts and highlights of an image.
  • 26. PQ EOTF 26 Code words are equally spaced in perceived brightness over this range nits. BrightnessCodeWords Minimum Detectable Contrast (%) = 𝐌𝐢𝐧𝐢𝐦𝐮𝐦 𝐃𝐞𝐭𝐞𝐜𝐭𝐚𝐛𝐥𝐞 𝐃𝐢𝐟𝐟𝐞𝐫𝐞𝐧𝐜𝐞 𝐢𝐧 𝐋𝐮𝐦𝐢𝐧𝐚𝐧𝐜𝐞 𝐋𝐮𝐦𝐢𝐧𝐮𝐧𝐜𝐞 × 𝟏𝟎𝟎 = ∆𝑳 𝑳 ×100 2 L
  • 27. Code Words Utilization by Luminance Range in PQ 27 – PQ headroom from 5000 to 10,000 nits = 7% of code space – 100 nits is near the midpoint of the code range
  • 28. 0 0.2 0.4 0.6 0.8 1 1.2 0 0.2 0.4 0.6 0.8 1 SignalValue Linear light SDR gamma curve SDR with Knee HDR HLG Hybrid Log-Gamma (HLG) HDR-TV 28 E : The signal for each color component {RS, GS, BS} proportional to scene linear light and scaled by camera exposure, normalized to the range [0:12]. E′ :The resulting non-linear HLG coded signal {R',G',B'} in the range [0:1]. a = 0.17883277, b = 0.28466892, c = 0.55991073 More CodeWords for Dark Area          112ln 03 OETF 12 1 12 1 EcbEa EE EE Less CodeWords for BrightArea ITU-R Application 2 ,ARIB B67 (Association of Radio Industries and Businesses)
  • 29. HDR & SDR Mastering 29 HDR BT.2020 SDR BT.709
  • 30. HDR & SDR Mastering Example
  • 31. Tone Mapping and Inverse Tone Mapping Tone Mapping (Down-conversion) Limiting Luminance Range Inverse Tone Mapping (Up-conversion) Expanding Luminance Range 31 HDR BT.2020 SDR Signal (BT.709 or BT.2020) HDR HDR Signal (BT.2020) SDR Signal (BT.709 or BT.2020) SDR (BT.709 or BT.2020) HDR Signal (BT.2020) SDR
  • 32. Static Tone Mapping (HDR10) 32 – Optimized only for the brightest scene in the contents – This avoids hard clipping of detail in the highlights – It is not invariant under blind multiple round-trip conversions. Static and Dynamic Tone Mapping 200 1500
  • 33. Dynamic Tone Mapping 33 – Optimized for each scene in the contents – Ex: frame-by-frame, or scene-by-scene basis (Varying the EETF based on statistics of the image). – This approach could survive multiple round-trip conversions Static and Dynamic Tone Mapping
  • 34. Clipping Clipping No additional limiting/clipping in the event of multiple round-trip conversions (i.e. PQ->HLG->PQ- >HLG). 34
  • 35. Static and Dynamic Metadata in HDR Static Metadata – Mastering Display Color Volume (MDCV) Metadata (SMPTE ST2086) – The chromaticity of the red, green, and blue display primaries – White point of the mastering display – Black level and peak luminance level of the mastering display – Content Light Levels Metadata (The Blu-ray Disc Association and DECE groups): – MaxCLL (Maximum Content Light Level): Largest individual pixel light value of any video frame in the program – MaxFALL (Maximum Frame-Average Light Level): Largest average pixel light value of any video frame in the program (The maximum value of frame-average maxRGB for all frames in the content) (The frame-average maxRGB : The average luminance of all pixels in each frame) – They could be generated by the color grading software or other video analysis software. Dynamic Metadata – Content-dependent Metadata (SMPTE ST2094 (pending)) – Frame-by-frame or scene-by-scene Color Remapping Information (CRI) – Variable color transformation along the content timeline. 35
  • 36. Mapping – During the transition from SDR to HDR production (More SDR Display) or due to content owner preference – To preserve the “look” of the SDR content on HDR Display – Display-referred mapping To preserve the colors and relative tones of SDR on HDR Display – Scene-referred mapping To match the colors and lowlights and mid-tones of SDR camera with HDR camera. 36 SDR camera output (BT.709 or BT.2020) HDR Signal HDR BT.2020 Preserved SDR Look in HDR Program (Ex: 20%) (Without Expanded Luminance Range) HDR Signal HDR BT.2020 SDR Content (BT.709 or BT.2020) (Without Expanded Luminance Range) Preserved SDR Look in HDR Program (Ex:20%)
  • 37. Backwards Compatibility – Most of encoder/decoder and TVs are SDR (encoders/decoders replacement !!?? ) – Dolby Vision, Technicolor, Philips and BBC/NHK are all backwards compatible. – Backwards compatibility is less of an issue in over-the-top (OTT). 37 HDR Signal SDR UHDTV ITU-R BT.709 color space HDR metadata simply is ignored (Limited compatibility) (Color Signal) (B & W Display)
  • 38. HLG and PQ Backwards Compatibility with SDR Displays 38 HLG BT.2020 SDR BT.2020 color space − It has a degree of compatibility. − Hue changes can be perceptible in bright areas of highly saturated color or very high code values (Specular) − Both PQ and HLG provide limited compatibility HLG/PQ BT.2020 SDR BT.709 color space
  • 39. There is no Metadata other than Video Payload Identifier (VPID) in the SDI feed. – Camera – Lens (Performance Improvement) – Monitor (Especially Reference Monitor) – Waveform Monitor – Pattern Generator – CG and Graphic System – Playout and Ingest, Recorder and Player (HDMI Ports (HDMI 2.b)) – Cross Converters, SDI to HDMI Converter, HDMI to SDI Converter (HDMI 2.b) – HDMI Ports (HDMI 2.b) (Multi viewer, Scan Converter,…) – Video Production Switcher – Digital Glues, Embedder and De-Embedder – Lighting 39 HDR and WCG Production Equipment
  • 40. Ex: Benefit of 4K Lens for WCG and HDR – Both HD and 4K lens covers BT.2020. – Improve the transparency of Blue in 4K lens – Better S/N ratio. 40 – 4K lens can cut the flare and reduce black floating even in a backlit conditions. – Black floating is more noticeable in HDR. – Same object and same white level, but black level of – HD: 21.9% (HD lens reduces dynamic range!) – Full 4K:11.6% Same object and same white level, but different black level
  • 41. Ex: Color Bar Test Pattern for HDR TV Systems 41BT.2111-07 (40%) (75%) (0%)(75%)(0%) (0%) (75%) (40%) (75% colour bars) (100% colour bars) (–2%) (+2%) (+4%) BT. 709 colour bars Ramp (–7% - 109%) Stair (–7%, 0%, 10%, 20%, ..., 90%, 100%, 109%HLG)
  • 42. Ex: HDR Heat-map Tool in Waveform Monitor – User presets for SDR & HDR modes – Selectable background grey /color – Identify shadows, mid-tones or specular highlights 42
  • 43. HDR & HDMI 43 HDMI 2.0a supports ST2084 (PQ) and ST2086 (Mastering Display Color Volume Metadata) HDMI 2.0b followed up on HDMI 2.0a and added support for HLG and the HDR10 The HDMI 2.1 Specification will supersede 2.0b will support dynamic metadata and High Frame Rate
  • 45. Specifications for UHDTV Broadcasting 45 Items ITU Text Specification Video signal Spatial format Rec. ITU-R BT.2020 Rec. ITU-R BT.2100 7680×4320, 3840×2160 Frame frequency 24/1.001, 24, 25, 30/1.001, 30, 50, 60/1.001, 60, 100, 120/1.001, 120 Hz Colorimetry Wide colour gamut Transfer function Rec. ITU-R BT.2100 PQ, HLG Rec. ITU-R BT.2020 SDR Coding Rec. ITU-T H.265 Rec. ITU-R BT.1870 Rec. ITU-R BT.2073 MPEG-H HEVC Audio signal Speaker configuration Rec. ITU-R BS.2051 Channel-based (0+2+0 – 9+10+3), object- based Coding Rec. ITU-R BS.1196 MPEG-2 AAC, MPEG-4 AAC, MPEG-4 ALS Multimedia Rec. ITU-R BT.2075 IBB, HTML5 Rep. ITU-R BT.2342 Closed captions Transport Rec. ITU-T H.222.0 MPEG-2 TS Rec. ITU-R BT.2074 Rec. ITU-R BT.1869 MMT/TLV CAS Rec. ITU-R BT.1852 Satellite transmission Rec. ITU-R BO.1784 DVB-S2 Rec. ITU-R BO.2098 ISDB-S3
  • 46. World’s First: HDR Trial with Sky Germany (2015) 46
  • 48. HDR Ecosystem and Technologies (Open Standard) 48 HDR10 Static Metadata: SMPTE. 2086, MaxFALL, MaxCLL
  • 49. HDR Ecosystem and Technologies (Dolby Vision with License Fee) 49
  • 50. 50% bitrate saving – Direct-to-home 30% bitrate saving – Contribution 50% bitrate saving – Direct-to-home 30% bitrate saving – Contribution 50 2020 VVC 2020 (JVET) ≈50% bitrate saving – Direct-to-home ≈30% bitrate saving – Contribution HDR and WCG in Versatile Video Coding (VVC) for Contribution and Distribution
  • 51. HDR Standards – 4K Ultra Blu-ray – Netflix – Amazon – VUDU – YouTube Red – UltraFlix – PlayStation Video – ULTRA – Fandango – Google play – DirecTV – Dish – Xfinity 51 HDR Support Status IFA 2017
  • 52. HDR Standards Dynamic Metadata for Color Transform (DMCVT) Dolby Vision, HDR10+ (License-free Dynamic Metadata), SL-HDR1, Technicolor (PQ) Static Metadata (Mastering Display Color Volume (MDCV) Metadata+ MaxCLL+ MaxFALL) HDR10 (PQ + static metadata) PQ10 (+ Optional static metadata) No Metadata HLG10, PQ10 (without metadata) 52 StandoutExperienceSimplicity
  • 53. HDR Metadata and HDR/SDR Signal ID 53
  • 54. 8 - 54 12bit, HFR, BT.2020, HDR, 4:2:2, 4:4:4, Abject based audio Resolution, 14bit, Scalability DVB UHD Phases and HDR Delivery
  • 55. PQ10 & HLG10 HDR Systems in DVB Phase 2 55 – PQ10: PQ OETF, BT.2020,10-bit, non-constant luminance YCbCr, narrow range – HLG10: HLG OETF, BT.2020, 10-bit, non-constant luminance YCbCr, narrow range
  • 56. HDR information in HEVC Main 10 Profile (or H.264/MPEG-4 AVC) 56 [3] High Dynamic Range and/or High Frame Rates Bit streams are not intended to be used with BT. 709 color primaries. – VUI: Video Usability Information – SEI: Supplemental Enhancement Information – Alternative transfer characteristics: In order to serve both SDR and HDR receivers with a single stream in the case of HLG The SEI message is ignored by legacy SDR receivers It applies correct EOTF (Backward compatibility) (14) SDR ITU-R BT.2020 OETF
  • 57. SDRT.F indicator is sent over HDMI (14 in theVUI ) Two Methods of Signaling the HLG Transfer Function 57 HDRT.F indicator is sent over HDMI (18 in the SEI ) Video Stream HEVC HLG Aware STB or Decoder SDR Display HLG HDR Support SDRT.F indicator is signaled in theVUI (transfer_characteristics=14) HLGT.F indicator is signaled in the SEI (preferred_transfer_characteristics=18) HDRT.F indicator is sent over HDMI (18 in theVUI ) Video Stream HEVC HLG Aware STB or Decoder SDR Display HLG HDR Support HDRT.F indicator is signaled in theVUI (transfer_characteristics=18) It may produce acceptable results on SDR displays 14 ≠18 From “preferred_transfer_characteristic=18” it recognize that the bit stream is coded with HLG (actual transfer characteristics is HLG) It applies correct EOTF and gives backward compatibility feature of HLG. “Viewable SDR Pictures”
  • 58. Signaling Transfer Function, Color Space and Matrix Coefficients 58 *Note that both “1” and “14” are valid values to signal SDR transfer function; for example, DVB documents require “1” when the color container is BT.709 and “14” when the color container is BT.2020.
  • 59. Different Distribution Scenarios Single-layer – HDR video coding using HEVC Main 10 – HDR-to-SDR mapping at the receiver side (real-time) 59 HDRVideo HEVC Main 10 Encoding HEVC Main 10 Decoding Tone/Color Mapping HDR Display SDR Display
  • 60. Different Distribution Scenarios Single-layer – HDR video coding using HEVC Main 10 – HDR-to-SDR mapping at the receiver side (real-time) – Metadata from SDR master video to improve tone/color mapping and preserve artistic intent 60 HDRVideo HEVC Main 10 Encoding HEVC Main 10 Decoding Tone/Color Mapping HDR Display SDR DisplaySDRVideo Metadata
  • 61. Different Distribution Scenarios Single-layer – SDR video coding using HEVC – SDR-to-HDR mapping at the receiver side (real-time) 61 SDRVideo HEVC Main Encoding HEVC Main Decoding Inverse Tone/Color Mapping HDR Display SDR Display
  • 62. Different Distribution Scenarios Single-layer – SDR video coding using HEVC – SDR-to-HDR mapping at the receiver side (real-time) – Metadata from HDR master video to improve inverse tone/color mapping and preserve artistic intent 62 SDRVideo HEVC Main Encoding HEVC Main Decoding Inverse Tone/Color Mapping HDR Display SDR Display HDRVideo Metadata
  • 63. Different Distribution Scenarios Single-layer – SDR video obtained by HDR-to-SDR tone/color mapping – SDR video coding using HEVC – SDR-to-HDR mapping at the receiver side (real-time) 63 SDRVideo HEVC Main Encoding HEVC Main Decoding Inverse Tone/Color Mapping HDR Display SDR Display Tone/Color Mapping HDRVideo Metadata
  • 64. Different Distribution Scenarios Dual-layer, Simulcast – Simulcast (independent coding) of SDR and HDR video sequences – Not optimal in terms of bandwidth 64 HDRVideo HEVC Main 10 Encoding HEVC Main 10 Decoding HDR Display SDR DisplaySDRVideo HEVC Encoding HEVC Decoding
  • 65. Dual-layer, Scalable coding − Dual-layer, scalable coding − Quality can be Dynamic Range and WCG (PSNR or Quality Scalability in Encoder) 65 Base Layer Encoder (Low Quality Encoding) Base Layer Decoder Enhancement layer Encoder (Distortion Encoding) MULTIPLEXER − + InputVideo (HDR,WCG) E.L Bit Stream B.L Bit Stream Output Bit Stream Low QualityVide (SDR) BL Bit Stream High QualityVideo (HDR,WCG) BL + E.L Bit Streams Distortion of Low Quality Encoding Different Distribution Scenarios Tone/Color Mapping (SDR, BT.709) (SDR, BT.709)
  • 66. Different Distribution Scenarios Dual-layer, Scalable Coding – Joint coding of SDR and HDR video sequences using SHVC (Scalable HEVC) – Exploit better data redundancies 66 HDRVideo Scalable HEVC Main 10 Decoding HDR Display SDR Display SDRVideo Scalable HEVC Main 10 Encoding HEVC Decoding One Bit Stream
  • 67. (MDCV+SL-HDR1 Metadata) MDCV Metadata (e.g. ST 2086) (MDCV + SL-HDR1 Metadata) (e.g. SEI message) MDCV Metadata MDCV: Mastering Display Color Volume 67 Example of Single-layer Distribution Technicolor-Philips SL-HDR1 (Advanced HDR)
  • 68. Example of Dual-layer Distribution Dolby Vision 68
  • 69. (FIFA World Cup 2018) 69
  • 70. Global Picture of Sony “SR Live” for Live Productions (FIFA World Cup 2018) 70 – 8 Cameras Dual output UHD/HDR and HD/SDR – 11 Cameras Dual output HD/HDR and HD/SDR – 21 Cameras Single output HD/SDR – All Replays HD/SDR Shading of all cameras is done on the HD/SDR (BT. 709)
  • 71. Global Picture of “HLG-Live” for Live Productions 71 Shading of all cameras is done on the HD/SDR (BT. 709)