SlideShare ist ein Scribd-Unternehmen logo
1
Hands-on Video CourseHands-on Video Course
Yossi Cohen
June 2013
Lecture 2
RAW Video
2
Hands-on Video Course
Overview
Intro to color theory
Image Packing
Ex1- Hands on Image packing
3
Hands-on Video Course
Losless Compression
Model Based Compression
Model
Based
Transform/s
Quantize /
Prioritize Reorder
Entropy
Coding
Sample +Pre
Processing
Bit rate control
4
Hands-on Video Course
COLOR
Representation
Decimation
Conversion
5
Hands-on Video Course
Human Visual System
The human eye has two basic light receptors:
Rods – Light Intensity receptors
Cons – Colored light receptors
6
Hands-on Video Course
Rods and Cons Frequency Reception
7
Hands-on Video Course
4.2 Color Models in Images
Colors spaces are used to store, display, print
images.
Images are represented using different:
Color spaces
Color Depth
Color Decimation Methods
Pixel/Plane Interleaving methods
8
Hands-on Video Course
Color Spaces
 Color Spaces
 RGB – Each pixel is provided coordinates in 3D space.
Coordinates are in Red, Blue and Green. This is how we
perceive color
 YUV – Conversion of the color to a Light (Y) based system.
Y and V are Color Complements
 HSV – Hue, Saturation, Value
 YCbCr and more
9
Hands-on Video Course
RGB->YUV Color Transform
R
G
B
R
B
G
Y
U
V
10
Hands-on Video Course
Color matching
 How can we compare colors
so that the content creators
and consumers know what
they are seeing?
 Many different ways
including CIE chromacity
diagram
11
Hands-on Video Course
Video Color Transforms
 Largely derived from older analog methods of coding
color for TV. Luminance is separated from color
information.
 YIQ is used to transmit TV signals in North America and
Japan.This coding also makes its way into VHS video
tape coding in these countries since video tape
technologies also use YIQ.
 In Europe, video tape uses the PAL or SECAM codings,
which are based on TV that uses a matrix transform
called YUV.
 Finally, digital video mostly uses a matrix transform called
YCbCr that is closely related to YUV
12
Hands-on Video Course
YUV Separation
13
Hands-on Video Course
YUV Color Model
•YUV codes a luminance signal (for gamma-corrected
signals) equal to Y , the “luma".
•Chrominance refers to the difference between a color
and a reference white at the same luminance. (U and V)
The transform is:
14
Hands-on Video Course
YIQ Color Model
YIQ is used in NTSC color TV broadcasting.
Again, gray pixels generate zero (I;Q)
chrominance signal.
I and Q are a rotated version of U and V .
The transform is:
15
Hands-on Video Course
YCbCr Color Model
1. The Rec. 601 standard for digital video uses
another color space YCbCr which closely
related to the YUV transform.
2. The YCbCr transform is used in JPEG image
compression and MPEG video compression.
For 8-bit coding:
16
Hands-on Video Course
Color Decimation
Rods>>Cons
Spatial Representation(Light) >> SR(Color)
Current Representation of light by 3 coordinates
per pixel waste space.
Color Decimation is done only in Light based color
representation (not in RGB)
17
Hands-on Video Course
Color Decimation
YUV 4:4:4 – No Color decimation
Used in studio editing
WiFi Display
YUV 4:2:2 – UV are decimated by two
High end video coding
YUV 4:2:0 – UV pixels are decimated by 4
Standard video coding
UY V
UY V
U
Y
V
18
Hands-on Video Course
Color Packing
We could arrange the “Color” pixels in several
ways:
Packed:
 YUV|YUV|YUV
Planer:
 YYYYYY….UUUUU…..VVVVV
Semi Planer:
 YYYYYYY UVUVUV
19
Hands-on Video Course
Common Color Packing formats
For video coding well use
Progressive input (and not interleaved)
YUV 4:2:0 Decimation
Planer Color Packing (yuv420p / I420)

20
Hands-on Video Course
COLOR DECIMATION
PACKING AND CONVERSION
Lab 1
21
Hands-on Video Course
Open the file with YUVPlayer
Just open it as default what do you get?
22
Hands-on Video Course
YUV Player
Did you got this? Why?
1. It seems that YUV file-format does not hold
format information
2. There are many YUV formats
What to do?
23
Hands-on Video Course
Play & Probe file
FFPLAY akiyo_cif.yuv
Cant play missing Image size
FFPlay –s 352x288 akyo_cif.yuv
ffprobe.exe -video_size 352x288 akiyo_cif.yuv
Input #0, rawvideo, from 'akiyo_cif.yuv':
Duration: 00:00:12.00, start: 0.000000, bitrate: 30412 kb/s
Stream #0:0: Video: rawvideo (I420 / 0x30323449), yuv420p,
352x288, 30412 kb/s, 25 tbr, 25 tbn, 25 tbc
24Hands-on Video Course
Play & Probe file
FFPLAY akiyo_cif.y4m
FFProbe akiyo_cif.y4m
Input #0, yuv4mpegpipe, from 'akiyo_cif.y4m':
Duration: N/A, bitrate: N/A
Stream #0:0: Video: rawvideo (I420 / 0x30323449), yuv420p,
352x288, SAR 128:117 DAR 1408:1053, 29.97 fps, 29.97
tbr, 29.97 tbn, 29.97 tbc
25Hands-on Video Course
Back to YUV Player
Select YUV420
And if we need it in UYVY (YUV422 Packed)
ffmpeg -s 352x288 -i akiyo_cif.yuv -pix_fmt
uyvy422 akiyo_cif_uyvy.yuv
26Hands-on Video Course
Ex 1
Create Akiyo YUV file which is opened using
YUV422 option of YUVPlayer
What is the difference between this 4:2:2 format
and the previous one?
Can we open this format using Y only setting?
If not create a Y only file
Is there an option for a YUV file with headers?
Save akiyo in raw YUV with headers
27Hands-on Video Course
EX1 answers
Check FFMPEG –pix_fmts
ffmpeg -s 352x288 -i akiyo_cif.yuv -pix_fmt
yuv422p akiyo_cif_422p.yuv
ffmpeg -s 352x288 -i akiyo_cif.yuv -pix_fmt gray
akiyo_cif_y.yuv
28Hands-on Video Course
Y4M filel Format
Y4M is a YUV file with a header.
Header states
YUV decimation and packing
Frame resolution
FPS

Weitere ähnliche Inhalte

Was ist angesagt?

H.263 Video Codec
H.263 Video CodecH.263 Video Codec
H.263 Video Codec
Kavisha Miyan
 
H261
H261H261
H261
Videoguy
 
On the Impact of Viewing Distance on Perceived Video Quality
On the Impact of Viewing Distance on Perceived Video QualityOn the Impact of Viewing Distance on Perceived Video Quality
On the Impact of Viewing Distance on Perceived Video Quality
Alpen-Adria-Universität
 
Scalable Video Coding Guidelines and Performance Evaluations for Adaptive Me...
Scalable Video Coding Guidelines and Performance Evaluations for Adaptive Me...Scalable Video Coding Guidelines and Performance Evaluations for Adaptive Me...
Scalable Video Coding Guidelines and Performance Evaluations for Adaptive Me...
mgrafl
 
MMC MPEG4
MMC MPEG4MMC MPEG4
INCEPT: Intra CU Depth Prediction for HEVC
INCEPT: Intra CU Depth Prediction for HEVCINCEPT: Intra CU Depth Prediction for HEVC
INCEPT: Intra CU Depth Prediction for HEVC
Alpen-Adria-Universität
 
HTTP Adaptive Streaming State of the Art and Challenges Ahead
HTTP Adaptive StreamingState of the Art and Challenges AheadHTTP Adaptive StreamingState of the Art and Challenges Ahead
HTTP Adaptive Streaming State of the Art and Challenges Ahead
Alpen-Adria-Universität
 
HEVC / H265 Hands-On course
HEVC / H265 Hands-On courseHEVC / H265 Hands-On course
HEVC / H265 Hands-On course
Yoss Cohen
 
Video coding standards ppt
Video coding standards pptVideo coding standards ppt
Video coding standards ppt
Lokesh Reddy Avula
 
HEVC overview main
HEVC overview mainHEVC overview main
HEVC overview main
Nirma University
 
Understanding Quality of Experience of Heuristic-based HTTP Adaptive Bitrate ...
Understanding Quality of Experience of Heuristic-based HTTP Adaptive Bitrate ...Understanding Quality of Experience of Heuristic-based HTTP Adaptive Bitrate ...
Understanding Quality of Experience of Heuristic-based HTTP Adaptive Bitrate ...
Alpen-Adria-Universität
 
Dynamic Adaptive Point Cloud Streaming
Dynamic Adaptive Point Cloud StreamingDynamic Adaptive Point Cloud Streaming
Dynamic Adaptive Point Cloud Streaming
Alpen-Adria-Universität
 
Multimedia
MultimediaMultimedia
Multimedia
BUDNET
 
1 state of-the-art and trends in scalable video
1 state of-the-art and trends in scalable video1 state of-the-art and trends in scalable video
1 state of-the-art and trends in scalable video
Yogananda Patnaik
 
Press Release of 131st WG11 (MPEG) Meeting
Press Release of 131st WG11 (MPEG) MeetingPress Release of 131st WG11 (MPEG) Meeting
Press Release of 131st WG11 (MPEG) Meeting
Alpen-Adria-Universität
 
HEVC VIDEO CODEC By Vinayagam Mariappan
HEVC VIDEO CODEC By Vinayagam MariappanHEVC VIDEO CODEC By Vinayagam Mariappan
HEVC VIDEO CODEC By Vinayagam Mariappan
Vinayagam Mariappan
 
Bandwidth Prediction in Low-Latency Chunked Streaming
Bandwidth Prediction in Low-Latency Chunked StreamingBandwidth Prediction in Low-Latency Chunked Streaming
Bandwidth Prediction in Low-Latency Chunked Streaming
Alpen-Adria-Universität
 
A QoS-Adaptive Framework for Screen Sharing Over Internet
A QoS-Adaptive Framework for Screen Sharing Over InternetA QoS-Adaptive Framework for Screen Sharing Over Internet
A QoS-Adaptive Framework for Screen Sharing Over Internet
Duc Nguyen
 
PERFORMANCE EVALUATION OF H.265/MPEG-HEVC, VP9 AND H.264/MPEGAVC VIDEO CODING
PERFORMANCE EVALUATION OF H.265/MPEG-HEVC, VP9 AND H.264/MPEGAVC VIDEO CODINGPERFORMANCE EVALUATION OF H.265/MPEG-HEVC, VP9 AND H.264/MPEGAVC VIDEO CODING
PERFORMANCE EVALUATION OF H.265/MPEG-HEVC, VP9 AND H.264/MPEGAVC VIDEO CODING
ijma
 
IPTV Codec & Packeting
IPTV Codec & PacketingIPTV Codec & Packeting
IPTV Codec & Packeting
Kuncoro Wastuwibowo
 

Was ist angesagt? (20)

H.263 Video Codec
H.263 Video CodecH.263 Video Codec
H.263 Video Codec
 
H261
H261H261
H261
 
On the Impact of Viewing Distance on Perceived Video Quality
On the Impact of Viewing Distance on Perceived Video QualityOn the Impact of Viewing Distance on Perceived Video Quality
On the Impact of Viewing Distance on Perceived Video Quality
 
Scalable Video Coding Guidelines and Performance Evaluations for Adaptive Me...
Scalable Video Coding Guidelines and Performance Evaluations for Adaptive Me...Scalable Video Coding Guidelines and Performance Evaluations for Adaptive Me...
Scalable Video Coding Guidelines and Performance Evaluations for Adaptive Me...
 
MMC MPEG4
MMC MPEG4MMC MPEG4
MMC MPEG4
 
INCEPT: Intra CU Depth Prediction for HEVC
INCEPT: Intra CU Depth Prediction for HEVCINCEPT: Intra CU Depth Prediction for HEVC
INCEPT: Intra CU Depth Prediction for HEVC
 
HTTP Adaptive Streaming State of the Art and Challenges Ahead
HTTP Adaptive StreamingState of the Art and Challenges AheadHTTP Adaptive StreamingState of the Art and Challenges Ahead
HTTP Adaptive Streaming State of the Art and Challenges Ahead
 
HEVC / H265 Hands-On course
HEVC / H265 Hands-On courseHEVC / H265 Hands-On course
HEVC / H265 Hands-On course
 
Video coding standards ppt
Video coding standards pptVideo coding standards ppt
Video coding standards ppt
 
HEVC overview main
HEVC overview mainHEVC overview main
HEVC overview main
 
Understanding Quality of Experience of Heuristic-based HTTP Adaptive Bitrate ...
Understanding Quality of Experience of Heuristic-based HTTP Adaptive Bitrate ...Understanding Quality of Experience of Heuristic-based HTTP Adaptive Bitrate ...
Understanding Quality of Experience of Heuristic-based HTTP Adaptive Bitrate ...
 
Dynamic Adaptive Point Cloud Streaming
Dynamic Adaptive Point Cloud StreamingDynamic Adaptive Point Cloud Streaming
Dynamic Adaptive Point Cloud Streaming
 
Multimedia
MultimediaMultimedia
Multimedia
 
1 state of-the-art and trends in scalable video
1 state of-the-art and trends in scalable video1 state of-the-art and trends in scalable video
1 state of-the-art and trends in scalable video
 
Press Release of 131st WG11 (MPEG) Meeting
Press Release of 131st WG11 (MPEG) MeetingPress Release of 131st WG11 (MPEG) Meeting
Press Release of 131st WG11 (MPEG) Meeting
 
HEVC VIDEO CODEC By Vinayagam Mariappan
HEVC VIDEO CODEC By Vinayagam MariappanHEVC VIDEO CODEC By Vinayagam Mariappan
HEVC VIDEO CODEC By Vinayagam Mariappan
 
Bandwidth Prediction in Low-Latency Chunked Streaming
Bandwidth Prediction in Low-Latency Chunked StreamingBandwidth Prediction in Low-Latency Chunked Streaming
Bandwidth Prediction in Low-Latency Chunked Streaming
 
A QoS-Adaptive Framework for Screen Sharing Over Internet
A QoS-Adaptive Framework for Screen Sharing Over InternetA QoS-Adaptive Framework for Screen Sharing Over Internet
A QoS-Adaptive Framework for Screen Sharing Over Internet
 
PERFORMANCE EVALUATION OF H.265/MPEG-HEVC, VP9 AND H.264/MPEGAVC VIDEO CODING
PERFORMANCE EVALUATION OF H.265/MPEG-HEVC, VP9 AND H.264/MPEGAVC VIDEO CODINGPERFORMANCE EVALUATION OF H.265/MPEG-HEVC, VP9 AND H.264/MPEGAVC VIDEO CODING
PERFORMANCE EVALUATION OF H.265/MPEG-HEVC, VP9 AND H.264/MPEGAVC VIDEO CODING
 
IPTV Codec & Packeting
IPTV Codec & PacketingIPTV Codec & Packeting
IPTV Codec & Packeting
 

Andere mochten auch

色彩模型 Color Models
 色彩模型 Color Models 色彩模型 Color Models
色彩模型 Color Models
YKLee3434
 
Introduction to HEVC
Introduction to HEVCIntroduction to HEVC
Introduction to HEVC
Yoss Cohen
 
YUV, Y CB CR and Subsampling
YUV, Y CB CR and SubsamplingYUV, Y CB CR and Subsampling
YUV, Y CB CR and Subsampling
University of Sunderland
 
Audio video system slides, Microphone loudspeaker, Aduio devices slides, AVS ...
Audio video system slides, Microphone loudspeaker, Aduio devices slides, AVS ...Audio video system slides, Microphone loudspeaker, Aduio devices slides, AVS ...
Audio video system slides, Microphone loudspeaker, Aduio devices slides, AVS ...
dreamygyz
 
Understanding video technologies
Understanding video technologiesUnderstanding video technologies
Understanding video technologies
fionayoung
 
Television basic understanding
Television   basic understandingTelevision   basic understanding
Television basic understanding
Nithin Kalorth, PhD
 
GSM Architecture
GSM ArchitectureGSM Architecture
GSM Architecture
Pratik Gupta
 
Audio Video Engineering
Audio Video Engineering Audio Video Engineering
Audio Video Engineering
Yogesh kanade
 
Video technology
Video technologyVideo technology
Video technology
Simon Wright
 
Introduction to Video Signals
Introduction to Video SignalsIntroduction to Video Signals
Introduction to Video Signals
Devashish Raval
 
Ch 6 introduction to television
Ch 6 introduction to televisionCh 6 introduction to television
Ch 6 introduction to television
kapil raviya
 
Colout TV Fundamentals
Colout TV FundamentalsColout TV Fundamentals
Colout TV Fundamentals
Madhumita Tamhane
 
Television Basics
Television BasicsTelevision Basics
Television Basics
Nishith Kumar
 
Multimedia fundamentals
Multimedia fundamentalsMultimedia fundamentals
Multimedia fundamentals
Prithvi Raj M
 
Chapter 1 - Multimedia Fundamentals
Chapter 1 - Multimedia FundamentalsChapter 1 - Multimedia Fundamentals
Chapter 1 - Multimedia Fundamentals
Pratik Pradhan
 
Television Receiver
Television ReceiverTelevision Receiver
Television Receiver
Devashish Raval
 
GSM Architecture
GSM ArchitectureGSM Architecture
GSM Architecture
koonlay
 
GSM Presentation
GSM PresentationGSM Presentation
GSM Presentation
Dheeraj Raja
 
Television ppt
Television pptTelevision ppt
Television ppt
Anirban Mandal
 
Multimedia presentation
  Multimedia presentation   Multimedia presentation
Multimedia presentation
kamalesh2015
 

Andere mochten auch (20)

色彩模型 Color Models
 色彩模型 Color Models 色彩模型 Color Models
色彩模型 Color Models
 
Introduction to HEVC
Introduction to HEVCIntroduction to HEVC
Introduction to HEVC
 
YUV, Y CB CR and Subsampling
YUV, Y CB CR and SubsamplingYUV, Y CB CR and Subsampling
YUV, Y CB CR and Subsampling
 
Audio video system slides, Microphone loudspeaker, Aduio devices slides, AVS ...
Audio video system slides, Microphone loudspeaker, Aduio devices slides, AVS ...Audio video system slides, Microphone loudspeaker, Aduio devices slides, AVS ...
Audio video system slides, Microphone loudspeaker, Aduio devices slides, AVS ...
 
Understanding video technologies
Understanding video technologiesUnderstanding video technologies
Understanding video technologies
 
Television basic understanding
Television   basic understandingTelevision   basic understanding
Television basic understanding
 
GSM Architecture
GSM ArchitectureGSM Architecture
GSM Architecture
 
Audio Video Engineering
Audio Video Engineering Audio Video Engineering
Audio Video Engineering
 
Video technology
Video technologyVideo technology
Video technology
 
Introduction to Video Signals
Introduction to Video SignalsIntroduction to Video Signals
Introduction to Video Signals
 
Ch 6 introduction to television
Ch 6 introduction to televisionCh 6 introduction to television
Ch 6 introduction to television
 
Colout TV Fundamentals
Colout TV FundamentalsColout TV Fundamentals
Colout TV Fundamentals
 
Television Basics
Television BasicsTelevision Basics
Television Basics
 
Multimedia fundamentals
Multimedia fundamentalsMultimedia fundamentals
Multimedia fundamentals
 
Chapter 1 - Multimedia Fundamentals
Chapter 1 - Multimedia FundamentalsChapter 1 - Multimedia Fundamentals
Chapter 1 - Multimedia Fundamentals
 
Television Receiver
Television ReceiverTelevision Receiver
Television Receiver
 
GSM Architecture
GSM ArchitectureGSM Architecture
GSM Architecture
 
GSM Presentation
GSM PresentationGSM Presentation
GSM Presentation
 
Television ppt
Television pptTelevision ppt
Television ppt
 
Multimedia presentation
  Multimedia presentation   Multimedia presentation
Multimedia presentation
 

Ähnlich wie Hands-on Video Course - "RAW Video"

video compression
video compressionvideo compression
video compression
Aniruddh Tyagi
 
video compression
video compressionvideo compression
video compression
aniruddh Tyagi
 
video compression
video compressionvideo compression
video compression
aniruddh Tyagi
 
7
77
Scct2013 topic4 video
Scct2013 topic4 videoScct2013 topic4 video
Scct2013 topic4 video
Anies Syahieda
 
Chapter four.pptx
Chapter four.pptxChapter four.pptx
Chapter four.pptx
TadeseBeyene
 
Chapter fourvvvvvvvbbhhgggghhhhhhheryuuuhh
Chapter fourvvvvvvvbbhhgggghhhhhhheryuuuhhChapter fourvvvvvvvbbhhgggghhhhhhheryuuuhh
Chapter fourvvvvvvvbbhhgggghhhhhhheryuuuhh
TadeseBeyene
 
VIDEO CODECS
VIDEO CODECSVIDEO CODECS
VIDEO CODECS
Vinayagam Mariappan
 
Lec2
Lec2Lec2
Lec2
Kh Ravy
 
Chapter 3- Media Representation and Formats.ppt
Chapter 3- Media Representation and Formats.pptChapter 3- Media Representation and Formats.ppt
Chapter 3- Media Representation and Formats.ppt
VasanthiMuniasamy2
 
Particle filter and cam shift approach for motion detection
Particle filter and cam shift approach for motion detectionParticle filter and cam shift approach for motion detection
Particle filter and cam shift approach for motion detection
kalyanibedekar
 
TAAI 2016 Keynote Talk: It is all about AI
TAAI 2016 Keynote Talk: It is all about AITAAI 2016 Keynote Talk: It is all about AI
TAAI 2016 Keynote Talk: It is all about AI
Yi-Shin Chen
 
To Understand Video
To Understand VideoTo Understand Video
To Understand Video
adil raja
 
Video
VideoVideo
simple video compression
simple video compression simple video compression
simple video compression
LaLit DuBey
 
Video Data
Video DataVideo Data
Video Data
Sanea
 
E4 ident video analysis
E4 ident video analysisE4 ident video analysis
E4 ident video analysis
Luke Finlay
 
Unit 1 Lesson 01
Unit 1 Lesson 01Unit 1 Lesson 01
Applying Media Content Analysis to the Production of Musical Videos as Summar...
Applying Media Content Analysis to the Production of Musical Videos as Summar...Applying Media Content Analysis to the Production of Musical Videos as Summar...
Applying Media Content Analysis to the Production of Musical Videos as Summar...
Chris Huang
 
chapter5.pptx
chapter5.pptxchapter5.pptx
chapter5.pptx
AparnaDas827261
 

Ähnlich wie Hands-on Video Course - "RAW Video" (20)

video compression
video compressionvideo compression
video compression
 
video compression
video compressionvideo compression
video compression
 
video compression
video compressionvideo compression
video compression
 
7
77
7
 
Scct2013 topic4 video
Scct2013 topic4 videoScct2013 topic4 video
Scct2013 topic4 video
 
Chapter four.pptx
Chapter four.pptxChapter four.pptx
Chapter four.pptx
 
Chapter fourvvvvvvvbbhhgggghhhhhhheryuuuhh
Chapter fourvvvvvvvbbhhgggghhhhhhheryuuuhhChapter fourvvvvvvvbbhhgggghhhhhhheryuuuhh
Chapter fourvvvvvvvbbhhgggghhhhhhheryuuuhh
 
VIDEO CODECS
VIDEO CODECSVIDEO CODECS
VIDEO CODECS
 
Lec2
Lec2Lec2
Lec2
 
Chapter 3- Media Representation and Formats.ppt
Chapter 3- Media Representation and Formats.pptChapter 3- Media Representation and Formats.ppt
Chapter 3- Media Representation and Formats.ppt
 
Particle filter and cam shift approach for motion detection
Particle filter and cam shift approach for motion detectionParticle filter and cam shift approach for motion detection
Particle filter and cam shift approach for motion detection
 
TAAI 2016 Keynote Talk: It is all about AI
TAAI 2016 Keynote Talk: It is all about AITAAI 2016 Keynote Talk: It is all about AI
TAAI 2016 Keynote Talk: It is all about AI
 
To Understand Video
To Understand VideoTo Understand Video
To Understand Video
 
Video
VideoVideo
Video
 
simple video compression
simple video compression simple video compression
simple video compression
 
Video Data
Video DataVideo Data
Video Data
 
E4 ident video analysis
E4 ident video analysisE4 ident video analysis
E4 ident video analysis
 
Unit 1 Lesson 01
Unit 1 Lesson 01Unit 1 Lesson 01
Unit 1 Lesson 01
 
Applying Media Content Analysis to the Production of Musical Videos as Summar...
Applying Media Content Analysis to the Production of Musical Videos as Summar...Applying Media Content Analysis to the Production of Musical Videos as Summar...
Applying Media Content Analysis to the Production of Musical Videos as Summar...
 
chapter5.pptx
chapter5.pptxchapter5.pptx
chapter5.pptx
 

Mehr von Yoss Cohen

Infrared simulation and processing on Nvidia platforms
Infrared simulation and processing on Nvidia platformsInfrared simulation and processing on Nvidia platforms
Infrared simulation and processing on Nvidia platforms
Yoss Cohen
 
open platform for swarm training
open platform for swarm training open platform for swarm training
open platform for swarm training
Yoss Cohen
 
Deep Learning - system view
Deep Learning - system viewDeep Learning - system view
Deep Learning - system view
Yoss Cohen
 
Dspip deep learning syllabus
Dspip deep learning syllabusDspip deep learning syllabus
Dspip deep learning syllabus
Yoss Cohen
 
IoT consideration selection
IoT consideration selectionIoT consideration selection
IoT consideration selection
Yoss Cohen
 
IoT evolution
IoT evolutionIoT evolution
IoT evolution
Yoss Cohen
 
Nvidia jetson nano bringup
Nvidia jetson nano bringupNvidia jetson nano bringup
Nvidia jetson nano bringup
Yoss Cohen
 
Autonomous car teleportation architecture
Autonomous car teleportation architectureAutonomous car teleportation architecture
Autonomous car teleportation architecture
Yoss Cohen
 
Motion estimation overview
Motion estimation overviewMotion estimation overview
Motion estimation overview
Yoss Cohen
 
Computer Vision - Image Filters
Computer Vision - Image FiltersComputer Vision - Image Filters
Computer Vision - Image Filters
Yoss Cohen
 
Intro to machine learning with scikit learn
Intro to machine learning with scikit learnIntro to machine learning with scikit learn
Intro to machine learning with scikit learn
Yoss Cohen
 
DASH and HTTP2.0
DASH and HTTP2.0DASH and HTTP2.0
DASH and HTTP2.0
Yoss Cohen
 
HEVC Definitions and high-level syntax
HEVC Definitions and high-level syntaxHEVC Definitions and high-level syntax
HEVC Definitions and high-level syntax
Yoss Cohen
 
FFMPEG on android
FFMPEG on androidFFMPEG on android
FFMPEG on android
Yoss Cohen
 
Web video standards
Web video standardsWeb video standards
Web video standards
Yoss Cohen
 
Product wise computer vision development
Product wise computer vision developmentProduct wise computer vision development
Product wise computer vision development
Yoss Cohen
 
3D Video Programming for Android
3D Video Programming for Android3D Video Programming for Android
3D Video Programming for Android
Yoss Cohen
 
Analog Video
Analog Video Analog Video
Analog Video
Yoss Cohen
 
WiFi Display
WiFi DisplayWiFi Display
WiFi Display
Yoss Cohen
 
Video optimization for android - Part I
Video optimization for android - Part IVideo optimization for android - Part I
Video optimization for android - Part I
Yoss Cohen
 

Mehr von Yoss Cohen (20)

Infrared simulation and processing on Nvidia platforms
Infrared simulation and processing on Nvidia platformsInfrared simulation and processing on Nvidia platforms
Infrared simulation and processing on Nvidia platforms
 
open platform for swarm training
open platform for swarm training open platform for swarm training
open platform for swarm training
 
Deep Learning - system view
Deep Learning - system viewDeep Learning - system view
Deep Learning - system view
 
Dspip deep learning syllabus
Dspip deep learning syllabusDspip deep learning syllabus
Dspip deep learning syllabus
 
IoT consideration selection
IoT consideration selectionIoT consideration selection
IoT consideration selection
 
IoT evolution
IoT evolutionIoT evolution
IoT evolution
 
Nvidia jetson nano bringup
Nvidia jetson nano bringupNvidia jetson nano bringup
Nvidia jetson nano bringup
 
Autonomous car teleportation architecture
Autonomous car teleportation architectureAutonomous car teleportation architecture
Autonomous car teleportation architecture
 
Motion estimation overview
Motion estimation overviewMotion estimation overview
Motion estimation overview
 
Computer Vision - Image Filters
Computer Vision - Image FiltersComputer Vision - Image Filters
Computer Vision - Image Filters
 
Intro to machine learning with scikit learn
Intro to machine learning with scikit learnIntro to machine learning with scikit learn
Intro to machine learning with scikit learn
 
DASH and HTTP2.0
DASH and HTTP2.0DASH and HTTP2.0
DASH and HTTP2.0
 
HEVC Definitions and high-level syntax
HEVC Definitions and high-level syntaxHEVC Definitions and high-level syntax
HEVC Definitions and high-level syntax
 
FFMPEG on android
FFMPEG on androidFFMPEG on android
FFMPEG on android
 
Web video standards
Web video standardsWeb video standards
Web video standards
 
Product wise computer vision development
Product wise computer vision developmentProduct wise computer vision development
Product wise computer vision development
 
3D Video Programming for Android
3D Video Programming for Android3D Video Programming for Android
3D Video Programming for Android
 
Analog Video
Analog Video Analog Video
Analog Video
 
WiFi Display
WiFi DisplayWiFi Display
WiFi Display
 
Video optimization for android - Part I
Video optimization for android - Part IVideo optimization for android - Part I
Video optimization for android - Part I
 

Kürzlich hochgeladen

5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides
DanBrown980551
 
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERPBest 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
Pixlogix Infotech
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
Matthew Sinclair
 
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdfMonitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Tosin Akinosho
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
MichaelKnudsen27
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
Chart Kalyan
 
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean lotus Threat actors project by John Sitima 2024 (1).pptxOcean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
SitimaJohn
 
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying AheadDigital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Wask
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
Jason Packer
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc
 
WeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation TechniquesWeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation Techniques
Postman
 
Skybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoptionSkybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoption
Tatiana Kojar
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
Zilliz
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
ssuserfac0301
 
Recommendation System using RAG Architecture
Recommendation System using RAG ArchitectureRecommendation System using RAG Architecture
Recommendation System using RAG Architecture
fredae14
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
akankshawande
 
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing InstancesEnergy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Alpen-Adria-Universität
 
OpenID AuthZEN Interop Read Out - Authorization
OpenID AuthZEN Interop Read Out - AuthorizationOpenID AuthZEN Interop Read Out - Authorization
OpenID AuthZEN Interop Read Out - Authorization
David Brossard
 
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
Edge AI and Vision Alliance
 
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial IntelligenceAI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
IndexBug
 

Kürzlich hochgeladen (20)

5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides
 
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERPBest 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
 
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdfMonitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
 
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean lotus Threat actors project by John Sitima 2024 (1).pptxOcean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
 
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying AheadDigital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying Ahead
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
 
WeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation TechniquesWeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation Techniques
 
Skybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoptionSkybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoption
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
 
Recommendation System using RAG Architecture
Recommendation System using RAG ArchitectureRecommendation System using RAG Architecture
Recommendation System using RAG Architecture
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
 
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing InstancesEnergy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
 
OpenID AuthZEN Interop Read Out - Authorization
OpenID AuthZEN Interop Read Out - AuthorizationOpenID AuthZEN Interop Read Out - Authorization
OpenID AuthZEN Interop Read Out - Authorization
 
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
 
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial IntelligenceAI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
 

Hands-on Video Course - "RAW Video"

  • 1. 1 Hands-on Video CourseHands-on Video Course Yossi Cohen June 2013 Lecture 2 RAW Video
  • 2. 2 Hands-on Video Course Overview Intro to color theory Image Packing Ex1- Hands on Image packing
  • 3. 3 Hands-on Video Course Losless Compression Model Based Compression Model Based Transform/s Quantize / Prioritize Reorder Entropy Coding Sample +Pre Processing Bit rate control
  • 5. 5 Hands-on Video Course Human Visual System The human eye has two basic light receptors: Rods – Light Intensity receptors Cons – Colored light receptors
  • 6. 6 Hands-on Video Course Rods and Cons Frequency Reception
  • 7. 7 Hands-on Video Course 4.2 Color Models in Images Colors spaces are used to store, display, print images. Images are represented using different: Color spaces Color Depth Color Decimation Methods Pixel/Plane Interleaving methods
  • 8. 8 Hands-on Video Course Color Spaces  Color Spaces  RGB – Each pixel is provided coordinates in 3D space. Coordinates are in Red, Blue and Green. This is how we perceive color  YUV – Conversion of the color to a Light (Y) based system. Y and V are Color Complements  HSV – Hue, Saturation, Value  YCbCr and more
  • 9. 9 Hands-on Video Course RGB->YUV Color Transform R G B R B G Y U V
  • 10. 10 Hands-on Video Course Color matching  How can we compare colors so that the content creators and consumers know what they are seeing?  Many different ways including CIE chromacity diagram
  • 11. 11 Hands-on Video Course Video Color Transforms  Largely derived from older analog methods of coding color for TV. Luminance is separated from color information.  YIQ is used to transmit TV signals in North America and Japan.This coding also makes its way into VHS video tape coding in these countries since video tape technologies also use YIQ.  In Europe, video tape uses the PAL or SECAM codings, which are based on TV that uses a matrix transform called YUV.  Finally, digital video mostly uses a matrix transform called YCbCr that is closely related to YUV
  • 13. 13 Hands-on Video Course YUV Color Model •YUV codes a luminance signal (for gamma-corrected signals) equal to Y , the “luma". •Chrominance refers to the difference between a color and a reference white at the same luminance. (U and V) The transform is:
  • 14. 14 Hands-on Video Course YIQ Color Model YIQ is used in NTSC color TV broadcasting. Again, gray pixels generate zero (I;Q) chrominance signal. I and Q are a rotated version of U and V . The transform is:
  • 15. 15 Hands-on Video Course YCbCr Color Model 1. The Rec. 601 standard for digital video uses another color space YCbCr which closely related to the YUV transform. 2. The YCbCr transform is used in JPEG image compression and MPEG video compression. For 8-bit coding:
  • 16. 16 Hands-on Video Course Color Decimation Rods>>Cons Spatial Representation(Light) >> SR(Color) Current Representation of light by 3 coordinates per pixel waste space. Color Decimation is done only in Light based color representation (not in RGB)
  • 17. 17 Hands-on Video Course Color Decimation YUV 4:4:4 – No Color decimation Used in studio editing WiFi Display YUV 4:2:2 – UV are decimated by two High end video coding YUV 4:2:0 – UV pixels are decimated by 4 Standard video coding UY V UY V U Y V
  • 18. 18 Hands-on Video Course Color Packing We could arrange the “Color” pixels in several ways: Packed:  YUV|YUV|YUV Planer:  YYYYYY….UUUUU…..VVVVV Semi Planer:  YYYYYYY UVUVUV
  • 19. 19 Hands-on Video Course Common Color Packing formats For video coding well use Progressive input (and not interleaved) YUV 4:2:0 Decimation Planer Color Packing (yuv420p / I420) 
  • 20. 20 Hands-on Video Course COLOR DECIMATION PACKING AND CONVERSION Lab 1
  • 21. 21 Hands-on Video Course Open the file with YUVPlayer Just open it as default what do you get?
  • 22. 22 Hands-on Video Course YUV Player Did you got this? Why? 1. It seems that YUV file-format does not hold format information 2. There are many YUV formats What to do?
  • 23. 23 Hands-on Video Course Play & Probe file FFPLAY akiyo_cif.yuv Cant play missing Image size FFPlay –s 352x288 akyo_cif.yuv ffprobe.exe -video_size 352x288 akiyo_cif.yuv Input #0, rawvideo, from 'akiyo_cif.yuv': Duration: 00:00:12.00, start: 0.000000, bitrate: 30412 kb/s Stream #0:0: Video: rawvideo (I420 / 0x30323449), yuv420p, 352x288, 30412 kb/s, 25 tbr, 25 tbn, 25 tbc
  • 24. 24Hands-on Video Course Play & Probe file FFPLAY akiyo_cif.y4m FFProbe akiyo_cif.y4m Input #0, yuv4mpegpipe, from 'akiyo_cif.y4m': Duration: N/A, bitrate: N/A Stream #0:0: Video: rawvideo (I420 / 0x30323449), yuv420p, 352x288, SAR 128:117 DAR 1408:1053, 29.97 fps, 29.97 tbr, 29.97 tbn, 29.97 tbc
  • 25. 25Hands-on Video Course Back to YUV Player Select YUV420 And if we need it in UYVY (YUV422 Packed) ffmpeg -s 352x288 -i akiyo_cif.yuv -pix_fmt uyvy422 akiyo_cif_uyvy.yuv
  • 26. 26Hands-on Video Course Ex 1 Create Akiyo YUV file which is opened using YUV422 option of YUVPlayer What is the difference between this 4:2:2 format and the previous one? Can we open this format using Y only setting? If not create a Y only file Is there an option for a YUV file with headers? Save akiyo in raw YUV with headers
  • 27. 27Hands-on Video Course EX1 answers Check FFMPEG –pix_fmts ffmpeg -s 352x288 -i akiyo_cif.yuv -pix_fmt yuv422p akiyo_cif_422p.yuv ffmpeg -s 352x288 -i akiyo_cif.yuv -pix_fmt gray akiyo_cif_y.yuv
  • 28. 28Hands-on Video Course Y4M filel Format Y4M is a YUV file with a header. Header states YUV decimation and packing Frame resolution FPS