3. AVast Challenge/Opportunity
“This suggests that there are,at the very
least, aquarter of amillion distinct
English words,excluding inflections,and
words from technical and regional
vocabulary[JonnatohantGocod]overed by the OED ...”
2
[Oxford English Dictionary]
4. AVast Challenge/Opportunity
[Jonathan Good]
“This suggests that there are,at the very
least, a quarter of a million distinct
English words,excluding inflections,and
words from technical and regional
vocabulary not covered by the OED ...”
2
[Oxford English Dictionary]
Novel methods and applications to link
digital image content with human language.
22. Summary
15
• Link any characteristic to any keyword.
• Fast and highly scalable:
millions of images and thousands of keywords.
• Base for subsequent imaging applications with
semantic awareness.
40. Semantic Component
0 50 200 250
6
5
4
3
2
1
0
100 150
pixel value
v
al
u
e
z
red
green
blue
significance values for rose
22
41. Semantic Component
0 50 200 250
6
5
4
3
2
1
0
100 150
pixel value
v
al
u
e
z
red
green
blue
0 200
0
50
100
150
200
250
100
input value
outputvalue
red
green
blue
identit
f 0 =
⇢
1/ (1 + Sz)
1 + S|z|
if z Ç 0
if z < 0
S global scale parameter
significance values for rose Tone mapping function f
22
60. 9000+ Color Names
47
• XKCD color survey,psychophysical experiment.
• 950 English color names + color values.
61. 9000+ Color Names
48
• XKCD color survey,psychophysical experiment.
• 950 English color names + color values.
• Translate to 9 other languages:
Chinese,French,German,Italian,Japanese,Korean,
Portuguese,Russian,and Spanish.
62. 9000+ Color Names
49
• XKCD color survey,psychophysical experiment.
• 950 English color names + color values.
• Translate to 9 other languages:
Chinese,French,German,Italian,Japanese,Korean,
Portuguese,Russian,and Spanish.
• Example:柔和的粉红色,soft pink, rose tendre,sanftes
pink, rosa tenue,ソフトピンク,부드러운녹색,rosa
suave,нежно розовый,rosa suave.
70. Soft Pink
柔和的粉红色,cn
soft pink,en
rose tendre,fr
sanftes pink,de
rosatenue,it
ソフトピンク,jp
부드러운녹색,ko
rosasuave,pt
rosasuave,es
Language and country restrict.
54
74. Conclusions & FutureWork
sunset layout 5
0
−5
−10
−15
Easily scalable statistical framework.
input grass
Semantic image enhancement for
tone-mapping,color and depth-of-field.
periwinkle blue
Automatic color naming and an
interactive online color thesaurus.
61
75. •Du-Sik Park,Youngshin Kwak,Hyunwook Ok and Chang-Yeong Kim,Preferred skin color
reproduction on the display,JEI,2006.
•Gianluigi Ciocca,Claudio Cusano,Francesca Gasparini and Raimondo Schettini,ContentAware
Image Enhancement,Artificial Intelligence and Human-Oriented Computing,2007.
•Liad Kaufman.Dani Lischinski and MichaelWerman,Content-AwareAutomatic Photo
Enhancement,Computer Graphics Forum,2012.
•BaoyuanWang,YizhouYu,Tien-TsinWong,Chun Chen andYing-Qing Xu, Data-Driven Image
ColorTheme Enhancement,ACM SIGGRAPH,2010.
•NailaMurray,Sandra Skaff and Luca Marchesotti,Towards Automatic ConceptTransfer,
SIGGRAPH/Eurographics Symposium on Non-PhotorealisticAnimation and Rendering,2011.
•FrankWilcoxon,Individual Comparisons by Ranking Methods,Biometrics Bulletin,1945.
•Shaojie Zhuo andTerence Sim,Defocus map estimation from a single image,Pattern
Recognition,2011.
•Sung Ju Hwang,Ashish Kapoor and Sing Bing Kang,Context-BasedAutomatic Local Image
Enhancement,ECCV,2012.
Reference