1. Applications of Spectral
Color Research
Markku Hauta-Kasari
PhD, Docent
Director of InFotonics Center Joensuu
University of Eastern Finland
Joensuu campus
P.O.Box 111, FI-80101 Joensuu, FINLAND
VIPP Symposium 2010, Aalto University, January 21, 2010

2. Contents
 Introduction
 InFotonics Center Joensuu – concept
 Spectral imaging systems
 Case examples of spectral color related
industrial applications
 Research projects and project funding examples
 Conclusions

3. Introduction
 In this talk, applied research results related to
spectral color will be presented
 Talk is focused to industrial applications
 Case studies have been realized in InFotonics
Center Joensuu, which is the research center in the
field of photonics and spectral color research at the
University of Eastern Finland

4. University of Joensuu Color Group
Spectral color analysis
Leaders
Dr. Markku Hauta-Kasari
Prof. Timo Jääskeläinen
Prof. Jussi Parkkinen Dr. Birgitta Martinkauppi
Dr. Hannu Laamanen
Spectral measurements Dr. Oili Kohonen
Dr. Jouni Hiltunen Dr. Juha Lehtonen
Dr. Jarkko Mutanen
Dr. Martti Mäkinen Dr. Joni Orava
M.Sc. Jussi Kinnunen M.Sc. Jukka Antikainen
M.Sc. Alexey Andriyashin
M.Sc. Students M.Sc. Pauli Fält
10
M.Sc. Ville Heikkinen
M.Sc. Tuija Jetsu
M.Sc. Pesal Koirala
M.Sc. Konstantin Krasavin
M.Sc. Hongyu Li
M.Sc. Paras Pant
M.Sc. Elina Räisänen
M.Sc. Masayuki Ukishima

5. InFotonics Center Joensuu
 Established in 2003 at the University to
generate new openings with industrial
partners
 A core strategy:
 research center in the field of optics and spectral
color research
 research collaboration with other scientific
organizations and high technology companies

6. Background
 Optics Research
- Since 1970, from holography to diffractive optics
 Spectral Color Research
- Group started in the middle of 1980’s
- Joint group of the Physics and Computer Science
• Long-term research background and internationally known groups
Industrial cooperation expanded
→ Need for the research center
→ InFotonics Center started on September 2003

7. Optics and Spectral Color in Joensuu, FINLAND
University of Joensuu
• optics group ~ 70 Nanocomp Ltd
• spectral color group ~ 25 1997
• InFotonics Center ~ 10
~ 100 SPECIALISTS
IN THE FIELD OF OPTICS AND
SPECTRAL COLOR
Optoinspection Ltd
2003
Joensuu Science Park
SoftColor Ltd MGM-Devices Ltd
2005 2005

8. InFotonics Center’s activities
Reseach cooperation with other scientific
organizations and services for high technology
companies
 Applied research projects
 Measurement services
 Feasibility studies
 Concept development

9. Financiers of InFotonics Center
Funding for years 2003 – 2009 ~ 5 milj. euros
 The EU social fund and structural fund
- State Provincial Office of Eastern Finland
- Employment and Economic Development Centre of Joensuu
- The Regional Council of North Karelia
 Euregio Karelia Neighbourhood Programme (Interreg) and TEKES
(Finnish Funding Agency for Technology and Innovation)
 City of Joensuu
 Joensuu Regional Development Company, JOSEK Ltd
 Funding from industry

10. Spectral Imaging Systems

11. Spectral Imaging Systems at the Color
Research Laboratory
 Filter based system
 Nuance LCTF visible (by CRI)
 Nuance LCTF visible + NIR (by CRI)
 Line scanning based spectral imaging systems
 ImSpector V8
 ImSpector V10E
 ImSpector N17E
 ImSpector UV
 ImSpector IR

12. Capturing Spectral Image
 Spectral scanning
 LCTF
 Interference
filter, etc.
 Spatial scanning
 ImSpector
Spectral Image Structure

13. Illuminator
Spectral
camera
Sample holder
and XY-table

14. Software for spectral camera

18. Case studies
 Examples are focused to industrial applications
1. Plastics industry
2. Optimizing color images for displays
3. Fluorescence for biophotonics
4. Spectral based fundus imaging
5. Paper and printing industry
6. Digital museum exhibition

19. Case 1: Application for quality control of
plastics products

21. Case 2: Metameric color reproduction
 Application for industrial product presentation

22. Display Characteristics

23. Examples for CRT and LCD displays
IMAGE OF IMAGE OF METAMERIC
IMAGE OF
SRGB-REPRODUCTION COLOR REPRODUCTION
ORIGINAL SAMPLE
ON CRT DISPLAY ON CRT DISPLAY

24. Spectral based Optimization of Screen Images
for Industrial Product Presentation
Lari Härkönen, Birgitta Martinkauppi, Hannu Laamanen, Markku Hauta-Kasari
InFotonics Center
Department of Computer Science, Department of Physics
University of Joensuu, FINLAND
Petri Huhtelin, Pekka Horttanainen
Tulikivi Corporation, FINLAND
Electronic Imaging, San Jose, 2006

25. Case 3: Fluorescence for biophotonics

26. Example of fluorescent colors

27. Optical setup for bispectrometer

28. Optical setup for bispectrometer

29. Fluorescent standard samples

30. Fluorescence analysis

31. Fluorescence analysis

32. Applications
 Biological
 Geological
 Medicine
 Paper Industry
 Safety Industry
 Textile Industry

33. Case 4: Spectral Fundus Imaging

36. Examples
458 nm
 550 nm 694 nm


37. Inner product images. Upper row PCA, lower row ICA.

38. Case 5 : Paper and printing industry

39. Application for quality control of printed
products
 The reclamation cases were analyzed for the
company
 Customer had selected the printing quality by the
pre-print, however, the final print was not
satisfactory
 The color differences under different illuminations
were simulated by spectral color technologies

40. Comparison between pre-print and print
color difference
pre-print print

41. Spectral properties of printing inks

42. Visualization of color gamuts: same paper,
different ink set used

43. Spectral analysis of printing dots

44. Case 6: Digital Museum Exhibition

45. Shades of Colors –
Digital Museum Exhibition
Location:
North-Karelian Museum, Carelicum, Joensuu, FINLAND
http://digimuseo.joensuu.fi

46. Shades of Colors exhibition
 Dates: January 25 – September 2, 2007
 Location: North-Karelian Museum, Carelicum,
Joensuu, FINLAND
 Organizers:
 North-Karelian Museum
 University of Joensuu, InFotonics Center Joensuu
 North-Karelian Polytechnic
 National Museum of Japanese History, JAPAN
(Kokuritsu Rekishi Minzoku Hakubutsukan, Rekihaku)

49. Lecture serie
 January 24, 2007, Wed., at 6 pm.
Auditorium in Carelicum, Torikatu st. 21 C, Joensuu
Dr. Kimiyoshi Miyata, National Museum of Japanese History, Japan ”Welcome words”
Professor Jussi Parkkinen, University of Joensuu, Finland, ”Opening lecture”
 February 7, 2007, Wed., at 7 pm.
Auditorium Louhela, Science Park, Länsikatu st. 15, Joensuu
Professor Shigeki Nakauchi, Toyohashi Technical University, Japan
"Psychophysical color research"
The lecture will be interpreted from English into Finnish. After the lecture, the public is invited to acquaint themselves with the
research laboratory of the color research group of the University of Joensuu.
 February 28, 2007, Wed., at 6 pm.
The Art Museum of Joensuu, Kirkkokatu st. 23
Instructor Harald Arnkil, University of Art and Design Helsinki
"Väri taiteen ja tieteen yhtymäkohtana" (Color as a point of contact between art and science)
The lecture will be delivered in Finnish.
 March 21, 2007, Wed., at 6 pm.
Auditorium in Carelicum, Torikatu st. 21 C, Joensuu
Professor Göte Nyman, University of Helsinki
"Värin subjektiivisen kokemuksen mittaaminen" (Measuring the subjective experience of color)
The lecture will be delivered in Finnish.
 March 25, 2007,Sun., at 2 pm.
Auditorium in Carelicum, Torikatu st. 21 C, Joensuu
Director Markku Hauta-Kasari, InFotonics Center Joensuu
"Mitä värit ovat" What colors are ?
 April 25, 2007, Wed., at 6 pm.
Auditorium Louhela, Science Park, Länsikatu 15, Joensuu
Professor Fernando Fermi, University of Parma, Parma, Italy
"Color technology in study of paintings"
The lecture will be interpreted from English into Finnish.

50. Internet-connections
 http://digimuseo.joensuu.fi
 Skype: digimuseo
 Internet based Feedback-system
 Web-camera broadcast

51. Acknowledgements for Digital
Museum Exhibition
 Finnish Cultural Foundation
 Collaborators:
 Dr. Kimiyoshi Miyata, Rekihaku, Japan
 Mr. Sawada, Rekihaku, Japan
 Dr. Norimichi Tsumura, Chiba University, Japan
 Mr. Ochiai, Chiba University, Japan
 Prof. Shigeki Nakauchi, Toyohashi University of Technology
 Itoh Optics, Japan
 Riikka Räisänen, Department of Home Economics and Craft Science,
University of Helsinki
 Olli Ronkainen, North Karelia Polytechnic
 Kerttu Kalteinen, artisan
 Päivi Hintsanen, coloria.net

52. Example of the plastics component, in which three
different nanostructures are written.
• We can design and manufacture this
kind of components for massproduction
Recycling marks

53. Applications
 Diffractive beam splitters
 Divide light into diffraction
orders
 Used in machine vision,
optical communication,…
 Continuous, binary, and
multilevel structures
 Applications: gratings for
spectrometers and spectral
cameras
 Massproduction:
Nanocomp Ltd. Joensuu,
Finland

54. Examples of recent applied research projects
 NaarMu – Nanostructures into mold, Tekes, 2005-2007
 Aktiva – Injection moulding of active materials, Tekes, 2005-2006
 NEMO, Network of Excellence on Micro-Optics, EU 6. framework programme, 2004 -2008
 Haiku - Managing High-Quality Image Material in Evolving Media,
Tekes, Joint project with the University of Helsinki, Toyohashi
University of Technology, Chiba University, Nokia, M-real), 2003-2006
 HIPROLA - Spectral based monitoring of laser welding, Tekes, joint project with the Lappeenranta University of technology, (Companies:
Daimler-Chrysler, Precitec, Kemppi Ltd. , Gasmet Ltd., Specim Ltd.), 2004-2007
 Future Steel Frontages – Tekes, Rautaruukki (Other parties: InFotonics
Center, Hämeenlinna Polytechnic, TopAnalytica Ltd.), 2006-2008
 ImageRet – Machine Vision for Retinal Image Analysis – Tekes, Lappeenranta University of Technology, (Other parties: University of Kuopio,
InFotonics Center, Imperial College London, YTI Research Center Mikkeli, Kuomed Oy, Perimetria Oy, Santen Oy, VAS Oy), 2006.
 Tekes = Finnish Funding Agency for Technology and Innovation

55.  Digital museum concept development – joint project with North Carelian museum,
North Carelian Polytechnic, and National Museum of Japanese History, grant from
the Finnish Cultural Foundation 2006-2008.
 InFotonics Center Joensuu – knowledge and technology transfer
development, Tekes – Euregio Karelia Neighbourhood Programme
(Cooperating Universires: St. Petersburg State Technical University,
Russia, St. Petersburg State University, Russia, Petrozavodsk State
University, Russia, Companies: PunaMusta, M-real, Stora Enso, Metso
Paper, Mäntsälän saha), 2005-2007
 Papvision – Paper Printability Inspection Using Machine Vision, Tekes, Lappeenranta University of Technology, (Other Parties: Stora Enso, Metso
Paper, UPM-Kymmene, Myllykoski Paper, Future Printing Center, Labvision Technologies, InFotonics Center) 2006
 RedWood, - Wood humidity analysis by spectral color technique - Tekes, MILA Kajaani, (Other Parties: InFotonics Center, Mecano Group, Valutec,
UPM-Kymmene Wood), 2006-2007
 ImageRet2 – Optimal Detection and Decision – Support Diagnosis of Diabetic Retin
Opathy, Tekes, Joint project of Lappeenranta University of Technology, InFotonics Center,
University of Kuopio, (Other parties: Imperial College London, YTI Research Center
Mikkeli, Kuomed Oy, Mawell Oy, Perimetria Oy, Santen Oy, VAS Oy), 2007-2009.
 AKO – Aluekeskuohjelma-toimenpide: Fotoniikka ja spektrinen väritutkimus pk-yritysten tuotekehityksen tueksi – selvitykset ja kartoitukset , Joensuun
seudun kehittämisyhtiö, JOSEK, 2007 – 2009
 .
 DIME – Direct color marking of metal surfaces by fibrelaser – Tekes, VTT, IFC, (Other parties: Iittala Group, Kone, Nanofoot Finland, Nokia, Savcor
Alfa), 2007-2009.
 Highresolution remote sensing to measure single trees, Academy of Finland, University of Joensuu, Facultu of Forestry, InFotonics Center, 01.01.2008–
31.12.2011
 Aging Macula, Tekes (Pharma-technology program), Joint project with University of Kuopio, (Other parties:
InFotonics Center, Joensuu Santen, Novartis Finland Oy, Santen Oy, Duallaser Oy, CNServices Oy), 2008 –
2010.

56.  Optical sensor technology in applications of medical physics and
medical technology,Start-up project for the University of Eastern
Finland, 2007-2010.
 Tools for simulation of color in digital prints, MittUniversitet, Sweden,
(Other parties: M-real, Agfa, MoRe, Stora Enso, Lorentzen-Wettre,
StFi, Daus, InFotonics Center) – research project, 2007 - 2009
 Mitsubishi Paper Mills – Chiba University- InFotonics Center,
researcher exchange, 2007 – 2009
 Qvision – Imaging techniques in paper industry, ForestCluster Ltd,
(SHOK) consortium project with several universities, 2009-2010.

57. Company projects
 Research project: IFC - Samsung Advanced Institute of Technology (SAIT), Korea, 2005-2006
 Research project: IFC – CPS Color, 2006
 Research project: IFC – KCL, 2006-2007, 2009
 Research project: IFC – WinGlobal Technology Inc. (Taiwan), 2006
 Research project: IFC – DENSO CORPORATION (Japan), 2007-2008
 Research project: IFC – Upload Image Processing Ltd., 2007
 Research project IFC – MGM Devices Oy, 2008
 Research project IFC – UPM Kymmene, 2007-2010
 Research project IFC – Medisize Corporation, 2009
 In addition, 40 short term feasibility studies and concept developments for industry since 2003
 Perlos 8, Nanocomp 2, M-real 8, Nokia 2, Tameye 4, Turun Sarjatuote 1, Exel 2, Tulikivi 1, Metso Paper 1, Rautaruukki 1, Mastsystems Int’l 1,
Moventas 1, Specim 1, ColoChrome 2, Kemira 1, Aduser Oy 2, Pohjois-Karjalan eMaakunta 1, Joensuun Tiedepuisto, network Oasis, FlexLab 1

58. International industrial co-operation
 Samsung Advanced Institute of Technology, Korea
 Daimler-Chrysler, Germany
 Precitec, Germany
 Winglobal, Taiwan
 DENSO CORPORATION, Japan
 Mitsubishi Paper Mills, Japan
 Exel, Belgium
 Agfa, Sweden
 M-real, Sweden
 StFi, Sweden
 Lorentzen-Wettre, Sweden
 Daus, Sweden
 Stora Enso, Sweden

59. International cooperation
Research co-operation since 1988 with Japanese research groups, totally over 25 researcher years:
 Chiba University, Japan
 Toyohashi University of Technology, Japan
 Saitama University, Japan
 Nara Institute of Science and Technology, Japan
 Tokyo Institute of Technology, Japan
 National Museum of Japanese History, Japan
Other international cooperation
 Fudan University, China
 Kyungpook National University, Korea
 Rochester Institute of Technology, USA
 St. Petersburg State Polytechnical University, Russia
 St. Petersburg State University, Russia
 Petrozavodsk State University, Russia
 Linköping University, Sweden
Erasmus-Mundus ”Color in Informatics and Media Technology” master programme
 University of Joensuu
 University of Saint-Etienne, France
 Gjovik University College, Norway
 University of Granada, Spain

60. Conclusions
 The advantages of the spectral color based systems
are that the most accurate color representation is
acquired and it can then be filtered for specific
purposes, such as for displaying the color
characterized image.
 The final sensor optimized to specific spectral
wavelengths can be designed according to the
results from high-dimensional spectral analysis
 Due to the technical development of spectral
imaging systems, they are becoming more and more
possible to be used in industrial applications, for
example, on online quality control applications.

61. Acknowledgements
Joensuu Color Group
Spectral color analysis
Leaders Dr. Markku Hauta-Kasari
Prof. Timo Jääskeläinen Dr. Birgitta Martinkauppi
Prof. Jussi Parkkinen Dr. Hannu Laamanen
Dr. Oili Kohonen
Spectral measurements
Dr. Jouni Hiltunen Dr. Juha Lehtonen
Dr. Jarkko Mutanen Dr. Joni Orava
Dr. Martti Mäkinen M.Sc. Jukka Antikainen
M.Sc. Jussi Kinnunen M.Sc. Alexey Andriyashin
M.Sc. Pauli Fält
M.Sc. Students
10 M.Sc. Ville Heikkinen
M.Sc. Tuija Jetsu
M.Sc. Pesal Koirala
M.Sc. Konstantin Krasavin
M.Sc. Hongyu Li
M.Sc. Elina Räisänen
M.Sc. Masayuki Ukishima
Acknowledgements: University of Joensuu Color Group, InFotonics Center Joensuu,
our research and industrial partners

62. More Information
 http://ifc.joensuu.fi
 Email: info@ifc.joensuu.fi
Acknowledgements: Joensuu Color Group, InFotonics Center Joensuu,
our research and industrial partners