Multilingual Knowledge Systems: Knowledge Meets Language

@coreonapp
@wetzelmichael
@multi_knowledge
michael@coreon.com
Terminology Summer School 2016, 14 July, Vienna
Michael Wetzel, MD, Coreon GmbH
Multilingual Knowledge Systems:
Knowledge Meets Language

14-07-2016 MKS – Multilingual Knowledge Systems @wetzelmichael
Agenda
What is an MKS?
Three Business
Cases
Summary

LISE Project Research from 2011-2012:
Resources Increase, Quality Decreases
3
Oh, our classification had been built in English,
- no, I don‘t know whether there is one in
French
Searching on our intranet is a pain – I‘ve just
researched for documents containing LCD screen –
nothing found! ... Should have known that they are
all tagged with monitor.
„Manual revision of the keyword
lists are not possible any more“
(AUP, AT)
Duplicates, inconsistencies, gaps and
content coverage problems after
merging two resources (Imaging
company, UK)
„Difficulty to ensure
consistency, in terms of
quality, coverage,
completeness“ (EU
Representative)

Divide et Impera!
4
Today:
Unstructured
haystack of
concepts
Better:
Ordered scheme, a
taxonomy
Introduce control
Turn information
into knowledge

Taxonomy, thesaurus, ontology tools:
Good, but not for language needs
5
Though, very helpful
• Classifications,
nomenclatures
• Tagging in CMS
• Semantic Search
• Standards: SKOS, OWL
• Conferences: semantics,
KMWorld, SemTechBiz,
Wissensmanagementtage
Not for Language
• For trained experts only (!)
• Lexically organised
• Weak in managing
synonyms
• Weak in multilingualism
• Not for describing
terminology data

Termbases, Glossaries
• Control language
• Focus on translation
• Lack knowledge modelling
• Only searching, no exploring
Taxonomies, Thesauri
• For knowledge structuring
• Lack multilingualism
• Lack language control
Before MKS: Two Parallel Approaches to
Inventorise and Leverage Knowledge
6
Huge, unaddressed potential for cross-lingual
data analysis, enterprise search, e-discovery and
to facilitate interoperability
would boost with data
would add structure
… …
mirror base Spiegelfuß
wing mirror Außenspiegel
… …
mirror
wing
mirror
left wing
mirror
…

14-07-2016 MKS – Multilingual Knowledge Systems @wetzelmichael7
Before MKS: No Comprehensive Approach
 Termbases store concepts rather one by one
 fail to master large data, unsafe use
 Taxonomies achieve structure but ignore the
pragmatics of terminologies
 fail to manage multilingual data
 No structured multilingual resources
 no crosslingual data analysis nor e-discovery,
missed leverage

Unify through a Multidimensional
Repository for Knowledge and Language
8
08
45
76
35
17
1: Taxonomy: 
output
devices
visual
output
devices
screen
audio
output
devices
head-
phones

9
3: Multilingualism: 
Synonymy
• screen • monitor
• écran
• Bildschirm• Monitor • Display
08
45
76
rejected
accepted
35
17
2: Synonymy: 1: Taxonomy:  4: Control: 9

10
Synonymy
• screen • monitor
• écran
• Bildschirm• Monitor • Display
• visual output device
• Optisches Ausgabegerät
08
45
76
rejected
accepted
35
17
3: Multilingualism: 2: Synonymy: 1: Taxonomy:  5: Meaning: ~4: Control: 9

Solution: Multilingual Knowledge System
11
Inventory of Linked
Multilingual
Concepts
Fusion of Taxonomy
/ Ontology Graph
with Multilingual
Terminology

Coreon combines flexible tools
for creating, exploring, and
maintaining taxonomies with
terminology management.
Coreon is the most advanced
SaaS solution for multilingual
knowledge systems.

One System, One View, All Languages:
Concepts, Relations, Terms
13
Immediate broader /
narrower neighborhood
Concept meta
data
Terms and
synonyms
Extensive term
descriptors
Location in map
Alphabetic,
multilingual list

Leverage Existing Assets for Your MKS
14
Multilingual Knowledge System
Multilingual Terminology List Knowledge Map
Structure
semantically
Cover Languages,
Variants, Registers

The Business Case for:
Terminology and Data Maintainers
What is an MKS?
• Fusion of terminology with taxonomy /
thesaurus models
• Captures language and knowledge
Three Business Cases
Summary
Avoid a loss of
your investment
through
systematic
terminology work

Ad-hoc Collecting Terms is Dangerous
17
Do you feel incomfortable by adding and
adding new data without a pause?
Where are the doublettes?
Did we translate some records twice?
Can we unify two larger terminology
resources?
Visualise and make above
navigatable.
Avoid noise and redundancies.
Achieve clarity and consistency.

(Re-)Gain Control through Structure
... ...
… …
… …
… …
... ...
Yesterday:
List of terms
Goal:
Visualised Multilingual Concept Map
Schule school
Oberschule secondary school
Realschule intermediate school
Gymnasium grammar school
Grundschule elementary school
Schule
school
Oberschule
secondary
school
Gymnasium
grammar
school
Realschule
intermediate
school
Grundschule
elementary
school

For the Maintainer: Less Effort
through Term Creation in Context
19
Crafting terms
for more
specific
concepts
Crafting terms
in other
languages
Comparing
definitions,
attributes etc.
screen
LCD
screen
CRT
…?
screen
LCD
screen
CRT
screen
CRT screen
CRT monitor
screen
monitor
screen
monitor
CRT screen
CRT monitor
screen
Bild-
schirm
screen
CRT
screen
Bild-
schirm
CRT Bild-
schirm
CRT
screen
CRT
Monitor
?
=

Less Redundancies Means Quality
20
 Lexical approach:
Doublettes remain hidden
 Concept map:
Doublettes made transparent

Develop Terminology in Context
22
Dangerous:
Tunnel view onto one isolated concept
Control through Context:
All related concepts in sight

14-07-2016 MKS – Multilingual Knowledge Systems @wetzelmichael 23
Benefits: Large Terminology Collections
under Control, thus Valuable
Trust
Investment
Protected
Quality
Control
Efficiency
Systematic
Approach

Cross-border Interoperability
What is an MKS?
thesaurus models
Summary
Harmonizing
Organisations
and their Systems

Semantic Interoperability
 “We are connecting systems”
 Vocabularies only for meta
data?
 This is rather syntactic
interoperability

Problem: Cross-Border Interoperability
 Not a translation but a semantic
problem:
 Is Austria‘s Matura the same as
Germany‘s Abitur? And its
synonyms?
 What if a qualification like
Realschulabschluß doesn’t exist in
other countries?
 „Agree on that we disagree“

Creating a Unified Resource
– across Languages
27
UK SE DE
Multiple terminologies
are merged into a unified
resource.
Linguistic similarity search:
maps units that share
the same meaning.

Concept Mapping Example:
Trademark Classifications
Remote controls for diapositive projectors
Remote controls for projectors
Controls for projectors
Remote controls for slide projectors
Uses advanced linguistic search activating strict metadata
rules to achieve meaning matching.

A Little Protocol: Processing such Large
Language Resources
Start
• 110,000 English terms
• Other languages ranging from 8,000 to 60,000 terms
Clean
• Reduced English to 93,000 terms
Language
coverage
• 93,000 terms in all EU languages too expensive without automation
• Therefore: Mining data for translations
• DB grew from 400,000 to 2.1m terms
Conceptual
clustering
• Non essential entries removed – DB shrunk to 1.5m terms
• Semi-automatic creation of 50,000 meaning clusters
Taxonomy
• Built for the top layers and concepts linked

Success Story: Cross-border
Interoperability in Trademarks
30
• Seamless and
borderless intellectual
property registration,
opposition, and legal
processing, in all bodies
of the EU and the
member states
Organizational
Benefits
• My trademark, as it is
described in my native
language, can be
applied for globally
without changes and is
subject to the same
legislation all over the
EU
Commercial
Benefits

Digital Single Market
What is an MKS?
thesaurus models
Summary
Cross-lingual
semantic search
is a pre-requisite
for the European
DSM

The Vision of a Digital Single Market
“Consumers need to be able
to buy the best products
at the best prices,
wherever they are in Europe.”
Vice-President Ansip, Dec 2014
Accelerating growth through a connected Europe:
Speech at GSMA Mobile 360 conference in Brussels
http://europa.eu/rapid/press-release_SPEECH-14-2420_en.htm
32

…and the Reality
http://europa.eu/rapid/attachment/IP-15-
4653/en/Digital_Single_Market_Factsheet_20150325.pd
f
33

Broken already by a Simple Search
<search string>
“Rasenmäher”
34

Language Independent Semantic Search:
Start in any Language
35
Start in any
language
Heisswasserkocher
bouilloires
hervidores

Decompose the Query String
36
Morphological
analysis
Heiss|wasser|kocher
bouilloire|s
hervidor|es

Iterate via “Normal Language” Synonyms
37
Morphological
analysis
Expand paradigm
through standard
synonyms
heiss
heiß
Wasser
H20
Boiler
Kocher
Erhitzer
bouilloire
hervidor

Now Locate a Concept in the MKS
38
Morphological
analysis
Expand paradigm through
standard synonyms
Locate
concept
in MKS
heiss
heiß
Wasser
H20
Boiler
Kocher
Erhitzer
bouilloire
hervidor
Heißwasserkocher
bouilloire
hervidor

Realize your Domain Specific Synonyms
39
Morphological
analysis
standard synonyms
Locate concept
in MKS
Realize
weighted
domain
synonyms
Heißweisserkocher
HWK
bouilloire
théière
hervidor
Synonyms are
weighted, i.e. carry
attributes to help
disambiguating and
improve ranking

Consider then the Related Concepts
40
Morphological
analysis
standard synonyms
Locate concept
in MKS
Realize weighted
domain synonyms
Semantic
expansion
through
concept map
Samowar
“Caykolik Samowar”

Now Match the Item in your Warehouse DB
41
Caykolik
Samowar
Successful
identification of item
in target database
Caykolik 1,5 l Samowar

Language Independent Semantic Search - Summary
From Heisswasserkocher to Caykolik 1,5l Samowar
42
Start in any
language
Heisswasserkocher
bouilloires
hervidores
Morphological
analysis
standard synonyms
Locate concept
in MKS
Realize weighted
domain synonyms
Semantic expansion
through concept map
Caykolik 1,5 l Samowar
Successful
identification of item
in target database

MKS – Indispensable for Processing
Multilingual Data
Insights & Sense & Sentiment
Language Detection
NLP/Tokenization
ML
TextAnalytics
Search
MT
Provenance
Multilingual
Knowledge
System

Benefits: Enable the Digital Single Market
 Find items
 with any word
 in any spelling
 in any language
 Find even related relevant items
through concept map
(“Did you mean …?”)
 Have more first-time purchasers
 Increase international business
 Increase e-sales
 Happy audience

Enterprise
Search
Social Media
Analysis
Document
Classification
Inter-
operability
Staff Training
Globalisation
Multilingual Knowledge System Plays
Key Role in many Business Processes

Coreon GmbH
MKS is the Company’s Core Focus
• Spin-off from ESTeam
(established 1995)
• Initiated through market and
technology research in
context of EU FP7 project LISE
Since 2012
• Strong entrepreneurship
community
• Europe’s
“Language Valley”
Headquarter in Berlin
48
Jochen Hummel, CEO
• founder of TRADOS
• ESTeam CEO, Chair of
LTInnovate
Michael Wetzel, MD
• TRADOS/SDL MultiTerm (1997-
2011)
• Contributor to TMX, TBX, OLIF
Gudrun Magnusdottir,
CSO
• ESTeam CSO
Lambros Kranias, CTO
• ESTeam CTO
• 20+ years NLP
Key Staff

Multilingual Knowledge Systems
A fusion of terminology with taxonomy / thesaurus,
to capture language with knowledge in a holistic way
Most systematic and visual approach to control
large terminology collections
Huge value in various business processes, industries
and segments
49

Michael Wetzel
m michael@coreon.com
s mlwetzel
t @wetzelmichael
l Berlin-Mitte
Discover it now:
https://app.coreon.com
50

Multilingual Knowledge Systems: Knowledge Meets Language

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Andere mochten auch

Andere mochten auch (12)

Ähnlich wie Multilingual Knowledge Systems: Knowledge Meets Language

Ähnlich wie Multilingual Knowledge Systems: Knowledge Meets Language (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

Multilingual Knowledge Systems: Knowledge Meets Language