SlideShare ist ein Scribd-Unternehmen logo
1 von 24
Downloaden Sie, um offline zu lesen
CONTENT WRITING
OPTIMIZATION WITH REWRITER
Anabela Barreiro
ab@metatrad.com
Translating and the Computer Conference 2010
Anabela Barreiro London, 18-19 November 2010
OUTLINE
 LINGUISTIC QUALITY ASSURANCE
 HOW TO ACHIEVE WRITING OPTIMIZATION
 REWRITER
 PARAPHRASES COVERED BY REWRITER
 REWRITER V0.1 AND V0.2 – INTERFACE AND MODUS OPERANDI
 LINGUISTIC RESOURCES USED BY REWRITER
 EVALUATION RESULTS
 TRANSFORMATIONS FOR THE NEAR FUTURE
 WHO COULD BENEFIT FROM REWRITER?
 FROM REWRITER TO MACHINE TRANSLATION
 IMPROVEMENT OF REWRITER
Translating and the Computer Conference 2010
Anabela Barreiro London, 18-19 November 2010
LINGUISTIC QUALITY ASSURANCE
Translating and the Computer Conference 2010
Anabela Barreiro London, 18-19 November 2010
 Reassures that a certain level of linguistic quality is guaranteed in texts
 Uses techniques to verify the quality of specialized documentation
 Helps individuals/businesses connect with their target audience in a clear
and understandable way by achieving:
• strategic, high quality, meaningful content
• relevant content written and optimized specifically for a particular
purpose (or for a particular business)
• custom content (relevant keywords and adequate terminologies)
• original texts (creative writing) or domain specific texts (technical
writing)
• readable / publishable content
LINGUISTIC QUALITY ASSURANCE
Translating and the Computer Conference 2010
Anabela Barreiro London, 18-19 November 2010
 Professional text writing and revision
• Orthographic, grammatical, stylistic and terminological verification of
the technical documents
• Use of tools
 Spell and grammar checkers
 Writing/authoring aids
 Style guides
 Terminologies (technical domains)
 Controlled language
• Consistent, direct, and simple language
• Restricted grammar (avoid certain types of construction)
• Avoid complex reasoning, figures of speech, metaphors, etc.
• Elimination of wordiness
HOW TO ACHIEVE WRITING
OPTIMIZATION
Translating and the Computer Conference 2010
Anabela Barreiro London, 18-19 November 2010
 Synonymy
 Stylistics
 PARAPHRASING
• effective in helping writers with writing difficulties or learners of a non-
native language (pedagogical exercise)
• essential component in the translation process and of an extreme value
to machine translation pre-editing
• can be employed in linguistic quality assurance for both source and
target texts
For the past few years, researchers have been trying to achieve
automated paraphrasing to respond to the commercial enterprises’ wish
to include paraphrases in their text processing tools, authoring
aids, learning tools, etc.
REWRITER – PARAPHRASING TOOL
 authoring aid (word processing applications)
 Language composition tool
 Text production and style editor
 Empirical testbed for linguistic quality assurance (source and target texts)
 text (pre-)editing (machine translation)
 “Revision memory” tool (≈ “translation memory”)
 Applicable to general and technical language
(e.g. student texts or legal texts)
Portuguese version “ReEscreve” - publicly available service at:
http://www.linguateca.pt/ReEscreve/
Soon to be integrated in a cyber school project – “Ciberescola”
Translating and the Computer Conference 2010
Anabela Barreiro London, 18-19 November 2010
PARAPHRASES COVERED BY REWRITER
 Synonyms in context (ex: phrasal verbs into equivalent expressions)
to clear up (weather) = (weather) to become better/brighter
 Support verb constructions into single verbs
to make a decision = to decide
make a presentation of = present
to give support to N(AN) = to support N(AN)
to go V-ing = to continue V-ing
to get into contact with = to contact
to turn on N(light) = to extinguish N(light)
to become acid = to acidify
 Support verb constructions into their stylistic variants
to make an audit = to perform an audit
to make an impression = to create an impression
 Aspectual constructions into single verbs
to launch an attack = to attack
Translating and the Computer Conference 2010
Anabela Barreiro London, 18-19 November 2010
 Adverbials (compounds into single adverbs)
in a constructive way = constructively
on purpose > purposely = deliberately
 Relatives into participial adjectives
the president that was elected = the president elect
 Relatives into possessives
the role that Europe plays/has = the role of Europe
the position that the Church defends = the position of the Church
 Relatives into compound nouns (and vice-versa)
a container for the milk = a milk container
a bottle made of plastic = a plastic bottle
 Agentive passives into actives
the young man is released by the police officer = the police officer releases
the young man
Translating and the Computer Conference 2010
Anabela Barreiro London, 18-19 November 2010
PARAPHRASES COVERED BY REWRITER
REWRITER (V0.1)
INTERFACE FOR THE PUBLIC SERVICE
Interactive ReWriter
for word processing applications,
such as text editing
Translating and the Computer Conference 2010
Anabela Barreiro London, 18-19 November 2010
REWRITER (V0.1)
SUGGESTIONS FOR EXAMPLE SENTENCES
Suggestions for general language
linguistic phenomena
Compound adverbs >
single adverbs
Support verb constructions >
single verbs
Relatives >
participial adjectives
Translating and the Computer Conference 2010
Anabela Barreiro London, 18-19 November 2010
REWRITER (V0.1)
USER’S CAPABILITY TO ADD NEW
REWRITING OPTIONS
The user can suggest new words or
expressions (synonyms or paraphrases)
Translating and the Computer Conference 2010
Anabela Barreiro London, 18-19 November 2010
REWRITER (V0.2)
COMMERCIAL INTERFACE - PROTOTYPE
Users can select among general and technical dictionaries (more than one
selection allowed), grammars for specific linguistic transformations (one, several
or all grammars can be selected). The interface provides sample texts for testing.
Sample LEGAL text
Informative details about the
linguistic resources selected
Translating and the Computer Conference 2010
Anabela Barreiro London, 18-19 November 2010
REWRITER (V0.2)
COMMERCIAL INTERFACE - PROTOTYPE
Identification of legal terms in the text
Suggestions for the term “breach of law”
Users can select one term on the list of suggestions or provide a new suggestion
Translating and the Computer Conference 2010
Anabela Barreiro London, 18-19 November 2010
REWRITER (V0.2)
COMMERCIAL INTERFACE - PROTOTYPE
Text rewritten
• In red, the expressions in the source text
• In green, suggestions provided by ReWriter and selected by the user
It is possible to go back and change the
user option as many times as necessary
Translating and the Computer Conference 2010
Anabela Barreiro London, 18-19 November 2010
LINGUISTIC RESOURCES USED BY REWRITER
 Eng4NooJ – linguistic knowledge database
• OpenLogos dictionary (http://logos-os.dfki.de/) – commercial version
belongs to GROUP Business Software, Germany
• converted into NooJ format, and enhanced with new properties, including
derivational and morpho-syntactic and semantic relations
 Allows linguistic annotation and processing of corpora
 Instrument for empirical testbed to support theoretical linguistics
research
 Basis for language technology applications, including machine
translation between several languages
 Sample of Dictionary of Legal Terms
Translating and the Computer Conference 2010
Anabela Barreiro London, 18-19 November 2010
Sample of terms classified
as Information +
Instructional/legal
Translating and the Computer Conference 2010
Anabela Barreiro London, 18-19 November 2010
LINGUISTIC RESOURCES USED BY REWRITER
Translating and the Computer Conference 2010
Anabela Barreiro London, 18-19 November 2010
NDRV04 = <B>ion/Npred+Nom
ADRV02 = <B>icable
AVDRV01 = <E>ly/ADV
AVDRV04 = <B>tically/ADV
impress,V+FLX=POLISH+SAL=PVPCpleasetype+PT=impressionar+DRV=NDRV01:BOOK+
VSUP=make+VSUP=cause+NPREP=on
aesthetic,AFLX=NATURAL+SAL=AVstate+PT=aesthetically+DRV=AVDRV03
skepticism,N+FLX=BOOK+SAL=ABcause+PT=cepticismo+DRV=NAVDRV02
Grammar to recognize adverbial compounds and
transform them into equivalent single adverbs
Rules to transform
morpho-syntactically
and semantically
related words of
different parts of
speech
General language dictionary entries
LINGUISTIC RESOURCES USED BY REWRITER
Morpho-syntactic
and semantic
relations
EVALUATION RESULTS: PARAPHRASING
PRECISION
Translating and the Computer Conference 2010
Anabela Barreiro London, 18-19 November 2010
SVC Recognition
Precision
SVC Recognition
Recall
SVC Paraphrasing
Precision
Pôr 73/73 - 100% 73/100 – 73% 72/73 - 98.6%
Tomar 75/75 - 100% 75/100 – 75% 68/73 - 93.1%
Ter 65/65 - 100% 65/100 – 65% 59/65 - 90.7%
Dar 57/60 - 95% 57/100 – 57% 46/51 - 90.1%
Fazer 43/45 – 95.5% 43/100 – 43% 40/45 - 88.8%
Average 62.6/63.6 - 98.4% 62.6/100 - 62.6% 57/61 - 93.4%
Evaluation of recognition and paraphrasing
of support verb constructions
Corpus of fiction: 500 sentences
100 for each of 5 elementary support verbs
EVALUATION RESULTS: IMPACT ON
TRANSLATABILITY (MT)
Translating and the Computer Conference 2010
Anabela Barreiro London, 18-19 November 2010
Same corpus, 50 sentences selected randomly
(i) automated pre-processing of support verb constructions with ReWriter and
conversion into equivalent single verbs
(ii) pre-processed sentences (automatically generated paraphrases) and original text
are submitted to MT and the output translations for both original and pre-processed
sentences were compared
• 29 (58%) of the best translations were of automatically generated paraphrases
• 9 (18%) were of support verb constructions
• 12 (24%) were equally bad or equally good
CONCLUSION
The experiment indicates that paraphrases such as those generated by ReWriter
help improve translation scores
• The automated paraphrasing of support verb constructions through ReWriter
allowed a significant improvement of the quality of the MT results in that context
TRANSFORMATIONS FOR THE NEAR FUTURE
[Popular versus technical terms]
around the orbit of the eye ≡ periorbital
[If clauses]
if it is necessary ≡ if necessary
[Passives into actives - whenever suitable]
That book was written by Saramago in 2008 > Saramago wrote that book in 2008
Florida was hit by a tornado > A tornado hit Florida
[Coordinated noun phrases - conjoining or disjoining]
linguistic resources for teaching and for research > linguistic resources for teaching and research
[Subjunctive clauses - into infinitives]
we ask the favor that you confirm your attendance > we ask the favor to confirm your attendance
[Marked-up constructions]
if the end-user need is to create controlled language text > if the end-user needs to create
controlled language text
[Vague and undefined or null subject sentences] (whenever the real subject/actor is known)
[-] there was shouting in the street > [N-PRON]/someone shouted in the street
Translating and the Computer Conference 2010
Anabela Barreiro London, 18-19 November 2010
WHO COULD BENEFIT FROM REWRITER?
 Writers in general (searching for synonyms and paraphrases)
 Technical writers (searching for the “exact” term)
 Editors
 MT pre-editors
 Translators
 Learners of a second language
 Students learning language and writing skills
Translating and the Computer Conference 2010
Anabela Barreiro London, 18-19 November 2010
$EN
FROM REWRITER TO MACHINE
TRANSLATION
Translating and the Computer Conference 2010
Anabela Barreiro London, 18-19 November 2010
a fazer um estágio para dar aulas de / tutor Religião
a fazer um estágio para dar aulas de / lecture Religião
a fazer um estágio para dar aulas de / teach Religião
começa a dar exemplos / exemplify :
sentia-se capaz de dar um murro em / punch quem quisesse detê-lo
gostávamos de lhe dar uma palavrinha / speak .
IMPROVEMENT OF REWRITER
 Writing (pedagogical) exercises – students learning how to improve
their writing skills in a native or foreign language
 Professional writers and translators using (and testing) the
tool, marking [informal], [idiomatic], [slang] and other uses of the
terminology
 Detection of errors (words that are not synonyms, or not in a
particular context)
 Define linguistic rules to improve precision in specific contexts (e.g.:
[bring(vt)) N(charge; action) > present(vt) N(idem)]
 Include “revision memories” (recycling validated reviewed
sentences, structures or phrases)
Translating and the Computer Conference 2010
Anabela Barreiro London, 18-19 November 2010
Translating and the Computer Conference 2010
Anabela Barreiro London, 18-19 November 2010
To learn more
on
paraphrases…
Soon to be
released!Anabela Barreiro
ab@metatrad.com

Weitere ähnliche Inhalte

Andere mochten auch

Tarea mapa luz dary paredes infante
Tarea mapa luz dary paredes infanteTarea mapa luz dary paredes infante
Tarea mapa luz dary paredes infanteDary_13
 
Polinesia 120720150458-phpapp02
Polinesia 120720150458-phpapp02Polinesia 120720150458-phpapp02
Polinesia 120720150458-phpapp02belenfig
 
Emotional Health from a biblical and CBT perspective.
Emotional Health from a biblical and CBT perspective.Emotional Health from a biblical and CBT perspective.
Emotional Health from a biblical and CBT perspective.Joel Young
 

Andere mochten auch (6)

When Multiwords Go Bad in Machine Translation
When Multiwords Go Bad in Machine TranslationWhen Multiwords Go Bad in Machine Translation
When Multiwords Go Bad in Machine Translation
 
Chemistry(g17)2
Chemistry(g17)2Chemistry(g17)2
Chemistry(g17)2
 
Tarea mapa luz dary paredes infante
Tarea mapa luz dary paredes infanteTarea mapa luz dary paredes infante
Tarea mapa luz dary paredes infante
 
Polinesia 120720150458-phpapp02
Polinesia 120720150458-phpapp02Polinesia 120720150458-phpapp02
Polinesia 120720150458-phpapp02
 
Como Elegir Carrera
Como  Elegir CarreraComo  Elegir Carrera
Como Elegir Carrera
 
Emotional Health from a biblical and CBT perspective.
Emotional Health from a biblical and CBT perspective.Emotional Health from a biblical and CBT perspective.
Emotional Health from a biblical and CBT perspective.
 

Ähnlich wie Content Writing Optimization with ReWriter

12. Gloria Corpas, Jorge Leiva, Miriam Seghiri (UMA) Human Translation & Tran...
12. Gloria Corpas, Jorge Leiva, Miriam Seghiri (UMA) Human Translation & Tran...12. Gloria Corpas, Jorge Leiva, Miriam Seghiri (UMA) Human Translation & Tran...
12. Gloria Corpas, Jorge Leiva, Miriam Seghiri (UMA) Human Translation & Tran...RIILP
 
IMPACT Final Conference - Hildelies Balk-Pennington de Jongh
IMPACT Final Conference - Hildelies Balk-Pennington de JonghIMPACT Final Conference - Hildelies Balk-Pennington de Jongh
IMPACT Final Conference - Hildelies Balk-Pennington de JonghIMPACT Centre of Competence
 
Effect of Machine Translation in Interlingual Conversation: Lessons from a Fo...
Effect of Machine Translation in Interlingual Conversation: Lessons from a Fo...Effect of Machine Translation in Interlingual Conversation: Lessons from a Fo...
Effect of Machine Translation in Interlingual Conversation: Lessons from a Fo...Kotaro Hara
 
Terminology: tips and tricks to boost your terminology work
Terminology: tips and tricks to boost your terminology workTerminology: tips and tricks to boost your terminology work
Terminology: tips and tricks to boost your terminology workLaura Ramirez Polo
 
07-Effect-Of-Machine-Translation-In-Interlingual-Conversation.pdf
07-Effect-Of-Machine-Translation-In-Interlingual-Conversation.pdf07-Effect-Of-Machine-Translation-In-Interlingual-Conversation.pdf
07-Effect-Of-Machine-Translation-In-Interlingual-Conversation.pdfsimonp16
 
Fhbib Chronology2
Fhbib Chronology2Fhbib Chronology2
Fhbib Chronology2translit
 
LRC XIII Localisation Conference - Using community feedback to improve social...
LRC XIII Localisation Conference - Using community feedback to improve social...LRC XIII Localisation Conference - Using community feedback to improve social...
LRC XIII Localisation Conference - Using community feedback to improve social...sarni
 
MOLTO Annual Report 2011
MOLTO Annual Report 2011MOLTO Annual Report 2011
MOLTO Annual Report 2011Olga Caprotti
 
A Corpus-based Study on the Effectiveness of Subtitling from English into Sin...
A Corpus-based Study on the Effectiveness of Subtitling from English into Sin...A Corpus-based Study on the Effectiveness of Subtitling from English into Sin...
A Corpus-based Study on the Effectiveness of Subtitling from English into Sin...AJHSSR Journal
 
IRJET- Text to Speech Synthesis for Hindi Language using Festival Framework
IRJET- Text to Speech Synthesis for Hindi Language using Festival FrameworkIRJET- Text to Speech Synthesis for Hindi Language using Festival Framework
IRJET- Text to Speech Synthesis for Hindi Language using Festival FrameworkIRJET Journal
 
Direct Punjabi to English Speech Translation using Discrete Units
Direct Punjabi to English Speech Translation using Discrete UnitsDirect Punjabi to English Speech Translation using Discrete Units
Direct Punjabi to English Speech Translation using Discrete UnitsIJCI JOURNAL
 
Iterative usability evaluation of DSLs
Iterative usability evaluation of DSLsIterative usability evaluation of DSLs
Iterative usability evaluation of DSLsAnkica Barisic
 
Translation as a professional activity
Translation as a professional activityTranslation as a professional activity
Translation as a professional activityChelo Vargas
 
Working without Words: The Methods of Translating Open Access Technological E...
Working without Words: The Methods of Translating Open Access Technological E...Working without Words: The Methods of Translating Open Access Technological E...
Working without Words: The Methods of Translating Open Access Technological E...Ekrema Shehab
 

Ähnlich wie Content Writing Optimization with ReWriter (20)

ReEscreve: A Translator-Friendly Multi-Purpose Paraphrasing Software Tool
ReEscreve: A Translator-Friendly Multi-Purpose Paraphrasing Software ToolReEscreve: A Translator-Friendly Multi-Purpose Paraphrasing Software Tool
ReEscreve: A Translator-Friendly Multi-Purpose Paraphrasing Software Tool
 
12. Gloria Corpas, Jorge Leiva, Miriam Seghiri (UMA) Human Translation & Tran...
12. Gloria Corpas, Jorge Leiva, Miriam Seghiri (UMA) Human Translation & Tran...12. Gloria Corpas, Jorge Leiva, Miriam Seghiri (UMA) Human Translation & Tran...
12. Gloria Corpas, Jorge Leiva, Miriam Seghiri (UMA) Human Translation & Tran...
 
IMPACT Final Conference - Hildelies Balk-Pennington de Jongh
IMPACT Final Conference - Hildelies Balk-Pennington de JonghIMPACT Final Conference - Hildelies Balk-Pennington de Jongh
IMPACT Final Conference - Hildelies Balk-Pennington de Jongh
 
Effect of Machine Translation in Interlingual Conversation: Lessons from a Fo...
Effect of Machine Translation in Interlingual Conversation: Lessons from a Fo...Effect of Machine Translation in Interlingual Conversation: Lessons from a Fo...
Effect of Machine Translation in Interlingual Conversation: Lessons from a Fo...
 
Terminology: tips and tricks to boost your terminology work
Terminology: tips and tricks to boost your terminology workTerminology: tips and tricks to boost your terminology work
Terminology: tips and tricks to boost your terminology work
 
An Application for Performing Real Time Speech Translation in Mobile Environment
An Application for Performing Real Time Speech Translation in Mobile EnvironmentAn Application for Performing Real Time Speech Translation in Mobile Environment
An Application for Performing Real Time Speech Translation in Mobile Environment
 
07-Effect-Of-Machine-Translation-In-Interlingual-Conversation.pdf
07-Effect-Of-Machine-Translation-In-Interlingual-Conversation.pdf07-Effect-Of-Machine-Translation-In-Interlingual-Conversation.pdf
07-Effect-Of-Machine-Translation-In-Interlingual-Conversation.pdf
 
Fhbib Chronology2
Fhbib Chronology2Fhbib Chronology2
Fhbib Chronology2
 
LRC XIII Localisation Conference - Using community feedback to improve social...
LRC XIII Localisation Conference - Using community feedback to improve social...LRC XIII Localisation Conference - Using community feedback to improve social...
LRC XIII Localisation Conference - Using community feedback to improve social...
 
Lemon at-mlw3
Lemon at-mlw3Lemon at-mlw3
Lemon at-mlw3
 
IMPACT Final Conference - NCSR - Wordspotting
IMPACT Final Conference - NCSR - WordspottingIMPACT Final Conference - NCSR - Wordspotting
IMPACT Final Conference - NCSR - Wordspotting
 
visH (fin).pptx
visH (fin).pptxvisH (fin).pptx
visH (fin).pptx
 
MOLTO Annual Report 2011
MOLTO Annual Report 2011MOLTO Annual Report 2011
MOLTO Annual Report 2011
 
A Corpus-based Study on the Effectiveness of Subtitling from English into Sin...
A Corpus-based Study on the Effectiveness of Subtitling from English into Sin...A Corpus-based Study on the Effectiveness of Subtitling from English into Sin...
A Corpus-based Study on the Effectiveness of Subtitling from English into Sin...
 
IRJET- Text to Speech Synthesis for Hindi Language using Festival Framework
IRJET- Text to Speech Synthesis for Hindi Language using Festival FrameworkIRJET- Text to Speech Synthesis for Hindi Language using Festival Framework
IRJET- Text to Speech Synthesis for Hindi Language using Festival Framework
 
Direct Punjabi to English Speech Translation using Discrete Units
Direct Punjabi to English Speech Translation using Discrete UnitsDirect Punjabi to English Speech Translation using Discrete Units
Direct Punjabi to English Speech Translation using Discrete Units
 
Iterative usability evaluation of DSLs
Iterative usability evaluation of DSLsIterative usability evaluation of DSLs
Iterative usability evaluation of DSLs
 
Translation as a professional activity
Translation as a professional activityTranslation as a professional activity
Translation as a professional activity
 
Lit mtap
Lit mtapLit mtap
Lit mtap
 
Working without Words: The Methods of Translating Open Access Technological E...
Working without Words: The Methods of Translating Open Access Technological E...Working without Words: The Methods of Translating Open Access Technological E...
Working without Words: The Methods of Translating Open Access Technological E...
 

Mehr von INESC-ID (Spoken Language Systems Laboratory - L2F)

Mehr von INESC-ID (Spoken Language Systems Laboratory - L2F) (20)

Multi3Generation@INGL2020
Multi3Generation@INGL2020Multi3Generation@INGL2020
Multi3Generation@INGL2020
 
NooJ 2020 presentation
NooJ 2020 presentationNooJ 2020 presentation
NooJ 2020 presentation
 
PROPOR2020_Barreiroetal
PROPOR2020_BarreiroetalPROPOR2020_Barreiroetal
PROPOR2020_Barreiroetal
 
Análise comparativa das edições portuguesa e brasileira de Os livros que dev...
Análise comparativa das edições portuguesa e brasileira de  Os livros que dev...Análise comparativa das edições portuguesa e brasileira de  Os livros que dev...
Análise comparativa das edições portuguesa e brasileira de Os livros que dev...
 
Welcome session 3rd Annual MC Meeting - enetCollect COST Action
Welcome session 3rd Annual MC Meeting - enetCollect COST ActionWelcome session 3rd Annual MC Meeting - enetCollect COST Action
Welcome session 3rd Annual MC Meeting - enetCollect COST Action
 
Syntactic-semantic analysis for information extraction in biomedicine
Syntactic-semantic analysis for information extraction in biomedicineSyntactic-semantic analysis for information extraction in biomedicine
Syntactic-semantic analysis for information extraction in biomedicine
 
Cross language semantic relations between English and Portuguese
Cross language semantic relations between English and PortugueseCross language semantic relations between English and Portuguese
Cross language semantic relations between English and Portuguese
 
Paraphrasing biomedical support verb constructions for machine translation
Paraphrasing biomedical support verb constructions for machine translationParaphrasing biomedical support verb constructions for machine translation
Paraphrasing biomedical support verb constructions for machine translation
 
ReWriter for legal text
ReWriter for legal textReWriter for legal text
ReWriter for legal text
 
Chatbots for Language Learning
Chatbots for Language LearningChatbots for Language Learning
Chatbots for Language Learning
 
eSPERTo’s Paraphrastic Knowledge Applied to Question-Answering and Summarization
eSPERTo’s Paraphrastic Knowledge Applied to Question-Answering and SummarizationeSPERTo’s Paraphrastic Knowledge Applied to Question-Answering and Summarization
eSPERTo’s Paraphrastic Knowledge Applied to Question-Answering and Summarization
 
Barreiro et al POP@PROPOR2018-informal2formal-language
Barreiro et al POP@PROPOR2018-informal2formal-languageBarreiro et al POP@PROPOR2018-informal2formal-language
Barreiro et al POP@PROPOR2018-informal2formal-language
 
Rebelo-Arnold et al POP@PROPOR2018-EP-BP-alignments
Rebelo-Arnold et al POP@PROPOR2018-EP-BP-alignmentsRebelo-Arnold et al POP@PROPOR2018-EP-BP-alignments
Rebelo-Arnold et al POP@PROPOR2018-EP-BP-alignments
 
Barreiro-Batista-LR4NLP@Coling2018-presentation
Barreiro-Batista-LR4NLP@Coling2018-presentationBarreiro-Batista-LR4NLP@Coling2018-presentation
Barreiro-Batista-LR4NLP@Coling2018-presentation
 
Barreiro-Mota-VarDial@Coling2018-poster
Barreiro-Mota-VarDial@Coling2018-posterBarreiro-Mota-VarDial@Coling2018-poster
Barreiro-Mota-VarDial@Coling2018-poster
 
NooJ-2018-Palermo
NooJ-2018-PalermoNooJ-2018-Palermo
NooJ-2018-Palermo
 
Poster @ enetCollect CA MC meeting in Iasi, Romania
Poster @ enetCollect CA MC meeting in Iasi, Romania Poster @ enetCollect CA MC meeting in Iasi, Romania
Poster @ enetCollect CA MC meeting in Iasi, Romania
 
projeto-eSPERTo
projeto-eSPERToprojeto-eSPERTo
projeto-eSPERTo
 
Poster l2f 2017
Poster l2f 2017Poster l2f 2017
Poster l2f 2017
 
Nooj2017 cmota-etal
Nooj2017 cmota-etalNooj2017 cmota-etal
Nooj2017 cmota-etal
 

Kürzlich hochgeladen

COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaborationbruanjhuli
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesMd Hossain Ali
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8DianaGray10
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemAsko Soukka
 
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationUsing IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationIES VE
 
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfIaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfDaniel Santiago Silva Capera
 
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...DianaGray10
 
Babel Compiler - Transforming JavaScript for All Browsers.pptx
Babel Compiler - Transforming JavaScript for All Browsers.pptxBabel Compiler - Transforming JavaScript for All Browsers.pptx
Babel Compiler - Transforming JavaScript for All Browsers.pptxYounusS2
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IES VE
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPathCommunity
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024SkyPlanner
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxMatsuo Lab
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1DianaGray10
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7DianaGray10
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAshyamraj55
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataSafe Software
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6DianaGray10
 
RAG Patterns and Vector Search in Generative AI
RAG Patterns and Vector Search in Generative AIRAG Patterns and Vector Search in Generative AI
RAG Patterns and Vector Search in Generative AIUdaiappa Ramachandran
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureEric D. Schabell
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024D Cloud Solutions
 

Kürzlich hochgeladen (20)

COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystem
 
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationUsing IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
 
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfIaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
 
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
 
Babel Compiler - Transforming JavaScript for All Browsers.pptx
Babel Compiler - Transforming JavaScript for All Browsers.pptxBabel Compiler - Transforming JavaScript for All Browsers.pptx
Babel Compiler - Transforming JavaScript for All Browsers.pptx
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation Developers
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptx
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6
 
RAG Patterns and Vector Search in Generative AI
RAG Patterns and Vector Search in Generative AIRAG Patterns and Vector Search in Generative AI
RAG Patterns and Vector Search in Generative AI
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability Adventure
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024
 

Content Writing Optimization with ReWriter

  • 1. CONTENT WRITING OPTIMIZATION WITH REWRITER Anabela Barreiro ab@metatrad.com Translating and the Computer Conference 2010 Anabela Barreiro London, 18-19 November 2010
  • 2. OUTLINE  LINGUISTIC QUALITY ASSURANCE  HOW TO ACHIEVE WRITING OPTIMIZATION  REWRITER  PARAPHRASES COVERED BY REWRITER  REWRITER V0.1 AND V0.2 – INTERFACE AND MODUS OPERANDI  LINGUISTIC RESOURCES USED BY REWRITER  EVALUATION RESULTS  TRANSFORMATIONS FOR THE NEAR FUTURE  WHO COULD BENEFIT FROM REWRITER?  FROM REWRITER TO MACHINE TRANSLATION  IMPROVEMENT OF REWRITER Translating and the Computer Conference 2010 Anabela Barreiro London, 18-19 November 2010
  • 3. LINGUISTIC QUALITY ASSURANCE Translating and the Computer Conference 2010 Anabela Barreiro London, 18-19 November 2010  Reassures that a certain level of linguistic quality is guaranteed in texts  Uses techniques to verify the quality of specialized documentation  Helps individuals/businesses connect with their target audience in a clear and understandable way by achieving: • strategic, high quality, meaningful content • relevant content written and optimized specifically for a particular purpose (or for a particular business) • custom content (relevant keywords and adequate terminologies) • original texts (creative writing) or domain specific texts (technical writing) • readable / publishable content
  • 4. LINGUISTIC QUALITY ASSURANCE Translating and the Computer Conference 2010 Anabela Barreiro London, 18-19 November 2010  Professional text writing and revision • Orthographic, grammatical, stylistic and terminological verification of the technical documents • Use of tools  Spell and grammar checkers  Writing/authoring aids  Style guides  Terminologies (technical domains)  Controlled language • Consistent, direct, and simple language • Restricted grammar (avoid certain types of construction) • Avoid complex reasoning, figures of speech, metaphors, etc. • Elimination of wordiness
  • 5. HOW TO ACHIEVE WRITING OPTIMIZATION Translating and the Computer Conference 2010 Anabela Barreiro London, 18-19 November 2010  Synonymy  Stylistics  PARAPHRASING • effective in helping writers with writing difficulties or learners of a non- native language (pedagogical exercise) • essential component in the translation process and of an extreme value to machine translation pre-editing • can be employed in linguistic quality assurance for both source and target texts For the past few years, researchers have been trying to achieve automated paraphrasing to respond to the commercial enterprises’ wish to include paraphrases in their text processing tools, authoring aids, learning tools, etc.
  • 6. REWRITER – PARAPHRASING TOOL  authoring aid (word processing applications)  Language composition tool  Text production and style editor  Empirical testbed for linguistic quality assurance (source and target texts)  text (pre-)editing (machine translation)  “Revision memory” tool (≈ “translation memory”)  Applicable to general and technical language (e.g. student texts or legal texts) Portuguese version “ReEscreve” - publicly available service at: http://www.linguateca.pt/ReEscreve/ Soon to be integrated in a cyber school project – “Ciberescola” Translating and the Computer Conference 2010 Anabela Barreiro London, 18-19 November 2010
  • 7. PARAPHRASES COVERED BY REWRITER  Synonyms in context (ex: phrasal verbs into equivalent expressions) to clear up (weather) = (weather) to become better/brighter  Support verb constructions into single verbs to make a decision = to decide make a presentation of = present to give support to N(AN) = to support N(AN) to go V-ing = to continue V-ing to get into contact with = to contact to turn on N(light) = to extinguish N(light) to become acid = to acidify  Support verb constructions into their stylistic variants to make an audit = to perform an audit to make an impression = to create an impression  Aspectual constructions into single verbs to launch an attack = to attack Translating and the Computer Conference 2010 Anabela Barreiro London, 18-19 November 2010
  • 8.  Adverbials (compounds into single adverbs) in a constructive way = constructively on purpose > purposely = deliberately  Relatives into participial adjectives the president that was elected = the president elect  Relatives into possessives the role that Europe plays/has = the role of Europe the position that the Church defends = the position of the Church  Relatives into compound nouns (and vice-versa) a container for the milk = a milk container a bottle made of plastic = a plastic bottle  Agentive passives into actives the young man is released by the police officer = the police officer releases the young man Translating and the Computer Conference 2010 Anabela Barreiro London, 18-19 November 2010 PARAPHRASES COVERED BY REWRITER
  • 9. REWRITER (V0.1) INTERFACE FOR THE PUBLIC SERVICE Interactive ReWriter for word processing applications, such as text editing Translating and the Computer Conference 2010 Anabela Barreiro London, 18-19 November 2010
  • 10. REWRITER (V0.1) SUGGESTIONS FOR EXAMPLE SENTENCES Suggestions for general language linguistic phenomena Compound adverbs > single adverbs Support verb constructions > single verbs Relatives > participial adjectives Translating and the Computer Conference 2010 Anabela Barreiro London, 18-19 November 2010
  • 11. REWRITER (V0.1) USER’S CAPABILITY TO ADD NEW REWRITING OPTIONS The user can suggest new words or expressions (synonyms or paraphrases) Translating and the Computer Conference 2010 Anabela Barreiro London, 18-19 November 2010
  • 12. REWRITER (V0.2) COMMERCIAL INTERFACE - PROTOTYPE Users can select among general and technical dictionaries (more than one selection allowed), grammars for specific linguistic transformations (one, several or all grammars can be selected). The interface provides sample texts for testing. Sample LEGAL text Informative details about the linguistic resources selected Translating and the Computer Conference 2010 Anabela Barreiro London, 18-19 November 2010
  • 13. REWRITER (V0.2) COMMERCIAL INTERFACE - PROTOTYPE Identification of legal terms in the text Suggestions for the term “breach of law” Users can select one term on the list of suggestions or provide a new suggestion Translating and the Computer Conference 2010 Anabela Barreiro London, 18-19 November 2010
  • 14. REWRITER (V0.2) COMMERCIAL INTERFACE - PROTOTYPE Text rewritten • In red, the expressions in the source text • In green, suggestions provided by ReWriter and selected by the user It is possible to go back and change the user option as many times as necessary Translating and the Computer Conference 2010 Anabela Barreiro London, 18-19 November 2010
  • 15. LINGUISTIC RESOURCES USED BY REWRITER  Eng4NooJ – linguistic knowledge database • OpenLogos dictionary (http://logos-os.dfki.de/) – commercial version belongs to GROUP Business Software, Germany • converted into NooJ format, and enhanced with new properties, including derivational and morpho-syntactic and semantic relations  Allows linguistic annotation and processing of corpora  Instrument for empirical testbed to support theoretical linguistics research  Basis for language technology applications, including machine translation between several languages  Sample of Dictionary of Legal Terms Translating and the Computer Conference 2010 Anabela Barreiro London, 18-19 November 2010
  • 16. Sample of terms classified as Information + Instructional/legal Translating and the Computer Conference 2010 Anabela Barreiro London, 18-19 November 2010 LINGUISTIC RESOURCES USED BY REWRITER
  • 17. Translating and the Computer Conference 2010 Anabela Barreiro London, 18-19 November 2010 NDRV04 = <B>ion/Npred+Nom ADRV02 = <B>icable AVDRV01 = <E>ly/ADV AVDRV04 = <B>tically/ADV impress,V+FLX=POLISH+SAL=PVPCpleasetype+PT=impressionar+DRV=NDRV01:BOOK+ VSUP=make+VSUP=cause+NPREP=on aesthetic,AFLX=NATURAL+SAL=AVstate+PT=aesthetically+DRV=AVDRV03 skepticism,N+FLX=BOOK+SAL=ABcause+PT=cepticismo+DRV=NAVDRV02 Grammar to recognize adverbial compounds and transform them into equivalent single adverbs Rules to transform morpho-syntactically and semantically related words of different parts of speech General language dictionary entries LINGUISTIC RESOURCES USED BY REWRITER Morpho-syntactic and semantic relations
  • 18. EVALUATION RESULTS: PARAPHRASING PRECISION Translating and the Computer Conference 2010 Anabela Barreiro London, 18-19 November 2010 SVC Recognition Precision SVC Recognition Recall SVC Paraphrasing Precision Pôr 73/73 - 100% 73/100 – 73% 72/73 - 98.6% Tomar 75/75 - 100% 75/100 – 75% 68/73 - 93.1% Ter 65/65 - 100% 65/100 – 65% 59/65 - 90.7% Dar 57/60 - 95% 57/100 – 57% 46/51 - 90.1% Fazer 43/45 – 95.5% 43/100 – 43% 40/45 - 88.8% Average 62.6/63.6 - 98.4% 62.6/100 - 62.6% 57/61 - 93.4% Evaluation of recognition and paraphrasing of support verb constructions Corpus of fiction: 500 sentences 100 for each of 5 elementary support verbs
  • 19. EVALUATION RESULTS: IMPACT ON TRANSLATABILITY (MT) Translating and the Computer Conference 2010 Anabela Barreiro London, 18-19 November 2010 Same corpus, 50 sentences selected randomly (i) automated pre-processing of support verb constructions with ReWriter and conversion into equivalent single verbs (ii) pre-processed sentences (automatically generated paraphrases) and original text are submitted to MT and the output translations for both original and pre-processed sentences were compared • 29 (58%) of the best translations were of automatically generated paraphrases • 9 (18%) were of support verb constructions • 12 (24%) were equally bad or equally good CONCLUSION The experiment indicates that paraphrases such as those generated by ReWriter help improve translation scores • The automated paraphrasing of support verb constructions through ReWriter allowed a significant improvement of the quality of the MT results in that context
  • 20. TRANSFORMATIONS FOR THE NEAR FUTURE [Popular versus technical terms] around the orbit of the eye ≡ periorbital [If clauses] if it is necessary ≡ if necessary [Passives into actives - whenever suitable] That book was written by Saramago in 2008 > Saramago wrote that book in 2008 Florida was hit by a tornado > A tornado hit Florida [Coordinated noun phrases - conjoining or disjoining] linguistic resources for teaching and for research > linguistic resources for teaching and research [Subjunctive clauses - into infinitives] we ask the favor that you confirm your attendance > we ask the favor to confirm your attendance [Marked-up constructions] if the end-user need is to create controlled language text > if the end-user needs to create controlled language text [Vague and undefined or null subject sentences] (whenever the real subject/actor is known) [-] there was shouting in the street > [N-PRON]/someone shouted in the street Translating and the Computer Conference 2010 Anabela Barreiro London, 18-19 November 2010
  • 21. WHO COULD BENEFIT FROM REWRITER?  Writers in general (searching for synonyms and paraphrases)  Technical writers (searching for the “exact” term)  Editors  MT pre-editors  Translators  Learners of a second language  Students learning language and writing skills Translating and the Computer Conference 2010 Anabela Barreiro London, 18-19 November 2010
  • 22. $EN FROM REWRITER TO MACHINE TRANSLATION Translating and the Computer Conference 2010 Anabela Barreiro London, 18-19 November 2010 a fazer um estágio para dar aulas de / tutor Religião a fazer um estágio para dar aulas de / lecture Religião a fazer um estágio para dar aulas de / teach Religião começa a dar exemplos / exemplify : sentia-se capaz de dar um murro em / punch quem quisesse detê-lo gostávamos de lhe dar uma palavrinha / speak .
  • 23. IMPROVEMENT OF REWRITER  Writing (pedagogical) exercises – students learning how to improve their writing skills in a native or foreign language  Professional writers and translators using (and testing) the tool, marking [informal], [idiomatic], [slang] and other uses of the terminology  Detection of errors (words that are not synonyms, or not in a particular context)  Define linguistic rules to improve precision in specific contexts (e.g.: [bring(vt)) N(charge; action) > present(vt) N(idem)]  Include “revision memories” (recycling validated reviewed sentences, structures or phrases) Translating and the Computer Conference 2010 Anabela Barreiro London, 18-19 November 2010
  • 24. Translating and the Computer Conference 2010 Anabela Barreiro London, 18-19 November 2010 To learn more on paraphrases… Soon to be released!Anabela Barreiro ab@metatrad.com

Hinweis der Redaktion

  1. Good afternoon! I’am Anabela Barreiro and I’m presenting ReWriter, a paraphrasing tool designed to help with content writing optimization.
  2. The system includes several dictionaries. The structure of the dictionary is XXX