SlideShare ist ein Scribd-Unternehmen logo
1 von 13
Measuring Translation
TAUS Roundtable
Barcelona
May 12, 2016
Why measure?
 To know something unknown.
 To learn what to measure.
 To reduce uncertainty and the risk of wasting
money.
Measuring Translation
1
Basic questions
 What decision a measurement is supposed to
support?
 What is the definition of the thing being
measured?
 How does this thing matter to the decision?
 What is the current level of uncertainty?
 What is the value of additional information?
Measuring Translation
2
Measurement
categories
(scales)
 Nominal
 Excluding statements; no ordering among responses
 Translation
 Ordinal
 To say whether one value is more than another, but not
by how much
 Hotel ratings
 Interval
 Homogeneous units to express a numerical difference
between two values
 Temperatures
 Ratio
 Interval scale with a zero position indicating absence
 Kelvin scale
Measuring Translation
3
Baselines,
thresholds and
benchmarks
 Baselines
 The starting point for comparison
 Hotel rating  Pricing
 Thresholds
 The value for something to come into effect
 Acceptance Quality Levels
 Maximum tolerable number of deviations from a predetermined
level
 Benchmarks
 A performance average
 Alignment or outdoing
Measuring Translation
4
Areas for
measurement
Area Primary measure Related measure
Sales Price Cost of service
Operations Cost of service Customer satisfaction
Procurement Vendor rating Payments
Human resources Resource development Vendor rating
Quality Quality index Vendor rating
Production Productivity Vendor capacity
Finance Cash flow Invoicing
Measuring Translation
5
Basic measures
Financial Operational Sales
• Revenues
• Cash flow
• Profits
• ROI
• Timely invoicing
• Labor cost
• Staff
• Number
• Empowerment
• Turnover
• Efficiency
• Complaints
• Projects closures
• Automation
• New customers
• Customer size
• Customer profitability
• Customer satisfaction
• Complaints
• Loyalty
Measuring Translation
6
Expected
measurements
Buyer
 Vendor reliability & capability
 Average Outgoing Quality
(AOQ)
 DIFOT (Delivery In-Full, On-
Time) rate
 OFCT (Order Fulfillment Cycle
Time)
 FPY (First Pass Yield)
 Rework percentage
Vendor
 Specs & requirements
 Sampling lot size
 Acceptance Quality Level
(AQL)
 Source content profiling
 Source content ranking
 Translatability score
Measuring Translation
7
Translation
data
 Most requested domains
 What about profitable domains?
 Most requested language pairs
 What about revenues per language pairs?
 High volume customers
 What about most profitable customers?
 Translation time
 What about productivity per vendor?
 Numbers of jobs per linguist
 What about deadline, volume and compensation?
Measuring Translation
8
How is content
measurable?
 Modular
 Reusable
 Standard
 Unambiguous
 Simple
 Translatable
Measuring Translation
9
Predictive
quality
 Profiling
 Weighted quality score
 Comparison with reference corpus
 Translatability score
 Vendor rating
 Common business intelligence criteria
 Performance data
Measuring Translation
10
What gets
measured gets
managed
Measuring Translation
11
Gràcies
Measuring Translation
12

Weitere ähnliche Inhalte

Andere mochten auch (9)

S W H
S W HS W H
S W H
 
Translatability and untranslatability
Translatability and untranslatabilityTranslatability and untranslatability
Translatability and untranslatability
 
Linguistics relativity
Linguistics relativityLinguistics relativity
Linguistics relativity
 
Linguistic relativity
Linguistic relativityLinguistic relativity
Linguistic relativity
 
Sapir-Whorf Hypothesis
Sapir-Whorf HypothesisSapir-Whorf Hypothesis
Sapir-Whorf Hypothesis
 
Sapir Whorf hypothesis
Sapir Whorf hypothesisSapir Whorf hypothesis
Sapir Whorf hypothesis
 
Untranslatability in translation
Untranslatability in translation Untranslatability in translation
Untranslatability in translation
 
Methods Of Translation
Methods Of TranslationMethods Of Translation
Methods Of Translation
 
Translation Types
Translation TypesTranslation Types
Translation Types
 

Ähnlich wie Measuring Translation, Luigi Muzii, sQuid

Module 16 - The Role of Data Systems and Tools in Internal and External Analy...
Module 16 - The Role of Data Systems and Tools in Internal and External Analy...Module 16 - The Role of Data Systems and Tools in Internal and External Analy...
Module 16 - The Role of Data Systems and Tools in Internal and External Analy...
caniceconsulting
 
Bldg accnt relation
Bldg accnt relationBldg accnt relation
Bldg accnt relation
amitgurus
 
Bobhayestcebigdatawebinar03272013 130417142258-phpapp01
Bobhayestcebigdatawebinar03272013 130417142258-phpapp01Bobhayestcebigdatawebinar03272013 130417142258-phpapp01
Bobhayestcebigdatawebinar03272013 130417142258-phpapp01
TCELab LLC
 
Translation quality measurement2
Translation quality measurement2Translation quality measurement2
Translation quality measurement2
patigalin
 
Translation quality measurement2
Translation quality measurement2Translation quality measurement2
Translation quality measurement2
patigalin
 

Ähnlich wie Measuring Translation, Luigi Muzii, sQuid (20)

Measuring for success: Goals, performances, and outcomes
Measuring for success: Goals, performances, and outcomesMeasuring for success: Goals, performances, and outcomes
Measuring for success: Goals, performances, and outcomes
 
Application of Decision Sciences to Solve Business Problems in the Consumer P...
Application of Decision Sciences to Solve Business Problems in the Consumer P...Application of Decision Sciences to Solve Business Problems in the Consumer P...
Application of Decision Sciences to Solve Business Problems in the Consumer P...
 
Quality Assessment and Economic Sustainability of Translation
Quality Assessment and Economic Sustainability of TranslationQuality Assessment and Economic Sustainability of Translation
Quality Assessment and Economic Sustainability of Translation
 
A data driven approach to translation outcomes
A data driven approach to translation outcomesA data driven approach to translation outcomes
A data driven approach to translation outcomes
 
KPIs and Capability Statements
KPIs and Capability StatementsKPIs and Capability Statements
KPIs and Capability Statements
 
Quality 1 40
Quality 1 40Quality 1 40
Quality 1 40
 
Effective Specification Writing
Effective Specification WritingEffective Specification Writing
Effective Specification Writing
 
Localization Metrics and KPIs
Localization Metrics and KPIsLocalization Metrics and KPIs
Localization Metrics and KPIs
 
ATC 2015
ATC 2015ATC 2015
ATC 2015
 
Module 16 - The Role of Data Systems and Tools in Internal and External Analy...
Module 16 - The Role of Data Systems and Tools in Internal and External Analy...Module 16 - The Role of Data Systems and Tools in Internal and External Analy...
Module 16 - The Role of Data Systems and Tools in Internal and External Analy...
 
Popovich-ProdOpsMgt.ppt
Popovich-ProdOpsMgt.pptPopovich-ProdOpsMgt.ppt
Popovich-ProdOpsMgt.ppt
 
Bldg accnt relation
Bldg accnt relationBldg accnt relation
Bldg accnt relation
 
Six Sigma
Six SigmaSix Sigma
Six Sigma
 
LavaCon 2015: Efficient Translation Management - 5 Specific Metrics That Wil...
LavaCon 2015:  Efficient Translation Management - 5 Specific Metrics That Wil...LavaCon 2015:  Efficient Translation Management - 5 Specific Metrics That Wil...
LavaCon 2015: Efficient Translation Management - 5 Specific Metrics That Wil...
 
Bobhayestcebigdatawebinar03272013 130417142258-phpapp01
Bobhayestcebigdatawebinar03272013 130417142258-phpapp01Bobhayestcebigdatawebinar03272013 130417142258-phpapp01
Bobhayestcebigdatawebinar03272013 130417142258-phpapp01
 
Translation quality measurement2
Translation quality measurement2Translation quality measurement2
Translation quality measurement2
 
Translation quality measurement2
Translation quality measurement2Translation quality measurement2
Translation quality measurement2
 
Agile Metrics, Value, and Softwre
Agile Metrics, Value, and SoftwreAgile Metrics, Value, and Softwre
Agile Metrics, Value, and Softwre
 
A Robust approach to analysis of Customer Satisfaction Survey feedback
A  Robust approach to analysis of Customer Satisfaction Survey feedbackA  Robust approach to analysis of Customer Satisfaction Survey feedback
A Robust approach to analysis of Customer Satisfaction Survey feedback
 
Strategic Planning And Budgeting Part 2: Alignment, Budgeting, and Resources
Strategic Planning And Budgeting Part 2: Alignment, Budgeting, and ResourcesStrategic Planning And Budgeting Part 2: Alignment, Budgeting, and Resources
Strategic Planning And Budgeting Part 2: Alignment, Budgeting, and Resources
 

Mehr von TAUS - The Language Data Network

Mehr von TAUS - The Language Data Network (20)

TAUS Global Content Summit Amsterdam 2019 / Beyond MT. A few premature reflec...
TAUS Global Content Summit Amsterdam 2019 / Beyond MT. A few premature reflec...TAUS Global Content Summit Amsterdam 2019 / Beyond MT. A few premature reflec...
TAUS Global Content Summit Amsterdam 2019 / Beyond MT. A few premature reflec...
 
TAUS Global Content Summit Amsterdam 2019 / Measure with DQF, Dace Dzeguze (T...
TAUS Global Content Summit Amsterdam 2019 / Measure with DQF, Dace Dzeguze (T...TAUS Global Content Summit Amsterdam 2019 / Measure with DQF, Dace Dzeguze (T...
TAUS Global Content Summit Amsterdam 2019 / Measure with DQF, Dace Dzeguze (T...
 
TAUS Global Content Summit Amsterdam 2019 / Automatic for the People by Domin...
TAUS Global Content Summit Amsterdam 2019 / Automatic for the People by Domin...TAUS Global Content Summit Amsterdam 2019 / Automatic for the People by Domin...
TAUS Global Content Summit Amsterdam 2019 / Automatic for the People by Domin...
 
TAUS Global Content Summit Amsterdam 2019 / The Quantum Leap: Human Parity, C...
TAUS Global Content Summit Amsterdam 2019 / The Quantum Leap: Human Parity, C...TAUS Global Content Summit Amsterdam 2019 / The Quantum Leap: Human Parity, C...
TAUS Global Content Summit Amsterdam 2019 / The Quantum Leap: Human Parity, C...
 
TAUS Global Content Summit Amsterdam 2019 / Growing Business by Connecting Co...
TAUS Global Content Summit Amsterdam 2019 / Growing Business by Connecting Co...TAUS Global Content Summit Amsterdam 2019 / Growing Business by Connecting Co...
TAUS Global Content Summit Amsterdam 2019 / Growing Business by Connecting Co...
 
Achieving Translation Efficiency and Accuracy for Video Content, Xiao Yuan (P...
Achieving Translation Efficiency and Accuracy for Video Content, Xiao Yuan (P...Achieving Translation Efficiency and Accuracy for Video Content, Xiao Yuan (P...
Achieving Translation Efficiency and Accuracy for Video Content, Xiao Yuan (P...
 
Introduction Innovation Contest Shenzhen by Henri Broekmate (Lionbridge)
Introduction Innovation Contest Shenzhen by Henri Broekmate (Lionbridge)Introduction Innovation Contest Shenzhen by Henri Broekmate (Lionbridge)
Introduction Innovation Contest Shenzhen by Henri Broekmate (Lionbridge)
 
Game Changer for Linguistic Review: Shifting the Paradigm, Klaus Fleischmann...
 Game Changer for Linguistic Review: Shifting the Paradigm, Klaus Fleischmann... Game Changer for Linguistic Review: Shifting the Paradigm, Klaus Fleischmann...
Game Changer for Linguistic Review: Shifting the Paradigm, Klaus Fleischmann...
 
A translation memory P2P trading platform - to make global translation memory...
A translation memory P2P trading platform - to make global translation memory...A translation memory P2P trading platform - to make global translation memory...
A translation memory P2P trading platform - to make global translation memory...
 
Shiyibao — The Most Efficient Translation Feedback System Ever, Guanqing Hao ...
Shiyibao — The Most Efficient Translation Feedback System Ever, Guanqing Hao ...Shiyibao — The Most Efficient Translation Feedback System Ever, Guanqing Hao ...
Shiyibao — The Most Efficient Translation Feedback System Ever, Guanqing Hao ...
 
Stepes – Instant Human Translation Services for the Digital World, Carl Yao (...
Stepes – Instant Human Translation Services for the Digital World, Carl Yao (...Stepes – Instant Human Translation Services for the Digital World, Carl Yao (...
Stepes – Instant Human Translation Services for the Digital World, Carl Yao (...
 
Farmer Lv (TrueTran)
Farmer Lv (TrueTran)Farmer Lv (TrueTran)
Farmer Lv (TrueTran)
 
Smart Translation Resource Management: Semantic Matching, Kirk Zhang (Wiitran...
Smart Translation Resource Management: Semantic Matching, Kirk Zhang (Wiitran...Smart Translation Resource Management: Semantic Matching, Kirk Zhang (Wiitran...
Smart Translation Resource Management: Semantic Matching, Kirk Zhang (Wiitran...
 
The Theory and Practice of Computer Aided Translation Training System, Liu Q...
 The Theory and Practice of Computer Aided Translation Training System, Liu Q... The Theory and Practice of Computer Aided Translation Training System, Liu Q...
The Theory and Practice of Computer Aided Translation Training System, Liu Q...
 
Translation Technology Showcase in Shenzhen
Translation Technology Showcase in ShenzhenTranslation Technology Showcase in Shenzhen
Translation Technology Showcase in Shenzhen
 
How to efficiently use large-scale TMs in translation, Jing Zhang (Tmxmall)
How to efficiently use large-scale TMs in translation, Jing Zhang (Tmxmall)How to efficiently use large-scale TMs in translation, Jing Zhang (Tmxmall)
How to efficiently use large-scale TMs in translation, Jing Zhang (Tmxmall)
 
SDL Trados Studio 2017, Jocelyn He (SDL)
SDL Trados Studio 2017, Jocelyn He (SDL)SDL Trados Studio 2017, Jocelyn He (SDL)
SDL Trados Studio 2017, Jocelyn He (SDL)
 
How we train post-editors - Yongpeng Wei (Lingosail)
How we train post-editors - Yongpeng Wei (Lingosail)How we train post-editors - Yongpeng Wei (Lingosail)
How we train post-editors - Yongpeng Wei (Lingosail)
 
A use-case for getting MT into your company, Kerstin Berns (berns language c...
 A use-case for getting MT into your company, Kerstin Berns (berns language c... A use-case for getting MT into your company, Kerstin Berns (berns language c...
A use-case for getting MT into your company, Kerstin Berns (berns language c...
 
QE integrated in XTM, by Bob Willans (XTM)
QE integrated in XTM, by Bob Willans (XTM)QE integrated in XTM, by Bob Willans (XTM)
QE integrated in XTM, by Bob Willans (XTM)
 

Kürzlich hochgeladen

If this Giant Must Walk: A Manifesto for a New Nigeria
If this Giant Must Walk: A Manifesto for a New NigeriaIf this Giant Must Walk: A Manifesto for a New Nigeria
If this Giant Must Walk: A Manifesto for a New Nigeria
Kayode Fayemi
 
Uncommon Grace The Autobiography of Isaac Folorunso
Uncommon Grace The Autobiography of Isaac FolorunsoUncommon Grace The Autobiography of Isaac Folorunso
Uncommon Grace The Autobiography of Isaac Folorunso
Kayode Fayemi
 
Chiulli_Aurora_Oman_Raffaele_Beowulf.pptx
Chiulli_Aurora_Oman_Raffaele_Beowulf.pptxChiulli_Aurora_Oman_Raffaele_Beowulf.pptx
Chiulli_Aurora_Oman_Raffaele_Beowulf.pptx
raffaeleoman
 

Kürzlich hochgeladen (20)

Report Writing Webinar Training
Report Writing Webinar TrainingReport Writing Webinar Training
Report Writing Webinar Training
 
Dreaming Music Video Treatment _ Project & Portfolio III
Dreaming Music Video Treatment _ Project & Portfolio IIIDreaming Music Video Treatment _ Project & Portfolio III
Dreaming Music Video Treatment _ Project & Portfolio III
 
Governance and Nation-Building in Nigeria: Some Reflections on Options for Po...
Governance and Nation-Building in Nigeria: Some Reflections on Options for Po...Governance and Nation-Building in Nigeria: Some Reflections on Options for Po...
Governance and Nation-Building in Nigeria: Some Reflections on Options for Po...
 
AWS Data Engineer Associate (DEA-C01) Exam Dumps 2024.pdf
AWS Data Engineer Associate (DEA-C01) Exam Dumps 2024.pdfAWS Data Engineer Associate (DEA-C01) Exam Dumps 2024.pdf
AWS Data Engineer Associate (DEA-C01) Exam Dumps 2024.pdf
 
If this Giant Must Walk: A Manifesto for a New Nigeria
If this Giant Must Walk: A Manifesto for a New NigeriaIf this Giant Must Walk: A Manifesto for a New Nigeria
If this Giant Must Walk: A Manifesto for a New Nigeria
 
Air breathing and respiratory adaptations in diver animals
Air breathing and respiratory adaptations in diver animalsAir breathing and respiratory adaptations in diver animals
Air breathing and respiratory adaptations in diver animals
 
lONG QUESTION ANSWER PAKISTAN STUDIES10.
lONG QUESTION ANSWER PAKISTAN STUDIES10.lONG QUESTION ANSWER PAKISTAN STUDIES10.
lONG QUESTION ANSWER PAKISTAN STUDIES10.
 
BDSM⚡Call Girls in Sector 97 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 97 Noida Escorts >༒8448380779 Escort ServiceBDSM⚡Call Girls in Sector 97 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 97 Noida Escorts >༒8448380779 Escort Service
 
SaaStr Workshop Wednesday w/ Lucas Price, Yardstick
SaaStr Workshop Wednesday w/ Lucas Price, YardstickSaaStr Workshop Wednesday w/ Lucas Price, Yardstick
SaaStr Workshop Wednesday w/ Lucas Price, Yardstick
 
Causes of poverty in France presentation.pptx
Causes of poverty in France presentation.pptxCauses of poverty in France presentation.pptx
Causes of poverty in France presentation.pptx
 
Mohammad_Alnahdi_Oral_Presentation_Assignment.pptx
Mohammad_Alnahdi_Oral_Presentation_Assignment.pptxMohammad_Alnahdi_Oral_Presentation_Assignment.pptx
Mohammad_Alnahdi_Oral_Presentation_Assignment.pptx
 
Call Girl Number in Khar Mumbai📲 9892124323 💞 Full Night Enjoy
Call Girl Number in Khar Mumbai📲 9892124323 💞 Full Night EnjoyCall Girl Number in Khar Mumbai📲 9892124323 💞 Full Night Enjoy
Call Girl Number in Khar Mumbai📲 9892124323 💞 Full Night Enjoy
 
Re-membering the Bard: Revisiting The Compleat Wrks of Wllm Shkspr (Abridged)...
Re-membering the Bard: Revisiting The Compleat Wrks of Wllm Shkspr (Abridged)...Re-membering the Bard: Revisiting The Compleat Wrks of Wllm Shkspr (Abridged)...
Re-membering the Bard: Revisiting The Compleat Wrks of Wllm Shkspr (Abridged)...
 
ANCHORING SCRIPT FOR A CULTURAL EVENT.docx
ANCHORING SCRIPT FOR A CULTURAL EVENT.docxANCHORING SCRIPT FOR A CULTURAL EVENT.docx
ANCHORING SCRIPT FOR A CULTURAL EVENT.docx
 
Introduction to Prompt Engineering (Focusing on ChatGPT)
Introduction to Prompt Engineering (Focusing on ChatGPT)Introduction to Prompt Engineering (Focusing on ChatGPT)
Introduction to Prompt Engineering (Focusing on ChatGPT)
 
Uncommon Grace The Autobiography of Isaac Folorunso
Uncommon Grace The Autobiography of Isaac FolorunsoUncommon Grace The Autobiography of Isaac Folorunso
Uncommon Grace The Autobiography of Isaac Folorunso
 
Busty Desi⚡Call Girls in Sector 51 Noida Escorts >༒8448380779 Escort Service-...
Busty Desi⚡Call Girls in Sector 51 Noida Escorts >༒8448380779 Escort Service-...Busty Desi⚡Call Girls in Sector 51 Noida Escorts >༒8448380779 Escort Service-...
Busty Desi⚡Call Girls in Sector 51 Noida Escorts >༒8448380779 Escort Service-...
 
Chiulli_Aurora_Oman_Raffaele_Beowulf.pptx
Chiulli_Aurora_Oman_Raffaele_Beowulf.pptxChiulli_Aurora_Oman_Raffaele_Beowulf.pptx
Chiulli_Aurora_Oman_Raffaele_Beowulf.pptx
 
Dreaming Marissa Sánchez Music Video Treatment
Dreaming Marissa Sánchez Music Video TreatmentDreaming Marissa Sánchez Music Video Treatment
Dreaming Marissa Sánchez Music Video Treatment
 
The workplace ecosystem of the future 24.4.2024 Fabritius_share ii.pdf
The workplace ecosystem of the future 24.4.2024 Fabritius_share ii.pdfThe workplace ecosystem of the future 24.4.2024 Fabritius_share ii.pdf
The workplace ecosystem of the future 24.4.2024 Fabritius_share ii.pdf
 

Measuring Translation, Luigi Muzii, sQuid

  • 2. Why measure?  To know something unknown.  To learn what to measure.  To reduce uncertainty and the risk of wasting money. Measuring Translation 1
  • 3. Basic questions  What decision a measurement is supposed to support?  What is the definition of the thing being measured?  How does this thing matter to the decision?  What is the current level of uncertainty?  What is the value of additional information? Measuring Translation 2
  • 4. Measurement categories (scales)  Nominal  Excluding statements; no ordering among responses  Translation  Ordinal  To say whether one value is more than another, but not by how much  Hotel ratings  Interval  Homogeneous units to express a numerical difference between two values  Temperatures  Ratio  Interval scale with a zero position indicating absence  Kelvin scale Measuring Translation 3
  • 5. Baselines, thresholds and benchmarks  Baselines  The starting point for comparison  Hotel rating  Pricing  Thresholds  The value for something to come into effect  Acceptance Quality Levels  Maximum tolerable number of deviations from a predetermined level  Benchmarks  A performance average  Alignment or outdoing Measuring Translation 4
  • 6. Areas for measurement Area Primary measure Related measure Sales Price Cost of service Operations Cost of service Customer satisfaction Procurement Vendor rating Payments Human resources Resource development Vendor rating Quality Quality index Vendor rating Production Productivity Vendor capacity Finance Cash flow Invoicing Measuring Translation 5
  • 7. Basic measures Financial Operational Sales • Revenues • Cash flow • Profits • ROI • Timely invoicing • Labor cost • Staff • Number • Empowerment • Turnover • Efficiency • Complaints • Projects closures • Automation • New customers • Customer size • Customer profitability • Customer satisfaction • Complaints • Loyalty Measuring Translation 6
  • 8. Expected measurements Buyer  Vendor reliability & capability  Average Outgoing Quality (AOQ)  DIFOT (Delivery In-Full, On- Time) rate  OFCT (Order Fulfillment Cycle Time)  FPY (First Pass Yield)  Rework percentage Vendor  Specs & requirements  Sampling lot size  Acceptance Quality Level (AQL)  Source content profiling  Source content ranking  Translatability score Measuring Translation 7
  • 9. Translation data  Most requested domains  What about profitable domains?  Most requested language pairs  What about revenues per language pairs?  High volume customers  What about most profitable customers?  Translation time  What about productivity per vendor?  Numbers of jobs per linguist  What about deadline, volume and compensation? Measuring Translation 8
  • 10. How is content measurable?  Modular  Reusable  Standard  Unambiguous  Simple  Translatable Measuring Translation 9
  • 11. Predictive quality  Profiling  Weighted quality score  Comparison with reference corpus  Translatability score  Vendor rating  Common business intelligence criteria  Performance data Measuring Translation 10