Translation is supposed to be unmeasurable. However, as the famous statistician David S. Moore said, “If you don’t know what to measure, measure anyway. You’ll learn what to measure.” In fact, measuring allows decision-makers to reduce uncertainty and the risk of wasting money. During the presentation, I will go through the following questions that must be answered before making a measurement:
What decision a measurement is supposed to support?
What is the definition of the thing being measured?
How does this thing matter to the decision?
What is the current level of uncertainty?
What is the value of additional information?
2. Why measure?
To know something unknown.
To learn what to measure.
To reduce uncertainty and the risk of wasting
money.
Measuring Translation
1
3. Basic questions
What decision a measurement is supposed to
support?
What is the definition of the thing being
measured?
How does this thing matter to the decision?
What is the current level of uncertainty?
What is the value of additional information?
Measuring Translation
2
4. Measurement
categories
(scales)
Nominal
Excluding statements; no ordering among responses
Translation
Ordinal
To say whether one value is more than another, but not
by how much
Hotel ratings
Interval
Homogeneous units to express a numerical difference
between two values
Temperatures
Ratio
Interval scale with a zero position indicating absence
Kelvin scale
Measuring Translation
3
5. Baselines,
thresholds and
benchmarks
Baselines
The starting point for comparison
Hotel rating Pricing
Thresholds
The value for something to come into effect
Acceptance Quality Levels
Maximum tolerable number of deviations from a predetermined
level
Benchmarks
A performance average
Alignment or outdoing
Measuring Translation
4
6. Areas for
measurement
Area Primary measure Related measure
Sales Price Cost of service
Operations Cost of service Customer satisfaction
Procurement Vendor rating Payments
Human resources Resource development Vendor rating
Quality Quality index Vendor rating
Production Productivity Vendor capacity
Finance Cash flow Invoicing
Measuring Translation
5
9. Translation
data
Most requested domains
What about profitable domains?
Most requested language pairs
What about revenues per language pairs?
High volume customers
What about most profitable customers?
Translation time
What about productivity per vendor?
Numbers of jobs per linguist
What about deadline, volume and compensation?
Measuring Translation
8
10. How is content
measurable?
Modular
Reusable
Standard
Unambiguous
Simple
Translatable
Measuring Translation
9
11. Predictive
quality
Profiling
Weighted quality score
Comparison with reference corpus
Translatability score
Vendor rating
Common business intelligence criteria
Performance data
Measuring Translation
10