Obtaining valuable insights into quality and productivity with no or minimum human effort is one of the challenges TAUS has been trying to address in the past five years. One TAUS initiative in this direction is the development of the TAUS Efficiency Score. This score is based on translator productivity and edit distance but can be extended with additional data points such as error types assigned during review, MT confidence scores, TM match percentages or keystrokes and mouse clicks. In today's translation software, many of these data points are available ready to be harvested and analyzed. Some data types need special functions or plug-ins to become meaningful for the user. How can we make more efficient use of the available data? Can we save time on review and quality evaluation and still provide the right level of quality? What are best practices for accelerating the review process by sampling and content profiling techniques? Session leader: Ruben de la Fuente (PayPal) Panelists: Maribel Rodriguez (Moravia), Dragos Munteanu (SDL), Christian Weih (Across Systems GmbH), Gábor Bessenyei (MorphoLogic Localisation Ltd.)

1. Quality Planning
1. Pre-Production
• Processes, Standards, Qualified/Trained
Resources…
2. Production
• Control, Procedure, Management, Tools..
3. Post-Production
• Measurement, Data, Analysis, Feedback
4. Localization Quality Improvement….

2. Automatization helps
 Pre-production:
 Evaluate vendors/translators/MT engines
 Determine price
 Production:
 QA checks
 Smart routing of content through workflows
 Post-production:
 Select samples for human review
 Improvement
 Gather data, improve metrics
TAUS GLOBAL LEADERS - DUBLIN 2016

3. Many applications, many
approaches
 Different applications of automatic
measurements require different technologies.
 The industry already has a few distinct ones:
 Translation quality estimation (BLEU/METEOR/etc)
 MT quality estimation (KantanAnalytics, TrustScore)
 Fair pricing estimation (Fairtradetranslation.com)
 More new techniques are needed!
TAUS GLOBAL LEADERS - DUBLIN 2016