Boost your QA productivity with smart sampling (Sien Accou, Yamagata Europe)

•Als PPTX, PDF herunterladen•

0 gefällt mir•1,379 views

The short presentations are followed by a discussion with all participants about the following questions: 1) How do we drive adoption of the DQF-MQM metrics? 2) What do buyers of translation need next to make their translation quality evaluation process more effective? 3) What do providers of translation need next to make their translation quality evaluation process more effective?

Technologie

SMART QA
HOW TO BOOST YOUR QA PRODUCTIVITY WITH SMART SAMPLING
MARCH 2016
www.yamagata-europe.com

YAMAGATA EUROPE
www.yamagata-europe.com 2
EUROPE
INDIA USA
USA Sales
JAPAN
Southeast ASIA
CHINA

WHAT DO WE DO?
www.yamagata-europe.com 3
We write
We translate
We do the layout
We print
We package & ship
We create software

TO MEASURE IS TO KNOW
5
Amount of mistakes
 per match rate
 per vendor
 per project
 per customer
 per language
Experience of the translator
Type of mistakes
 Omissions
 Formatting
 Inconsistencies
 Terminology
 Spelling
 Tags
Conclusions such as best
performers and worst performers
www.yamagata-europe.com

MISTAKES PER MATCH RATE
6
 Figures 2015 for a customer with 1,785,506 translated words
 Indication to reduce checks in a certain category
Match Rate Error %
100% 0.50%
High fuzzy matches
95-99% 8.00%
85-94% 6.50%
Low fuzzy matches
75-84% 7.00%
50-74% 2.50%
No match 75.50%
www.yamagata-europe.com

MISTAKES PER QA CATEGORY
QA Category Errors %
Quotes 36.81%
Terminology 14.94%
Pattern match 13.86%
Number formatting 6.60%
Inconsistent translation 5.24%
Consecutive spaces 4.68%
Number value 4.32%
Punctuation 2.92%
Capitalisation 1.69%
Corrupt character 1.52%
Search: match found 1.32%
Brackets 1.13%
Forgotten translation 1.10%
Punctuation spacing 1.07%
Partial forgotten translation 0.66%
Skipped translation 0.65%
Empty translation 0.58%
Incomplete translation 0.45%
Explicit Tab 0.26%
Leading/trailing spaces 0.16%
Word spacing 0.05%
7
 Figures 2015 for all jobs
 Indication to reduce checks for certain types of errors
www.yamagata-europe.com

MISTAKES PER VENDOR
 Figures 2015 (for vendors with > 10 QA reports / > 50,000 words)
 Indication to reduce checks for certain vendors
www.yamagata-europe.com 8
Best QA
Vendor % QA Errors
Vendor A 0,00%
Vendor B 0,00%
Vendor C 0,00%
Vendor D 0,00%
Vendor E 0,00%
Vendor F 0,00%
Vendor G 2,04%
Vendor H 3,09%
Vendor I 3,70%
Vendor J 5,11%
Vendor K 7,96%
Vendor L 12,20%
Vendor M 12,50%
Vendor N 13,16%
Vendor O 14,29%
Vendor P 14,91%
Vendor Q 15,38%
Vendor R 17,07%
Vendor S 17,24%
Vendor T 17,56%
Worst QA
Vendor % QA Errors # Reports with Errors
Vendor A‘ 100,00% 11
Vendor B‘ 92,86% 13
Vendor C‘ 89,66% 26
Vendor D‘ 85,71% 12
Vendor E‘ 85,00% 17
Vendor F‘ 81,82% 18
Vendor G‘ 81,82% 9
Vendor H‘ 76,00% 19
Vendor I‘ 75,00% 12
Vendor J‘ 75,00% 9
Vendor K‘ 75,00% 15
Vendor L‘ 73,91% 17
Vendor M‘ 73,08% 19
Vendor N‘ 72,00% 18
Vendor O‘ 71,43% 10
Vendor P‘ 70,27% 26
Vendor Q‘ 68,75% 22
Vendor R‘ 68,42% 26
Vendor S‘ 66,67% 8
Vendor T‘ 66,67% 16

HOW DOES SMART SAMPLING WORK?
www.yamagata-europe.com 9
Several
parameters
Smartly selected
sections
QA approach
 target audience
 content type
 type of product
 target language
 TM leverage
 volume of the assignment
 vendor experience
 …
= indication of
overall quality

EXAMPLE 1
www.yamagata-europe.com 10
 Target audience:
internal communication
 Content type:
general
Sampling!
New vendor
No sampling!

EXAMPLE 2
www.yamagata-europe.com 11
 Content type:
highly technical
 Product:
medical device
No sampling!

EXAMPLE 3
 Content: camera user manual
 High word count
 Mostly full matches
 Same translator for years
Sampling!
www.yamagata-europe.com 12

Analyse QA report
Pass or fail score
Pass?
Deliver to customer
Fail?
Restart full QA cycle
SCORING
www.yamagata-europe.com

QA DISTILLER
www.yamagata-europe.com 14
 First version developed by Yamagata Europe in 2003
 Standalone tool for checking bilingual files with default settings for
over 90 languages
 Automatic detection of formal errors in translations
 Allows checking of high text volumes within limited time frame
 Studies prove that results of QA Distiller check also give a good
indication of overall linguistic quality
 In the industry considered as a valid method to serve the 4-eyes-
principle

SMART SAMPLING WITH QAD
www.yamagata-europe.com 15
New feature: based on percentage of text

ANY QUESTIONS?
www.yamagata-europe.com 16

CONTACT US
SIEN.ACCOU@YAMAGATA-EUROPE.COM
WWW.YAMAGATA-EUROPE.COM

Weitere ähnliche Inhalte

Andere mochten auch

Currently there is a win-win relationship between human translation and machine translation. At the one hand Computer Aided Translation is one of the best ways to utilize machine translation and help humans do the translation. At the other hand the result of human translation can contribute to machine translation. In this presentation we will deeply explore this relationship. Besides, where else can we use machine translation? E-commerce is one of the most popular answer and tourism is one of the most helpful answer. Machine translation can somehow help you to know the world that you never know.

How to make Translation easier with Machines, by Hao Zong, Global Tone Commun...

TAUS - The Language Data Network

The music-loving Baltic countries are a multilingual hotspot in Europe, with the majority of citizens speaking (and singing) three languages on a daily basis. At the same time, the melodious Baltic languages are famously complex and morphologically rich, containing lots of ambiguity and intricate word agreements. Taken together, these factors make the region a prime spot for driving innovation in language technologies. Tilde, a language technology company specializing in custom MT and terminology services, has leveraged its extensive linguistic experience in the Baltic region to create custom MT systems for a wide variety of languages and domains, helping EU and global companies to boost translation productivity and make their applications multilingual. Tilde recently embarked on the challenging task of building a large-scale MT service for the Latvian government, Hugo.lv. This service was adapted to create a communication tool for the 2015 EU Presidency. The presentation will introduce the audience to languages and MT in the Baltic region and highlight these two case studies, which showcased the crucial role of language technology in enabling multilingual communication in the digital age.

Why the Baltics are a prime region for driving innovation in language technol...

TAUS - The Language Data Network

TAUS 2.0 and the Game Changers in Localization (Jaap van der Meer, director o...

TAUS - The Language Data Network

It’s no longer a question of whether technologies will reshape language service industry; it's just a matter of how quickly and how deeply. The future of translation industry will be prosperously stimulated by the further development of economic globalization and the popularization of internet usage, but clients' requirement will be further diverse in terms of quality, turnaround, volume, content, and cost. To deliver matched services, language service providers need to enable agile translation, machine translation and scalable translation capacity. However, it is hard to deliver all these diverse services without the help of technology and an innovative business model. New technologies, such as workflow automation, online service, crowdsourcing supported by new technologies and internet becoming a competitive edge for LSPs, and new relationships with resources (translators) are also a must after millennial generation dominate the labor market, the succeed of a LSP will be more technologies- and innovations-driven. This presentation will focus on how technology/Internet is reshaping the translation industry in China.

Technology/Internet is reshaping translation industry, by Dr. James Wei, CEO...

TAUS - The Language Data Network

Currently, MT is taking on a new cross-paradigm development characterized by the hybridization of data-driven statistical approaches and linguistic knowledge models. This presentation introduces the structural design of CCID's hybrid MT system including extracting term and lexicon entries from parallel corpora, extracting multi-word expressions (MWEs) in native English from the three-tuple comparable corpora, and new approach in statistical post-editing of Rule-based MT for domain adaptation. Research and Application of MT and language corpora in areas such as Corporate financial narratives will also be discussed in this session.

New Development in MT Technology and Services, by Anthony Wong, CCID TransTech

TAUS - The Language Data Network

In the past, software development used to follow a waterfall approach; today, localization must be embedded in an agile software development model. Most current i18n/l10n processes are not well suited for an agile software development process and definitely not suitable for Continuous Integration and Continuous Delivery. What are the implications of this change? What must be changed to allow i18n and l10n in an agile software development model? What is the role of the “traditional” Language Service Provider in this new scenario? Is there any out-of-the-box localization technology capable of covering all the requirements that a large company has to automate software localization and documentation today? In this Roundtable, we will discuss in which the direction our business is heading. We will try to answer some key questions on the requirements that a new business model should meet from the translation services buyer point of view.

Language Service and Technology Providers role in an Agile i18n and L10n proc...

TAUS - The Language Data Network

TAUS DQF and the Quality Dashboard provide various methods to monitor productivity and efficiency and to ensure the right quality is delivered. Users can track their own productivity, conduct evaluations and benchmark the results against industry averages. The tools help establish return-on-investment and benchmark performance enabling users to take informed decisions. To ensure evaluation results are reliable it is vital that best practices are applied. The aim of this session is to discuss best practices on using TAUS DQF and to analyze different use cases. Session leader: María Azqueta (Seprotec) Panelists: Nigel Watson (SDL), Daniel Brockmann (SDL), Alessandro Cattelan (Translated)

TAUS Quality Dashboard: Use Cases and Integrations - María Azqueta (Seprotec)

TAUS - The Language Data Network

Just as defining workflows and putting in place metrics are essential parts of an effective corporate strategy for post-editing machine translation (PEMT), so is the development of a post-editing guide for linguists. Z-Axis Director Uwe Muegge will present a simple approach to writing a PEMT guide. He will demonstrate how a PEMT guide has a positive impact on post-editing output, which in turn frees up linguistic QA resources for more important work.

How to write a Post-Editing Guide that will optimize your QA Process, by Uwe ...

TAUS - The Language Data Network

Quality estimation: the Holy Grail in the MT scene (Gábor Bessenyei, CEO of M...

TAUS - The Language Data Network

Panelists: Yoshiyasu Yamakawa (Intel), JP Barraza (Systran), Konstantin Dranch (Memsource), David Koot (TAUS) The focus of this session will be on predictions and risk management. What kind of things can you predict and how can you manage risks by by analyzing your translation data or monitoring your productivity and quality. Tracking translation data in different cycles of the translation process (translation, post-editing, review, proof-reading) offers tremendous value when it comes to predicting future trends or making informed choices. What type of data can be valuable and what kind of predictions can we make using this data? How can we make more efficient use of already available data? How can we use this type of data to improve machine translation, automatic QA, error-recognition, sampling or quality estimation? How can academia and industry work together towards a common goal?

Topic 4: The Magician's Hat: Turning Data into Business Intelligence (3)

TAUS - The Language Data Network

Topic 4: The Magician's Hat: Turning Data into Business Intelligence (2)

TAUS - The Language Data Network

Hosted by Jessica Roland (SDL) with panelists: Mimi Hills (VMWare), David Snider (LinkedIn) and Melissa Biggs (Informatica). So you have your localization tools and data in a private, public or hybrid Cloud. Great! But how “Cloud” are you, really? Do you have your people working at the speed of Cloud? If you don’t, does it matter if you have all the Cloud infrastructure/systems in place? And which is more important, speed of Cloud or ease of Cloud? Our panel of expert leaders has seen the full-spectrum journey to the Cloud and will share their thoughts on what it takes to really leverage this oh-so-popular model…and why.

How cloud are you?

TAUS - The Language Data Network

Andere mochten auch (12)