SlideShare a Scribd company logo
1 of 37
Webcast
17:00-18:00 CET, 25 September
TAUS Dynamic Quality Framework
From Labs to Market
Aims
1. Context
2. Overview of current resources
3. Outline upcoming activity
Agenda
1. Welcome and Context (Jaap van der Meer)
2. DQF Overview (Rahzeb Choudhury)
1. e-Learning (Willem Stoeller)
2. DQF Tools (Maxim Khalilov)
3. Q&A
The DQF in Context
Jaap van der Meer
Evolution of the Translation Industry
From the TAUS Translation Technology Landscape Report (April, 2013)
Is the translation industry ready?
Where We Stand
This slide may not be used or copied without permission from TAUS
Together We
Know More
We Know
Better
Our Vision
This slide may not be used or copied without permission from TAUS
Human Language Project
Collaboration between business,
government and academia worldwide
Data
Translation data of 400 most
spoken languages in the world
(160,000 language pairs).
Technology
Central resource for education
and advancement in open-source
and commercial MT.
Interoperability
Coordinate translation web
services to optimize connectivity.
Metrics
Provide for measuring and
benchmarking translation
quality.
Think of:
 the Human Genome Project: a $3.8 Billion
investment in sharing data about the
human genome drove $796 Billion in
economic impact, and spurred growth in the
life sciences industry.
Why TAUS – From Think Tank to Industry-Shared Services
TAUS is a member organization for the global translation industry. Founded in January 2005 as a think tank TAUS has evolved to a
global platform supporting corporations, government organizations and translation suppliers to innovate and automate their
business.
Innovation Think Tank Industry-Shared Services
Resources Insights Data & Apps Metrics
TAUS offers guidance and indispensable industry support services to every agency and company and every buyer of translation
services and technologies. TAUS also runs a program of industry events around the world that attracts a vibrant community of
executives and entrepreneurs from the global content and translation industries.
2005 2006 2008 2009
DQF Overview
Rahzeb Choudhury
See evaluation.taus.net
e-Learning
Willem Stoeller
Objectives
• Upon completion of this program, you will:
– Better manage the issues related to managing
translation quality
– Appreciate how different quality management
standards can contribute to managing translation
quality
– Be able to place the TAUS Dynamic Quality Framework
within the context of quality management models
– Be able to use the DQF resources to guide your
evaluation decisions
Target Audience
• Anyone interested in translation quality
– TSP project managers, quality managers and lead
translators
– Translation buyer project managers, quality
managers and lead translators
– Other translation professionals interested in
translation quality using machine or human
translation
– TAUS membership not required
Agenda
Quality Management in Translation
and the
TAUS Dynamic Quality Framework
Self Study
Introduction
Quality
Management
Standards
DQF
Overview
Experience
with DQF
Certification
Test
Temporary
License
Hands-on
with DQF
Quality Management Standards
Quality Management Standards
General Standards
ISO
9001:2008
PMBOK®
Guide
CMMI Six Sigma
Translation
Specific Standards
EN15038
CAN CGSB
131.10
ASTM
F2575-06
Standard
Guide
Quality Management Standards:
to Remember
Manual
Processes
(What &
When)
Work
Instructions
(How)
Records
QMS
Project management
guidelines Continuous improvement
Use Metrics
and BSC
F2575: definitions
and specifications
The Dynamic Quality Evaluation
Framework
19
Initial Project Participants
Published Reports
The Dynamic Quality Evaluation
Framework
23
The Dynamic Quality Evaluation
Framework
24
DQF
Knowledge
Database
Adequacy/Fluency
Adherence to
regulatory
instruments
Community-based
evaluation
Customer
feedback
Error typology
Readability
evaluation
Usability
evaluation
The Dynamic Quality Evaluation
Framework
25
The Dynamic Quality Evaluation
Framework
26
DQF Case Studies
• I conducted four interviews with TAUS
members regarding their experience with
DQF:
DQF Case Studies - EMC
DQF
Compare MT
systems
QE of
translations
MT/PEMT
performance
DQF Case Studies - AVB
DQF
Compare MT
systems
QE of
translations
MT/PEMT
performance
DQF Case Studies - Pactera
DQF
Compare MT
systems
QE of
translations
MT/PEMT
performance
DQF Case Studies - Intel
DQF
Compare MT
systems
QE of
translations
MT/PEMT
performance
Quality Management in Translation
and the
TAUS Dynamic Quality Framework
Thank you for your attention!
Tools Demo
Maxim Khalilov
DQF Overview
Rahzeb Choudhury
Upcoming DQF Report
New DQF Content Profiling v2 being
tested
TAUS QE Summit
Question and Answer
This slide may not be used or copied without permission from TAUS

More Related Content

More from TAUS - The Language Data Network

More from TAUS - The Language Data Network (20)

TAUS Global Content Summit Amsterdam 2019 / Beyond MT. A few premature reflec...
TAUS Global Content Summit Amsterdam 2019 / Beyond MT. A few premature reflec...TAUS Global Content Summit Amsterdam 2019 / Beyond MT. A few premature reflec...
TAUS Global Content Summit Amsterdam 2019 / Beyond MT. A few premature reflec...
 
TAUS Global Content Summit Amsterdam 2019 / Measure with DQF, Dace Dzeguze (T...
TAUS Global Content Summit Amsterdam 2019 / Measure with DQF, Dace Dzeguze (T...TAUS Global Content Summit Amsterdam 2019 / Measure with DQF, Dace Dzeguze (T...
TAUS Global Content Summit Amsterdam 2019 / Measure with DQF, Dace Dzeguze (T...
 
TAUS Global Content Summit Amsterdam 2019 / Automatic for the People by Domin...
TAUS Global Content Summit Amsterdam 2019 / Automatic for the People by Domin...TAUS Global Content Summit Amsterdam 2019 / Automatic for the People by Domin...
TAUS Global Content Summit Amsterdam 2019 / Automatic for the People by Domin...
 
TAUS Global Content Summit Amsterdam 2019 / The Quantum Leap: Human Parity, C...
TAUS Global Content Summit Amsterdam 2019 / The Quantum Leap: Human Parity, C...TAUS Global Content Summit Amsterdam 2019 / The Quantum Leap: Human Parity, C...
TAUS Global Content Summit Amsterdam 2019 / The Quantum Leap: Human Parity, C...
 
TAUS Global Content Summit Amsterdam 2019 / Growing Business by Connecting Co...
TAUS Global Content Summit Amsterdam 2019 / Growing Business by Connecting Co...TAUS Global Content Summit Amsterdam 2019 / Growing Business by Connecting Co...
TAUS Global Content Summit Amsterdam 2019 / Growing Business by Connecting Co...
 
Achieving Translation Efficiency and Accuracy for Video Content, Xiao Yuan (P...
Achieving Translation Efficiency and Accuracy for Video Content, Xiao Yuan (P...Achieving Translation Efficiency and Accuracy for Video Content, Xiao Yuan (P...
Achieving Translation Efficiency and Accuracy for Video Content, Xiao Yuan (P...
 
Introduction Innovation Contest Shenzhen by Henri Broekmate (Lionbridge)
Introduction Innovation Contest Shenzhen by Henri Broekmate (Lionbridge)Introduction Innovation Contest Shenzhen by Henri Broekmate (Lionbridge)
Introduction Innovation Contest Shenzhen by Henri Broekmate (Lionbridge)
 
Game Changer for Linguistic Review: Shifting the Paradigm, Klaus Fleischmann...
 Game Changer for Linguistic Review: Shifting the Paradigm, Klaus Fleischmann... Game Changer for Linguistic Review: Shifting the Paradigm, Klaus Fleischmann...
Game Changer for Linguistic Review: Shifting the Paradigm, Klaus Fleischmann...
 
A translation memory P2P trading platform - to make global translation memory...
A translation memory P2P trading platform - to make global translation memory...A translation memory P2P trading platform - to make global translation memory...
A translation memory P2P trading platform - to make global translation memory...
 
Shiyibao — The Most Efficient Translation Feedback System Ever, Guanqing Hao ...
Shiyibao — The Most Efficient Translation Feedback System Ever, Guanqing Hao ...Shiyibao — The Most Efficient Translation Feedback System Ever, Guanqing Hao ...
Shiyibao — The Most Efficient Translation Feedback System Ever, Guanqing Hao ...
 
Stepes – Instant Human Translation Services for the Digital World, Carl Yao (...
Stepes – Instant Human Translation Services for the Digital World, Carl Yao (...Stepes – Instant Human Translation Services for the Digital World, Carl Yao (...
Stepes – Instant Human Translation Services for the Digital World, Carl Yao (...
 
Farmer Lv (TrueTran)
Farmer Lv (TrueTran)Farmer Lv (TrueTran)
Farmer Lv (TrueTran)
 
Smart Translation Resource Management: Semantic Matching, Kirk Zhang (Wiitran...
Smart Translation Resource Management: Semantic Matching, Kirk Zhang (Wiitran...Smart Translation Resource Management: Semantic Matching, Kirk Zhang (Wiitran...
Smart Translation Resource Management: Semantic Matching, Kirk Zhang (Wiitran...
 
The Theory and Practice of Computer Aided Translation Training System, Liu Q...
 The Theory and Practice of Computer Aided Translation Training System, Liu Q... The Theory and Practice of Computer Aided Translation Training System, Liu Q...
The Theory and Practice of Computer Aided Translation Training System, Liu Q...
 
Translation Technology Showcase in Shenzhen
Translation Technology Showcase in ShenzhenTranslation Technology Showcase in Shenzhen
Translation Technology Showcase in Shenzhen
 
How to efficiently use large-scale TMs in translation, Jing Zhang (Tmxmall)
How to efficiently use large-scale TMs in translation, Jing Zhang (Tmxmall)How to efficiently use large-scale TMs in translation, Jing Zhang (Tmxmall)
How to efficiently use large-scale TMs in translation, Jing Zhang (Tmxmall)
 
SDL Trados Studio 2017, Jocelyn He (SDL)
SDL Trados Studio 2017, Jocelyn He (SDL)SDL Trados Studio 2017, Jocelyn He (SDL)
SDL Trados Studio 2017, Jocelyn He (SDL)
 
How we train post-editors - Yongpeng Wei (Lingosail)
How we train post-editors - Yongpeng Wei (Lingosail)How we train post-editors - Yongpeng Wei (Lingosail)
How we train post-editors - Yongpeng Wei (Lingosail)
 
A use-case for getting MT into your company, Kerstin Berns (berns language c...
 A use-case for getting MT into your company, Kerstin Berns (berns language c... A use-case for getting MT into your company, Kerstin Berns (berns language c...
A use-case for getting MT into your company, Kerstin Berns (berns language c...
 
QE integrated in XTM, by Bob Willans (XTM)
QE integrated in XTM, by Bob Willans (XTM)QE integrated in XTM, by Bob Willans (XTM)
QE integrated in XTM, by Bob Willans (XTM)
 

Recently uploaded

Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
Earley Information Science
 

Recently uploaded (20)

Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 

TAUS DQF Webinar: From Labs to Market - 25 September 2013

  • 1. Webcast 17:00-18:00 CET, 25 September TAUS Dynamic Quality Framework From Labs to Market
  • 2. Aims 1. Context 2. Overview of current resources 3. Outline upcoming activity
  • 3. Agenda 1. Welcome and Context (Jaap van der Meer) 2. DQF Overview (Rahzeb Choudhury) 1. e-Learning (Willem Stoeller) 2. DQF Tools (Maxim Khalilov) 3. Q&A
  • 4. The DQF in Context Jaap van der Meer
  • 5. Evolution of the Translation Industry From the TAUS Translation Technology Landscape Report (April, 2013)
  • 6. Is the translation industry ready?
  • 7. Where We Stand This slide may not be used or copied without permission from TAUS Together We Know More We Know Better
  • 8. Our Vision This slide may not be used or copied without permission from TAUS Human Language Project Collaboration between business, government and academia worldwide Data Translation data of 400 most spoken languages in the world (160,000 language pairs). Technology Central resource for education and advancement in open-source and commercial MT. Interoperability Coordinate translation web services to optimize connectivity. Metrics Provide for measuring and benchmarking translation quality. Think of:  the Human Genome Project: a $3.8 Billion investment in sharing data about the human genome drove $796 Billion in economic impact, and spurred growth in the life sciences industry.
  • 9. Why TAUS – From Think Tank to Industry-Shared Services TAUS is a member organization for the global translation industry. Founded in January 2005 as a think tank TAUS has evolved to a global platform supporting corporations, government organizations and translation suppliers to innovate and automate their business. Innovation Think Tank Industry-Shared Services Resources Insights Data & Apps Metrics TAUS offers guidance and indispensable industry support services to every agency and company and every buyer of translation services and technologies. TAUS also runs a program of industry events around the world that attracts a vibrant community of executives and entrepreneurs from the global content and translation industries. 2005 2006 2008 2009
  • 13. Objectives • Upon completion of this program, you will: – Better manage the issues related to managing translation quality – Appreciate how different quality management standards can contribute to managing translation quality – Be able to place the TAUS Dynamic Quality Framework within the context of quality management models – Be able to use the DQF resources to guide your evaluation decisions
  • 14. Target Audience • Anyone interested in translation quality – TSP project managers, quality managers and lead translators – Translation buyer project managers, quality managers and lead translators – Other translation professionals interested in translation quality using machine or human translation – TAUS membership not required
  • 15. Agenda Quality Management in Translation and the TAUS Dynamic Quality Framework Self Study Introduction Quality Management Standards DQF Overview Experience with DQF Certification Test Temporary License Hands-on with DQF
  • 16. Quality Management Standards Quality Management Standards General Standards ISO 9001:2008 PMBOK® Guide CMMI Six Sigma Translation Specific Standards EN15038 CAN CGSB 131.10 ASTM F2575-06 Standard Guide
  • 17. Quality Management Standards: to Remember Manual Processes (What & When) Work Instructions (How) Records QMS Project management guidelines Continuous improvement Use Metrics and BSC F2575: definitions and specifications
  • 18. The Dynamic Quality Evaluation Framework 19
  • 21. The Dynamic Quality Evaluation Framework 23
  • 22. The Dynamic Quality Evaluation Framework 24 DQF Knowledge Database Adequacy/Fluency Adherence to regulatory instruments Community-based evaluation Customer feedback Error typology Readability evaluation Usability evaluation
  • 23. The Dynamic Quality Evaluation Framework 25
  • 24. The Dynamic Quality Evaluation Framework 26
  • 25. DQF Case Studies • I conducted four interviews with TAUS members regarding their experience with DQF:
  • 26. DQF Case Studies - EMC DQF Compare MT systems QE of translations MT/PEMT performance
  • 27. DQF Case Studies - AVB DQF Compare MT systems QE of translations MT/PEMT performance
  • 28. DQF Case Studies - Pactera DQF Compare MT systems QE of translations MT/PEMT performance
  • 29. DQF Case Studies - Intel DQF Compare MT systems QE of translations MT/PEMT performance
  • 30. Quality Management in Translation and the TAUS Dynamic Quality Framework Thank you for your attention!
  • 34. New DQF Content Profiling v2 being tested
  • 37. This slide may not be used or copied without permission from TAUS

Editor's Notes

  1. Illustrate the growing complexity and opportunity
  2. Today the internet is not accessible to two-thirds of the world’s populations: http://internet.org/
  3. The challenge is to strike the right balance between cooperation and competition.The self-conscious position of Only We Know is challenged by Innovators, often coming from outside the industry (the Invaders).TAUS position and inspiration: complexity is too great and the opportunity is to big to NOT collaborate....
  4. Our grand vision of the HLP may never materialize, but on our journey we can support all industry stakeholders to achieve greater efficiencies and open new business opportunities and grow global revenue
  5. Historic evolution of TAUS
  6. Enough about myself, lets talk about the objectives of this training program. Upon completion of this training program you will better manage issues related to managing translation quality,Appreciate how different quality management standards can contribute to managing translation quality and place the Taus Labs Dynamic Quality Framework within the context of those quality management models. In particular you will gain hands-on experience with the different components of the Dynamic Quality Framework and be able to use the DQF resources to guide your evaluation decisions.
  7. Here is the agenda for the quality management in translation and the Taus dynamic quality framework certification program. As you can see, there are two components: the online self study and a temporary license that provides access to the Dynamic Quality Framework components on the taus.net website. The online self study is comprised of an introduction, followed by an overview of seven different quality standards. Subsequently an overview of the approach behind the dynamic quality framework and a walk through of the three major components of the dynamic quality framework are presented. The self study is completed with a discussion of several user experiences with the dynamic quality framework tools and a one hour online certification test followed by a short survey. The temporary license allows you to test and use the DQF tools in the Taus Lab with your own data.Now that you have signed up for the self study component, you should receive a UserID and password for access to the DQF Tools on taus.net from memberservices@taus.net within 48 hours.Access to the self study and the DQF Tools on taus.net will be available for 10 weeks from sign up.
  8. It is better, faster and cheaper to build in translation quality than to correct quality especially at the end of a project. There are four distinct areas influencing translation quality.Source content:The quality of the source content has a very strong impact on the quality of the translation. If the source content uses convoluted and very long sentences, both human translators and machine translation systems will have a hard time producing good quality translation. The same is true of inconsistent use of terminology and linguistic errors in the source content. Many localization buyers have turned to tools such as Acrolinx to control and improve the source quality.Localization enablement or internationalization issues will result in translation quality problems. Common examples are hard coded and therefore untranslatable text in application user interfaces, inability to change the word order or apply the correct locale specific formatting.Finally the limitations of the translator tools used can impact the translation quality. For example source content with frequent use of inline formatting will result in translation quality issues if the translation tools used have very limited inline formatting capabilities. Another is the availability of terminology in spreadsheet form not integrated with the translation workbench used. In that case the translators will not use the terminology consistently due to the manual lookup and lack of built in validation.Translation requirements:As discussed, translation requirements should provide the input to what resources are needed, what training is needed, what workflow should be used and what quality evaluation methods should be used to determine that the characteristics of the translation meet the specified translation requirements. Unclear or missing translation requirements will negatively impact translation quality and make the decision on quality subjective and emotional.Translator experience, training and performance:Translators need to be matched with the domain, content type and expected quality levels. The translators education, past performance (hence the need for the translation service provider to monitor the translator performance) and experience also dictate the amount of training and reference material that needs to be provided to the selected translators. Many buyers of translation tend to overlook the need to provide training to their translation service providers. When using machine translation combined with post editing, the experience and training with post editing is essential. Post editing requires specialized guidelines for the translators due to the type of errors made by machine translation systems.Processes and tools used:The translation requirements should dictate the workflow to be used, especially the different review steps in the process. For example the need to use a subject matter expert in an additional review step or not. The translation memory, workflow tools, translator and reviewer tools used will impact translation quality. This is also very important when using machine translation either stand alone or combined with post editing: the particular system used for a given language pair impacts quality, since not all systems perform equally. Also the amount of customization needed for the machine translation system is dictated by the translation requirements. Finally the quality evaluation methods to be used depend on translation requirements, budget and time available.All of these areas impacting quality translation need to be addressed as part of the initiate and planning process groups, not during project execution.