The document discusses translation quality measurement and proposes a system for calculating a Translation Quality Index (TQI). It suggests using checklists and sampling techniques to measure errors in a translation sample. Errors would be categorized and assigned weights. The number of errors would be calculated as a percentage of the total words to determine a TQI score, with lower percentages indicating higher quality. An example TQI calculation using a 3,000 word sample with 30 error points is provided. The TQI is proposed as a standardized metric for measuring and comparing translation quality.

1. Translation Quality Measurement

10. Customer-driven Considerations

21. Translation Quality Factors

22. Inspection Points Key Principle: Reject “defective material” at its lowest value Proof Edit Translation SL Content Development (GIGO) $ Value of Service Stages of Production

23. Inspection Points Key Principle: Reject “defective material” at its lowest value Proof Edit Translation SL Content Development (GIGO) $ Value of Service Stages of Production

33. Classification of Errors

45. A TQI Tool Prototype

46. ATA Implementation

47. ATA Implementation

48. SAE Implementation (Modified)

49. SAE Implementation (Modified)

50. TQI Log Error Category EP Remarks Bookmark Path File Grader Date Is Formal 2 irregular capitalization; should be is, not Is x2_is C:ocuments and SettingsS1643403esktopuality Measurement CoffeMakerTest.doc RS1643403 11/1/2003 aluminium Formal 1 British spelling; American English should be aluminum, not aluminium x3_aluminium C:ocuments and SettingsS1643403esktopuality Measurement CoffeMakerTest.doc RS1643403 11/1/2003 food Meaning 2 The container is not made to cook food, it is made to brew a beverage. x5_food C:ocuments and SettingsS1643403esktopuality Measurement CoffeMakerTest.doc RS1643403 11/1/2003 right for the gas cooker, the electric plate and the pyroceram Formal 1 A better phase might be: "acceptable for use on gas and electric stoves." x6_right_for C:ocuments and SettingsS1643403esktopuality Measurement CoffeMakerTest.doc RS1643403 11/1/2003 pyroceram Meaning 4 The word "pyroceram" is unknown to most English speakers. x7_pyroceram C:ocuments and SettingsS1643403esktopuality Measurement CoffeMakerTest.doc RS1643403 11/1/2003 wash Meaning 2 In English, the word "wash" typically means water and soap. The instructions specify only using water, so a better word choice would be "rinse." x8_wash C:ocuments and SettingsS1643403esktopuality Measurement CoffeMakerTest.doc RS1643403 11/1/2003 trow Meaning 2 The word "trow" is a misspelling of "throw." x9_trow C:ocuments and SettingsS1643403esktopuality Measurement CoffeMakerTest.doc RS1643403 11/1/2003 total 14 N. of words 42 TQI 67%

71. Let’s Calculate Two TQIs Implicit TQI = 93.2% Implicit TQI = 99.0% 250 words (estimate) 17 error points 17 error pts / 250 words = 0.068 3,000 words (12 pages @ 250 words) 30 error points 30 error pts / 3,000 words = 0.01 ATA Framework for Standard Error Marking LISA QA Model ver. 1.0 (1995)

73. Process Flow Diagram

89. Select Bibliography • Brue, G. : Six Sigma for Managers, New York, McGraw Hill , 2000 • Deming, W. Edwards: Out of the Crisis, Cambridge (Mass), MIT Press, 2000 • Eckersley, H.: “Systems for Evaluating Translation Quality”, in Multilingual Computing & Technology, #47 Volume 13 Issue 3, April/May 2002 • Grove, A.: High Output Management, 2nd ed., New York, Vintage Press, 1995 • Hönig, H. : “Positions, Power and Practice: Functionalist Approaches and Translation Quality Assessment”, in Schäffner, C. (ed.) Translation and Quality. Clevendon, Multilingual Matters, 1998 • Language International: “Engineering Language Quality – A word with quality-standards consultant John Gagliardi”, in Language International Vol. 12 No. 3, June 2000 • Lauscher S.: “Concepts of Translation Quality and Quality Assessment”, in Proceedings of the 39th Annual Conference of the American Translators Association, 1998 • Ling Koo, S., and Kinds, H.: “A Quality-Assurance Model for Large Projects”, in Sprung, R. (ed.) Translating into Success. Cutting-edge strategies for going multilingual in a global age. Amsterdam/Philadelphia, John Benjamins Publishing Company, 2000 • LISA: “Microsoft Quality Standards”, in Case Studies and Client Requirements, 1998 • McConnell, S.: Software Project Survival Guide, Redmond, Microsoft Press, 1998 • Moroney, M.J.: “Facts from Figures”, Harmondsworth, Penguins, 1951, 1956(3rd) , • Reiss, Katharina: Translation Criticism - The Potential & Limitations. Categories and Criteria for Translation Quality Assessment. Translated by Erroll F. Rhodes. St. Jerome Publishing 2000 • Schäffner, C. (ed.): Translation and Quality, Clevendon, Multilingual Matters, 1998 • Shewhart, W. : Statistical Method from the Viewpoint of Quality Control. 1939. New York: Dover Publications. Reprint, 1986. (Originally published: Washington, D.C.: Graduate School of the Department of Agriculture, 1939.) • Spurr W., and Bonini C. : Statistical Analysis for Business Decisions, Homewood, IL: Richard D. Irwin, Inc., 1967 • Sturz, W.: “DIN 2345 Hits the Language Industry” in Language International Vol. 10 No. 5, May 1998 • Vogel, S.; Nießen, S.; Hermann, N.: “Automatic Extrapolation of Human Assessment of Translation Quality” http://www‑i6.informatik.rwth‑aachen.de/PostScript/InterneArbeiten/Paper_2000/Vogel_Evaluation_LREC_2000-corrected.ps.gz , 2000 • Woyde, R.: “Introduction to the SAE J2450 Translation Quality Metric”, in Language International Vol. 13 No. 2, April 2001