The document discusses translation quality measurement and proposes a system for calculating a Translation Quality Index (TQI). It suggests using checklists and sampling techniques to measure errors in a translation sample. Errors would be categorized and assigned weights. The number of errors would be calculated as a percentage of the total words to determine a TQI score, with lower percentages indicating higher quality. An example TQI calculation using a 3,000 word sample with 30 error points is provided. The TQI is proposed as a standardized metric for measuring and comparing translation quality.
22. Inspection Points Key Principle: Reject “defective material” at its lowest value Proof Edit Translation SL Content Development (GIGO) $ Value of Service Stages of Production
23. Inspection Points Key Principle: Reject “defective material” at its lowest value Proof Edit Translation SL Content Development (GIGO) $ Value of Service Stages of Production
50. TQI Log Error Category EP Remarks Bookmark Path File Grader Date Is Formal 2 irregular capitalization; should be is, not Is x2_is C:ocuments and SettingsS1643403esktopuality Measurement CoffeMakerTest.doc RS1643403 11/1/2003 aluminium Formal 1 British spelling; American English should be aluminum, not aluminium x3_aluminium C:ocuments and SettingsS1643403esktopuality Measurement CoffeMakerTest.doc RS1643403 11/1/2003 food Meaning 2 The container is not made to cook food, it is made to brew a beverage. x5_food C:ocuments and SettingsS1643403esktopuality Measurement CoffeMakerTest.doc RS1643403 11/1/2003 right for the gas cooker, the electric plate and the pyroceram Formal 1 A better phase might be: "acceptable for use on gas and electric stoves." x6_right_for C:ocuments and SettingsS1643403esktopuality Measurement CoffeMakerTest.doc RS1643403 11/1/2003 pyroceram Meaning 4 The word "pyroceram" is unknown to most English speakers. x7_pyroceram C:ocuments and SettingsS1643403esktopuality Measurement CoffeMakerTest.doc RS1643403 11/1/2003 wash Meaning 2 In English, the word "wash" typically means water and soap. The instructions specify only using water, so a better word choice would be "rinse." x8_wash C:ocuments and SettingsS1643403esktopuality Measurement CoffeMakerTest.doc RS1643403 11/1/2003 trow Meaning 2 The word "trow" is a misspelling of "throw." x9_trow C:ocuments and SettingsS1643403esktopuality Measurement CoffeMakerTest.doc RS1643403 11/1/2003 total 14 N. of words 42 TQI 67%
51.
52.
53.
54.
55.
56.
57.
58.
59.
60.
61.
62.
63.
64.
65.
66.
67.
68.
69.
70.
71. Let’s Calculate Two TQIs Implicit TQI = 93.2% Implicit TQI = 99.0% 250 words (estimate) 17 error points 17 error pts / 250 words = 0.068 3,000 words (12 pages @ 250 words) 30 error points 30 error pts / 3,000 words = 0.01 ATA Framework for Standard Error Marking LISA QA Model ver. 1.0 (1995)
89. Select Bibliography • Brue, G. : Six Sigma for Managers, New York, McGraw Hill , 2000 • Deming, W. Edwards: Out of the Crisis, Cambridge (Mass), MIT Press, 2000 • Eckersley, H.: “Systems for Evaluating Translation Quality”, in Multilingual Computing & Technology, #47 Volume 13 Issue 3, April/May 2002 • Grove, A.: High Output Management, 2nd ed., New York, Vintage Press, 1995 • Hönig, H. : “Positions, Power and Practice: Functionalist Approaches and Translation Quality Assessment”, in Schäffner, C. (ed.) Translation and Quality. Clevendon, Multilingual Matters, 1998 • Language International: “Engineering Language Quality – A word with quality-standards consultant John Gagliardi”, in Language International Vol. 12 No. 3, June 2000 • Lauscher S.: “Concepts of Translation Quality and Quality Assessment”, in Proceedings of the 39th Annual Conference of the American Translators Association, 1998 • Ling Koo, S., and Kinds, H.: “A Quality-Assurance Model for Large Projects”, in Sprung, R. (ed.) Translating into Success. Cutting-edge strategies for going multilingual in a global age. Amsterdam/Philadelphia, John Benjamins Publishing Company, 2000 • LISA: “Microsoft Quality Standards”, in Case Studies and Client Requirements, 1998 • McConnell, S.: Software Project Survival Guide, Redmond, Microsoft Press, 1998 • Moroney, M.J.: “Facts from Figures”, Harmondsworth, Penguins, 1951, 1956(3rd) , • Reiss, Katharina: Translation Criticism - The Potential & Limitations. Categories and Criteria for Translation Quality Assessment. Translated by Erroll F. Rhodes. St. Jerome Publishing 2000 • Schäffner, C. (ed.): Translation and Quality, Clevendon, Multilingual Matters, 1998 • Shewhart, W. : Statistical Method from the Viewpoint of Quality Control. 1939. New York: Dover Publications. Reprint, 1986. (Originally published: Washington, D.C.: Graduate School of the Department of Agriculture, 1939.) • Spurr W., and Bonini C. : Statistical Analysis for Business Decisions, Homewood, IL: Richard D. Irwin, Inc., 1967 • Sturz, W.: “DIN 2345 Hits the Language Industry” in Language International Vol. 10 No. 5, May 1998 • Vogel, S.; Nießen, S.; Hermann, N.: “Automatic Extrapolation of Human Assessment of Translation Quality” http://www‑i6.informatik.rwth‑aachen.de/PostScript/InterneArbeiten/Paper_2000/Vogel_Evaluation_LREC_2000-corrected.ps.gz , 2000 • Woyde, R.: “Introduction to the SAE J2450 Translation Quality Metric”, in Language International Vol. 13 No. 2, April 2001