An overview of assessment in interpreting: A conversation with our colleagues in language testing

Reynaldo J Pagura

doi:10.14393/LL63-v35n2-2019-8

Authors

Reynaldo J Pagura University of Illinois at Urbana-Champaign https://orcid.org/0000-0003-3039-0516

DOI:

https://doi.org/10.14393/LL63-v35n2-2019-8

Keywords:

Interpreting assessment, Validity, Reliability, Test constructs, Quality in interpreting

Abstract

This article suggests that the interpreter education community would benefit from cross-fertilization with the language testing community, which has been around much longer. The main principles used in testing speaking (or communicative competence) developed along the last decades by language testing experts and institutions can – and should – be applied to the testing of interpreter performance, mainly in high stakes examinations, such as those used for certification, employment at an international institution, or graduation from an educational program. The concept and some relevant studies concerning the notion of quality in professional interpretation are also discussed and suggested as ancillary help to build the constructs used in said examinations.

Downloads

Download data is not yet available.

References

ADMINISTRATIVE OFFICE OF THE UNITED STATES COURTS. Examinee Handbook – United States Courts – Federal Court Interpreter Certification Examination, Revised edition. Washington, D.C.: Court Services Office, 2019. Available at https://www.prometric.com/test-takers/search/aousc. Accessed in October 2019.

AIIC (Association Internationale des Interprètes de Conférence). Colloque Sur L’enseignment de L’interprétation. Paris: AIIC, 1965.

ANGELELLI, C. Using a Rubric to Assess Translation Ability: Defining the Construct. In: ANGELELLI, C.; JACOBSON, H. E. Testing and Assessment in Translation and Interpreting Studies. ATA Scholarly Monograph Series XIV. Amsterdam/Philadelphia: John Benjamins, 2009. https://doi.org/10.1075/ata.xiv.03ang

ANGELELLI, C.; JACOBSON, H. E. Testing and Assessment in Translation and Interpreting Studies. ATA Scholarly Monograph Series XIV. Amsterdam/Philadelphia: John Benjamins, 2009. https://doi.org/10.1075/ata.xiv

ARJONA-TSENG, E. A Psychometric Approach to the Selection of Translation and Interpreting Students in Taiwan. In: MOSER-MERCER, B.; LAMBERT, S. (Ed.). Bridging the Gap: Empirical Research in Simultaneous Interpretation. Amsterdam/Philadelphia: John Benjamins, 1994. https://doi.org/10.1075/btl.3.08arj

BOGUCKI, L. (Ed.) Teaching Translation and Interpreting: Challenges and Practice. Newscastle upon Tyne: Cambridge Scholars, 2010.

DAVIES, A.; BROWN, A.; ELDER, C.; HILL, K.; LUMLEY, T.; MCNAMARA, T. Dictionary of Language Testing. Reprint. Cambridge: Cambridge University Press, 1999/2002.

DODDS, J. M. On the Aptitude of Aptitude Testing. The Interpreters’ Newsletter, v. 3, p. 17-22, 1990.

DONOVAN, C. Experience with Interim Testing at ESIT – Some General Considerations, 2008. Available at https://www.emcinterpreting.org/resources/projects. Accessed in October 2019.

GAMBIER, Y.; GILE, D.; TAYLOR, C. Conference Interpreting: Current Trends in Research. Amsterdam/Philadelphia: John Benjamins, 1997. https://doi.org/10.1075/btl.23

GILE, D. L’évaluation de la qualité de l’interprétation en cours de formation. Meta, v. 46, n. 2, p. 379-393, 2001. https://doi.org/10.7202/002890ar

GILE, D. L’évaluation de la Qualité de L’interprétation par les délegues: Une Étude de Cas. The Interpreters’ Newsletter, v. 3, p. 66-71, 1990.

HEWETSON, Z. Mid-year Test and Resits at the University of Westminster: an Update, 2008. Available at https://www.emcinterpreting.org/resources/projects. Accessed in October 2019.

HLAVAC, J. Formalizing Community Interpreting Standards: A Cross-National Comparison of Testing Systems, Certification Conventions and Recent ISO Guidelines. International Journal of Interpreter Education, v. 7, n. 2, p. 21-38, 2015.

JACOBSON, H. Moving beyond Words in Assessing Mediated Interaction – Measuring Interactional Competence in Healthcare Settings. In: ANGELELLI, C.; JACOBSON, H. E. (Ed.). Testing and Assessment in Translation and Interpreting Studies. ATA Scholarly Monograph Series XIV. Amsterdam/Philadelphia: John Benjamins, 2009. https://doi.org/10.1075/ata.xiv.04jac

KEISER, W. Selection and Training of Conference Interpreters. In: GERVER, D.; SINAIKO, H. W. (Ed.). Language, Interpretation and Communication, Proceedings of the NATO Symposium on Language, Interpretation and Communication. New York: Plenum Press, 1978. https://doi.org/10.1007/978-1-4615-9077-4_3

KURZ, I. Conference Interpreting: User Expectations. ATA – Proceedings of the 30th Annual Conference. Medford, New Jersey: Learned Information, 1989. p. 143-148.

KURZ, I. Conference Interpreting: Quality in the Ears of the User. Meta, v. 46, n. 2, p. 394-409, 2001. https://doi.org/10.7202/003364ar

LONGLEY, P. An Integrated Programme for Training Interpreters. In: GERVER, D.; SINAIKO, H. W. (Ed.). Language, Interpretation and Communication, Proceedings of the NATO Symposium on Language, Interpretation and Communication. New York: Plenum Press, 1978. https://doi.org/10.1007/978-1-4615-9077-4_6

MACDONALD, P. It Don’t Mean a Thing... Simultaneous Interpretation Quality and User Satisfaction. The Interpreters Newsletter, v. 18, p. 35-59, 2013.

MACKINTOSH, J. A Review of Conference Interpretation: Practice and Training. Target , v. 7, n. 1, p. 119-133, 1995. https://doi.org/10.1075/target.7.1.10mac

MOSER, P. Survey on Expectations of Users of Conference Interpretation, Final Report in pdf available at https://aiic.net/page/736/survey-on-expectations-of-users-of-conference-interpretation/lang/1, 1995 (pdf version 2012). Accessed in November 2019.

MOSER-MERCER, B. Aptitude Testing for Conference Interpreting: Why, When and How. In: MOSER-MERCER, B.; LAMBERT, S. (Ed.). Bridging the Gap: Empirical Research in Simultaneous Interpretation. Amsterdam/Philadelphia: John Benjamins, 1994. https://doi.org/10.1075/btl.3.07mos

MOSER-MERCER, B.; LAMBERT, S. Bridging the Gap: Empirical Research in Simultaneous Interpretation. Amsterdam/Philadelphia: John Benjamins, 1994.

PELLATT, V.; GRIFFITHS, K.; WU, S.-C. Teaching and Testing Interpreting and Translating. Bern (Switzerland): Peter Lang, 2010. https://doi.org/10.3726/978-3-0353-0267-7

PÖCHHACKER, F. Quality Assessment in Conference and Community Interpreting. Meta, v. 46, n. 2, p. 410-425, 2001. https://doi.org/10.7202/003847ar

SAWYER, D. B. Fundamental Aspects of Interpreter Education. Amsterdam/Philadelphia: John Benjamins, 2004. https://doi.org/10.1075/btl.47

SELESKOVITCH, D.; LEDERER, M. Pédagogie Rasionnée de L’interprétation. 2eme edition, corrigée et augmentée. Paris and Brussels: Didier Érudition/Office des Publications Officielles des Commuautés Européennes, 2002.

SETTON, R.; DAWRANT, A. Conference Interpreting: A Trainer’s Guide. Amsterdam/Philadelphia: John Benjamins, 2016. https://doi.org/10.1075/btl.120

SHLESINGER, M. Quality in Simultaneous Interpreting. In: GAMBIER, Y.; GILE, D.; TAYLOR, C. (Ed.). Conference Interpreting: Current Trends in Research. Amsterdam/Philadelphia: John Benjamins, 1997. https://doi.org/10.1075/btl.23.08shl

SIKORSKI, J. Interpreter Aptituded in Testing – Procedures. In: BOGUCKI, L. (Ed.) Teaching Translation and Interpreting: Challenges and Practice. Newscastle upon Tyne: Cambridge Scholars, 2010.

STEVENSON, D. K. Beyond Faith and Face Validity: The Multitrait-Multimode Matrix and the Convergent and Discrimant Validity of Oral Proficiency Tests. In: PALMER, A. S. et al. (Ed.) The Construct Validation of Tests of Communicative Competence. Washington, D.C.: TESOL, 1981.

VIDAJOVIC, I. and GALACZI, E. The Measurement of Speaking Ability 1913-2012. In: WEIR, C. J.; Peter J. GROOT, M.; TROSPER, G. A. Measured Constructs: A History of Cambridge English language examinations 193-2012. Cambridge: Cambridge University Press, 2012.

WEIR, C. J. An overview of the influences on English language testing in the United Kingdom 1913-2012. In: WEIR, C. J. et al. Measured Constructs: A History of Cambridge English language examinations 193-2012. Cambridge: Cambridge University Press, 2012.

WEIR, C. J. et al. Measured Constructs: A History of Cambridge English Language Examinations 193-2012. Cambridge: Cambridge University Press, 2012.

WU, S. C. Some Reliability Issues of Simultaneous Interpreting Assessment within the Education Career. In: PELLATT, V.; GRIFFITHS, K.; WU, S.-C. Teaching and Testing Interpreting and Translating. Bern (Switzerland): Peter Lang, 2010.