Washback or backwash? Revisiting the status quo of washback and test impact in EFL contexts

Mohammad Ali Salmani Nodoushan

Abstract


It has been argued in the literature on (language) testing that any act of testing/assessment can impact (a) educators’ curriculum design, (b) teachers’ teaching practices, and (c) students’ learning behaviors. This quality of any given testing situation or act of assessment has been called washback, or backwash if you will. Washback falls into the two categories of positive or negative—that is, beneficial or harmful. After an overview of the existing scholarly knowledge on washback, this paper argues that washback is not necessarily a test quality. Drawing on the notion of test method facets, the paper lends support to claims that see washback as a main function of teaching, learning, and policy-making situations or conditions rather than a quality of any given test. The paper also argues that the concepts of facet design and analysis including formal research designs, structural hypothesis testing, and measurement are inevitable and inescapable in any comprehensive model of washback. A possible borderline between backwash and washback is also proposed. 


Keywords


assessment; backwash; coaching; test impact; testing; washback

Full Text:

PDF

References


Abadzi, H. (2009). Instructional time loss in developing countries: Concepts, measurement, and implications. The World Bank Research Observer, 24(2), 267-290. https://doi.org/10.1093/wbro/lkp008

Alderson, J. C. (2004). Foreword. In L. Cheng, Y. J. Watanabe & A. Curtis (Eds.), Washback in language testing: Research contents and methods (pp. 3-17). Lawrence Erlbaum Associates, Inc.

Alderson, J. C., & Hamp-Lyons, L. (1996). TOEFL preparation courses: A study of washback. Language Testing, 13, 280-297. https://doi.org/10.1177/026553229601300304

Alderson, J. C., & Wall, D. (1993). Does washback exist? Applied Linguistics, 14(2), 115-129. https://doi.org/10.1093/applin/14.2.115

Anderson, J. O., Muir, W., Bateson, D. J., Blackmore, D. & Rogers, W. T. (1990). The impact of provincial examinations on education in British Columbia: General report. British Columbia Ministry of Education.

Bachman, L. F. (1990). Fundamental considerations in language testing. Oxford University Press.

Bailey, K. M. (1996). Working for washback: A review of the washback concept in language testing. Language Testing, 13, 257-279. https://doi.org/10.1177/026553229601300303

Bailey, K. M. (2006). Issues in teaching speaking skills to adult ESOL learners. In J. Comings, B. Garner & C. Smith (Eds.), Review of adult learning and literacy: Connecting research, policy, and practice (pp. 113-164). Lawrence Erlbaum Associates.

Baker, E. L. (1991, September 4-6). Issues in policy, assessment, and equity [Paper presented]. National Research Symposium on Limited English Proficient Students’ Issues: Focus on Evaluation and Measurement, Washington DC, USA.

Bracey, G. W. (1989). The $150 million redundancy. Phi Delta Kappa, 70, 698-702.

Brown, J. D. (1997). The washback effect of language tests. University of Hawaii Working Papers in ESL, 16(1), 27-45.

Buck, G. (1988). Testing listening comprehension in Japanese university entrance examinations. Journal of the Japan Association of Language Teachers JALT, 10(1), 15-42.

Buschman, J. (2020). A political sociology of the Beall’s list affair. The Library Quarterly, 90(3), 298-313. https://doi.org/10.1086/708959

Caine, N. A. (2005). EFL examination washback in Japan: Investigating the effects of oral assessment on teaching and learning [Unpublished master’s thesis]. The University of Manchester.

Calder, P. (1990). Impact of diploma examinations on the teaching-learning process. Alberta Teacher Association.

Calder, P. (1997). Impact of Alberta achievement tests on the teaching-learning process. Alberta Teacher Association.

Cheng, L., & Curtis, A. (2004). Washback or backwash: A review of the impact of testing on teaching and learning. In L. Cheng, Y. J. Watanabe & A. Curtis (Eds.), Washback in language testing: Research contents and methods (pp. 3-17). Lawrence Erlbaum Associates, Inc.

Cooley, W. W. (1991). State-wide student assessment. Educational Measurement: Issues and Practice, 10, 3-6. https://doi.org/10.1111/j.1745-3992.1991.tb00209.x

Cronbach, L. J. (1988). Five perspectives on the validity argument. In H. Wainer & H. I. Braun (Eds.), Test validity (pp. 3-17). Lawrence Erlbaum Associates.

Darling-Hammond, L., & Wise, A. E. (1985). Beyond standardization: State standards and school improvement. The Elementary School Journal, 85, 315-336. https://doi.org/10.1086/461408

Davies, A. (Ed.). (1968). Language testing symposium: A psycholinguistic approach. Oxford University Press.

Davies, A. (1985). Follow my leader: Is that what language tests do? In Y. P. Lee, C. Y. Y. Fok, R. Lord & G. Low (Eds.), New directions in language testing (pp. 1-12). Pergamon Press.

Fish, J. (1988). Responses to mandated standardized testing [Unpublished doctoral dissertation]. University of California.

Frederiksen, J. R., & Collins, A. (1989). A system approach to educational testing. Educational Researcher, 18(9), 27-32. https://doi.org/10.2307/1176716

Frederiksen, N. (1984). The real test bias: Influences of testing on teaching and learning. American Psychology, 39, 193-202. https://doi.org/10.1037/0003-066X.39.3.193

Gardner, H. (1992). Assessment in context: The alternative to standardized testing. In B. R. Gifford & M. C. O’Connor (Eds.), Changing assessments: Alternative views of aptitude, achievement and instruction (pp. 77-119). Kluwer Academic.

Gates, S. (1995). Exploiting washback from standardized tests. In J. D. Brown & S. O. Yamashita (Eds.), Language testing in Japan (pp. 101-106). Japanese Association for Language Teaching.

Gifford, B. R., & O’Connor, M. C. (Eds.). (1992). Changing assessments: Alternative views of aptitude, achievement and instruction. Kluwer Academic.

Gipps, C. V. (1994). Beyond testing: Towards a theory of educational assessment. The Falmer Press.

Guttman, L. (1954). A new approach to factor analysis: The radex. In P. F. Lazarsfeld (Ed.), Mathematical thinking in the social sciences (pp. 258-348). Free Press.

Guttman, L. (1959). Introduction to facet design and analysis. Proceedings of the Fifteenth International Congress of Psychology (pp. 130-132). North-Holland.

Guttman, R., & Greenbaum, C. W. (1998). Facet theory: Its development and current status. European Psychologist, 3(1), 13-36. https://doi.org/10.1027/1016-9040.3.1.13

Haladyna, T. M. (1991, September 4-6). Test score pollution: Implications for limited English proficient students [Paper presentation]. Proceedings of the National Research Symposium on Limited English Proficient Student. Washington DC, USA.

Haladyna, T. M., Nolen, S. B., & Haas, N. S. (1991). Raising standardized achievement test scores and the origins of test score pollution. Educational Researcher, 20(5), 2-7. https://doi.org/10.2307/1176395

Heyneman, S. P. (1987). Uses of examinations in developing countries: Selection, research, and education sector management. International Journal of Education Development, 7, 251-263. https://doi.org/10.1016/0738-0593(87)90023-X

Hughes, A. (1989). Testing for language teachers. Cambridge University Press.

Hughes, A. (1993). Backwash and TOEFL 2000 [Unpublished manuscript]. Department of Linguistics, University of Reading.

Linn, R. L. (1992). Educational assessment: Expanded expectations and challenges (Tech. Rep. 351). University of Colorado at Boulder, Center for the Study of Evaluation.

Linn, R. L., Baker, E. L., & Dunbar, S. B. (1991). Complex, performance-based assessment: Expectations and validation criteria. Educational Researcher, 20(8), 15-21.

Luoma, S. (2001). What does your language test measure? [Unpublished doctoral dissertation]. University of Jyväskyla.

Madaus, G. F. (1988). The influence of testing on the curriculum. In L. N. Tanner (Ed.), Critical issues in curriculum: Eighty-seventh yearbook of the National Society for the Study of Education (pp. 83-121). University of Chicago Press.

Messick, S. (1989). Validity. In R. Linn (Ed.), Educational measurement (3rd ed., pp. 13-103). Macmillan.

Messick, S. (1994). The interplay between evidence and consequences in the validation of performance assessments. Educational Researcher, 23(2), 13-23. https://doi.org/10.2307/1176219

Messick, S. (1996). Validity and washback in language testing. Language Testing, 13(3), 241-256. https://doi.org/10.1177/026553229601300302

Morrow, K. (1986). The evaluation of tests of communicative performance. In M. Portal (Ed.), Innovations in language testing. NFER/Nelson.

Noble, A. J., & Smith, M. L. (1994a). Measurement-driven reform: Research on policy, practice, repercussion [Tech. Rep. 381]. Arizona State University, Center for the Study of Evaluation.

Noble, A. J., & Smith, M. L. (1994b). Old and new beliefs about measurement-driven reform: ‘The more things change, the more they stay the same’ [Tech. Rep. 373]. Arizona State University, Center for the Study of Evaluation.

Pearson, I. (1988). Tests as levers for change. In D. Chamberlain & R. J. Baumgardner (Eds.), ESP in the classroom: Practice and evaluation (pp. 98-107). Modern English.

Phelps, R. P. (2019). Test frequency, stakes, and feedback in student achievement: A meta-analysis. Evaluation Review. 43(3-4), 111-151. https://doi.org/10.1177/0193841X19865628

Salmani Nodoushan, M. A. (2006). A comparative sociopragmatic study of ostensible invitations in English and Farsi. Speech Communication, 48(8), 903-912. https://doi.org/10.1016/j.specom.2005.12.001

Salmani Nodoushan, M. A. (2009). The Shaffer-Gee perspective: Can epistemic games serve education? Teaching and Teacher Education, 25(6), 897-901. https://doi.org/10.1016/j.tate.2009.01.013

Salmani Nodoushan, M. A. (2012). A structural move analysis of discussion sub-genre in applied linguistics. DacoRomania, 17(2), 199-212.

Salmani Nodoushan, M. A. (2016a). On the functions of swearing in Persian. Journal of Language Aggression and Conflict, 4(2), 234-254. https://doi.org/10.1075/jlac.4.2.04sal

Salmani Nodoushan, M. A. (2016b). Rituals of death as staged communicative acts and pragmemes. In A. Capone & J. L. Mey (Eds.), Interdisciplinary studies in pragmatics, culture and society (pp. 925-959). Springer.

Salmani Nodoushan, M. A. (2018a). Implementation of the Beghetto-Kaufman-Baer approach to creativity and the four-c developmental trajectory in common core foreign language classrooms. In L. Caudle (Ed.), Teachers and teaching: Practices, challenges and prospects (pp. 157-174). Nova Science Publishers, Inc.

Salmani Nodoushan, M. A. (2018b). Toward a taxonomy of errors in Iranian EFL learners’ basic-level writing. International Journal of Language Studies, 12(1), 101-116.

Salmani Nodoushan, M. A. (2018c). Which view of indirect reports do Persian data corroborate? International Review of Pragmatics, 10(1), 76-100.

Salmani Nodoushan, M. A. (2019). Clearing the mist: The border between linguistic politeness and social etiquette. International Journal of Language Studies, 13(2), 109-120.

Salmani Nodoushan, M. A. (2020a). English for Specific Purposes: Traditions, trends, directions. Studies in English Language and Education, 7(1), 247-268. https://doi.org/10.24815/siele.v7i1.16342

Salmani Nodoushan, M. A. (2020b). Language assessment: Lessons learnt from the existing literature. International Journal of Language Studies, 14(2), 135-146.

Salmani Nodoushan, M. A. (2021a). Demanding versus asking in Persian: Requestives as acts of verbal harassment. International Journal of Language Studies, 15(1), 27-46.

Salmani Nodoushan, M. A. (2021b). Test affordances or test function? Did we get Messick’s message right? International Journal of Language Studies, 15(3), 127-139.

Shohamy, E. (1992). Beyond proficiency testing: A diagnostic feedback testing model for assessing foreign language learning. Modern Language Journal, 76, 513-521. https://doi.org/10.2307/330053

Shohamy, E. (1993). The power of test: The impact of language testing on teaching and learning. National Foreign Language Center Occasional Papers (pp. 1-19). The National Foreign Language Center.

Shohamy, E., Donitsa-Schmidt, S., & Ferman, I. (1996). Test impact revisited: Washback effect over time. Language Testing, 13, 298-317. https://doi.org/10.1177/026553229601300305

Smith, M. L. (1991). Put to the test: The effects of external testing on teachers. Educational Researcher, 20(5), 8-11. https://doi.org/10.3102/0013189X020005008

Smith, M. L., Edelsky, C., Draper, K., Rottenberg, C., & Cherland, M. (1989). The role of testing in elementary schools. Center for Research on Educational Standards and Student Tests, Graduate School of Education, UCLA.

Tsagari, D. (2007). Review of washback in language testing: How has been done? What more needs doing? [Unpublished manuscript]. Department of Linguistics, Lancaster University.

Turner, C. E., & Purpura, J. E. (2015). Learning oriented assessment in second and foreign language classrooms. In D. Tsagari & J. Banjeree (Eds.), Handbook of second language assessment (pp. 255-272). DeGruyter Mouton.

Vernon, P. E. (1956). The measurement of abilities (2nd ed.). University of London Press.

Wall, D. (1996). Introducing new tests into traditional systems: Insights from general education and from innovation theory. Language Testing, 13, 334-354. https://doi.org/10.1177/026553229601300307

Wall, D. (1999). The impact of high-stakes examinations on classroom teaching: A case study using insights from testing and innovation theory [Unpublished doctoral dissertation]. Lancaster University.

Wall, D. (2012). Washback. In G. Fulcher & F. Davidson (Eds.), The Routledge handbook of language testing (pp. 79-92). Routledge.

Wall, D., & Alderson, J. C. (1993). Examining washback: The Sri Lankan impact study. Language Testing, 10, 41-69. https://doi.org/10.1177/026553229301000103

Widen, M. F., O’Shea, T., & Pye, I. (1997). High-stakes testing and the teaching of science. Canadian Journal of Education, 22, 428-444. https://doi.org/10.2307/1585793

Wigglesworth, G. (2008). Task and performance based assessment. In E. Shohamy & N. H. Hornberger (Eds.), Language testing and assessment. Encyclopedia of language and education (vol. 7, pp. 111-22). Springer.

Wiseman, S. (Ed.). (1961). Examinations and English education. Manchester University Press.

Wolf, D., Bixby, J., Glenn, J., & Gardner, H. (1991). To use their minds well: Investigating new forms of student assessment. Review of Research in Education, 17, 31-74. https://doi.org/10.3102/0091732X017001031




DOI: https://doi.org/10.24815/siele.v8i3.21406

Refbacks

  • There are currently no refbacks.


Print ISSN: 2355-2794, Online ISSN: 2461-0275

This work is licensed under a Creative Commons Attribution 4.0 International License.