FOREIGN LANGUAGE RESEARCH 2018 No. 1 Serial No. 200 * H319 A DOI /j. cnki /h

Size: px

Start display at page:

Download "FOREIGN LANGUAGE RESEARCH 2018 No. 1 Serial No. 200 * H319 A DOI /j. cnki /h"

汤窦
5 years ago
Views:

1 FOREIGN LANGUAGE RESEARCH 2018 No. 1 Serial No. 200 * H319 A DOI /j. cnki /h Validity and Fairness in Language Assessment Jiang Xiu-juan Qufu Normal University Qufu China Beijing Foreign Studies University Beijing China Validity has been regarded as the key element of any assessment and fairness plays a very important role in achieving high validity. Based on the conceptual changes of validity and changes in the modes of validation this paper deals with the evolution of fairness studies in language assessment over the past 50 years from the following three perspectives categorized unitary and argumentative validity concepts. It reveals that the methods and contents in the study of fairness are nearly the same as those in the study of validity and validation and the assessment experts have different views towards the necessity of the fairness exploration in language assessment. According to the analysis above the paper summarizes the relationship between the two and points out what the further studies should explore thoroughly in the future. Key words language assessment validity fairness Zieky * 16CZWJ29 97

2 APA Technical Recommendations for Psychological Educational Testing Service ETS Tests and Diagnostic Techniques predictive validity concurrent validity content validity construct validity 1966 Standards for Educational and Psychological Tests and Manuals AERA et al. criterion-related validity 1961 Lado Language Testing Lado Valette 1967 Harris Messick unitary 1969 Heaton 1975 Finocchiaro Sako 1983 Heaton concept of validity Lado progressive matrix 1 1 Lado / Messick Messick construct-irrelevant Messick bias AERA et al Bachman Palmer 1996 test bias test usefulness framework Messick re- liability authenticity interactiveness impact practicality 6 McNamara Roever Differential Item Functioning DIF DIF DIF 98

3 Weigle 2002 Context Framework Messick 1989 Kunnan the Naturalization Test construct under-representation construct-irrele- 3 Kunnan vant variance Bachman Palmer Kunnan Messick Jensen 1980 Kunnan 2004 JCTP Bachman 2005 Kunnan 2009 Xi Kunnan AERA et al Kunnan Kunnan 2009 Kunnan the Test

4 Kane Kane et al Mislevy et al Toulmin 2003 practical 6 reasoning model 1 argument-based approach to validation Xi 2010 Domain definition Evaluation Generalization Explana- 4 tion Extrapolation Utilization 6 Toulmin 2003 counter-evi- 1 Toulmin dence Toulmin Xi Xi TOEFL ibt Kane 2006 interpretive argument validity argument 4 Xi Bachman Palmer 2010 Assessment Use Argument AUA 3 2 Kane 2006 Bachman 2005 Xi 2010 Fairness Argument Framework Xi Xi Xi TOEFL ibt 155 Xi 6 sub-argument 1 3 AUA Bachman Palmer

2018 1 6 4 Xi 2010 165 5 3 2010 Davies How do we go about investigating test fairness Xi 2010 1999 Davies 2010 173-175 Code of Fair Testing Practices in Education 2004. J. 2013 5. AERA APA NCME.

5 Xi Davies How do we go about investigating test fairness Xi Davies Code of Fair Testing Practices in Education J AERA APA NCME. Standards for Educational and Psychological Testing Z. Washington American Psycho- 4 logical Association Kunnan 2000 AERA APA NCME. Standards for Educational and Psychological Testing Z. Washington American Psycho- 3 Kunnan logical Association APA. Technical Recommendations for Psychological Tests and Diagnostic Techniques J. Psychological Bulletin Supplement com- APA AERA NCME. Standards for Educational and Psy- parable validity Willingham Cole chological Tests and Manuals Z. Washington Ameri- can Psychological Association

6 Bachman L. Building and Supporting a Case for Test Use J. Language Assessment Quarterly Bachman L. Palmer A. Language Testing in Practice M. Oxford OUP Bachman L. Palmer A. Language Assessment in Practice Developing Language Assessment and Justifying Their Use in the Real World M. Oxford OUP Davies A. Test Fairness A Response J. Language Testing Finocchiaro M. Sako S. Foreign Language Testing A Practical Approach M. New York Regents Publishing Company Harris D. Testing English as a Second Language M. New York McGraw-Hill Heaton J. Writing English Language Test M. London Longman Jensen H. R. Bias in Mental Testing M. New York Free Press Joint Committee on Testing Practices JCTP. Code of Fair Testing Practices in Education Z. Washington American Psychological Association Joint Committee on Testing Practices JCTP. Code of Fair Testing Practices in Education Z. Washington American Psychological Association Kane M. An Argument-based Approach to Validity J. Psychological Bulletin Kane M. Validating High-stakes Testing Programs J. Educational Measurement Issues and Practice Kane M. Certification Testing as an Illustration Argumentbased Validation J. Measurement Interdisciplinary Research and Perspectives Kane M. Validation A. In Brennan R. Ed.. Educational Measurement C. Westport Greenwood Publishing Kane M. Crooks T. Cohen A. Validating Measures of Performance J. Educational Measurement Issues and Practice Kunnan A. J. Fairness and Justice for All A. In Kunnan A. J. Ed. Fairness and Validation in Language Assessment Selected Papers from the 19th Language Testing Research Colloquium Orlando Florida Studies in Language Testing 9 C. Cambridge Cambridge University Press Kunnan A. J. Test Fairness A. In Milanovic M. Weir C. Eds. European Language Testing in a Global Context Proceedings of the ALTE Barcelona Conference C. Cambridge Cambridge University Press Kunnan A. J. Testing for Citizenship The U. S. Naturalization Test J. Language Assessment Quarterly Lado R. Language Testing M. London Longman McNamara T. F. Roever C. Language Testing The Social Dimension M. Oxford Blackwell Messick S. The Once and Future Issues of Validity Assessing the Meaning and Consequences of Measurement A. In Wainer H. Braun H. I. Eds. Test Validity C. Hillsdale Lawrence Erlbaum Messick S. Validity A. In Linn R. L. Ed. Educational Measurement C. New York American Council on Education and Macmillan Mislevy R. Steinberg L. Almond R. Design and Analysis in Task-based Language Assessment J. Language Testing Mislevy R. Steinberg L. Almond R. On the Structure of Educational Assessments J. Measurement Interdisciplinary Research and Perspectives Toulmin S. The Use of Argument Updated Edition M. Cambridge CUP Valette R. Modern Language Testing M. New York Harcourt Brace & World Weigle S. Assessing Writing M. Cambridge CUP Willingham W. W. Cole N. Gender and Fair Assessment M. Mahwah Lawrence Erlbaum Associates Xi X. How Do We Go about Investigating Test Fairness J. Language Testing Zieky M. Fairness Review in Assessment A. In Downing S. Haladyna T. Eds. Handbook of Test Development C. Mahwah Lawrence Erlbaum

Microsoft Word - 3906.doc

Microsoft Word - 3906.doc 在线测试离我们有多远? 语言在线测试调研报告陈晓红, 蔡静 ( 北京外国语大学网络教育学院, 北京 100089) 摘要 : 本文是一篇关于英语在线测试的调研报告, 由三部分组成第一部分介绍计算机在语言测试中的重要作用及各种基于计算