ARGUMENTS AND EVIDENCE OF RELIABILITY ASSESSMENT OF STUDENTS’ COMPETENCES
https://doi.org/10.31161/1995-0659-2018-12-2-43-50
Abstract
The aim of this study is a new approach to ensuring the reliable evaluation of the students’ competencies.
Method. Analysis of the possibilities of the new method of designing the pedagogical meters based on the pattern-design Evidence-Centered Design (ECD), providing the evidence and argumentation of assessments of subjects. The ECD method has found wide application in foreign education, but is little known in the domestic education system.
Results. The algorithm for designing students' assessment tools based on ECD is proposed by connecting the model of the student (knowledge and competences) and the model of a significant task with a set of evidence and argumentation of the observed results of the student's activity. The use of evidence-based design in the development of evaluation tools creates a reliable basis for establishing a link between the assessment and adjustment of educational policies.
Conclusions. For effective organization of the educational process a feedback plays an important role, which is ensured by the reliability of estimates, which in turn requires the development of a reliable evaluation tool. The problem is related to the fact that the construction of evaluation tools causes difficulties for teachers. This approach can be successfully applied both in the evaluation of students’ knowledge and in the evaluation of competencies, ensuring the reliability of results, the relationship between the processes of developing the assessment system and ensuring the conditions of activity, so that with the use of knowledge, students show what and how they can do.
About the Author
N. F. Efremova
Don State Technical University (DSTU).
Russian Federation
Russian Federation
Nadezhda F. Efremova, Doctor of Pedagogy, professor, the head of the chair of Pedagogical Measurements.
Rostov-on-Don.
References
1. Efremova N. F. Approaches to assessing the competence of first-year students, embarking on the development of basic educational programs. Vestnik Donskogo gosudarstvennogo tekhnicheskogo universiteta [Bulletin of Don State Technical University]. 2010. Vol. 10. No. 5 (48). Pp. 774-782. (In Russian)
2. Efremova N. F. Educational achievements as an object of testing and an indicator of quality in education. Voprosy testirovaniya v obrazovanii [Issues of Testing in Education]. 2004. No. 9. Pp. 39-50. (In Russian)
3. Assessing model-based reasoning using evidence-centered design: a suite of research-based design patterns by R. J. Mislevy, G. Haertel, M. Riconscente, D. Rutstein, C. Ziker. 2017, Springer Publ. 130 p. (In Russian)
4. Griffin P., McGaw B., Editors E. Assessment and Teaching of 21st Century Skills. Springer Dordrecht Heidelberg. London, New York, 2014. 362 p. (In Russian)
5. Messick S. The interplay of evidence and consequences in the validation of performance assessments. Education Researcher, 1994. 32 (2). Pp. 13–23. (In Russian)
6. Mislevy R. J., Almond R. G., & Lukas J. F. (2003). A brief introduction to evidence-centered design. (ETS Research Report RR-03-16). Princeton, NJ: Educational Testing Service. 2003. 37 p.
7. Mislevy R. J., Levy R. Bayesian psychometric modeling from an evidence-centered design perspective. In: Rao, C.R., Sinharay, S. eds. Handbook of statistics. Elsevier, Amsterdam, 2007. Pp. 839-865.
8. Sukin T., Dunn J. Validity Argument for a Statewide Alternative Assessment. Addressing Inferences with Novel Approaches. National Council for Educational Measurement. Vancouver, 2012. 33 p.
9. Toulmin S. E. The uses of argument. Cambridge, Cambridge University Press Publ., 1958. 264 p.
10. Van der Linden, W. J., & Glas, C.A.W. (2010). Elements of adaptive testing. New York, Springer Publ., 2010. 462 p.
Review
For citations:
Efremova N.F. ARGUMENTS AND EVIDENCE OF RELIABILITY ASSESSMENT OF STUDENTS’ COMPETENCES. Dagestan State Pedagogical University. Journal. Psychological and Pedagogical Sciences. 2018;12(2):43-50. (In Russ.) https://doi.org/10.31161/1995-0659-2018-12-2-43-50
Views:
154
Email this article 