<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.3 20210610//EN" "JATS-journalpublishing1-3.dtd">
<article article-type="research-article" dtd-version="1.3" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xml:lang="ru"><front><journal-meta><journal-id journal-id-type="publisher-id">inppd</journal-id><journal-title-group><journal-title xml:lang="ru">Инновационная наука: Психология. Педагогика. Дефектология</journal-title><trans-title-group xml:lang="en"><trans-title>Innovative science: psychology, pedagogy, defectology</trans-title></trans-title-group></journal-title-group><issn pub-type="epub">2658-7165</issn><publisher><publisher-name>Don State Technical University - DSTU, Rostov-on-Don, Russia</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.23947/2658-7165-2021-4-4-71-84</article-id><article-id custom-type="elpub" pub-id-type="custom">inppd-133</article-id><article-categories><subj-group subj-group-type="heading"><subject>Research Article</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="ru"><subject>ОБЩАЯ ПЕДАГОГИКА, ИСТОРИЯ ПЕДАГОГИКИ И ОБРАЗОВАНИЯ</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="en"><subject>GENERAL PEDAGOGY, HISTORY OF PEDAGOGY AND EDUCATION</subject></subj-group></article-categories><title-group><article-title>Надежность оценочной системы как условие качественного управления обучением</article-title><trans-title-group xml:lang="en"><trans-title>Reliability of the assessment system as a condition of qualitative learning management</trans-title></trans-title-group></title-group><contrib-group><contrib contrib-type="author" corresp="yes"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0003-4556-008X</contrib-id><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Ефремова</surname><given-names>Н. Ф.</given-names></name><name name-style="western" xml:lang="en"><surname>Efremova</surname><given-names>N. F.</given-names></name></name-alternatives><bio xml:lang="ru"><p>Надежда Ф. Ефремова</p><p>г. Ростов-на-Дону</p></bio><bio xml:lang="en"><p>Nadezhda F. Efremova</p><p>Rostov-on-Don</p></bio><email xlink:type="simple">nefremova61@donstu.ru</email><xref ref-type="aff" rid="aff-1"/></contrib></contrib-group><aff-alternatives id="aff-1"><aff xml:lang="ru"><institution>Донской государственный технический университет</institution><country>Россия</country></aff><aff xml:lang="en"><institution>Don State Technical University</institution><country>Russian Federation</country></aff></aff-alternatives><pub-date pub-type="collection"><year>2021</year></pub-date><pub-date pub-type="epub"><day>15</day><month>08</month><year>2023</year></pub-date><volume>4</volume><issue>4</issue><fpage>71</fpage><lpage>84</lpage><permissions><copyright-statement>Copyright &amp;#x00A9; Ефремова Н.Ф., 2021</copyright-statement><copyright-year>2021</copyright-year><copyright-holder xml:lang="ru">Ефремова Н.Ф.</copyright-holder><copyright-holder xml:lang="en">Efremova N.F.</copyright-holder><license xml:lang="ru" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>Данная работа распространяется под лицензией Creative Commons Attribution 4.0.</license-p></license><license xml:lang="en" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>This work is licensed under a Creative Commons Attribution 4.0 License.</license-p></license></permissions><self-uri xlink:href="https://www.inov-ppd.ru/jour/article/view/133">https://www.inov-ppd.ru/jour/article/view/133</self-uri><abstract><p>Во Введении раскрываются причины необходимости нового взгляда на оценку образовательных достижений обучающихся. В первую очередь это связано с процессами международной интеграции в сфере образования, компетентностным подходом к процессу и результатам обучения, расширением техник и технологий обучения. Поэтому задача повышения объективности оценки рассматривается как педагогический аспект, требующий исследований по совершенствованию оценочных процедур и инструментария. Однако в педагогической практике ключевым ценностям надежного оценивания пока уделяется недостаточно внимания и, особенно, при оценивании компетенций как результатов освоения образовательных программ. В своем большинстве преподаватели используют традиционные средства оценки, не позволяющие выявить и оценить глубоко латентные характеристики в форме компетенций, которые, по сути, и обеспечивают успешность личности в профессиональной деятельности. Вместе с тем основные принципы построения качественной оценки требуют все большего внимания в связи с цифровой трансформацией системы образования, расширением различных форм дистанционного обучения, большей самостоятельностью обучающихся при выборе образовательной траектории.В Теоретическом обосновании показаны основные направления научно обоснованного подхода к аргументированной доказательности оценки. Логика современного оценивания требует организации деятельности обучающихся при выполнении комплексных заданий. Проектирование такого оценочного инструментария требует соблюдения ряда правил, которые обеспечивают надежность результатов, а соответственно, помогают обоснованно управлять процессом обучения, оказывая помощь обучающимся на каждом значимом этапе освоения образовательной программы. В Обсуждении результатов показаны принципы создания инновационного инструментария для комплексного оценивания образовательных достижений в условиях организации планируемой деятельности обучающихся в ситуации оценки.В Заключении автором сделан акцент на трудностях создания комплексных оценочных средств и возможностях решения этой проблемы в системе вуза.</p></abstract><trans-abstract xml:lang="en"><p>The Introduction part reveals the reasons for the need for a new perspective on the assessment of educational achievements of students is required. First of all, it is connected with the international integration processes in the education sphere, competence-based approach to the process and learning outcomes, techniques expansion and learning technologies. Therefore, the improving task to the assessment objectivity is considered as a pedagogical aspect, requiring research to improve assessment procedures and tools. However, in pedagogical practice the key values of reliable assessment are not yet paid enough attention and, especially, when assessing competencies as learning outcomes. Most teachers use traditional assessment tools which do not allow identifying and assessing deeply latent characteristics in the competencies form which, in fact, ensure the success of an individual in professional activity. At the same time, the basic principles of qualitative assessment construction require more and more attention due to digital transformation of the education system, expansion various forms of distance learning, greater student’s independence when choosing an educational trajectory.The Theoretical justification part shows the main directions of scientifically grounded approach to evidence-based assessment. The modern assessment logic requires organizing the students activities when completing complex tasks. Designing such an assessment toolkit requires adherence to a rules number that ensure the reliable results help reasonably manage the learning process by assisting learners at each mastering meaningful stage of the educational program.The Discussion of the results shows the creating innovative tools principles for comprehensive assessment of educational achievements in the conditions organizing the planned student’s activities in an assessment situation are shown.In Conclusion author focuses on the difficulties of creating complex assessment tools and the possibilities of solving this problem in the university system.</p></trans-abstract><kwd-group xml:lang="ru"><kwd>результаты обучения</kwd><kwd>оценочный инструментарий</kwd><kwd>надежность</kwd><kwd>компетенции</kwd><kwd>проектирование оценки</kwd><kwd>доказательная аргументация</kwd></kwd-group><kwd-group xml:lang="en"><kwd>learning outcomes</kwd><kwd>assessment tools</kwd><kwd>reliability</kwd><kwd>competencies</kwd><kwd>assessment design</kwd><kwd>evidence-based argumentation</kwd></kwd-group></article-meta></front><back><ref-list><title>References</title><ref id="cit1"><label>1</label><citation-alternatives><mixed-citation xml:lang="ru">Декларация участников IV форума по вопросам политики Болонского процесса Ереван. (2015). Высшее образование в России, 10, 65–67.</mixed-citation><mixed-citation xml:lang="en">Almond, R. G., Mislevy, R. J., Steinberg, L., Yan, D., Williamson, D. M. (2019). Bayesian networks in educational assessment. Technology, Knowledge and Learning, 24, 97–99. doi: https://doi.org/10.1007/s10758-016-9292-x</mixed-citation></citation-alternatives></ref><ref id="cit2"><label>2</label><citation-alternatives><mixed-citation xml:lang="ru">Ефремова, Н. Ф. (2018)a. Аргументации и доказательства надежности оценок компетенций студентов. Известия Дагестанского государственного педагогического университета. Психолого-педагогические науки, 12(2), 43–50.</mixed-citation><mixed-citation xml:lang="en">Awwal, N., Scoular, C., Griffin, P. (2016). Implementation issues with games-based assessment. In International Conference on Education and New Learning Technologies, EDULEARN16 Proceedings (pp. 905–910). Barcelona: IATED. doi: http://dx.doi.org/10.21125/edulearn.2016.1179</mixed-citation></citation-alternatives></ref><ref id="cit3"><label>3</label><citation-alternatives><mixed-citation xml:lang="ru">Ефремова, Н. Ф. (2018)b. Проектирование оценочных средств по модели доказательной аргументации. Педагогические измерения, 3, 8–15.</mixed-citation><mixed-citation xml:lang="en">Declaration of the participants of the IV Policy Forum Bologna Process Yerevan. (2015). Higher education in Russia, 10, 65–67. (in Russ.).</mixed-citation></citation-alternatives></ref><ref id="cit4"><label>4</label><citation-alternatives><mixed-citation xml:lang="ru">Звонников, В. И., Малыгин, А. А., Челышкова, М. Б. (2012). Оценивание в высшем образовании: от линейности к адаптивности. Известия высших учебных заведений. Серия: Гуманитарные науки, 5(2), 166–171. Ризви, С., Барбер, М., Доннелли, К. (2013). Накануне схода лавины. Высшее образование и грядущая революция (пер. с англ. Н. Микшиной). Вопросы образования, 3, 152–229.</mixed-citation><mixed-citation xml:lang="en">Efremova, N. (2021). Problems of competence-based learning in a digital environment. In XIV International Scientific and Practical Conference “State and Prospects for the Development of Agribusiness - INTERAGROMASH 2021”, E3S Web of Conferences 273, 12082. doi: https://doi.org/10.1051/e3sconf/202127312082</mixed-citation></citation-alternatives></ref><ref id="cit5"><label>5</label><citation-alternatives><mixed-citation xml:lang="ru">Стандарты и руководства для обеспечения качества высшего образования в Европейском пространстве высшего образования (ESG). (2015). ENQA. URL: https://pandia.ru/text/80/268/56052.php (дата обращения: 20.07.2021).</mixed-citation><mixed-citation xml:lang="en">Efremova, N., Huseynova, A. (2021). The impact of digital technology on learning motivation and learning modes. In XIV International Scientific and Practical Conference “State and Prospects for the Development of Agribusiness - INTERAGROMASH 2021”, E3S Web of Conferences 273, 12083. doi: https://doi.org/10.1051/e3sconf/202127312083</mixed-citation></citation-alternatives></ref><ref id="cit6"><label>6</label><citation-alternatives><mixed-citation xml:lang="ru">Almond, R. G., Mislevy, R. J., Steinberg, L., Yan, D., Williamson, D. M. (2019). Bayesian networks in educational assessment. Technology, Knowledge and Learning, 24, 97–99. doi: https://doi.org/10.1007/s10758-016-9292-x</mixed-citation><mixed-citation xml:lang="en">Efremova, N. F. (2018)a. Arguments and evidence for the reliability of assessments of students' competencies. Vestnik of the Dagestan State Pedagogical University. Psychological and pedagogical sciences, 12(2), 43–50. (in Russ.).</mixed-citation></citation-alternatives></ref><ref id="cit7"><label>7</label><citation-alternatives><mixed-citation xml:lang="ru">Awwal, N., Scoular, C., Griffin, P. (2016). Implementation issues with games-based assessment. In International Conference on Education and New Learning Technologies, EDULEARN16 Proceedings (pp. 905–910). Barcelona: IATED. doi: http://dx.doi.org/10.21125/edulearn.2016.1179</mixed-citation><mixed-citation xml:lang="en">Efremova, N. F. (2018)b. Designing assessment tools according to the model of evidence-based argumentation. Pedagogical measurements, 3, 8–15. (in Russ.).</mixed-citation></citation-alternatives></ref><ref id="cit8"><label>8</label><citation-alternatives><mixed-citation xml:lang="ru">Efremova, N. (2021). Problems of competence-based learning in a digital environment. In XIV International Scientific and Practical Conference “State and Prospects for the Development of Agribusiness - INTERAGROMASH 2021”, E3S Web of Conferences 273, 12082. doi: https://doi.org/10.1051/e3sconf/202127312082</mixed-citation><mixed-citation xml:lang="en">Gibson, D. C., Webb, M. E. (2015). Data science in educational assessment. Education and Information Technologies, 20, 697–713. doi: https://doi.org/10.1007/s10639-015-9411-7</mixed-citation></citation-alternatives></ref><ref id="cit9"><label>9</label><citation-alternatives><mixed-citation xml:lang="ru">Efremova, N., Huseynova, A. (2021). The impact of digital technology on learning motivation and learning modes. In XIV International Scientific and Practical Conference “State and Prospects for the Development of Agribusiness - INTERAGROMASH 2021”, E3S Web of Conferences 273, 12083. doi: https://doi.org/10.1051/e3sconf/202127312083</mixed-citation><mixed-citation xml:lang="en">Lambert, W. T. Schuwirth, Cees, P. M. Van der Vleuten. (2011). Programmatic assessment: from assessment of learning to assessment for learning. Medical teacher, 33, 478–485. doi: https://doi.org/10.3109/0142159X.2011.565828</mixed-citation></citation-alternatives></ref><ref id="cit10"><label>10</label><citation-alternatives><mixed-citation xml:lang="ru">Gibson, D. C., Webb, M. E. (2015). Data science in educational assessment. Education and Information Technologies, 20, 697–713. doi: https://doi.org/10.1007/s10639-015-9411-7</mixed-citation><mixed-citation xml:lang="en">Mislevy, R. J., Almond, R. G., Lukas, J. F. (2003). A Brief Introduction to Evidencecentered Design. Educational Testing Service, Research &amp; Development Division Princeton, NJ 08541.</mixed-citation></citation-alternatives></ref><ref id="cit11"><label>11</label><citation-alternatives><mixed-citation xml:lang="ru">Lambert, W. T. Schuwirth, Cees, P. M. Van der Vleuten. (2011). Programmatic assessment: from assessment of learning to assessment for learning. Medical teacher, 33, 478–485. doi: https://doi.org/10.3109/0142159X.2011.565828</mixed-citation><mixed-citation xml:lang="en">Mislevy, R. J., Behrens, J. T., Dicerbo, K. E., Levy, R. (2012). Design and discovery in educational assessment: evidence-centered design, psychometrics, and educational data mining. Journal of Educational Data Mining, 4(1), 11–48.</mixed-citation></citation-alternatives></ref><ref id="cit12"><label>12</label><citation-alternatives><mixed-citation xml:lang="ru">Mislevy, R. J., Almond, R. G., Lukas, J. F. (2003). A Brief Introduction to Evidencecentered Design. Educational Testing Service, Research &amp; Development Division Princeton, NJ 08541.</mixed-citation><mixed-citation xml:lang="en">Mohan, B. (2021). Analects of Higher Education. Academia Letters, 1221. doi: https://doi.org/10.20935/AL1221.</mixed-citation></citation-alternatives></ref><ref id="cit13"><label>13</label><citation-alternatives><mixed-citation xml:lang="ru">Mislevy, R. J., Behrens, J. T., Dicerbo, K. E., Levy, R. (2012). Design and discovery in educational assessment: evidence-centered design, psychometrics, and educational data mining. Journal of Educational Data Mining, 4(1), 11–48.</mixed-citation><mixed-citation xml:lang="en">Mulder, M. (2017). Competence-based Vocational and Professional Education. Cham: Springer. doi: https://doi.org/10.1007/978-3-319-41713-4</mixed-citation></citation-alternatives></ref><ref id="cit14"><label>14</label><citation-alternatives><mixed-citation xml:lang="ru">Mohan, B. (2021). Analects of Higher Education. Academia Letters, 1221. doi: https://doi.org/10.20935/AL1221.</mixed-citation><mixed-citation xml:lang="en">Pellegrino, J. W. (2014). Assessment as a Positive Influence on 21st Century Teaching and Learning: A Systems Approach to Progress. Psicología Educativa, 20(2), 65–77.</mixed-citation></citation-alternatives></ref><ref id="cit15"><label>15</label><citation-alternatives><mixed-citation xml:lang="ru">Mulder, M. (2017). Competence-based Vocational and Professional Education. Cham: Springer. doi: https://doi.org/10.1007/978-3-319-41713-4</mixed-citation><mixed-citation xml:lang="en">Rizvi, S., Barber, M., Donnelly, K. (2013). On the eve of the avalanche. Higher education and the coming revolution (translated from English by N. Mikshina). Educational issues, 3, 152–229. (in Russ.).</mixed-citation></citation-alternatives></ref><ref id="cit16"><label>16</label><citation-alternatives><mixed-citation xml:lang="ru">Pellegrino, J. W. (2014). Assessment as a Positive Influence on 21st Century Teaching and Learning: A Systems Approach to Progress. Psicología Educativa, 20(2), 65–77.</mixed-citation><mixed-citation xml:lang="en">Shute, V. J., Leighton, J. P., Jang, E. E., Chu, M.-W. (2016). Advances in the Science of Assessment. Educational Assessment, 21(1), 34–59. doi: https://doi.org/10.1080/10627197.2015.1127752</mixed-citation></citation-alternatives></ref><ref id="cit17"><label>17</label><citation-alternatives><mixed-citation xml:lang="ru">Shute, V. J., Leighton, J. P., Jang, E. E., Chu, M.-W. (2016). Advances in the Science of Assessment. Educational Assessment, 21(1), 34–59. doi: https://doi.org/10.1080/10627197.2015.1127752</mixed-citation><mixed-citation xml:lang="en">Shute, V. J., Rahimi, S. (2017). Review of computer-based assessment for learning in elementary and secondary education. Journal of Computer Assisted Learning, 33(1), 1–19. doi: https://doi.org/10.1111/jcal.12172</mixed-citation></citation-alternatives></ref><ref id="cit18"><label>18</label><citation-alternatives><mixed-citation xml:lang="ru">Shute, V. J., Rahimi, S. (2017). Review of computer-based assessment for learning in elementary and secondary education. Journal of Computer Assisted Learning, 33(1), 1–19. doi: https://doi.org/10.1111/jcal.12172</mixed-citation><mixed-citation xml:lang="en">Standards and guidelines for quality assurance in higher education in the European Higher Education Area (ESG). (2015). ENQA. URL: https://pandia.ru/text/80/268/56052.php (accessed: 07/20/2021). (in Russ.).</mixed-citation></citation-alternatives></ref><ref id="cit19"><label>19</label><citation-alternatives><mixed-citation xml:lang="ru">Uludag, G., Bardakci, S., Yildiz, O. F., Tunc, Y., Akkoyunlu, B., Nasir, V. A., Ercan, S., Elmas, M. (2020). Assessing Students' Learning Online: It's More Than Testing. In Teachıng And Learnıng Qualıty Assurance in Hıgher Educatıon Under the Pandemıc. Proceedings of the 12th Higher Education International Conference 12 (pp. 40–50). Macao: Macao Polytechnic Institute.</mixed-citation><mixed-citation xml:lang="en">Uludag, G., Bardakci, S., Yildiz, O. F., Tunc, Y., Akkoyunlu, B., Nasir, V. A., Ercan, S., Elmas, M. (2020). Assessing Students' Learning Online: It's More Than Testing. In Teachıng And Learnıng Qualıty Assurance in Hıgher Educatıon Under the Pandemıc. Proceedings of the 12th Higher Education International Conference 12 (pp. 40–50). Macao: Macao Polytechnic Institute.</mixed-citation></citation-alternatives></ref><ref id="cit20"><label>20</label><citation-alternatives><mixed-citation xml:lang="ru">Zvonnikov, V. I., Malygin, A. A., Chelyshkova, M. B. (2012). Assessment in Higher Education: From Linearity to Adaptability. Proceedings of universities. Series: Humanitarian sciences, 5(2), 166–171. (in Russ.).</mixed-citation><mixed-citation xml:lang="en">Zvonnikov, V. I., Malygin, A. A., Chelyshkova, M. B. (2012). Assessment in Higher Education: From Linearity to Adaptability. Proceedings of universities. Series: Humanitarian sciences, 5(2), 166–171. (in Russ.).</mixed-citation></citation-alternatives></ref></ref-list><fn-group><fn fn-type="conflict"><p>The authors declare that there are no conflicts of interest present.</p></fn></fn-group></back></article>
