#4165. Development and validation of a rating scale for summarization as an integrated task

August 2026publication date
Proposal available till 25-05-2025
4 total number of authors per manuscript0 $

The title of the journal is available only for the authors who have already paid for
Journal’s subject area:
Education
Places in the authors’ list:
place 1place 2place 3place 4
FreeFreeFreeFree
2350 $1200 $1050 $900 $
Contract №4165.1 Contract №4165.2 Contract №4165.3 Contract №4165.4
1 place - free (for sale)
2 place - free (for sale)
3 place - free (for sale)
4 place - free (for sale)

Abstract:
Summary writing is essential for academic success, and has attracted renewed interest in academic research and large-scale language test. This study reports on the validation of a summary rubric that represented an approach to scale development with limited resources out of consideration for practicality. Participants were 83 students and three raters. Diagnostic evaluation of the scale components and categories was based on raters’ perception of their use and the scores of students’ summaries which were analyzed using multifaceted Rasch measurement (MFRM). Correlation analysis revealed significant relationships among the scoring components, but the coefficients among some of the components were over high. MFRM analysis provided evidence in support of the usefulness of the scoring rubric, but also suggested the need of a refinement of the components and categories. This study has implications for summarization task design, scoring scale development and validation in particular.
Keywords:
Practicality; Scale development; Summary writing; Task design; Validation

Contacts :
0