Título:
RETUYT-INCO at BEA 2026 Shared Task 2: meta-prompting in Rubric-based Scoring for German
Otros títulos:
Coordinador:
Director:
Compilador:
Autor:
Sastre, Ignacio
Remersaro, Ignacio
Díaz, Facundo
de Horta, Nicolás
Chiruzzo, Luis
Rosá, Aiala
Góngora, Santiago
Remersaro, Ignacio
Díaz, Facundo
de Horta, Nicolás
Chiruzzo, Luis
Rosá, Aiala
Góngora, Santiago
Tutor:
Tipo de documento:
Ponencia
Editor:
Palabras clave:
Descriptores:
Año de publicación:
2026
Contenido:
Resumen:
In this paper, we present the RETUYT-INCO participation at the BEA 2026 shared task “Rubric-based Short Answer Scoring for German”. Our team participated in track 1 (Unseen answers three-way), track 3 (Unseen answers two-way) and track 4 (Unseen questions two-way). Since these tracks required scoring
short student answers using specific rubrics, we looked for ways to handle the changing nature of the task. We created a method called Metaprompting. In this approach, an LLM creates a custom prompt based on examples from the Train set. This prompt is then used to grade new student answers. Along with this method,
we also describe other approaches we used, such as classic machine learning, fine-tuning open-source LLMs, and different prompting techniques. According to the official results, our team placed 6th out of 8 participants in
Track 1 with a QWK of 0.729. In Track 3, we secured 4th place out of 9 with a QWK of 0.674, and we also placed 4th out of 8 in Track 4 with a QWK of 0.49.
Descripción:
metadata.articulos.dc.description.uri:
Editorial:
EN:
Proceedings of the 21st Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2026), pp. 1235–1243 July 3-4, 2026, San Diego, California, USA. Association for Computational Linguistics.
Financiadores:
FSED_2_2023_1_179355
Citación:
Sastre, I., Remersaro, I., Díaz, F. y otros. RETUYT-INCO at BEA 2026 Shared Task 2: meta-prompting in Rubric-based Scoring for German [en línea] EN: Proceedings of the 21st Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2026), pp. 1235–1243 July 3-4, 2026, San Diego, California, USA. Association for Computational Linguistics.
Citación:
metadata.articulos.cc.license.name:
ISBN:
e-ISBN:
ISSN:
ISMN:
Otros identificadores:
Cobertura geográfica:
Cobertura temporal:
Departamento académico:
Grupo de investigación:
Licencia:
Licencia Creative Commons Atribución - No Comercial - Sin Derivadas (CC - By-NC-ND 4.0)
Colecciones:
| Ficheros | Descripción | Tamaño | Formato | ||
|---|---|---|---|---|---|
| SRDHCRG26.pdf | Versión definitiva | 207.47 KB | Adobe PDF |