Stockholm university

Research seminar: Really good grammatical error correction, and how to evaluate it

Seminar

Date: Wednesday 11 January 2023

Time: 13.00 – 14.00

Location: M20, DSV, Campus Kista or Zoom

Welcome to a research seminar with Robert Östling, Department of Linguistics at Stockholm University. We will discuss language technology, ChatGPT and AI-supported assessment.

About the seminar
Grammatical error correction (GEC) has received relatively little attention for Swedish, with much of the important work published two decades ago. We perform a thorough evaluation using both automatic and manual methods of three very different types of models: the rule-based Granska system, a sequence-to-sequence model trained on artificial data, and the GPT-3 language model in a few-shot setup. We find that GPT-3 by far outperforms the other GEC systems for Swedish, a language comprising only 0.11% of its training data. When evaluating this heterogeneous set of GEC systems, we were also able to investigate how different evaluation methods are biased towards certain types of systems.

Robert Östling is a researcher in computational linguistics.
Read about his work


Registration
To register for this seminar, send an e-mail to Harko Verhagen, verhagen@dsv.su.se.
Please indicate if you wish to participate on site or online!

There are a limited number of seats in room M20 at the Department of Computer and Systems Sciences (DSV) which is located in the Nod building, Borgarfjordsgatan 12, Kista.
Find your way to DSV

For online participants, a Zoom link will be available upon registration.