POLEVAL 2021

Welcome to PolEval 2021!

PolEval is a SemEval-inspired evaluation campaign for natural language processing tools for Polish. Submitted tools compete against one another within certain tasks selected by organizers, using available data and are evaluated according to pre-established procedures.

PolEval 2021 Tasks

In 2021 the following tasks have been announced:

1. Punctuation restoration from read text
2. Evaluation of translation quality assessment metrics
3. Post-correction of OCR results
4. Question answering challenge

Discussions

Please join our Discord server to discuss PolEval competition in general and ask task-specific questions.

Previous editions

The tasks and results of previous editions are available through the links below:

• PolEval 2020
• PolEval 2019
• PolEval 2018
• PolEval 2017

PolEval introduction (in Polish)

Info

September 15, 2021

• The gold-standard annotations for test data are available. Please check Task descriptions for links.

September 6, 2021

• The results of PolEval 2021 are available through our evaluation platform: https://beta.poleval.pl/

June 24, 2021

• Meet us at Polish NLProc Meetup on June 24, 2021! We will discuss all the tasks and the upcoming evaluation platform for PolEval 2021!

June 14, 2021

• Task 4: Question answering challenge has been published!

May 18, 2021

• Task descriptions and data for Task 2 and Task 3 has been published!

February 5, 2021

• Call for Tasks for PolEval 2021 has started! Please submit your proposals until the end of February 2021.