Welcome to PolEval 2026!

PolEval is a SemEval-inspired evaluation campaign for natural language processing tools for Polish. Submitted tools compete against one another within certain tasks selected by organisers, using available data and are evaluated according to pre-established procedures.

PolEval 2026 Tasks

At the turn of 2026 and 2027, the next edition of PolEval, a shared task competition for computational tools for processing Polish, will take place. The aim of the shared task is to improve the quality of existing solutions, test new algorithms and methods, and support the development of computational linguistics.

We are now opening the Call for task proposals for PolEval 2026. Until September 7, 2026, we invite submissions from individuals, teams, and organisations interested in preparing and coordinating shared tasks as part of the competition.

A task proposal should include: 

  • task title – a short and unambiguous name;
  • task description – outlining its goal, scope, and main assumptions;
  • motivation and relevance – in particular, information on whether a similar task has already been organised as part of other competitions or benchmarks, e.g. for other languages; if the proposal concerns a new problem or a problem specific to Polish, please highlight its uniqueness and potential importance for the development of natural language processing;
  • task preparation status – in particular, information on the availability and status of training and test data, any licensing restrictions, and the expected date by which the complete dataset will be ready;
  • evaluation procedure – a description of how systems will be evaluated, including the proposed metrics, result submission procedure, etc.;
  • proposed timeline for running the task as part of PolEval 2026 – in particular, the expected dates for data release and completion of the evaluation.

Task organisers will be responsible for preparing the task description, data, and evaluation procedure; communicating with participants; coordinating the review process for submitted papers; and publishing a paper summarising the task in the PolEval proceedings in the ACL Anthology.

Task proposals should be sent to: lukasz.kobylinski@ipipan.waw.pl

Discussions

Please join our Discord server to discuss PolEval competition in general and ask task-specific questions.

Previous editions

The tasks and results of previous editions are available through the links below: