Call for Participation: COLIEE 2021@ICAIL 2021

[Ken Satoh (web mail)]

Dear colleagues,

We are happy to announce COLIEE 2021@ICAIL 2021.
Please consider the participation.

Best Regards,

On Behalf of COLIEE 2021 organizers,
Ken Satoh
National Institute of Informatics
2-1-2 Hitotsubashi, 101-8430, Tokyo, Japan
http://research.nii.ac.jp/~ksatoh/
------------------------------------------------
==================== CALL FOR PARTICIPATION ======================
Competition on Legal Information Extraction/Entailment (COLIEE) 2021,
in association with the International Conference on Artificial Intelligence and Law (ICAIL) 2021
http://www.ualberta.ca/~rabelo/COLIEE2021/
https://icail.lawgorithm.com.br
June 21-25, 2021, São Paulo, Brazil (Online Conference)

As an associated event of ICAIL 2021, we are happy to announce the 9th Competition on Legal Information Extraction and Entailment (COLIEE-2021), which will include tasks on both statute law and case law.

Four tasks are included in the 2021 edition: Tasks 1 and 2 are about case law, and tasks 3, 4 and 5(new task) are on statute law. Task 1 is a legal case retrieval task, and it involves reading a new case Q, and extracting supporting cases S1, S2…, Sn from the provided case law corpus, to support the decision for Q. Task 2 is the legal case entailment task, which involves the identification of one or more paragraphs from an existing case that entail the decision of a new case. As in previous COLIEE competitions, Task 3 is to consider a yes/no legal question Q and retrieve relevant statutes from a database of Japanese civil code statutes; Task 4 is to confirm entailment of a yes/no answer from the retrieved civil code statutes. Task 5 is to answer a yes/no question without the retrieved civil code statues.

Further details can be found in the following URL: http://www.ualberta.ca/~rabelo/COLIEE2021/

The datasets for Task 1 and Task 2 are in English, and the datasets for Task 3, Task 4 and Task 5 are available both in Japanese and English (translation from Japanese bar exams and civil code). You can choose any (or both) language datasets and any task for participation.

The intention is to build a community of practice regarding legal information processing and textual entailment, so that the adoption and adaptation of general methods from a variety of fields is considered, and that participants share their approaches, problems, and results.

We require participants to submit a paper on their method and experimental results to ICAIL 2021 in accordance with the instructions specified at https://icail.lawgorithm.com.br and to present the paper at the COLIEE workshop in ICAIL 2021 (held online).

Accepted papers will be published at an EPiC Series in Computing. The papers authored by the competition winners will be included in the main ICAIL 2021 proceedings if COLIEE organizers admit the paper novelty after the review process.

======================================================================
Important dates:
31 Jan, 2021 Training data release
08 Feb, 2021 Test data release
15 Mar, 2021 Submission deadline of competition test runs for task 3
19 Mar, 2021 Submission deadline of competition test runs for task 5
22 Mar, 2021 Return of competition test run rankings/assessments for task 3 and announcements of answers (relevant article(s) for each question) for task 4
29 Mar, 2021 Submission deadline of competition test runs for task 1 and 2
29 Mar, 2021 Submission deadline of competition test runs for task 4 using the above answers for the same test of bar exam questions
03 Apr, 2021 Announcements of rankings/ assessments for tasks 1, 2, 4 and 5
12 Apr, 2021 Paper submission deadline for the COLIEE workshop
26 Apr, 2021 Notification for the COLIEE workshop paper
10 May, 2021 Camera-ready copy deadline
21-25 Jun, 2021 ICAIL 2021 (one day for the COLIEE workshop)
======================================================================

Application Details:
Potential participants to COLLIE-2021 should respond to this call for participation by submitting an application. To apply, submit the application and memorandums of the following URL to rabelo(at)ualberta.ca .

Application:
http://www.ualberta.ca/~rabelo/COLIEE2021/application.pdf

Memorandum for Tasks 1 and/or 2 (Case law competition)
http://www.ualberta.ca/~rabelo/COLIEE2021/CL_memorandum.pdf

Memorandum for Tasks 3 and/or 4 and/or 5 (Statute law competition, English Data)
http://www.ualberta.ca/~rabelo/COLIEE2021/SL_EN_memorandum.pdf

Memorandum for Tasks 3 and/or 4 and/or 5 (Statute law competition, Japanese Data)
http://www.ualberta.ca/~rabelo/COLIEE2021/SL_JA_memorandum.pdf

An acknowledgement note will be sent to the email address supplied in the form once the form has been processed.

Task coordinators:
Mi-Young Kim, University of Alberta, Canada
Randy Goebel, University of Alberta, Canada
Juliano Rabelo, University of Alberta, Canada
Ken Satoh, National Institute of Informatics, Japan
Yoshinobu Kano, Shizuoka University, Japan
Masaharu Yoshioka, Hokkaido University, Japan

Questions and further information:
rabelo(at)ualberta.ca