Img

Shared Task Description

AILBIZ 2021 includes a shared task with experimental datasets recently developed by the organizers, which contain more than 200k timecard narratives and 2k matters. Baseline systems are available to the shared task participants for reference purposes. The shared task includes two tracks and one discussion session:

* Track 1: unsupervised approaches for understanding legal matter structure. In this track, participating teams are invited to process data without using any external sources of knowledge. The objective is to break down matters into meaningful units of work by following UTBMS code definitions.

* Track 2: semi-supervised approaches for understanding legal matter structure. Within this track, participating teams are invited to process data along with external sources of knowledge to guide the decomposition of legal matters into predefined units of work by following UTBMS code definitions.

* Discussion session: integration of traditional business logic and AI. This discussion session invites for position papers superficially focusing on the problem of incorporating AI/ML based solutions into more traditional business logic for a more comprehensive approach to timecard processing and legal business understanding.

Participation Instructions

The Shared Task is hosted at Codalab. All information needed for registering and participating at the two competition tracks is available at their corresponding competition pages:

* Track 1: unsupervised approaches for understanding legal matter structure.

* Track 2: semi-supervised approaches for understanding legal matter structure.

The competition is run in two phases: "Preparation Phase" and "Evaluation Phase". During the first phase, participants are able to make up to 3 submissions per day with a total maximum of 60 submissions. During the second phase, which constitutes the final evaluation, participants are able to make a total of 5 submissions only.

Important Dates

* March 15, 2021: Phase 1 (Preparation Phase) Starts
* May 17, 2021: Phase 2 (Evaluation Phase) Starts
* May 24, 2021: Phase 2 (Evaluation Phase) Ends
* June 25, 2021: AILBIZ @ ICAIL 2021