CHAMP: Efficient Annotation and Consolidation of Cluster Hierarchies

Arie Cattan; Tom Hope; Doug Downey; Roy Bar-Haim; Lilach Eden; Yoav Kantor; Ido Dagan

CHAMP: Efficient Annotation and Consolidation of Cluster Hierarchies

Arie Cattan, Tom Hope, Doug Downey, Roy Bar-Haim, Lilach Eden, Yoav Kantor, Ido Dagan

Computer Science

Research output: Contribution to conference › Paper › peer-review

Abstract

Various NLP tasks require a complex hierarchical structure over nodes, where each node is a cluster of items. Examples include generating entailment graphs, hierarchical cross-document coreference resolution, annotating event and subevent relations, etc. To enable efficient annotation of such hierarchical structures, we release CHAMP, an open source tool allowing to incrementally construct both clusters and hierarchy simultaneously over any type of texts. This incremental approach significantly reduces annotation time compared to the common pairwise annotation approach and also guarantees maintaining transitivity at the cluster and hierarchy levels. Furthermore, CHAMP includes a consolidation mode, where an adjudicator can easily compare multiple cluster hierarchy annotations and resolve disagreements.

Original language	English (US)
Pages	403-412
Number of pages	10
State	Published - 2023
Event	2023 Conference on Empirical Methods in Natural Language Processing, EMNLP 2023 - Singapore, Singapore Duration: Dec 6 2023 → Dec 10 2023

Conference

Conference	2023 Conference on Empirical Methods in Natural Language Processing, EMNLP 2023
Country/Territory	Singapore
City	Singapore
Period	12/6/23 → 12/10/23

Funding

This work was supported by the Israel Science Foundation (grant no. 2827/21). Arie Cattan is partially supported by the PBC fellowship for outstanding PhD candidates in data science.

ASJC Scopus subject areas

Computational Theory and Mathematics
Computer Science Applications
Information Systems

Cite this

@conference{849123f148cb4c5ba0ac1a394f143344,

title = "CHAMP: Efficient Annotation and Consolidation of Cluster Hierarchies",

abstract = "Various NLP tasks require a complex hierarchical structure over nodes, where each node is a cluster of items. Examples include generating entailment graphs, hierarchical cross-document coreference resolution, annotating event and subevent relations, etc. To enable efficient annotation of such hierarchical structures, we release CHAMP, an open source tool allowing to incrementally construct both clusters and hierarchy simultaneously over any type of texts. This incremental approach significantly reduces annotation time compared to the common pairwise annotation approach and also guarantees maintaining transitivity at the cluster and hierarchy levels. Furthermore, CHAMP includes a consolidation mode, where an adjudicator can easily compare multiple cluster hierarchy annotations and resolve disagreements.",

author = "Arie Cattan and Tom Hope and Doug Downey and Roy Bar-Haim and Lilach Eden and Yoav Kantor and Ido Dagan",

note = "Publisher Copyright: {\textcopyright} 2023 Association for Computational Linguistics.; 2023 Conference on Empirical Methods in Natural Language Processing, EMNLP 2023 ; Conference date: 06-12-2023 Through 10-12-2023",

year = "2023",

language = "English (US)",

pages = "403--412",

}

TY - CONF

T1 - CHAMP

T2 - 2023 Conference on Empirical Methods in Natural Language Processing, EMNLP 2023

AU - Cattan, Arie

AU - Hope, Tom

AU - Downey, Doug

AU - Bar-Haim, Roy

AU - Eden, Lilach

AU - Kantor, Yoav

AU - Dagan, Ido

PY - 2023

Y1 - 2023

N2 - Various NLP tasks require a complex hierarchical structure over nodes, where each node is a cluster of items. Examples include generating entailment graphs, hierarchical cross-document coreference resolution, annotating event and subevent relations, etc. To enable efficient annotation of such hierarchical structures, we release CHAMP, an open source tool allowing to incrementally construct both clusters and hierarchy simultaneously over any type of texts. This incremental approach significantly reduces annotation time compared to the common pairwise annotation approach and also guarantees maintaining transitivity at the cluster and hierarchy levels. Furthermore, CHAMP includes a consolidation mode, where an adjudicator can easily compare multiple cluster hierarchy annotations and resolve disagreements.

AB - Various NLP tasks require a complex hierarchical structure over nodes, where each node is a cluster of items. Examples include generating entailment graphs, hierarchical cross-document coreference resolution, annotating event and subevent relations, etc. To enable efficient annotation of such hierarchical structures, we release CHAMP, an open source tool allowing to incrementally construct both clusters and hierarchy simultaneously over any type of texts. This incremental approach significantly reduces annotation time compared to the common pairwise annotation approach and also guarantees maintaining transitivity at the cluster and hierarchy levels. Furthermore, CHAMP includes a consolidation mode, where an adjudicator can easily compare multiple cluster hierarchy annotations and resolve disagreements.

UR - http://www.scopus.com/inward/record.url?scp=85184665319&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85184665319&partnerID=8YFLogxK

M3 - Paper

AN - SCOPUS:85184665319

SP - 403

EP - 412

Y2 - 6 December 2023 through 10 December 2023

ER -

CHAMP: Efficient Annotation and Consolidation of Cluster Hierarchies

Abstract

Conference

Funding

ASJC Scopus subject areas

Other files and links

Fingerprint

Cite this