RESIN: A Dockerized Schema-Guided Cross-document Cross-lingual Cross-media Information Extraction and Event Tracking System

Haoyang Wen; Ying Lin; Tuan Manh Lai; Xiaoman Pan; Sha Li; Xudong Lin; Ben Zhou; Manling Li; Haoyu Wang; Hongming Zhang; Xiaodong Yu; Alexander Dong; Zhenhailong Wang; Yi Ren Fung; Piyush Mishra; Qing Lyu; Dídac Surís; Brian Chen; Susan Windisch Brown; Martha Palmer; Chris Callison-Burch; Carl Vondrick; Jiawei Han; Dan Roth; Shih Fu Chang; Heng Ji

RESIN: A Dockerized Schema-Guided Cross-document Cross-lingual Cross-media Information Extraction and Event Tracking System

Haoyang Wen, Ying Lin, Tuan Manh Lai, Xiaoman Pan, Sha Li, Xudong Lin, Ben Zhou, Manling Li, Haoyu Wang, Hongming Zhang, Xiaodong Yu, Alexander Dong, Zhenhailong Wang, Yi Ren Fung, Piyush Mishra, Qing Lyu, Dídac Surís, Brian Chen, Susan Windisch Brown, Martha PalmerChris Callison-Burch, Carl Vondrick, Jiawei Han, Dan Roth, Shih Fu Chang, Heng Ji

Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

46 Scopus citations

Abstract

We present a new information extraction system that can automatically construct temporal event graphs from a collection of news documents from multiple sources, multiple languages (English and Spanish for our experiment), and multiple data modalities (speech, text, image and video). The system advances state-of-the-art from two aspects: (1) extending from sentence-level event extraction to cross-document cross-lingual cross-media event extraction, coreference resolution and temporal event tracking; (2) using human curated event schema library to match and enhance the extraction output. We have made the dockerlized system publicly available for research purpose at GitHub, with a demo video.

Original language	English (US)
Title of host publication	NAACL-HLT 2021 - 2021 Conference of the North American Chapter of the Association for Computational Linguistics
Subtitle of host publication	Human Language Technologies, Demonstrations
Publisher	Association for Computational Linguistics (ACL)
Pages	133-143
Number of pages	11
ISBN (Electronic)	9781954085480
State	Published - 2021
Event	2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2021 - Virtual, Online Duration: Jun 6 2021 → Jun 11 2021

Publication series

Name	NAACL-HLT 2021 - 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Demonstrations

Conference

Conference	2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2021
City	Virtual, Online
Period	6/6/21 → 6/11/21

ASJC Scopus subject areas

Information Systems
Software
Computer Networks and Communications
Hardware and Architecture

Cite this

Wen, H., Lin, Y., Lai, T. M., Pan, X., Li, S., Lin, X., Zhou, B., Li, M., Wang, H., Zhang, H., Yu, X., Dong, A., Wang, Z., Fung, Y. R., Mishra, P., Lyu, Q., Surís, D., Chen, B., Brown, S. W., ... Ji, H. (2021). RESIN: A Dockerized Schema-Guided Cross-document Cross-lingual Cross-media Information Extraction and Event Tracking System. In NAACL-HLT 2021 - 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Demonstrations (pp. 133-143). (NAACL-HLT 2021 - 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Demonstrations). Association for Computational Linguistics (ACL).

Wen, Haoyang ; Lin, Ying ; Lai, Tuan Manh et al. / RESIN : A Dockerized Schema-Guided Cross-document Cross-lingual Cross-media Information Extraction and Event Tracking System. NAACL-HLT 2021 - 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Demonstrations. Association for Computational Linguistics (ACL), 2021. pp. 133-143 (NAACL-HLT 2021 - 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Demonstrations).

@inproceedings{e9452557e7e046e38e7ac35593e39240,

title = "RESIN: A Dockerized Schema-Guided Cross-document Cross-lingual Cross-media Information Extraction and Event Tracking System",

abstract = "We present a new information extraction system that can automatically construct temporal event graphs from a collection of news documents from multiple sources, multiple languages (English and Spanish for our experiment), and multiple data modalities (speech, text, image and video). The system advances state-of-the-art from two aspects: (1) extending from sentence-level event extraction to cross-document cross-lingual cross-media event extraction, coreference resolution and temporal event tracking; (2) using human curated event schema library to match and enhance the extraction output. We have made the dockerlized system publicly available for research purpose at GitHub, with a demo video.",

author = "Haoyang Wen and Ying Lin and Lai, {Tuan Manh} and Xiaoman Pan and Sha Li and Xudong Lin and Ben Zhou and Manling Li and Haoyu Wang and Hongming Zhang and Xiaodong Yu and Alexander Dong and Zhenhailong Wang and Fung, {Yi Ren} and Piyush Mishra and Qing Lyu and D{\'i}dac Sur{\'i}s and Brian Chen and Brown, {Susan Windisch} and Martha Palmer and Chris Callison-Burch and Carl Vondrick and Jiawei Han and Dan Roth and Chang, {Shih Fu} and Heng Ji",

note = "Publisher Copyright: {\textcopyright} 2021 Association for Computational Linguistics.; 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2021 ; Conference date: 06-06-2021 Through 11-06-2021",

year = "2021",

language = "English (US)",

series = "NAACL-HLT 2021 - 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Demonstrations",

publisher = "Association for Computational Linguistics (ACL)",

pages = "133--143",

booktitle = "NAACL-HLT 2021 - 2021 Conference of the North American Chapter of the Association for Computational Linguistics",

}

Wen, H, Lin, Y, Lai, TM, Pan, X, Li, S, Lin, X, Zhou, B, Li, M, Wang, H, Zhang, H, Yu, X, Dong, A, Wang, Z, Fung, YR, Mishra, P, Lyu, Q, Surís, D, Chen, B, Brown, SW, Palmer, M, Callison-Burch, C, Vondrick, C, Han, J, Roth, D, Chang, SF & Ji, H 2021, RESIN: A Dockerized Schema-Guided Cross-document Cross-lingual Cross-media Information Extraction and Event Tracking System. in NAACL-HLT 2021 - 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Demonstrations. NAACL-HLT 2021 - 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Demonstrations, Association for Computational Linguistics (ACL), pp. 133-143, 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2021, Virtual, Online, 6/6/21.

RESIN: A Dockerized Schema-Guided Cross-document Cross-lingual Cross-media Information Extraction and Event Tracking System. / Wen, Haoyang; Lin, Ying; Lai, Tuan Manh et al.
NAACL-HLT 2021 - 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Demonstrations. Association for Computational Linguistics (ACL), 2021. p. 133-143 (NAACL-HLT 2021 - 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Demonstrations).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - RESIN

T2 - 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2021

AU - Wen, Haoyang

AU - Lin, Ying

AU - Lai, Tuan Manh

AU - Pan, Xiaoman

AU - Li, Sha

AU - Lin, Xudong

AU - Zhou, Ben

AU - Li, Manling

AU - Wang, Haoyu

AU - Zhang, Hongming

AU - Yu, Xiaodong

AU - Dong, Alexander

AU - Wang, Zhenhailong

AU - Fung, Yi Ren

AU - Mishra, Piyush

AU - Lyu, Qing

AU - Surís, Dídac

AU - Chen, Brian

AU - Brown, Susan Windisch

AU - Palmer, Martha

AU - Callison-Burch, Chris

AU - Vondrick, Carl

AU - Han, Jiawei

AU - Roth, Dan

AU - Chang, Shih Fu

AU - Ji, Heng

PY - 2021

Y1 - 2021

N2 - We present a new information extraction system that can automatically construct temporal event graphs from a collection of news documents from multiple sources, multiple languages (English and Spanish for our experiment), and multiple data modalities (speech, text, image and video). The system advances state-of-the-art from two aspects: (1) extending from sentence-level event extraction to cross-document cross-lingual cross-media event extraction, coreference resolution and temporal event tracking; (2) using human curated event schema library to match and enhance the extraction output. We have made the dockerlized system publicly available for research purpose at GitHub, with a demo video.

AB - We present a new information extraction system that can automatically construct temporal event graphs from a collection of news documents from multiple sources, multiple languages (English and Spanish for our experiment), and multiple data modalities (speech, text, image and video). The system advances state-of-the-art from two aspects: (1) extending from sentence-level event extraction to cross-document cross-lingual cross-media event extraction, coreference resolution and temporal event tracking; (2) using human curated event schema library to match and enhance the extraction output. We have made the dockerlized system publicly available for research purpose at GitHub, with a demo video.

UR - http://www.scopus.com/inward/record.url?scp=85108521203&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85108521203&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:85108521203

T3 - NAACL-HLT 2021 - 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Demonstrations

SP - 133

EP - 143

BT - NAACL-HLT 2021 - 2021 Conference of the North American Chapter of the Association for Computational Linguistics

PB - Association for Computational Linguistics (ACL)

Y2 - 6 June 2021 through 11 June 2021

ER -

Wen H, Lin Y, Lai TM, Pan X, Li S, Lin X et al. RESIN: A Dockerized Schema-Guided Cross-document Cross-lingual Cross-media Information Extraction and Event Tracking System. In NAACL-HLT 2021 - 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Demonstrations. Association for Computational Linguistics (ACL). 2021. p. 133-143. (NAACL-HLT 2021 - 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Demonstrations).

RESIN: A Dockerized Schema-Guided Cross-document Cross-lingual Cross-media Information Extraction and Event Tracking System

Abstract

Publication series

Conference

ASJC Scopus subject areas

Other files and links

Fingerprint

Cite this