An Evaluation of Inter-Annotator Agreement in the Observation of Anaphoric and Referential Relations
François Trouilleux, Gabriel Bès, Eric Gaussier
When proposing a description of the data he observes, the linguist must make sure that his observations may
be also regularly made by other persons. In this paper, we introduce a typology of anaphoric and referential
relations and an experiment which aims at assessing that this typology is operational. Given three newspaper
articles, five students were asked to identify anaphoric and/or referential relations between expressions and
referents. This inter-subjectivity test confirms results already obtained: coreference is an operational notion,
but the perspicuity of other relations is not obvious.
Proceedings of Discourse, Anaphora and Reference Resolution Conference, DAARC-2000. Lancaster, UK, 2000.
daarc2000.pdf (139.61 kB)