next up previous
Next: The grammar Up: The Alpino Dependency Treebank Previous: The Alpino Dependency Treebank

Introduction

Alpino is a wide-coverage computational analyzer of Dutch that aims at accurate, full parsing of unrestricted text. In section 2 we present the setup of the grammar and the constraint-based formalism that we have adopted. A syntactically annotated corpus is needed to train the grammar and to evaluate its performance. For this purpose we have started to develop the Alpino Dependency Treebank.

The treebank consists of sentences from the newspaper ( cdbl) part of the Eindhoven corpus (Uit den Boogaard 1975). The sentences are each assigned a dependency structure, which is a relatively theory independent annotation format. The format is taken from the corpus of spoken Dutch (CGN)1 (Oostdijk 2000), which in turn based its format on the Tiger Treebank (Skut 1997). In section 3 we go into the characteristics of dependency structures and motivate our choice for this annotation format.

Section 4 is the central part of this paper. Here we explain the annotation method as we use it, the tools that we have developed, the advantages and the shortcomings of the system. It starts with a description of the parsing process that is at the beginning of the annotation process. Although it is a good idea to start annotation with parsing (building dependency trees manually is very time consuming and error prone), it has one main disadvantage: ambiguity. For a sentence of average length typically a set of hundreds or even thousands of parses is generated. Selection of the best parse from this large set of possible parses is time intensive.

The tools that we present in this paper aim at facilitating the annotation process and making it less time consuming. We present two tools that reduce the number of parses generated by the parser and a third tool that facilitates the addition of lexical information during the annotation process. Finally a parse selection tool is developed to facilitate the selection of the best parse from the reduced set of parses.

The Alpino Dependency Treebank is a searchable treebank in an XML format. In section 5 we present examples illustrating how the standard XML query language XPath can be used to search the treebank for linguistically relevant information. In section 6 we explain how the corpus can be used to evaluate the Alpino parser and to train the probabilistic disambiguation component of the grammar. We end with conclusions and some pointers to future work in 7.


next up previous
Next: The grammar Up: The Alpino Dependency Treebank Previous: The Alpino Dependency Treebank
Noord G.J.M. van
2002-06-13