|
XTAG chunks: [Borrowed shares] [on the Amex] [rose] [to another record] Treebank chunks: [Borrowed shares on the Amex] [rose] [to another record]Using these chunks, we can normalize for the fact that in the dependencies produced by XTAG borrowed is dependent on shares (i.e. in the same chunk) while in the Treebank borrowed is directly dependent on the verb rose. That is to say, we are looking at links between chunks, not between words. The dependencies for the sentence are given below.
XTAG dependency Treebank dependency Borrowed::shares Borrowed::rose shares::rose shares::rose on::shares on::shares the::Amex the::Amex Amex::on Amex::on rose::NIL rose::NIL to::rose to::rose another::record another::record record::to record::toAfter this normalization, testing simply consisted of counting how many of the dependency links produced by XTAG matched the Treebank dependency links. Due to some tokenization and subsequent alignment problems we could only test on 835 of the original 9891 parsed sentences. There were a total of 6135 dependency links extracted from the Treebank. The XTAG parses also produced 6135 dependency links for the same sentences. Of the dependencies produced by the XTAG parser, 5165 were correct giving us an accuracy of .