This HTML5 document contains 49 embedded RDF statements represented using HTML+Microdata notation.

The embedded RDF content will be recognized by any processor of HTML5 Microdata.

Namespace Prefixes

PrefixIRI
n19http://linked.opendata.cz/ontology/domain/vavai/riv/typAkce/
dctermshttp://purl.org/dc/terms/
n16http://localhost/temp/predkladatel/
n11http://purl.org/net/nknouf/ns/bibtex#
n8http://linked.opendata.cz/resource/domain/vavai/riv/tvurce/
n6http://linked.opendata.cz/resource/domain/vavai/projekt/
n13http://linked.opendata.cz/ontology/domain/vavai/
n21https://schema.org/
n20http://linked.opendata.cz/resource/domain/vavai/vysledek/RIV%2F00216208%3A11320%2F10%3A10078024%21RIV11-GA0-11320___/
shttp://schema.org/
skoshttp://www.w3.org/2004/02/skos/core#
n4http://linked.opendata.cz/ontology/domain/vavai/riv/
n2http://linked.opendata.cz/resource/domain/vavai/vysledek/
rdfhttp://www.w3.org/1999/02/22-rdf-syntax-ns#
n7http://linked.opendata.cz/ontology/domain/vavai/riv/klicoveSlovo/
n9http://linked.opendata.cz/ontology/domain/vavai/riv/duvernostUdaju/
xsdhhttp://www.w3.org/2001/XMLSchema#
n17http://linked.opendata.cz/ontology/domain/vavai/riv/aktivita/
n12http://linked.opendata.cz/ontology/domain/vavai/riv/jazykVysledku/
n14http://linked.opendata.cz/ontology/domain/vavai/riv/druhVysledku/
n5http://linked.opendata.cz/ontology/domain/vavai/riv/obor/
n10http://reference.data.gov.uk/id/gregorian-year/

Statements

Subject Item
n2:RIV%2F00216208%3A11320%2F10%3A10078024%21RIV11-GA0-11320___
rdf:type
n13:Vysledek skos:Concept
dcterms:description
The paper presents several ways to measure and evaluate the annotation and annotators, proposed and used during the building of the Czech part of the Prague Czech-English Dependency Treebank. At first, the basic principles of the treebank annotation project are introduced (division to three layers: morphological, analytical and tectogrammatical). The main part of the paper describes in detail one of the important phases of the annotation process: three ways of evaluation of the annotators - inter-annotator agreement, error rate and performance. The measuring of the inter-annotator agreement is complicated by the fact that the data contain added and deleted nodes, making the alignment between annotations non-trivial. The error rate is measured by a set of automatic checking procedures that guard the validity of some invariants in the data. The performance of the annotators is measured by a booking web application. All three measures are later compared and related to each other. The paper presents several ways to measure and evaluate the annotation and annotators, proposed and used during the building of the Czech part of the Prague Czech-English Dependency Treebank. At first, the basic principles of the treebank annotation project are introduced (division to three layers: morphological, analytical and tectogrammatical). The main part of the paper describes in detail one of the important phases of the annotation process: three ways of evaluation of the annotators - inter-annotator agreement, error rate and performance. The measuring of the inter-annotator agreement is complicated by the fact that the data contain added and deleted nodes, making the alignment between annotations non-trivial. The error rate is measured by a set of automatic checking procedures that guard the validity of some invariants in the data. The performance of the annotators is measured by a booking web application. All three measures are later compared and related to each other.
dcterms:title
Ways of Evaluation of the Annotators in Building the Prague Czech-English Dependency Treebank Ways of Evaluation of the Annotators in Building the Prague Czech-English Dependency Treebank
skos:prefLabel
Ways of Evaluation of the Annotators in Building the Prague Czech-English Dependency Treebank Ways of Evaluation of the Annotators in Building the Prague Czech-English Dependency Treebank
skos:notation
RIV/00216208:11320/10:10078024!RIV11-GA0-11320___
n4:aktivita
n17:P
n4:aktivity
P(GAP406/10/0875), P(GPP406/10/P193), P(LC536)
n4:dodaniDat
n10:2011
n4:domaciTvurceVysledku
n8:7841469 n8:6803105
n4:druhVysledku
n14:D
n4:duvernostUdaju
n9:S
n4:entitaPredkladatele
n20:predkladatel
n4:idSjednocenehoVysledku
298632
n4:idVysledku
RIV/00216208:11320/10:10078024
n4:jazykVysledku
n12:eng
n4:klicovaSlova
treebank; dependency; english; czech; prague; building; annotators; evaluation; ways
n4:klicoveSlovo
n7:annotators n7:evaluation n7:dependency n7:english n7:treebank n7:building n7:czech n7:prague n7:ways
n4:kontrolniKodProRIV
[6B63C42F887D]
n4:mistoKonaniAkce
Valletta, Malta
n4:mistoVydani
Valletta, Malta
n4:nazevZdroje
Proceedings of the 7th International Conference on Language Resources and Evaluation (LREC 2010)
n4:obor
n5:AI
n4:pocetDomacichTvurcuVysledku
2
n4:pocetTvurcuVysledku
2
n4:projekt
n6:GAP406%2F10%2F0875 n6:LC536 n6:GPP406%2F10%2FP193
n4:rokUplatneniVysledku
n10:2010
n4:tvurceVysledku
Štěpánek, Jan Mikulová, Marie
n4:typAkce
n19:WRD
n4:zahajeniAkce
2010-05-17+02:00
s:numberOfPages
4
n11:hasPublisher
European Language Resources Association
n21:isbn
2-9517408-6-7
n16:organizacniJednotka
11320