This HTML5 document contains 47 embedded RDF statements represented using HTML+Microdata notation.

The embedded RDF content will be recognized by any processor of HTML5 Microdata.

Namespace Prefixes

PrefixIRI
dctermshttp://purl.org/dc/terms/
n14http://localhost/temp/predkladatel/
n13http://linked.opendata.cz/resource/domain/vavai/riv/tvurce/
n11http://linked.opendata.cz/resource/domain/vavai/projekt/
n17http://linked.opendata.cz/resource/domain/vavai/subjekt/
n12http://linked.opendata.cz/ontology/domain/vavai/
shttp://schema.org/
skoshttp://www.w3.org/2004/02/skos/core#
n3http://linked.opendata.cz/ontology/domain/vavai/riv/
n8http://bibframe.org/vocab/
n2http://linked.opendata.cz/resource/domain/vavai/vysledek/
rdfhttp://www.w3.org/1999/02/22-rdf-syntax-ns#
n5http://linked.opendata.cz/ontology/domain/vavai/riv/klicoveSlovo/
n20http://linked.opendata.cz/ontology/domain/vavai/riv/duvernostUdaju/
xsdhhttp://www.w3.org/2001/XMLSchema#
n10http://linked.opendata.cz/ontology/domain/vavai/riv/aktivita/
n18http://linked.opendata.cz/ontology/domain/vavai/riv/jazykVysledku/
n4http://linked.opendata.cz/resource/domain/vavai/vysledek/RIV%2F00216208%3A11320%2F11%3A10107804%21RIV12-GA0-11320___/
n19http://linked.opendata.cz/ontology/domain/vavai/riv/obor/
n15http://linked.opendata.cz/ontology/domain/vavai/riv/druhVysledku/
n6http://reference.data.gov.uk/id/gregorian-year/

Statements

Subject Item
n2:RIV%2F00216208%3A11320%2F11%3A10107804%21RIV12-GA0-11320___
rdf:type
n12:Vysledek skos:Concept
dcterms:description
This paper proposes a new method of manual evaluation for statistical machine translation, the so-called quiz-based evaluation, estimating whether people are able to extract information from machine-translated texts reliably. We apply the method to two commercial and two experimental MT systems that participated in WMT 2010 in English-to-Czech translation. We report inter-annotator agreement for the evaluation as well as the outcomes of the individual systems. The quiz-based evaluation suggests rather different ranking of the systems compared to the WMT 2010 manual and automatic metrics. We also see that overall, MT quality is becoming acceptable for obtaining information from the text: about 80% of questions can be answered correctly given only machine-translated text. This paper proposes a new method of manual evaluation for statistical machine translation, the so-called quiz-based evaluation, estimating whether people are able to extract information from machine-translated texts reliably. We apply the method to two commercial and two experimental MT systems that participated in WMT 2010 in English-to-Czech translation. We report inter-annotator agreement for the evaluation as well as the outcomes of the individual systems. The quiz-based evaluation suggests rather different ranking of the systems compared to the WMT 2010 manual and automatic metrics. We also see that overall, MT quality is becoming acceptable for obtaining information from the text: about 80% of questions can be answered correctly given only machine-translated text.
dcterms:title
Quiz-Based Evaluation of Machine Translation Quiz-Based Evaluation of Machine Translation
skos:prefLabel
Quiz-Based Evaluation of Machine Translation Quiz-Based Evaluation of Machine Translation
skos:notation
RIV/00216208:11320/11:10107804!RIV12-GA0-11320___
n12:predkladatel
n17:orjk%3A11320
n3:aktivita
n10:P
n3:aktivity
P(7E09003), P(GAP406/11/1499), P(GPP406/10/P259)
n3:cisloPeriodika
1
n3:dodaniDat
n6:2012
n3:domaciTvurceVysledku
n13:3785041 n13:3526569 n13:2630176
n3:druhVysledku
n15:J
n3:duvernostUdaju
n20:S
n3:entitaPredkladatele
n4:predkladatel
n3:idSjednocenehoVysledku
225499
n3:idVysledku
RIV/00216208:11320/11:10107804
n3:jazykVysledku
n18:eng
n3:klicovaSlova
translation; machine; evaluation; based; quiz
n3:klicoveSlovo
n5:translation n5:based n5:machine n5:evaluation n5:quiz
n3:kodStatuVydavatele
CZ - Česká republika
n3:kontrolniKodProRIV
[C003CEEE83C9]
n3:nazevZdroje
The Prague Bulletin of Mathematical Linguistics
n3:obor
n19:AI
n3:pocetDomacichTvurcuVysledku
3
n3:pocetTvurcuVysledku
3
n3:projekt
n11:GAP406%2F11%2F1499 n11:7E09003 n11:GPP406%2F10%2FP259
n3:rokUplatneniVysledku
n6:2011
n3:svazekPeriodika
95
n3:tvurceVysledku
Bojar, Ondřej Berka, Jan Černý, Martin
s:issn
0032-6585
s:numberOfPages
10
n8:doi
10.2478/v10108-011-0006-1
n14:organizacniJednotka
11320