About: A Grain of Salt for the WMT Manual Evaluation

Facets (new session)
Description
Metadata
Settings
- owl:sameAs
- Inference Rule:

About: A Grain of Salt for the WMT Manual Evaluation Goto Sponge NotDistinct Permalink

An Entity of Type : http://linked.opendata.cz/ontology/domain/vavai/Vysledek, within Data Space : linked.opendata.cz associated with source document(s)

Attributes	Values
rdf:type	skos:Concept http://linked.opendata.cz/ontology/domain/vavai/Vysledek
Description	The Workshop on Statistical Machine Translation (WMT) has become one of ACL's flagship workshops, held annually since 2006. In addition to soliciting papers from the research community, WMT also features a shared translation task for evaluating MT systems. This shared task is notable for having manual evaluation as its cornerstone. The Workshop's overview paper, playing a descriptive and administrative role, reports the main results of the evaluation without delving deep into analyzing those results. The aim of this paper is to investigate and explain some interesting idiosyncrasies in the reported results, which only become apparent when performing a more thorough analysis of the collected annotations. Our analysis sheds some light on how the reported results should (and should not) be interpreted, and also gives rise to some helpful recommendation for the organizers of WMT. The Workshop on Statistical Machine Translation (WMT) has become one of ACL's flagship workshops, held annually since 2006. In addition to soliciting papers from the research community, WMT also features a shared translation task for evaluating MT systems. This shared task is notable for having manual evaluation as its cornerstone. The Workshop's overview paper, playing a descriptive and administrative role, reports the main results of the evaluation without delving deep into analyzing those results. The aim of this paper is to investigate and explain some interesting idiosyncrasies in the reported results, which only become apparent when performing a more thorough analysis of the collected annotations. Our analysis sheds some light on how the reported results should (and should not) be interpreted, and also gives rise to some helpful recommendation for the organizers of WMT. (en)
Title	A Grain of Salt for the WMT Manual Evaluation A Grain of Salt for the WMT Manual Evaluation (en)
skos:prefLabel	A Grain of Salt for the WMT Manual Evaluation A Grain of Salt for the WMT Manual Evaluation (en)
skos:notation	RIV/00216208:11320/11:10107928!RIV12-GA0-11320___
http://linked.open...avai/riv/aktivita	P Z
http://linked.open...avai/riv/aktivity	P(7E09003), P(GPP406/10/P259), Z(MSM0021620838)
http://linked.open...vai/riv/dodaniDat	2012
http://linked.open...aciTvurceVysledku	Bojar, Ondřej Popel, Martin Ercegovčević, Miloš
http://linked.open.../riv/druhVysledku	D - Článek ve sborníku
http://linked.open...iv/duvernostUdaju	S - Úplné a pravdivé údaje nepodléhající ochraně podle zvláštních právních předpisů
http://linked.open...titaPredkladatele	Univerzita Karlova v Praze / Matematicko-fyzikální fakulta
http://linked.open...dnocenehoVysledku	183831
http://linked.open...ai/riv/idVysledku	RIV/00216208:11320/11:10107928
http://linked.open...riv/jazykVysledku	eng - angličtina
http://linked.open.../riv/klicovaSlova	evaluation; manual; salt; grain (en)
http://linked.open.../riv/klicoveSlovo	evaluation grain manual salt
http://linked.open...ontrolniKodProRIV	[BDCB6D7F2BB3]
http://linked.open...v/mistoKonaniAkce	Edinburgh, United Kingdom
http://linked.open...i/riv/mistoVydani	Edinburgh, UK
http://linked.open...i/riv/nazevZdroje	Proceedings of the Sixth Workshop on Statistical Machine Translation
http://linked.open...in/vavai/riv/obor	AI
http://linked.open...ichTvurcuVysledku	3 (xsd:int)
http://linked.open...cetTvurcuVysledku	4 (xsd:int)
http://linked.open...vavai/riv/projekt	EuroMatrixPlus—Bringing Machine Translation for European Languages to the User Combining Phrase-Based and Deep-Syntactic Machine Translation
http://linked.open...UplatneniVysledku	2011
http://linked.open...iv/tvurceVysledku	Bojar, Ondřej Ercegovčević, Miloš Popel, Martin Zaidan, Omar F.
http://linked.open...vavai/riv/typAkce	CST - Celostátní
http://linked.open.../riv/zahajeniAkce	2011-07-30 (xsd:date)
http://linked.open...n/vavai/riv/zamer	Moderní metody, struktury a systémy informatiky
number of pages	11 (xsd:int)
http://purl.org/ne...btex#hasPublisher	Association for Computational Linguistics
https://schema.org/isbn	978-1-937284-12-1
http://localhost/t...ganizacniJednotka	11320

Faceted Search & Find service v1.16.118 as of Jun 21 2024

Alternative Linked Data Documents: ODE Content Formats:

RDF

ODATA

Microdata

About

OpenLink Virtuoso version 07.20.3240 as of Jun 21 2024, on Linux (x86_64-pc-linux-gnu), Single-Server Edition (126 GB total memory, 77 GB memory in use)
Data on this page belongs to its respective rights holders.
Virtuoso Faceted Browser Copyright © 2009-2024 OpenLink Software