About: Precise Regression Benchmarking with Random Effects: Improving Mono Benchmark Results

Facets (new session)
Description
Metadata
Settings
- owl:sameAs
- Inference Rule:

About: Precise Regression Benchmarking with Random Effects: Improving Mono Benchmark Results Goto Sponge NotDistinct Permalink

An Entity of Type : http://linked.opendata.cz/ontology/domain/vavai/Vysledek, within Data Space : linked.opendata.cz associated with source document(s)

Attributes	Values
rdf:type	skos:Concept http://linked.opendata.cz/ontology/domain/vavai/Vysledek
Description	Benchmarking as a method of assessing software performance is known to suffer from random fluctuations that distort the observed performance. In this paper, we focus on the fluctuations caused by compilation. We show that the design of a benchmarking experiment must reflect the existence of the fluctuations if the performance observed during the experiment is to be representative of reality. We present a new statistical model of a benchmark experiment that reflects the presence of the fluctuations in compilation, execution and measurement. The model describes the observed performance and makes it possible to calculate the optimum dimensions of the experiment that yield the best precision within a given amount of time. Using a variety of benchmarks, we evaluate the model within the context of regression benchmarking. We show that the model significantly decreases the number of erroneously detected performance changes in regression benchmarking. Benchmarking as a method of assessing software performance is known to suffer from random fluctuations that distort the observed performance. In this paper, we focus on the fluctuations caused by compilation. We show that the design of a benchmarking experiment must reflect the existence of the fluctuations if the performance observed during the experiment is to be representative of reality. We present a new statistical model of a benchmark experiment that reflects the presence of the fluctuations in compilation, execution and measurement. The model describes the observed performance and makes it possible to calculate the optimum dimensions of the experiment that yield the best precision within a given amount of time. Using a variety of benchmarks, we evaluate the model within the context of regression benchmarking. We show that the model significantly decreases the number of erroneously detected performance changes in regression benchmarking. (en)
Title	Precise Regression Benchmarking with Random Effects: Improving Mono Benchmark Results Precise Regression Benchmarking with Random Effects: Improving Mono Benchmark Results (en)
skos:prefLabel	Precise Regression Benchmarking with Random Effects: Improving Mono Benchmark Results Precise Regression Benchmarking with Random Effects: Improving Mono Benchmark Results (en)
skos:notation	RIV/00216208:11320/06:00206184!RIV10-GA0-11320___
http://linked.open...avai/riv/aktivita	P Z
http://linked.open...avai/riv/aktivity	P(1ET400300504), P(GD201/05/H014), Z(MSM0021620838)
http://linked.open...vai/riv/dodaniDat	2010
http://linked.open...aciTvurceVysledku	Tůma, Petr Kalibera, Tomáš
http://linked.open.../riv/druhVysledku	D - Článek ve sborníku
http://linked.open...iv/duvernostUdaju	S - Úplné a pravdivé údaje nepodléhající ochraně podle zvláštních právních předpisů
http://linked.open...titaPredkladatele	Univerzita Karlova v Praze / Matematicko-fyzikální fakulta
http://linked.open...dnocenehoVysledku	493923
http://linked.open...ai/riv/idVysledku	RIV/00216208:11320/06:00206184
http://linked.open...riv/jazykVysledku	eng - angličtina
http://linked.open.../riv/klicovaSlova	Precise; Regression; Benchmarking; Random; Effects; Improving; Benchmark; Results (en)
http://linked.open.../riv/klicoveSlovo	Benchmark Improving Random Regression Benchmarking Effects Results Precise
http://linked.open...ontrolniKodProRIV	[9D797A33F30E]
http://linked.open...v/mistoKonaniAkce	Neuveden
http://linked.open...i/riv/nazevZdroje	Third European Performance Engineering Workshop, EPEW 2006, Budapest, Hungary, June 21-22, 2006
http://linked.open...in/vavai/riv/obor	JC
http://linked.open...ichTvurcuVysledku	2 (xsd:int)
http://linked.open...cetTvurcuVysledku	2 (xsd:int)
http://linked.open...vavai/riv/projekt	Collegium Informaticum Realistic application of formal methods in component systems
http://linked.open...UplatneniVysledku	2006
http://linked.open...iv/tvurceVysledku	Kalibera, Tomáš Tůma, Petr
http://linked.open...vavai/riv/typAkce	WRD - Světová
http://linked.open...ain/vavai/riv/wos	000239480100005
http://linked.open.../riv/zahajeniAkce	2006-01-01 (xsd:date)
http://linked.open...n/vavai/riv/zamer	Moderní metody, struktury a systémy informatiky
number of pages	15 (xsd:int)
http://purl.org/ne...btex#hasPublisher	Stochastic Modeling Laboratory, Dept. of Telecommunications, Technical University of Budapest
https://schema.org/isbn	3-540-35362-3
http://localhost/t...ganizacniJednotka	11320

Faceted Search & Find service v1.16.118 as of Jun 21 2024

Alternative Linked Data Documents: ODE Content Formats:

RDF

ODATA

Microdata

About

OpenLink Virtuoso version 07.20.3240 as of Jun 21 2024, on Linux (x86_64-pc-linux-gnu), Single-Server Edition (126 GB total memory, 58 GB memory in use)
Data on this page belongs to its respective rights holders.
Virtuoso Faceted Browser Copyright © 2009-2024 OpenLink Software