On the Risk of Tool Over-tuning in Run-time Verification Competitions (position paper)

4 pages•Published: December 14, 2017

Abstract

In this position paper we discuss the risk of tool over-tuning in
runtime verification competitions. We believe that the risk is
inherently enabled by the format of the competitions and we discuss it
in the context of the "First International Competition on Software
for Runtime Verification (CSRV~2014)", in which we participated.

Keyphrases: competition, over tuning, run time verification

In: Giles Reger and Klaus Havelund (editors). RV-CuBES 2017. An International Workshop on Competitions, Usability, Benchmarks, Evaluation, and Standardisation for Runtime Verification Tools, vol 3, pages 37-40.

Links:	https://easychair.org/publications/paper/N6cC
	https://doi.org/10.29007/l43m

BibTeX entry

@inproceedings{RV-CuBES2017:Risk_Tool_Over_tuning,
  author    = {Domenico Bianculli and Srdjan Krstic},
  title     = {On the Risk of Tool Over-tuning in Run-time Verification  Competitions (position paper)},
  booktitle = {RV-CuBES 2017. An International Workshop on Competitions, Usability, Benchmarks, Evaluation, and Standardisation for Runtime Verification Tools},
  editor    = {Giles Reger and Klaus Havelund},
  series    = {Kalpa Publications in Computing},
  volume    = {3},
  publisher = {EasyChair},
  bibsource = {EasyChair, https://easychair.org},
  issn      = {2515-1762},
  url       = {/publications/paper/N6cC},
  doi       = {10.29007/l43m},
  pages     = {37-40},
  year      = {2017}}

Download PDF Open PDF in browser