EvalRS2022: CIKM EvalRS 2022 DataChallenge The Westin Peachtree Plaza Hotel Atlanta, GA, United States, October 17, 2022 |
Conference website | https://reclist.io/cikm2022-cup/ |
Submission link | https://easychair.org/conferences/?conf=evalrs2022 |
Submission deadline | September 25, 2022 |
Call for Papers
We invite submissions of two types of paper:
- short design papers (2 pages, plus references) in which authors are requested to describe their model, the tests and the rationale behind them;
- long papers (5 pages, plus references) in which authors may provide a longer description of their approach, engage with the relevant literature and detail the testing strategies they adopted.
All papers will be peer reviewed by two experts each: reviews are mainly meant to improve the exposition of the work done for the Data Challenge and ensure the necessarily scholarly standards for CIKM (reference, clarity, rigor). The review process will be single blind, therefore submitted papers should not be anonymized.
Teams are required to submit at least a short paper for their submission. We are working with CEUR to verify if it will be possible to publish long papers through CEUR as proceedings. Irrespective of their length, all papers will be archived in this repository and all authors will have a chance to present at the hybrid workshop during CIKM. Submissions should therefore follow the CEUR Template and use the two column format.
NOTE: dealine has been extended to October the 1st 2022.
Paper structure
To help students and younger researchers, we suggest some important questions / common sections for the papers.
Short design papers should answer the following questions:
- What is the model used in the challenge?
- What errors did the model make? What did the authors learn iterating on different tests?
- Did the competition help in debugging RecSys errors?
Regular papers should be structured loosely as follows:
- Introduction: describing the challenge and citing related work;
- Method: describing the solution adopted;
- Experiments; describing the experiment run throughout the challenge. All papers should describe the custom tests implemented and their rationale.
- Data: in case additional or augmentation was performed;
- Hyperparameters: details on any setup defined for reproducibility;
- Results;
- Error analysis;
- Discussion and Reflection: analysis of results and tests, plus a take on possible future research. We encourage speculative ideas and future proposals;
- Conclusions.
Notes:
- one additional page will be given to integrate reviewers' comments;
- all papers should contain the proper citation of the WWW RecList paper and pre-print of the EvalRS paper.
Submission instructions
All submissions should therefore follow the CEUR Template and use the two columns format.
Submissions to EVALRS should be made:
https://easychair.org/conferences/?conf=evalrs2022
The deadline for paper submission is October the 1st, 2022 (11: 59 P.M. AoE).