[CfP] [ICSOC 2026] BenchSOC: 1st International Workshop on Benchmarking in Service-Oriented Computing
Massimiliano GARDA
When and Where: December 1, 2026 - Łódź, Poland
Submission Link (EasyChair): https://easychair.org/conferences/?conf=icsoc2026 (track “1st International Workshop on Benchmarking in Service-Oriented Computing”)
For any inquiries related to this workshop, please contact: benchs...@easychair.org
==========================================================================================================Rigorous experimental evaluation is essential in Service-Oriented Computing (SOC), enabling researchers to validate, compare, and reproduce approaches for service identification, discovery, composition, recommendation, QoS prediction, and service ecosystem design. Despite decades of research, however, the SOC community still lacks shared and widely adopted benchmarking infrastructures, including curated datasets, benchmark suites, and standardized evaluation protocols that support fair and systematic comparisons across competing approaches. The growing adoption of Artificial Intelligence (AI) and Large Language Models (LLMs) in SOC further exacerbates this challenge, as these approaches are highly sensitive to dataset characteristics and evaluation settings. The 1st International Workshop on Benchmarking in Service-Oriented Computing (BenchSOC) aims to provide a venue for researchers to present, discuss, and advance the creation, dissemination, and maintenance of reusable datasets, benchmark suites, evaluation methodologies, and reference implementations for the SOC community. Beyond introducing new benchmarking resources, the workshop seeks to foster a broader discussion on evaluation practices and on how to establish shared experimental foundations that improve reproducibility, comparability, and long-term scientific progress in SOC.
==========================================================================================================
Submission Categories BenchSOC welcomes contributions addressing benchmarking, evaluation, and reusable research resources for SOC, in the following categories:
- Dataset papers, describing new or re-curated datasets;
- Benchmark task papers, defining reusable evaluation problems and benchmark specifications;
- Evaluation methodology papers, proposing or critically analyzing evaluation protocols and performance metrics;
- Resource mapping papers, surveying existing datasets, benchmarks, and evaluation resources while identifying current gaps;
- Baseline and reference system papers, providing reusable implementations that facilitate comparative evaluation.
Submissions are expected to clearly describe: (i) motivation and target problem; (ii) construction or design methodology; (iii) design decisions and assumptions; (iv) evaluation protocols and intended use cases; (v) reuse potential and reproducibility. ==========================================================================================================
Submission Instructions Proceedings of the workshop will be submitted to CEUR Workshop Proceedings (CEUR-WS.org), an open-access and Scopus-indexed proceedings series, for online publication.
Format and length
Authors are requested to prepare their manuscripts using the CEUR-ART 1-column style template. Papers must not exceed 12 pages, excluding references.
Papers must be written in English and submitted in PDF format via EasyChair (https://easychair.org/conferences/?conf=icsoc2026) selecting the track “1st International Workshop on Benchmarking in Service-Oriented Computing”.
Research artifacts
Authors are required to make accompanying datasets, benchmarks, software, and other evaluation artifacts publicly available through persistent repositories (e.g., Zenodo or GitHub) to support reproducibility and community reuse.
Dual submission policy
Papers (and related artifacts) submitted to BenchSOC must not be simultaneously submitted to, or under review by, another workshop, conference, or publication venue (including the ICSOC Artifacts Track, associated with papers accepted to the main conference). By submitting a paper to BenchSOC, authors confirm that it is not under concurrent review or evaluation elsewhere.
==========================================================================================================
Review and Presentation Policy
BenchSOC adopts a single-blind review process. Submissions not conforming to the CEUR-ART 1-column format, the page limitations, or being obviously out of the scope of the workshop, will be rejected without review. All reviews will be conducted in accordance with the reviewer guidelines available on the workshop website.
At least one author of each accepted paper must register for either the Workshop Day only (December 1st) or the full ICSOC 2026 conference before the camera-ready deadline. In addition, at least one author must present the paper in person at the workshop. In-person presentation is mandatory for inclusion in the workshop proceedings.
========================================================================================================== Workshop Organizers - Ada Bagozi (University of Brescia, Italy) - Massimiliano Garda (University of Brescia, Italy) - Ilche Georgievski (University of Stuttgart, Germany) Workshop Advisor
- Massimo Mecella (Sapienza University of Rome, Italy)