CfP: LT 2015 - The Fourth International Workshop on Large-Scale Testing

[Jack ZhenMing Jiang]

=======================================================================

                        CALL FOR PAPERS

 The Fourth International Workshop on Large-Scale Testing (LT 2015)

                     Co-located with ICPE 2015

                         January 31, 2015

                         Austin, TX, USA

                   http://lt2015.eecs.yorku.ca/

=======================================================================

Many large-scale software systems (e.g., e-commerce websites, 

telecommunication infrastructures, enterprise systems, etc.) must service 

hundreds, thousands or even millions of concurrent requests. Many field 

problems of these systems originate in their inability to scale to field 

workloads, rather than feature bugs. In addition to conventional functional 

testing, these systems must be tested with large volumes of concurrent 

requests (called the load) to ensure the quality of these systems. 

Large-scale testing includes all different objectives and strategies of 

testing large-scale software systems using load. Examples of large-scale 

testing are live upgrade testing, load testing, high availability testing, 

operational profile testing, performance testing, reliability testing, 

stability testing and stress testing.

Large-scale testing is a difficult task requiring a great understanding 

of the system under test. Practitioners face many challenges such as tooling 

(choosing and implementing the testing tools), environments (software and 

hardware setup) and time (limited time to design, test, and analyze). Yet, 

little research is done in the software engineering domain concerning this 

topic. Moreover, prior large-scale testing research is largely focused on 

telecommunication applications and web-based e-commerce systems. Industry 

is focused primarily on creating tools to automatically drive specified 

load into the system under test (e.g., LoadRunner or Apache JMeter). In this 

workshop, we intend to bring together industrial practitioners and researchers 

to establish and grow an academic research community around this important 

and practical research topic. Especially as large-scale testing is gaining 

more importance, due to an increasing number of systems (on-premise and/or 

cloud-based systems) that need to serve thousands or millions of users. 

We solicit the following two tracks of submissions: technical papers 

(maximum 4 pages) and extended abstracts for industry talks (maximum 700 

words). Papers should follow the standard ACM SIG proceedings format

(http://www.acm.org/sigs/publications/proceedings-templates) and 

need to be submitted electronically via 

EasyChair (https://www.easychair.org/conferences/?conf=lt2015). 

Accepted papers will be published in the ICPE 2015 Proceedings. Submitted 

papers can be research papers, position papers, case studies or experience 

reports addressing issues including but not limited to the following:

- Efficient and cost-effective test executions

- Rapid and scalable analysis of the test results

- Case studies and experience reports on large-scale testing

- Large-scale testing on emerging systems (e.g., adaptive/autonomic systems 

  or cloud services)

- Taxonomies of testing large-scale software systems

- Large-scale testing in the context of agile software development process

- Using performance models to support large-scale testing

- Efficient test data management for large-scale testing

Important Dates

- Intent to Submit:                   October 20th, 2014

- Research Papers:                    October 27th, 2014

- Industry Talks:                     November 19th, 2014

- Notifications:                      November 30th, 2014

- Workshop date:                      January 31st, 2015

Workshop Organizers

- Andreas Brunnert, fortiss GmbH, Germany

- Zhen Ming (Jack) Jiang, York University, Canada

Program Committee

- Bram Adams (École Polytechnique de Montréal, Canada)

- Cor-Paul Bezemer (Delft University of Technology, Netherlands)

- Thomas Cerqueus (University College Dublin, Ireland)

- Christoph Csallner (University of Texas at Arlington, USA)

- Shaun Dunning (NetApp Inc., USA) 

- Gregory Franks (Carleton University, Canada) 

- Vahid Garousi (University of Calgary, Canada)

- Ahmed E. Hassan (Queen’s University, Canada)

- Robert Horrox (EMC Isilon, USA)

- André van Hoorn (University of Stuttgart, Germany)

- Diwakar Krishnamurthy (University of Calgary, Canada)

- Haroon Malik (University of Waterloo, Canada)

- Jerome A. Rolia (HP Labs, USA)

- Gerson Sunyé (University of Nantes, France)

- Anthony Ventresque (University College Dublin, Ireland)