Tutorial – Performance Benchmarking of Infrastructure-as-a-Service (IaaS) Clouds with Cloud WorkBench

Abstract

The continuing growth of the cloud computing market has led to an unprecedented diversity of cloud services with different performance characteristics. To support service selection, researchers and practitioners conduct cloud performance benchmarking by measuring and objectively comparing the performance of different providers and configurations (e.g., instance types in different data center regions). In this tutorial, we demonstrate how to write performance tests for IaaS clouds using the Web-based benchmarking tool Cloud WorkBench (CWB). We will motivate and introduce benchmarking of IaaS cloud in general, demonstrate the execution of a simple benchmark in a public cloud environment, summarize the CWB tool architecture, and interactively develop and deploy a more advanced benchmark together with the participants.

Publication
2019 IEEE 4th International Workshops on Foundations and Applications of Self* Systems (FAS*W)

This tutorial was presented at FAS*W, which is the tutorial and workshop track co-located with the conferences ICAC and SASO:

  • The 16th IEEE International Conference on Autonomic Computing (ICAC)
  • The 13th IEEE International Conference on Self-Adaptive and Self-Organizing Systems (SASO 2019)

Notice that ICAC and SASO will be merged into International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS) in 2020.

CWB Tutorial