Applying Design of Experiments (DOE) to performance evaluation of commercial cloud services

Zheng Li, Liam OàBrien, He Zhang, Rajiv Ranjan

    Research output: Contribution to journalArticlepeer-review

    Abstract

    Appropriate performance evaluations of commercial Cloud services are crucial and beneficial for both customers and providers to understand the service runtime, while suitable experimental design and analysis would be vital for practical evaluation implementations. However, there seems to be a lack of effective methods for Cloud services performance evaluation. For example, in most of the existing evaluation studies, experimental factors (also called parameters or variables) were considered randomly and intuitively, experimental sample sizes were determined on the fly, and few experimental results were comprehensively analyzed. To address these issues, the authors suggest applying Design of Experiments (DOE) to Cloud services evaluation. To facilitate applying DOE techniques, this paper introduces an experimental factor framework and a set of DOE application scenarios. As such, new evaluators can explore and conveniently adapt our work to their own experiments for performance evaluation of commercial Cloud services.

    Original languageEnglish
    Pages (from-to)75-93
    Number of pages19
    JournalInternational Journal of Grid and High Performance Computing
    Volume5
    Issue number3
    DOIs
    Publication statusPublished - 2013

    Fingerprint

    Dive into the research topics of 'Applying Design of Experiments (DOE) to performance evaluation of commercial cloud services'. Together they form a unique fingerprint.

    Cite this