Cloud service selection can be a complex and challenging task for a cloud engineer.mMost current approaches try to identify a best cloud service provider by evaluating several relevant criteria like prices, processing, memory, disk, network performance, quality of service and so on. Nevertheless, the decision making problem involves so many variables, that it is hard to model it appropriately.We present an approach that is not about selecting a best cloud service provider.It is about selecting most similar resources provided by different cloud service providers. This fits much better practical needs of cloud service engineers. Especially, if container clusters are involved. EasyCompare, an automated benchmarking tool suite to compare cloud service providers, is able to benchmark and compare virtual machine types of different cloud service providers using an Euclidian distance measure. It turned out, that only 1% of theoretical possible machine pairs have to be considered in practice. These relevant machine types can be identified by systematic benchmark runs in less than three hours. We present some expectable but also astonishing evaluation results of EasyCompare used to evaluate two major and representative public cloud service providers: Amazon Web Services and Google Compute Engine.

Details [KQ2015]

Author(s): Kratzke, Nane and Quint, Peter-Christian
Title(s): About Automatic Benchmarking of IaaS Cloud Service Providers for a World of Container Clusters
Journal: Journal of Cloud Computing Research
Volume: 1
Number: 1
Pages: 16-34
Publisher: Columbia International Publishing
Url: http://jccr.uscip.us/PublishedIssues.aspx
Url: https://www.researchgate.net/publication/278242891
Year: 2015