The first benchmark suite for emerging scale-out applications


Falsafi Babak

Project Website

CloudSuite is a benchmark suite for emerging scale-out applications. The first release consists of six applications that have been selected based on their popularity in today’s datacenters. The benchmarks are based on real-world software stacks and represent real-world setups.

Cloud computing is emerging as a dominant computing platform for providing scalable online services to a global client base. Today’s popular online services (e.g., web search, social networking, and business analytics) are characterized by massive working sets, high degrees of parallelism, and realtime constraints. These characteristics set scale-out applications apart from desktop (SPEC), parallel (PARSEC), and traditional commercial server applications. In order to stimulate research in the field of cloud and data-centric computing, we have created CloudSuite, a benchmark suite based on realworld online services.

CloudSuite covers a broad range of application categories commonly found in today’s datacenters. The first release includes data analytics, data serving, media streaming, large-scale and computationintensive tasks, web search, and web serving. More information about the benchmarks may be found in the overview page.

CloudSuite on Flexus

To faciliate micro-architectural simulation of CloudSuite applications, we prepared CloudSuite images running on Simics full-system simulator. The Simics images allow the simulation of  CloudSuite applications running on up-to 64 cores and were released at our ISCA 2012 tutorial: “CloudSuite on Flexus”.

CloudSuite is available for researchers interested in pursuing research in the field of cloud computing and datacenters. CloudSuite’s software components are all available as open-source software. All of the software components are governed by their own licencing terms. Researchers interested in using CloudSuite are required to fully understand and abide by the licensing terms of the various components. For more information, please refer to the licenses page.

For a microarchitectural characterization of the benchmarks, please see the following ASPLOS paper: Clearing the Clouds: A Study of Emerging Scale-out Workloads on Modern Hardware.