BigDataBench: a Big Data Benchmark Suite from Web Search Engines

Abstract

This paper presents our joint research efforts on big data benchmarking with several industrial partners. Considering the complexity, diversity, workload churns, and rapid evolution of big data systems, we take an incremental approach in big data benchmarking. For the first step, we pay attention to search engines, which are the most important domain in Internet services in terms of the number of page views and daily visitors. However, search engine service providers treat data, applications, and web access logs as business confidentiality, which prevents us from building benchmarks. To overcome those difficulties, with several industry partners, we widely investigated the open source solutions in search engines, and obtained the permission of using anonymous Web access logs. Moreover, with two years' great efforts, we created a sematic search engine named ProfSearch (available from http://prof.ict.ac.cn). These efforts pave the path for our big data benchmark suite from search engines---BigDataBench, which is released on the web page (http://prof.ict.ac.cn/BigDataBench). We report our detailed analysis of search engine workloads, and present our benchmarking methodology. An innovative data generation methodology and tool are proposed to generate scalable volumes of big data from a small seed of real data, preserving semantics and locality of data. Also, we preliminarily report two case studies using BigDataBench for both system and architecture researches.

arXiv comment7 pages, 5 figures, The Third Workshop on Architectures and Systems for Big Data(ASBD 2013) in conjunction with The 40th International Symposium on Computer Architecture, May 2013

References in corpus (1)

• High Volume Computing: Identifying and Characterizing Throughput Oriented Workloads in Data Centers

Cited by in corpus (9)

• RIoTBench: A Real-time IoT Benchmark for Distributed Stream Processing Platforms
• Benchmarking Distributed Stream Processing Platforms for IoT Applications
• Improving Spark Application Throughput Via Memory Aware Task Co-location: A Mixture of Experts Approach
• Characterizing Data Analysis Workloads in Data Centers
• BDGS: A Scalable Big Data Generator Suite in Big Data Benchmarking
• AxPUE: Application Level Metrics for Power Usage Effectiveness in Data Centers
• Benchmarking Big Data Systems: State-of-the-Art and Future Directions
• The Implications from Benchmarking Three Big Data Systems
• Understanding Big Data Analytic Workloads on Modern Processors