Dynamic partitioning of the cache hierarchy in shared data centers

Gokul Soundararajan, Jin Cheny, Mohamed A. Sharaf, Cristiana Amza

Research output: Contribution to journalArticlepeer-review

15 Citations (Scopus)


Due to the imperative need to reduce the management costs of large data centers, operators multiplex several concurrent database applications on a server farm connected to shared network attached storage. Determining and enforcing per-application resource quotas in the resulting cache hierarchy, on the fly, poses a complex resource allocation problem spanning the database server and the storage server tiers. This problem is further complicated by the need to provide strict Quality of Service (QoS) guarantees to hosted applications. In this paper, we design and implement a novel coordinated partitioning technique of the database buffer pool and storage cache between applications for any given cache replacement policy and per-application access pattern. We use statistical regression to dynamically determine the mapping between cache quota settings and the resulting per-application QoS. A resource controller embedded within the database engine actuates the partitioning of the two-level cache, converging towards the configuration with maximum application utility, expressed as the service provider revenue in that configuration, based on a set of latency sample points. Our experimental evaluation, using the MySQL database engine, a server farm with consolidated storage, and two e-commerce benchmarks, shows the effectiveness of our technique in enforcing application QoS, as well as maximizing the revenue of the service provider in shared server farms Copyright 2008 VLDB Endowment.

Original languageEnglish
Pages (from-to)635-646
Number of pages12
JournalProceedings of the VLDB Endowment
Issue number1
Publication statusPublished - 2008
Externally publishedYes

ASJC Scopus subject areas

  • Computer Science (miscellaneous)
  • General Computer Science


Dive into the research topics of 'Dynamic partitioning of the cache hierarchy in shared data centers'. Together they form a unique fingerprint.

Cite this