A generic auto-provisioning framework for cloud databases

Jennie Rogers*, Olga Papaemmanouil, Ugur Cetintemel

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

25 Citations (Scopus)

Abstract

We discuss the problem of resource provisioning for database management systems operating on top of an Infrastructure-As-A-Service (IaaS) cloud. To solve this problem, we describe an extensible framework that, given a target query workload, continually optimizes the system's operational cost, estimated based on the IaaS provider's pricing model, while satisfying QoS expectations. Specifically, we describe two different approaches, a "white-box" approach that uses a fine-grained estimation of the expected resource consumption for a workload, and a "black-box" approach that relies on coarse-grained profiling to characterize the workload's end-to-end performance across various cloud resources. We formalize both approaches as a constraint programming problem and use a generic constraint solver to efficiently tackle them. We present preliminary experimental numbers, obtained by running TPC-H queries with PostsgreSQL on Amazon's EC2, that provide evidence of the feasibility and utility of our approaches. We also briefly discuss the pertinent challenges and directions of on-going research.

Original languageEnglish (US)
Title of host publicationICDE Workshops 2010 - The 2010 IEEE 26th International Conference on Data Engineering Workshops
Pages63-68
Number of pages6
DOIs
StatePublished - May 28 2010
Event2010 IEEE 26th International Conference on Data Engineering Workshops, ICDEW 2010 - Long Beach, CA, United States
Duration: Mar 1 2010Mar 6 2010

Publication series

NameProceedings - International Conference on Data Engineering
ISSN (Print)1084-4627

Other

Other2010 IEEE 26th International Conference on Data Engineering Workshops, ICDEW 2010
CountryUnited States
CityLong Beach, CA
Period3/1/103/6/10

Fingerprint

Costs
Quality of service

ASJC Scopus subject areas

  • Software
  • Signal Processing
  • Information Systems

Cite this

Rogers, J., Papaemmanouil, O., & Cetintemel, U. (2010). A generic auto-provisioning framework for cloud databases. In ICDE Workshops 2010 - The 2010 IEEE 26th International Conference on Data Engineering Workshops (pp. 63-68). [5452746] (Proceedings - International Conference on Data Engineering). https://doi.org/10.1109/ICDEW.2010.5452746
Rogers, Jennie ; Papaemmanouil, Olga ; Cetintemel, Ugur. / A generic auto-provisioning framework for cloud databases. ICDE Workshops 2010 - The 2010 IEEE 26th International Conference on Data Engineering Workshops. 2010. pp. 63-68 (Proceedings - International Conference on Data Engineering).
@inproceedings{a8871b8efc0e43fbaf02eda0fab24356,
title = "A generic auto-provisioning framework for cloud databases",
abstract = "We discuss the problem of resource provisioning for database management systems operating on top of an Infrastructure-As-A-Service (IaaS) cloud. To solve this problem, we describe an extensible framework that, given a target query workload, continually optimizes the system's operational cost, estimated based on the IaaS provider's pricing model, while satisfying QoS expectations. Specifically, we describe two different approaches, a {"}white-box{"} approach that uses a fine-grained estimation of the expected resource consumption for a workload, and a {"}black-box{"} approach that relies on coarse-grained profiling to characterize the workload's end-to-end performance across various cloud resources. We formalize both approaches as a constraint programming problem and use a generic constraint solver to efficiently tackle them. We present preliminary experimental numbers, obtained by running TPC-H queries with PostsgreSQL on Amazon's EC2, that provide evidence of the feasibility and utility of our approaches. We also briefly discuss the pertinent challenges and directions of on-going research.",
author = "Jennie Rogers and Olga Papaemmanouil and Ugur Cetintemel",
year = "2010",
month = "5",
day = "28",
doi = "10.1109/ICDEW.2010.5452746",
language = "English (US)",
isbn = "9781424465217",
series = "Proceedings - International Conference on Data Engineering",
pages = "63--68",
booktitle = "ICDE Workshops 2010 - The 2010 IEEE 26th International Conference on Data Engineering Workshops",

}

Rogers, J, Papaemmanouil, O & Cetintemel, U 2010, A generic auto-provisioning framework for cloud databases. in ICDE Workshops 2010 - The 2010 IEEE 26th International Conference on Data Engineering Workshops., 5452746, Proceedings - International Conference on Data Engineering, pp. 63-68, 2010 IEEE 26th International Conference on Data Engineering Workshops, ICDEW 2010, Long Beach, CA, United States, 3/1/10. https://doi.org/10.1109/ICDEW.2010.5452746

A generic auto-provisioning framework for cloud databases. / Rogers, Jennie; Papaemmanouil, Olga; Cetintemel, Ugur.

ICDE Workshops 2010 - The 2010 IEEE 26th International Conference on Data Engineering Workshops. 2010. p. 63-68 5452746 (Proceedings - International Conference on Data Engineering).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - A generic auto-provisioning framework for cloud databases

AU - Rogers, Jennie

AU - Papaemmanouil, Olga

AU - Cetintemel, Ugur

PY - 2010/5/28

Y1 - 2010/5/28

N2 - We discuss the problem of resource provisioning for database management systems operating on top of an Infrastructure-As-A-Service (IaaS) cloud. To solve this problem, we describe an extensible framework that, given a target query workload, continually optimizes the system's operational cost, estimated based on the IaaS provider's pricing model, while satisfying QoS expectations. Specifically, we describe two different approaches, a "white-box" approach that uses a fine-grained estimation of the expected resource consumption for a workload, and a "black-box" approach that relies on coarse-grained profiling to characterize the workload's end-to-end performance across various cloud resources. We formalize both approaches as a constraint programming problem and use a generic constraint solver to efficiently tackle them. We present preliminary experimental numbers, obtained by running TPC-H queries with PostsgreSQL on Amazon's EC2, that provide evidence of the feasibility and utility of our approaches. We also briefly discuss the pertinent challenges and directions of on-going research.

AB - We discuss the problem of resource provisioning for database management systems operating on top of an Infrastructure-As-A-Service (IaaS) cloud. To solve this problem, we describe an extensible framework that, given a target query workload, continually optimizes the system's operational cost, estimated based on the IaaS provider's pricing model, while satisfying QoS expectations. Specifically, we describe two different approaches, a "white-box" approach that uses a fine-grained estimation of the expected resource consumption for a workload, and a "black-box" approach that relies on coarse-grained profiling to characterize the workload's end-to-end performance across various cloud resources. We formalize both approaches as a constraint programming problem and use a generic constraint solver to efficiently tackle them. We present preliminary experimental numbers, obtained by running TPC-H queries with PostsgreSQL on Amazon's EC2, that provide evidence of the feasibility and utility of our approaches. We also briefly discuss the pertinent challenges and directions of on-going research.

UR - http://www.scopus.com/inward/record.url?scp=77952656750&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77952656750&partnerID=8YFLogxK

U2 - 10.1109/ICDEW.2010.5452746

DO - 10.1109/ICDEW.2010.5452746

M3 - Conference contribution

SN - 9781424465217

T3 - Proceedings - International Conference on Data Engineering

SP - 63

EP - 68

BT - ICDE Workshops 2010 - The 2010 IEEE 26th International Conference on Data Engineering Workshops

ER -

Rogers J, Papaemmanouil O, Cetintemel U. A generic auto-provisioning framework for cloud databases. In ICDE Workshops 2010 - The 2010 IEEE 26th International Conference on Data Engineering Workshops. 2010. p. 63-68. 5452746. (Proceedings - International Conference on Data Engineering). https://doi.org/10.1109/ICDEW.2010.5452746