TY - GEN
T1 - Optimized processing of multiple aggregate continuous queries
AU - Guirguis, Shenoda
AU - Sharaf, Mohamed A.
AU - Chrysanthis, Panos K.
AU - Labrinidis, Alexandros
PY - 2011
Y1 - 2011
N2 - Data Streams Management Systems are designed to support monitoring applications, which require the processing of hundreds of Aggregate Continuous Queries (ACQs). These ACQs typically have different time granularities, with possibly different selection predicates and group-by attributes. In order to achieve scalability in the presence of heavy workloads, in this paper, we introduce the concept of 'Weaveability' as an indicator of the potential gains of sharing the processing of ACQs. We then propose Weave Share, a cost-based optimizer that exploits weaveability to optimize the shared processing of ACQs. Our experimental analysis shows that Weave Share outperforms the alternative sharing schemes generating up to four orders of magnitude better quality plans. Finally, we describe a practical implementation of the Weave Share optimizer.
AB - Data Streams Management Systems are designed to support monitoring applications, which require the processing of hundreds of Aggregate Continuous Queries (ACQs). These ACQs typically have different time granularities, with possibly different selection predicates and group-by attributes. In order to achieve scalability in the presence of heavy workloads, in this paper, we introduce the concept of 'Weaveability' as an indicator of the potential gains of sharing the processing of ACQs. We then propose Weave Share, a cost-based optimizer that exploits weaveability to optimize the shared processing of ACQs. Our experimental analysis shows that Weave Share outperforms the alternative sharing schemes generating up to four orders of magnitude better quality plans. Finally, we describe a practical implementation of the Weave Share optimizer.
KW - aggregate continuous queries
KW - data streams
KW - query optimization
UR - http://www.scopus.com/inward/record.url?scp=83055191146&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=83055191146&partnerID=8YFLogxK
U2 - 10.1145/2063576.2063793
DO - 10.1145/2063576.2063793
M3 - Conference contribution
AN - SCOPUS:83055191146
SN - 9781450307178
T3 - International Conference on Information and Knowledge Management, Proceedings
SP - 1515
EP - 1524
BT - CIKM'11 - Proceedings of the 2011 ACM International Conference on Information and Knowledge Management
T2 - 20th ACM Conference on Information and Knowledge Management, CIKM'11
Y2 - 24 October 2011 through 28 October 2011
ER -