TY - GEN
T1 - Potential-driven load distribution for distributed data stream processing
AU - Wang, Weihan
AU - Sharaf, Mohamed A.
AU - Guo, Shimin
AU - Özsu, M. Tamer
PY - 2008
Y1 - 2008
N2 - A large class of applications require real-time processing of continuous stream data resulting in the development of data stream management systems (DSMS). Since many of these applications are distributed, distributed DSMSs are starting to receive attention. In this paper, we focus on an important issue in distributed DSMS operation, namely load distribution to minimize end-to-end latency. We identify the often conflicting requirements of load distribution, and propose a "potential-driven" load distribution approach to mimic the movements of objects in the physical world. Our approach also takes into account heterogeneous machines, different network conditions, and resource constraints. We present experimental results that investigate our algorithms from various aspects, and show that they outperform existing techniques in terms of end-to-end latency.
AB - A large class of applications require real-time processing of continuous stream data resulting in the development of data stream management systems (DSMS). Since many of these applications are distributed, distributed DSMSs are starting to receive attention. In this paper, we focus on an important issue in distributed DSMS operation, namely load distribution to minimize end-to-end latency. We identify the often conflicting requirements of load distribution, and propose a "potential-driven" load distribution approach to mimic the movements of objects in the physical world. Our approach also takes into account heterogeneous machines, different network conditions, and resource constraints. We present experimental results that investigate our algorithms from various aspects, and show that they outperform existing techniques in terms of end-to-end latency.
KW - Data streams
KW - Distributed systems
KW - Load balancing
UR - http://www.scopus.com/inward/record.url?scp=57349146302&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=57349146302&partnerID=8YFLogxK
U2 - 10.1145/1379272.1379277
DO - 10.1145/1379272.1379277
M3 - Conference contribution
AN - SCOPUS:57349146302
SN - 9781595939630
T3 - ACM International Conference Proceeding Series
SP - 13
EP - 22
BT - ACM International Conference Proceeding Series - Proceedings of the 2nd International Workshop on Scalable Stream Processing System 2008, SSPS'08
T2 - 2nd International Workshop on Scalable Stream Processing System 2008, SSPS'08
Y2 - 9 March 2008 through 9 March 2008
ER -