Conference Contribution

Cloud Application Predictability through Integrated Load-Balancing and Service Time Control

Tommi Nylander, Marcus Thelander Andrén, Karl-Erik Årzén, Martina Maggio


Cloud computing provides the illusion of infinite capacity to application developers. However, data center provisioning is complex and it is still necessary to handle the risk of capacity shortages. To handle capacity shortages, graceful degradation techniques sacrifice user experience for predictability. In all these cases, the decision making policy that determines the degradation interferes with other decisions happening at the infrastructure level, like load-balancing choices. Here, we reconcile the two approaches, developing a load-balancing strategy that also handles capacity shortages and graceful degradation when necessary. The proposal is based on a sound control-theoretical approach. The design of the approach avoids the pitfalls of interfering control decisions. We describe the technique and provide evidence that it allows us to achieve higher performance in terms of emergency management and user experience.


Cloud computing, Graceful degradation, Load balancing


In 15th IEEE International Conference on Autonomic Computing , Trento, Italy, September  2018.

Download tommi-icac-2018-final.pdf

Record in LUP