Chronicles of jockeying in queuing systems
2402.11061
0
0
Abstract
The relevance of studies in queuing theory in social systems has inspired its adoption in other mainstream technologies with its application in distributed and communication systems becoming an intense research domain. Considerable work has been done regarding the application of the impatient queuing phenomenon in distributed computing to achieve optimal resource sharing and allocation for performance improvement. Generally, there are two types of common impatient queuing behaviour that have been well studied, namely balking and reneging, respectively. In this survey, we are interested in the third type of impatience: jockeying, a phenomenon that draws origins from impatient customers switching from one queue to another. This survey chronicles classical and latest efforts that labor to model and exploit the jockeying behaviour in queuing systems, with a special focus on those related to information and communication systems, especially in the context of Multi-Access Edge Computing. We comparatively summarize the reviewed literature regarding their methodologies, invoked models, and use cases.
Create account to get full access
Overview
- Explores the concept of "jockeying" in queuing systems, where customers switch between queues to try and get served faster
- Categorizes different types of jockeying models and analyzes their behavior
- Examines the impact of jockeying on queue dynamics and system performance
Plain English Explanation
Queuing systems are common in our daily lives, from waiting in line at the grocery store to calling a customer service hotline. In these systems, customers arrive and join a queue to be served in order. However, sometimes customers get impatient and try to switch to a different queue that they think will get them served faster. This behavior is known as "jockeying."
The research paper explores different models of jockeying behavior and how it affects the overall performance of the queuing system. For example, in one model, customers can instantly switch between queues, while in another, they have to wait a certain amount of time before they can switch.
By understanding these different jockeying behaviors, researchers can develop better queue management strategies and optimization techniques to improve the overall efficiency and customer experience of queuing systems. This knowledge can be applied in a wide range of settings, from call centers and hospitals to transportation hubs and AI-based routing systems.
Technical Explanation
The research paper categorizes jockeying models into two main types: instantaneous jockeying and timed jockeying. In instantaneous jockeying, customers can switch between queues instantly, while in timed jockeying, they must wait a certain amount of time before they can switch.
The paper then analyzes the behavior of these different jockeying models using Markov decision processes and other mathematical techniques. This allows the researchers to understand how factors like customer impatience, queue lengths, and service rates influence the overall system performance, such as average wait times and throughput.
The researchers also explore more complex jockeying scenarios, such as when customers have imperfect information about queue lengths or when there are multiple classes of customers with different priorities. By incorporating these real-world complexities, the paper provides a more comprehensive understanding of how jockeying can impact the dynamics and performance of queuing systems.
Critical Analysis
The paper provides a thorough and rigorous analysis of jockeying behavior in queuing systems, exploring a range of models and scenarios. However, the authors acknowledge that their work is primarily theoretical and does not directly address practical implementation challenges.
For example, the paper does not consider the cost and feasibility of implementing the proposed queue management strategies in real-world settings. There may also be challenges in accurately measuring customer impatience and preferences, which are key inputs to the models.
Additionally, the paper does not address the potential ethical concerns around queue management, such as the fairness of prioritizing certain customers over others. As queue management systems become more sophisticated, these social and ethical considerations will be increasingly important to consider.
Overall, the research provides valuable theoretical insights, but further work is needed to bridge the gap between the models and real-world application.
Conclusion
This research paper offers a comprehensive exploration of the concept of "jockeying" in queuing systems, where customers attempt to switch between queues to get served faster. By analyzing different models of jockeying behavior, the researchers have provided a deeper understanding of how this phenomenon can impact the overall performance and dynamics of queuing systems.
The findings from this study have the potential to inform the design of more efficient and customer-friendly queue management strategies across a wide range of industries, from call centers and healthcare to transportation hubs and AI-powered routing systems. As queuing systems become more complex and pervasive in our lives, the insights from this research will be increasingly valuable in improving the overall customer experience and optimizing resource utilization.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
Resource Allocation in Mobile Networks: A Decision Model Of Jockeying in Queues
Anthony Kiggundu, Bin Han, Dennis Krummacker, Hans D. Schotten
0
0
Use-case-specific network slicing in decentralized multi-tenancy cloud environments is a promising approach to bridge the gap between the demand and supply of resources in next-generation communication networks. Our findings associate different slice profiles to queues in a multi-server setting, such that tenants continuously assess their preferences and make rational decisions to minimize the queuing delay. Deviated from classical approaches that statistically model the jockeying phenomena in queuing systems, our work pioneers to setup a behavioral model of jockeying impatient tenants. This will serve as a basis for decentralized management of multi-queue systems, where the decision to jockey is individually made by each tenant upon its up-to-date assessment of expected waiting time. Additionally, we carry out numerical simulations to empirically unravel the parametric dependencies of the tenants' jockeying behavior.
5/20/2024
🏅
Design and Scheduling of an AI-based Queueing System
Jiung Lee, Hongseok Namkoong, Yibo Zeng
0
0
To leverage prediction models to make optimal scheduling decisions in service systems, we must understand how predictive errors impact congestion due to externalities on the delay of other jobs. Motivated by applications where prediction models interact with human servers (e.g., content moderation), we consider a large queueing system comprising of many single server queues where the class of a job is estimated using a prediction model. By characterizing the impact of mispredictions on congestion cost in heavy traffic, we design an index-based policy that incorporates the predicted class information in a near-optimal manner. Our theoretical results guide the design of predictive models by providing a simple model selection procedure with downstream queueing performance as a central concern, and offer novel insights on how to design queueing systems with AI-based triage. We illustrate our framework on a content moderation task based on real online comments, where we construct toxicity classifiers by finetuning large language models.
6/12/2024
🤿
Queuing dynamics of asynchronous Federated Learning
Louis Leconte, Matthieu Jonckheere, Sergey Samsonov, Eric Moulines
0
0
We study asynchronous federated learning mechanisms with nodes having potentially different computational speeds. In such an environment, each node is allowed to work on models with potential delays and contribute to updates to the central server at its own pace. Existing analyses of such algorithms typically depend on intractable quantities such as the maximum node delay and do not consider the underlying queuing dynamics of the system. In this paper, we propose a non-uniform sampling scheme for the central server that allows for lower delays with better complexity, taking into account the closed Jackson network structure of the associated computational graph. Our experiments clearly show a significant improvement of our method over current state-of-the-art asynchronous algorithms on an image classification problem.
5/2/2024
The logistic queue model: theoretical properties and performance evaluation
Franco Coltraro, Marc Ruiz, Luis Velasco
0
0
The advent of digital twins (DT) for the control and management of communication networks requires accurate and fast methods to estimate key performance indicators (KPI) needed for autonomous decision-making. Among several alternatives, queuing theory can be applied to model a real network as a queue system that propagates entities representing network traffic. By using fluid flow queue simulation and numerical methods, a good trade-off between accuracy and execution time can be obtained. In this work, we present the formal derivation and mathematical properties of a continuous fluid flow queuing model called the logistic queue model. We give novel proofs showing that this queue model has all the theoretical properties one should expect such as positivity of the queue and first-in first-out (FIFO) property. Moreover, extensions are presented in order to model different characteristics of telecommunication networks, including finite buffer sizes and propagation of flows with different priorities. Numerical results are presented to validate the accuracy and improved performance of our approach in contrast to traditional discrete event simulation, using synthetic traffic generated with the characteristics of real captured network traffic. Finally, we evaluate a DT built using a queue system based on the logistic queue model and demonstrate its applicability to estimate KPIs of an emulated real network under different traffic conditions.
5/29/2024