OL-DEC-MDP Model for Multiagent Online Scheduling with a Time-Dependent Probability of Success

Joint Authors

Luo, Jiangfeng
Zhang, Weiming
Zhu, Cheng
Liu, Zhong

Source

Mathematical Problems in Engineering

Issue

Vol. 2014, Issue 2014 (31 Dec. 2014), pp.1-10, 10 p.

Publisher

Hindawi Publishing Corporation

Publication Date

2014-07-22

Country of Publication

Egypt

No. of Pages

10

Main Subjects

Civil Engineering

Abstract EN

Focusing on the on-line multiagent scheduling problem, this paper considers the time-dependent probability of success and processing duration and proposes an OL-DEC-MDP (opportunity loss-decentralized Markov Decision Processes) model to include opportunity loss into scheduling decision to improve overall performance.

The success probability of job processing as well as the process duration is dependent on the time at which the processing is started.

The probability of completing the assigned job by an agent would be higher when the process is started earlier, but the opportunity loss could also be high due to the longer engaging duration.

As a result, OL-DEC-MDP model introduces a reward function considering the opportunity loss, which is estimated based on the prediction of the upcoming jobs by a sampling method on the job arrival.

Heuristic strategies are introduced in computing the best starting time for an incoming job by each agent, and an incoming job will always be scheduled to the agent with the highest reward among all agents with their best starting policies.

The simulation experiments show that the OL-DEC-MDP model will improve the overall scheduling performance compared with models not considering opportunity loss in heavy-loading environment.

American Psychological Association (APA)

Zhu, Cheng& Luo, Jiangfeng& Zhang, Weiming& Liu, Zhong. 2014. OL-DEC-MDP Model for Multiagent Online Scheduling with a Time-Dependent Probability of Success. Mathematical Problems in Engineering،Vol. 2014, no. 2014, pp.1-10.
https://search.emarefa.net/detail/BIM-496053

Modern Language Association (MLA)

Zhu, Cheng…[et al.]. OL-DEC-MDP Model for Multiagent Online Scheduling with a Time-Dependent Probability of Success. Mathematical Problems in Engineering No. 2014 (2014), pp.1-10.
https://search.emarefa.net/detail/BIM-496053

American Medical Association (AMA)

Zhu, Cheng& Luo, Jiangfeng& Zhang, Weiming& Liu, Zhong. OL-DEC-MDP Model for Multiagent Online Scheduling with a Time-Dependent Probability of Success. Mathematical Problems in Engineering. 2014. Vol. 2014, no. 2014, pp.1-10.
https://search.emarefa.net/detail/BIM-496053

Data Type

Journal Articles

Language

English

Notes

Includes bibliographical references

Record ID

BIM-496053