Control design for untimed Petri nets using Markov Decision Processes

Journal Title: Operations Research and Decisions - Year 2017, Vol 27, Issue 4

Abstract

Design of control sequences for discrete event systems (DESs) has been presented modelled by untimed Petri nets (PNs). PNs are well-known athematical and graphical models that are widely used to describe distributed DESs, including choices, synchronizations and parallelisms. The domains of application include, but are not restricted to, manufacturing systems, computer science and transportation networks. We are motivated by the observation that such systems need to plan their production or services. The paper is more particularly concerned with control issues in uncertain environments when unexpected events occur or when control errors disturb the behaviour of the system. To deal with such uncertainties, a new approach based on discrete time Markov decision processes (MDPs) has been proposed that associates the modelling power of PNs with the planning power of MDPs. Finally, the simulation results illustrate the benefit of our method from the computational point of view.

Authors and Affiliations

Cherki DAOUI, Dimitri LEFEBVRE

Keywords

Related Articles

Determination of the optimal exchange rate via control of the domestic interest rate in Nigeria

An economic scenario has been considered where the government seeks to achieve a favourable balance-of-payments over a fixed planning horizon through exchange rate policy and control of the domestic interest rate. The dy...

Opinion formation in social networks

A number of selected works on the dynamics of opinions and beliefs in social networks has been discussed. Both Bayesian and non-Bayesian approaches to social learning have been considered, but the analysis has been focus...

Probabilistic models for analyzing the availability and profit of a deteriorating 2-out-of-4 system

This paper deals with modelling and evaluating the availability and profit of a linear consecutive 2-out-of-4 system exposed to three consecutive stages of deterioration before failure. The system will pass through three...

Orders of criticality in voting games

The authors focus on the problem of investigating the blackmail power of players in simple games, which is the possibility of players of threatening coalitions to cause them loss using arguments that are (apparently) unj...

Estimating the reliability of the elements of cloud services

Cloud technologies are a very considerable area that influence IT infrastructure, network services and applications. Research has highlighted difficulties in the functioning of cloud infrastructure. For instance, if a se...

Download PDF file
  • EP ID EP323667
  • DOI -
  • Views 32
  • Downloads 0

How To Cite

Cherki DAOUI, Dimitri LEFEBVRE (2017). Control design for untimed Petri nets using Markov Decision Processes. Operations Research and Decisions, 27(4), 27-43. https://europub.co.uk/articles/-A-323667