Example of applying markov decision process o model vehicle maintenance process

The subject of this paper are selected issues connected with modelling, prognosis and control of the process of operation and maintenance of a certain category of technical objects. The research object is a system of transport means operation. Assumptions for building a model of the operation process state changes of objects used in a complex system of operation and maintenance have been presented. The operation process model was built on the basis of an analysis of the space of states and events concerning technical objects, which are used in the analysed real transportation system. Source data necessary to make assumptions for the model development and its initial verification, has been obtained by means of the passive experiment method from a real system of transport means operation. An example of Markov decision process use for modelling and analysis of a public city transportation system operation process has been presented. Determination of values of indices characterizing the analysed process has been carried out basing on computer simulation of Markov decision process, being a mathematical model of technical objects operation process. A computing model has illustrated the entire study. Values of the model parameters have been estimated basing on the results of preliminary tests conducted in a real system of transport means operation. The model presented in this work has been built in such a way that it can be used for a wide category of problems connected with technical objects operation.