Abstract




 
   

Vol. 1, No. 4 (November 1988) 201-210   

downloaded Downloaded: 38   viewed Viewed: 1376

  A PARTIALLY OBSERVABLE MARKOVIAN MAINTENANCE PROCESS WITH CONTINUOUS COST FUNCTIONS
 
 
M. Aryanezhad

Department of Industrial Engineering
Iran University of Science and technology
Tehran, Iran
 
 
( Received: September 1988 )
 
 

Abstract    In this paper a two-state Markovian maintenance process where the true state is unknown will be considered. The operating cost per period is a continuous random variable which depends on the state of the process. If investigation cost is incurred at the beginning of any period, the system wit I be returned to the "in-control" state instantaneously. This problem is solved using the average criteria. The method involves exploiting the structure of the problem to develop an algorithm which is shown to be more efficient than the usual dynamic programming approach. Results of extensive tests show the accuracy of this algorithm. In addition, it is shown that if certain condition is satisfied, then it is possible to find the average cost per period by a simple calculation.

 
 

References   

1. Aryanezhad, M. B., “Optimal Investigation of partially Observable Markovian Maintenance Process”, Proceedings, of APROS 1988 Conference, SEOL, KOREA.
2. Brown, G. D., “Recursive Sets of Rules in Statistical Decision Processes”, In Statistical papers in Honor of George, W. Schnedecor, Edited by Bancroft, T. A., Amess, lowa State University Press, (1972).
3. Buckman, A. G. and Miller, B. L., “Optimal Investigation as a Regenerative Stopping Problem”, Working paper Western Management Science Institute, University of Calfornia, Los Angeles, No. 289, (1979).
4. Buckman, A. G. and Miller, R. L. Optimal Investigation of a Multiple Cost processes System”, J. of Accounting Research”, Vol. 20, (1982), 28-41.
5. Clinlar, E., “Introduction to Stochastic Processes”, Prinntice Hall,Inc., Englewood Cliffs, N. J., (1975).
6. Denardo, E. J., “Contraction Mapping in the Theory of Underlying Dynamic Programming,” SIAMReview, Vol. 9, (1967), 165-77.
7. Dittman, D. and Prakash, P., “Cost Variance Investigation, Markovian Control of Markovian Processes”, J. of Accounting Research, Vol. 16, (1978), 14-25.
8. Dittman, D. and Prakash, P., “Cost Variance Investigation, markovian vs. Optimal Control”, The Acconting Review, Vol. 54, (1979), 385-73.





International Journal of Engineering
E-mail: office@ije.ir
Web Site: http://www.ije.ir