Further Real Applications of Markov Decision Processes
INFORMS Journal on Applied AnalyticsPublished 1 October 1988
D. J. White
Citations81
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
This paper extends an earlier paper on real applications of Markov decision processes in which the results of the studies have been implemented, have had some influence on the actual decisions, or on which the analyses are based on real data.
Abstract
This paper extends an earlier paper [White 1985] on real applications of Markov decision processes in which the results of the studies have been implemented, have had some influence on the actual decisions, or in which the analyses are based on real data.
Keywords
Computer ScienceDecision SciencesEngineering
INFORMS Journal on Applied AnalyticsReal Applications of Markov Decision Processes
129 Citations1985Douglas J. White
In the first few years of an ongoing survey of applications of Markov decision processes where the results have been implemented or have had some influence on decisions, few applications have been identified but there appears to be an increasing effort to model many phenomena as Markov decisions processes.
European Journal of Operational ResearchBooking policy for flights with two types of passengers
119 Citations1986Jens Alstrup, Søren Boas +2 more
An overbooking model for a fixed nonstop flight with two types of passengers is presented, which treats the airline booking process as a Markovian nonhomogeneous sequential decision process and is solved by two dimensional stochastic dynamic programming.
INFORMS Journal on Applied AnalyticsCoordinating the Energy Generation of the Brazilian National Hydrothermal Electrical Generating System
103 Citations1986L. Terry, M.V.F. Pereira +3 more
Water Resources ResearchOptimization of Real‐Time Reservoir Operations With Markov Decision Processes
70 Citations1986Dapei Wang, Barry J. Adams
Operations ResearchOil Stockpiles and Import Reductions: A Dynamic Programming Approach
47 Citations1983Hung‐po Chao, Alan S. Manne
This paper analyzes oil stockpiling policies using models in which U.S. policy choices are restricted to just two instruments-stockpiles and disruption "tariffs" and develops a probabilistic view of disruptions analyzed by applying dynamic programming.
INFORMS Journal on Applied Analytics“Decision Simulators” Speed Implementation and Improve Operations
46 Citations1984Mark R. Lembersky, Uli H.
Packaging MS/OR models and algorithms in “Decision Simulators” (DS) helps users accept model performance and solutions, making implementation more likely and more rapid.
Water Resources ResearchAgricultural vs. hydropower tradeoffs in the operation of the High Aswan Dam
36 Citations1982Katherine Oven‐Thompson, Luis Alercon +1 more
Operations ResearchOptimal Claim Decisions by Policyholders in Automobile Insurance with Merit-Rating Structures
26 Citations1974Christoph Haehling von Lanzenauer
This work proposes an approach toMerit-rating structures in automobile-insurance systems that can be solved by dynamic programming, and provides a number of observations that are of interest from the insurance industry's point of view.
Transportation ScienceThe Application of Semi-Markov Decision Processes to Queueing of Aircraft for Landing at an Airport
22 Citations1985Robert C. Rue, Matthew Rosenshine
Socially optimal control of access to the landing queue of an airport is investigated and semi-Markov decision process models, M / M /1 and M / E k /1, for several classes of customers are used to determine how access should be controlled.
IEEE Transactions on Power Apparatus and SystemsA Risk-Constrained Stochastic Dynamic Programming Approach To The Operation Planning Of Hydrothermal Systems
22 Citations1985Tristao de A. Araripe Neto, Mario V. F. Pereira +1 more
INFOR Information Systems and Operational ResearchRepair Limit Policies for Vehicle Replacement<sup>†</sup>
20 Citations1982C.E. Love, Allan Rodger +1 more
Vehicle replacement using repair limit policies are found to be sensitive to the discount rate chosen; the lower the discounts chosen, the more sensitive the policy is to the condition of the vehicle.
Journal of Agricultural Engineering ResearchUse of weather uncertainty, compaction and timeliness in the selection of optimum machinery for autumn field work—A dynamic programme
15 Citations1984E. Audsley
Journal of the Operational Research SocietyOptimal Claiming on Vehicle Insurance Revisited
8 Citations1980John M. Norman, D. C. S. Shearn
INFORMS Journal on Applied AnalyticsStrategic and Midterm Planning of Forest-to-Product Flows
8 Citations1984Douglas A. Hay, Paul N. Dahl
Computers & Operations ResearchSource/sink inventory control for vehicle rental systems
5 Citations1985C.E. Love
A restocking decision is embedded into the problem, in order to determine the optimal quantity of equipment lo be periodically rebalanced between locations due to “one-way” flows.
Journal of the Operational Research SocietyOptimal Equipment Transfer Pricing in Service Systems
3 Citations1980C.E. Love
Operations research proceedingsOptimal Control of a Dam Under Seasonal Electricity Prices
2 Citations1984Laurent Cantaluppi