A multiple model adaptive dual control algorithm for stochastic systems with unknown parameters
IEEE Transactions on Automatic ControlPublished 1 August 1980
C. Wenk, Yaakov Bar‐Shalom
Citations53
SJR quartileQ1
SJR score3.80
SNIP2.59
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
Abstract
An adaptive dual control algorithm is presented for linear stochastic systems with constant but unknown parameters. The system parameters are assumed to belong to a finite set on which a prior probability distribution is available. The tool used to derive the algorithm is preposterior analysis: a probabilistic characterization of the future adaptation process allows the controller to take advantage of the dual effect. The resulting actively adaptive control called model adaptive dual (MAD) control is compared to two passively adaptive control algorithms-the heuristic certainty equivalence (HCE) and the Deshpande-Upadhyay-Lainiotis (DUL) model-weighted controllers. An analysis technique developed for the comparison of different controllers is used to show statistically significant improvement in the performance of the MAD algorithm over those of the HCE and DUL.
Keywords
Engineering
CERN Document Server (European Organization for Nuclear Research)Principles of Communication Engineering
1,920 Citations1965I. M. Jacobs, John M. Wozencraft
Textbook on communication engineering emphasizing random processes, information and detection theory, statistical communication theory, applications, etc.
Optimization of stochastic systems
579 Citations1986Peter W. Glynn
This paper gives a short survey of Monte Carlo algorithms for stochastic optimization, with emphasis on the analysis of convergence rate.
IEEE Transactions on Automatic ControlDual effect, certainty equivalence, and separation in stochastic control
381 Citations1974Yaakov Bar‐Shalom, Edison Tse
IEEE Transactions on Automatic ControlThe stochastic control of the F-8C aircraft using a multiple model adaptive control (MMAC) method--Part I: Equilibrium flight
347 Citations1977Michael Athans, David A. Castañón +5 more
IEEE Transactions on Automatic ControlAn actively adaptive control for linear systems with random parameters via the dual control approach
115 Citations1973Edison Tse, Yaakov Bar‐Shalom
AutomaticaAdaptive control of linear stochastic systems
99 Citations1973Jayant G. Deshpande, T.N. Upadhyay +1 more
An adaptive control algorithm for linear systems with unknown constant parameters and quadratic performance criterion has been obtained and is given as the weighted integral of the model conditional optimal controls with the a-posteriori probabilities as weights.
IEEE Transactions on Automatic ControlParameter identification and control of linear discrete-time systems
71 Citations1972G.N. Saridis, Robert N. Lobbia
The parameter-adaptive self-organizing control of linear discrete-time systems is considered by designing dynamic feedback controllers which depend on the estimates of the parameters provided by an appropriate identifier.
IEEE Transactions on Automatic ControlIdentification and control of linear discrete systems
59 Citations1967James B. Farison, R. A. Graham +1 more
Algorithms for explicit calculation of the identification and control of linear discrete systems with Gauss-Markov random parameters and conditioned quadratic cost function are given for systems with perfect state measurement.
AutomaticaA learning approach to the parameter-adaptive self-organizing control problem
48 Citations1972G.N. Saridis, T.K. Dao
A new algorithm for the solution of the Parameter-Adaptive Self-Organizing Control Problem is proposed, based on the learning property of the a posteriori probabilities of the parameter estimates, which forces the algorithm to converge to the optimal solution rapidly.
AutomaticaSynthesis of cascaded multiple-loop feedback systems with large plant parameter ignorance
39 Citations1973Isaac Horowitz, Marcel J. Sidi
A design procedure is presented wherein one works backwards step by step from the system output, designing each loop function L"i almost as if the remaining loops (L"i"+"j, j>0) are perfect.
AutomaticaA parameter-adaptive control technique
36 Citations1969G. Stein, G.N. Saridis
Control of linear stochastic systems with unknown parameters is accomplished by means of an approximate solution of the associated functional equation of dynamic programming which leads to an adaptive control system which is linear in an expanded vector of state estimates with feedback gains which are explicit functions of a posteriori parameter probabilities.
IEEE Transactions on Automatic ControlApplication of stochastic control theory to resource allocation under uncertainty
18 Citations1974Yaakov Bar‐Shalom, R. Larson +1 more
The subject of this paper is the application of stochastic control theory to resource allocation under uncertainty in the context of the general problem of allocating resources to repair machines where it is possible to perform a limited number of diagnostic experiments to learn more about potential failures.
IEEE Transactions on Automatic ControlOptimum control of an unknown linear plant using Bayesian estimation of the error
12 Citations1965H.A. Spang
Effect of uncertainties on the control performance of linear systems with unknown parameters and trajectory confidence tubes
4 Citations1977Yaakov Bar‐Shalom
An algorithm based upon the open-loop feedback concept is presented that evaluates the increase in the cost due to parameter errors and can be used to assess the potential usefulness of adaptive control for a problem.
Performance adaptive resource allocation in a time-varying environment
3 Citations1976Yaakov Bar‐Shalom
A suboptimal procedure that preserves the essential features of stochastic dynamic programming is developed and is measured in terms of the improvement in the performance index when the action resources are allocated subsequently with more accurate, even though still imperfect, information.