On capturing human skills and knowledge; algorithmic approaches to model identification
IEEE Transactions on Systems Man and CyberneticsPublished 1 January 1989
William B. Rouse, John M. Hammer, C. Michael Lewis
Citations42
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
The discussion of available methods and known limits concludes with consideration of the general implications for endeavors aimed at describing and explaining human skills and knowledge.
Abstract
Algorithmic identification of models of human skills and knowledge is considered. Alternative representational forms are discussed in terms of variables, relationships among variables, and parameters within relationships. A key distinction is between models of signal processing and models of symbol processing. Methods of identification for these two classes of models are discussed and contrasted. Identifiability, or the uniqueness of models identified, is considered for both classes of model, and a variety of fundamental limits relating to existence and computability are reviewed. Practical issues and results associated with identification are considered in the context of three examples of identifying signal processing and symbol processing models. The discussion of available methods and known limits concludes with consideration of the general implications for endeavors aimed at describing and explaining human skills and knowledge.>
Keywords
Computer Science
The MIT Press eBooksParallel Distributed Processing
15,227 Citations1986David E. Rumelhart, James L. McClelland +1 more
Psychological ReviewTelling more than we can know: Verbal reports on mental processes.
11,285 Citations1977Richard E. Nisbett, Timothy D. Wilson
Psychological ReviewOn the psychology of prediction.
6,171 Citations1973Daniel Kahneman, Amos Tversky
Language<b>Mental models</b> : Towards a cognitive science of language, inference, and consciousness. By Philip N. Johnson-Laird (Cognitive science series, 6.) Cambridge, MA: Harvard University Press, 1983. Pp. 528. $25.00.
4,491 Citations1985Marilyn Ford
This an extraordinarily rich book, providing a coherent account of much recent experimental work in cognitive psychology, along with lucid explanations of relevant theory in linguistics, computer science, and philosophy.
A theory of the learnable
4,242 Citations1984Leslie G. Valiant
This paper regards learning as the phenomenon of knowledge acquisition in the absence of explicit programming, and gives a precise methodology for studying this phenomenon from a computational viewpoint.
Information and ControlLanguage identification in the limit
3,569 Citations1967Eric Gold
It was found that theclass of context-sensitive languages is learnable from an informant, but that not even the class of regular languages is learningable from a text.
Communications of the ACMA theory of the learnable
3,268 Citations1984Leslie G. Valiant
This paper regards learning as the phenomenon of knowledge acquisition in the absence of explicit programming, and gives a precise methodology for studying this phenomenon from a computational viewpoint.
Artificial IntelligenceA qualitative physics based on confluences
1,499 Citations1984Johan de Kleer, John Seely Brown
A fairly encompassing account of qualitative physics, which introduces causality as an ontological commitment for explaining how devices behave, and presents algorithms for determining the behavior of a composite device from the generic behavior of its components.
Psychological BulletinOn looking into the black box: Prospects and limits in the search for mental models.
1,193 Citations1986William B. Rouse, Nancy M. Morris
Information and ControlComplexity of automaton identification from given data
770 Citations1978Eric Gold
The question of whether there is an automaton with n states which agrees with a finite set D of data is shown to be NP-complete, although identification-in-the-limit of finite automata is possible in polynomial time as a function of the size of D.
AutomaticaThe application of fuzzy control systems to industrial processes
767 Citations1977Paul J. King, E.H. Mamdani
The fuzzy control algorithm is used to implement linguistically expressed heuristic control policies directly, with a view to automating those complex and poorly-defined processes where modelling difficulties and lack of suitable measurements make manual control imperative.
Cognitive PsychologyThe functional equivalence of problem solving skills
742 Citations1975Herbert A. Simon
The tower of Hanoi problem is used to show that, even in simple problem environments, numerous distinct solution strategies are available, and different subjects may learn different strategies, and the analysis underscores the importance of subject-by-subject analysis of “what is learned” in understanding human behavior in problem-solving situations.
Journal of the ACMInference of Reversible Languages
530 Citations1982Dana Angluin
An efficient algonthrn is presented for mfernng reversible languages from posmve and negative examples, and it is shown that it leads to correct identification m the hmlt of the class of reversible languages.
BMC NursingThe Need for Biases in Learning Generalizations
527 Citations2007Tom M. Mitchell
The current study showed that the Digital Education Package (DEP) is an effective method for reducing children’s anxiety during hospitalization and recommended it as a preferred and simple method rather than routine education for pediatric nurses.
IEEE Transactions on ComputersOn the Synthesis of Finite-State Machines from Samples of Their Behavior
496 Citations1972Alan W. Biermann, Jerome A. Feldman
The Nerode realization technique for synthesizing finite-state machines from their associated right-invariant equivalence relations is modified to give a method for synthesizer machines from finite subsets of their input-output behavior.
IEEE Transactions on Pattern Analysis and Machine IntelligencePattern Recognition as Rule-Guided Inductive Inference
405 Citations1980Ryszard S. Michalski
The paper formulates the theoretical framework and a method for inferring general and optimal descriptions of object classes from examples of classification or partial descriptions and an experimental computer implementation of the method is briefly described and illustrated by an example.
IFAC Proceedings VolumesIdentifiability of Model Parameter
170 Citations1985K.R. Godfrey, Joseph J. DiStefano
International Journal of ControlDistributed parameter system indentification A survey†
146 Citations1977Carlos S. Kubrusly
This report presents a survey of methods for the Distributed Parameter System Identification Problem, grouping the various identification methods into three disjoint classes, namely ‘ Direct Method ’, ‘ Reduction to a Lumped Parameter system ’ and ‘ reduction to an Algebraic Equation ’.
International Journal of Human-Computer StudiesVerbal reports as evidence of the process operator's knowledge
136 Citations1999Lisanne Bainbridge
Several methods of obtaining verbal reports are surveyed: system state/action state diagram, questionnaire, interview, static simulation and verbal protocol, and the results are not clear.
International Journal of Man-Machine StudiesVerbal reports as evidence of the process operator's knowledge
109 Citations1979Lisanne Bainbridge
International Journal of General SystemsON THE CONNECTION BETWEEN THE COMPLEXITY AND CREDIBILITY OF INFERRED MODELS
97 Citations1978Judea Pearl
This paper derives formal relationships between n, c and the probability of ambiguous predictions by examining three modeling languages under binary classification tasks: perceptrons, Boolean formulae, and Boolean networks.
IEEE Transactions on Systems Man and CyberneticsThe effects of type of knowledge upon human problem solving in a process control task
89 Citations1985Nancy M. Morris, William B. Rouse
The question of what the operator of a dynamic system needs to know was investigated in an experiment using PLANT, a simulation of a generic dynamic production process, and instructions had no effect on achievement of the primary goal of production or on subjects' ability to diagnose unfamiliar failures.
IEEE Transactions on Systems Man and CyberneticsA Model of the Human Observer in Failure Detection Tasks
70 Citations1976E. Gai, Renwick E. Curry
A model for the human observer in failure detection tasks is proposed which consists of a linear estimator and a decision mechanism which leads to a decision function which is the integration of the filter residuals.
Cognitive Architectures and Rational Analysis: Comment
63 Citations1989Herbert A. Simon
In my view, Anderson assigns too little weight to architecture (and by implication to strategies) as determinants of adaptive behavior.
Elsevier eBooksIDENTIFIABILITY OF MODEL PARAMETERS
63 Citations1987K.R. Godfrey, Joseph J. DiStefano
The problem is whether the parameters of a model can be identified from a specified input-output experiment, and if perfect data are assumed, and the models are linear and time-invariant, there are several approaches for identifiability analysis.
Psychology Press eBooksThe Place of Cognitive Architectures in a Rational Analysis
57 Citations2014John R. Anderson
It is argued that human cognition can be predicted from the assumption that it is optimized to the information-processing demands that are placed on it and implications of this rationality principle for cognitive architectures are discussed.
National Conference on Artificial IntelligenceA declarative approach to bias in concept learning
51 Citations1987Stuart Russell, Benjamin N. Grosof
A declarative formulation of the biases used in inductive concept learning, particularly the Version-Space approach is given, and one part of the bias can be represented using first-order axioms called determinations, and can be derived from basic background knowledge about chemistry.
IEEE Transactions on Pattern Analysis and Machine IntelligenceLocal Languages, the Succesor Method, and a Step Towards a General Methodology for the Inference of Regular Grammars
38 Citations1987Pedro Antonio García López, Enrique Vidal +1 more
A methodology is proposed for the inference of regular grammars from positive samples of their languages, mainly based on the generative mechanism associated with local languages, which allows us to obtain arbitrary regular languages by applying morphic operators to local languages.
IEEE Transactions on Systems Man and CyberneticsRegular Inference with a Tail-Clustering Method
37 Citations1980Laurent Miclet
A characterization of the solutions to the regular grammatical Infrence problem and an Introduction to a methodology for Infering regular grammars, based on the clutering of the states of a "maximal" solution, are presented.
IEEE Transactions on Systems Man and CyberneticsInference of regular grammars via skeletons
36 Citations1987V. Radhakrishnan, G. S. Nagaraja
A constructive method for the inference of regular grammars from positive sample strings of language using skeletal structure descriptions, is proposed, and polynomial-time algorithms based on the method are presented.
ErgonomicsOperator Performance in the Control of a Laboratory Process Plant
31 Citations1975F.R. Brigham, Lambros Laios
IEEE Transactions on Systems Man and CyberneticsPLANT: An experimental task for the study of human problem solving in process control
28 Citations1985Nancy M. Morris, William B. Rouse +1 more
Production levels and network troubleshooting (PLANT) is a computer-based process-control task which may be used to provide opportunities for subjects to control a dynamic system and diagnose, repair, and compensate for system failures.
IEEE Transactions on Systems Man and CyberneticsA Theory of Human Decisionmaking in Stochastic Estimation Tasks
20 Citations1977William B. Rouse
Concepts from stochastic estimation theory are used to develop a theory of human decisionmaking that employs optimal Stochastic estimators with a short-term memory model, at least one long-term model, and a method of trading off estimates derived from each model.
ErgonomicsDifferent Levels of Analysing Process Control Tasks
19 Citations1979Xavier Cuny
The investigation of one industrial situation, the production of insulation panels of expanded polystyrene, is used here as a support for a general procedural presentation aiming at in-depth analysis of the task of operators assigned to process control work.
Proceedings of the Human Factors Society Annual MeetingConflict Resolution Maneuvers during near Miss Encounters with Cockpit Traffic Displays
16 Citations1983Everett Palmer
IEEE Transactions on Systems Man and CyberneticsDevelopment and Optimization of a Nonlinear Multiparameter Human Operator Model
15 Citations1972Gunnar Johannsen
A nonlinear multiparameter human operator model is presented which considers the complex input information rate in a single display and shows a marked superiority of the nonlinear model.
ErgonomicsThe Control Performance of Operators Controlling a Continuous Distillation Process†
15 Citations1978P.H. Paternotte
Mathematical BiosciencesParameter identification of distributed parameter systems
14 Citations1985Curtis C. Travis, Luther W. White
Elsevier eBooksOn the Tractability of Learning from Incomplete Theories
10 Citations1988Sridhar Mahadevan, Prasad Tadepalli
An in-depth analysis of the tractability of learning functions from determinations, a particular form of incomplete domain theory, and introduces the notion of “exceptions,” which is used to identify sufficient conditions for the learnability of function families consistent with partial and extended determinations.
Mathematical BiosciencesNear-identifiability of dynamical systems
9 Citations1985Fred Y. Hadaegh, George A. Bekey
The near-equivalence between model and process is defined, using allowable bounds on modeling error and output error, and the near-identifiability of the system identification is defined in terms of the modeling error.
Research Showcase @ Carnegie Mellon University (Carnegie Mellon University)Learning functions from examples
9 Citations2018B. K. Natarajan
A theorem is proved identifying the most general conditions under which a family of functions can be efficiently learned from examples, and strong evidence against the existence of efficient algorithms for learning the regular functions and the polynomial time computable functions is presented.
ErgonomicsA study of control skills in an industrial task, and in a simulation, using the verbal protocol technique
7 Citations1981I.G. Umbers
Analysis of the prediction, decision and action selection routines employed by the controllers indicated that in certain circum stances control performance could be sub-optimal.
IEEE Transactions on Systems Man and CyberneticsSignificance Testing of Rules in Rule-Based Models of Human Problem Solving
7 Citations1986C. Michael Lewis, John M. Hammer
Three methods of testing rules for analysis of variance, randomization, and contingency tables are presented and advantages and disadvantages are described.
Identification of Finite State Models of Human Operators.
6 Citations1979Richard A. Miller
An abstract system theoretic structure suitable for representing discrete control systems is developed and the structure is used to organize the analysis of data obtained from a man-in-the-loop simulation of an AAA system.
IFAC Proceedings VolumesBiomedical Identification: Overview, Problems and Prospects
5 Citations1985P. Eykhoff
This paper summarizes a number of pertinent general considerations on the continuing development of (potential) successful applications of bio-medical systems, with an emphasis on the more recent contributions.
Proceedings of the Human Factors Society Annual MeetingRule-Based Analysis of Pilot Decisions
3 Citations1985C. Michael Lewis
IFAC Proceedings VolumesIssues in The Identification of Models of Human Behavior
2 Citations1982William B. Rouse, Ruston M. Hunt
Issues considered include the models' relative abilities to describe time-varying behavior, possible levels of description, uses of contextual cues, and identifiability.
NASA Technical Reports Server (NASA)A discrete control model of PLANT
2 Citations1985Christine Mitchell
A model of the PLANT system using the discrete control modeling techniques developed by Miller is described, which accounts for how specific control actions are selected from information about the controlled system, the environment, and the context of the situation.