Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
Advances in psychologyPublished 1 January 1988
Sandra G. Hart, Lowell E. Staveland
Citations14,345
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
Abstract
The results of a multi-year research program to identify the factors associated with variations in subjective workload within and between different types of tasks are reviewed. Subjective evaluations of 10 workload-related factors were obtained from 16 different experiments. The experimental tasks included simple cognitive and manual control tasks, complex laboratory and supervisory control tasks, and aircraft simulation. Task-, behavior-, and subject-related correlates of subjective workload experiences varied as a function of difficulty manipulations within experiments, different sources of workload between experiments, and individual differences in workload definition. A multi-dimensional rating scale is proposed in which information about the magnitude and sources of six workload-related factors are combined to derive a sensitive and reliable estimate of workload.
Keywords
PsychologyEngineering
Revue économiqueNonparametric Statistics for the Behavioral Sciences
35,492 Citations1958Henri Guitton, Sidney Siegel
ScienceJudgment under Uncertainty: Heuristics and Biases
28,003 Citations1974Amos Tversky, Daniel Kahneman
Three heuristics that are employed in making judgements under uncertainty are described: representativeness, availability of instances or scenarios, which is often employed when people are asked to assess the frequency of a class or the plausibility of a particular development.
Judgment under Uncertainty: Heuristics and Biases
23,088 Citations1975Amos Tversky, Daniel Kahneman
Psychological ReviewTelling more than we can know: Verbal reports on mental processes.
11,285 Citations1977Richard E. Nisbett, Timothy D. Wilson
Journal of the Franklin InstituteNonparametric statistics for the behavioral sciences
7,279 Citations1957Laurence C. McGinn
Acta PsychologicaThe discovery of processing stages: Extensions of Donders' method
3,144 Citations1969Saul Sternberg
It is demonstrated that stage-durations may be additive without being stochastically independent, a result that is relevant to the formulation of mathematical models of RT.
Munich Personal RePEc Archive (Ludwig Maximilian University of Munich)The use of pilot rating in the evaluation of aircraft handling qualities
861 Citations1969George E. Cooper, Robert P. Harper
Human Factors The Journal of the Human Factors and Ergonomics SocietyOn the Psychophysics of Workload: Why Bother with Subjective Measures?
281 Citations1984Daniel Gopher, Rolf Braune
PsycEXTRA DatasetProceedings of the 10th Annual Conference on Manual Control
108 Citations1974
The volume presents recent developments in the field of manual control theory and applications, and includes procedures to evaluate and identify display systems, controllers, manipulators, human operators, aircraft, and non-flying vehicles.
Acta PsychologicaAdaptive and part-whole training in the acquisition of a complex perceptual-motor skill
97 Citations1989Amir Mané, Jack A. Adams +1 more
Final Report of Experimental Psychology Group
62 Citations1979G. Johanssen, Neville Moray +4 more
DSpace@MIT (Massachusetts Institute of Technology)Toward the definition and measurement of the mental workload of transport pilots
50 Citations1979Thomas B. Sheridan, Robert W. Simpson
Work performed in the first year of a continuing research project aimed at developing useful methods for measuring the workload of pilots operating aircraft in the ATC system resulted in the generation of a prototype subjective rating method for IFR pilot workload modeled closely on the Cooper-Harper rating developed in 1969.
Proceedings of the Human Factors Society Annual MeetingAssessing Subjective Workload Assessment: A Comparison of SWAT and the NASA-Bipolar Methods
39 Citations1985Michael A. Vidulich, Pamela S. Tsang
Applied ErgonomicsMeasuring pilot workload in a motion base trainer
35 Citations1986Michael R. Bortolussi, Barry H. Kantowitz +1 more
Four widely used methods to predict and measure pilot workload were compared: a visual two-and four-choice reaction time task, time production, retrospective multi-dimensional subjective ratings and in-flight verbal workload estimates.
Proceedings of the Human Factors Society Annual MeetingComparison of Workload Measures on Computer—Generated Primary Flight Displays
27 Citations1987Mark Nataupsky, Terence S. Abbott
Proceedings of the Human Factors Society Annual MeetingSubjective Workload Assessment in a Memory Update Task
24 Citations1982F. Thomas Eggemeier, Mark S. Crabtree +3 more
The SWAT ratings proved more sensitive than memory error to task difficulty variations in all but one of the most difficult memory conditions, supporting the applicability of SWAT as a sensitive workload index.
NASA Technical Reports Server (NASA)POPCORN: a Supervisory Control Simulation for Workload and Performance Research
20 Citations1984Sandra G. Hart, Vernol Battiste +1 more
A multi-task simulation of a semi-automatic supervisory control system was developed to provide an environment in which training, operator strategy development, failure detection and resolution, levels of automation, and operator workload can be investigated.
NASA Technical Reports Server (NASA)Inflight evaluation of pilot workload measures for rotorcraft research
19 Citations1987Robert J. Shively, Michael R. Bortolussi +4 more
The effectiveness of heart-rate monitoring and the NASA TLX workload rating scale (Hart et al., 1985) in measuring helicopter-pilot workloads is investigated experimentally, and it is found that the TLX ratings clearly distinguish the flight segments and are well correlated with the performance data.
PsycEXTRA DatasetAssessing the subjective workload of directional orientation tasks
12 Citations1984Ronald C. Miller, Sandra G. Hart
NASA Technical Reports Server (NASA)Mental workload measurement: Event-related potentials and ratings of workload and fatigue
12 Citations1985Michael A. Biferno
Proceedings of the Human Factors Society Annual MeetingThe Effect of Varying Task Difficulty on Subjective Workload
11 Citations1985Yei-Yu Yen, Christopher D. Wickens +1 more
Proceedings of the Human Factors Society Annual MeetingThe Effect of Processing Code, Response Modality and Task Difficulty on Dual Task Performance and Subjective Workload in a Manual System
10 Citations1987Yili Liu, Christopher D. Wickens
The results provide strong evidence that tasks and processes competing for common processing resources are time shared less effectively and have higher workload than tasks competing for separate resources.
Proceedings of the Human Factors Society Annual MeetingCurrent Issues in Subjective Assessment of Workload
10 Citations1981F. Thomas Eggemeier
Proceedings of the Human Factors Society Annual MeetingThe Reliability and Validity of Flight Task Workload Ratings
9 Citations1982Mary E. Childress, Sandra G. Hart +1 more
Proceedings of the Human Factors Society Annual MeetingThe Psychophysics of Workload — A Second Look at the Relationship between Subjective Measures and Performance
9 Citations1985Daniel Gopher, Nella Chillag +1 more
Proceedings of the Human Factors Society Annual MeetingModel-Based Estimation and Prediction of Task-Imposed Mental Workload
8 Citations1983Azad M. Madni, John Lyman
A model-based approach for quantifying mental workload in operational terms is presented and insights gained from analyzing task-specific workload within this modelling paradigm can suggest plausible explanations for reconciling discrepancies between subjectively elicited workload estimates and behavioral/performance measures.
Proceedings of the Human Factors Society Annual MeetingStep Tracking Shrinking Targets
8 Citations1987Walter W. Johnson, Sandra G. Hart
A Linguistic Rule-Based Expert System For Mental Workload
6 Citations1985İ.B. Türkşen, Neville Moray +1 more
“Although the conventional mathematical techniques have been and will continue to be applied to the analysis of humanistic systems, it is clear that the great complexity of such systems calls for approaches that are significantly different in spirit as well as in substance from traditional methods.
Proceedings of the Human Factors Society Annual MeetingTime-Sharing Visual and Auditory Tracking Tasks
6 Citations1987Pamela S. Tsang, Michael A. Vidulich
Results show that presenting the two tracking signals in two input modalities did not improve time-sharing efficiency and whether utilizing the same control dynamics between the time-shared tasks could generate an integrality effect was unclear from the present data.
Proceedings of the Human Factors Society Annual MeetingUse of SWAT in Usaf System T & E
5 Citations1984John F. Courtright, Gilad J. Kuperman
NASA Technical Reports Server (NASA)Techniques of subjective workload assessment - A comparison of two methodologies
5 Citations1985Michael A. Vidulich, Pamela S. Tsang
It is concluded that both techniques appear to be worthwhile in terms of the general validity of subjective workload assessments.
NASA Technical Reports Server (NASA)The effects of stimulus modality and task integrality: Predicting dual-task performance and workload from single-task levels
4 Citations1986Sandra G. Hart, Robert J. Shively +2 more
The results suggest the importance of distinguishing between concurrent tasks that complete for limited resources from those that beneficially share common resources when selecting the stimulus modalities for information displays.
Automation - Changes in cognitive demands and mental workload
3 Citations1987Pamela S. Tsang, Walter W. Johnson
The automation is shown to improve objective performance and lower subjective workload significantly in the combined FC/TA task, but not in the FC task alone or in theFC/EF task.
PsycEXTRA DatasetDecision tree rating scales for workload estimation: Theme and variations
3 Citations1984W. W. Wietwille, Julie Hamilton Skipper +1 more
PsycEXTRA DatasetClassification systems for individual differences in multiple-task performance and subjective estimates of workload
3 Citations1984Diane L. Damos
NASA Technical Reports Server (NASA)Predicted versus experienced workload and performance on a supervisory control task
3 Citations1985Vernol Battiste, Sandra G. Hart
The results have indicated that an operator might correctly predict the workload of a realistically complex task if he is familiar with the basic system, and the design, functional requirements, and operational procedures of the proposed modifications are described clearly.
NASA Technical Reports Server (NASA)Measuring Pilot Workload in a Moving-base Simulator. Part 2: Building Levels of Workload
2 Citations1984Barry H. Kantowitz, Sandra G. Hart +3 more
The present research acknowledges that total mental workload depends upon the specific nature of the sub-tasks that a pilot must complete as a first approximation, and flight tasks were divided into three levels of complexity.
An Evaluation of Data Entry Devices
1 Citations1994Jane M. Kline, Martin N. Anesgart +1 more
Overall, the objective and subjective data indicated the most preferred device and best performance was obtained with the alphanumeric keypad, and the ICAO table was second place in performance and preference.
SAE technical papers on CD-ROM/SAE technical paper seriesPilot Workload Prediction
1 Citations1987David D. Pepitone, Robert J. Shively +1 more