Evaluating Federal R&D in the United States

This chapter describes the practice of federal research impact evaluation, and peer review in its broadest sense is the most widely used method in research selection, review, and ex-post assessment.

Abstract

This chapter describes the practice of federal research impact evaluation. Evaluation of research impact is described for three cases: Research selection, where the work has not yet been performed; Research review, where work and results are ongoing; and ex-post research assessment, where research has been completed and results can be tracked. Qualitative methods (such as peer review), semi-quantitative methods (such as historiographic tracings of accomplishments and critical scientific events), and quantitative methods (such as cost-benefit analysis and bibliometrics) are described. While peer review in its broadest sense is the most widely used method in research selection, review, and ex-post assessment, it has its deficiencies, and there is no single method which provides a complete impact evaluation.