Critical issues in evaluating the impact of IT on information activity in academic research: Developing a qualitative research solution

Qualitative issues arising from the evaluation of the impact of IT-assisted information systems are discussed, which required the development of creative research solutions within a framework which includes holistic, inductive research.

Abstract

The advent of the electronic library and associated information technology (IT) assisted communication and organization of information, has implications for information-seeking and research in academia. This article, while indicating emerging findings, primarily discusses methodological issues arising from the evaluation of the impact of IT-assisted information systems. Five key issues are outlined: (1) incomplete knowledge of the operating variables in this new area, (2) the complexity of the information-seeking process, (3) the largely implicit nature of research and information skills, (4) the difficulty of detecting impact of new systems on research activity, and (5) the difficulty of explaining learning and take-up of IT-assisted information systems. These issues have required the development of creative research solutions within a framework which includes the following: holistic, inductive research; a fluid, developing methodology; the use of both idiographic and nomothetic approaches; collection of data on behavior, cognitions, and emotions; techniques to bring implicit knowledge into conscious awareness, such as information access stories and research timelines; and the analysis of both research outcome and process and the investigation of strategies for learning how to use systems.