Measuring the effects of business intelligence systems: The relationship between business process and organizational performance

A new measure is developed based on an understanding of the characteristics of BI systems in a process-oriented framework that is employed in an examination of the relationship between the business process performance and organizational performance, finding significant differences in the strength of the relationships between industry sectors.

Abstract

Business intelligence (BI) systems provide the ability to analyse business information in order to support and improve management decision making across a broad range of business activities. They leverage the large data infrastructure investments (e.g. ERP systems) made by firms, and have the potential to realise the substantial value locked up in a firm's data resources. While substantial business investment in BI systems is continuing to accelerate, there is a complete absence of a specific and rigorous method to measure the realised business value, if any. By exploiting the lessons learned from prior attempts to measure business value of IT-intensive systems, we develop a new measure that is based on an understanding of the characteristics of BI systems in a process-oriented framework. We then employ the measure in an examination of the relationship between the business process performance and organizational performance, finding significant differences in the strength of the relationship between industry sectors. This study reinforces the need to consider the specific context of use when designing performance measurement for IT-intensive systems, and highlights the need for further research examining contextual moderators to the realisation of such performance benefits.