Policy analytics: an agenda for research and practice
EURO Journal on Decision ProcessesPublished 30 April 2013
Alexis Tsoukiàs, Gilberto Montibeller, Giulia Lucertini, Valerie Belton
Citations110
SJR quartileQ2
SJR score0.59
SNIP0.88
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
A framework for the use of analytics in supporting the policy cycle—and conceptualise it as “Policy Analytics” is suggested.
Abstract
International audience
Keywords
Computer ScienceDecision SciencesBusiness, Management and Accounting
European Journal of Operational ResearchMeasuring the efficiency of decision making units
28,688 Citations1978A. Charnes, W. W. Cooper +1 more
A nonlinear (nonconvex) programming model provides a new definition of efficiency for use in evaluating activities of not-for-profit entities participating in public programs and methods for objectively determining weights by reference to the observational data for the multiple outputs and multiple inputs that characterize such programs.
The Quarterly Journal of EconomicsA BEHAVIORAL MODEL OF RATIONAL CHOICE
15,263 Citations1955Herbert A. Simon
Socio-Economic Planning SciencesEvaluation of research in efficiency and productivity: A survey and analysis of the first 30 years of scholarly literature in DEA
992 Citations2008Ali Emrouznejad, Barnett R. Parker +1 more
An extensive, if not nearly complete, listing of DEA research covering theoretical developments as well as "real-world" applications from inception to the year 2007 is presented.
OmegaMultimethodology: Towards a framework for mixing methodologies
672 Citations1997John Mingers, John Brocklesby
A framework that can attend to the relative strengths of different methodologies and provide a basis for constructing multimethodology designs is described, and a systematic way of decomposing methodologies to identify detachable elements is presented.
Research in Engineering DesignC-K design theory: an advanced formulation
640 Citations2008Armand Hatchuel, Benoît Weil
This work shows that C-K theory captures the generation of new objects and new knowledge and offers a rigorous definition of Design, and interprets Braha and Reich’s topological structures for design modelling as special assumptions about the stability of objects in space K.
European Journal of Operational ResearchDecision science or decision-aid science?
471 Citations1993Bernard Roy
A ‘decision science’ can only be rooted in the path of realism, which implies accepting postulates and hypotheses which have proved unusable in the practice of OR-DA, and how by shifting the object of the quest for knowledge it nonetheless appears possible to speak in terms of a decision-aid science.
European Journal of Operational ResearchFacilitated modelling in operational research
369 Citations2009L. Alberto Franco, Gilberto Montibeller
Drawing on research scattered across a range of publications and domains, the review presented here provides a formal definition of facilitated modelling, together with a general framework that allows the conceptualisation of a wide variety of facilitated modeling approaches to organisational intervention.
Management ScienceCreating Policy Alternatives Using Stakeholder Values
365 Citations1994Robin Gregory, Ralph L. Keeney
European Journal of Operational ResearchPolicies, decisions and information sources for modeling
353 Citations1992Jay W. Forrester
This work states that rich stores of information about governing policies and economic structure are available from mental data bases built up from experience and observation, and all kinds of information should be used, not merely numerical data.
Artificial IntelligenceA general account of argumentation with preferences
352 Citations2012Sanjay Modgil, Henry Prakken
It is shown that under some assumptions, the resulting framework satisfies key properties and rationality postulates, and it is argued that ASPIC^+@?s modelling of defeasible inference rules further testifies to the generality of the framework.
Critical Perspectives on AccountingPublic sector governance and accountability
337 Citations2012Roland Almquist, Giuseppe Grossi +2 more
European Journal of Operational ResearchDecision Support Systems in action: Integrated application in a multicriteria decision aid process
322 Citations1999Carlos A. Bana e Costa, Leonardo Ensslin +2 more
A real application of Multi-Criteria Decision Analysis (MCDA) in which several Decision Support Systems were harmoniously integrated in the interactive learning process of tackling the complex strategic problematic situation faced by the Santa Catarina textile industry, in the south of Brazil is described.
European Journal of Operational ResearchPreference programming for robust portfolio modeling and project selection
257 Citations2006Juuso Liesiö, Pekka Mild +1 more
The Robust Portfolio Modeling methodology is developed, which extends Preference Programming methods into portfolio problems where a subset of project proposals are funded in view of multiple evaluation criteria, and a project-level index is proposed to convey which projects are robust choices and how continued activities in preference elicitation should be focused.
International series in management science/operations research/International series in operations research & management scienceEvaluation and Decision Models
225 Citations2000Denis Bouyssou, Thierry Marchant +4 more
European Journal of Operational ResearchFrom decision theory to decision aiding methodology
207 Citations2007Alexis Tsoukiàs
The author’s partial and personal historical reconstruction of how decision theory is evolving to a decision aiding methodology is presented, showing mainly how “alternative” approaches to classic decision theory evolved.
Harvard University Press eBooksNew Foundations of Cost-Benefit Analysis
200 Citations2006Matthew D. Adler, Eric A. Posner
Risk AnalysisA Multiattribute Utility Analysis of Alternative Sites for the Disposal of Nuclear Waste
191 Citations1987Miley W. Merkhofer, Ralph L. Keeney
Five potential sites nominated for the Nation's first geologic repository for disposing of nuclear waste are evaluated using multiattribute utility analysis, producing insights into the relative advantages and disadvantages of the nominated sites.
European Journal of Operational ResearchSystem dynamics and microworlds for policymakers
189 Citations1988John Morecroft
Four major developments in the subject that have brought about change in system dynamics are reviewed, allowing modelers to create computer-based learning environments for policymakers to ‘play-with’ their knowledge of business and social systems and to debate policy and strategy change.
Risk AnalysisA Risk and Economic Analysis of Dirty Bomb Attacks on the Ports of Los Angeles and Long Beach
177 Citations2007Heather Rosoff, Detlof von Winterfeldt +1 more
Analysis of possible terrorist attacks on the ports of Los Angeles and Long Beach using a radiological dispersal device (RDD) to shut down port operations and cause substantial economic and psychological impacts suggests that the chances of a successful dirty bomb attack are about 10-40% and high radiological doses are confined to a relatively small area.
OmegaIntegrating multicriteria decision analysis and scenario planning—Review and extension
177 Citations2012Theodor J. Stewart, Simon French +1 more
This paper develops a framework for integrating MCDA and scenario thinking, based on applying MCDA concepts across a range of “metacriteria” (combinations of scenarios and primary criteria).
Environmental Science & PolicyEvidence, politics and power in public policy for the environment
176 Citations2009Meri Juntti, Duncan Russel +1 more
Journal of the Operational Research SocietyCausal maps and the evaluation of decision options—a review
175 Citations2006Gilberto Montibeller, Valerie Belton
The main aim of this paper is to review systematically the approaches for evaluating options following from the use of a causal map for problem structuring; some directly using the map structure, others working with concepts extracted from, or an external model derived from, the map.
Journal of Multi-Criteria Decision AnalysisIntegrated Support from Problem Structuring through to Alternative Evaluation Using COPE and V·I·S·A
173 Citations1997Valerie Belton, Fran Ackermann +1 more
This paper describes a study which sought to integrate one of these approaches, SODA (strategic options development and analysis), using the COPE software for cognitive mapping, with multiple criteria evaluation based on a multi-attribute value function using V·I·S·A.
Journal of Multi-Criteria Decision AnalysisCombining scenario planning and multi‐criteria decision analysis in practice
168 Citations2006Gilberto Montibeller, Haidee Gummer +1 more
Two case-studies are described where the use of scenario planning with multi-attribute value theory with Multi-Criteria Decision Analysis was used to support real-world strategic decisions.
Organization ScienceThe Formulation Processes and Tactics Used in Organizational Decision Making
156 Citations1993Paul C. Nutt
INFORMS Journal on Applied AnalyticsThe Analytics Movement: Implications for Operations Research
155 Citations2010Matthew J. Liberatore, Wenhong Luo
The drivers of the analytics movement, an example of an analytics project, and the opportunities and implications for operations research are discussed, i.e., the problem scope, models and methods, implementation issues, organizational role, professional skills, and education.
European Journal of Operational ResearchAssessing police forces in England and Wales using data envelopment analysis
154 Citations1995Emmanuel Thanassoulis
Annals of Operations ResearchOn the concept of decision aiding process: an operational perspective
139 Citations2007Alexis Tsoukiàs
The aim of the paper is to analyse the type of activities occurring between a “client” and an “analyst” both engaged in a decision process to present the decision aiding process as an extension of the decision process.
European Journal of Operational ResearchMixing OR methods in practice: Past, present and future directions
139 Citations2011Susan Howick, Fran Ackermann
The aim of this paper is to carry out generic lessons that may be associated with mixing methods, regardless of the methods chosen, through considering case studies on how OR methods have been mixed.
Journal of the Operational Research SocietyReasoning maps for decision aid: an integrated approach for problem-structuring and multi-criteria evaluation
135 Citations2007Gilberto Montibeller, Valerie Belton +2 more
A tool for multi-criteria decision aid to be referred to as a Reasoning Map is proposed, motivated by a desire to provide an integrated approach to problem structuring and evaluation, and in particular, to make the transition between these two processes a natural and seamless progression.
IEEE Transactions on Systems Man and CyberneticsDecision problem structuring: generating options
127 Citations1988L. Robin Keller, Joanna L.Y. Ho
An integrative framework of methods for generating options for subsequent evaluation in a formal decision analysis is proposed and an associative network model of the way knowledge is represented cognitively is presented.
Technology Analysis and Strategic ManagementRationales for Government Intervention in the Commercialization of New Technologies
118 Citations2002Jukka-Pekka Salmenkaita, Ahti Salo
Examining rationales relevant to the evolving roles of government intervention and private venture capital industry in the commercialization of new technologies finds that government interventions may aim to mitigate market and systemic failures, eliminate structural rigidities, or respond to anticipatory myopia.
Journal of Multi-Criteria Decision AnalysisRobust solutions and methods in decision-aid
111 Citations1999Philippe Vincke
A theoretical framework allowing to deal with decision-aid questions about the validity of the proposed solutions for different sets of acceptable values for the model and the method is introduced.
International series in management science/operations research/International series in operations research & management scienceProblem Structuring and Multiple Criteria Decision Analysis
109 Citations2010Valerie Belton, Theodor J. Stewart
This chapter addresses two complementary themes in relation to problem structuring and MCDA, with a brief discussion of the complementary theme that MCDA can also be viewed as creating a problem structure within which many other standard tools of OR may be applied, and could therefore also be view as a PSM.
Decision AnalysisValue-Focused Brainstorming
93 Citations2012Ralph L. Keeney
Value-focused brainstorming incorporates two features of value-focused thinking into the traditional brainstorming procedures, and explicitly identifies the valued aspects of potential alternatives to guide brainstormers to create alternatives of greater value.
Wiley Encyclopedia of Operations Research and Management ScienceProblem Structuring for Multicriteria Decision Analysis Interventions
88 Citations2010Luis A. Franco, Gilberto Montibeller
Operations ResearchOperations Research Trajectories: The Anglo-American Experience from the 1940s to the 1990s
85 Citations2000M. W. Kirby
The paper advocates the need for ongoing research into the history of OR as an essential complement to the advancing frontier of knowledge, both in theory and in practice.
Decision AnalysisDevelopment of Reusable Bid Evaluation Models for the Portuguese Electric Transmission Company
82 Citations2008Carlos A. Bana e Costa, João Carlos Lourenço +2 more
The decision analysis models currently in use at the Portuguese Electric Transmission Company (REN) to evaluate bids were developed through a decision-conferencing process supported by the MACBETH multicriteria approach and software.
Journal of Multi-Criteria Decision AnalysisDynamic decision problem structuring
81 Citations2001James L. Corner, John Buchanan +1 more
This approach endeavours to bridge the gap between prescriptive and descriptive decision problem structuring, and synthesizes a number of models and approaches cited in the decision-making literature in general and the multi-criteria literature in particular.
Journal of Risk ResearchScenario‐based multiple criteria analysis for infrastructure policy impacts and planning
70 Citations2010Matthew Schroeder, James H. Lambert
A practical methodology of scenario‐based planning within a multi‐criteria decision aid to support the comparison of transportation policies across state, regional, and local agencies is developed.
European Journal of Operational ResearchStructuring resource allocation decisions: A framework for building multi-criteria portfolio models with area-grouped options
68 Citations2009Gilberto Montibeller, L. Alberto Franco +2 more
Different ways to structuring portfolio models where projects are divided into areas and evaluated by multiple criteria are suggested, and their use in two action-research projects are illustrated.
Journal of the Operational Research SocietyInto the Swamp: The Analysis of Social Issues
64 Citations1992Jonathan Rosenhead
Journal of the Operational Research SocietyRaising the bar: strategic multi-criteria decision analysis
63 Citations2010Gilberto Montibeller, L. Alberto Franco
It is suggested that structuring strategic objectives, dealing with high levels of uncertainty about the future, as well as considering the interconnectedness of strategic options and their long-term consequences are key aspects of strategic decision making support.
Risk AnalysisNuclear Risk Management on Stage: A Decision Analysis Perspective on the UK's Committee on Radioactive Waste Management
62 Citations2009Alec Morton, Mara Airoldi +1 more
The explicit and implicit principles that guided CoRWM are described, and some of the key developments in the UK's radioactive waste management process, which followed on from the publication of CoR WM's report are outlined.
Journal of Interdisciplinary EconomicsThe Evaluation of Public Policy: Normative Economic Theories of Government Failure
62 Citations1996Brian Dollery, Andrew C. Worthington
Journal of the Operational Research SocietyOn Linking Approaches to Decision-Aiding: Issues and Prospects
61 Citations1985Peter Bennett
Though it concentrates on work involving certain specific approaches, the issues raised are relevant to the linkage and/or classification of other decision-aiding methods.
Technological Forecasting and Social ChangeExploring the impact of evaluating strategic options in a scenario-based multi-criteria framework
60 Citations2012Camelia Ram, Gilberto Montibeller
RAIRO - Operations ResearchReformulations in Mathematical Programming: Definitions and Systematics
58 Citations2009Leo Liberti
A framework for storing and manipulating mathematical pro- gramming formulations in essentially four types (opt-reformulations, narrow- ings, relaxations and approximations) is defined and some theoretical results and reformulation examples for each type are established.
Preventive Veterinary MedicineAn integrated process and management tools for ranking multiple emerging threats to animal health
57 Citations2012Victor Del Rio Vilas, Fay Voller +6 more
The systematic characterisation of the processes leading to the assessment of T&V by the VRG has led to a consistent, auditable and transparent approach to the identification and assessment of emerging risks.
California Management ReviewManagement Half-Truths and Nonsense: How to Practice Evidence-Based Management
57 Citations2006Jeffrey Pfeffer, Robert I. Sutton
Ecological ModellingUsing environmental indicators to quantify the robustness of policy alternatives to uncertainty
56 Citations2000Jason Levy, Keith W. Hipel +1 more
Sustainable development indicators are used to improve multiple-objective environmental decision making under conditions of unknown variability and the robustness to uncertainty of competing policy alternatives is assessed using multi-attribute value theory and the recently developed information gap methodology.
Journal of the Operational Research SocietyProblem structuring methods: new directions in a problematic world
55 Citations2006Duncan Shaw, L. Alberto Franco +1 more
This special issue aims to take stock of the field and provide focus for the continued research and development of PSMs, and develops a taxonomy by which the authors assess the advantages and disadvantages of an array of approaches that might be adopted to more systematically interrogate the decision options available in the map.
Lecture notes in computer scienceInteractive Multiobjective Optimization from a Learning Perspective
52 Citations2008Valerie Belton, Jürgen Branke +5 more
Two complementary aspects of learning: individual learning and model or machine learning are considered, i.e., what the decision maker can learn, and what the formal model can learn in the course of an IMO procedure.
European Journal of Operational ResearchAn explicative model of ‘public’ interorganizational interactions
51 Citations1993Anna Ostanello, Alexis Tsoukiàs
This paper investigates the possible effects of an existing meta-object for actors of different organizations and proposes a model of IS which permits the outlining of an integrated representation of a variety of simultaneous processes.
Regulation & GovernanceThe triumph of regulatory politics: Benefit–cost analysis and political salience
47 Citations2012Stuart Shapiro, J Morrall
Journal of Evaluation in Clinical PracticeDecision analysis in evidence‐based decision making
45 Citations2000Manouche Tavakoli, Huw Davies +1 more
It is argued that decision analysis could, to some extent, overcome complexity of decision making by a clear structuring of the problem and a formal analysis of the implications of different decisions.
European Journal of Operational ResearchA taxing problem: The complementary use of hard and soft OR in the public sector
44 Citations2005Joyce Brown, Ceri Cooper +1 more
A review of the UK personal taxation system used a combination of hard and soft OR approaches in a complementary way, revealing that soft OR is much more than common sense and, that, used in parallel, soft and hard approaches have a powerful synergy.
OmegaVoices and values: Linking values with participation in OR/MS in public policy making
41 Citations2006Leroy White, Humphrey Bourne
Journal of the Operational Research SocietyA rigorous definition of Robustness Analysis
31 Citations2000H-Y Wong, Jonathan Rosenhead
A revised definition of RA is presented which is based on earlier presentations of RA as well as new results derived from empirical research and constructs new definitions of robustness score.
Lecture notes in computer sciencePARMENIDES: Facilitating Democratic Debate
25 Citations2004Katie Atkinson, Trevor Bench‐Capon +1 more
This paper describes PARMENIDES, a system which facilitates structured debate about government policy and provides a framework for future generation of policy-makers to adopt and implement sustainable development policies.
European Journal of Operational ResearchPreference modeling as a reasoning process: A new way to face uncertainty in multiple criteria decision support systems
25 Citations1991Alexis Tsoukiàs
An attempt is made, through the use of Artificial Intelligence techniques, towards a declarative representation of decision aid activities and principally towards a new way to face problems of uncertainty in preference modeling.
Decision Support SystemsSupporting factoring transactions in Brazil using reasoning maps: a language-based DSS for evaluating accounts receivable
23 Citations2005Gilberto Montibeller, Valerie Belton +1 more
A case study is described in which a language-based DSS was developed for a Brazilian factoring company to evaluate the perceived risk of buying accounts receivable and discusses the suitability of different approaches to decision support for this type of decision in Brazil-which may be relevant for similar situations in other developing countries.
AI & SocietyComputer decision-support systems for public argumentation: assessing deliberative legitimacy
21 Citations2004William Rehg, Peter McBurney +1 more
Drawing on deliberative democratic theory, normative criteria for deliberative legitimacy are elaborate and used for assessing two argumentation systems.
Lecture notes in computer scienceThe Reformulation-Optimization Software Engine
17 Citations2010Leo Liberti, Sonia Cafieri +1 more
A Reformulation-Optimization Software Engine (ROSE) is described for performing (automatic) symbolic computation on mathematical programming formulations to solve difficult optimization problems.
British Journal of Healthcare ManagementRapid access to information: the key to cutting costs in the NHS
2 Citations2010Paul Fitzsimmons
Today's mass of siloed information may enable reporting on prescriptive targets, but it provides limited insight into performance variations or the cost of service delivery.