Methods for Evaluating Process Model Search
Lecture notes in business information processingPublished 1 January 2014
Matthias Kunze, Mathias Weske
Citations2
SJR quartileQ3
SJR score0.26
SNIP0.52
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
This work aims at improving the analysis of future process model search techniques and comparability between them by presenting measures and proposed methods for evaluating the quality and performance of process modelSearch techniques.
Abstract
Process model search has received significant interest in the scientific community, recently, due to its precursory role for process model reuse. An abundance of diverse techniques has been proposed. Yet, few of them have been evaluated thoroughly, and a commonly agreed evaluation method is missing. Based on a literature review, we present measures and propose methods for evaluating the quality and performance of process model search techniques, and discuss their relevance and suitability by a case study. This work aims at improving the analysis of future process model search techniques and comparability between them.
Keywords
Computer ScienceBusiness, Management and AccountingEngineering
Ontology Matching
2,112 Citations2007Jérôme Euzenat, Pavel Shvaiko
Choice Reviews OnlineModern information retrieval: the concepts and technology behind search
791 Citations2011
This paper presents a meta-modelling architecture for search that automates the very labor-intensive and therefore time-heavy and expensive and expensive process of manually cataloging and querying documents.
Information SystemsSimilarity of business process models: Metrics and evaluation
607 Citations2010Remco Dijkman, Marlon Dumas +3 more
Three similarity metrics that can be used to answer queries on process repositories are presented, including node matching similarity that compares the labels and attributes attached to process model elements; structural similarity that connects element labels as well as causal relations captured in the process model.
ACM SIGIR ForumEvaluating Evaluation Measure Stability
567 Citations2017Chris Buckley, Ellen M. Voorhees
A novel way of examining the accuracy of the evaluation measures commonly used in information retrieval experiments is presented, which validates several of the rules-of-thumb experimenters use and challenges other beliefs, such as the common evaluation measures are equally reliable.
Lecture notes in computer scienceThe state explosion problem
452 Citations1998Antti Valmari
The article contains a lengthy discussion on alternative ways of stating analysis and verification questions, and algorithms for answering them, and many advanced state space methods are briefly described.
Business Process Management JournalPotential pitfalls of process modeling: part A
271 Citations2006Michael Rosemann
Typical pitfalls as they can be observed in larger process modeling projects are summarized, and a list of typical characteristics of unsuccessful process modeling is provided.
Proceedings/Proceedings - International Conference on Software EngineeringMatching and Merging of Statecharts Specifications
246 Citations2007Shiva Nejati, Mehrdad Sabetzadeh +3 more
The Match operator is heuristic, making use of both static and behavioural properties of the models to improve the accuracy of matching, and the Merge operator preserves the hierarchical structure of the input models, and handles differences in behaviour through parameterization.
Sap R/3 Business Blueprint: Understanding the Business Process Reference Model
242 Citations1997Thomas A. Curran, Gerhard Keller +1 more
This chapter discusses Business Engineering and Enterprise Optimization in R/3, which involves Modeling and Configuring the Enterprise, and the Architecture of the R/ 3 System, which consists of the Three-Tier Client/Server R/2 Architecture and the Distributed Environment.
Computers in IndustryManaging large collections of business process models—Current techniques and challenges
161 Citations2012Remco Dijkman, Marcello La Rosa +1 more
The goal of this paper is to provide an overview of the management techniques that currently exist, as well as the open research challenges that they pose.
Notes on numerical fluid mechanics and multidisciplinary designThe ICoP Framework: Identification of Correspondences between Process Models
154 Citations2010Matthias Weidlich, Remco Dijkman +1 more
It is shown that the ICoP framework can be used to develop matchers in a flexible and adaptable manner and that the resulting matchers can identify a significant number of complex correspondences.
Computers in IndustryA comparative survey of business process similarity measures
142 Citations2012Michael Becker, Ralf Laue
This article investigated, how different kinds of changes in a model influence the values of different similarity measures that have been published in academic literature and identified eight properties that a similarity measure should have from a theoretical point of view and analysed how these properties are fulfilled by the different measures.
TU/e Research PortalSimilarity search of business process models
139 Citations2009Marlon Dumas, Luciano García‐Bañuelos +1 more
Recent work on an instance of this class of problems, where the objects in question are business process models, is reviewed to identify process models in a repository that most closely resemble a given process model or a fragment thereof.
BPMN-Q: A Language to Query Business Processes
136 Citations2007Ahmed Awad
A new visual query language for business processes is introduced that addresses processes definitions and extends BPMN for its abstract syntax as BPMn is a standard visual notation for modeling business processes.
Lecture notes in computer scienceBehavioral Similarity – A Proper Metric
120 Citations2011Matthias Kunze, Matthias Weidlich +1 more
A proper metric to quantify process similarity based on behavioral profiles is introduced, grounded in the Jaccard coefficient and leverages behavioral relations between pairs of process model activities.
IEEE Transactions on Services ComputingRanking BPEL Processes for Service Discovery
86 Citations2010Daniela Grigori, Juan Carlos Corrales +2 more
This paper developed a BPEL ranking platform that allows to find in a service repository, a set of service candidates satisfying user requirements, and then, to rank these candidates using a behavioral-based similarity measure.
Business Process Management JournalPotential pitfalls of process modeling: part B
77 Citations2006Michael Rosemann
Communications in computer and information scienceInformation Retrieval
72 Citations2016Olessia Koltsova, Koltsov, Sergei +5 more
This course will provide an overview of the theory, implementation, and evaluation of IR systems and IR techniques, and explore how search engines work, how they "interpret" human language, what different users expect from them, how they are evaluated, why they sometimes fail, and how they might be improved in the future.
Lecture notes in business information processingMetric Trees for Efficient Similarity Search in Large Process Model Repositories
62 Citations2011Matthias Kunze, Mathias Weske
This paper focuses on process model repositories, which contain hundreds or thousands of process models, and how to manage and manage these repositories using a single website.
Lecture notes in computer scienceApproximate Clone Detection in Repositories of Business Process Models
55 Citations2012Chathura C. Ekanayake, Marlon Dumas +3 more
Experiments show that the proposed techniques are able to accurately retrieve clusters of approximate clones that originate from copy/pasting followed by independent modifications to the copied fragments.
Distributed and Parallel DatabasesFast business process similarity search
54 Citations2012Zhiqiang Yan, Remco Dijkman +1 more
The algorithm works by efficiently estimating model similarity, based on small characteristic model fragments, called features, which helps to perform similarity search about 10 times faster than the original algorithm.
World Wide WebQuerying business process model repositories
50 Citations2013Jianmin Wang, Tao Jin +2 more
An overview of the field of querying business process models; a summary of its literature; and a list of challenges (and some potential solutions) that have yet to be addressed are provided.
Lecture notes in computer scienceEfficient and Accurate Retrieval of Business Process Models through Indexing
44 Citations2010Tao Jin, Jianmin Wang +3 more
This work investigates the use of indexes to speed up the retrieval of models from large business process model repositories and achieves a significant reduction in query evaluation time.
Lecture notes in computer scienceEfficient Retrieval of Similar Workflow Models Based on Behavior
20 Citations2012Tao Jin, Jianmin Wang +1 more
A more efficient algorithm for similarity calculation and an index named TARIndex for query processing is proposed that considers the semantic similarity between labels to improve the efficiency of similarity retrieval based on behavior.
Lecture notes in computer scienceEfficient Retrieval of Similar Business Process Models Based on Structure
17 Citations2011Tao Jin, Jianmin Wang +1 more
This paper solves the problem of querying similar models efficiently based on structure by using an index named TaskEdgeIndex for query processing and finding the candidate models that actually do not satisfy the similarity requirement.
Lecture notes in computer scienceFNet: An Index for Advanced Business Process Querying
17 Citations2012Zhiqiang Yan, Remco Dijkman +1 more
This paper proposes an efficient technique to quickly retrieve business process models that satisfy a given query, using feature nets, and experiments show that on average the technique performs two orders of magnitude faster than existing techniques.
Lecture notes in business information processingLocal Behavior Similarity
9 Citations2012Matthias Kunze, Mathias Weske
Effective capabilities to manage and, in particular, search are required to leverage stored business process models.
Lecture notes in business information processingSemantics-Based Business Process Model Similarity
9 Citations2012Bernhard G. Humm, Janina Fengel
A novel approach for determining semantic similarity in an automated manner, directed at supporting business analysis through semantic reasoning, is presented.
Lecture notes in computer scienceEvaluation Measures for Similarity Search Results in Process Model Repositories
7 Citations2012Markus Guentert, Matthias Kunze +1 more
Quality measures for similarity search results are proposed, providing information on how good and how differentiated the results are, and comprehensively evaluate their prediction towards human assessment of process similarity.