PReServ: Provenance Recording for Services
ePrints Soton (University of Southampton)Published 17 July 2008Open access
Paul Groth, Simon Miles, Luc Moreau
Citations62
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
Provenance Recording for Services (PReServ) is a software package that allows developers to integrate process documentation recording into their applications and its performance has been benchmarked.
Abstract
The importance of understanding the process by which a result was generated in an experiment is fundamental to science. Without such information, other scientists cannot replicate, validate, or duplicate an experiment. We define provenance as the process that led to a result. With large scale in-silico experiments, it becomes increasingly difficult for scientists to record process documentation that can be used to retrieve the provenance of a result. Provenance Recording for Services (PReServ) is a software package that allows developers to integrate process documentation recording into their applications. PReServ has been used by several applications and its performance has been benchmarked. 1
Keywords
Computer ScienceDecision Sciences
Lecture notes in computer scienceWhy and Where: A Characterization of Data Provenance
1,310 Citations2001Peter Buneman, Sanjeev Khanna +1 more
An approach to computing provenance when the data of interest has been created by a database query is described, adopting a syntactic approach and present results for a general data model that applies to relational databases as well as to hierarchical data such as XML.
Chimera: a virtual data system for representing, querying, and automating data derivation
608 Citations2002Ian Foster, Jens Vöckler +2 more
The Chimera virtual data system is developed, which combines avirtual data catalog for representing data derivation procedures and derived data, with a virtual data language interpreter that translates user requests into data definition and query operations on the database.
A case for grid computing on virtual machines
370 Citations2004Renato Figueiredo, Peter A. Dinda +1 more
This work advocates a novel approach to grid computing that is based on a combination of "classic" operating system level virtual machines (VMs) and middleware mechanisms to manage VMs in a distributed environment.
From Sandbox to Playground: Dynamic Virtual Environments in the Grid
116 Citations2005K. Keahey, K. Doering +1 more
This work model dynamic virtual environments (DVEs) as first-class entities in a distributed environment, with grid service interfaces defined to negotiate creation, monitor properties, and manage lifetime, and proposes here a codification of the interactions required to negotiate the creation of new execution environments.
ePrints Soton (University of Southampton)Provenance of e-Science Experiments - Experience from Bioinformatics
112 Citations2003Mark Greenwood, Carole Goble +7 more
An overview of initial work on the provenance of bioinformatics e-Science experiments within myGrid uses two kinds of provenance: the derivation path of information and annotation and explores how the resulting Webs of experimental data holdings can be mined for useful information and presentations for the e-Scientist.
Lecture notes in computer scienceRecording and Reasoning over Data Provenance in Web and Grid Services
104 Citations2003Martin Szomszor, Luc Moreau
This work proposes an infrastructure level support for a provenance recording capability for service-oriented architectures such as the Grid and Web Services and provides a mechanism by which provenance is used to determine whether previous computed results are still up to date.
Lecture notes in computer scienceA Protocol for Recording Provenance in Service-Oriented Grids
98 Citations2005Paul Groth, G. Flucke +1 more
An implementation-independent protocol for the recording of provenance capture in Grids is developed and a liveness property for the system is sketched using an abstract state machine or three-dimensional state transition diagram.
Recording and using provenance in a protein compressibility experiment
72 Citations2005Paul Groth, Simon Miles +4 more
It is demonstrated that provenance recording overhead of the prototype system remains under 10% of execution time, and it is shown that the recorded information successfully supports use cases in a performant manner.
Lineage tracing in data warehouses
53 Citations2001Jennifer Widom, Yingwei Cui
This thesis presents formal definitions of data lineage for data warehouses defined as relational materialized views over relational sources, and for warehouses defined using graphs of general data transformations, along with algorithms for lineage tracing along with a suite of optimization techniques.
Provenance-Aware Sensor Data Storage
51 Citations2005Jonathan Ledlie, Chaki Ng +1 more
The key to sensor data identity is provenance, the full history or lineage of the data, which addresses the naming and indexing issues and is presented as a research agenda for constructing distributed, indexed repositories of sensor data.
A Provenance-Aware Weighted Fault Tolerance Scheme for Service-Based Applications
36 Citations2005Paul Townend, Paul Groth +1 more
A scheme that - for the first time - links the technique of provenance with that of multi-version fault tolerance and results in a much more dependable system than either of the other systems tested, whilst imposing a negligible timing overhead.
Lecture notes in computer scienceE-notebook Middleware for Accountability and Reputation Based Trust in Distributed Data Sharing Communities
21 Citations2004Paul Ruth, Dongyan Xu +2 more
A new middleware which provides support for trust and accountability in distributed data sharing communities by adding accountability to the provenance of each data set and ensures data integrity insofar as any errors can be identified and corrected.
ePrints Soton (University of Southampton)A Proof of Concept: Provenance in a Service Oriented Architecture
17 Citations2005Liming Chen, Victor Tan +6 more
The cake baking scenario is described, some provenance-type questions that can be asked about the baking process are presented and an implementation of the cake baking process within a service-oriented architecture framework that can answer these questions using collated provenance data is provided.