Abstract
The Job Provenance (JP) service is designed to automate keeping track of computations on large scale Grids, giving thus users a tool to correctly archive information about their jobs and to re-submit any job in a reconstructed environment. JP provides a permanent minimal record of job (and its environment) related information, to which free-form user annotations can be added. JP also offers the capability of configuring any number of indexed logical views on the large collections of raw data, allowing efficient processing of even complex user queries selecting on both system data and the annotations. The scalable architecture, capable to handle millions of jobs in a single JP installation, and integrated into the EGEE gLite middleware environment is presented.
This work has been supported by the EU EGEE project INFSO-RI-508833.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
AliEn (ALIce ENvironment), http://aliceinfo.cern.ch/AliEn
EU FP6 Programme Enabling and Supporting Provenance in Grids for Complex Problems, http://twiki.gridprovenance.org/bin/view/Provenance/ProjectInformation
gLite—Ligthweight Middleware for Grid Computing, http://glite.web.cern.ch/glite/default.asp
Mygrid Provenance Outline, http://phoebus.cs.man.ac.uk/twiki/bin/view/Mygrid/ProvenanceOutline
PASOA: Provenance Aware Service Oriented Architecture, http://twiki.pasoa.ecs.soton.ac.uk/bin/view/PASOA/AboutPasoa
SAM (Sequential data Access via Meta-data), http://d0db.fnal.gov/sam/
The Atlas Metadata Interface, https://atlastagcollector.in2p3.fr:8443/AMI/
Chen, L., Tan, V., Xu, F., Biller, A., Groth, P., Miles, S., Ibbotson, J., Luck, M., Moreau, L.: A proof of concept: Provenance in a Service Oriented Architecture. In: Proceedings of the fourth UK e-Science All Hands Meeting, Nottingham, UK (2005)
EGEE JRA1. EGEE Middleware Design—Release 1, https://edms.cern.ch/document/487871/
Groth, P., Luck, M., Moreau, L.: A protocol for recording provenance in service-oriented grids. In: Higashino, T. (ed.) OPODIS 2004. LNCS, vol. 3544, pp. 124–139. Springer, Heidelberg (2005)
EGEE JRA2. Job Metrics, http://egee-jra2.web.cern.ch/EGEE-JRA2/QoS/JobsMetrics/JobMetrics.htm
Rajbhandari, S., Walker, D.W.: Support for Provenance in a Service-based Computing Grid. In: Proceedings of the third UK e-Science All Hands Meeting, Nottingham, UK (2004)
Townend, P., Groth, P., Xu, J.: A provenance-aware weighted fault tolerance scheme for service-based applications. In: Proceedings of the 8th IEEE International Symposium on Object-oriented Real-time distributed Computing (ISORC 2005) (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Dvořák, F. et al. (2006). gLite Job Provenance. In: Moreau, L., Foster, I. (eds) Provenance and Annotation of Data. IPAW 2006. Lecture Notes in Computer Science, vol 4145. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11890850_25
Download citation
DOI: https://doi.org/10.1007/11890850_25
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-46302-3
Online ISBN: 978-3-540-46303-0
eBook Packages: Computer ScienceComputer Science (R0)