New Grid Scheduling and Rescheduling Methods in the GrADS Project
International Journal of Parallel ProgrammingPublished 1 June 2005
Fran Berman, Henri Casanova, Andrew A. Chien, Keith D. Cooper, Holly Dail, Anshuman Dasgupta
Citations199
SJR quartileQ3
SJR score0.35
SNIP0.63
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
This paper presents recent extensions to the GrADS software framework: a new approach to scheduling workflow computations, applied to a 3-D image reconstruction application; a simple stop/migrate/restart approach to rescheduling Grid applications, application to a QR factorization benchmark; and a process-swapping approach to Rescheduling, applications to an N-body simulation.
Abstract
The goal of the Grid Application Development Software (GrADS) Project is to provide programming tools and an execution environment to ease program development for the Grid. This paper presents recent extensions to the GrADS software framework: a new approach to scheduling workflow computations, applied to a 3-D image reconstruction application; a simple stop/migrate/restart approach to rescheduling Grid applications, applied to a QR factorization benchmark; and a process-swapping approach to rescheduling, applied to an N-body simulation. Experiments validating these methods were carried out on both the GrADS MacroGrid (a small but functional Grid) and the MicroGrid (a controlled emulation of the Grid). © 2005 Springer Science+Business Media, Inc.
Keywords
Computer ScienceDecision Sciences
The Grid 2: Blueprint for a New Computing Infrastructure
7,622 Citations1998Ian Foster, Carl Kesselman
This chapter discusses grids in context, distributed supercomputing applications, and testbed Bridges from Research to Infrastructure.
Journal of Structural BiologyEMAN: Semiautomated Software for High-Resolution Single-Particle Reconstructions
2,413 Citations1999Steven J. Ludtke, Philip R. Baldwin +1 more
EMAN (Electron Micrograph ANalysis), a software package for performing semiautomated single-particle reconstructions from transmission electron micrographs, was written from scratch in C++ and is provided free of charge on the Web site.
Journal of Parallel and Distributed ComputingA Comparison of Eleven Static Heuristics for Mapping a Class of Independent Tasks onto Heterogeneous Distributed Computing Systems
1,715 Citations2001Tracy D. Braun, Howard Jay Siegel +9 more
It is shown that for the cases studied here, the relatively simple Min?min heuristic performs well in comparison to the other techniques, and one even basis for comparison and insights into circumstances where one technique will out-perform another.
Future Generation Computer SystemsThe network weather service: a distributed resource performance forecasting service for metacomputing
1,287 Citations1999Rich Wolski, Neil Spring +1 more
The current implementation of the NWS for Unix and TCP/IP sockets is described and examples of its performance monitoring and forecasting capabilities are provided.
Heuristics for scheduling parameter sweep applications in grid environments
569 Citations2002Henri Casanova, Arnaud Legrand +2 more
This study proposes an adaptive scheduling algorithm for parameter sweep applications on the grid, modify standard heuristics for task/host assignment in perfectly predictable environments, and proposes an extension of Sufferage called XSufferage.
Physics TodayLIGO and the Detection of Gravitational Waves
427 Citations1999B. C. Barish, Rainer Weiß
A directory service for configuring high-performance distributed computations
415 Citations2002Sharyn M. Fitzgerald, I. Foster +4 more
This work proposes a Metacomputing Directory Service that provides efficient and scalable access to diverse, dynamic, and distributed information about resource structure and state and defines an extensible data model to represent required information and presents a scalable, high-performance, distributed implementation.
G-commerce: market formulations controlling resource allocation on the computational grid
200 Citations2002Rich Wolski, James S. Plank +2 more
This paper investigates G-commerce-computational economies for controlling resource allocation in Computational Grid settings and indicates that commodities markets are a better choice for controlling Grid resources than previously defined auction strategies.
The Internet Backplane Protocol: Storage in the Network
117 Citations1999James S. Plank, Micah Beck +4 more
The development of IBP is discussed, the implementation of a prototype system for managing network storage, and a preliminary deployment as part of the Internet-2 Distributed Storage Initiative are discussed.
Toward a framework for preparing and executing adaptive grid programs
113 Citations2002Ken Kennedy, M. Mazina +11 more
The goal of this framework is to provide good resource allocation for Grid applications and to support adaptive reallocation if performance degrades because of changes in the availability of Grid resources.
Future Generation Computer SystemsThe Autopilot performance-directed adaptive control system
103 Citations2001Randy Ribler, Huseyin Simitci +1 more
Autopilot provides a flexible set of performance sensors, decision procedures, and policy actuators to realize adaptive control of applications and resource management policies on both parallel and wide area distributed systems.
A heuristic algorithm for mapping communicating tasks on heterogeneous resources
101 Citations2002Kenjiro Taura, Andrew A. Chien
A heuristic algorithm that maps data processing tasks onto heterogeneous resources (i.e. processors and links of various capacities) is presented and shows that it performs significantly better than communication-ignorant schedulers.
Parallel Processing LettersSRS: A FRAMEWORK FOR DEVELOPING MALLEABLE AND MIGRATABLE PARALLEL APPLICATIONS FOR DISTRIBUTED SYSTEMS
100 Citations2003Sathish Vadhiyar, Jack Dongarra
A framework for developing malleable and migratable MPI message-passing parallel applications for distributed systems that includes a user-level checkpointing library called SRS and a runtime support system that manages the checkpointed data for distribution to distributed locations is discussed.
Lecture notes in computer sciencePerformance Contracts: Predicting and Monitoring Grid Application Behavior
98 Citations2001Fredrik Vraalsen, Ruth Aydt +2 more
An application signature model and performance contracts are introduced to specify expected grid application behavior, and a monitoring infrastructure that detects when actual behavior does not meet expectations is discussed.
A performance oriented migration framework for the grid
94 Citations2003Sathish Vadhiyar, Jack Dongarra
A migration framework for performance oriented Grid systems that implements tightly coupled policies for both suspension and migration of executing applications and takes into account both system load and application characteristics is described.
A metascheduler for the Grid
89 Citations2003Sathish Vadhiyar, Jack Dongarra
This paper describes a metascheduling architecture for a Grid system that takes into account both the application and system level considerations and results are presented to demonstrate the usefulness of the meetascheduler.
GridSAT
88 Citations2003Wahid Chrabakh, Rich Wolski
It is shown how the large number of computational resources that are available from a Grid can be managed effectively for the application by an automatic scheduler and effective implementation and how GridSAT has solved previously unsolved satisfiability problems and the domain science contribution these results make.
The International Journal of High Performance Computing ApplicationsNumerical Libraries and the Grid
74 Citations2001Antoine Petitet, Susan Blackford +5 more
This paper describes an overall framework for the design of numerical libraries on a computational grid of processors in which the processors may be geographically distributed and under the control of a grid-based scheduling system.
Image processing for the grid: a toolkit for building grid-enabled image processing applications
70 Citations2003S. Hastings, Tahsin Kurç +4 more
This paper designs and implementation of a toolkit that allows rapid and efficient development of biomedical image analysis applications in a distributed environment and employs the Insight Segmentation and Registration Toolkit and Visualization Toolkit layered on a component-based framework.
The MicroGrid: a Scientific Tool for Modeling Computational Grids
58 Citations2000Hoseok Song, Xudong Liu +5 more
Traffic-based Load Balance for Scalable Network Emulation
49 Citations2003Xin Liu, Andrew A. Chien
These studies show that exploiting static topology and application placement information can achieve reasonable load balance, but a profile-based approach further improves load balance for even large scale network emulation.
Numerical libraries and the grid
48 Citations2001Antoine Petitet, Susan Blackford +5 more
An overall framework for the design of numerical libraries on a computational Grid of processors where the processors may be geographically distributed and under the control of a Grid-based scheduling system is described.
Lecture notes in computer scienceCactus Application: Performance Predictions in Grid Environments
41 Citations2001Matei Ripeanu, Adriana Iamnitchi +1 more
This paper addresses issues related to the execution of applications like Cactus in Grid environments with two types of Grids: a set of geographically distributed supercomputers and a collection of the scale of one million Internet-connected workstations.
The International Journal of High Performance Computing ApplicationsA Simple MPI Process Swapping Architecture for Iterative Applications
38 Citations2004Otto Sievert, Henri Casanova
This paper presents MPI process swapping, a simple performance enhancing add-on to the MPI programming paradigm that can be added to iterative MPI applications and requires as few as three lines of source code change.
Elsevier eBooksBuilding Reliable Clients and Services
36 Citations2004Douglas Thain, Miron Livny
This chapter presents a range of principles and techniques that can be used to construct Grid services and clients that execute reliably (from a client perspective) despite various classes of failures.
Rice University's digital scholarship archive (Rice University)Semi-Automatic Synthesis of Parameterized Performance Models for Scientific Programs
9 Citations2003Gabriel Marin
These models are designed to characterize node performance between synchronization points in parallel programs, with the eventual goal of modeling the performance of parallel applications.
Policies for swapping MPI processes
3 Citations2004Otto Sievert, Henri Casanova
The results show that, with adequate swapping policies, MPI process swapping can provide substantial performance benefits with very limited implementation effort.
Rice University's digital scholarship archive (Rice University)Mapping HPF onto the Grid
2 Citations2003Anirban Mandal