Software as a service for data scientists
Communications of the ACMPublished 24 January 2012
Bryce Allen, John Bresnahan, Lisa Childers, Ian Foster, Gopi Kandaswamy, Raj Kettimuthu
Citations247
SJR quartileQ1
SJR score1.15
SNIP3.34
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
Globus Online manages fire-and-forget file transfers for big-data, high-performance scientific collaborations.
Abstract
Globus Online manages fire-and-forget file transfers for big-data, high-performance scientific collaborations.
Keywords
Computer ScienceDecision Sciences
Incentives Build Robustness in Bit-Torrent
2,661 Citations2003Bram Cohen
The BitTorrent file distribution system uses tit-fortat as a method of seeking pareto efficiency, which achieves a higher level of robustness and resource utilization than any currently known cooperative technique.
The Globus Striped GridFTP Framework and Server
597 Citations2005William Allcock, John Bresnahan +2 more
It is argued that this combination of performance and modular structure make the Globus GridFTP framework both a good foundation on which to build tools and applications, and a unique testbed for the study of innovative data management techniques and network protocols.
An online credential repository for the Grid: MyProxy
394 Citations2002Jason Novotny, Steven Tuecke +1 more
This work examines the requirements of Grid portals, gives an overview of the GSI, and demonstrates how MyProxy enables them to function together, using an online credentials repository system, called MyProxy.
ANU Open Research (Australian National University)The rsync algorithm
309 Citations1996Andrew Tridgell, Paul Mackerras
X.509 Proxy Certificates for Dynamic Delegation
215 Citations2004Von Welch, Ian Foster +7 more
This work has defined and standardized X.509 Proxy Certificates for the purpose of providing restricted proxying and delegation within a PKI-based authentication system.
Reliability and security in the CoDeeN content distribution network
193 Citations2004Limin Wang, Kyong Soo Park +3 more
The Kangaroo approach to data movement on the Grid
115 Citations2002Douglas Thain, Jim Basney +2 more
Kangaroo is illustrated, a simple data movement system that makes opportunistic use of disks and networks to keep applications running and can achieve better end-to-end performance than traditional data movement techniques, even though its individual components do not achieve high performance.
Lecture notes in computer scienceSoftware as a Service: An Integration Perspective
112 Citations2007Wei Sun, Kuo Zhang +3 more
This paper analyzes the key functional and non-functional SaaS integration requirements from an industry practitioner point of view, and summarizes the SAAS integration patterns and existing offerings; then point out the gaps from both technology and tooling perspectives; and introduces a SaaD integration framework to address those gaps.
Wide area data replication for scientific collaborations
100 Citations2005Ann Chervenak, Robert Schuler +3 more
Journal of Parallel and Distributed ComputingA framework for reliable and efficient data placement in distributed computing systems
82 Citations2005Tevfik Kosar, Miron Livny
A framework which can be considered as a ''data placement subsystem'' for distributed computing systems, similar to the I/O subsystem in operating systems is proposed, which includes a specialized scheduler for data placement, a high level planner aware of data placement jobs, a resource broker/policy enforcer and some optimization tools.
NEWT: A RESTful service for building High Performance Computing web applications
58 Citations2010Shreyas Cholia, David Skinner +1 more
The goal of this effort is to create a model whereby HPC becomes easily accessible through the web, allowing users to interact with their scientific computing, data and applications entirely through such web interfaces.
Peer-to-Peer Computing for Secure High Performance Data Copying
46 Citations2002Andrew Hanushevsky
The BaBar Copy Program (bbcp) is an excellent representative of peer-to-peer (P2P) computing and a pioneering application of its type in the P2P arena, built upon the foundation of its predecessor, Secure Fast Copy (sfcp), which incorporates significant improvements performance and usability.
Budget-constrained bulk data transfer via internet and shipping networks
34 Citations2011Brian Cho, Indranil Gupta
This paper develops techniques to create an optimal transfer plan that minimizes transfer latency subject to a budget constraint and develops efficient binary search methods that find the optimal shipment transfer plan.
Communications of the ACMHow will astronomy archives survive the data tsunami?
33 Citations2011G. Bruce Berriman, Steven L. Groom
Synthesis lectures on information concepts, retrieval, and servicesiRODS Primer
33 Citations2010Arcot Rajasekar, Reagan Moore +10 more
The integrated Rule-Oriented Data System implements the data management framework required to support policy-based data management and is a highly extensible and tunable system that can enforce management policies, automate administrative tasks, and periodically validate assessment criteria.
arXiv (Cornell University)TeraScale SneakerNet: Using Inexpensive Disks for Backup, Archiving, and Data Exchange
32 Citations2002Jim Gray, Wyman Chong +3 more
This article describes how the Sloan Digital Sky Survey ships terabyte scale datasets both within the US and to Europe and Asia, and some software issues that they raise.
Journal of Physics Conference SeriesPhEDEx Data Service
32 Citations2010Ricky Egeland, T. Wildish +1 more
CATCH: A Cloud-Based Adaptive Data Transfer Service for HPC
26 Citations2011Henry M. Monti, Ali R. Butt +1 more
CATCH leverages a bevy of cloud storage resources to orchestrate a decentralized data transport with fail-over capabilities, and can help improve the data transfer times at the HPC center by as much as 81.1\% for typical HPC workloads.