Delayed Instantiation Bulk Operations for Management of Distributed, Object-Based Storage Systems

Abstract

The basic distributed, object-based storage system model lacks features for storage management. This work presents and analyzes a strategy for using existing facilities to implement atomic operations on sets of objects. These bulk operations form the basis for managing snapshots (read-only copies) and forks (read-write copies) of portions of the storage system. Specifically, we propose to leverage the access control capabilities, and annotations at the metadata server, to allow for selective clone and delete operations on sets of objects. In order to act upon a set of objects, a bulk operation follows these steps. First, the metadata server accepts the operation, contacts the storage nodes to revoke outstanding capabilities on the set of objects, and retains a record of the operation and the affected set of objects. At this point, clients can make no changes to existing objects since any capabilities they hold will be rejected by storage nodes. Second, when clients subsequently contact the metadata server to access affected objects (e.g., acquire fresh capabilities), any records of bulk operations are consulted. Finding that a client is accessing an affected object, the metadata server will take the necessary steps to enact the uninstantiated operation before responding to the client request. This eventual enforcement of operation semantics ensures compliance with the operation's intent but delays the corresponding work until the next client access. With appropriate background instantiation, the work of instantiating bulk operations can be hidden from clients.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Aug 01, 2009
Accession Number
ADA512930

Entities

People

  • Andrew J. Klosterman

Organizations

  • Carnegie Mellon University

Tags

Communities of Interest

  • Energy and Power Technologies

DTIC Thesaurus Topics

  • Algorithms
  • Coding
  • Computer Access Control
  • Computer Programming
  • Computers
  • Data Storage Systems
  • Databases
  • Distributed Computing
  • Failure Mode And Effect Analysis
  • Language
  • Object-Oriented Database Management Systems
  • Operating Systems
  • Programming Languages
  • Servers (Computer Hardware)
  • Standards
  • Systems Engineering
  • Workload

Fields of Study

  • Computer science

Readers

  • Computer Science/Computer Engineering/Data Science/Digital Signal Processing.
  • Database Systems and Applications