WO2009126771A2 - Directed placement of data in a redundant data storage system - Google Patents
Directed placement of data in a redundant data storage system Download PDFInfo
- Publication number
- WO2009126771A2 WO2009126771A2 PCT/US2009/040007 US2009040007W WO2009126771A2 WO 2009126771 A2 WO2009126771 A2 WO 2009126771A2 US 2009040007 W US2009040007 W US 2009040007W WO 2009126771 A2 WO2009126771 A2 WO 2009126771A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- updated
- storing
- data
- data file
- data storage
- Prior art date
Links
- 238000013500 data storage Methods 0.000 title claims abstract description 69
- 238000012545 processing Methods 0.000 claims abstract description 27
- 230000004044 response Effects 0.000 claims abstract description 12
- 230000010076 replication Effects 0.000 claims description 49
- 238000000034 method Methods 0.000 claims description 22
- 238000004891 communication Methods 0.000 description 17
- 239000004744 fabric Substances 0.000 description 7
- 238000013459 approach Methods 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 5
- 230000008439 repair process Effects 0.000 description 4
- 230000003068 static effect Effects 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 230000007246 mechanism Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 238000005192 partition Methods 0.000 description 2
- ABEXEQSGABRUHS-UHFFFAOYSA-N 16-methylheptadecyl 16-methylheptadecanoate Chemical compound CC(C)CCCCCCCCCCCCCCCOC(=O)CCCCCCCCCCCCCCC(C)C ABEXEQSGABRUHS-UHFFFAOYSA-N 0.000 description 1
- RYGMFSIKBFXOCR-UHFFFAOYSA-N Copper Chemical compound [Cu] RYGMFSIKBFXOCR-UHFFFAOYSA-N 0.000 description 1
- 241000764238 Isis Species 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- VQLYBLABXAHUDN-UHFFFAOYSA-N bis(4-fluorophenyl)-methyl-(1,2,4-triazol-1-ylmethyl)silane;methyl n-(1h-benzimidazol-2-yl)carbamate Chemical compound C1=CC=C2NC(NC(=O)OC)=NC2=C1.C=1C=C(F)C=CC=1[Si](C=1C=CC(F)=CC=1)(C)CN1C=NC=N1 VQLYBLABXAHUDN-UHFFFAOYSA-N 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 238000013523 data management Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000005417 image-selected in vivo spectroscopy Methods 0.000 description 1
- 238000012739 integrated shape imaging system Methods 0.000 description 1
- 230000005012 migration Effects 0.000 description 1
- 238000013508 migration Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
- G06F16/184—Distributed file systems implemented as replicated file system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/16—Error detection or correction of the data by redundancy in hardware
- G06F11/20—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
- G06F11/2053—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant
- G06F11/2094—Redundant storage or storage space
Definitions
- the present disclosure generally relates to computer data storage.
- Examples of distributed filesystems include the HP Lustre File System, SGI Clustered Extensible File System (CXFS), Veritas File System (VxFS), Google File System (GFS), Omneon Extended File System (EFS), Oracle Cluster File System (OCFS), and the Hadoop Distributed File System (HDFS).
- Distributed hardware systems include Isilon, Panasas, Avid ISIS.
- FIG. 1 shows a system manager client of a metadata server of a distributed storage system and a sequence of steps that may be taken, in one embodiment, to add a new server class attribute and define a new class
- FIG. 2 shows a data client of a distributed storage system and an example sequence of steps taken to write data to a file in a specific class.
- FIG. 3 shows a system manager client of a metadata server of a distributed storage system and an example sequence of steps taken to update an existing class.
- FIG. 4 shows a system manager client re-associating a file to a new or different class.
- FIG. 5A illustrates logical relationships of a file, class, subclasses, and data servers.
- FIG. 5B illustrates an example server property database.
- FIG. 6 illustrates a computer system upon which an embodiment may be implemented.
- a data processing apparatus comprises a metadata store storing information about files that are stored in a distributed data storage system, and comprising a class database; one or more processing units; logic configured for receiving and storing in the class database a definition of a class of data storage servers comprising one or more subclasses each comprising one or more server selection criteria; associating the class with one or more directories of the data storage system; in response to a data client storing a data file in a directory, binding the class to the data file, determining and storing a set of identifiers of one or more data storage servers in the system that match the server selection criteria, and providing the set of identifiers to the data client.
- the invention encompasses a computer-implemented method and a computer-readable medium configured to carry out the foregoing steps.
- a replication framework is provided to control the placement and migration of file data within a distributed storage system. Control over data placement is useful to leverage differences in servers in a heterogeneous server cluster supporting a distributed file system. Control over data placement also allows files to expand within specific server partitions. Control over data placement also can help localize file repair within a redundant data fabric.
- FIG. 1 shows a system manager client 102 of a metadata server 1 of a distributed storage system and a sequence of steps that may be taken, in one embodiment, to add a new server class attribute and define a new class.
- files are associated with classes of specific servers. The association of files to server classes provides a means for controlling the placement of data images within the cluster to specific server partitions.
- a class is a set of servers that satisfy a set of server properties. For example, a class could be defined as all of the high performance servers within a cluster that are also connected to the highest bandwidth network switches. Any number of properties having any degree of complexity may define a class.
- FIG. 5A illustrates logical relationships of a file, class, subclasses, and data servers.
- a file 502 is associated by stored information in the metadata server 1 with a class 504.
- the class 504 is defined by one or more subclasses 505 A, 505N. Any number of subclasses may be used.
- Collectively the class 504 and its subclasses 505A, 5O5N define a set 506 of servers that match the class.
- a client of the system of FIG. 1 can define the structure of FIG. 5A, and consequently the client can influence where the file 502 is stored by restricting storage to servers that are in the set 506 as determined by the class 504 and its subclasses.
- each class 504 is represented by a name and a class identifier.
- Each subclass is represented by server selection criteria, such as a database view command string, a list of servers currently matching the criteria and equivalent to set 506, and an optional representation count that can be used to determine a replication factor for data images mapped to the class, and a logical class identifier.
- the name, server selection criteria, and class identifier are shared as global state values among redundant metadata servers.
- the metadata servers described in the system of US Patent Publication 2007- 0214183-A1 may be used.
- an embodiment may use the Omneon MediaGrid storage system, commercially available from Omneon, Inc., Sunnyvale, California.
- Classes may overlap.
- a '"share/no-share" property of a class indicates whether the class may overlap with others.
- a server property database 110 is maintained on each metadata server 1 in a distributed storage system.
- rows represent servers that are class members, and columns represent server properties.
- FIG. 5B illustrates an example server property database 110 in which column 510 identifiers servers, each of which is associated with a row, and columns 512, 514, 516, 518, 520 store properties of the server for the associated row. Any number of rows and columns may be represented in database 110.
- the database 110 is initialized by storing read-only system level properties for each available server in the columns 514, 516, 518, 520.
- Example system-level properties include serial number, network topology location, processor speed, and number of processor cores, as seen in FIG. 5B, but any properties may be used.
- the database 110 applies a sequence of commands, which are journaled on the metadata server, to make the database current and consistent with databases on other metadata servers controlling the server cluster.
- a transient list of abstract read/write server properties e.g., server owner, repair priority
- all data of the file 502 is mapped to one class 504.
- the metadata stored in metadata server 1 for each replicated data image of a file contains the logical class identifier, thereby binding the location of file data to a particular class of servers.
- the metadata may be stored in local data storage of the metadata server 1, which is replicated to and synchronized with metadata data storage in all other metadata servers in the system.
- a server change results in a repair to the data storage fabric, data is moved to other servers so that all file data remains in servers of the class to which the data is bound.
- classes are redefined, or as files are moved between classes, the set of servers housing each data image for a file is reformed relative to the class. All such data movement is done local to the cluster, and does not require data movement between a client utility and the cluster servers.
- a nonzero representation count in a subclass 505A indicates the minimum number of servers from that subclass that must be represented in a replica set.
- a request to store data may indicate, using a nonzero representation count for a subclass 505A, an enforced replication factor for any file 502 mapped to that subclass 505 A.
- Subclasses 505 A, 5O5N may affect data replication in a redundant data fabric as follows. When a class 504 consists of subclasses 505 A, 505N all having a zero representation count, then the replication factor for data images mapped to that class is obtained from an inherited file property, such as replication factor 508 of namespace properties 509 as seen in FIG. 5A. Otherwise, the effective data image replication factor is the sum of all subclass representation counts; moreover, in this latter case, any subclass with a zero representation count is ignored during sequence generation and data fabric repair. Furthermore, the replication factor for a file can be individually modified only when the sum of all subclass representation counts of the associated class is zero.
- the metadata servers use a message-based control path for communications to intelligent storage elements to collect dynamic storage availability statistics.
- the metadata servers calculate the availability of the data fabric with respect to each class.
- clients of the storage system can specify where the data for a file is to be located within a potentially huge cluster of commodity servers by binding the file to a class identifier.
- control of placement of replicated data images in a redundant data fabric is provided on a per-file basis. This additional control enables users to further optimize access of data in distributed file system according to dynamic business needs.
- clients of a distributed file system have control over how data is placed and maintained.
- Previous approaches using metadata servers generally have placed redundant data images on data servers by globally optimizing the availability selection criteria over all servers.
- data placement and the use of optimized availability selection criteria can be applied locally to specific sets of servers. By binding each data image to a class, files can be placed on specific sets of servers as the files are written, or as the data fabric is repaired.
- client control of data placement enables a wide variety new uses for such a file system, including hierarchical data management and data access staging.
- a video file in a class consisting of a few large capacity servers may be reassigned to a class consisting of many high performing servers configured only with RAM disks, just prior to performing transcoding or just prior to playing the file in a video network.
- Embodiments also enable the development of intelligent cluster manager applications to monitor and control a cluster on a class basis without having to copy data in and out of the cluster.
- a manager application can monitor file class assignments and re-assign files that have not been accessed recently to classes in order to maintain a specific amount of free space in frequently accessed classes.
- the manager application also could reassign additional servers to non overlapping classes that are nearly full.
- FIG. 1 further shows a sequence of steps that may be taken, in one embodiment, to add a new server class attribute and define a new class.
- a system manager 102 is coupled to a metadata server 1.
- the system manager 102 is a client of the metadata server 1.
- Each metadata server 1 may be implemented using a general purpose computer system as shown in FIG. 6 in which the memory or local data storage stores program instructions or other software elements that implement the functions described herein.
- metadata server 1 may comprise logic that implements a name space manager 104, class manager 106, server manager 108, and class database 110.
- the class manager 106 journals state data, and updates the class database 110.
- the attribute and server set are passed to other metadata servers (16).
- the techniques to share data on a redundant metadata server ring described in U.S. Pat. No. 6,665,675 Bl may be used.
- the example request indicates that servers associated with a class named "fastServerClass” comprise all 3GHz servers in labl and Iab2 that have been allocated for the owner "demo".
- class manager 106 uses the subclass criteria to identify a set of servers that satisfy the attribute criteria. Class manager 106 then sends the server set to the server manager 108 at (26).
- Subclasses may identify any desired criteria, such as processor speed, number of CPUs or CPU cores, the speed of a switch to which a server is coupled, location, read latency, write latency, etc.
- the representation count values may be different in different subclasses. Thus, while the representation count is "2" in both subclasses of the example above, other embodiments may use different counts in different subclasses. Use of representation counts enables clients to indirectly specify, for example, that a file must have high availability. For example, high representation count values will result in storing the file with a high replication factor, so that the file can be delivered to more clients concurrently.
- the server manager 108 assigns a new class identifier for the servers and shares this identifier with all other server manager instances of other metadata servers 1 among the redundant metadata servers 112 at (27).
- the server manager 108 returns the class identifier to the class manager at (22).
- the class manager 106 updates the class database 110 at (28) and returns the class identifier to the system manager 102 at (29). Because the representation count values are "2,” all subsequent file data associated with the class identifier will be replicated twice among the 3GHz servers owned by "demo" in labl and twice among the
- availability selection criteria is used to locate the best available servers in the class to house the data for the file.
- all data for the affected files are re -replicated using only that part of the cluster that contains servers in the class.
- FIG. 2 shows a data client of a distributed storage system and an example sequence of steps that may be performed to write data to a file in a specific class.
- file includes data files, application files including executables, and all other data that can be stored in a storage system.
- a data client 202 is coupled to the metadata server 1 and creates a file in a directory (10).
- the name space manager 104 assigns a class identifier for the directory to the file as an inherited property.
- the name space manager 104 sends a path name and class identifier to the class manager to bind the file to the class for subsequent reverse lookup files by class (11).
- the name space manager 104 returns a handle to the client
- the data client 202 which is unaware of any class definition, requests the network addresses of a set of servers to write to (20).
- the name space manager 104 requests (21) the server manager 108 for the "optimal" servers in the class for writes. Based on best availability criteria applied locally to the server members in the class, the server manager 108 returns the addresses and the replication factor to the client (22).
- the replication factor is determined by summing the representation counts for all subclasses.
- the data client 202 sends data to a first data server 13 with instructions for storing and forwarding onto the other servers in the sequence.
- the first data server 13, a second data server 15, and a third data server 18 each perform copy/forward operations, resulting in storing and forwarding data three more times
- FIG. 3 shows a system manager client of a metadata server of a distributed storage system and an example sequence of steps taken to update an existing class.
- a system manager 102 is coupled to metadata server 1 as in FIG. 1.
- FIG. 3 also illustrates a first class comprising data servers 11, 12. 13, 14, 15, 16, 17, 18, 19, IA, IB, 1C, and a second or updated class comprising different data servers 21, 22, 23, 24, 25. 26, 27, 28, 29, 2A. 2B,
- the system manager 102 acting as client makes a remote procedure request to update the subclass database string (10).
- class manager 106 updates the class database locally, and updates other metadata servers 1 among the redundant metadata servers
- server manager instances on all the metadata servers associate a new server set for the specific class as in FIG. 1.
- the name space manager 104 performs a reverse lookup and reads the list of paths associated with the specific class. For each data chunk of each file, the name space manager
- the server manager 108 requests the server manager 108 to re-replicate the associated data images for the updated class (15). For each data chunk, the server manager 108 calculates the best available server set in the updated class and requests each server holding a specific data image (20, 30, 40, 50) to move the data in parallel to the optimally available server set for the updated class (21, 31,
- the updated class reflects a higher replication factor than before, then data movement from one to multiple servers is implied, and is performed. Because the server manager 108 maintains a broad view of server availability, some of the servers holding the original data image may be too busy to move data. In this case, the movement is done with a subset of servers (e.g., data server 13 and 17). As data movement completes, the server manager 108 updates the location of the data images on the metadata server 1
- the data client 202 may receive an asynchronous event notification, or may poll the metadata server 1 to determine whether data movement is complete (60).
- data movement is contingent on available space in the updated class. If the servers in the updated class do not have available space, the metadata server will retry failed replications as the space dynamic parameters collected from each server in the class change over time.
- FIG. 4 shows a system manager client re-associating a file to a new or different class.
- a file may be re-associated with a new class or a different class for several reasons For example, as the number of read accesses for a video file increases, the value of that file within a data storage cluster increases.
- the cluster By reassigning a frequently requested file to a class consisting of servers with fast central processing units and network interfaces, the cluster is able to service read requests so that the video is played out on more clients. If that class also has a higher representation count, then more copies of the file are distributed and maintained within the cluster, which also makes the file more available for clients reading it.
- system manager client 102 makes a remote procedure request to the namespace manager 104 to update the file attributes containing a new class identifier (10)
- the name space manager validates the new class with the class manager (11, 12).
- the name space manager informs the server manager to reassign the data chunk to the new class identifier (15).
- FIG. 6 is a block diagram that illustrates a computer system 600 upon which an embodiment of the invention may be implemented.
- Computer system 600 includes a bus 602 or other communication mechanism for communicating information, and a processor 604 coupled with bus 602 for processing information.
- Computer system 600 also includes a main memory 606, such as a random access memory (RAM) or other dynamic storage device, coupled to bus 602 for storing information and instructions to be executed by processor 604. Main memory 606 also may be used for storing temporary variables or other intermediate information during execution of instructions to be executed by processor 604. Computer system 600 further includes a read only memory (ROM) 608 or other static storage device coupled to bus 602 for storing static information and instructions for processor 604. A storage device 610, such as a magnetic disk or optical disk, is provided and coupled to bus 602 for storing information and instructions.
- main memory 606 such as a random access memory (RAM) or other dynamic storage device
- Computer system 600 may be coupled via bus 602 to a display 612, such as a cathode ray tube (CRT), for displaying information to a computer user.
- a display 612 such as a cathode ray tube (CRT)
- An input device 614 is coupled to bus 602 for communicating information and command selections to processor 604.
- cursor control 616 is Another type of user input device
- cursor control 616 such as a mouse, a trackball, or cursor direction keys for communicating direction information and command selections to processor 604 and for controlling cursor movement on display 612.
- This input device typically has two degrees of freedom in two axes, a first axis (e.g., x) and a second axis (e.g , y), that allows the device to specify positions in a plane.
- the invention is related to the use of computer system 600 for implementing the techniques described herein. According to one embodiment of the invention, those techniques are performed by computer system 600 in response to processor 604 executing one or more sequences of one or more instructions contained in main memory 606. Such instructions may be read into main memory 606 from another machine-readable medium, such as storage device 610. Execution of the sequences of instructions contained in main memory 606 causes processor 604 to perform the process steps described herein. In alternative embodiments, hard-wired circuitry may be used in place of or in combination with software instructions to implement the invention Thus, embodiments of the invention are not limited to any specific combination of hardware circuitry and software.
- machine -readable medium refers to any medium that participates in providing data that causes a machine to operation in a specific fashion.
- various machine-readable media are involved, for example, in providing instructions to processor 604 for execution.
- Such a medium may take many forms, including but not limited to storage media and transmission media.
- Storage media includes both non-volatile media and volatile media.
- Non- volatile media includes, for example, optical or magnetic disks, such as storage device 610.
- Volatile media includes dynamic memory, such as main memory 606.
- Transmission media includes coaxial cables, copper wire and fiber optics, including the wires that comprise bus 602.
- Transmission media can also take the form of acoustic or light waves, such as those generated during radio-wave and infra-red data communications. All such media must be tangible to enable the instructions carried by the media to be detected by a physical mechanism that reads the instructions into a machine.
- Machine-readable media include, for example, a floppy disk, a flexible disk, hard disk, magnetic tape, or any other magnetic medium, a CD-ROM, any other optical medium, punch cards, paper tape, any other physical medium with patterns of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, any other memory chip or cartridge, a carrier wave as described hereinafter, or any other medium from which a computer can read.
- Various forms of machine-readable media may be involved in carrying one or more sequences of one or more instructions to processor 604 for execution. For example, the instructions may initially be carried on a magnetic disk of a remote computer.
- the remote computer can load the instructions into its dynamic memory and send the instructions over a telephone line using a modem.
- a modem local to computer system 600 can receive the data on the telephone line and use an infra-red transmitter to convert the data to an infra-red signal.
- An infra-red detector can receive the data carried in the infra-red signal and appropriate circuitry can place the data on bus 602.
- Bus 602 carries the data to main memory 606, from which processor 604 retrieves and executes the instructions.
- the instructions received by main memory 606 may optionally be stored on storage device 610 either before or after execution by processor 604.
- Computer system 600 also includes a communication interface 618 coupled to bus 602.
- Communication interface 618 provides a two-way data communication coupling to a network link 620 that is connected to a local network 622.
- communication interface 618 may be an integrated services digital network (ISDN) card or a modem to provide a data communication connection to a corresponding type of telephone line.
- ISDN integrated services digital network
- communication interface 618 may be a local area network (LAN) card to provide a data communication connection to a compatible LAN.
- LAN local area network
- Wireless links may also be implemented.
- communication interface 618 sends and receives electrical, electromagnetic or optical signals that carry digital data streams representing various types of information.
- Network link 620 typically provides data communication through one or more networks to other data devices.
- network link 620 may provide a connection through local network 622 to a host computer 624 or to data equipment operated by an Internet Service Provider (ISP) 626.
- ISP 626 in turn provides data communication services through the world wide packet data communication network now commonly referred to as the '"Internet" 628.
- Local network 622 and Internet 628 both use electrical, electromagnetic or optical signals that carry digital data streams.
- the signals through the various networks and the signals on network link 620 and through communication interface 618, which carry the digital data to and from computer system 600, are exemplary forms of carrier waves transporting the information.
- Computer system 600 can send messages and receive data, including program code, through the network(s), network link 620 and communication interface 618.
- a server 630 might transmit a requested code for an application program through Internet 628, ISP 626, local network 622 and communication interface 618.
- the received code may be executed by processor 604 as it is received, and/or stored in storage device 610, or other non- volatile storage for later execution. In this manner, computer system 600 may obtain application code in the form of a carrier wave.
Abstract
A data processing apparatus, comprising a metadata store storing information about files that are stored in a distributed data storage system, and comprising a class database; one or more processing units; logic configured for receiving and storing in the class database a definition of a class of data storage servers comprising one or more subclasses each comprising one or more server selection criteria; associating the class with one or more directories of the data storage system; in response to a data client storing a data file in a directory, binding the class to the data file, determining and storing a set of identifiers of one or more data storage servers in the system that match the server selection criteria, and providing the set of identifiers to the data client.
Description
DIRECTED PLACEMENT OF DATA IN A REDUNDANT DATA STORAGE SYSTEM
DIRECTED PLACEMENT OF DATA IN A REDUNDANT DATA STORAGE SYSTEM
TECHNICAL FIELD [0001] The present disclosure generally relates to computer data storage.
BACKGROUND
[0002] The approaches described in this section could be pursued, but are not necessarily approaches that have been previously conceived or pursued. Therefore, unless otherwise indicated herein, the approaches described in this section are not prior art to the claims in this application and are not admitted to be prior art by inclusion in this section. [0003] In a distributed data storage system, where particular data is stored may affect data retrieval time, especially in systems that deliver real-time data such as video data. US Patent Publication 2007-0214183-A1 describes a distributed data storage system that can place redundant data images by globally optimizing the availability selection criteria over all servers. Distributed data storage also may be implemented using RAID (Redundant Array of Inexpensive Drives), NAS (Network Attached Storage), and SAN (Storage Area Network). Examples of distributed filesystems include the HP Lustre File System, SGI Clustered Extensible File System (CXFS), Veritas File System (VxFS), Google File System (GFS), Omneon Extended File System (EFS), Oracle Cluster File System (OCFS), and the Hadoop Distributed File System (HDFS). Distributed hardware systems include Isilon, Panasas, Avid ISIS.
BRIEF DESCRIPTION OF THE DRAWINGS [0004] In the drawings:
[0005] FIG. 1 shows a system manager client of a metadata server of a distributed storage system and a sequence of steps that may be taken, in one embodiment, to add a new server class attribute and define a new class
[0006] FIG. 2 shows a data client of a distributed storage system and an example sequence of steps taken to write data to a file in a specific class.
[0007] FIG. 3 shows a system manager client of a metadata server of a distributed storage system and an example sequence of steps taken to update an existing class. [0008] FIG. 4 shows a system manager client re-associating a file to a new or different class.
S).
[0009] FIG. 5A illustrates logical relationships of a file, class, subclasses, and data servers.
[0010] FIG. 5B illustrates an example server property database.
[0011] FIG. 6 illustrates a computer system upon which an embodiment may be implemented.
DETAILED DESCRIPTION
[0012] In the following description, for the purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the present invention. It will be apparent, however, to one skilled in the art that the present invention may be practiced without these specific details. In other instances, well-known structures and devices are shown in block diagram form in order to avoid unnecessarily obscuring the present invention. [0013] Embodiments are described herein according to the following outline:
1.0 General Overview
2.0 Structural and Functional Overview
3.0 Implementation Mechanisms — Hardware Overview
4.0 Extensions and Alternatives
[0014] 1.0 GENERAL OVERVIEW
[0015] In an embodiment, a data processing apparatus comprises a metadata store storing information about files that are stored in a distributed data storage system, and comprising a class database; one or more processing units; logic configured for receiving and storing in the class database a definition of a class of data storage servers comprising one or more subclasses each comprising one or more server selection criteria; associating the class with one or more directories of the data storage system; in response to a data client storing a data file in a directory, binding the class to the data file, determining and storing a set of identifiers of one or more data storage servers in the system that match the server selection criteria, and providing the set of identifiers to the data client.
[0016] In other embodiments, the invention encompasses a computer-implemented method and a computer-readable medium configured to carry out the foregoing steps. [0017] In an embodiment, a replication framework is provided to control the placement and migration of file data within a distributed storage system. Control over data placement is useful to leverage differences in servers in a heterogeneous server cluster supporting a distributed file system. Control over data placement also allows files to expand within
specific server partitions. Control over data placement also can help localize file repair within a redundant data fabric.
[0018] Although certain embodiments are described in the context of storing data files, the techniques in this disclosure also can be applied to the placement of distributed applications among intelligent storage elements of a distributed storage system. [0019] 2.0 STRUCTURAL AND FUNCTIONAL OVERVIEW [0020] FIG. 1 shows a system manager client 102 of a metadata server 1 of a distributed storage system and a sequence of steps that may be taken, in one embodiment, to add a new server class attribute and define a new class. In an embodiment, files are associated with classes of specific servers. The association of files to server classes provides a means for controlling the placement of data images within the cluster to specific server partitions. In an embodiment, a class is a set of servers that satisfy a set of server properties. For example, a class could be defined as all of the high performance servers within a cluster that are also connected to the highest bandwidth network switches. Any number of properties having any degree of complexity may define a class.
[0021] FIG. 5A illustrates logical relationships of a file, class, subclasses, and data servers. A file 502 is associated by stored information in the metadata server 1 with a class 504. The class 504 is defined by one or more subclasses 505 A, 505N. Any number of subclasses may be used. Collectively the class 504 and its subclasses 505A, 5O5N define a set 506 of servers that match the class. A client of the system of FIG. 1 can define the structure of FIG. 5A, and consequently the client can influence where the file 502 is stored by restricting storage to servers that are in the set 506 as determined by the class 504 and its subclasses.
[0022] In an embodiment, each class 504 is represented by a name and a class identifier. Each subclass is represented by server selection criteria, such as a database view command string, a list of servers currently matching the criteria and equivalent to set 506, and an optional representation count that can be used to determine a replication factor for data images mapped to the class, and a logical class identifier. The name, server selection criteria, and class identifier are shared as global state values among redundant metadata servers. For example, the metadata servers described in the system of US Patent Publication 2007- 0214183-A1 may be used. Alternatively, an embodiment may use the Omneon MediaGrid storage system, commercially available from Omneon, Inc., Sunnyvale, California. [0023] Classes may overlap. In an embodiment, a '"share/no-share" property of a class indicates whether the class may overlap with others.
[0024] In an embodiment, a server property database 110 is maintained on each metadata server 1 in a distributed storage system. In the database 110, rows represent servers that are class members, and columns represent server properties. FIG. 5B illustrates an example server property database 110 in which column 510 identifiers servers, each of which is associated with a row, and columns 512, 514, 516, 518, 520 store properties of the server for the associated row. Any number of rows and columns may be represented in database 110. During startup, the database 110 is initialized by storing read-only system level properties for each available server in the columns 514, 516, 518, 520. Example system-level properties include serial number, network topology location, processor speed, and number of processor cores, as seen in FIG. 5B, but any properties may be used.
[0025] In an embodiment, the database 110 applies a sequence of commands, which are journaled on the metadata server, to make the database current and consistent with databases on other metadata servers controlling the server cluster. A transient list of abstract read/write server properties (e.g., server owner, repair priority) may be assigned to servers over time. [0026] In an embodiment, all data of the file 502 is mapped to one class 504. The metadata stored in metadata server 1 for each replicated data image of a file contains the logical class identifier, thereby binding the location of file data to a particular class of servers. The metadata may be stored in local data storage of the metadata server 1, which is replicated to and synchronized with metadata data storage in all other metadata servers in the system. If a server change results in a repair to the data storage fabric, data is moved to other servers so that all file data remains in servers of the class to which the data is bound. As classes are redefined, or as files are moved between classes, the set of servers housing each data image for a file is reformed relative to the class. All such data movement is done local to the cluster, and does not require data movement between a client utility and the cluster servers. [0027] In an embodiment, a nonzero representation count in a subclass 505A indicates the minimum number of servers from that subclass that must be represented in a replica set. Thus, a request to store data may indicate, using a nonzero representation count for a subclass 505A, an enforced replication factor for any file 502 mapped to that subclass 505 A. [0028] Subclasses 505 A, 5O5N may affect data replication in a redundant data fabric as follows. When a class 504 consists of subclasses 505 A, 505N all having a zero representation count, then the replication factor for data images mapped to that class is obtained from an inherited file property, such as replication factor 508 of namespace properties 509 as seen in FIG. 5A. Otherwise, the effective data image replication factor is the sum of all subclass representation counts; moreover, in this latter case, any subclass with a zero representation count is ignored during sequence generation and data fabric repair.
Furthermore, the replication factor for a file can be individually modified only when the sum of all subclass representation counts of the associated class is zero.
[0029] The metadata servers use a message-based control path for communications to intelligent storage elements to collect dynamic storage availability statistics. The metadata servers calculate the availability of the data fabric with respect to each class.
[0030] As a result, clients of the storage system can specify where the data for a file is to be located within a potentially huge cluster of commodity servers by binding the file to a class identifier. Thus, using embodiments, control of placement of replicated data images in a redundant data fabric is provided on a per-file basis. This additional control enables users to further optimize access of data in distributed file system according to dynamic business needs.
[0031] With embodiments, clients of a distributed file system have control over how data is placed and maintained. Previous approaches using metadata servers generally have placed redundant data images on data servers by globally optimizing the availability selection criteria over all servers. With the embodiments herein, data placement and the use of optimized availability selection criteria can be applied locally to specific sets of servers. By binding each data image to a class, files can be placed on specific sets of servers as the files are written, or as the data fabric is repaired.
[0032] Some previous approaches have partitioned servers into static groups, typically aligned along power distribution boundaries, and replication has sought to distribute images globally by striding them over groups. The present approach complements static group striding methods. In particular, when classes overlay multiple groups, distribution is biased so that images are distributed over all groups in the overlay.
[0033] Using the techniques herein, client control of data placement enables a wide variety new uses for such a file system, including hierarchical data management and data access staging. For example, a video file in a class consisting of a few large capacity servers may be reassigned to a class consisting of many high performing servers configured only with RAM disks, just prior to performing transcoding or just prior to playing the file in a video network.
[0034] Embodiments also enable the development of intelligent cluster manager applications to monitor and control a cluster on a class basis without having to copy data in and out of the cluster. For example, a manager application can monitor file class assignments and re-assign files that have not been accessed recently to classes in order to maintain a specific amount of free space in frequently accessed classes. The manager application also could reassign additional servers to non overlapping classes that are nearly full.
[0035] 2.1 ADDING A SERVER CLASS ATTRIBUTE AND DEFINING A CLASS [0036] FIG. 1 further shows a sequence of steps that may be taken, in one embodiment, to add a new server class attribute and define a new class.
[0037] In an embodiment, a system manager 102 is coupled to a metadata server 1. The system manager 102 is a client of the metadata server 1. In various embodiments, there may be any number of metadata servers. For example, the architecture of US Patent Publication 2007-0214183-A1 may be used. Each metadata server 1 may be implemented using a general purpose computer system as shown in FIG. 6 in which the memory or local data storage stores program instructions or other software elements that implement the functions described herein. For example, metadata server 1 may comprise logic that implements a name space manager 104, class manager 106, server manager 108, and class database 110. [0038] First the client makes a remote procedure request (10) to assign a class attribute to a set of servers. For example, the commands attribute = "owner=demo" servers = { server l-server30} assign the owner attribute to "demo" to servers identified using identifier values serverl through server30. The class manager 106 journals state data, and updates the class database 110. The attribute and server set are passed to other metadata servers (16). For example, the techniques to share data on a redundant metadata server ring described in U.S. Pat. No. 6,665,675 Bl may be used.
[0039] System manager 102 as client makes a remote procedure request (20) to define a new class by specifying the class name and set of subclass strings. For example, system manager 102 sends the following request: name = "fastServerClass" subclassl = (processorSpeed=3GHz && "owner = demo" && "location=labRoom 1 )(representationCount=2) subclass2 = (processorSpeed=3GHz && "owner = demo" &&
"location=labRoom2)(representationCount=2)
[0040] The example request indicates that servers associated with a class named "fastServerClass" comprise all 3GHz servers in labl and Iab2 that have been allocated for the owner "demo". In response to the request, class manager 106 uses the subclass criteria to identify a set of servers that satisfy the attribute criteria. Class manager 106 then sends the server set to the server manager 108 at (26). Subclasses may identify any desired criteria,
such as processor speed, number of CPUs or CPU cores, the speed of a switch to which a server is coupled, location, read latency, write latency, etc.
[0041] The representation count values may be different in different subclasses. Thus, while the representation count is "2" in both subclasses of the example above, other embodiments may use different counts in different subclasses. Use of representation counts enables clients to indirectly specify, for example, that a file must have high availability. For example, high representation count values will result in storing the file with a high replication factor, so that the file can be delivered to more clients concurrently.
[0042] In response, the server manager 108 assigns a new class identifier for the servers and shares this identifier with all other server manager instances of other metadata servers 1 among the redundant metadata servers 112 at (27). The server manager 108 returns the class identifier to the class manager at (22).
[0043] In response, the class manager 106 updates the class database 110 at (28) and returns the class identifier to the system manager 102 at (29). Because the representation count values are "2," all subsequent file data associated with the class identifier will be replicated twice among the 3GHz servers owned by "demo" in labl and twice among the
3GHz servers owned by "demo" in Iab2.
[0044] 2.2 WRITING DATA TO A FILE IN A CLASS
[0045] In an embodiment, when a file is to be stored and the file has an association to a class, availability selection criteria is used to locate the best available servers in the class to house the data for the file. When the members of a class change, or when the association of a file is changed to a different class, all data for the affected files are re -replicated using only that part of the cluster that contains servers in the class.
[0046] FIG. 2 shows a data client of a distributed storage system and an example sequence of steps that may be performed to write data to a file in a specific class.
[0047] Since servers supporting a massively distributed file system may simultaneously host parallel applications, the methods described herein can be used to control placement of applications executing within the cluster. Thus, the term "file" as used herein includes data files, application files including executables, and all other data that can be stored in a storage system.
[0048] In an embodiment, a data client 202 is coupled to the metadata server 1 and creates a file in a directory (10). The name space manager 104 assigns a class identifier for the directory to the file as an inherited property. The name space manager 104 sends a path name and class identifier to the class manager to bind the file to the class for subsequent
reverse lookup files by class (11). The name space manager 104 returns a handle to the client
(15).
[0049] The data client 202, which is unaware of any class definition, requests the network addresses of a set of servers to write to (20). The name space manager 104 requests (21) the server manager 108 for the "optimal" servers in the class for writes. Based on best availability criteria applied locally to the server members in the class, the server manager 108 returns the addresses and the replication factor to the client (22). The replication factor is determined by summing the representation counts for all subclasses.
[0050] Continuing the example above, at (30) the data client 202 sends data to a first data server 13 with instructions for storing and forwarding onto the other servers in the sequence.
In response, the first data server 13, a second data server 15, and a third data server 18 each perform copy/forward operations, resulting in storing and forwarding data three more times
(31, 32, 33).
[0051] 2.3 UPDATING A CLASS
[0052] FIG. 3 shows a system manager client of a metadata server of a distributed storage system and an example sequence of steps taken to update an existing class. In FIG. 3, a system manager 102 is coupled to metadata server 1 as in FIG. 1. FIG. 3 also illustrates a first class comprising data servers 11, 12. 13, 14, 15, 16, 17, 18, 19, IA, IB, 1C, and a second or updated class comprising different data servers 21, 22, 23, 24, 25. 26, 27, 28, 29, 2A. 2B,
2C, 2D, 2E.
[0053] For example, assume that a user desires to replace "labl'' with "Iab3'' in the representation of "fastServerClass" set forth above.
[0054] The system manager 102 acting as client makes a remote procedure request to update the subclass database string (10). In response, class manager 106 updates the class database locally, and updates other metadata servers 1 among the redundant metadata servers
112 (FIG. 1) with the new database string. In response, the server manager instances on all the metadata servers associate a new server set for the specific class as in FIG. 1.
[0055] The name space manager 104 performs a reverse lookup and reads the list of paths associated with the specific class. For each data chunk of each file, the name space manager
104 requests the server manager 108 to re-replicate the associated data images for the updated class (15). For each data chunk, the server manager 108 calculates the best available server set in the updated class and requests each server holding a specific data image (20, 30, 40, 50) to move the data in parallel to the optimally available server set for the updated class (21, 31,
41, 51).
[0056] If the updated class reflects a higher replication factor than before, then data movement from one to multiple servers is implied, and is performed. Because the server manager 108 maintains a broad view of server availability, some of the servers holding the original data image may be too busy to move data. In this case, the movement is done with a subset of servers (e.g., data server 13 and 17). As data movement completes, the server manager 108 updates the location of the data images on the metadata server 1 The data client 202 (FIG. 2) may receive an asynchronous event notification, or may poll the metadata server 1 to determine whether data movement is complete (60).
[0057] In an embodiment, data movement is contingent on available space in the updated class. If the servers in the updated class do not have available space, the metadata server will retry failed replications as the space dynamic parameters collected from each server in the class change over time.
[0058] 2.4 ASSOCIATING A FILE TO A DIFFERENT CLASS [0059] FIG. 4 shows a system manager client re-associating a file to a new or different class. A file may be re-associated with a new class or a different class for several reasons For example, as the number of read accesses for a video file increases, the value of that file within a data storage cluster increases. By reassigning a frequently requested file to a class consisting of servers with fast central processing units and network interfaces, the cluster is able to service read requests so that the video is played out on more clients. If that class also has a higher representation count, then more copies of the file are distributed and maintained within the cluster, which also makes the file more available for clients reading it. [0060] Reassigning the file to a new class can be performed as the file is being accessed. For purposes of this disclosure, the terms "re-associating" and "reassigning" are equivalent [0061] In an embodiment, system manager client 102 makes a remote procedure request to the namespace manager 104 to update the file attributes containing a new class identifier (10) The name space manager validates the new class with the class manager (11, 12). [0062] For each data chunk associated with the file, the name space manager informs the server manager to reassign the data chunk to the new class identifier (15). For each data chunk, the server manager calculates the best available server set in the new class and requests each server holding a specific data image (20, 40) in the old class with an implied replication factor of 2, to move the data (in parallel) to an optimally available sener set for the new class (21, 22, 41, 42) with a higher implied replication factor of 4, as shown just above Data Server 21.
[0063] 3.0 IMPLEMENTATION MECHANISMS -- HARDWARE OVERVIEW [0064] FIG. 6 is a block diagram that illustrates a computer system 600 upon which an embodiment of the invention may be implemented. Computer system 600 includes a bus 602 or other communication mechanism for communicating information, and a processor 604 coupled with bus 602 for processing information. Computer system 600 also includes a main memory 606, such as a random access memory (RAM) or other dynamic storage device, coupled to bus 602 for storing information and instructions to be executed by processor 604. Main memory 606 also may be used for storing temporary variables or other intermediate information during execution of instructions to be executed by processor 604. Computer system 600 further includes a read only memory (ROM) 608 or other static storage device coupled to bus 602 for storing static information and instructions for processor 604. A storage device 610, such as a magnetic disk or optical disk, is provided and coupled to bus 602 for storing information and instructions.
[0065] Computer system 600 may be coupled via bus 602 to a display 612, such as a cathode ray tube (CRT), for displaying information to a computer user. An input device 614, including alphanumeric and other keys, is coupled to bus 602 for communicating information and command selections to processor 604. Another type of user input device is cursor control 616, such as a mouse, a trackball, or cursor direction keys for communicating direction information and command selections to processor 604 and for controlling cursor movement on display 612. This input device typically has two degrees of freedom in two axes, a first axis (e.g., x) and a second axis (e.g , y), that allows the device to specify positions in a plane. [0066] The invention is related to the use of computer system 600 for implementing the techniques described herein. According to one embodiment of the invention, those techniques are performed by computer system 600 in response to processor 604 executing one or more sequences of one or more instructions contained in main memory 606. Such instructions may be read into main memory 606 from another machine-readable medium, such as storage device 610. Execution of the sequences of instructions contained in main memory 606 causes processor 604 to perform the process steps described herein. In alternative embodiments, hard-wired circuitry may be used in place of or in combination with software instructions to implement the invention Thus, embodiments of the invention are not limited to any specific combination of hardware circuitry and software. [0067] The term "machine -readable medium" as used herein refers to any medium that participates in providing data that causes a machine to operation in a specific fashion. In an embodiment implemented using computer system 600, various machine-readable media are involved, for example, in providing instructions to processor 604 for execution. Such a
medium may take many forms, including but not limited to storage media and transmission media. Storage media includes both non-volatile media and volatile media. Non- volatile media includes, for example, optical or magnetic disks, such as storage device 610. Volatile media includes dynamic memory, such as main memory 606. Transmission media includes coaxial cables, copper wire and fiber optics, including the wires that comprise bus 602. Transmission media can also take the form of acoustic or light waves, such as those generated during radio-wave and infra-red data communications. All such media must be tangible to enable the instructions carried by the media to be detected by a physical mechanism that reads the instructions into a machine.
[0068] Common forms of machine-readable media include, for example, a floppy disk, a flexible disk, hard disk, magnetic tape, or any other magnetic medium, a CD-ROM, any other optical medium, punch cards, paper tape, any other physical medium with patterns of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, any other memory chip or cartridge, a carrier wave as described hereinafter, or any other medium from which a computer can read. [0069] Various forms of machine-readable media may be involved in carrying one or more sequences of one or more instructions to processor 604 for execution. For example, the instructions may initially be carried on a magnetic disk of a remote computer. The remote computer can load the instructions into its dynamic memory and send the instructions over a telephone line using a modem. A modem local to computer system 600 can receive the data on the telephone line and use an infra-red transmitter to convert the data to an infra-red signal. An infra-red detector can receive the data carried in the infra-red signal and appropriate circuitry can place the data on bus 602. Bus 602 carries the data to main memory 606, from which processor 604 retrieves and executes the instructions. The instructions received by main memory 606 may optionally be stored on storage device 610 either before or after execution by processor 604.
[0070] Computer system 600 also includes a communication interface 618 coupled to bus 602. Communication interface 618 provides a two-way data communication coupling to a network link 620 that is connected to a local network 622. For example, communication interface 618 may be an integrated services digital network (ISDN) card or a modem to provide a data communication connection to a corresponding type of telephone line. As another example, communication interface 618 may be a local area network (LAN) card to provide a data communication connection to a compatible LAN. Wireless links may also be implemented. In any such implementation, communication interface 618 sends and receives electrical, electromagnetic or optical signals that carry digital data streams representing various types of information.
[0071] Network link 620 typically provides data communication through one or more networks to other data devices. For example, network link 620 may provide a connection through local network 622 to a host computer 624 or to data equipment operated by an Internet Service Provider (ISP) 626. ISP 626 in turn provides data communication services through the world wide packet data communication network now commonly referred to as the '"Internet" 628. Local network 622 and Internet 628 both use electrical, electromagnetic or optical signals that carry digital data streams. The signals through the various networks and the signals on network link 620 and through communication interface 618, which carry the digital data to and from computer system 600, are exemplary forms of carrier waves transporting the information.
[0072] Computer system 600 can send messages and receive data, including program code, through the network(s), network link 620 and communication interface 618. In the Internet example, a server 630 might transmit a requested code for an application program through Internet 628, ISP 626, local network 622 and communication interface 618. [0073] The received code may be executed by processor 604 as it is received, and/or stored in storage device 610, or other non- volatile storage for later execution. In this manner, computer system 600 may obtain application code in the form of a carrier wave. [0074] 4.0 EXTENSIONS AND ALTERNATIVES
[0075] In the foregoing specification, embodiments of the invention have been described with reference to numerous specific details that may vary from implementation to implementation. Thus, the sole and exclusive indicator of what is the invention, and is intended by the applicants to be the invention, is the set of claims that issue from this application, in the specific form in which such claims issue, including any subsequent correction. Any definitions expressly set forth herein for terms contained in such claims shall govern the meaning of such terms as used in the claims. Hence, no limitation, element, property, feature, advantage or attribute that is not expressly recited in a claim should limit the scope of such claim in any way. The specification and drawings are, accordingly, to be regarded in an illustrative rather than a restrictive sense.
Claims
1. A data processing apparatus, comprising: a metadata store storing information about files that are stored in a distributed data storage system, and comprising a class database; one or more processing units; logic coupled to the processing unit(s) and to the metadata store and comprising stored sequences of instructions which, when executed by the processing unit(s), cause: receiving and storing in the class database a definition of a class of data storage servers comprising one or more subclasses each comprising one or more server selection criteria; associating the class with one or more directories of the data storage system; in response to a data client storing a data file in a directory, binding the class to the data file, determining and storing a set of identifiers of one or more data storage servers in the system that match the server selection criteria, and providing the set of identifiers to the data client.
2. The apparatus of claim 1, further comprising sequences of instructions which, when executed by the processing unit(s), cause receiving a representation count in the definition of the one or more subclasses, determining a replication factor for the data file based on a sum of the representation counts, and storing a plurality of replicas of the data file in the data storage servers according to the replication factor.
3. The apparatus of claim 1, further comprising sequences of instructions which, when executed by the processing unit(s), cause receiving a representation count of zero in the definition of the one or more subclasses, determining a replication factor for the data file based on a replication factor property of the data file that is inherited from a directory in which the data file was created, and storing a plurality of replicas of the data file in the data storage servers according to the replication factor.
4. The apparatus of claim 1, further comprising sequences of instructions which, when executed by the processing unit(s), cause determining and storing the set of identifiers based further on one or more best availability criteria that are applied only to the data storage servers in the system that match the server selection criteria.
5. The apparatus of claim 1, wherein the server selection criteria comprise processor speed, owner and location.
6. The apparatus of claim 1, further comprising sequences of instructions which, when executed by the processing unit(s), cause automatically storing the data file only on one or more first data storage servers that are identified in the set of identifiers.
7. The apparatus of claim 6, further comprising sequences of instructions which, when executed by the processing unit(s), cause: receiving an updated definition of one or more of the subclasses comprising one or more updated server selection criteria; based on the updated definition, determining and storing an updated set of identifiers of one or more different data storage servers in the system that match the updated server selection criteria; causing automatically storing the data file only on one or more second data storage servers that are identified in the updated set of identifiers.
8. The apparatus of claim 1, further comprising sequences of instructions which, when executed by the processing unit(s), cause: receiving a representation count in the definition of the one or more subclasses, determining a first replication factor for the data file based on a sum of the representation counts, and storing a plurality of replicas of the data file in the data storage servers according to the first replication factor; receiving an updated definition of one or more of the subclasses comprising one or more updated server selection criteria; based on the updated definition, determining and storing an updated set of identifiers of one or more different data storage servers in the system that match the updated server selection criteria, and determining a second replication factor for the data file based on a sum of the representation counts in the updated definition; storing the data file only on one or more second data storage servers that are identified in the updated set of identifiers, in a plurality of replicas according to the second replication factor.
9. The apparatus of claim 1, further comprising sequences of instructions which, when executed by the processing unit(s), cause: receiving an updated file attribute for the data file that comprises an updated class identifier; determining and storing an updated set of identifiers of one or more different data storage servers in the system that match the server selection criteria of the one or more subclasses of the class of the updated class identifier; storing the data file only on one or more second data storage servers that are identified in the updated set of identifiers.
10. The apparatus of claim 9, further comprising sequences of instructions which, when executed by the processing unit(s), cause: determining a replication factor for the data file based on a sum of representation counts of the one or more subclasses of the updated class identifier; storing the data file only on the second data storage servers that are identified in the updated set of identifiers, in a plurality of replicas according to the replication factor.
11. A computer-readable data storage medium comprising stored sequences of instructions which, when executed by one or more processing unit(s), cause: receiving and storing, in a class database in a metadata store storing information about files that are stored in a distributed data storage system, a definition of a class of data storage servers comprising one or more subclasses each comprising one or more server selection criteria; associating the class with one or more directories of the data storage system; in response to a data client storing a data file in a directory, binding the class to the data file, determining and storing a set of identifiers of one or more data storage servers in the system that match the server selection criteria, and providing the set of identifiers to the data client.
12. The storage medium of claim 10, further comprising sequences of instructions which, when executed by the processing unit(s), cause receiving a representation count in the definition of the one or more subclasses, determining a replication factor for the data file based on a sum of the representation counts, and storing a plurality of replicas of the data file in the data storage servers according to the replication factor.
13. The storage medium of claim 10, further comprising sequences of instructions which, when executed by the processing unit(s), cause receiving a representation count of zero in the definition of the one or more subclasses, determining a replication factor for the data file based on a replication factor property of the data file that is inherited from a directory in which the data file was created, and storing a plurality of replicas of the data file in the data storage servers according to the replication factor.
14. The storage medium of claim 10, further comprising sequences of instructions which, when executed by the processing unit(s), cause determining and storing the set of identifiers based further on one or more best availability criteria that are applied only to the data storage servers in the system that match the server selection criteria.
15. The storage medium of claim 10, wherein the server selection criteria comprise processor speed, owner and location.
16. The storage medium of claim 10, further comprising sequences of instructions which, when executed by the processing unit(s), cause automatically storing the data file only on one or more first data storage servers that are identified in the set of identifiers.
17. The storage medium of claim 10, further comprising sequences of instructions which, when executed by the processing unit(s), cause: receiving an updated definition of one or more of the subclasses comprising one or more updated server selection criteria; based on the updated definition, determining and storing an updated set of identifiers of one or more different data storage servers in the system that match the updated server selection criteria; causing automatically storing the data file only on one or more second data storage servers that are identified in the updated set of identifiers.
18. The storage medium of claim 10, further comprising sequences of instructions which, when executed by the processing unit(s), cause: receiving a representation count in the definition of the one or more subclasses, determining a first replication factor for the data file based on a sum of the representation counts, and storing a plurality of replicas of the data file in the data storage servers according to the first replication factor; receiving an updated definition of one or more of the subclasses comprising one or more updated server selection criteria; based on the updated definition, determining and storing an updated set of identifiers of one or more different data storage servers in the system that match the updated server selection criteria, and determining a second replication factor for the data file based on a sum of the representation counts in the updated definition; storing the data file only on one or more second data storage servers that are identified in the updated set of identifiers, in a plurality of replicas according to the second replication factor.
19. The storage medium of claim 10, further comprising sequences of instructions which, when executed by the processing unit(s), cause: receiving an updated file attribute for the data file that comprises an updated class identifier; determining and storing an updated set of identifiers of one or more different data storage servers in the system that match the server selection criteria of the one or more subclasses of the class of the updated class identifier; storing the data file only on one or more second data storage servers that are identified in the updated set of identifiers.
20. The storage medium of claim 19, further comprising sequences of instructions which, when executed by the processing unit(s), cause: determining a replication factor for the data file based on a sum of representation counts of the one or more subclasses of the updated class identifier; storing the data file only on the second data storage servers that are identified in the updated set of identifiers, in a plurality of replicas according to the replication factor.
21. A computer-implemented method, comprising: receiving and storing, in a class database in a metadata store storing information about files that are stored in a distributed data storage system, a definition of a class of data storage servers comprising one or more subclasses each comprising one or more server selection criteria; associating the class with one or more directories of the data storage system; in response to a data client storing a data file in a directory, binding the class to the data file, determining and storing a set of identifiers of one or more data storage servers in the system that match the server selection criteria, and providing the set of identifiers to the data client.
22. The method of claim 21, further comprising receiving a representation count in the definition of the one or more subclasses, determining a replication factor for the data file based on a sum of the representation counts, and storing a plurality of replicas of the data file in the data storage servers according to the replication factor.
23. The method of claim 21, further comprising receiving a representation count of zero in the definition of the one or more subclasses, determining a replication factor for the data file based on a replication factor property of the data file that is inherited from a directory in which the data file was created, and storing a plurality of replicas of the data file in the data storage servers according to the replication factor.
24. The method of claim 21, further comprising determining and storing the set of identifiers based further on one or more best availability criteria that are applied only to the data storage servers in the system that match the server selection criteria.
25. The method of claim 21, further comprising automatically storing the data file only on one or more first data storage servers that are identified in the set of identifiers.
26. The method of claim 25, further comprising: receiving an updated definition of one or more of the subclasses comprising one or more updated server selection criteria; based on the updated definition, determining and storing an updated set of identifiers of one or more different data storage servers in the system that match the updated server selection criteria; causing automatically storing the data file only on one or more second data storage servers that are identified in the updated set of identifiers.
27. The method of claim 21, further comprising: receiving a representation count in the definition of the one or more subclasses, determining a first replication factor for the data file based on a sum of the representation counts, and storing a plurality of replicas of the data file in the data storage servers according to the first replication factor; receiving an updated definition of one or more of the subclasses comprising one or more updated server selection criteria; based on the updated definition, determining and storing an updated set of identifiers of one or more different data storage servers in the system that match the updated server selection criteria, and determining a second replication factor for the data file based on a sum of the representation counts in the updated definition; storing the data file only on one or more second data storage servers that are identified in the updated set of identifiers, in a plurality of replicas according to the second replication factor.
28. The method of claim 21, further comprising: receiving an updated file attribute for the data file that comprises an updated class identifier; determining and storing an updated set of identifiers of one or more different data storage servers in the system that match the server selection criteria of the one or more subclasses of the class of the updated class identifier; storing the data file only on one or more second data storage servers that are identified in the updated set of identifiers.
29. The method of claim 28, further comprising: determining a replication factor for the data file based on a sum of representation counts of the one or more subclasses of the updated class identifier; storing the data file only on the second data storage servers that are identified in the updated set of identifiers, in a plurality of replicas according to the replication factor.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2011504164A JP5411250B2 (en) | 2008-04-09 | 2009-04-09 | Data placement according to instructions to redundant data storage system |
EP09731450A EP2288998A2 (en) | 2008-04-09 | 2009-04-09 | Directed placement of data in a redundant data storage system |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/100,302 | 2008-04-09 | ||
US12/100,302 US8103628B2 (en) | 2008-04-09 | 2008-04-09 | Directed placement of data in a redundant data storage system |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2009126771A2 true WO2009126771A2 (en) | 2009-10-15 |
WO2009126771A3 WO2009126771A3 (en) | 2009-12-17 |
Family
ID=41162592
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2009/040007 WO2009126771A2 (en) | 2008-04-09 | 2009-04-09 | Directed placement of data in a redundant data storage system |
Country Status (4)
Country | Link |
---|---|
US (2) | US8103628B2 (en) |
EP (1) | EP2288998A2 (en) |
JP (1) | JP5411250B2 (en) |
WO (1) | WO2009126771A2 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2012073777A (en) * | 2010-09-28 | 2012-04-12 | Kddi Corp | Distributed file system control apparatus |
Families Citing this family (71)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070214183A1 (en) * | 2006-03-08 | 2007-09-13 | Omneon Video Networks | Methods for dynamic partitioning of a redundant data fabric |
US8132166B2 (en) | 2007-05-14 | 2012-03-06 | Red Hat, Inc. | Methods and systems for provisioning software |
US8561058B2 (en) | 2007-06-20 | 2013-10-15 | Red Hat, Inc. | Methods and systems for dynamically generating installation configuration files for software |
US8464247B2 (en) | 2007-06-21 | 2013-06-11 | Red Hat, Inc. | Methods and systems for dynamically generating installation configuration files for software |
US8103628B2 (en) * | 2008-04-09 | 2012-01-24 | Harmonic Inc. | Directed placement of data in a redundant data storage system |
US8713177B2 (en) | 2008-05-30 | 2014-04-29 | Red Hat, Inc. | Remote management of networked systems using secure modular platform |
US9100297B2 (en) | 2008-08-20 | 2015-08-04 | Red Hat, Inc. | Registering new machines in a software provisioning environment |
US8930512B2 (en) | 2008-08-21 | 2015-01-06 | Red Hat, Inc. | Providing remote software provisioning to machines |
US8838827B2 (en) * | 2008-08-26 | 2014-09-16 | Red Hat, Inc. | Locating a provisioning server |
US9477570B2 (en) | 2008-08-26 | 2016-10-25 | Red Hat, Inc. | Monitoring software provisioning |
US8793683B2 (en) | 2008-08-28 | 2014-07-29 | Red Hat, Inc. | Importing software distributions in a software provisioning environment |
US9952845B2 (en) | 2008-08-29 | 2018-04-24 | Red Hat, Inc. | Provisioning machines having virtual storage resources |
US8103776B2 (en) | 2008-08-29 | 2012-01-24 | Red Hat, Inc. | Systems and methods for storage allocation in provisioning of virtual machines |
US9164749B2 (en) | 2008-08-29 | 2015-10-20 | Red Hat, Inc. | Differential software provisioning on virtual machines having different configurations |
US8244836B2 (en) | 2008-08-29 | 2012-08-14 | Red Hat, Inc. | Methods and systems for assigning provisioning servers in a software provisioning environment |
US9111118B2 (en) | 2008-08-29 | 2015-08-18 | Red Hat, Inc. | Managing access in a software provisioning environment |
US8527578B2 (en) | 2008-08-29 | 2013-09-03 | Red Hat, Inc. | Methods and systems for centrally managing multiple provisioning servers |
US9021470B2 (en) | 2008-08-29 | 2015-04-28 | Red Hat, Inc. | Software provisioning in multiple network configuration environment |
US8326972B2 (en) | 2008-09-26 | 2012-12-04 | Red Hat, Inc. | Methods and systems for managing network connections in a software provisioning environment |
US8612968B2 (en) | 2008-09-26 | 2013-12-17 | Red Hat, Inc. | Methods and systems for managing network connections associated with provisioning objects in a software provisioning environment |
US20100115472A1 (en) * | 2008-10-30 | 2010-05-06 | Lee Kun-Bin | Method of Facilitating Browsing and Management of Multimedia Files with Data Structure thereof |
US8898305B2 (en) | 2008-11-25 | 2014-11-25 | Red Hat, Inc. | Providing power management services in a software provisioning environment |
US9124497B2 (en) | 2008-11-26 | 2015-09-01 | Red Hat, Inc. | Supporting multiple name servers in a software provisioning environment |
US8782204B2 (en) | 2008-11-28 | 2014-07-15 | Red Hat, Inc. | Monitoring hardware resources in a software provisioning environment |
US8832256B2 (en) | 2008-11-28 | 2014-09-09 | Red Hat, Inc. | Providing a rescue Environment in a software provisioning environment |
US8775578B2 (en) | 2008-11-28 | 2014-07-08 | Red Hat, Inc. | Providing hardware updates in a software environment |
US8402123B2 (en) | 2009-02-24 | 2013-03-19 | Red Hat, Inc. | Systems and methods for inventorying un-provisioned systems in a software provisioning environment |
US9727320B2 (en) | 2009-02-25 | 2017-08-08 | Red Hat, Inc. | Configuration of provisioning servers in virtualized systems |
US8413259B2 (en) | 2009-02-26 | 2013-04-02 | Red Hat, Inc. | Methods and systems for secure gated file deployment associated with provisioning |
US8892700B2 (en) | 2009-02-26 | 2014-11-18 | Red Hat, Inc. | Collecting and altering firmware configurations of target machines in a software provisioning environment |
US20100217944A1 (en) * | 2009-02-26 | 2010-08-26 | Dehaan Michael Paul | Systems and methods for managing configurations of storage devices in a software provisioning environment |
US9411570B2 (en) | 2009-02-27 | 2016-08-09 | Red Hat, Inc. | Integrating software provisioning and configuration management |
US8572587B2 (en) | 2009-02-27 | 2013-10-29 | Red Hat, Inc. | Systems and methods for providing a library of virtual images in a software provisioning environment |
US8640122B2 (en) | 2009-02-27 | 2014-01-28 | Red Hat, Inc. | Systems and methods for abstracting software content management in a software provisioning environment |
US9940208B2 (en) | 2009-02-27 | 2018-04-10 | Red Hat, Inc. | Generating reverse installation file for network restoration |
US9558195B2 (en) | 2009-02-27 | 2017-01-31 | Red Hat, Inc. | Depopulation of user data from network |
US8990368B2 (en) | 2009-02-27 | 2015-03-24 | Red Hat, Inc. | Discovery of network software relationships |
US8667096B2 (en) | 2009-02-27 | 2014-03-04 | Red Hat, Inc. | Automatically generating system restoration order for network recovery |
US8135989B2 (en) | 2009-02-27 | 2012-03-13 | Red Hat, Inc. | Systems and methods for interrogating diagnostic target using remotely loaded image |
US8417926B2 (en) | 2009-03-31 | 2013-04-09 | Red Hat, Inc. | Systems and methods for providing configuration management services from a provisioning server |
US9250672B2 (en) | 2009-05-27 | 2016-02-02 | Red Hat, Inc. | Cloning target machines in a software provisioning environment |
US9134987B2 (en) | 2009-05-29 | 2015-09-15 | Red Hat, Inc. | Retiring target machines by a provisioning server |
US9047155B2 (en) | 2009-06-30 | 2015-06-02 | Red Hat, Inc. | Message-based installation management using message bus |
US8924513B2 (en) * | 2009-07-08 | 2014-12-30 | International Business Machines Corporation | Storage system |
US10133485B2 (en) | 2009-11-30 | 2018-11-20 | Red Hat, Inc. | Integrating storage resources from storage area network in machine provisioning platform |
US8825819B2 (en) | 2009-11-30 | 2014-09-02 | Red Hat, Inc. | Mounting specified storage resources from storage area network in machine provisioning platform |
US8181061B2 (en) | 2010-04-19 | 2012-05-15 | Microsoft Corporation | Memory management and recovery for datacenters |
US8438244B2 (en) | 2010-04-19 | 2013-05-07 | Microsoft Corporation | Bandwidth-proportioned datacenters |
US9454441B2 (en) | 2010-04-19 | 2016-09-27 | Microsoft Technology Licensing, Llc | Data layout for recovery and durability |
US9170892B2 (en) | 2010-04-19 | 2015-10-27 | Microsoft Technology Licensing, Llc | Server failure recovery |
US8996611B2 (en) | 2011-01-31 | 2015-03-31 | Microsoft Technology Licensing, Llc | Parallel serialization of request processing |
US8533299B2 (en) | 2010-04-19 | 2013-09-10 | Microsoft Corporation | Locator table and client library for datacenters |
US9813529B2 (en) | 2011-04-28 | 2017-11-07 | Microsoft Technology Licensing, Llc | Effective circuits in packet-switched networks |
US8447833B2 (en) | 2010-04-19 | 2013-05-21 | Microsoft Corporation | Reading and writing during cluster growth phase |
US8751456B2 (en) | 2011-04-04 | 2014-06-10 | Symantec Corporation | Application wide name space for enterprise object store file system |
US9703610B2 (en) * | 2011-05-16 | 2017-07-11 | Oracle International Corporation | Extensible centralized dynamic resource distribution in a clustered data grid |
US8843502B2 (en) | 2011-06-24 | 2014-09-23 | Microsoft Corporation | Sorting a dataset of incrementally received data |
EP2701363B1 (en) * | 2011-07-22 | 2015-09-02 | Huawei Technologies Co., Ltd. | Content processing method, device and system |
CN103377269B (en) | 2012-04-27 | 2016-12-28 | 国际商业机器公司 | Sensing data localization method and device |
US9778856B2 (en) | 2012-08-30 | 2017-10-03 | Microsoft Technology Licensing, Llc | Block-level access to parallel storage |
US9984083B1 (en) | 2013-02-25 | 2018-05-29 | EMC IP Holding Company LLC | Pluggable storage system for parallel query engines across non-native file systems |
US10120900B1 (en) | 2013-02-25 | 2018-11-06 | EMC IP Holding Company LLC | Processing a database query using a shared metadata store |
US9600558B2 (en) | 2013-06-25 | 2017-03-21 | Google Inc. | Grouping of objects in a distributed storage system based on journals and placement policies |
US9158472B2 (en) | 2013-06-25 | 2015-10-13 | Google Inc. | Hierarchical chunking of objects in a distributed storage system |
US11422907B2 (en) | 2013-08-19 | 2022-08-23 | Microsoft Technology Licensing, Llc | Disconnected operation for systems utilizing cloud storage |
US9396202B1 (en) | 2013-12-27 | 2016-07-19 | Google Inc. | Weakly synchronized garbage collection and compaction for aggregated, replicated object stores |
US9798631B2 (en) | 2014-02-04 | 2017-10-24 | Microsoft Technology Licensing, Llc | Block storage by decoupling ordering from durability |
US10380486B2 (en) * | 2015-01-20 | 2019-08-13 | International Business Machines Corporation | Classifying entities by behavior |
US10209901B2 (en) | 2017-01-04 | 2019-02-19 | Walmart Apollo, Llc | Systems and methods for distributive data storage |
CN109145084B (en) * | 2018-07-10 | 2022-07-01 | 创新先进技术有限公司 | Data processing method, data processing device and server |
CN111984200A (en) * | 2020-08-28 | 2020-11-24 | 大连大学 | Mass video data storage system |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020124006A1 (en) * | 2000-12-28 | 2002-09-05 | Parnell Todd C. | Classification based content management system |
US20040186854A1 (en) * | 2003-01-28 | 2004-09-23 | Samsung Electronics Co., Ltd. | Method and system for managing media file database |
US20070185934A1 (en) * | 2006-02-03 | 2007-08-09 | Cannon David M | Restoring a file to its proper storage tier in an information lifecycle management environment |
US20070198593A1 (en) * | 2005-11-28 | 2007-08-23 | Anand Prahlad | Systems and methods for classifying and transferring information in a storage network |
Family Cites Families (55)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5519855A (en) | 1994-01-14 | 1996-05-21 | Microsoft Corporation | Summary catalogs |
US5583995A (en) | 1995-01-30 | 1996-12-10 | Mrj, Inc. | Apparatus and method for data storage and retrieval using bandwidth allocation |
US5881311A (en) | 1996-06-05 | 1999-03-09 | Fastor Technologies, Inc. | Data storage subsystem with block based data management |
US5928327A (en) | 1996-08-08 | 1999-07-27 | Wang; Pong-Sheng | System and process for delivering digital data on demand |
US5893920A (en) | 1996-09-30 | 1999-04-13 | International Business Machines Corporation | System and method for cache management in mobile user file systems |
GB2327781A (en) * | 1997-07-26 | 1999-02-03 | Ibm | Data replication tracking method for a distributed data processing system |
US6415373B1 (en) | 1997-12-24 | 2002-07-02 | Avid Technology, Inc. | Computer system and process for transferring multiple high bandwidth streams of data between multiple storage units and multiple applications in a scalable and reliable manner |
US6374336B1 (en) | 1997-12-24 | 2002-04-16 | Avid Technology, Inc. | Computer system and process for transferring multiple high bandwidth streams of data between multiple storage units and multiple applications in a scalable and reliable manner |
US6597956B1 (en) | 1999-08-23 | 2003-07-22 | Terraspring, Inc. | Method and apparatus for controlling an extensible computing system |
US6732088B1 (en) * | 1999-12-14 | 2004-05-04 | Xerox Corporation | Collaborative searching by query induction |
US6799202B1 (en) * | 1999-12-16 | 2004-09-28 | Hachiro Kawaii | Federated operating system for a server |
US6477540B1 (en) * | 1999-12-22 | 2002-11-05 | Ncr Corporation | Method and apparatus for using Java as a stored procedure language and as an embedded language on a client |
US6647479B1 (en) | 2000-01-03 | 2003-11-11 | Avid Technology, Inc. | Computer file system providing looped file structure for post-occurrence data collection of asynchronous events |
US7117246B2 (en) * | 2000-02-22 | 2006-10-03 | Sendmail, Inc. | Electronic mail system with methodology providing distributed message store |
GB2366706B (en) * | 2000-08-31 | 2004-11-03 | Content Technologies Ltd | Monitoring electronic mail messages digests |
US7685183B2 (en) * | 2000-09-01 | 2010-03-23 | OP40, Inc | System and method for synchronizing assets on multi-tiered networks |
US6665675B1 (en) * | 2000-09-07 | 2003-12-16 | Omneon Video Networks | Shared file system having a token-ring style protocol for managing meta-data |
US6970939B2 (en) * | 2000-10-26 | 2005-11-29 | Intel Corporation | Method and apparatus for large payload distribution in a network |
ATE381191T1 (en) * | 2000-10-26 | 2007-12-15 | Prismedia Networks Inc | METHOD AND SYSTEM FOR MANAGING DISTRIBUTED CONTENT AND CORRESPONDING METADATA |
US7043473B1 (en) * | 2000-11-22 | 2006-05-09 | Widevine Technologies, Inc. | Media tracking system and method |
US7054927B2 (en) * | 2001-01-29 | 2006-05-30 | Adaptec, Inc. | File system metadata describing server directory information |
US6606690B2 (en) * | 2001-02-20 | 2003-08-12 | Hewlett-Packard Development Company, L.P. | System and method for accessing a storage area network as network attached storage |
US7209973B2 (en) * | 2001-04-09 | 2007-04-24 | Swsoft Holdings, Ltd. | Distributed network data storage system and method |
US7685126B2 (en) | 2001-08-03 | 2010-03-23 | Isilon Systems, Inc. | System and methods for providing a distributed file system utilizing metadata to track information about data stored throughout the system |
US20030037187A1 (en) | 2001-08-14 | 2003-02-20 | Hinton Walter H. | Method and apparatus for data storage information gathering |
US7092977B2 (en) | 2001-08-31 | 2006-08-15 | Arkivio, Inc. | Techniques for storing data based upon storage policies |
JP3777114B2 (en) * | 2001-11-05 | 2006-05-24 | 日立建機株式会社 | Hydraulic circuit device for hydraulic working machine |
US7024427B2 (en) * | 2001-12-19 | 2006-04-04 | Emc Corporation | Virtual file system |
US20040088380A1 (en) * | 2002-03-12 | 2004-05-06 | Chung Randall M. | Splitting and redundant storage on multiple servers |
JP2004094681A (en) * | 2002-08-30 | 2004-03-25 | Ntt Comware Corp | Control device, control method, and control program for distributed database |
US7395536B2 (en) * | 2002-11-14 | 2008-07-01 | Sun Microsystems, Inc. | System and method for submitting and performing computational tasks in a distributed heterogeneous networked environment |
US7533141B2 (en) * | 2003-01-24 | 2009-05-12 | Sun Microsystems, Inc. | System and method for unique naming of resources in networked environments |
US7865536B1 (en) * | 2003-02-14 | 2011-01-04 | Google Inc. | Garbage collecting systems and methods |
US6779202B1 (en) * | 2003-02-20 | 2004-08-24 | Andrew L. Alldredge | Plunger appliance for toilets |
US7055014B1 (en) * | 2003-08-11 | 2006-05-30 | Network Applicance, Inc. | User interface system for a multi-protocol storage appliance |
US7210091B2 (en) | 2003-11-20 | 2007-04-24 | International Business Machines Corporation | Recovering track format information mismatch errors using data reconstruction |
US7225211B1 (en) * | 2003-12-31 | 2007-05-29 | Veritas Operating Corporation | Multi-class storage mechanism |
US7359909B2 (en) * | 2004-03-23 | 2008-04-15 | International Business Machines Corporation | Generating an information catalog for a business model |
US20050216428A1 (en) * | 2004-03-24 | 2005-09-29 | Hitachi, Ltd. | Distributed data management system |
US7209967B2 (en) | 2004-06-01 | 2007-04-24 | Hitachi, Ltd. | Dynamic load balancing of a storage system |
US20060004856A1 (en) * | 2004-06-15 | 2006-01-05 | Xiangyang Shen | Data management and persistence frameworks for network management application development |
US7747836B2 (en) | 2005-03-08 | 2010-06-29 | Netapp, Inc. | Integrated storage virtualization and switch system |
US7599941B2 (en) * | 2005-07-25 | 2009-10-06 | Parascale, Inc. | Transparent redirection and load-balancing in a storage network |
US7778972B1 (en) * | 2005-12-29 | 2010-08-17 | Amazon Technologies, Inc. | Dynamic object replication within a distributed storage system |
US7716180B2 (en) * | 2005-12-29 | 2010-05-11 | Amazon Technologies, Inc. | Distributed storage system with web services client interface |
US20070214183A1 (en) * | 2006-03-08 | 2007-09-13 | Omneon Video Networks | Methods for dynamic partitioning of a redundant data fabric |
US20070226224A1 (en) * | 2006-03-08 | 2007-09-27 | Omneon Video Networks | Data storage system |
US20070260641A1 (en) * | 2006-05-02 | 2007-11-08 | Mypoints.Com Inc. | Real-time aggregate counting in a distributed system architecture |
US8266182B2 (en) * | 2006-06-30 | 2012-09-11 | Harmonic Inc. | Transcoding for a distributed file system |
US8117155B2 (en) * | 2006-06-30 | 2012-02-14 | Microsoft Corporation | Collection-based object replication |
US8122111B2 (en) * | 2006-07-25 | 2012-02-21 | Network Appliance, Inc. | System and method for server configuration control and management |
US7627572B2 (en) * | 2007-05-02 | 2009-12-01 | Mypoints.Com Inc. | Rule-based dry run methodology in an information management system |
US7685185B2 (en) * | 2007-06-29 | 2010-03-23 | Microsoft Corporation | Move-in/move-out notification for partial replica synchronization |
US8103628B2 (en) * | 2008-04-09 | 2012-01-24 | Harmonic Inc. | Directed placement of data in a redundant data storage system |
BRPI0922990B1 (en) * | 2008-12-22 | 2020-11-10 | Google Llc | SYSTEM AND METHODS OF STORAGE, SCANNING AND DEDUPLICATION OF OBJECT INDEXES IN DISTRIBUTED DATA REPLICATION SYSTEM, DEVICE PLURALITY DEVICE IN DISTRIBUTED DATA REPLICATION SYSTEM AND COMPUTER-READABLE MEMORY |
-
2008
- 2008-04-09 US US12/100,302 patent/US8103628B2/en active Active
-
2009
- 2009-04-09 JP JP2011504164A patent/JP5411250B2/en active Active
- 2009-04-09 WO PCT/US2009/040007 patent/WO2009126771A2/en active Application Filing
- 2009-04-09 EP EP09731450A patent/EP2288998A2/en not_active Withdrawn
-
2012
- 2012-01-24 US US13/357,524 patent/US8504571B2/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020124006A1 (en) * | 2000-12-28 | 2002-09-05 | Parnell Todd C. | Classification based content management system |
US20040186854A1 (en) * | 2003-01-28 | 2004-09-23 | Samsung Electronics Co., Ltd. | Method and system for managing media file database |
US20070198593A1 (en) * | 2005-11-28 | 2007-08-23 | Anand Prahlad | Systems and methods for classifying and transferring information in a storage network |
US20070185934A1 (en) * | 2006-02-03 | 2007-08-09 | Cannon David M | Restoring a file to its proper storage tier in an information lifecycle management environment |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2012073777A (en) * | 2010-09-28 | 2012-04-12 | Kddi Corp | Distributed file system control apparatus |
Also Published As
Publication number | Publication date |
---|---|
JP5411250B2 (en) | 2014-02-12 |
US8504571B2 (en) | 2013-08-06 |
WO2009126771A3 (en) | 2009-12-17 |
US20120191710A1 (en) | 2012-07-26 |
US20090259665A1 (en) | 2009-10-15 |
JP2011516994A (en) | 2011-05-26 |
US8103628B2 (en) | 2012-01-24 |
EP2288998A2 (en) | 2011-03-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8504571B2 (en) | Directed placement of data in a redundant data storage system | |
US20210382790A1 (en) | Distributing Data on Distributed Storage Systems | |
US10915408B2 (en) | Snapshot for grouping and elastic replication of virtual machines | |
Nicolae et al. | BlobSeer: Bringing high throughput under heavy concurrency to Hadoop Map-Reduce applications | |
US8984031B1 (en) | Managing data storage for databases based on application awareness | |
US7660966B2 (en) | Location-independent RAID group virtual block management | |
US10852984B2 (en) | Mirror vote synchronization | |
US9128942B1 (en) | On-demand operations | |
US10740005B1 (en) | Distributed file system deployment on a data storage system | |
US20020087672A1 (en) | Self-defining data units | |
US20080221856A1 (en) | Method and System for a Self Managing and Scalable Grid Storage | |
US10642837B2 (en) | Relocating derived cache during data rebalance to maintain application performance | |
EP3788489B1 (en) | Data replication in a distributed storage system | |
CN103597440A (en) | Method for creating clone file, and file system adopting the same | |
JP5375972B2 (en) | Distributed file system, data selection method thereof, and program | |
US11907261B2 (en) | Timestamp consistency for synchronous replication | |
Fu et al. | Performance optimization for managing massive numbers of small files in distributed file systems | |
CN108369588A (en) | Database rank Automatic Storage Management | |
US11079960B2 (en) | Object storage system with priority meta object replication | |
Azagury et al. | GPFS-based implementation of a hyperconverged system for software defined infrastructure | |
CN111078120A (en) | Data migration method and system of distributed file system and related components | |
US20220197944A1 (en) | File metadata service | |
US11093465B2 (en) | Object storage system with versioned meta objects | |
US11074002B2 (en) | Object storage system with meta object replication | |
WO2023097270A1 (en) | Detecting idle periods at network endpoints for management actions at processing clusters for managed databases |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 09731450 Country of ref document: EP Kind code of ref document: A2 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2011504164 Country of ref document: JP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2009731450 Country of ref document: EP |