US20120259953A1 - Data Storage and Data Sharing in a Network of Heterogeneous Computers - Google Patents

Data Storage and Data Sharing in a Network of Heterogeneous Computers Download PDF

Info

Publication number
US20120259953A1
US20120259953A1 US13/527,126 US201213527126A US2012259953A1 US 20120259953 A1 US20120259953 A1 US 20120259953A1 US 201213527126 A US201213527126 A US 201213527126A US 2012259953 A1 US2012259953 A1 US 2012259953A1
Authority
US
United States
Prior art keywords
computer
data
network
computers
data storage
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US13/527,126
Inventor
Ilya Gertner
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ls Cloud Storage Technologies LLC
Original Assignee
Network Disk Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=46282086&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=US20120259953(A1) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Priority claimed from US09/236,409 external-priority patent/US6549988B1/en
Application filed by Network Disk Inc filed Critical Network Disk Inc
Priority to US13/527,126 priority Critical patent/US20120259953A1/en
Publication of US20120259953A1 publication Critical patent/US20120259953A1/en
Assigned to FISH & RICHARDSON P.C. reassignment FISH & RICHARDSON P.C. LIEN (SEE DOCUMENT FOR DETAILS). Assignors: NETWORK DISK, INC.
Priority to US14/997,327 priority patent/US10154092B2/en
Assigned to NETWORK DISK, INC. reassignment NETWORK DISK, INC. RELEASE BY SECURED PARTY (SEE DOCUMENT FOR DETAILS). Assignors: FISH & RICHARDSON P.C.
Assigned to NETWORK DISK, INC. reassignment NETWORK DISK, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: GERTNER, ILYA
Assigned to GERTNER, ILYA reassignment GERTNER, ILYA ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: NETWORK DISK, INC.
Assigned to SPOT ON CORP. reassignment SPOT ON CORP. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: GERTNER, ILYA
Assigned to NETWORK DISK, INC. reassignment NETWORK DISK, INC. CORRECTIVE ASSIGNMENT TO CORRECT THE EXECUTION DATE OF THE RELEASE OF SECURITY INTEREST PREVIOUSLY RECORDED ON REEL 039493 FRAME 0809. ASSIGNOR(S) HEREBY CONFIRMS THE EXECUTION DATE OF THE RELEASE OF SECURITY INTEREST SHOULD BE 08/23/2016. Assignors: FISH & RICHARDSON P.C.
Assigned to LS CLOUD STORAGE TECHNOLOGIES, LLC reassignment LS CLOUD STORAGE TECHNOLOGIES, LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: SPOT ON CORP.
Priority to US15/440,277 priority patent/US9811463B2/en
Priority to US16/180,657 priority patent/US20190075163A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1097Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • G06F16/258Data format conversion from or to a database
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02Addressing or allocation; Relocation
    • G06F12/08Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
    • G06F12/0802Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
    • G06F12/0806Multiuser, multiprocessor or multiprocessing cache systems
    • G06F12/0808Multiuser, multiprocessor or multiprocessing cache systems with cache invalidating means
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02Addressing or allocation; Relocation
    • G06F12/08Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
    • G06F12/12Replacement control
    • G06F12/121Replacement control using replacement algorithms
    • G06F12/128Replacement control using replacement algorithms adapted to multidimensional cache systems, e.g. set-associative, multicache, multiset or multilevel
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0614Improving the reliability of storage systems
    • G06F3/0619Improving the reliability of storage systems in relation to data integrity, e.g. data losses, bit errors
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0629Configuration or reconfiguration of storage systems
    • G06F3/0635Configuration or reconfiguration of storage systems by changing the path, e.g. traffic rerouting, path reconfiguration
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0646Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
    • G06F3/065Replication mechanisms
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services
    • H04L67/568Storing data temporarily at an intermediate stage, e.g. caching
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02Addressing or allocation; Relocation
    • G06F12/08Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
    • G06F12/12Replacement control
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/62Details of cache specific to multiprocessor cache arrangements
    • G06F2212/621Coherency control relating to peripheral accessing, e.g. from DMA or I/O device
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/70Details relating to dynamic memory management

Definitions

  • This invention relates generally to the field of cached data storage systems and more particularly to a data storage system that permits independent access from local hosts connected via I/O channels and independent access from remote hosts and remote storage systems connected via network links.
  • a network of PCs permits building a high-performance, scalable, data storage system using off-the-shelf components at reduced cost.
  • a configuration manager ensures consistency of data stored in the distributed cache.
  • a typical data processing system generally involves a cached data storage system that connects to local host computers via I/O channels or remote host computers via network links.
  • the purpose of the data storage system is to improve the performance of applications running on the host computer by offloading I/O processing from the host to the data storage system.
  • the purpose of the cache memory in a data storage system is to further improve the performance of the applications by temporarily storing data buffers in the cache so that the references to those buffers can be resolved efficiently as “cache hits”. Reading data from a cache is an order of magnitude faster than reading data from a back end storage device such as a disk.
  • Writing data to a cache is also an order of magnitude faster than writing to a disk. All writes are cache hits because data is simply copied into cache buffers that are later flushed to disks.
  • Prior art data storage systems are implemented using proprietary hardware and very low-level software, frequently referred to as microcode, resulting in expensive and not portable systems.
  • the preferred embodiment of the present invention uses standard hardware and software components.
  • a network of commercial PCs is used to implement a high-performance data storage system.
  • a method using the network of PCs includes an algorithm for a configuration manager that manages access to the distributed cache memory stored in PCs interconnected by the network.
  • the above systems use dedicated communication links that are very expensive when compared to modern networking technology.
  • the data management model is limited to the primary-node sending messages to the secondary node scenario. This model does not support arbitrary read and write requests in a distributed data storage system.
  • the primary object of the invention is to provide a high performance, scalable, data storage system using off-the-shelf standard components.
  • the preferred embodiment of the present invention comprises a network of PCs including an I/O channel adapter and network adapter and method for managing distributed cache memory stored in the plurality of PCs interconnected by the network.
  • the use of standard PCs reduces the cost of the data storage system.
  • the use of the network of PCs permits building large, high-performance, data storage systems.
  • Another object of the invention is to provide a distributed cache that supports arbitrary reads and writes arriving via I/O channels or network links, as well as a method for sharing data between two or more heterogeneous host computers using different data formats and connected to a data storage system.
  • the method includes a translation module that inputs a record in a format compatible with the first host and stores the translated record in a data format compatible with the second host. Sharing of data in one format and having a translation module permitting representations in different formats in cache memory provides a means for improving performance of I/O requests and saving disk storage space.
  • a data storage system comprises a network of PCs each of which includes a cache memory, an I/O channel adapter for transmitting data over the channel and a network adapter for transmitting data and control signals over the network.
  • a method for managing resources in a cache memory ensures consistency of data stored in the distributed cache.
  • a method for sharing data between two or more heterogeneous hosts includes the steps of: reading a record in a format compatible with one computer; identifying a translation module associated with the second computer; translating the record into the format compatible with the second computer and writing said translated record into a cache memory.
  • the preferred embodiment of the present invention involves a method for building a data storage system that provides superior functionality at lower cost when compared to prior art systems.
  • the superior functionality is achieved by using an underlying general-purpose operating system to provide utilities for managing storage devices, backing data, troubleshooting storage devices and performance monitoring.
  • the lower cost is achieved by relying on standard components.
  • the preferred embodiment of the present invention overcomes the limitations of prior art systems by providing concurrent access for both I/O channel attached hosts and network link attached hosts.
  • the preferred embodiment of this invention uses SCSI channels to connect to local hosts and uses standard network links card such as Ethernet, or ATM to connect to remote hosts.
  • the alternate embodiment of the present invention uses fiber channel link such as Fibre Channel as defined by the Fibre Channel Association, FCA, 2570 West El Camino Real, Ste. 304, Mountain View, Calif. 94040-1313 or SSA as defined SSA Industry Association, DEPT H65/B-013 5600 Cottle Road, San Jose, Calif. 95193.
  • Prior art systems such as U.S. Pat. No. 5,841,997, Bleiwess, et. al., Nov. 24, 1998, Apparatus for effecting port switching of fibre channel loops, and U.S. Pat. No. 5,828,475, Bennett, et. al., Oct. 27, 1998, Bypass switching and messaging mechanism for providing intermix fiber optic switch using a bypass bus and buffer, disclosure methods that connects disks and controllers.
  • the problems remain in software, solution of which require methods described in the preferred embodiment of the present
  • FIG. 1 shows data storage systems configurations
  • FIG. 2 illustrates in block diagram form the alternate embodiment of the data storage system of the present invention
  • FIG. 2A illustrates in block diagram form the alternate embodiment of the data storage system of the present invention
  • FIG. 2B illustrates in block diagram form another variation of the alternate embodiment of the present invention
  • FIG. 3 shows a PC data storage system
  • FIG. 4 illustrates in data flow diagram form the operations of a data storage system including: FIG. 4A illustrating operations in write exclusive mode, FIG. 4B in read exclusive mode, FIG. 4C in write shared mode, FIG. 4D in read shared mode, FIG. 4E in disk interrupt, FIG. 4F in page flusher; and
  • FIG. 5 illustrates in block diagram form data sharing operations.
  • FIG. 1 illustrates data storage system configurations of the preferred embodiment.
  • the PC data storage system 131 services a plurality of channel attached host processors 111 , 112 using channels 121 , 122 , and a plurality of network attached host processors 106 , 107 using network link 151 , and a plurality of network attached data storage systems 132 , 133 using network links 152 , 153 .
  • PC storage system 132 services channel attached hosts 157 , 158 .
  • Hosts 157 and 158 access a data storage system 131 indirectly via network attached data storage system 132 , thereby offloading communications protocol overhead from remote hosts 157 , 158 .
  • Hosts 106 and 107 directly access storage system 131 via network link 151 thereby incurring communications protocol overhead on hosts 106 , 107 and therefore decreasing performance of applications running on said hosts.
  • Host 111 accesses remote disk 181 via local data storage system 131 , network link 153 , and remote data storage system 133 without incurring protocol overhead on host 111 .
  • Host 157 accesses disk 161 via data storage system 133 , network link 152 , and data storage system 131 without incurring protocol overhead on host 157 .
  • Host 106 directly accesses local disk 161 via network link 151 thereby incurring protocol overhead.
  • the disks 191 , 192 that are attached to hosts 106 , 107 without a data storage system, cannot be accessed by outside hosts.
  • the preferred embodiment of the present inventions uses well-established technologies such as SCSI channels for I/O traffic and Ethernet link for network traffic.
  • the alternate embodiment of the present invention uses fiber channel technology for both I/O traffic and network traffic.
  • the fiber channel connects computers and hard disks into one logical network.
  • the fiber optics link is organized as a Fiber Channel Arbitrated Loop (FCAL).
  • FCAL Fiber Channel Arbitrated Loop
  • FIG. 2A the fiber optics link is organized as a switching network.
  • FIG. 2B the fiber channel is organized in two FCAL loops connected via switch.
  • FIG. 3 shows a software architecture and modules of a PC data storage system corresponding to the data storage system 131 in FIG. 1 .
  • Data is received from the hosts 111 , 112 via I/O channels 121 , 122 in front-end software module 310 in FIG. 3 .
  • the front-end module 310 handles channel commands and places the results in cache memory 322 in the form of new data or modification to data already stored on the disk 161 .
  • the cache manager software module 320 calls routines in the configuration manager 340 to ensure consistency of the cache memory in other network attached data storage systems.
  • the back-end software module 342 invokes a page flusher module to write modified data to disks 161 and 162 and free up cache memory.
  • front-end module 310 including I/O adapter driver has been modified to accept target SCSI I/O requests from hosts 111 and 112 .
  • Said front-end module handles I/O requests in such a manner that hosts 111 and 112 are not aware of a data storage system.
  • Hosts 111 and 112 issue I/O requests as if the request is going to a standard disk.
  • the presence of fast access cache memory permits front end channels and network links to operate completely independent of the back-end physical disk devices. Because of this front-end/back-end separation, the data storage system 131 is liberated from the I/O channel and network timing dependencies. The data storage system is free to dedicate its processing resources to increase performance through more intelligent scheduling and data transfer network protocol.
  • FIG. 4 shows a flowchart of a data storage system in the process of reading or writing to data volumes stored on disk drives shown in FIG. 3 .
  • the flowchart uses a volume access table 450 (see also FIG. 5 ) and controlled by the configuration manager.
  • Local operations begin in step 401 where the corresponding front-end module 310 of FIG. 3 allocates a channel and waits for I/O requests from the initiating hosts 111 or 112 .
  • Remote operations begin in step 402 .
  • the requests are routed either as shown in FIG. 4A for write exclusive mode, FIG. 4B for read exclusive, FIG. 4C for write shared or FIG. 4D for read shared.
  • the independent page flusher daemon shown in FIG. 4F scans cache memory and writes buffers to disks. Disk interrupt processing is shown in FIG. 4E .
  • Volume access table 450 (see FIG. 4 ) contains a mapping between hosts and volumes specifying an access mode value. If the access mode is set neither to shared nor exclusive, the configuration manager forwards I/O requests directly to disk. In addition to the access mode, the volume access table may contain other values that help the configuration manager and improve performance of the data storage system.
  • the volume access table includes a translation module for a given host to facilitate volume mapping.
  • the translation module is a dynamically loadable library that can be changed, compiled and linked at run-time.
  • a user of a data storage system can externally set the values and parameters in a volume access table. For each host and volume pair, a user can explicitly specify the access mode value. For some applications, where data on a remote volume is accessed infrequently, the user may want to specify other than shared or exclusive in order to disable cache for the remote volume. By disabling caching, the user eliminates cache coherency traffic entirely for the volume.
  • a user or a system administrator actively monitors and changes the behavior of a cache manager by changing values in a volume access table in order to improve performance of the data storage system.
  • FIG. 4A shows a flowchart of the cache manager 320 (see FIG. 3 ) as it processes a write request in an exclusive mode.
  • the cache manager checks whether the requested buffer is in cache or not. For a cache miss, in step 412 , the cache manager allocates a new buffer for storing data that will be written. For a cache hit, the cache manager branches directly to step 413 where data is copied into the newly allocated buffer.
  • the cache manager calls a configuration manager routine that sends an invalidate request to the list of shared hosts for this particular volume.
  • the cache manager checks the type of a request. For a channel type of a request, the cache manager returns to step 405 to release the channel. For a network type of a request, the cache manager proceeds to release network request in step 419 on the right side of FIG. 4A .
  • step 416 network interrupt identifies and receives a remote write request.
  • step 417 the cache manager calls configuration manager routine to determine the validity of the request. Bad requests are ignored in step 418 . Correct requests proceed to step for 410 for write exclusive processing. Step 415 returns the flow to step 419 , which releases network resources.
  • FIG. 4B shows a flowchart of the cache manager as it processes a read request in an exclusive mode.
  • the cache manager checks whether the requested buffer is in cache or not. For a cache miss, in step 421 , the cache manager allocates a buffer for storing data that will be read in. In step 422 , the cache manager updates the buffer status with read pending. In step 423 , the cache manager starts an operation to read from a hard disk driver and proceeds to release the channel in step 405 . For a cache hit, in step 424 , the cache manager transmits read data and proceeds to release the channel in step 405 . For an identified network request, in step 425 , the cache manager sends back read results in step 429 .
  • step 426 network interrupt identifies and receives a remote read request.
  • the cache manager calls a configuration manager routine that checks the configuration file and ignores bad requests in step 428 . Correct requests proceed to step 420 for read exclusive processing.
  • Step 425 returns the flow to step 429 that sends read results.
  • FIG. 4C shows a flowchart of the cache manager as it processes a write request in a shared mode.
  • the cache manager checks whether the requested buffer is in cache or not. For a cache miss, in step 431 , the cache manager allocates a new buffer for storing data that will be written. For a cache hit, the cache manager branches directly to step 432 where data is copied into the newly allocated buffer. In step 433 , the cache manager updates the buffer status with write pending and proceeds to step 434 to release the channel.
  • the cache manager calls a configuration manager routine that sends a remote write request to the host that holds this particular volume in an exclusive mode. In follow up to step 435 , the cache manager returns to the beginning of FIG. 4 .
  • the cache manager updates the buffer status with write done in step 444 .
  • the flow begins with the network interrupt that calls configuration manager to validate the request in step 441 . Bad requests are ignored in step 442 .
  • a correct request proceeds to step 443 that checks whether the status of this particular buffer is write pending. If the status is pending, in step 444 , the cache manager updates the buffer status to write done. For any other buffer status, in step 445 , the cache manager updates the status to free. This buffer is released in accordance with the invalidate request that has come from a remote host that holds this volume in an exclusive mode as has been described in FIG. 4A .
  • FIG. 4D shows a flowchart of the cache manager as it processes a read request in a shared mode.
  • the cache manager checks whether the requested buffer is in cache or not. For a cache miss, in step 452 , the cache manager allocates a buffer for storing data that will be read into. For a cache hit, in step 451 , the cache manager transmits read data and proceeds to step 405 to release the channel. In the case of the cache miss, the cache manager allocates a new buffer in step 452 and updates its status to read pending in step 453 . In step 454 , the cache manager closes the channel with an optimizer that maintains a pool of open channels which are kept open only for the specified amount of time. In step 455 , the cache manager calls configuration manager routine that sends a remote read request to the host that holds this particular volume in an exclusive mode. The operations of the host holding volume in read exclusive mode have been shown in FIG. 4B .
  • a network interrupt identifies a remote read result.
  • the cache manager performs an optimized channel open. Depending upon the status of the optimizer that has been initiated in step 454 , the cache manager may immediately get access to the still open channel or, if the optimizer fails, the cache manager may need to reopen the channel.
  • the cache manager transmits read data.
  • the cache manager updates the buffer status to read done and proceeds to step 459 where it releases the channel.
  • FIG. 4E shows a flowchart of the cache manager as it processes a hard disk interrupt request marking the completion of a read or write request.
  • the read request has been started in step 423 in FIG. 4B .
  • the write request has been started in step 475 in FIG. 4F .
  • the cache manager checks the type of the hardware interrupt. For a write interrupt in step 461 , the cache manager updates the buffer status to write done and releases resources associated with the interrupt. For a read interrupt in step 462 , the cache manager updates the buffer status to read done.
  • the cache manager checks request type of the read operation that has been started in FIG. 4B . For a channel request, the cache manager proceeds to open a channel in step 466 .
  • step 467 the cache manager transmits read data and proceeds to release the channel in step 405 .
  • the cache manager finds the remote read requests that initiated the request.
  • the cache manager sends read results and ends interrupt processing.
  • FIG. 4F shows a flowchart of a cache memory page flusher.
  • the flusher is a separate daemon running as part of the cache manager.
  • the flusher waits for the specified amount of time. After the delay in step 472 , the flusher begins to scan pages in cached memory.
  • the flusher checks the page status. If the page list has been exhausted in branch no more pages, the flusher returns to step 471 where it waits. If the page status is other than the write pending, the flusher returns to step 472 to continue scanning for more pages. If the page status is write pending, the flusher proceeds to step 474 .
  • the flusher checks the request type. For a channel type, the flusher starts a read operation in step 475 and returns to scan pages in step 472 . For a network type, the flusher checks for the network operations in progress and returns to step 472 for more pages.
  • FIG. 5 shows a data sharing operation between a plurality of heterogeneous host computers.
  • the plurality of hosts includes but is not limited to a Sun Solaris workstation 111 , Windows NT server 112 , HP UNIX 106 , and Digital UNIX 107 each accessing a distinct virtual device respectively 510 , 520 , 530 and 540 .
  • Configuration manager 560 provides concurrency control for accessing virtual devices that are mapped to the same physical device 161 .
  • the configuration manager uses a volume access table 450 that has been shown in FIG. 4 .
  • a virtual device is a method that comprises three operations: initialization, read and write.
  • the initialization operation registers a virtual device in an operating system on a heterogeneous host. Following the registration, the virtual device appears as if it is another physical device that can be brought on-line, offline or mounted on a file system. An application program running on the host cannot distinguish between a virtual device and a physical device.
  • the read operation begins with a read from a physical device followed by a call to a translation module.
  • the translation, module inputs a shared record in a original format used on a physical disk and outputs the record in a new format that is specified for and is compatible with a host computer.
  • the write operation begins with a call to a translation module that inputs a record in a new format and outputs a record in a shared format.
  • the translation module is a dynamically loadable library that can be changed, compiled and linked at run-time.
  • the virtual device method described above allows a plurality of heterogeneous host computers to share one copy of data stored on a physical disk.
  • a plurality of virtual devices is maintained in cache without requiring a copy of data on a physical disk.

Abstract

A network of PCs includes an I/O channel adapter and network adapter, and is configured for management of a distributed cache memory stored in the plurality of PCs interconnected by the network. The use of standard PCs reduces the cost of the data storage system. The use of the network of PCs permits building large, high-performance, data storage systems.

Description

    RELATED APPLICATIONS
  • This is a continuation-in-part of U.S. Ser. No. 09/236,409, filed on Jan. 22, 1999, the entire disclosure of which is incorporated by reference in its entirety.
  • FIELD OF THE INVENTION
  • This invention relates generally to the field of cached data storage systems and more particularly to a data storage system that permits independent access from local hosts connected via I/O channels and independent access from remote hosts and remote storage systems connected via network links. A network of PCs permits building a high-performance, scalable, data storage system using off-the-shelf components at reduced cost. A configuration manager ensures consistency of data stored in the distributed cache.
  • BACKGROUND OF THE INVENTION
  • A typical data processing system generally involves a cached data storage system that connects to local host computers via I/O channels or remote host computers via network links. The purpose of the data storage system is to improve the performance of applications running on the host computer by offloading I/O processing from the host to the data storage system. The purpose of the cache memory in a data storage system is to further improve the performance of the applications by temporarily storing data buffers in the cache so that the references to those buffers can be resolved efficiently as “cache hits”. Reading data from a cache is an order of magnitude faster than reading data from a back end storage device such as a disk. Writing data to a cache is also an order of magnitude faster than writing to a disk. All writes are cache hits because data is simply copied into cache buffers that are later flushed to disks.
  • Prior art data storage systems are implemented using proprietary hardware and very low-level software, frequently referred to as microcode, resulting in expensive and not portable systems. In contrast to the prior art systems, the preferred embodiment of the present invention uses standard hardware and software components. A network of commercial PCs is used to implement a high-performance data storage system. A method using the network of PCs includes an algorithm for a configuration manager that manages access to the distributed cache memory stored in PCs interconnected by the network.
  • Numerous prior art systems and methods exist for managing cache memory in a data storage system. The prior art has suggested several methods for managing cache for channel attached hosts. U.S. Pat. No. 5,717,884, Gzym, et. al., Feb. 2, 1996, Method and Apparatus for Cache Management, discloses data structures and algorithms that use a plurality of slots, each of which is used to store data files. U.S. Pat. No. 5,757,473, Vishlitzky, et. al., Cache Management system using time stamping for replacement queue, Jul. 28, 1998, discloses a method that uses time stamps to manage queues in a cached data storage system. U.S. Pat. No. 5,751,993, Ofek, et. al., May 12, 1998, Cache Management Systems, discloses yet another aspect in queue management algorithms. U.S. Pat. No. 5,600,817, Macon Jr., et. al., Feb. 4, 1997, Asynchronous read-ahead disk caching using multiple disk I/O processes and dynamically variable prefetch length, discloses read-ahead methods in cached storage systems. U.S. Pat. No. 5,758,050, Brady, et. al., May 26, 1998, Reconfigurable data storage system, discloses a method for reconfiguring a data storage system.
  • However, the above systems use very specialized embedded operating systems and custom programming in a very low-level programming language such as assembler. The obvious drawback of the above systems is high cost because assembler-level programming is very time consuming. Another drawback is inflexibility and lack of functionality. For example, some features such as reconfigurability in data storage are very limited in proprietary embedded systems when compared to general purpose operating systems. Finally, networking support is very expensive and limited because it relies on dedicated communication links such as T1, T3and ESCON.
  • One prior art system using networking of data storage systems is disclosed in U.S. Pat. No. 5,742,792, Yanai, et. al., Apr. 21, 1998, Remote Data Mirroring. This patent discloses a primary data storage system providing storage services to a primary host and a secondary data storage system providing services to a secondary host. The primary storage system sends all writes to the secondary storage system via IBM ESCON, or optionally via T1 or T3 communications link. The secondary data storage system provides a backup copy of the primary storage system. Another prior art system is disclosed in U.S. Pat. No. 5,852,715, Raz , et al., Dec. 22, 1998, System for currently updating database by one host and reading the database by different host for the purpose of implementing decision support functions.
  • However, the above systems use dedicated communication links that are very expensive when compared to modern networking technology. Furthermore, the data management model is limited to the primary-node sending messages to the secondary node scenario. This model does not support arbitrary read and write requests in a distributed data storage system.
  • There is a growing demand for distributed data storage systems. In response to this demand some prior art systems have evolved into complex assemblies of two systems, one proprietary a data storage system and the other an open networking server. One such system is described in a white paper on a company web site on Internet. The industry white paper, EMC Data Manager: A high-performance, centralized open system backup/restore solution for LAN-based and Symmetrix resident data, describes two different systems, one for network attached hosts and second for channel attached hosts. The two systems are needed because of the lack of generic networking support. In related products such as Celerra File Server, product data sheets suggest using data movers for copying data between LAN-based open system storage and channel attached storage system.
  • However, the above systems are built from two systems, one for handling I/O channels, and another for handling open networks. Two systems are very expensive even in minimal configuration that must include two systems.
  • In another branch of storage industry, network attached storage systems use network links to attach to host computers. Various methods for managing cache memory and distributed applications for network attached hosts have been described in prior art. U.S. Pat. No. 5,819,292, Hitz, et. al., Method for maintaining consistent states of a file system and for creating user-accessible read-only copies of a file system, Oct. 6, 1998, U.S. Pat. No. 5,644,751, and Burnett, et. al., Jul. 1, 1997, Distributed file system (DFS) cache management system based on file access characteristics, discloses methods for implementing distributed file systems. U.S. Pat. No. 5,649,105, Aldred, et. al., Jul. 15, 1997, Collaborative working in a network, discloses programming methods for distributed applications using file sharing. U.S. Pat. No. 5,701,516, Chen, et. al., Dec 23, 1997, High-performance non-volatile RAM protected write cache accelerator system employing DMA and data transferring scheme, discloses optimization methods for network attached hosts. However, those systems support only network file systems. Those systems do not support I/O channels.
  • In another application of storage systems, U.S. Pat. No. 5,790,795, Hough, Aug. 4, 1998, Media server system which employs a SCSI bus and which utilizes SCSI logical units to differentiate between transfer modes, discloses a media server that supports different file systems on different SCSI channels. However the system above is limited to a video data and does not support network attached hosts. Furthermore, in storage industry papers, Data Sharing, by Neema, Storage Management Solutions, Vol. 3, No. 3, May, 1998, and another industry paper, Storage management in UNIX environments: challenges and solutions, by Jerry Hoetger, Storage Management Solutions, Vol. 3, No. 4, survey a number of approaches in commercial storage systems and data sharing. However, existing storage systems are limited when applied to support multiple platform systems.
  • Therefore, a need exists to provide a high-performance data storage system that is assembled out of standard modules, using off-the-shelf hardware components and a standard general-purpose operating system that supports standard network software and protocols. In addition, the needs exists to provide a cached data storage system that permits independent data accesses from I/O channel attached local hosts, network attached remote hosts, and network-attached remote data storage systems.
  • SUMMARY OF THE INVENTION
  • The primary object of the invention is to provide a high performance, scalable, data storage system using off-the-shelf standard components. The preferred embodiment of the present invention comprises a network of PCs including an I/O channel adapter and network adapter and method for managing distributed cache memory stored in the plurality of PCs interconnected by the network. The use of standard PCs reduces the cost of the data storage system. The use of the network of PCs permits building large, high-performance, data storage systems.
  • Another object of the invention is to provide a distributed cache that supports arbitrary reads and writes arriving via I/O channels or network links, as well as a method for sharing data between two or more heterogeneous host computers using different data formats and connected to a data storage system. The method includes a translation module that inputs a record in a format compatible with the first host and stores the translated record in a data format compatible with the second host. Sharing of data in one format and having a translation module permitting representations in different formats in cache memory provides a means for improving performance of I/O requests and saving disk storage space.
  • In accordance with a preferred embodiment of the invention, a data storage system comprises a network of PCs each of which includes a cache memory, an I/O channel adapter for transmitting data over the channel and a network adapter for transmitting data and control signals over the network. In one embodiment, a method for managing resources in a cache memory ensures consistency of data stored in the distributed cache. In another embodiment, a method for sharing data between two or more heterogeneous hosts includes the steps of: reading a record in a format compatible with one computer; identifying a translation module associated with the second computer; translating the record into the format compatible with the second computer and writing said translated record into a cache memory.
  • The preferred embodiment of the present invention involves a method for building a data storage system that provides superior functionality at lower cost when compared to prior art systems. The superior functionality is achieved by using an underlying general-purpose operating system to provide utilities for managing storage devices, backing data, troubleshooting storage devices and performance monitoring. The lower cost is achieved by relying on standard components. Furthermore, the preferred embodiment of the present invention overcomes the limitations of prior art systems by providing concurrent access for both I/O channel attached hosts and network link attached hosts.
  • The preferred embodiment of this invention uses SCSI channels to connect to local hosts and uses standard network links card such as Ethernet, or ATM to connect to remote hosts. The alternate embodiment of the present invention uses fiber channel link such as Fibre Channel as defined by the Fibre Channel Association, FCA, 2570 West El Camino Real, Ste. 304, Mountain View, Calif. 94040-1313 or SSA as defined SSA Industry Association, DEPT H65/B-013 5600 Cottle Road, San Jose, Calif. 95193. Prior art systems such as U.S. Pat. No. 5,841,997, Bleiwess, et. al., Nov. 24, 1998, Apparatus for effecting port switching of fibre channel loops, and U.S. Pat. No. 5,828,475, Bennett, et. al., Oct. 27, 1998, Bypass switching and messaging mechanism for providing intermix fiber optic switch using a bypass bus and buffer, disclosure methods that connects disks and controllers. However, the problems remain in software, solution of which require methods described in the preferred embodiment of the present invention.
  • The drawings constitute a part of this specification and include exemplary embodiments to the invention, which may be embodied in various forms.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 shows data storage systems configurations;
  • FIG. 2 illustrates in block diagram form the alternate embodiment of the data storage system of the present invention;
  • FIG. 2A illustrates in block diagram form the alternate embodiment of the data storage system of the present invention;
  • FIG. 2B illustrates in block diagram form another variation of the alternate embodiment of the present invention;
  • FIG. 3 shows a PC data storage system;
  • FIG. 4 illustrates in data flow diagram form the operations of a data storage system including: FIG. 4A illustrating operations in write exclusive mode, FIG. 4B in read exclusive mode, FIG. 4C in write shared mode, FIG. 4D in read shared mode, FIG. 4E in disk interrupt, FIG. 4F in page flusher; and
  • FIG. 5 illustrates in block diagram form data sharing operations.
  • DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • Detailed descriptions of the preferred embodiment are provided herein. It is to be understood, however, that the present invention may be embodied in various forms. Therefore, specific details disclosed herein are not to be interpreted as limiting.
  • FIG. 1 illustrates data storage system configurations of the preferred embodiment. The PC data storage system 131 services a plurality of channel attached host processors 111, 112 using channels 121, 122, and a plurality of network attached host processors 106, 107 using network link 151, and a plurality of network attached data storage systems 132, 133 using network links 152, 153. PC storage system 132 services channel attached hosts 157, 158.
  • Hosts 157 and 158 access a data storage system 131 indirectly via network attached data storage system 132, thereby offloading communications protocol overhead from remote hosts 157, 158. Hosts 106 and 107 directly access storage system 131 via network link 151 thereby incurring communications protocol overhead on hosts 106, 107 and therefore decreasing performance of applications running on said hosts.
  • Host 111 accesses remote disk 181 via local data storage system 131, network link 153, and remote data storage system 133 without incurring protocol overhead on host 111. Host 157 accesses disk 161 via data storage system 133, network link 152, and data storage system 131 without incurring protocol overhead on host 157. Host 106 directly accesses local disk 161 via network link 151 thereby incurring protocol overhead. The disks 191, 192 that are attached to hosts 106, 107 without a data storage system, cannot be accessed by outside hosts.
  • The preferred embodiment of the present inventions uses well-established technologies such as SCSI channels for I/O traffic and Ethernet link for network traffic. In FIG. 2, the alternate embodiment of the present invention uses fiber channel technology for both I/O traffic and network traffic. The fiber channel connects computers and hard disks into one logical network. In one variation of the alternate embodiment in FIG. 2, the fiber optics link is organized as a Fiber Channel Arbitrated Loop (FCAL). In another variation shown in FIG. 2A, the fiber optics link is organized as a switching network. In yet another variation in FIG. 2B, the fiber channel is organized in two FCAL loops connected via switch.
  • FIG. 3 shows a software architecture and modules of a PC data storage system corresponding to the data storage system 131 in FIG. 1. Data is received from the hosts 111, 112 via I/ O channels 121, 122 in front-end software module 310 in FIG. 3. The front-end module 310 handles channel commands and places the results in cache memory 322 in the form of new data or modification to data already stored on the disk 161. The cache manager software module 320 calls routines in the configuration manager 340 to ensure consistency of the cache memory in other network attached data storage systems. At some later point in time, the back-end software module 342 invokes a page flusher module to write modified data to disks 161 and 162 and free up cache memory.
  • In FIG. 3, front-end module 310 including I/O adapter driver has been modified to accept target SCSI I/O requests from hosts 111 and 112. Said front-end module handles I/O requests in such a manner that hosts 111 and 112 are not aware of a data storage system. Hosts 111 and 112 issue I/O requests as if the request is going to a standard disk.
  • The presence of fast access cache memory permits front end channels and network links to operate completely independent of the back-end physical disk devices. Because of this front-end/back-end separation, the data storage system 131 is liberated from the I/O channel and network timing dependencies. The data storage system is free to dedicate its processing resources to increase performance through more intelligent scheduling and data transfer network protocol.
  • FIG. 4 shows a flowchart of a data storage system in the process of reading or writing to data volumes stored on disk drives shown in FIG. 3. The flowchart uses a volume access table 450 (see also FIG. 5) and controlled by the configuration manager. Local operations begin in step 401 where the corresponding front-end module 310 of FIG. 3 allocates a channel and waits for I/O requests from the initiating hosts 111 or 112. Remote operations begin in step 402. Depending upon the status of the value in a volume access table 450 the requests are routed either as shown in FIG. 4A for write exclusive mode, FIG. 4B for read exclusive, FIG. 4C for write shared or FIG. 4D for read shared. Concurrently with the processing of I/O operations, the independent page flusher daemon shown in FIG. 4F scans cache memory and writes buffers to disks. Disk interrupt processing is shown in FIG. 4E.
  • Volume access table 450 (see FIG. 4) contains a mapping between hosts and volumes specifying an access mode value. If the access mode is set neither to shared nor exclusive, the configuration manager forwards I/O requests directly to disk. In addition to the access mode, the volume access table may contain other values that help the configuration manager and improve performance of the data storage system.
  • In another embodiment of this application, shown in FIG. 5, the volume access table includes a translation module for a given host to facilitate volume mapping. The translation module is a dynamically loadable library that can be changed, compiled and linked at run-time.
  • A user of a data storage system can externally set the values and parameters in a volume access table. For each host and volume pair, a user can explicitly specify the access mode value. For some applications, where data on a remote volume is accessed infrequently, the user may want to specify other than shared or exclusive in order to disable cache for the remote volume. By disabling caching, the user eliminates cache coherency traffic entirely for the volume. In a data storage system, a user or a system administrator actively monitors and changes the behavior of a cache manager by changing values in a volume access table in order to improve performance of the data storage system.
  • FIG. 4A shows a flowchart of the cache manager 320 (see FIG. 3) as it processes a write request in an exclusive mode. In step 411 of FIG. 4A, the cache manager checks whether the requested buffer is in cache or not. For a cache miss, in step 412, the cache manager allocates a new buffer for storing data that will be written. For a cache hit, the cache manager branches directly to step 413 where data is copied into the newly allocated buffer. In step 414, the cache manager calls a configuration manager routine that sends an invalidate request to the list of shared hosts for this particular volume. In step 415, the cache manager checks the type of a request. For a channel type of a request, the cache manager returns to step 405 to release the channel. For a network type of a request, the cache manager proceeds to release network request in step 419 on the right side of FIG. 4A.
  • On the right side of FIG. 4A, in step 416, network interrupt identifies and receives a remote write request. In step 417, the cache manager calls configuration manager routine to determine the validity of the request. Bad requests are ignored in step 418. Correct requests proceed to step for 410 for write exclusive processing. Step 415 returns the flow to step 419, which releases network resources.
  • FIG. 4B shows a flowchart of the cache manager as it processes a read request in an exclusive mode. In step 420, the cache manager checks whether the requested buffer is in cache or not. For a cache miss, in step 421, the cache manager allocates a buffer for storing data that will be read in. In step 422, the cache manager updates the buffer status with read pending. In step 423, the cache manager starts an operation to read from a hard disk driver and proceeds to release the channel in step 405. For a cache hit, in step 424, the cache manager transmits read data and proceeds to release the channel in step 405. For an identified network request, in step 425, the cache manager sends back read results in step 429.
  • On the right side of FIG. 4B, in step 426, network interrupt identifies and receives a remote read request. In step 427, the cache manager calls a configuration manager routine that checks the configuration file and ignores bad requests in step 428. Correct requests proceed to step 420 for read exclusive processing. Step 425 returns the flow to step 429 that sends read results.
  • FIG. 4C shows a flowchart of the cache manager as it processes a write request in a shared mode. In step 430, the cache manager checks whether the requested buffer is in cache or not. For a cache miss, in step 431, the cache manager allocates a new buffer for storing data that will be written. For a cache hit, the cache manager branches directly to step 432 where data is copied into the newly allocated buffer. In step 433, the cache manager updates the buffer status with write pending and proceeds to step 434 to release the channel. In step 435, the cache manager calls a configuration manager routine that sends a remote write request to the host that holds this particular volume in an exclusive mode. In follow up to step 435, the cache manager returns to the beginning of FIG. 4.
  • On the right side of FIG. 4C, the cache manager updates the buffer status with write done in step 444. The flow begins with the network interrupt that calls configuration manager to validate the request in step 441. Bad requests are ignored in step 442. A correct request proceeds to step 443 that checks whether the status of this particular buffer is write pending. If the status is pending, in step 444, the cache manager updates the buffer status to write done. For any other buffer status, in step 445, the cache manager updates the status to free. This buffer is released in accordance with the invalidate request that has come from a remote host that holds this volume in an exclusive mode as has been described in FIG. 4A.
  • FIG. 4D shows a flowchart of the cache manager as it processes a read request in a shared mode. In step 450, the cache manager checks whether the requested buffer is in cache or not. For a cache miss, in step 452, the cache manager allocates a buffer for storing data that will be read into. For a cache hit, in step 451, the cache manager transmits read data and proceeds to step 405 to release the channel. In the case of the cache miss, the cache manager allocates a new buffer in step 452 and updates its status to read pending in step 453. In step 454, the cache manager closes the channel with an optimizer that maintains a pool of open channels which are kept open only for the specified amount of time. In step 455, the cache manager calls configuration manager routine that sends a remote read request to the host that holds this particular volume in an exclusive mode. The operations of the host holding volume in read exclusive mode have been shown in FIG. 4B.
  • On the right side of FIG. 4D, in step 456, a network interrupt identifies a remote read result. In step 457, the cache manager performs an optimized channel open. Depending upon the status of the optimizer that has been initiated in step 454, the cache manager may immediately get access to the still open channel or, if the optimizer fails, the cache manager may need to reopen the channel. In step 458, the cache manager transmits read data. In step 459, the cache manager updates the buffer status to read done and proceeds to step 459 where it releases the channel.
  • FIG. 4E shows a flowchart of the cache manager as it processes a hard disk interrupt request marking the completion of a read or write request. The read request has been started in step 423 in FIG. 4B. The write request has been started in step 475 in FIG. 4F. In step 460, the cache manager checks the type of the hardware interrupt. For a write interrupt in step 461, the cache manager updates the buffer status to write done and releases resources associated with the interrupt. For a read interrupt in step 462, the cache manager updates the buffer status to read done. In step 463, the cache manager checks request type of the read operation that has been started in FIG. 4B. For a channel request, the cache manager proceeds to open a channel in step 466. In step 467, the cache manager transmits read data and proceeds to release the channel in step 405. For a network request in step 464, the cache manager finds the remote read requests that initiated the request. In step 466, the cache manager sends read results and ends interrupt processing.
  • FIG. 4F shows a flowchart of a cache memory page flusher. The flusher is a separate daemon running as part of the cache manager. In step 471, the flusher waits for the specified amount of time. After the delay in step 472, the flusher begins to scan pages in cached memory. In step 473, the flusher checks the page status. If the page list has been exhausted in branch no more pages, the flusher returns to step 471 where it waits. If the page status is other than the write pending, the flusher returns to step 472 to continue scanning for more pages. If the page status is write pending, the flusher proceeds to step 474. In step 474, the flusher checks the request type. For a channel type, the flusher starts a read operation in step 475 and returns to scan pages in step 472. For a network type, the flusher checks for the network operations in progress and returns to step 472 for more pages.
  • FIG. 5 shows a data sharing operation between a plurality of heterogeneous host computers. In one embodiment the plurality of hosts includes but is not limited to a Sun Solaris workstation 111, Windows NT server 112, HP UNIX 106, and Digital UNIX 107 each accessing a distinct virtual device respectively 510, 520, 530 and 540. Configuration manager 560 provides concurrency control for accessing virtual devices that are mapped to the same physical device 161. The configuration manager uses a volume access table 450 that has been shown in FIG. 4.
  • A virtual device is a method that comprises three operations: initialization, read and write. The initialization operation registers a virtual device in an operating system on a heterogeneous host. Following the registration, the virtual device appears as if it is another physical device that can be brought on-line, offline or mounted on a file system. An application program running on the host cannot distinguish between a virtual device and a physical device.
  • For a virtual device, the read operation begins with a read from a physical device followed by a call to a translation module. The translation, module inputs a shared record in a original format used on a physical disk and outputs the record in a new format that is specified for and is compatible with a host computer. The write operation begins with a call to a translation module that inputs a record in a new format and outputs a record in a shared format. The translation module is a dynamically loadable library that can be changed, compiled and linked at run-time.
  • The virtual device method described above allows a plurality of heterogeneous host computers to share one copy of data stored on a physical disk. In a data storage system using said virtual device method, a plurality of virtual devices is maintained in cache without requiring a copy of data on a physical disk.
  • While the invention has been described in connection with a preferred embodiment, it is not intended to limit the scope of the invention to the particular form set forth.

Claims (17)

1. A data storage system for use in a first computer connected to a network comprising a plurality of other computers, each computer on the network storing data in a respective data format, the storage system comprising:
(1) management software enabling any other computer connected to the network to access data stored on the first computer; and
(2) translation software for translating the accessed data into a format compatible with the other computer.
2. The system of claim 1 wherein:
(1) the management software further enables any other computer to store data on the first computer; and
(2) the translation software further facilitates translating data from the other computer into a format compatible with the first computer.
3. The system of claim 2 wherein the data on the first computer is stored in a cache memory.
4. The system of claim 3 wherein the cache memory comprises a portion of a distributed cache memory stored in the first computer and the other computers on the network.
5. The system of claim 1 wherein the computers comprise off-the-shelf hardware and operating systems.
6. The system of claim 5 wherein the management software includes a configuration manager that employs a file system from the off-the-shelf operating system.
7. The system of claim 6 wherein:
(1) at least some of the computers comprise at least one storage device; and
(2) the file system manages at least some of the storage devices on other computers as virtual data storage devices.
8. The system of claim 6 wherein:
(1) each storage device comprises a mappable data volume; and
(2) the configuration manager includes a configuration file providing mapping between data volumes referenced by computers on the network and data volumes of the first computer.
9. A data sharing system for use in a first computer connected to a network comprising a plurality of other computers, each computer on the network storing data in a respective data format, the sharing system comprising a plurality of computers intercommunicating on the computer network, each computer comprising a virtual device that itself comprises a translation module for translating between a native data format and a data format of at least one other computer connected to the network.
10. The system of claim 9 wherein each computer further comprises a configuration manager program for providing concurrency control for accessing the virtual device.
11. The system of claim 10 further comprising a volume access table employed by the configuration manager.
12. The system of claim 10 wherein each virtual device further comprises:
(1) an initialization means for registering the virtual device in at least one other computer connected to the network;
(2) a read means for allowing the first computer to access data stored on at least one other computer connected to the network using the translation module as an intermediary; and
(3) a write means for allowing at least one other computer to store data on the first computer in a shared data format using the translation module as an intermediary.
13. A method of storing and retrieving data in a first computer connected to a network comprising a plurality of other computers, each computer on the network storing data in a respective data format, the method comprising the steps of:
(1) receiving on the first computer a data request from a second computer over the network;
(2) causing the first computer to respond to the request by translating the requested data into a format compatible with the second computer; and
(3) causing the first computer to make the translated data available to the second computer.
14. The method of claim 13 wherein the data on the first computer is stored in a cache memory.
15. The method of claim 14 wherein the cache memory comprises a portion of a distributed cache memory located in the first computer and the other computers on the network.
16. The method of claim 13 wherein the computers comprise off-the-shelf hardware and operating systems.
17. The method of claim 16 wherein the first computer comprises management software including a configuration manager that employs a file system from the off-the-shelf operating system.
US13/527,126 1999-01-22 2012-06-19 Data Storage and Data Sharing in a Network of Heterogeneous Computers Abandoned US20120259953A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
US13/527,126 US20120259953A1 (en) 1999-01-22 2012-06-19 Data Storage and Data Sharing in a Network of Heterogeneous Computers
US14/997,327 US10154092B2 (en) 1999-01-22 2016-01-15 Data sharing using distributed cache in a network of heterogeneous computers
US15/440,277 US9811463B2 (en) 1999-01-22 2017-02-23 Apparatus including an I/O interface and a network interface and related method of use
US16/180,657 US20190075163A1 (en) 1999-01-22 2018-11-05 Apparatus including an i/o interface and a network interface and related method of use

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US09/236,409 US6549988B1 (en) 1999-01-22 1999-01-22 Data storage system comprising a network of PCs and method using same
US10/382,016 US8225002B2 (en) 1999-01-22 2003-03-05 Data storage and data sharing in a network of heterogeneous computers
US13/527,126 US20120259953A1 (en) 1999-01-22 2012-06-19 Data Storage and Data Sharing in a Network of Heterogeneous Computers

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US10/382,016 Continuation US8225002B2 (en) 1999-01-22 2003-03-05 Data storage and data sharing in a network of heterogeneous computers

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US14/997,327 Continuation US10154092B2 (en) 1999-01-22 2016-01-15 Data sharing using distributed cache in a network of heterogeneous computers

Publications (1)

Publication Number Publication Date
US20120259953A1 true US20120259953A1 (en) 2012-10-11

Family

ID=46282086

Family Applications (5)

Application Number Title Priority Date Filing Date
US10/382,016 Expired - Fee Related US8225002B2 (en) 1999-01-22 2003-03-05 Data storage and data sharing in a network of heterogeneous computers
US13/527,126 Abandoned US20120259953A1 (en) 1999-01-22 2012-06-19 Data Storage and Data Sharing in a Network of Heterogeneous Computers
US14/997,327 Expired - Fee Related US10154092B2 (en) 1999-01-22 2016-01-15 Data sharing using distributed cache in a network of heterogeneous computers
US15/440,277 Expired - Fee Related US9811463B2 (en) 1999-01-22 2017-02-23 Apparatus including an I/O interface and a network interface and related method of use
US16/180,657 Abandoned US20190075163A1 (en) 1999-01-22 2018-11-05 Apparatus including an i/o interface and a network interface and related method of use

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US10/382,016 Expired - Fee Related US8225002B2 (en) 1999-01-22 2003-03-05 Data storage and data sharing in a network of heterogeneous computers

Family Applications After (3)

Application Number Title Priority Date Filing Date
US14/997,327 Expired - Fee Related US10154092B2 (en) 1999-01-22 2016-01-15 Data sharing using distributed cache in a network of heterogeneous computers
US15/440,277 Expired - Fee Related US9811463B2 (en) 1999-01-22 2017-02-23 Apparatus including an I/O interface and a network interface and related method of use
US16/180,657 Abandoned US20190075163A1 (en) 1999-01-22 2018-11-05 Apparatus including an i/o interface and a network interface and related method of use

Country Status (1)

Country Link
US (5) US8225002B2 (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160134702A1 (en) * 1999-01-22 2016-05-12 Ilya Gertner Data sharing using distributed cache in a network of heterogeneous computers
US9882906B2 (en) 2014-12-12 2018-01-30 International Business Machines Corporation Recommendation schema for storing data in a shared data storage network
US20220103490A1 (en) * 2020-09-28 2022-03-31 Vmware, Inc. Accessing multiple external storages to present an emulated local storage through a nic
US11593278B2 (en) 2020-09-28 2023-02-28 Vmware, Inc. Using machine executing on a NIC to access a third party storage not supported by a NIC or host
US11606310B2 (en) 2020-09-28 2023-03-14 Vmware, Inc. Flow processing offload using virtual port identifiers
US11636053B2 (en) 2020-09-28 2023-04-25 Vmware, Inc. Emulating a local storage by accessing an external storage through a shared port of a NIC
US11829793B2 (en) 2020-09-28 2023-11-28 Vmware, Inc. Unified management of virtual machines and bare metal computers
US11863376B2 (en) 2021-12-22 2024-01-02 Vmware, Inc. Smart NIC leader election
US11899594B2 (en) 2022-06-21 2024-02-13 VMware LLC Maintenance of data message classification cache on smart NIC
US11928367B2 (en) 2022-06-21 2024-03-12 VMware LLC Logical memory addressing for network devices

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AR033067A1 (en) * 2001-03-22 2003-12-03 United Video Properties Inc PROVISIONS AND METHODS TO PROVIDE FUNCTIONS OF PERSONAL VIDEO RECORDER
US7222173B2 (en) * 2003-02-10 2007-05-22 International Business Machines Corporation Limited knowledge of configuration information of a FICON controller
US7770059B1 (en) * 2004-03-26 2010-08-03 Emc Corporation Failure protection in an environment including virtualization of networked storage resources
US7380071B2 (en) * 2005-03-29 2008-05-27 International Business Machines Corporation Snoop filtering system in a multiprocessor system
US7464126B2 (en) * 2005-07-21 2008-12-09 International Business Machines Corporation Method for creating an application-consistent remote copy of data using remote mirroring
US7889670B2 (en) * 2008-09-22 2011-02-15 Qwest Communications International, Inc. Dynamic modem bandwidth checking
US9178935B2 (en) * 2009-03-05 2015-11-03 Paypal, Inc. Distributed steam processing
CN110572882B (en) 2017-08-11 2021-03-05 华为技术有限公司 Communication method, device, computer storage medium and communication system
KR102444208B1 (en) * 2017-10-19 2022-09-19 에스케이하이닉스 주식회사 Storage device and operating method thereof
US11153382B2 (en) * 2018-06-29 2021-10-19 International Business Machines Corporation Isolation of management data for security and operational advantages
CN109212379A (en) * 2018-10-16 2019-01-15 深圳美特优科技有限公司 A kind of smart electric grid system
US11012511B1 (en) * 2020-01-14 2021-05-18 Facebook, Inc. Smart network interface controller for caching distributed data
US11709611B2 (en) 2021-10-26 2023-07-25 SambaNova Systems, Inc. Determining and using memory unit partitioning solutions for reconfigurable dataflow computing systems

Citations (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4648030A (en) * 1983-09-22 1987-03-03 Digital Equipment Corporation Cache invalidation mechanism for multiprocessor systems
US5251311A (en) * 1989-10-12 1993-10-05 Nec Corporation Method and apparatus for processing information and providing cache invalidation information
US5577204A (en) * 1993-12-15 1996-11-19 Convex Computer Corporation Parallel processing computer system interconnections utilizing unidirectional communication links with separate request and response lines for direct communication or using a crossbar switching device
US5761734A (en) * 1996-08-13 1998-06-02 International Business Machines Corporation Token-based serialisation of instructions in a multiprocessor system
US5768211A (en) * 1996-07-31 1998-06-16 Cypress Semiconductor Corporation Multi-port arbitration for high performance width expansion
US5778353A (en) * 1994-05-20 1998-07-07 International Business Machines Corporation Computer program product for optimizing data retrieval using index scanning
US6101497A (en) * 1996-05-31 2000-08-08 Emc Corporation Method and apparatus for independent and simultaneous access to a common data set
US6101508A (en) * 1997-08-01 2000-08-08 Hewlett-Packard Company Clustered file management for network resources
US6119151A (en) * 1994-03-07 2000-09-12 International Business Machines Corp. System and method for efficient cache management in a distributed file system
US6311186B1 (en) * 1998-02-20 2001-10-30 Priority Call Management, Inc. Telecommunications switching system utilizing a channelized database access mechanism
US20020002625A1 (en) * 2000-04-17 2002-01-03 Mark Vange System and method for reformatting data traffic
US6341311B1 (en) * 1998-05-29 2002-01-22 Microsoft Corporation Directing data object access requests in a distributed cache
US20030126372A1 (en) * 2002-01-02 2003-07-03 Rand Tony S. Cache coherency arrangement to enhance inbound bandwidth
US20040022094A1 (en) * 2002-02-25 2004-02-05 Sivakumar Radhakrishnan Cache usage for concurrent multiple streams
US7003587B1 (en) * 1996-07-18 2006-02-21 Computer Associates Think, Inc. Method and apparatus for maintaining data integrity across distributed computer systems
US7072056B1 (en) * 2000-05-15 2006-07-04 Hewlett-Packard Development Company, L.P. Apparatus and method for translating and sending digital information to different types of receiving devices
US7254617B2 (en) * 2002-12-06 2007-08-07 Scott Ruple Distributed cache between servers of a network
US7293099B1 (en) * 1998-09-29 2007-11-06 Sun Microsystems, Inc. Heterogeneous network file access
US7739379B1 (en) * 1997-09-26 2010-06-15 Emc Corporation Network file server sharing local caches of file access information in data processors assigned to respective file systems
US7864758B1 (en) * 2001-09-28 2011-01-04 Emc Corporation Virtualization in a storage system

Family Cites Families (77)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS55112651A (en) 1979-02-21 1980-08-30 Fujitsu Ltd Virtual computer system
JPS62145340A (en) * 1985-12-20 1987-06-29 Toshiba Corp Cache memory control system
US4933846A (en) * 1987-04-24 1990-06-12 Network Systems Corporation Network communications adapter with dual interleaved memory banks servicing multiple processors
US5222224A (en) * 1989-02-03 1993-06-22 Digital Equipment Corporation Scheme for insuring data consistency between a plurality of cache memories and the main memory in a multi-processor system
US5091412A (en) 1990-02-16 1992-02-25 Harbor Branch Oceanographic Institution, Inc. Novel antiviral terpene hydroquinones and methods of use
US5544347A (en) 1990-09-24 1996-08-06 Emc Corporation Data storage system controlled remote data mirroring with respectively maintained data indices
JPH07504527A (en) 1992-03-09 1995-05-18 オースペックス システムズ インコーポレイテッド High performance non-volatile RAM protected write cache accelerator system
US5319766A (en) * 1992-04-24 1994-06-07 Digital Equipment Corporation Duplicate tag store for a processor having primary and backup cache memories in a multiprocessor computer system
US5611049A (en) * 1992-06-03 1997-03-11 Pitts; William M. System for accessing distributed data cache channel at each network node to pass requests and data
US5410653A (en) 1992-06-16 1995-04-25 International Business Machines Corporation Asynchronous read-ahead disk caching using multiple disk I/O processes and dynamically variable prefetch length
JPH0695898A (en) 1992-09-16 1994-04-08 Hitachi Ltd Control method for virtual computer and virtual computer system
JPH06187178A (en) 1992-12-18 1994-07-08 Hitachi Ltd Input and output interruption control method for virtual computer system
DE69425658T2 (en) 1993-06-03 2001-04-19 Network Appliance Inc ARRANGEMENT OF A FILE SYSTEM FOR DESCRIBING ANY AREAS
US5748985A (en) 1993-06-15 1998-05-05 Hitachi, Ltd. Cache control method and cache controller
US5598551A (en) * 1993-07-16 1997-01-28 Unisys Corporation Cache invalidation sequence system utilizing odd and even invalidation queues with shorter invalidation cycles
DE4330797A1 (en) 1993-09-10 1995-03-16 Gruenzweig & Hartmann Device and method for fiberizing optically dense glass melts
US5805857A (en) 1994-04-07 1998-09-08 International Business Machines Corporation DASD capacity in excess of 528 megabytes apparatus and method for personal computers
US5577226A (en) 1994-05-06 1996-11-19 Eec Systems, Inc. Method and system for coherently caching I/O devices across a network
US5644751A (en) 1994-10-03 1997-07-01 International Business Machines Corporation Distributed file system (DFS) cache management based on file access characteristics
US5649152A (en) 1994-10-13 1997-07-15 Vinca Corporation Method and system for providing a static snapshot of data stored on a mass storage system
US5659794A (en) * 1995-03-31 1997-08-19 Unisys Corporation System architecture for improved network input/output processing
JP2766216B2 (en) 1995-05-08 1998-06-18 甲府日本電気株式会社 Information processing device
US5715455A (en) 1995-05-18 1998-02-03 International Business Machines Corporation Apparatus and method for storing file allocation table efficiently in memory
US5860137A (en) 1995-07-21 1999-01-12 Emc Corporation Dynamic load balancing
US5887146A (en) 1995-08-14 1999-03-23 Data General Corporation Symmetric multiprocessing computer with non-uniform memory access architecture
US5751993A (en) 1995-09-05 1998-05-12 Emc Corporation Cache management system
US5592432A (en) 1995-09-05 1997-01-07 Emc Corp Cache management system using time stamping for replacement queue
US5841997A (en) 1995-09-29 1998-11-24 Emc Corporation Apparatus for effecting port switching of fibre channel loops
US5828475A (en) 1995-10-25 1998-10-27 Mcdata Corporation Bypass switching and messaging mechanism for providing intermix data transfer for a fiber optic switch using a bypass bus and buffer
US6151618A (en) 1995-12-04 2000-11-21 Microsoft Corporation Safe general purpose virtual machine computing system
US5802553A (en) 1995-12-19 1998-09-01 Intel Corporation File system configured to support variable density storage and data compression within a nonvolatile memory
US5898828A (en) * 1995-12-29 1999-04-27 Emc Corporation Reduction of power used by transceivers in a data transmission loop
US6026485A (en) 1996-01-24 2000-02-15 Sun Microsystems, Inc. Instruction folding for a stack-based machine
US5717884A (en) 1996-02-02 1998-02-10 Storage Technology Corporation Method and apparatus for cache management
US5758050A (en) 1996-03-12 1998-05-26 International Business Machines Corporation Reconfigurable data storage system
US5852715A (en) 1996-03-19 1998-12-22 Emc Corporation System for currently updating database by one host and reading the database by different host for the purpose of implementing decision support functions
US5802569A (en) * 1996-04-22 1998-09-01 International Business Machines Corp. Computer system having cache prefetching amount based on CPU request types
US5819310A (en) 1996-05-24 1998-10-06 Emc Corporation Method and apparatus for reading data from mirrored logical volumes on physical disk drives
US5901327A (en) * 1996-05-28 1999-05-04 Emc Corporation Bundling of write data from channel commands in a command chain for transmission over a data link between data storage systems for remote data mirroring
US5896506A (en) * 1996-05-31 1999-04-20 International Business Machines Corporation Distributed storage management system having a cache server and method therefor
US5790795A (en) 1996-07-01 1998-08-04 Sun Microsystems, Inc. Media server system which employs a SCSI bus and which utilizes SCSI logical units to differentiate between transfer modes
US5848251A (en) 1996-08-06 1998-12-08 Compaq Computer Corporation Secondary channel for command information for fibre channel system interface bus
US5900015A (en) * 1996-08-09 1999-05-04 International Business Machines Corporation System and method for maintaining cache coherency using path directories
US5787469A (en) * 1996-09-06 1998-07-28 Intel Corporation System and method for exclusively writing tag during write allocate requests
US5854942A (en) 1996-09-06 1998-12-29 International Business Machines Corporation Method and system for automatic storage subsystem configuration
US5832529A (en) * 1996-10-11 1998-11-03 Sun Microsystems, Inc. Methods, apparatus, and product for distributed garbage collection
US5913029A (en) 1997-02-07 1999-06-15 Portera Systems Distributed database system and method
US5974503A (en) * 1997-04-25 1999-10-26 Emc Corporation Storage and access of continuous media files indexed as lists of raid stripe sets associated with file names
JP4134357B2 (en) * 1997-05-15 2008-08-20 株式会社日立製作所 Distributed data management method
US6044438A (en) 1997-07-10 2000-03-28 International Business Machiness Corporation Memory controller for controlling memory accesses across networks in distributed shared memory processing systems
US6389479B1 (en) * 1997-10-14 2002-05-14 Alacritech, Inc. Intelligent network interface device and system for accelerated communication
US6226680B1 (en) * 1997-10-14 2001-05-01 Alacritech, Inc. Intelligent network interface system method for protocol processing
US7076568B2 (en) * 1997-10-14 2006-07-11 Alacritech, Inc. Data communication apparatus for computer intelligent network interface card which transfers data between a network and a storage device according designated uniform datagram protocol socket
US6185609B1 (en) 1997-10-24 2001-02-06 Sun Microsystems, Inc. Method, apparatus and program to provide client access to a management information service residing on a server in a computer network system
US6260077B1 (en) 1997-10-24 2001-07-10 Sun Microsystems, Inc. Method, apparatus and program product for interfacing a multi-threaded, client-based API to a single-threaded, server-based API
US6256637B1 (en) 1998-05-05 2001-07-03 Gemstone Systems, Inc. Transactional virtual machine architecture
US6496847B1 (en) 1998-05-15 2002-12-17 Vmware, Inc. System and method for virtualizing computer systems
US6397242B1 (en) 1998-05-15 2002-05-28 Vmware, Inc. Virtualization system including a virtual machine monitor for a computer with a segmented architecture
US6295575B1 (en) * 1998-06-29 2001-09-25 Emc Corporation Configuring vectors of logical storage units for data storage partitioning and sharing
US6421711B1 (en) * 1998-06-29 2002-07-16 Emc Corporation Virtual ports for data transferring of a data storage system
US6260120B1 (en) * 1998-06-29 2001-07-10 Emc Corporation Storage mapping and partitioning among multiple host processors in the presence of login state changes and host controller replacement
JP2000029635A (en) * 1998-07-08 2000-01-28 Hitachi Ltd Storage controller
US6711632B1 (en) * 1998-08-11 2004-03-23 Ncr Corporation Method and apparatus for write-back caching with minimal interrupts
US7664883B2 (en) * 1998-08-28 2010-02-16 Alacritech, Inc. Network interface device that fast-path processes solicited session layer read commands
US8631066B2 (en) 1998-09-10 2014-01-14 Vmware, Inc. Mechanism for providing virtual machines for use by multiple users
US6438652B1 (en) * 1998-10-09 2002-08-20 International Business Machines Corporation Load balancing cooperating cache servers by shifting forwarded request
US6253260B1 (en) * 1998-10-22 2001-06-26 International Business Machines Corporation Input/output data access request with assigned priority handling
JP2002531893A (en) 1998-11-30 2002-09-24 シーベル システムズ,インコーポレイティド Client server system with small and light client architecture
US6549988B1 (en) * 1999-01-22 2003-04-15 Ilya Gertner Data storage system comprising a network of PCs and method using same
US8225002B2 (en) * 1999-01-22 2012-07-17 Network Disk, Inc. Data storage and data sharing in a network of heterogeneous computers
US6457047B1 (en) * 2000-05-08 2002-09-24 Verity, Inc. Application caching system and method
US7188251B1 (en) * 2000-05-09 2007-03-06 Sun Microsystems, Inc. System and method for secure message-based leasing of resources in a distributed computing environment
US6850980B1 (en) * 2000-06-16 2005-02-01 Cisco Technology, Inc. Content routing service protocol
US6785714B1 (en) * 2000-09-28 2004-08-31 Microsoft Corporation System and method for employing slot level locking of a cache
JP2002366416A (en) * 2001-06-12 2002-12-20 Fujitsu Ltd Data distribution system, network cache device, data distribution server and access server
US6829637B2 (en) * 2001-07-26 2004-12-07 International Business Machines Corporation Distributed shared memory for server clusters
US7133905B2 (en) * 2002-04-09 2006-11-07 Akamai Technologies, Inc. Method and system for tiered distribution in a content delivery network

Patent Citations (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4648030A (en) * 1983-09-22 1987-03-03 Digital Equipment Corporation Cache invalidation mechanism for multiprocessor systems
US5251311A (en) * 1989-10-12 1993-10-05 Nec Corporation Method and apparatus for processing information and providing cache invalidation information
US5577204A (en) * 1993-12-15 1996-11-19 Convex Computer Corporation Parallel processing computer system interconnections utilizing unidirectional communication links with separate request and response lines for direct communication or using a crossbar switching device
US6119151A (en) * 1994-03-07 2000-09-12 International Business Machines Corp. System and method for efficient cache management in a distributed file system
US5778353A (en) * 1994-05-20 1998-07-07 International Business Machines Corporation Computer program product for optimizing data retrieval using index scanning
US20030069889A1 (en) * 1996-05-31 2003-04-10 Yuval Ofek Method and apparatus for independent and simultaneous access to a common data set
US6101497A (en) * 1996-05-31 2000-08-08 Emc Corporation Method and apparatus for independent and simultaneous access to a common data set
US7003587B1 (en) * 1996-07-18 2006-02-21 Computer Associates Think, Inc. Method and apparatus for maintaining data integrity across distributed computer systems
US5768211A (en) * 1996-07-31 1998-06-16 Cypress Semiconductor Corporation Multi-port arbitration for high performance width expansion
US5761734A (en) * 1996-08-13 1998-06-02 International Business Machines Corporation Token-based serialisation of instructions in a multiprocessor system
US6101508A (en) * 1997-08-01 2000-08-08 Hewlett-Packard Company Clustered file management for network resources
US7739379B1 (en) * 1997-09-26 2010-06-15 Emc Corporation Network file server sharing local caches of file access information in data processors assigned to respective file systems
US6311186B1 (en) * 1998-02-20 2001-10-30 Priority Call Management, Inc. Telecommunications switching system utilizing a channelized database access mechanism
US6341311B1 (en) * 1998-05-29 2002-01-22 Microsoft Corporation Directing data object access requests in a distributed cache
US7293099B1 (en) * 1998-09-29 2007-11-06 Sun Microsystems, Inc. Heterogeneous network file access
US20020002625A1 (en) * 2000-04-17 2002-01-03 Mark Vange System and method for reformatting data traffic
US7072056B1 (en) * 2000-05-15 2006-07-04 Hewlett-Packard Development Company, L.P. Apparatus and method for translating and sending digital information to different types of receiving devices
US7864758B1 (en) * 2001-09-28 2011-01-04 Emc Corporation Virtualization in a storage system
US20030126372A1 (en) * 2002-01-02 2003-07-03 Rand Tony S. Cache coherency arrangement to enhance inbound bandwidth
US20040022094A1 (en) * 2002-02-25 2004-02-05 Sivakumar Radhakrishnan Cache usage for concurrent multiple streams
US7254617B2 (en) * 2002-12-06 2007-08-07 Scott Ruple Distributed cache between servers of a network

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160134702A1 (en) * 1999-01-22 2016-05-12 Ilya Gertner Data sharing using distributed cache in a network of heterogeneous computers
US20170161189A1 (en) * 1999-01-22 2017-06-08 Ls Cloud Storage Technologies, Llc Apparatus including an i/o interface and a network interface and related method of use
US9811463B2 (en) * 1999-01-22 2017-11-07 Ls Cloud Storage Technologies, Llc Apparatus including an I/O interface and a network interface and related method of use
US10154092B2 (en) * 1999-01-22 2018-12-11 Ls Cloud Storage Technologies, Llc Data sharing using distributed cache in a network of heterogeneous computers
US9882906B2 (en) 2014-12-12 2018-01-30 International Business Machines Corporation Recommendation schema for storing data in a shared data storage network
US11736566B2 (en) 2020-09-28 2023-08-22 Vmware, Inc. Using a NIC as a network accelerator to allow VM access to an external storage via a PF module, bus, and VF module
US11792134B2 (en) 2020-09-28 2023-10-17 Vmware, Inc. Configuring PNIC to perform flow processing offload using virtual port identifiers
US11606310B2 (en) 2020-09-28 2023-03-14 Vmware, Inc. Flow processing offload using virtual port identifiers
US11636053B2 (en) 2020-09-28 2023-04-25 Vmware, Inc. Emulating a local storage by accessing an external storage through a shared port of a NIC
US11716383B2 (en) * 2020-09-28 2023-08-01 Vmware, Inc. Accessing multiple external storages to present an emulated local storage through a NIC
US20220103490A1 (en) * 2020-09-28 2022-03-31 Vmware, Inc. Accessing multiple external storages to present an emulated local storage through a nic
US11736565B2 (en) 2020-09-28 2023-08-22 Vmware, Inc. Accessing an external storage through a NIC
US11593278B2 (en) 2020-09-28 2023-02-28 Vmware, Inc. Using machine executing on a NIC to access a third party storage not supported by a NIC or host
US11824931B2 (en) 2020-09-28 2023-11-21 Vmware, Inc. Using physical and virtual functions associated with a NIC to access an external storage through network fabric driver
US11829793B2 (en) 2020-09-28 2023-11-28 Vmware, Inc. Unified management of virtual machines and bare metal computers
US11875172B2 (en) 2020-09-28 2024-01-16 VMware LLC Bare metal computer for booting copies of VM images on multiple computing devices using a smart NIC
US11863376B2 (en) 2021-12-22 2024-01-02 Vmware, Inc. Smart NIC leader election
US11899594B2 (en) 2022-06-21 2024-02-13 VMware LLC Maintenance of data message classification cache on smart NIC
US11928367B2 (en) 2022-06-21 2024-03-12 VMware LLC Logical memory addressing for network devices
US11928062B2 (en) 2022-06-21 2024-03-12 VMware LLC Accelerating data message classification with smart NICs

Also Published As

Publication number Publication date
US20170161189A1 (en) 2017-06-08
US8225002B2 (en) 2012-07-17
US20160134702A1 (en) 2016-05-12
US9811463B2 (en) 2017-11-07
US20030145114A1 (en) 2003-07-31
US20190075163A1 (en) 2019-03-07
US10154092B2 (en) 2018-12-11

Similar Documents

Publication Publication Date Title
US9811463B2 (en) Apparatus including an I/O interface and a network interface and related method of use
US8572352B2 (en) Virtualization controller and data transfer control method
EP0789877B1 (en) System and method for on-line, real-time, data migration
EP1489524B1 (en) Storage area network with a cache server
US7152149B2 (en) Disk array apparatus and control method for disk array apparatus
US7100089B1 (en) Determining differences between snapshots
US7743031B1 (en) Time and space efficient technique for creating virtual volume copies
US6549988B1 (en) Data storage system comprising a network of PCs and method using same
US20050144223A1 (en) Bottom-up cache structure for storage servers
JP3952640B2 (en) Data backup method, mainframe storage system, and mainframe host computer
JP2005301590A (en) Storage system and data copying method
US11327653B2 (en) Drive box, storage system and data transfer method
US10872036B1 (en) Methods for facilitating efficient storage operations using host-managed solid-state disks and devices thereof
EP0536375A1 (en) Fault tolerant network file system
US6782401B2 (en) Method and apparatus for implementing a reliable open file system
US7299332B1 (en) System and method for managing sessions and allocating memory resources used for replication of data in a data storage environment
JP3848268B2 (en) Computer system, computer apparatus, data access method and program in computer system
US7509465B1 (en) System and method for managing memory or session resources used for movement of data being copied in a data storage environment
US8307174B1 (en) System and method for managing sessions and reallocating memory resources used for replication of data in a data storage environment
JPH07182221A (en) Remote file system and method for managing file
US20050223180A1 (en) Accelerating the execution of I/O operations in a storage system
EP1507207B1 (en) Hierarchical approach to identifying changing device characteristics
JPH07210433A (en) File server

Legal Events

Date Code Title Description
AS Assignment

Owner name: FISH & RICHARDSON P.C., MINNESOTA

Free format text: LIEN;ASSIGNOR:NETWORK DISK, INC.;REEL/FRAME:030252/0041

Effective date: 20130419

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION

AS Assignment

Owner name: NETWORK DISK, INC., CALIFORNIA

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:FISH & RICHARDSON P.C.;REEL/FRAME:039493/0809

Effective date: 20130419

AS Assignment

Owner name: GERTNER, ILYA, CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:NETWORK DISK, INC.;REEL/FRAME:039841/0143

Effective date: 20120206

Owner name: NETWORK DISK, INC., MASSACHUSETTS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:GERTNER, ILYA;REEL/FRAME:039841/0066

Effective date: 20040805

Owner name: SPOT ON CORP., NEVADA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:GERTNER, ILYA;REEL/FRAME:039841/0292

Effective date: 20160601

Owner name: NETWORK DISK, INC., CALIFORNIA

Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE EXECUTION DATE OF THE RELEASE OF SECURITY INTEREST PREVIOUSLY RECORDED ON REEL 039493 FRAME 0809. ASSIGNOR(S) HEREBY CONFIRMS THE EXECUTION DATE OF THE RELEASE OF SECURITY INTEREST SHOULD BE 08/23/2016;ASSIGNOR:FISH & RICHARDSON P.C.;REEL/FRAME:040125/0223

Effective date: 20160823

AS Assignment

Owner name: LS CLOUD STORAGE TECHNOLOGIES, LLC, TEXAS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SPOT ON CORP.;REEL/FRAME:040124/0630

Effective date: 20161006