WO2003071419A3 - Fast path for performing data operations - Google Patents

Fast path for performing data operations Download PDF

Info

Publication number
WO2003071419A3
WO2003071419A3 PCT/US2002/039232 US0239232W WO03071419A3 WO 2003071419 A3 WO2003071419 A3 WO 2003071419A3 US 0239232 W US0239232 W US 0239232W WO 03071419 A3 WO03071419 A3 WO 03071419A3
Authority
WO
WIPO (PCT)
Prior art keywords
path
data operations
fast path
control path
handling
Prior art date
Application number
PCT/US2002/039232
Other languages
French (fr)
Other versions
WO2003071419A2 (en
Inventor
Richard Testardi
Original Assignee
Incipient Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US10/218,098 external-priority patent/US7173929B1/en
Priority claimed from US10/218,195 external-priority patent/US6959373B2/en
Priority claimed from US10/218,192 external-priority patent/US6986015B2/en
Priority claimed from US10/218,186 external-priority patent/US6973549B1/en
Priority claimed from US10/218,189 external-priority patent/US7013379B1/en
Application filed by Incipient Inc filed Critical Incipient Inc
Priority to EP02806874A priority Critical patent/EP1532520A2/en
Priority to AU2002366270A priority patent/AU2002366270A1/en
Publication of WO2003071419A2 publication Critical patent/WO2003071419A2/en
Publication of WO2003071419A3 publication Critical patent/WO2003071419A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/062—Securing storage systems
    • G06F3/0622—Securing storage systems in relation to access
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/16—Error detection or correction of the data by redundancy in hardware
    • G06F11/20—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
    • G06F11/2053—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant
    • G06F11/2056—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant by mirroring
    • G06F11/2082—Data synchronisation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/16—Error detection or correction of the data by redundancy in hardware
    • G06F11/20—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
    • G06F11/2053—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant
    • G06F11/2089—Redundant storage control functionality
    • G06F11/2092—Techniques of failing over between control units
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
    • G06F12/10—Address translation
    • G06F12/1027—Address translation using associative or pseudo-associative address translation means, e.g. translation look-aside buffer [TLB]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0629—Configuration or reconfiguration of storage systems
    • G06F3/0635—Configuration or reconfiguration of storage systems by changing the path, e.g. traffic rerouting, path reconfiguration
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0662—Virtualisation aspects
    • G06F3/0665—Virtualisation aspects at area level, e.g. provisioning of virtual or logical volumes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0683—Plurality of storage devices
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operation
    • G06F11/1402—Saving, restoring, recovering or retrying
    • G06F11/1471—Saving, restoring, recovering or retrying involving logging of persistent data for recovery
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F2003/0697—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers device management, e.g. handlers, drivers, I/O schedulers

Abstract

Described are techniques used in a computer system for handling data operations to storage devices. A switching fabric includes one or more fast path for handling lightweigth, common data operations and at least one control path for handling other data operations. A control path manages one or more fast path. The fast path and the control path are utilized in mapping virtual to physical addesses using mapping table. The mapping tables include an extent table of one or more entries corresponding to varying address ranges. The size of an extent may be changed dynamically in accordance with a corresponding state change of physical storage. The fast path may cache only portions of the extent table as needed in accordance with a caching technique. The fast path may cache a subset of the extent table stored within the control path. A set of primitives may be used in performing data operations. A locking mechanism is described for controlling access to data shared by the control path.
PCT/US2002/039232 2001-12-10 2002-12-09 Fast path for performing data operations WO2003071419A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP02806874A EP1532520A2 (en) 2001-12-10 2002-12-09 Fast path for performing data operations
AU2002366270A AU2002366270A1 (en) 2001-12-10 2002-12-09 Fast path for performing data operations

Applications Claiming Priority (14)

Application Number Priority Date Filing Date Title
US34005001P 2001-12-10 2001-12-10
US60/340,050 2001-12-10
US36894002P 2002-03-29 2002-03-29
US60/368,940 2002-03-29
US10/218,098 2002-08-13
US10/218,098 US7173929B1 (en) 2001-12-10 2002-08-13 Fast path for performing data operations
US10/218,195 US6959373B2 (en) 2001-12-10 2002-08-13 Dynamic and variable length extents
US10/218,195 2002-08-13
US10/218,192 US6986015B2 (en) 2001-12-10 2002-08-13 Fast path caching
US10/218,186 US6973549B1 (en) 2001-12-10 2002-08-13 Locking technique for control and synchronization
US10/218,189 2002-08-13
US10/218,189 US7013379B1 (en) 2001-12-10 2002-08-13 I/O primitives
US10/218,192 2002-08-13
US10/218,186 2002-08-13

Publications (2)

Publication Number Publication Date
WO2003071419A2 WO2003071419A2 (en) 2003-08-28
WO2003071419A3 true WO2003071419A3 (en) 2005-03-31

Family

ID=27761690

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2002/039232 WO2003071419A2 (en) 2001-12-10 2002-12-09 Fast path for performing data operations

Country Status (3)

Country Link
EP (1) EP1532520A2 (en)
AU (1) AU2002366270A1 (en)
WO (1) WO2003071419A2 (en)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005115506A (en) * 2003-10-06 2005-04-28 Hitachi Ltd Storage system
US7318134B1 (en) 2004-03-16 2008-01-08 Emc Corporation Continuous data backup using distributed journaling
US7599951B1 (en) 2004-03-25 2009-10-06 Emc Corporation Continuous data backup
US7398348B2 (en) * 2004-08-24 2008-07-08 Sandisk 3D Llc Method and apparatus for using a one-time or few-time programmable memory with a host device designed for erasable/rewritable memory
US7493458B1 (en) 2004-09-15 2009-02-17 Emc Corporation Two-phase snap copy
US8037154B2 (en) * 2005-05-19 2011-10-11 International Business Machines Corporation Asynchronous dual-queue interface for use in network acceleration architecture
US9569322B2 (en) 2014-03-31 2017-02-14 Oracle International Corporation Memory migration in presence of live memory traffic
CN109563684B (en) 2016-08-04 2021-06-18 艾斯登强生股份有限公司 Reinforcing member for industrial textiles
CN111061465B (en) * 2019-11-22 2023-06-13 上海乐白机器人有限公司 Reverse mapping method, system, electronic equipment and storage medium for robot programming
CN113064546B (en) * 2020-01-02 2024-02-09 阿里巴巴集团控股有限公司 File system management method and device, file system and storage medium
CN117093278B (en) * 2023-10-16 2024-03-15 荣耀终端有限公司 Kernel shutdown method, electronic device and storage medium

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5430855A (en) * 1991-02-06 1995-07-04 Storage Technology Corporation Disk drive array memory system using nonuniform disk drives
US5566331A (en) * 1994-01-24 1996-10-15 University Corporation For Atmospheric Research Mass storage system for file-systems
US5634028A (en) * 1994-12-15 1997-05-27 International Business Machines Corporation Compact track address translation mapping system and method
US5712976A (en) * 1994-09-08 1998-01-27 International Business Machines Corporation Video data streamer for simultaneously conveying same one or different ones of data blocks stored in storage node to each of plurality of communication nodes
WO2001033361A1 (en) * 1999-11-01 2001-05-10 Mangosoft Corporation Internet-based shared file service with native pc client access and semantics
GB2357171A (en) * 1999-07-28 2001-06-13 Matsushita Electric Ind Co Ltd A distributed file sysytem for a multimedia storage network
EP1117028A2 (en) * 2000-01-14 2001-07-18 Hitachi, Ltd. Security method and system for storage subsystem
US20010023463A1 (en) * 1990-02-26 2001-09-20 Akira Yamamoto Load distribution of multiple disks
US20010049779A1 (en) * 2000-06-06 2001-12-06 Naoki Shimada Information processing system and storage assigning method

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010023463A1 (en) * 1990-02-26 2001-09-20 Akira Yamamoto Load distribution of multiple disks
US5430855A (en) * 1991-02-06 1995-07-04 Storage Technology Corporation Disk drive array memory system using nonuniform disk drives
US5566331A (en) * 1994-01-24 1996-10-15 University Corporation For Atmospheric Research Mass storage system for file-systems
US5712976A (en) * 1994-09-08 1998-01-27 International Business Machines Corporation Video data streamer for simultaneously conveying same one or different ones of data blocks stored in storage node to each of plurality of communication nodes
US5634028A (en) * 1994-12-15 1997-05-27 International Business Machines Corporation Compact track address translation mapping system and method
GB2357171A (en) * 1999-07-28 2001-06-13 Matsushita Electric Ind Co Ltd A distributed file sysytem for a multimedia storage network
WO2001033361A1 (en) * 1999-11-01 2001-05-10 Mangosoft Corporation Internet-based shared file service with native pc client access and semantics
EP1117028A2 (en) * 2000-01-14 2001-07-18 Hitachi, Ltd. Security method and system for storage subsystem
US20010049779A1 (en) * 2000-06-06 2001-12-06 Naoki Shimada Information processing system and storage assigning method

Also Published As

Publication number Publication date
EP1532520A2 (en) 2005-05-25
WO2003071419A2 (en) 2003-08-28
AU2002366270A1 (en) 2003-09-09
AU2002366270A8 (en) 2003-09-09

Similar Documents

Publication Publication Date Title
US10831672B2 (en) Memory management for a hierarchical memory system
TW259855B (en) Data processing device
WO2003071419A3 (en) Fast path for performing data operations
WO2002008905A3 (en) Emulating a memory management unit and translation look-aside buffer
WO2003001384A3 (en) Fast and accurate cache way selection
EP1622007A3 (en) Information processing apparatus and software pre-fetch control method
WO2009025381A1 (en) I/o system and i/o control method
WO2004095212A3 (en) Memory management in a data processing system
WO2001088720A3 (en) System and method for high-speed substitute cache
TW376488B (en) Virtual memory system with local and global virtual address translation
IL109390A (en) System for disk meshing and flexible storage mapping with enhanced flexible caching
EP0215544A1 (en) Virtual memory address fetching
WO2002086730A3 (en) Multiprocessor system implementing virtual memory using a shared memory, and a page replacement method for maintaining paged memory coherence
GB0118657D0 (en) Multiple address translations
WO2001095113A3 (en) Fabric cache
TW200630797A (en) System and method for virtualization of processor resources
KR20000052480A (en) System and method for cache process
GB2377298A (en) Method for controlling cache system comprising direct-mapped cache and fully-associative buffer
KR20160060550A (en) Page cache device and method for efficient mapping
WO2005066804A3 (en) Virtual to physical address translation
WO2003100600A3 (en) An address generation unit for a processor
WO2003052577A3 (en) Cache storage system and method
JPH06180672A (en) Conversion-index buffer mechanism
US8706975B1 (en) Memory access management block bind system and method
CN109219804A (en) Nonvolatile memory access method, device and system

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ OM PH PL PT RO RU SD SE SG SK SL TJ TM TN TR TT TZ UA UG UZ VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR IE IT LU MC NL PT SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2002806874

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 2002806874

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Country of ref document: JP

WWW Wipo information: withdrawn in national office

Ref document number: 2002806874

Country of ref document: EP