WO2006069178A3 - A method to perform parallel data migration in a clustered storage environment - Google Patents
A method to perform parallel data migration in a clustered storage environment Download PDFInfo
- Publication number
- WO2006069178A3 WO2006069178A3 PCT/US2005/046433 US2005046433W WO2006069178A3 WO 2006069178 A3 WO2006069178 A3 WO 2006069178A3 US 2005046433 W US2005046433 W US 2005046433W WO 2006069178 A3 WO2006069178 A3 WO 2006069178A3
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- parallel data
- data migration
- storage environment
- storage
- logical unit
- Prior art date
Links
- 238000000034 method Methods 0.000 title 1
- 238000013508 migration Methods 0.000 title 1
- 230000005012 migration Effects 0.000 title 1
- 238000013507 mapping Methods 0.000 abstract 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/16—Error detection or correction of the data by redundancy in hardware
- G06F11/1666—Error detection or correction of the data by redundancy in hardware where the redundant component is memory or memory area
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0614—Improving the reliability of storage systems
- G06F3/0617—Improving the reliability of storage systems in relation to availability
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/0647—Migration mechanisms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/16—Error detection or correction of the data by redundancy in hardware
- G06F11/20—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
Abstract
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2007547047A JP2008524724A (en) | 2004-12-20 | 2005-12-20 | How to perform parallel data migration in a clustered storage environment |
EP05855057A EP1839117A2 (en) | 2004-12-20 | 2005-12-20 | A method to perform parallel data migration in a clustered storage environment |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/017,554 | 2004-12-20 | ||
US11/017,554 US7343467B2 (en) | 2004-12-20 | 2004-12-20 | Method to perform parallel data migration in a clustered storage environment |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2006069178A2 WO2006069178A2 (en) | 2006-06-29 |
WO2006069178A3 true WO2006069178A3 (en) | 2006-09-21 |
Family
ID=36190612
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2005/046433 WO2006069178A2 (en) | 2004-12-20 | 2005-12-20 | A method to perform parallel data migration in a clustered storage environment |
Country Status (5)
Country | Link |
---|---|
US (2) | US7343467B2 (en) |
EP (1) | EP1839117A2 (en) |
JP (1) | JP2008524724A (en) |
CN (1) | CN101084481A (en) |
WO (1) | WO2006069178A2 (en) |
Families Citing this family (66)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7162600B2 (en) | 2005-03-29 | 2007-01-09 | Hitachi, Ltd. | Data copying method and apparatus in a thin provisioned system |
US8782654B2 (en) | 2004-03-13 | 2014-07-15 | Adaptive Computing Enterprises, Inc. | Co-allocating a reservation spanning different compute resources types |
US20070266388A1 (en) | 2004-06-18 | 2007-11-15 | Cluster Resources, Inc. | System and method for providing advanced reservations in a compute environment |
US8176490B1 (en) | 2004-08-20 | 2012-05-08 | Adaptive Computing Enterprises, Inc. | System and method of interfacing a workload manager and scheduler with an identity manager |
CA2586763C (en) | 2004-11-08 | 2013-12-17 | Cluster Resources, Inc. | System and method of providing system jobs within a compute environment |
US8863143B2 (en) | 2006-03-16 | 2014-10-14 | Adaptive Computing Enterprises, Inc. | System and method for managing a hybrid compute environment |
US9075657B2 (en) | 2005-04-07 | 2015-07-07 | Adaptive Computing Enterprises, Inc. | On-demand access to compute resources |
US9231886B2 (en) | 2005-03-16 | 2016-01-05 | Adaptive Computing Enterprises, Inc. | Simple integration of an on-demand compute environment |
WO2006112980A2 (en) | 2005-03-16 | 2006-10-26 | Cluster Resources, Inc. | Reserving resources in an on-demand compute environment from a local compute environment |
US9225663B2 (en) | 2005-03-16 | 2015-12-29 | Adaptive Computing Enterprises, Inc. | System and method providing a virtual private cluster |
US8341459B2 (en) * | 2007-08-01 | 2012-12-25 | Brocade Communications Systems, Inc. | Data migration without interrupting host access and with data lock for write access requests such that held write access requests do not expire |
US8041773B2 (en) | 2007-09-24 | 2011-10-18 | The Research Foundation Of State University Of New York | Automatic clustering for self-organizing grids |
US8140637B2 (en) | 2007-10-25 | 2012-03-20 | Hewlett-Packard Development Company, L.P. | Communicating chunks between devices |
DE112007003693B4 (en) | 2007-10-25 | 2014-05-15 | Hewlett-Packard Development Co., L.P. | Data processing device and method for data processing |
US8782368B2 (en) * | 2007-10-25 | 2014-07-15 | Hewlett-Packard Development Company, L.P. | Storing chunks in containers |
WO2009054834A1 (en) | 2007-10-25 | 2009-04-30 | Hewlett-Packard Development Company, L.P. | Data processing apparatus and method of processing data |
CN101471830B (en) * | 2007-12-25 | 2011-02-02 | 英业达股份有限公司 | Method for accessing remote logic equipment through multiple routes in Linux system |
US9417812B1 (en) * | 2007-12-26 | 2016-08-16 | Emc Corporation | Methods and apparatus for minimally disruptive data migration |
US9471449B2 (en) * | 2008-01-03 | 2016-10-18 | Hewlett Packard Enterprise Development Lp | Performing mirroring of a logical storage unit |
US7899850B2 (en) | 2008-02-22 | 2011-03-01 | Bycast, Inc. | Relational objects for the optimized management of fixed-content storage systems |
GB2472520B (en) | 2008-04-25 | 2012-11-21 | Hewlett Packard Development Co | Data processing apparatus and method of deduplicating data for data backup |
US8954685B2 (en) * | 2008-06-23 | 2015-02-10 | International Business Machines Corporation | Virtualized SAS adapter with logic unit partitioning |
JP2010033481A (en) * | 2008-07-31 | 2010-02-12 | Fujitsu Ltd | Virtualized switch and computer system |
US20100049931A1 (en) * | 2008-08-20 | 2010-02-25 | Jacobson Michael B | Copying Logical Disk Mappings Between Arrays |
US8898267B2 (en) * | 2009-01-19 | 2014-11-25 | Netapp, Inc. | Modifying information lifecycle management rules in a distributed system |
US8261033B1 (en) * | 2009-06-04 | 2012-09-04 | Bycast Inc. | Time optimized secure traceable migration of massive quantities of data in a distributed storage system |
US11720290B2 (en) | 2009-10-30 | 2023-08-08 | Iii Holdings 2, Llc | Memcached server functionality in a cluster of data processing nodes |
US10877695B2 (en) | 2009-10-30 | 2020-12-29 | Iii Holdings 2, Llc | Memcached server functionality in a cluster of data processing nodes |
JP5603941B2 (en) * | 2010-08-06 | 2014-10-08 | 株式会社日立製作所 | Computer system and data migration method |
CN102375955A (en) * | 2010-08-17 | 2012-03-14 | 伊姆西公司 | System and method for locking files in combined naming space in network file system |
US8555019B2 (en) * | 2010-09-08 | 2013-10-08 | International Business Machines Corporation | Using a migration cache to cache tracks during migration |
KR101374655B1 (en) * | 2010-09-29 | 2014-03-24 | 네이버비즈니스플랫폼 주식회사 | System and method for distributely processing file volume for chunk unit |
CN102073462B (en) * | 2010-11-29 | 2013-04-17 | 华为技术有限公司 | Virtual storage migration method and system and virtual machine monitor |
US8799594B2 (en) * | 2011-04-27 | 2014-08-05 | International Business Machines Corporation | Online volume migration using multi-path input/output masquerading |
US8904128B2 (en) | 2011-06-08 | 2014-12-02 | Hewlett-Packard Development Company, L.P. | Processing a request to restore deduplicated data |
US20130166670A1 (en) * | 2011-12-21 | 2013-06-27 | James George Wayda | Networked storage system and method including private data network |
US9355120B1 (en) | 2012-03-02 | 2016-05-31 | Netapp, Inc. | Systems and methods for managing files in a content storage system |
US20150234618A1 (en) * | 2013-04-22 | 2015-08-20 | Hitachi, Ltd. | Storage management computer, storage management method, and storage system |
US9805070B2 (en) | 2013-07-09 | 2017-10-31 | Oracle International Corporation | Dynamic migration script management |
US9792321B2 (en) * | 2013-07-09 | 2017-10-17 | Oracle International Corporation | Online database migration |
US9996562B2 (en) | 2013-07-09 | 2018-06-12 | Oracle International Corporation | Automated database migration architecture |
US10776244B2 (en) | 2013-07-09 | 2020-09-15 | Oracle International Corporation | Consolidation planning services for systems migration |
US11157664B2 (en) | 2013-07-09 | 2021-10-26 | Oracle International Corporation | Database modeling and analysis |
US9747311B2 (en) | 2013-07-09 | 2017-08-29 | Oracle International Corporation | Solution to generate a scriptset for an automated database migration |
US10503723B2 (en) * | 2013-07-19 | 2019-12-10 | Transform Sr Brands Llc | Method and system for migrating data between systems without downtime |
JP2015072629A (en) * | 2013-10-03 | 2015-04-16 | 富士通株式会社 | Data processing program and data processing method |
CN103858092B (en) * | 2013-12-19 | 2016-03-09 | 华为技术有限公司 | A kind of data migration method and device |
US10235053B1 (en) * | 2014-03-31 | 2019-03-19 | Emc Corporation | Method and system for using host driver for flexible allocation fast-sideways data movements |
US20160080490A1 (en) | 2014-09-15 | 2016-03-17 | Microsoft Corporation | Online data movement without compromising data integrity |
US9971525B2 (en) | 2015-02-26 | 2018-05-15 | Red Hat, Inc. | Peer to peer volume extension in a shared storage environment |
CN104794155B (en) * | 2015-03-12 | 2019-06-18 | 北京奇虎科技有限公司 | The method, apparatus and system of data load |
US9715502B1 (en) * | 2015-03-25 | 2017-07-25 | Amazon Technologies, Inc. | Distributed data migration using chunking |
CN106155948B (en) * | 2015-04-16 | 2019-07-05 | 伊姆西公司 | For the method for storage system, aggregation configuration engine, aggregation configuration tool and file system |
US20170031600A1 (en) * | 2015-07-30 | 2017-02-02 | Netapp Inc. | Real-time analysis for dynamic storage |
US10296255B1 (en) * | 2015-12-16 | 2019-05-21 | EMC IP Holding Company LLC | Data migration techniques |
US11036696B2 (en) | 2016-06-07 | 2021-06-15 | Oracle International Corporation | Resource allocation for database provisioning |
CN108228672B (en) * | 2016-12-22 | 2022-05-03 | 阿里巴巴集团控股有限公司 | Metadata migration method, device, system and equipment |
CN106844510B (en) * | 2016-12-28 | 2021-01-15 | 北京五八信息技术有限公司 | Data migration method and device for distributed database cluster |
US10530870B2 (en) * | 2017-01-04 | 2020-01-07 | Lenovo Enterprise Solutions (Singapore) Pte. Ltd. | Direct volume migration in a storage area network |
CN107171865A (en) * | 2017-06-30 | 2017-09-15 | 郑州云海信息技术有限公司 | A kind of multinode storage system and LUN ownernode switching methods |
CN107832461B (en) * | 2017-11-28 | 2021-11-23 | 中国银行股份有限公司 | Data migration method and system |
CN109901786B (en) * | 2017-12-08 | 2021-07-16 | 腾讯科技(深圳)有限公司 | Data migration method, system, device and computer readable storage medium |
CN107991941B (en) * | 2017-12-27 | 2020-03-24 | 北京卫星制造厂 | MECHANTROLINK-II bus type drive control system |
CN110688056A (en) * | 2018-07-05 | 2020-01-14 | 北京忆恒创源科技有限公司 | Storage medium replacement for NVM groups |
US11256671B2 (en) | 2019-09-13 | 2022-02-22 | Oracle International Corporation | Integrated transition control center |
CN112052124B (en) * | 2020-09-25 | 2023-09-22 | 杭州宏杉科技股份有限公司 | Data redundancy method and distributed storage cluster |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5680640A (en) * | 1995-09-01 | 1997-10-21 | Emc Corporation | System for migrating data by selecting a first or second transfer means based on the status of a data element map initialized to a predetermined state |
US6073218A (en) * | 1996-12-23 | 2000-06-06 | Lsi Logic Corp. | Methods and apparatus for coordinating shared multiple raid controller access to common storage devices |
EP1130514A2 (en) * | 2000-03-03 | 2001-09-05 | Hitachi, Ltd. | Data migration method using storage area network |
EP1310876A1 (en) * | 2000-05-18 | 2003-05-14 | Hitachi, Ltd. | Computer system |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5459864A (en) * | 1993-02-02 | 1995-10-17 | International Business Machines Corporation | Load balancing, error recovery, and reconfiguration control in a data movement subsystem with cooperating plural queue processors |
US5673381A (en) * | 1994-05-27 | 1997-09-30 | Cheyenne Software International Sales Corp. | System and parallel streaming and data stripping to back-up a network |
US6145066A (en) * | 1997-11-14 | 2000-11-07 | Amdahl Corporation | Computer system with transparent data migration between storage volumes |
US5924097A (en) * | 1997-12-23 | 1999-07-13 | Unisys Corporation | Balanced input/output task management for use in multiprocessor transaction processing system |
WO1999063438A1 (en) * | 1998-06-05 | 1999-12-09 | Mylex Corporation | Apparatus, system and method for n-way raid controller |
US6934724B1 (en) * | 2000-12-21 | 2005-08-23 | Emc Corporation | Methods and apparatus for reducing resource contention in parallel data backup processes |
US20030028514A1 (en) * | 2001-06-05 | 2003-02-06 | Lord Stephen Philip | Extended attribute caching in clustered filesystem |
US7093088B1 (en) * | 2003-04-23 | 2006-08-15 | Emc Corporation | Method and apparatus for undoing a data migration in a computer system |
US6959313B2 (en) * | 2003-07-08 | 2005-10-25 | Pillar Data Systems, Inc. | Snapshots of file systems in data storage systems |
-
2004
- 2004-12-20 US US11/017,554 patent/US7343467B2/en active Active
-
2005
- 2005-12-20 EP EP05855057A patent/EP1839117A2/en not_active Withdrawn
- 2005-12-20 WO PCT/US2005/046433 patent/WO2006069178A2/en active Application Filing
- 2005-12-20 CN CNA2005800438994A patent/CN101084481A/en active Pending
- 2005-12-20 JP JP2007547047A patent/JP2008524724A/en active Pending
-
2008
- 2008-01-28 US US12/020,609 patent/US7913056B2/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5680640A (en) * | 1995-09-01 | 1997-10-21 | Emc Corporation | System for migrating data by selecting a first or second transfer means based on the status of a data element map initialized to a predetermined state |
US5896548A (en) * | 1995-09-01 | 1999-04-20 | Emc Corporation | Data transferring system having foreground and background modes and upon detecting significant pattern of access in foreground mode to change background mode control parameters |
US6073218A (en) * | 1996-12-23 | 2000-06-06 | Lsi Logic Corp. | Methods and apparatus for coordinating shared multiple raid controller access to common storage devices |
EP1130514A2 (en) * | 2000-03-03 | 2001-09-05 | Hitachi, Ltd. | Data migration method using storage area network |
EP1310876A1 (en) * | 2000-05-18 | 2003-05-14 | Hitachi, Ltd. | Computer system |
Also Published As
Publication number | Publication date |
---|---|
EP1839117A2 (en) | 2007-10-03 |
US7343467B2 (en) | 2008-03-11 |
JP2008524724A (en) | 2008-07-10 |
US20080147942A1 (en) | 2008-06-19 |
WO2006069178A2 (en) | 2006-06-29 |
US20060136691A1 (en) | 2006-06-22 |
US7913056B2 (en) | 2011-03-22 |
CN101084481A (en) | 2007-12-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2006069178A3 (en) | A method to perform parallel data migration in a clustered storage environment | |
WO2007064637A3 (en) | System and method for failover of iscsi target portal groups in a cluster environment | |
WO2007035653A3 (en) | Providing direct access to distributed managed content | |
WO2004036455A3 (en) | Master data access | |
WO2004021226A3 (en) | Methods and systems for storage architectures | |
EP1507246A4 (en) | Map data product, map data processing program product, map data processing method, and map data processing device | |
WO2006026680A3 (en) | Systems and methods for organizing and mapping data | |
WO2005050404A3 (en) | Transparent checkpointing and process migration in a distributed system | |
WO2005038561A3 (en) | System incorporating physics processing unit | |
WO2005109250A3 (en) | Methods and apparatus for accessing process control data | |
WO2007106569A3 (en) | Systems and methods for controlling error reporting and resolution | |
WO2007021435A3 (en) | Archiving data in a virtual application environment | |
ATE471624T1 (en) | CLIENT ERROR FENCE MECHANISM TO FENCE NETWORK FILE SYSTEM DATA IN A HOST CLUSTER ENVIRONMENT | |
WO2007146600A3 (en) | Adaptive power management of a disk drive based on user activity | |
WO2006121982A3 (en) | Data retrieval tags | |
WO2006098916A3 (en) | Network-accessible memory element, network-accessible memory module, network storage system and storage area network accelerator | |
WO2004036365A3 (en) | Dividing a travel query into sub-queries | |
WO2007095589A3 (en) | Aggregating and using physical samples | |
TW200630987A (en) | Method for tuning write strategy parameters of an optical storage device, and system thereof | |
WO2006088738A3 (en) | Application of in-situ plasma measurements to performance and control of a plasma processing system | |
WO2007149314A3 (en) | Methods and systems for providing sensor data using a sensor web | |
WO2005112571A3 (en) | System and method for flexible path handling | |
WO2007081794A3 (en) | System and method for extending the business data associated with a network-based user collaboration tool to include spatial reference information for collaborative visualization | |
WO2006119228A3 (en) | Contact management system and method | |
WO2009002020A3 (en) | Method and system for finding nearest neighbors based on vboronoi diagram |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 200580043899.4 Country of ref document: CN |
|
AK | Designated states |
Kind code of ref document: A2 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KM KN KP KR KZ LC LK LR LS LT LU LV LY MA MD MG MK MN MW MX MZ NA NG NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A2 Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU LV MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
WWE | Wipo information: entry into national phase |
Ref document number: 2005855057 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2007547047 Country of ref document: JP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2276/KOLNP/2007 Country of ref document: IN |
|
NENP | Non-entry into the national phase |
Ref country code: DE |