CN102541750A - Implementation method and device for data snapshot - Google Patents
Implementation method and device for data snapshot Download PDFInfo
- Publication number
- CN102541750A CN102541750A CN2011104600487A CN201110460048A CN102541750A CN 102541750 A CN102541750 A CN 102541750A CN 2011104600487 A CN2011104600487 A CN 2011104600487A CN 201110460048 A CN201110460048 A CN 201110460048A CN 102541750 A CN102541750 A CN 102541750A
- Authority
- CN
- China
- Prior art keywords
- snapshot
- storage area
- data
- address
- storage space
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention discloses an implementation method and device for a data snapshot. The implementation method comprises the following steps of: determining an address of a storage area needed to be snapshot in a storage space in case the snapshot is needed; and snapshotting data saved in the corresponding storage area according to the determined address. The implementation device comprises a determining module and a snapshotting module, wherein the determining module is used for determining the address of the storage area needed to be snapshot in the storage space in case the snapshot is needed; and the snapshotting module is used for snapshotting the data saved in the corresponding storage area according to the determined address. According to the implementation method and device disclosed by the invention, as all areas of the storage space can be snapshot in a regional manner, flexibility of the data snapshot can be effectively improved, and efficiency of the data snapshot can be increased; and moreover the implementation method and device are applicable to storage spaces of various dimensions.
Description
Technical field
The present invention relates to computer realm, and especially, relate to a kind of implementation method and device of data snapshot.
Background technology
At present; In extensive HPCC; The user is numerous, workload is huge, the demanding situation of whole IO handling capacity owing to existing; Therefore present NFS based on the individual server end can not satisfy user's demand, particularly large-scale data center and the demand that concurrent quantity is big, the IO amount is big greatly.At this moment, the notion of parallel memory system (distributed memory system) has been given birth to regard to application.
Occurred some parallel memory systems at present, these storage systems can realize that metadata and data store respectively, so that in read-write, improve performance; The quantity of data server is a plurality of, reaches hundreds if not thousands of from several, thereby has constituted large-scale NFS.
For general small-scale storage system (for example; The storage system of modal single machine); In the process of storage, can use the data snapshot technology usually, the data of storing in the system, change are preserved; Maybe need carry out under the situation of reduction of data so that break down, utilize the data of preserving to carry out data and recover in system.
But the storage space of the storage system in the conventional art is very little, therefore, is easy to the data in the storage space are scanned and snapshot; And the storage space of cluster parallel memory system is very big, at this moment, if hope that carrying out snapshot will spend the more time; And under many circumstances, necessity is not all carried out data snapshot to all storage spaces, therefore; Existing snapshot scheme underaction can be wasted a lot of times, reduces the efficiency of management of system.
, waste processing time dumb, reduce the problem of system management efficient, do not propose effective solution at present as yet to snapshot scheme in the correlation technique.
Summary of the invention
, waste processing time dumb, reduce the problem of system management efficient to snapshot scheme in the correlation technique; The present invention proposes a kind of implementation method and device of data snapshot; Can improve the dirigibility of data snapshot; Storage space is carried out the subregion snapshot, successfully manage the storage space of all size.
Technical scheme of the present invention is achieved in that
According to an aspect of the present invention, a kind of implementation method of data snapshot is provided, has been used for the storage space of cluster storage system is carried out data snapshot.
This method comprises: carry out at needs under the situation of snapshot, confirm need carry out in the storage space address of the storage area of snapshot; Snapshot is carried out to the data of preserving in the respective memory regions in address according to confirming.
Wherein, under the situation of the snapshot instruction that receives input, confirm to carry out snapshot; And confirm that the address that need carry out the storage area of snapshot in the storage space comprises: instruction is resolved to snapshot, obtains carrying out the address of the storage area of snapshot.
In addition; Storage space is divided into a plurality of logic regions in advance, and wherein, each logic region is corresponding to the time interval of carrying out snapshot separately; For each logic region; Under the situation that the corresponding snapshot time point of this logic region reaches, confirm and to carry out snapshot to this logic region, and the address of the storage area of snapshot is carried out in the address of this logic region as needs.
This method may further include: need carry out under the situation of snapshot a storage area, confirm whether the idle storage space of this storage area can hold the data that generate behind the snapshot; In judged result is under the situation not, comes this storage area is carried out dynamic expansion through other idle memory region in the storage space being divided to this storage area, and the storage area after the dynamic expansion is carried out snapshot.
In addition, a storage area being carried out snapshot comprises: the precalculated position in this storage area is duplicated and be stored in to the data that occur during than last snapshot in this storage area changing.
According to a further aspect in the invention, a kind of implement device of data snapshot is provided, has been used for the storage space of cluster storage system is carried out data snapshot.
This device comprises: determination module, be used for carrying out under the situation of snapshot at needs, and confirm need carry out in the storage space address of the storage area of snapshot; Snapshot module is used for carrying out snapshot according to the data that preserve respective memory regions the address of confirming.
Wherein, determination module is used under the situation of the snapshot instruction that receives input, confirming to carry out snapshot; And determination module also is used for snapshot instruction is resolved, and obtains carrying out the address of the storage area of snapshot.
In addition, storage space is divided into a plurality of logic regions in advance, wherein; Each logic region is corresponding to the time interval of carrying out snapshot separately; For each logic region, and determination module is used to judge whether the corresponding snapshot time point of this logic region reaches; In judged result is to confirm under the situation that is and need carry out snapshot to this logic region, and the address that need carry out the storage area of snapshot is confirmed as in the address of this logic region.
In addition, determination module also is used for and need carrying out under the situation of snapshot a storage area, confirms whether the idle storage space of this storage area can hold the data that generate behind the snapshot;
And; This device further comprises the dynamic assignment module; Be used under the data conditions that determination module is confirmed to generate after the idle storage space of this storage area can not be held snapshot; Come this storage area is carried out dynamic expansion through other idle memory region in the storage space are divided to this storage area, and the storage area after the dynamic expansion is carried out snapshot.
Alternatively, snapshot module is carried out snapshot to a storage area and is comprised: the precalculated position in this storage area is duplicated and be stored in to the data that occur changing during than last snapshot in this storage area.
The present invention carries out snapshot through storage space is carried out subregion to each zone, can effectively improve the dirigibility of data snapshot, improves the efficient of data snapshot, can be applicable to the storage space of all size.
Description of drawings
Fig. 1 is the process flow diagram according to the implementation method of the data snapshot of the embodiment of the invention;
Fig. 2 is the block diagram according to the implement device of the data snapshot of the embodiment of the invention.
Embodiment
According to embodiments of the invention, a kind of implementation method of data snapshot is provided, be used for the storage space of cluster storage system is carried out data snapshot.
As shown in Figure 1, comprise according to the implementation method of the data snapshot of the embodiment of the invention:
Step S101 carries out at needs under the situation of snapshot, confirms need carry out in the storage space address of the storage area of snapshot;
Step S103 carries out snapshot according to the address of confirming to the data of preserving in the respective memory regions.
Wherein, can under the situation of the snapshot instruction that receives input, confirm to carry out snapshot;
And, in the time of in confirming storage space, need carrying out the address of storage area of snapshot, can resolve the snapshot instruction, obtain carrying out the address of the storage area of snapshot.
In addition, storage space also can be divided into a plurality of logic regions in advance, wherein; Each logic region is corresponding to the time interval of carrying out snapshot separately; For each logic region, under the situation that the corresponding snapshot time point of this logic region reaches, confirm and to carry out snapshot to this logic region; And the address of this logic region carried out the address of the storage area of snapshot as needs; The snapshot time interval of each logic region specifically can be set according to the importance of each logical storage data, not only can make that the management of snapshot is flexible more, reasonable, and improve the stability and the reliability of system.
And,, except carrying out the snapshot, also can carry out snapshot to the logic region of needs snapshot according to operator's instruction according to the time interval of carrying out snapshot for each logic region that needs snapshot.
In addition, need carry out under the situation of snapshot, can confirm whether the idle storage space of this storage area can hold the data that generate behind the snapshot a storage area; In judged result is under the situation not, comes this storage area is carried out dynamic expansion through other idle memory region in the storage space being divided to this storage area, and the storage area after the dynamic expansion is carried out snapshot.
Be can the precalculated position in this storage area duplicated and be stored in to the data that occur changing during than last snapshot in the storage area that need snapshot, carrying out snapshot so that use when data are recovered follow-up carrying out.
According to embodiments of the invention, a kind of implement device of data snapshot also is provided, be used for the storage space of cluster storage system is carried out data snapshot.
As shown in Figure 2, comprise according to the implement device of the data snapshot of the embodiment of the invention:
Wherein, determination module 21 is used under the situation of the snapshot instruction that receives input, confirming to carry out snapshot; And determination module 21 also is used for snapshot instruction is resolved, and obtains carrying out the address of the storage area of snapshot.
In addition; Storage space can be divided into a plurality of logic regions in advance, and wherein, each logic region is corresponding to the time interval of carrying out snapshot separately; For each logic region; Under the situation that the corresponding snapshot time point of determination module 21 these logic regions of judgement reaches, confirm and to carry out snapshot to this logic region, and the address that need carry out the storage area of snapshot is confirmed as in the address of this logic region.
In addition, determination module 21 also is used for and need carrying out under the situation of snapshot a storage area, confirms whether the idle storage space of this storage area can hold the data that generate behind the snapshot; Device further comprises the dynamic assignment module; Be used under the data conditions that determination module is confirmed to generate after the idle storage space of this storage area can not be held snapshot; Come this storage area is carried out dynamic expansion through other idle memory region in the storage space are divided to this storage area, and the storage area after the dynamic expansion is carried out snapshot.
Through such scheme, make that the block device in the storage system has snapshot functions, that is,, can the fileinfo of being preserved on the equipment be carried out record at certain time point.After preserving snapshot, the file in the equipment carried out write operation, when changing file, using Copy on write (Copy-on-write) technology, two versions of spanned file, the version when version that promptly upgrades and snapshot.When equipment for a certain reason during loss of data, the version in the time of snapshot can being utilized, the data on the equipment are returned to the situation of snapshot when taking place.
In sum, by means of technique scheme of the present invention, snapshot is carried out in each zone through storage space is carried out subregion; Can effectively improve the dirigibility of data snapshot; Improve the efficient of data snapshot, can be applicable to the storage space of all size, and; Can also be set the cycle of carrying out snapshot respectively to each storage area (or logic region); Can carry out the snapshot of different cycles according to the different significance levels of different memory areas numeric field data, make that the snapshot of data is more flexible, and can further optimize the data efficiency of managing.And scheme of the present invention can be applicable to the storage system of all size, even for large-scale storage systems; Can carry out the snapshot management equally neatly, for example, for the data server of parastor100 parallel memory system; Make it can realize the regular snapshot functions of equipment, timed task promptly is set, make file status that this equipment is current etc. to note; When following certain time point, during device damage, can pass through snapshot functions; The information of equipment is returned to the time point of doing snapshot, thereby minimum possibly avoided losing of data.
The above is merely preferred embodiment of the present invention, and is in order to restriction the present invention, not all within spirit of the present invention and principle, any modification of being done, is equal to replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (10)
1. the implementation method of a data snapshot is used for the storage space of cluster storage system is carried out data snapshot, it is characterized in that said method comprises:
Carry out at needs under the situation of snapshot, confirm to carry out in the said storage space address of the storage area of snapshot;
Snapshot is carried out to the data of preserving in the respective memory regions in said address according to confirming.
2. implementation method according to claim 1 is characterized in that, under the situation of the snapshot instruction that receives input, confirms to carry out snapshot;
And, confirm that the address that need carry out the storage area of snapshot in the said storage space comprises:
Said snapshot instruction is resolved, obtain to carry out the address of the storage area of snapshot.
3. implementation method according to claim 1 is characterized in that, said storage space is divided into a plurality of logic regions in advance; Wherein, Each logic region is corresponding to the time interval of carrying out snapshot separately, for each logic region, under the situation that the corresponding snapshot time point of this logic region reaches; Confirm and to carry out snapshot to this logic region, and the address of the storage area of snapshot is carried out in the address of this logic region as needs.
4. implementation method according to claim 1 is characterized in that, further comprises:
Need carry out under the situation of snapshot a storage area, confirm whether the idle storage space of this storage area can hold the data that generate behind the snapshot;
In judged result is under the situation not, comes this storage area is carried out dynamic expansion through other idle memory region in the said storage space being divided to this storage area, and the storage area after the dynamic expansion is carried out snapshot.
5. according to each described implementation method in the claim 1 to 4; It is characterized in that, a storage area is carried out snapshot comprise: the precalculated position in this storage area is duplicated and be stored in to the data that occur during than last snapshot in this storage area changing.
6. the implement device of a data snapshot is used for the storage space of cluster storage system is carried out data snapshot, it is characterized in that said device comprises:
Determination module is used for carrying out under the situation of snapshot at needs, confirms need carry out in the said storage space address of the storage area of snapshot;
Snapshot module is used for carrying out snapshot according to the data that preserve respective memory regions the said address of confirming.
7. implement device according to claim 6 is characterized in that, said determination module is used under the situation of the snapshot instruction that receives input, confirming to carry out snapshot; And said determination module also is used for said snapshot instruction is resolved, and obtains carrying out the address of the storage area of snapshot.
8. implement device according to claim 6; It is characterized in that said storage space is divided into a plurality of logic regions in advance, wherein; Each logic region is corresponding to the time interval of carrying out snapshot separately; For each logic region, and said determination module is used to judge whether the corresponding snapshot time point of this logic region reaches; In judged result is to confirm under the situation that is and need carry out snapshot to this logic region, and the address that need carry out the storage area of snapshot is confirmed as in the address of this logic region.
9. implement device according to claim 6 is characterized in that, said determination module also is used for and need carrying out under the situation of snapshot a storage area, confirms whether the idle storage space of this storage area can hold the data that generate behind the snapshot;
Said device further comprises the dynamic assignment module; Be used under the data conditions that said determination module is confirmed to generate after the idle storage space of this storage area can not be held snapshot; Come this storage area is carried out dynamic expansion through other idle memory region in the said storage space are divided to this storage area, and the storage area after the dynamic expansion is carried out snapshot.
10. according to each described implement device in the claim 6 to 9; It is characterized in that said snapshot module is carried out snapshot to a storage area and comprised: the precalculated position in this storage area is duplicated and be stored in to the data that occur during than last snapshot in this storage area changing.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011104600487A CN102541750A (en) | 2011-12-31 | 2011-12-31 | Implementation method and device for data snapshot |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011104600487A CN102541750A (en) | 2011-12-31 | 2011-12-31 | Implementation method and device for data snapshot |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102541750A true CN102541750A (en) | 2012-07-04 |
Family
ID=46348690
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011104600487A Pending CN102541750A (en) | 2011-12-31 | 2011-12-31 | Implementation method and device for data snapshot |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102541750A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102799607A (en) * | 2012-05-31 | 2012-11-28 | 新奥特（北京）视频技术有限公司 | Method for processing data in snapshot mode |
| CN103176901A (en) * | 2013-02-27 | 2013-06-26 | 深圳创维数字技术股份有限公司 | Method and system for embedded software test monitoring |
| CN105045542A (en) * | 2015-09-11 | 2015-11-11 | 浪潮(北京)电子信息产业有限公司 | Method and apparatus for quick snapshot management |
| CN105095102A (en) * | 2015-08-12 | 2015-11-25 | 浪潮(北京)电子信息产业有限公司 | Automatic expansion method and device for snapshot volume |
| WO2020024772A1 (en) * | 2018-08-03 | 2020-02-06 | 华为技术有限公司 | Method and apparatus for querying data |
| WO2020042842A1 (en) * | 2018-08-31 | 2020-03-05 | 北京京东尚科信息技术有限公司 | Page presentation method and system, computer system, and computer-readable medium |
| CN111007990A (en) * | 2019-12-24 | 2020-04-14 | 曙光信息产业(北京)有限公司 | Positioning method for quickly positioning data block reference in snapshot system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6981114B1 (en) * | 2002-10-16 | 2005-12-27 | Veritas Operating Corporation | Snapshot reconstruction from an existing snapshot and one or more modification logs |
| CN1991778A (en) * | 2005-12-29 | 2007-07-04 | 英业达股份有限公司 | Snapshot extending system and method |
| CN101520743A (en) * | 2009-04-17 | 2009-09-02 | 杭州华三通信技术有限公司 | Data storage method, system and device based on copy-on-write |
-
2011
- 2011-12-31 CN CN2011104600487A patent/CN102541750A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6981114B1 (en) * | 2002-10-16 | 2005-12-27 | Veritas Operating Corporation | Snapshot reconstruction from an existing snapshot and one or more modification logs |
| CN1991778A (en) * | 2005-12-29 | 2007-07-04 | 英业达股份有限公司 | Snapshot extending system and method |
| CN101520743A (en) * | 2009-04-17 | 2009-09-02 | 杭州华三通信技术有限公司 | Data storage method, system and device based on copy-on-write |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102799607A (en) * | 2012-05-31 | 2012-11-28 | 新奥特（北京）视频技术有限公司 | Method for processing data in snapshot mode |
| CN103176901A (en) * | 2013-02-27 | 2013-06-26 | 深圳创维数字技术股份有限公司 | Method and system for embedded software test monitoring |
| CN105095102A (en) * | 2015-08-12 | 2015-11-25 | 浪潮(北京)电子信息产业有限公司 | Automatic expansion method and device for snapshot volume |
| CN105045542A (en) * | 2015-09-11 | 2015-11-11 | 浪潮(北京)电子信息产业有限公司 | Method and apparatus for quick snapshot management |
| CN105045542B (en) * | 2015-09-11 | 2018-08-03 | 浪潮(北京)电子信息产业有限公司 | A kind of method and device for realizing snapshot management |
| WO2020024772A1 (en) * | 2018-08-03 | 2020-02-06 | 华为技术有限公司 | Method and apparatus for querying data |
| US11579986B2 (en) | 2018-08-03 | 2023-02-14 | Huawei Cloud Computing Technologies Co., Ltd. | Data query method and apparatus |
| WO2020042842A1 (en) * | 2018-08-31 | 2020-03-05 | 北京京东尚科信息技术有限公司 | Page presentation method and system, computer system, and computer-readable medium |
| US11438403B2 (en) | 2018-08-31 | 2022-09-06 | Beijing Jingdong Shangke Information Technology Co., Ltd. | Page presentation method and system, computer system, and computer readable medium |
| CN111007990A (en) * | 2019-12-24 | 2020-04-14 | 曙光信息产业(北京)有限公司 | Positioning method for quickly positioning data block reference in snapshot system |
| CN111007990B (en) * | 2019-12-24 | 2023-09-19 | 曙光信息产业(北京)有限公司 | Positioning method for quickly positioning data block references in snapshot system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102541750A (en) | Implementation method and device for data snapshot | |
| US20200226042A1 (en) | Storage system and control software deployment method | |
| KR101259557B1 (en) | Cluster data management system and method for data recovery using parallel processing in cluster data management system | |
| EP2474919B1 (en) | System and method for data replication between heterogeneous databases | |
| CN100464307C (en) | Method and system for accomplishing data backup and recovery | |
| CN109358947B (en) | Method and system for realizing virtual machine snapshot | |
| CN104166606A (en) | File backup method and main storage device | |
| CN103279406B (en) | A kind of partition method of internal memory and device | |
| CN103221925A (en) | Data processing method and storage equipment | |
| CN102142032B (en) | Method and system for reading and writing data of distributed file system | |
| CN102317910A (en) | Methods, devices and system for virtual data backup and reintegration | |
| CN104919426A (en) | Data processing device and data processing method | |
| CN102750317A (en) | Method and device for data persistence processing and data base system | |
| CN104407933A (en) | Data backup method and device | |
| CN105701190A (en) | Data synchronizing method and device | |
| CN102411520A (en) | Data-unit-based disaster recovery method for seismic data | |
| CN105205143A (en) | File storage and processing method, device and system | |
| CN111930716A (en) | Database capacity expansion method, device and system | |
| CN109799991B (en) | Source code compiling method and system based on MapReduce framework distributed computing environment | |
| CN106874343B (en) | Data deletion method and system for time sequence database | |
| CN103049298A (en) | Nandflash burning writing method | |
| CN101937378A (en) | Method for carrying out back-up protection on data of storage equipment and computer system | |
| CN103399943A (en) | Communication method and communication device for parallel query of clustered databases | |
| CN106293509A (en) | Date storage method and system | |
| CN109189739A (en) | Spatial cache recovery method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20120704 |