CN104883381A - Data access method and system for distributed storage - Google Patents

Data access method and system for distributed storage Download PDF

Info

Publication number
CN104883381A
CN104883381A CN201410229794.9A CN201410229794A CN104883381A CN 104883381 A CN104883381 A CN 104883381A CN 201410229794 A CN201410229794 A CN 201410229794A CN 104883381 A CN104883381 A CN 104883381A
Authority
CN
China
Prior art keywords
data
back end
master control
control server
server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201410229794.9A
Other languages
Chinese (zh)
Other versions
CN104883381B (en
Inventor
陈杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201410229794.9A priority Critical patent/CN104883381B/en
Publication of CN104883381A publication Critical patent/CN104883381A/en
Application granted granted Critical
Publication of CN104883381B publication Critical patent/CN104883381B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The invention discloses a data access method and a data access system for distributed storage. The data access method comprises the steps that: a main control server receives data access information and sends the data access information to an index server; the index server looks up a data node corresponding to the data access information and returns information of the data node to the main control server; and the main control server is connected with the data node for data access. According to the data access method and the data access system for distributed storage, the index server only looks up data node information, the main control server is directly connected with the data node in subsequence, the stress on the index server is reduced, and the bottleneck of data node amount caused by the index server is removed; and in the process of carrying out data reading-writing by multiple main control servers simultaneously, multiple index servers can be used for decentralized processing, the storage performance of a distributed storage method is improved, equipment needed in the operation link of distributed storage is simplified and integrated, and the continuous availability of distributed storage is enhanced.

Description

The data access method of distributed storage and system
Technical field
The present invention relates to technical field of data storage, particularly relate to a kind of data access method and system of distributed storage.
Background technology
Common distributed data access technical approach receives data by master control server and writes (storage) and the demand read, position correspondence via index server finds the back end and Data Position that these data are relevant, via the write of related data node or reading data, complete the access of data.Such function mode, its major defect is actually in the increasing situation of back end, such as in the environment of large market demand, back end increases the pressure that relatively can increase master control server and index server, and the performance of such overall operation will run into bottleneck.
Summary of the invention
Based on this, be necessary to provide a kind of data access method and the system that effectively can solve the distributed storage of index server that back end too much causes and the large problem of master control server pressure.
For realizing the data access method of a kind of distributed storage that the object of the invention provides, comprise the following steps:
Master control server receives document access information, and sends described document access information to index server;
Described index server finds back end corresponding to described document access information, and the information returning described back end is to described master control server;
Described master control server connects described back end and carries out data access.
As a kind of embodiment of data access method of distributed storage, when described master control server receives data storage information, the method also comprises described master control server and judges that whether the data that will store are the step of new data by described index server;
If so, then described master control server connects the step that described back end carries out data access and comprises the following steps:
The data index value of the data that will store described in described back end produces;
Described data index value is stored in described index server by described back end;
The data that will store described in described back end stores are to local disk;
If not, then described master control server connects the step that described back end carries out data access and comprises the following steps:
Described back end finds the described data that will store in the position of local disk according to the data index value of the described data that will store by described index server;
The described back end former data of the described data cover local disk relevant position that will store.
As a kind of embodiment of data access method of distributed storage, described method also comprises described master control server and judges that the described data that will store are the need of the step split by described index server;
If so, then the multiple described back end of described master control server connection carries out data storage;
If not, then the single described back end of described master control server connection carries out data storage.
As a kind of embodiment of data access method of distributed storage, when described data need segmentation, described data index value comprises single index value and data assemblies value.
As a kind of embodiment of data access method of distributed storage, when described master control server receives data read information, the method also comprises described master control server and judges that whether the data that will read are the step of partition data by described index server;
If so, then the multiple described back end of described master control server connection carries out digital independent;
If not, then the single described back end of described master control server connection carries out digital independent.
As a kind of embodiment of data access method of distributed storage, the method is further comprising the steps of:
The result data that the data that described master control server real-time reception carries out the data accessed are transmitted, and judge that whether digital accessing apparatus is abnormal according to described result data;
When described digital accessing apparatus is abnormal, described master control server controls to start corresponding agent equipment and carries out data access;
Described digital accessing apparatus is described index server, and/or described back end, and/or local disk.
Based on the data access arrangement of a kind of distributed storage of same inventive concept, comprise master control server, index server and back end, wherein:
Described master control server receives document access information, and sends described document access information to described index server;
Described index server finds described back end corresponding to described document access information, and the information returning described back end is to described master control server;
Described master control server connects described back end and carries out data access.
As a kind of embodiment of data access arrangement of distributed storage, this system also comprises local disk, described master control server comprises new data judge module, and described back end comprises index value generation module, index value memory module, the first memory module, location lookup module and the second memory module;
When described master control server receives data storage information, by described index server, described new data judge module judges whether the data that will store are new data;
According to the judged result of described new data judge module, if so, then
The data index value of the data that will store described in described index value generation module produces;
Described data index value is stored in described index server by described index value memory module;
The data that will store described in described first memory module stores are to local disk;
If not, then
Described location lookup module finds the described data that will store in the position of local disk according to the data index value of the described data that will store by described index server;
The described second memory module former data of the described data cover local disk relevant position that will store.
As a kind of embodiment of data access arrangement of distributed storage, described master control server also comprises the first Data Segmentation judge module, many back end memory module and forms data node memory module, wherein:
The data that will store described in described first Data Segmentation judge module is judged by described index server are the need of segmentation;
If so, then the multiple described back end of described many back end memory module connection carries out data storage;
If not, then the single described back end of described forms data node memory module connection carries out data storage;
And when described data need segmentation, described data index value comprises single index value and data assemblies value.
As a kind of embodiment of data access arrangement of distributed storage, described master control server also comprises the second Data Segmentation judge module, many back end read module and forms data node read module;
When described master control server receives data read information, by described index server, described second Data Segmentation judge module judges that whether the data that will read are the step of partition data;
If so, then the multiple described back end of described many back end read module connection carries out digital independent;
If not, then the single described back end of described forms data node read module connection carries out digital independent.
As a kind of embodiment of data access arrangement of distributed storage, described master control server also comprises abnormal judge module and abnormality processing module, wherein:
The result data that the data that described abnormal judge module real-time reception carries out the data accessed are transmitted, and judge that whether digital accessing apparatus is abnormal according to described result data;
When described digital accessing apparatus is abnormal, described abnormality processing module controls starts corresponding agent equipment and carries out data access;
Described digital accessing apparatus is described index server, and/or described back end, and/or local disk.
Beneficial effect of the present invention comprises:
The data access method of a kind of distributed storage provided by the invention and system, index server only searches back end information, follow-up by the direct connection data node of master control server, thus alleviate the pressure of index server, also break away from the bottleneck of the back end quantity that index server causes.And carry out in the process of reading and writing data in multiple stage master control server, by multiple stage index server dispersion treatment, can greatly reduce the running bottleneck of index server. simultaneouslyThe memory property of the mode of distributed storage can be promoted, simplify and the equipment required for running link integrating distributed storage, promote the clock availability of distributed storage, the problem of script Single Point of Faliure majority is solved according to node mode.
Accompanying drawing explanation
Fig. 1 is the flow chart of a specific embodiment of the data access method of a kind of distributed storage of the present invention;
Fig. 2 is the data write schematic diagram of a specific embodiment of the data access method of a kind of distributed storage of the present invention;
Fig. 3 is the digital independent schematic diagram of a specific embodiment of the data access method of a kind of distributed storage of the present invention;
Fig. 4 is the flow chart of another specific embodiment of the data access method of a kind of distributed storage of the present invention;
Fig. 5 is the flow chart of the another specific embodiment of the data access method of a kind of distributed storage of the present invention;
Fig. 6 is the flow chart of a specific embodiment again of the data access method of a kind of distributed storage of the present invention;
Fig. 7 is the data Stored Procedure schematic diagram of a specific embodiment of the data access method of a kind of distributed storage of the present invention;
Fig. 8 is the digital independent schematic flow sheet of a specific embodiment of the data access method of a kind of distributed storage of the present invention;
Fig. 9 is the formation schematic diagram of a specific embodiment of the data access arrangement of a kind of distributed storage of the present invention;
Figure 10 is the formation schematic diagram of another specific embodiment of the data access arrangement of a kind of distributed storage of the present invention;
Figure 11 is the formation schematic diagram of a specific embodiment again of the data access arrangement of a kind of distributed storage of the present invention;
Figure 12 is that the master control server of a specific embodiment of the data access arrangement of a kind of distributed storage of the present invention forms schematic diagram;
Figure 13 is that the master control server of another specific embodiment of the data access arrangement of a kind of distributed storage of the present invention forms schematic diagram.
Embodiment
In order to make object of the present invention, technical scheme and advantage clearly understand, below in conjunction with accompanying drawing, the data access method of distributed storage of the present invention and the embodiment of system are described.Should be appreciated that specific embodiment described herein only in order to explain the present invention, be not intended to limit the present invention.
The data access method of the distributed storage of the embodiment of the present invention, as shown in Figure 1, comprises the following steps:
S100, master control server receives document access information, and sends described document access information to index server.
S200, described index server finds back end corresponding to described document access information, and the information returning described back end is to described master control server.
S300, described master control server connects described back end and carries out data access.
As the write of Fig. 2 data, shown in Fig. 3 digital independent, in the data access method of the distributed storage of the embodiment of the present invention, after master control server receives the data write of client transmission or the operation requests of reading, arrive first in index server the back end information of searching and relating to data, after finding back end information, master control server directly sets up the connection with related data node, coordinates master control server to complete reading or the write (storage) of related data by back end.Directly to search related data different at the particular location of local disk from index server in conventional art, in the embodiment of the present invention, as shown in dotted outline in FIG., index server only searches back end information, follow-up by the direct connection data node of master control server, thus alleviate the pressure of index server, also break away from the bottleneck of the back end quantity that index server causes.And carry out in the process of reading and writing data in multiple stage master control server, by multiple stage index server dispersion treatment, can greatly reduce the running bottleneck of index server. simultaneouslyThe memory property of the mode of distributed storage can be promoted, simplify and the equipment required for running link integrating distributed storage, promote the clock availability of distributed storage, the problem of script Single Point of Faliure majority is solved according to node mode.
Preferably, in the embodiment of the data access method of a distributed storage wherein, when described master control server receives data storage information, as shown in Figure 4, the method also comprises step S030, by index server, master control server judges whether the data that will store are new data, obtain judged result.
After master control server receives data write request, one or more back end that search index (metadata) server finds this data index value corresponding, and determine whether new data, if there is index value in data, then data are the renewal of data with existing, if data do not have corresponding index value, then decision data is new data.
According to judged result, when the data that will store are new datas, abovementioned steps S300 comprises the following steps:
S311, the data index value of the data that will store described in back end produces.
S312, described data index value is stored in described index server by back end.
S313, the data that will store described in back end stores are to local disk.
After master control server and back end connect, primarily of the storage of back end deal with data, and the transmission result data returning handled data is in real time to master control server.Corresponding data node produces the index value of new data, and by described index value write index server, the data that simultaneously will store are stored in the correspondence position of this disk.
According to judged result, when the data that will store are not new datas, abovementioned steps S300 comprises the following steps:
S321, described back end finds the described data that will store in the position of local disk according to the data index value of the described data that will store by described index server;
S322, the described back end former data of the described data cover local disk relevant position that will store.When the data that will store are not new datas, then back end directly finds the position of local disk corresponding to legacy data corresponding to the data that will store and the data cover block of correspondence by index server, directly carries out data cover in legacy data position.
Preferably, in the embodiment of the data access method of a distributed storage wherein, when described master control server receives data storage information, as shown in Figure 5, the method also comprises step S031, the data that will store described in master control server is judged by described index server, the need of segmentation, obtain judged result.
According to judged result, when the data that will store need segmentation, if so, then perform step S301, described master control server connects multiple described back end and carries out data storage;
If not, then perform step S302, master control server connects single described back end and carries out data storage.
Wherein, when described data need segmentation, described data index value comprises single index value and data assemblies value.Wherein, single index value is by index value header, and back end indicates and standard metadata information three part is formed.For the data of segmentation, its data index value, except comprising the single index value that enough become by three parts as elucidated before, also comprises the data assemblies value obtained by the data algorithm of standard disperse formula.
In the embodiment of the data access method of a distributed storage wherein, as shown in Figure 6, the method is further comprising the steps of:
S400, the result data that the data that described master control server real-time reception carries out the data accessed are transmitted, and judge that whether digital accessing apparatus is abnormal according to described result data, when digital accessing apparatus is abnormal, controls to start corresponding agent equipment and carry out data access.Wherein, digital accessing apparatus is described index server, and/or described back end, and/or local disk.
In conjunction with previous embodiment, as shown in Figure 7, when each step combines in one embodiment, data store carries out according to the following steps:
(1) when front-end server produces data write demand, master control server receives the data storage information in aforesaid data write demand, and find according to data storage information search index (metadata) server the back end that the index value of the data that will store is corresponding, and determine whether new data.
(2) if new data, then determine whether to carry out Data Segmentation, Data Segmentation can be adjusted by artificial factor data situation, as a reference, can cut in 4K ~ 64M magnitude range, after cutting, the data of segmentation are write each back end respectively, back end as calculated Posterior circle writes each back end, if legacy data, then after inquiring corresponding data node via index service, determine whether after Data Segmentation, transmit data to corresponding multiple back end.
(3) when each back end receives the data write demand that master control server transmits, according to the data index value search index server of the data that will write, find the position of the data that will write, if its index value is related combined value, then in the data that will write via re-writing and re-writing Combination nova value on index server after covering its region, if new data, then after each back end receives data write service, the single index value of the data that generation will write and data assemblies value, and the more single index value of data and data assemblies value are write index server after these data that will write are write this locality.
(4) data to write do not need to split, and when being new data, then send data write demand to this back end via master control server, single index value in the data that will write after the data that this back end will write write this locality writes index server as data index value, if be written as overriding legacy data, then search index server by back end, the partial write that will override after finding the position of the data that will write and region is local.
(5) in each data action process, result data can all be transmitted to master control server, if there is index server, back end, during local storage failure, or during arbitrary back end fault, then master control server can adjust and substitute its service by agent equipment or back end.
Preferably, in the embodiment of the data access method of a distributed storage wherein, when described master control server receives data read information, the method also comprises step S032, by described index server, master control server judges whether the data that will read are partition data, obtain judged result.
According to judged result, when to read be partition data time, then perform step S303, master control server connect multiple described back end carry out digital independent.
According to judged result, when to read be not partition data time, then perform step S304, master control server connect single described back end carry out digital independent.
Wherein in an embodiment, as shown in Figure 8, the step of digital independent is as follows in detail:
When front-end server (client) produces digital independent demand, demand data is transferred to master control server process, after master control server receives digital independent demand, the related data node that search index (metadata) server finds this data index value corresponding.
(1) if partition data, then reading requirement is sent into each back end that this Data Segmentation is relevant.
(2) when each back end receives the digital independent demand that master control server transmits, just according to its data index value search index server, find the position of these data, if this data directory (uniquely) value is related data assemblies value, then will read local relevant data according to combined value at this back end, and deliver to master control server.
(3) master control server receives each back end and reads and after the data responded, after data being reformulated complete data by this data assemblies value, deliver in the server of digital independent requirement.
(4) in each data action process, result data can all be transmitted to master control server, if there is index server, back end, during local storage failure, or during arbitrary back end fault, then master control server can adjust and substitute its service by agent equipment or back end.
Based on same inventive concept, the embodiment of the present invention provides a kind of data access arrangement of distributed storage, and the principle of dealing with problems due to this system is similar to a kind of aforementioned method, therefore, the enforcement of this system can realize according to the concrete steps of preceding method, repeats part and repeats no more.
The data access arrangement of the distributed storage of the embodiment of the present invention, as shown in Figure 9, comprises master control server 100, index server 200 and back end 300.Wherein: described master control server 100 receives document access information, and send described document access information to described index server; Described index server 200 finds described back end 300 corresponding to described document access information, and the information returning described back end is to described master control server; Described master control server connects described back end and carries out data access.
Wherein, described back end can be connected according to the actual requirements with the quantity of described index server, and along with the growth of distributed storage data volume, the quantity of back end and index server also can correspondingly increase.Back end initiatively by data association message (as, title, the numbering of only one, in the information write index servers such as position), even if therefore there is multiple stage index server all can be synchronously written simultaneously, at master controller or following support in the memory technology of index server, also can find the position of these data by random access index server, the problem of so also having disperseed the fault of index server to cause data cannot to access.
And in the embodiment of the present invention, index server only searches back end information, follow-up by the direct connection data node of master control server, thus alleviate the pressure of index server, also break away from the bottleneck of the back end quantity that index server causes.And carry out in the process of reading and writing data in multiple stage master control server, by multiple stage index server dispersion treatment, can greatly reduce the running bottleneck of index server. simultaneouslyThe memory property of the mode of distributed storage can be promoted.
In the embodiment of the data access arrangement of a distributed storage wherein, as shown in Figure 10, this system also comprises local disk 400, described master control server comprises new data judge module 110, and described back end comprises index value generation module 310, index value memory module 320, first memory module 330, location lookup module 340 and the second memory module 350.
When described master control server receives data storage information, by described index server, described new data judge module 110 judges whether the data that will store are new data;
According to the judged result of described new data judge module, if so, then
Described index value generation module 310 produces the data index value of the described data that will store;
Described data index value is stored in described index server by described index value memory module 320;
Described first memory module 330 stores the described data that will store to local disk;
If not, then
Described location lookup module 340 finds the described data that will store in the position of local disk according to the data index value of the described data that will store by described index server;
The described second memory module 350 former data of the described data cover local disk relevant position that will store.
In the embodiment of the data access arrangement of a distributed storage wherein, as shown in figure 11, described master control server also comprises the first Data Segmentation judge module 120, many back end memory module 130 and forms data node memory module 140.Wherein: the data that will store described in described first Data Segmentation judge module 120 is judged by described index server are the need of segmentation; If so, then described many back end memory module 130 connects multiple described back end and carries out data storage; If not, then described forms data node memory module 140 connects single described back end and carries out data storage; And when described data need segmentation, described data index value comprises single index value and data assemblies value.
In the embodiment of the data access arrangement of a distributed storage wherein, as shown in figure 12, described master control server also comprises the second Data Segmentation judge module 150, many back end read module 160 and forms data node read module 170.
When described master control server receives data read information, by described index server, described second Data Segmentation judge module 150 judges that whether the data that will read are the step of partition data; If so, then described many back end read module 160 connects multiple described back end and carries out digital independent; If not, then described forms data node read module 170 connects single described back end and carries out digital independent.
In the embodiment of the data access arrangement of a distributed storage wherein, as shown in figure 13, described master control server also comprises abnormal judge module 180 and abnormality processing module 190.Wherein: the result data that the data that described abnormal judge module 180 real-time reception carries out the data accessed are transmitted, and judge digital accessing apparatus whether exception according to described result data; When described digital accessing apparatus is abnormal, described abnormality processing module 190 controls to start corresponding agent equipment and carries out data access.Wherein, described digital accessing apparatus is described index server, and/or described back end, and/or local disk.
The above embodiment only have expressed several execution mode of the present invention, and it describes comparatively concrete and detailed, but therefore can not be interpreted as the restriction to the scope of the claims of the present invention.It should be pointed out that for the person of ordinary skill of the art, without departing from the inventive concept of the premise, can also make some distortion and improvement, these all belong to protection scope of the present invention.Therefore, the protection range of patent of the present invention should be as the criterion with claims.

Claims (11)

1. a data access method for distributed storage, is characterized in that, comprises the following steps:
Master control server receives document access information, and sends described document access information to index server;
Described index server finds back end corresponding to described document access information, and the information returning described back end is to described master control server;
Described master control server connects described back end and carries out data access.
2. the data access method of distributed storage according to claim 1, it is characterized in that, when described master control server receives data storage information, the method also comprises described master control server and judges that whether the data that will store are the step of new data by described index server;
If so, then described master control server connects the step that described back end carries out data access and comprises the following steps:
The data index value of the data that will store described in described back end produces;
Described data index value is stored in described index server by described back end;
The data that will store described in described back end stores are to local disk;
If not, then described master control server connects the step that described back end carries out data access and comprises the following steps:
Described back end finds the described data that will store in the position of local disk according to the data index value of the described data that will store by described index server;
The described back end former data of the described data cover local disk relevant position that will store.
3. the data access method of distributed storage according to claim 2, is characterized in that, described method also comprises described master control server and judges that the described data that will store are the need of the step split by described index server;
If so, then the multiple described back end of described master control server connection carries out data storage;
If not, then the single described back end of described master control server connection carries out data storage.
4. the data access method of distributed storage according to claim 3, is characterized in that, when described data need segmentation, described data index value comprises single index value and data assemblies value.
5. the data access method of distributed storage according to claim 1, it is characterized in that, when described master control server receives data read information, the method also comprises described master control server and judges that whether the data that will read are the step of partition data by described index server;
If so, then the multiple described back end of described master control server connection carries out digital independent;
If not, then the single described back end of described master control server connection carries out digital independent.
6. the data access method of the distributed storage according to any one of claim 1 to 5, is characterized in that, the method is further comprising the steps of:
The result data that the data that described master control server real-time reception carries out the data accessed are transmitted, and judge that whether digital accessing apparatus is abnormal according to described result data;
When described digital accessing apparatus is abnormal, described master control server controls to start corresponding agent equipment and carries out data access;
Described digital accessing apparatus is described index server, and/or described back end, and/or local disk.
7. a data access arrangement for distributed storage, is characterized in that, comprises master control server, index server and back end, wherein:
Described master control server receives document access information, and sends described document access information to described index server;
Described index server finds described back end corresponding to described document access information, and the information returning described back end is to described master control server;
Described master control server connects described back end and carries out data access.
8. the data access arrangement of distributed storage according to claim 7, it is characterized in that, this system also comprises local disk, described master control server comprises new data judge module, and described back end comprises index value generation module, index value memory module, the first memory module, location lookup module and the second memory module;
When described master control server receives data storage information, by described index server, described new data judge module judges whether the data that will store are new data;
According to the judged result of described new data judge module, if so, then
The data index value of the data that will store described in described index value generation module produces;
Described data index value is stored in described index server by described index value memory module;
The data that will store described in described first memory module stores are to local disk;
If not, then
Described location lookup module finds the described data that will store in the position of local disk according to the data index value of the described data that will store by described index server;
The described second memory module former data of the described data cover local disk relevant position that will store.
9. the data access arrangement of distributed storage according to claim 8, is characterized in that, described master control server also comprises the first Data Segmentation judge module, many back end memory module and forms data node memory module, wherein:
The data that will store described in described first Data Segmentation judge module is judged by described index server are the need of segmentation;
If so, then the multiple described back end of described many back end memory module connection carries out data storage;
If not, then the single described back end of described forms data node memory module connection carries out data storage;
And when described data need segmentation, described data index value comprises single index value and data assemblies value.
10. the data access arrangement of distributed storage according to claim 7, is characterized in that, described master control server also comprises the second Data Segmentation judge module, many back end read module and forms data node read module;
When described master control server receives data read information, by described index server, described second Data Segmentation judge module judges that whether the data that will read are the step of partition data;
If so, then the multiple described back end of described many back end read module connection carries out digital independent;
If not, then the single described back end of described forms data node read module connection carries out digital independent.
The data access arrangement of 11. distributed storage according to any one of claim 7 to 10, it is characterized in that, described master control server also comprises abnormal judge module and abnormality processing module, wherein:
The result data that the data that described abnormal judge module real-time reception carries out the data accessed are transmitted, and judge that whether digital accessing apparatus is abnormal according to described result data;
When described digital accessing apparatus is abnormal, described abnormality processing module controls starts corresponding agent equipment and carries out data access;
Described digital accessing apparatus is described index server, and/or described back end, and/or local disk.
CN201410229794.9A 2014-05-27 2014-05-27 The data access method and system of distributed storage Expired - Fee Related CN104883381B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410229794.9A CN104883381B (en) 2014-05-27 2014-05-27 The data access method and system of distributed storage

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410229794.9A CN104883381B (en) 2014-05-27 2014-05-27 The data access method and system of distributed storage

Publications (2)

Publication Number Publication Date
CN104883381A true CN104883381A (en) 2015-09-02
CN104883381B CN104883381B (en) 2018-09-04

Family

ID=53950715

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410229794.9A Expired - Fee Related CN104883381B (en) 2014-05-27 2014-05-27 The data access method and system of distributed storage

Country Status (1)

Country Link
CN (1) CN104883381B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106473472A (en) * 2016-10-20 2017-03-08 国网山东省电力公司菏泽供电公司 A kind of storage cabinet, control system and data storage system
CN108121511A (en) * 2017-12-21 2018-06-05 北京黑螺技术有限公司 Data processing method, device and equipment in a kind of distributed edge storage system
US11052636B2 (en) 2015-09-07 2021-07-06 Hak Sik JOO Fused sheet for electromagnetic wave absorption-extinction and shielding, and for electronic equipment high heat dissipation, and method of manufacturing the same

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6374253B1 (en) * 1998-12-30 2002-04-16 Microsoft Corporation System and method for generating hierarchical forward knowledge
CN1859115A (en) * 2006-01-24 2006-11-08 华为技术有限公司 Distributing storage downloading system, device and method for network data
CN101901275A (en) * 2010-08-23 2010-12-01 华中科技大学 Distributed storage system and method thereof
CN102110146A (en) * 2011-02-16 2011-06-29 清华大学 Key-value storage-based distributed file system metadata management method
CN102387179A (en) * 2010-09-02 2012-03-21 联想(北京)有限公司 Distributed file system and nodes, saving method and saving control method thereof
CN102694828A (en) * 2011-03-23 2012-09-26 中兴通讯股份有限公司 Method and apparatus for data access in distributed caching system
CN102833352A (en) * 2012-09-17 2012-12-19 深圳中兴网信科技有限公司 Distributed cache management system and method for implementing distributed cache management

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6374253B1 (en) * 1998-12-30 2002-04-16 Microsoft Corporation System and method for generating hierarchical forward knowledge
CN1859115A (en) * 2006-01-24 2006-11-08 华为技术有限公司 Distributing storage downloading system, device and method for network data
CN101901275A (en) * 2010-08-23 2010-12-01 华中科技大学 Distributed storage system and method thereof
CN102387179A (en) * 2010-09-02 2012-03-21 联想(北京)有限公司 Distributed file system and nodes, saving method and saving control method thereof
CN102110146A (en) * 2011-02-16 2011-06-29 清华大学 Key-value storage-based distributed file system metadata management method
CN102694828A (en) * 2011-03-23 2012-09-26 中兴通讯股份有限公司 Method and apparatus for data access in distributed caching system
CN102833352A (en) * 2012-09-17 2012-12-19 深圳中兴网信科技有限公司 Distributed cache management system and method for implementing distributed cache management

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11052636B2 (en) 2015-09-07 2021-07-06 Hak Sik JOO Fused sheet for electromagnetic wave absorption-extinction and shielding, and for electronic equipment high heat dissipation, and method of manufacturing the same
CN106473472A (en) * 2016-10-20 2017-03-08 国网山东省电力公司菏泽供电公司 A kind of storage cabinet, control system and data storage system
CN108121511A (en) * 2017-12-21 2018-06-05 北京黑螺技术有限公司 Data processing method, device and equipment in a kind of distributed edge storage system
CN108121511B (en) * 2017-12-21 2022-05-27 北京猫盘技术有限公司 Data processing method, device and equipment in distributed edge storage system

Also Published As

Publication number Publication date
CN104883381B (en) 2018-09-04

Similar Documents

Publication Publication Date Title
US9104338B2 (en) Network storage system, disk array device, host device, access control method, and data access method
CN103023879B (en) Wide-area data synchronous method between a kind of data center based on high-speed cache
CN108363641B (en) Main and standby machine data transmission method, control node and database system
CN109684414B (en) Method, device and equipment for synchronizing block data and storage medium
TWI451245B (en) Virtual machine monitoring method, system and computer readable storage medium for storing thereof
CN102710763B (en) The method and system of a kind of distributed caching pond, burst and Failure Transfer
CN102314506B (en) Based on the distributed buffering district management method of dynamic index
CN106202416B (en) Table data write method and device, table data read method and device
CN108989432B (en) User-mode file sending method, user-mode file receiving method and user-mode file receiving and sending device
CN101216832A (en) Data synchronization process and device
CN102411637A (en) Metadata management method of distributed file system
GB2291228A (en) Information duplicate distribution over a network
CN102117287A (en) Distributed file system access method, a metadata server and client side
CN103795801A (en) Metadata group design method based on real-time application group
CN102023816A (en) Object storage policy and access method of object storage system
CN111651526B (en) Data synchronization method of redundant front-end processor, front-end processor and processing system
CN104883381A (en) Data access method and system for distributed storage
US8499133B2 (en) Cache management for increasing performance of high-availability multi-core systems
CN106873902A (en) A kind of document storage system, data dispatching method and back end
CN107277188A (en) A kind of method, client, server and operation system for determining IP address attaching information
CN102724301B (en) Cloud database system and method and equipment for reading and writing cloud data
CN105323271B (en) Cloud computing system and processing method and device thereof
CN105446895A (en) Method and system for carrying out IO deduplication on non-homologous data of storage system in operation process
CN113120039A (en) Automatic acquisition method of operation diagram file compatible with single-computer and double-computer operation scenes
CN110750289A (en) Gray switching state maintaining method for distributed system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
EXSB Decision made by sipo to initiate substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20180904

CF01 Termination of patent right due to non-payment of annual fee