CN103793382A - Data processing method and system of database - Google Patents
Data processing method and system of database Download PDFInfo
- Publication number
- CN103793382A CN103793382A CN201210418832.6A CN201210418832A CN103793382A CN 103793382 A CN103793382 A CN 103793382A CN 201210418832 A CN201210418832 A CN 201210418832A CN 103793382 A CN103793382 A CN 103793382A
- Authority
- CN
- China
- Prior art keywords
- physical layer
- partitioning strategies
- configuration
- son
- executing data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
- G06F16/24553—Query execution of query operations
- G06F16/24554—Unary operations; Data partitioning operations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Software Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a data processing method of a database. The data processing method comprises the steps of configuring a partitioning strategy with a time unit as particle size; creating multiple sub files in a physical layer according to the configured partitioning strategy and enabling the multiple sub files to correspond to an index table of a logical layer; respectively storing execution data of the physical layer in the created sub files according to the configured partitioning strategy. The invention further provides a data processing system of the database. By adopting the technical scheme, the using performance of the database can be improved.
Description
Technical field
The present invention relates to data management technique, relate in particular to a kind of data processing method and system of database.
Background technology
At present, customer relation management (CRM, Customer Relationship Management) system executing data doubling year by year increase, these executing datas are all stored in Structured Query Language (SQL) (SQL, Structured Query Language) in the executing data table of server (Server) database, because the executing data amount in executing data table is huge, to the increase of the executing data in this executing data table, delete, revise, inquiry waits the speed of operation all very slow, cause the performance of the business that relates to executing data very low, user experiences very poor.
For the problems referred to above, MySQL database adopts submeter mode to solve, and as shown in Figure 1, for MySQL database, has multiple concordance lists in logical layer, and as concordance list 1～concordance list 3, the master file in Physical layer is the carrier of actual storage executing data; Conventionally, the master file of the preservation executing data that is positioned at Physical layer is divided into multiple master files, make the each concordance list in logical layer in Physical layer, have a corresponding master file, master file 1 as corresponding in concordance list 1, the corresponding master file 2 of concordance list 2, by that analogy; This scheme need to just set at first rule, and creates multiple master files, for storing the executing data of magnanimity, then goes in corresponding master file, to obtain executing data in Physical layer according to the rule arranging.
MySQL database can also adopt mode shown in Fig. 2 to solve, as shown in Figure 2, preserve in the SQL Server database of executing data of crm system, in logical layer, only have a concordance list, only there is a corresponding master file in Physical layer, this master file is preserved the executing data of all crm systems; Based on this mode, because executing data in crm system need to be by multiple use system calls, if the scheme of MySQL database is applied in the SQL Server database of the executing data of preserving crm system, need the concordance list in logical layer to be divided into multiple concordance lists, master file in Physical layer is divided into multiple master files, so, all will there is larger change in the logical layer of SQL Server database and Physical layer, and the method for query execution data also all will carry out corresponding change, the cost and the application risk that bring are larger.
Summary of the invention
In view of this, fundamental purpose of the present invention is to provide a kind of data processing method and system of database, can promote the usability of database.
For achieving the above object, technical scheme of the present invention is achieved in that
A data processing method for database, is configured to the partitioning strategies that chronomere is granularity; The method also comprises:
According to the partitioning strategies of configuration, create multiple son files in Physical layer, and corresponding with the concordance list of logical layer;
According to the partitioning strategies of configuration, the executing data of Physical layer is stored in respectively in multiple son files of establishment.
Wherein, the method also comprises:
According to the partitioning strategies of configuration, automatically create new son file, new executing data is stored in described new son file.
Wherein, the method also comprises:
Create backup database, historical data is moved in described backup database and preserved.
Wherein, the partitioning strategies that is configured to chronomere described in and is granularity is:
The executing data of preserving for Physical layer corresponding to the concordance list of logical layer is configured to the partitioning strategies that chronomere is granularity;
The described partitioning strategies take chronomere as granularity be according to the rise time according to carrying out subregion days, or carry out subregion according to day in year according to the rise time, or carry out subregion according to Nian Jia ID mantissa according to rise time and ID.
Wherein, the method also comprises:
In the concordance list of logical layer, increase by a row zone bit Pflag, and determine according to partitioning strategies the temporal information that described Pflag preserves.
Wherein, describedly create multiple son files in Physical layer, and corresponding with the concordance list of logical layer according to the partitioning strategies of configuration, for:
According to the partitioning strategies of configuration, determine the quantity that creates son file in Physical layer;
According to the quantity of definite establishment son file, multiple son files that the index table creation that is logical layer in Physical layer is corresponding with described concordance list.
Wherein, described according to the partitioning strategies of configuration, the executing data of Physical layer is stored in respectively in multiple son files of establishment and is:
According to the rise time of the executing data of preserving in the partitioning strategies of configuration and described Pflag, will originally be stored in the existing executing data of Physical layer, then store into respectively in multiple son files of Physical layer establishment;
By associated with the concordance list of logical layer each son file in Physical layer.
A data handling system for database, this system comprises: dispensing unit, creating unit, storage unit; Wherein,
Dispensing unit, for being configured to the partitioning strategies that chronomere is granularity;
Creating unit, for according to the partitioning strategies of dispensing unit configuration, creates multiple son files in Physical layer, and corresponding with the concordance list of logical layer;
Storage unit, according to the partitioning strategies of dispensing unit configuration, by the executing data of Physical layer, is stored in respectively in multiple son files of establishment.
Wherein, described creating unit, also, for according to the partitioning strategies of dispensing unit configuration, creates new son file automatically;
Described storage unit, also for storing new executing data into described new son file.
Wherein, described creating unit, also for creating backup database;
Described storage unit, also preserves for historical data being moved to described backup database.
Wherein, described dispensing unit also comprises partitioning strategies configuration subelement;
Described partitioning strategies configuration subelement, the executing data that is used to the Physical layer corresponding to concordance list of logical layer to preserve is configured to the partitioning strategies that chronomere is granularity; The described partitioning strategies take chronomere as granularity be according to the rise time according to carrying out subregion days, or carry out subregion according to day in year according to the rise time, or carry out subregion according to Nian Jia ID mantissa according to rise time and ID.
Wherein, described dispensing unit also comprises Pflag configuration subelement;
Described Pflag configuration subelement, for increase by a row Pflag at the concordance list of logical layer, and determines according to partitioning strategies the temporal information that described Pflag preserves.
Wherein, described dispensing unit also comprises Physical layer son file configuration subelement;
Described Physical layer son file configuration subelement, for according to the partitioning strategies of configuration, determines the quantity that creates son file in Physical layer; According to the quantity of definite establishment son file, multiple son files that the index table creation that is logical layer in Physical layer is corresponding with described concordance list.
Wherein, described dispensing unit also comprises Physical layer son file stored configuration subelement;
Described Physical layer son file stored configuration subelement, for according to the rise time of the partitioning strategies of configuration and the executing data preserved of described Pflag, to originally be stored in the existing executing data of Physical layer, then store into respectively in multiple son files of Physical layer establishment; By associated with the concordance list of logical layer each son file in Physical layer.
The data processing method of database provided by the invention and system, be configured to the partitioning strategies that chronomere is granularity; According to the partitioning strategies of configuration, create multiple son files in Physical layer, and corresponding with the concordance list of logical layer; According to the partitioning strategies of configuration, the executing data of Physical layer is stored in respectively in multiple son files of establishment, so, according to rational partitioning strategies, the data of storage are divided into multiple storage areas, can improve the speed of the operations such as increase to executing data in the tables of data of database, deletion, modification, inquiry, promote database usability, thereby improve the performance of the business that relates to executing data.
Accompanying drawing explanation
Fig. 1 is the structural representation of logical layer and Physical layer in MySQL database in prior art;
Fig. 2 is the structural representation of logical layer and Physical layer in SQL Server database in prior art;
Fig. 3 is the schematic flow sheet of the data processing method of fulfillment database of the present invention;
Fig. 4 is the structural representation of logical layer and Physical layer in database in the present invention;
Fig. 5 is the structural representation of the data handling system of fulfillment database of the present invention;
Fig. 6 is the schematic diagram of subelement in the dispensing unit of data handling system of fulfillment database of the present invention.
Embodiment
Basic thought of the present invention is: be configured to the partitioning strategies that chronomere is granularity; According to the partitioning strategies of configuration, create multiple son files in Physical layer, and corresponding with the concordance list of logical layer; According to the partitioning strategies of configuration, the executing data of Physical layer is stored in respectively in multiple son files of establishment.
Below by drawings and the specific embodiments, the present invention is described in further detail again.
The invention provides a kind of data processing method of database, Fig. 3 is the schematic flow sheet of the data processing method of fulfillment database of the present invention, and as shown in Figure 3, the method comprises the following steps:
Step 301, is configured to the partitioning strategies that chronomere is granularity;
Concrete, the data that the executing data in executing data table generates while being executing data operation, such as transaction data, every transaction data has the multiple row information such as transaction id, exchange hour, dealing money;
The executing data of preserving for Physical layer corresponding to the concordance list of logical layer is configured to the partitioning strategies that chronomere is granularity; The described partitioning strategies take chronomere as granularity can be according to exchange hour according to carrying out subregion days, or carry out subregion according to exchange hour according to day in year, or carry out subregion etc. according to exchange hour and transaction id according to year+ID mantissa;
After configure partition strategy, need in the concordance list of logical layer, increase by a row zone bit Pflag, determine according to partitioning strategies the temporal information that this Pflag preserves, for example, partitioning strategies is while carrying out subregion such as exchange hour according to days according to the rise time, this Pflag is used for the days of the exchange hour of preserving every transaction data, i.e. time+month.
Step 302, according to the partitioning strategies of configuration, creates multiple son files in Physical layer, and corresponding with the concordance list of logical layer;
Concrete, as shown in Figure 4, according to the partitioning strategies of configuration, can determine the quantity that creates son file in Physical layer, according to definite quantity, in Physical layer, be multiple son files corresponding to index table creation of logical layer; In order to make the IO performance of hard disk reach best, the multiple son files that create can be evenly distributed on each hard disk of server;
For example, when in the time that executing data operates, the rise time of generated data is specially exchange hour, can carry out subregion according to days according to exchange hour time, for within 2010, being divided into 201001～201012 Gong12Ge districts, for within 2011, being divided into 201101～201112 Gong12Ge districts, for within 2012, being divided into 201201～201212 Gong12Ge districts, for 2009 and executing data before in 2009, fewer and feweri due to what use in business, therefore can be not according to carrying out subregion days, and according to carrying out subregion year, there is 1 subregion, therefore, for the executing data of 2009 to 2012, can create 37 son files in Physical layer, while carrying out subregion according to exchange hour according to day in year, within 2010, can be divided into 201001,201002 ..., 201030,201031 Gong31Ge districts.
Step 303, according to the partitioning strategies of configuration, is stored in the executing data of Physical layer respectively in multiple son files of establishment;
Concrete, according to the exchange hour of the executing data of preserving in the partitioning strategies of configuration and Pflag, will originally be stored in existing executing data in Physical layer master file, then store into respectively in multiple son files of Physical layer establishment; For example, partitioning strategies is while carrying out subregion according to exchange hour according to days, according to the days of the exchange hour of the executing data of preserving in Pflag, by the executing data of 2009 to 2012 according to the partitioning strategies on days, store into respectively in 37 son files of establishment, all executing datas of certain January in preserving one year in each son file, so, executing data in each son file is relatively even, executing data in the son file at least same time is relatively even, granularity of division is thinner, and exchange hour is also the conventional field in database;
Executing data is being stored into after multiple son files of Physical layer, by associated with the concordance list of logical layer each son file in Physical layer, cancelling the associated of master file and concordance list in Physical layer, realization replaces the mode of an original master file by multiple son files; So, carrying out after subregion, can in the son file of each establishment, inquire about the executing data needing by the concordance list of logical layer; In addition, can also move after a period of time at database, delete original master file.
Further, can, according to the partitioning strategies of configuration, automatically create new son file, new executing data is stored in described new son file;
Concrete, the son file of son file that described new son file can be next month, next year every month; Executing data, the executing data of certain month of next year that described new executing data can be next month.For instance, if be 2012 this year, the son file creating is only in Dec, 2012, therefore, optional, can also configure an automatic creation procedure, this automatic creation procedure can move automatically, and for example, in timing automatic operation on annual Dec 15, creation procedure is according to the partitioning strategies of configuration automatically, all son files of disposable establishment next year in Physical layer, the son file of the next year of establishment will be preserved the new executing data producing of next year; For example, if partitioning strategies is according to carrying out subregion days according to exchange hour, this automatic creation procedure can be in automatically operation on Dec 15th, 2012, in Physical layer disposable establishment 12 son files of 2013 201301,201302 ..., 201312; So, in Physical layer, 12 son files of corresponding 2013 will be stored respectively the executing data of in every month, 2013; Automatically creation procedure is completing after the creation operation of all son files of next year, by mail notification data base administrator; So, solve according to the scaling concern of data in partitioning strategies process database and sustainability problem.
Further, can also create backup database, historical data is moved in backup database and preserved;
Concrete, optionally, in Physical layer, can also create again a Backup Data table identical with the structure of executing data table and can be stored in backup database, As time goes on, according to the needs of business, can optionally the executing data not re-using be moved in the Backup Data table of establishment and store, for example when 2013 beginning of the year, no longer use the executing data of 2009,200900 son file is moved to Backup Data table; When the end of the year in 2013, do not re-use the data of the first quarter in 2010, the son file of 201001 son file, 201002 son file and 201003 is moved to Backup Data table and store, thereby solve the too problem of redundancy of historical data; And migration son file in executing data belong to the operation of Physical layer, even if there is up to ten million data volumes, database also can complete at Millisecond, efficiency is very high.
Utilize such scheme provided by the invention, master file in Physical layer is substituted by multiple son files, realize the partitioned storage of executing data in Physical layer, do not need to change logical layer, thereby do not need to change the using method of executing data table, and through checking, for the same executing data of inquiry, utilize existing method, need to consume the time of 62160 milliseconds, utilize technical scheme of the present invention, only need the time of 14953 milliseconds, in addition, the renewal of executing data, the speed that insert and deletion etc. operates also obviously improves, play obvious optimization function for the use of executing data.
It should be noted that, technical scheme of the present invention can be applied to MySQL database, SQL Server database, Oracle databases (Oracel).
For realizing said method, the present invention also provides a kind of data handling system of database, and Fig. 5 is the structural representation of the data handling system of fulfillment database of the present invention, and as shown in Figure 5, this system comprises: dispensing unit 50, creating unit 60, storage unit 70; Wherein,
Dispensing unit 50, for being configured to the partitioning strategies that chronomere is granularity;
Creating unit 60, for the partitioning strategies configuring according to dispensing unit 50, creates multiple son files in Physical layer, and corresponding with the concordance list of logical layer;
Wherein, described creating unit 60, the also partitioning strategies for configuring according to dispensing unit 50, creates new son file automatically;
Described storage unit 70, also for storing new executing data into described new son file.
Here the son file of son file that, described new son file can be next month, next year every month; Executing data, the executing data of certain month of next year that described new executing data can be next month.
Described creating unit 60, also for creating backup database;
Described storage unit 70, also preserves for historical data being moved to described backup database.
Concrete, it is that the partitioning strategies of granularity is that described dispensing unit 50 is configured to chronomere: the executing data of preserving for Physical layer corresponding to the concordance list of logical layer is configured to the partitioning strategies that chronomere is granularity; The described partitioning strategies take chronomere as granularity be according to the rise time such as exchange hour is according to carrying out subregion days, or carry out subregion according to exchange hour according to day in year, or carry out subregion according to exchange hour and transaction id according to Nian Jia ID mantissa.
Described creating unit 60, according to the partitioning strategies of configuration, for the concordance list of logical layer creates multiple son files in Physical layer is: according to the partitioning strategies of configuration, determine the quantity that creates son file in Physical layer; According to the quantity of definite establishment son file, multiple son files that the index table creation that is logical layer in Physical layer is corresponding.
Described storage unit 70 is according to the partitioning strategies of configuration, the executing data of Physical layer is stored in respectively in multiple son files of establishment to be: according to the partitioning strategies of configuration, determine the quantity that creates son file in Physical layer; According to the quantity of definite establishment son file, multiple son files that the index table creation that is logical layer in Physical layer is corresponding.
Dispensing unit 50 can also comprise one or more the combination in following subelement, be illustrated in figure 6 the instantiation that dispensing unit 50 comprises following all subelements, comprise partitioning strategies configuration subelement 501, Pflag configuration subelement 502, Physical layer son file configuration subelement 503 and Physical layer son file stored configuration subelement 504.
Partitioning strategies configuration subelement 501, the executing data that is used to the Physical layer corresponding to concordance list of logical layer to preserve is configured to the partitioning strategies that chronomere is granularity; The described partitioning strategies take chronomere as granularity be according to the rise time according to carrying out subregion days, or carry out subregion according to day in year according to the rise time, or carry out subregion according to Nian Jia ID mantissa according to rise time and ID.
Pflag configures subelement 502, for increase by a row Pflag at the concordance list of logical layer, and determines according to partitioning strategies the temporal information that described Pflag preserves.
Physical layer son file configuration subelement 503, for according to the partitioning strategies of configuration, determines the quantity that creates son file in Physical layer; According to the quantity of definite establishment son file, multiple son files that the index table creation that is logical layer in Physical layer is corresponding with described concordance list.
Physical layer son file stored configuration subelement 504, for according to the rise time of the partitioning strategies of configuration and the executing data preserved of described Pflag, to originally be stored in the existing executing data of Physical layer, then store into respectively in multiple son files of Physical layer establishment; By associated with the concordance list of logical layer each son file in Physical layer.
The above, be only preferred embodiment of the present invention, is not intended to limit protection scope of the present invention, all any modifications of doing within the spirit and principles in the present invention, is equal to and replaces and improvement etc., within all should being included in protection scope of the present invention.
Claims (14)
1. a data processing method for database, is characterized in that, is configured to the partitioning strategies that chronomere is granularity; The method also comprises:
According to the partitioning strategies of configuration, create multiple son files in Physical layer, and corresponding with the concordance list of logical layer;
According to the partitioning strategies of configuration, the executing data of Physical layer is stored in respectively in multiple son files of establishment.
2. method according to claim 1, is characterized in that, the method also comprises:
According to the partitioning strategies of configuration, automatically create new son file, new executing data is stored in described new son file.
3. method according to claim 1 and 2, is characterized in that, the method also comprises:
Create backup database, historical data is moved in described backup database and preserved.
4. method according to claim 1, is characterized in that, described in to be configured to chronomere be that the partitioning strategies of granularity is:
The executing data of preserving for Physical layer corresponding to the concordance list of logical layer is configured to the partitioning strategies that chronomere is granularity;
The described partitioning strategies take chronomere as granularity be according to the rise time according to carrying out subregion days, or carry out subregion according to day in year according to the rise time, or carry out subregion according to Nian Jia ID mantissa according to rise time and ID.
5. method according to claim 4, is characterized in that, the method also comprises:
In the concordance list of logical layer, increase by a row zone bit Pflag, and determine according to partitioning strategies the temporal information that described Pflag preserves.
6. method according to claim 1, is characterized in that, describedly creates multiple son files in Physical layer, and corresponding with the concordance list of logical layer according to the partitioning strategies of configuration, for:
According to the partitioning strategies of configuration, determine the quantity that creates son file in Physical layer;
According to the quantity of definite establishment son file, multiple son files that the index table creation that is logical layer in Physical layer is corresponding with described concordance list.
7. method according to claim 4, is characterized in that, described according to the partitioning strategies of configuration, the executing data of Physical layer is stored in respectively in multiple son files of establishment to be:
According to the rise time of the executing data of preserving in the partitioning strategies of configuration and described Pflag, will originally be stored in the existing executing data of Physical layer, then store into respectively in multiple son files of Physical layer establishment;
By associated with the concordance list of logical layer each son file in Physical layer.
8. a data handling system for database, is characterized in that, this system comprises: dispensing unit, creating unit, storage unit; Wherein,
Dispensing unit, for being configured to the partitioning strategies that chronomere is granularity;
Creating unit, for according to the partitioning strategies of dispensing unit configuration, creates multiple son files in Physical layer, and corresponding with the concordance list of logical layer;
Storage unit, according to the partitioning strategies of dispensing unit configuration, by the executing data of Physical layer, is stored in respectively in multiple son files of establishment.
9. system according to claim 8, is characterized in that,
Described creating unit, also, for according to the partitioning strategies of dispensing unit configuration, creates new son file automatically;
Described storage unit, also for storing new executing data into described new son file.
10. system according to claim 8 or claim 9, is characterized in that,
Described creating unit, also for creating backup database;
Described storage unit, also preserves for historical data being moved to described backup database.
11. systems according to claim 8, is characterized in that, described dispensing unit also comprises partitioning strategies configuration subelement;
Described partitioning strategies configuration subelement, the executing data that is used to the Physical layer corresponding to concordance list of logical layer to preserve is configured to the partitioning strategies that chronomere is granularity; The described partitioning strategies take chronomere as granularity be according to the rise time according to carrying out subregion days, or carry out subregion according to day in year according to the rise time, or carry out subregion according to Nian Jia ID mantissa according to rise time and ID.
12. systems according to claim 11, is characterized in that, described dispensing unit also comprises Pflag configuration subelement;
Described Pflag configuration subelement, for increase by a row Pflag at the concordance list of logical layer, and determines according to partitioning strategies the temporal information that described Pflag preserves.
13. systems according to claim 8, is characterized in that, described dispensing unit also comprises Physical layer son file configuration subelement;
Described Physical layer son file configuration subelement, for according to the partitioning strategies of configuration, determines the quantity that creates son file in Physical layer; According to the quantity of definite establishment son file, multiple son files that the index table creation that is logical layer in Physical layer is corresponding with described concordance list.
14. systems according to claim 11, is characterized in that, described dispensing unit also comprises Physical layer son file stored configuration subelement;
Described Physical layer son file stored configuration subelement, for according to the rise time of the partitioning strategies of configuration and the executing data preserved of described Pflag, to originally be stored in the existing executing data of Physical layer, then store into respectively in multiple son files of Physical layer establishment; By associated with the concordance list of logical layer each son file in Physical layer.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210418832.6A CN103793382B (en) | 2012-10-26 | 2012-10-26 | A kind of data processing method and system of database |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210418832.6A CN103793382B (en) | 2012-10-26 | 2012-10-26 | A kind of data processing method and system of database |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103793382A true CN103793382A (en) | 2014-05-14 |
| CN103793382B CN103793382B (en) | 2019-09-20 |
Family
ID=50669067
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210418832.6A Active CN103793382B (en) | 2012-10-26 | 2012-10-26 | A kind of data processing method and system of database |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103793382B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106407191A (en) * | 2015-07-27 | 2017-02-15 | 中国移动通信集团公司 | Data processing method and server |
| CN107291823A (en) * | 2017-05-25 | 2017-10-24 | 中国科学院计算技术研究所 | Concordance list and the measure of master file uniformity intensity based on inconsistent window |
| CN110299964A (en) * | 2019-06-28 | 2019-10-01 | 京东数字科技控股有限公司 | Data transmission method and its device, computer can storage mediums |
| CN110502471A (en) * | 2019-07-31 | 2019-11-26 | 联想(北京)有限公司 | A kind of data processing method and electronic equipment |
| CN110795427A (en) * | 2019-09-27 | 2020-02-14 | 苏宁云计算有限公司 | Data separation storage method and device, computer equipment and storage medium |
| CN112905606A (en) * | 2021-05-07 | 2021-06-04 | 中建电子商务有限责任公司 | Attendance identification algorithm based on bitmap |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5345586A (en) * | 1992-08-25 | 1994-09-06 | International Business Machines Corporation | Method and system for manipulation of distributed heterogeneous data in a data processing system |
| CN101216821A (en) * | 2007-01-05 | 2008-07-09 | 中兴通讯股份有限公司 | Data acquisition system storage management method |
| US7401174B2 (en) * | 2003-12-16 | 2008-07-15 | Matsushita Electric Industrial Co., Ltd. | File system defragmentation and data processing method and apparatus for an information recording medium |
| CN102063490A (en) * | 2010-12-20 | 2011-05-18 | 大唐移动通信设备有限公司 | Database partition method and device |
-
2012
- 2012-10-26 CN CN201210418832.6A patent/CN103793382B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5345586A (en) * | 1992-08-25 | 1994-09-06 | International Business Machines Corporation | Method and system for manipulation of distributed heterogeneous data in a data processing system |
| US7401174B2 (en) * | 2003-12-16 | 2008-07-15 | Matsushita Electric Industrial Co., Ltd. | File system defragmentation and data processing method and apparatus for an information recording medium |
| CN101216821A (en) * | 2007-01-05 | 2008-07-09 | 中兴通讯股份有限公司 | Data acquisition system storage management method |
| CN102063490A (en) * | 2010-12-20 | 2011-05-18 | 大唐移动通信设备有限公司 | Database partition method and device |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106407191A (en) * | 2015-07-27 | 2017-02-15 | 中国移动通信集团公司 | Data processing method and server |
| CN107291823A (en) * | 2017-05-25 | 2017-10-24 | 中国科学院计算技术研究所 | Concordance list and the measure of master file uniformity intensity based on inconsistent window |
| CN107291823B (en) * | 2017-05-25 | 2020-02-28 | 中国科学院计算技术研究所 | Method for measuring consistency strength between index table and main file based on inconsistent window |
| CN110299964A (en) * | 2019-06-28 | 2019-10-01 | 京东数字科技控股有限公司 | Data transmission method and its device, computer can storage mediums |
| CN110502471A (en) * | 2019-07-31 | 2019-11-26 | 联想(北京)有限公司 | A kind of data processing method and electronic equipment |
| CN110795427A (en) * | 2019-09-27 | 2020-02-14 | 苏宁云计算有限公司 | Data separation storage method and device, computer equipment and storage medium |
| CN110795427B (en) * | 2019-09-27 | 2022-10-11 | 苏宁云计算有限公司 | Data separation storage method and device, computer equipment and storage medium |
| CN112905606A (en) * | 2021-05-07 | 2021-06-04 | 中建电子商务有限责任公司 | Attendance identification algorithm based on bitmap |
| CN112905606B (en) * | 2021-05-07 | 2021-08-03 | 中建电子商务有限责任公司 | Attendance identification algorithm based on bitmap |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103793382B (en) | 2019-09-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10509785B2 (en) | Policy-driven data manipulation in time-series database systems | |
| US11030189B2 (en) | Maintaining up-to-date materialized views for time-series database analytics | |
| US20220107963A1 (en) | System and method for in-place data writes to reduce fragmentation in a multidimensional database environment | |
| CN103793382A (en) | Data processing method and system of database | |
| US9934266B2 (en) | Memory-efficient computer system for dynamic updating of join processing | |
| US8352429B1 (en) | Systems and methods for managing portions of files in multi-tier storage systems | |
| US8862540B2 (en) | Replica placement strategy for distributed data persistence | |
| US9672126B2 (en) | Hybrid data replication | |
| CN102541694A (en) | Method and device for database backup | |
| CN103455526A (en) | ETL (extract-transform-load) data processing method, device and system | |
| US20210081358A1 (en) | Background dataset maintenance | |
| US10108690B1 (en) | Rolling subpartition management | |
| CN109885642B (en) | Hierarchical storage method and device for full-text retrieval | |
| CN104462389A (en) | Method for implementing distributed file systems on basis of hierarchical storage | |
| CN102779138A (en) | Hard disk access method of real time data | |
| CN109669975B (en) | Industrial big data processing system and method | |
| CN110096509A (en) | Realize that historical data draws the system and method for storage of linked list modeling processing under big data environment | |
| CN102982186A (en) | Method and system for maintaining range partitioning table based on oracle database system | |
| US10289685B2 (en) | Information lifecycle governance | |
| US9798483B2 (en) | Object storage power consumption optimization | |
| CN103106271A (en) | Database backup and recovery method and system based on mass data | |
| CN103258047A (en) | Data organization method of data warehouse for controlling operation cost of medicine enterprise | |
| CN103631831A (en) | Data backup method and device | |
| CN103544302A (en) | Partition maintenance method and device of database | |
| US11232095B2 (en) | Composite metadata objects for database systems |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |