WO2017071525A1

WO2017071525A1 - Data storage method and apparatus and data query method and apparatus

Info

Publication number: WO2017071525A1
Application number: PCT/CN2016/102764
Authority: WO
Inventors: 池雷
Original assignee: 北京国双科技有限公司
Priority date: 2015-10-30
Filing date: 2016-10-20
Publication date: 2017-05-04
Also published as: CN106649368A

Abstract

A data storage method and apparatus and a data query method and apparatus. The data storage method comprises: in a metadata table, adding an index definition of index data (S102); in an index data storage table, retrieving a data storage position of unstored data (S104), wherein the data storage position includes a column in the index data storage table being empty; establishing a mapping relationship between the index definition and the retrieved data storage position, so as to obtain an associated storage position (S106); and storing the index data in the associated storage position (S108). The method and apparatus solve the technical problem that the query efficiency of index data is low in the prior art.

Description

Data storage method, device and data query method and device

Technical field

The present application relates to the field of databases, and in particular, to a data storage method, apparatus, and data query method and apparatus.

Background technique

Data stored in a relational database data analysis system usually has many indicators to provide different combinations of dimensional indicators for different customers. In many cases, it is also necessary to import indicator data of other system statistics into the data analysis system for comprehensive analysis. Taking advertisement monitoring as an example, data analysis systems usually have data monitoring indicators such as exposure, click, and click rate, which are also called data indicators. When you need to analyze the relationship between cost and exposure or click and order volume, you need to import indicators such as order quantity, and then perform query statistics to facilitate correlation analysis.

Since the imported indicators are related to the needs of the analysis, different customer needs are different, so the indicators to be imported are unpredictable. In order to achieve the analysis effect, the data analysis system in the prior art introduces storage and query support of dynamic indicators. Taking the data analysis of advertisement monitoring as an example, the data recorded in the data analysis system is as shown in Table 1. When the indicators of “cost” and “order” need to be imported, the definition of the indicator is added first, as shown in Table 2. Regenerate the dynamic indicator data table, as shown in Table 3.

Table 1

维度IDDimension ID	曝光exposure	点击Click	点击率Click rate
11	100100	33	3.00％3.00%
…...

Table 2

指标IDIndicator ID	名称name
11	成本cost
22	订单Order
…...

table 3

维度IDDimension ID	指标值Index value	指标IDIndicator ID
11	100100	11
22	11	22
…...

When querying indicator data, its query statement is as follows:

Therefore, after importing the indicator, in the process of querying the original indicator and the imported indicator data, it is necessary to first convert the row storage indicator into a column storage, and jointly query the original indicator by the indicator relationship. Although the scheme overcomes the query implementation problem of adding dynamic indicators, it can dynamically complete the data analysis work without predicting the number of indicators. However, as time accumulates and the amount of data increases, the above scheme first stores the data. The query is converted to column storage. This query step will become slower and the query efficiency will gradually decrease.

In response to the above problems, no effective solution has been proposed yet.

Summary of the invention

The embodiment of the present application provides a data storage method, apparatus, and data query method and apparatus, so as to at least solve the technical problem of low efficiency of index data query in the prior art.

According to an aspect of the embodiments of the present application, a data storage method is provided, including: adding, in a metadata table, an indicator definition of the indicator data; and in the indicator data storage table, retrieving a data storage location of the unstored data, where The data storage location includes a column in the indicator data storage table is empty; establishing a mapping relationship between the indicator definition and the retrieved data storage location to obtain an associated storage location; storing the indicator data to the association In the storage location.

Further, establishing a mapping relationship between the indicator definition and the retrieved data storage location includes: obtaining an identifier of the retrieved data storage location; and querying, from the metadata table, a data table of a mapping relationship column corresponding to the indicator definition And storing an identifier of the retrieved data storage location into the data table to establish a mapping relationship between the data storage location and the indicator definition, and using the data storage location as the associated storage location.

Further, before querying the empty column preset in the indicator data storage table stored in the column, the method further includes: setting N columns of empty columns in the indicator data storage table, and using the empty column as the The data storage location, where 0 < N ≤ Max, the Max is a maximum value supported by a database storing index data; and the indicator data storage table is set in the database as column storage.

Further, the method further includes deleting, when the deletion instruction for deleting the indicator data is deleted, the indicator definition indicated by the deletion instruction in the metadata table and the indicator data in the indicator data storage table a mapping relationship; the metadata in the metadata table that records the indicator definition indicated by the deletion instruction is marked as redundant.

Further, before storing the indicator data in the associated storage location, the method further includes: acquiring a data type of the indicator data; acquiring a data storage type supported by the associated storage location; Determining, by the data type of the indicator data and the data storage type supported by the associated storage location, an associated storage location that matches a data type of the indicator data; storing the indicator data to a data type of the indicator data Match the associated storage location.

According to another aspect of the embodiments of the present application, a data query method is further provided, including: receiving a query instruction for querying indicator data; determining an indicator definition indicated by the query instruction from a metadata table, determining the The mapping relationship between the indicator indicated by the query instruction and the indicator data in the indicator data storage table is used; and the indicator data indicated by the query instruction is queried from the indicator data storage table by using the mapping relationship.

According to another aspect of the embodiments of the present application, a data storage apparatus is further provided, including: an adding unit, configured to add an indicator definition of the indicator data in the metadata table; and a retrieval unit, configured to be in the indicator data storage table , Retrieving a data storage location of the unstored data, wherein the data storage location includes a column in the indicator data storage table is empty; and an establishing unit, configured to establish a mapping relationship between the indicator definition and the data storage location, Obtaining an associated storage location; and importing unit for storing the indicator data in the associated storage location.

Further, the establishing unit includes: an obtaining module, configured to acquire an identifier of the retrieved data storage location; and a query module, configured to query data of the mapping relationship column corresponding to the indicator definition from the metadata table a table; a writing module, configured to store an identifier of the retrieved data storage location into the data table to establish a mapping relationship between the data storage location and the indicator definition, and use the data storage location as the association storage location.

Further, the apparatus further includes: a first setting unit, configured to set an N column of empty columns in the indicator data storage table, and use the empty column as the data before retrieving a data storage location of the unstored data a storage location, where 0<N≤Max, the Max is a maximum value supported by a database storing index data; and a second setting unit configured to set the indicator data storage table in the database as a column storage.

Further, the device further includes: a deleting unit, configured to delete the indicator definition indicated by the deletion instruction in the metadata table and the indicator data storage table when receiving the deletion instruction for deleting the indicator data a mapping relationship of the indicator data in the marking unit, configured to mark metadata in the metadata table that records the indicator definition indicated by the deletion instruction as redundant.

Further, the device further includes: a first acquiring unit, configured to acquire a data type of the indicator data; and a second acquiring unit, configured to acquire a data storage type supported by the associated storage location; And determining, according to the data type of the indicator data and the data storage type supported by the associated storage location, an associated storage location that matches a data type of the indicator data, and a storage unit configured to use the indicator The data is stored to an associated storage location that matches the data type of the indicator data.

According to another aspect of the embodiments of the present application, a data query apparatus is provided, including: a receiving unit, configured to receive a query instruction for querying indicator data; and a second determining unit, configured to determine, from the metadata table Determining, by the query instruction, the index definition, the mapping relationship between the indicator definition indicated by the query instruction and the indicator data in the indicator data storage table; and the query unit, configured to use the mapping relationship from the indicator data storage table Querying indicator data indicated by the query instruction.

According to the embodiment of the present application, in the metadata table, the indicator definition of the indicator data is added; in the indicator data storage table, the data storage location of the unstored data is retrieved, wherein the data storage location includes the column in the indicator data storage table is empty Establishing a mapping relationship between the indicator definition and the retrieved data storage location to obtain an associated storage location; storing the indicator data in the associated storage location, reducing the IO performance overhead of converting the row storage indicator into the column storage, and improving the query efficiency, The technical problem of low efficiency of index data query in the prior art is solved.

DRAWINGS

The drawings described herein are intended to provide a further understanding of the present application, and are intended to be a part of this application. In the drawing:

1 is a flow chart of a data storage method according to an embodiment of the present application;

2 is a flowchart of a data query method according to an embodiment of the present application;

3 is a schematic diagram of a data storage device in accordance with an embodiment of the present application;

4 is a schematic diagram of a data query device in accordance with an embodiment of the present application.

detailed description

The technical solutions in the embodiments of the present application are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present application. It is an embodiment of the present application, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present application without departing from the inventive scope shall fall within the scope of the application.

It should be noted that the terms "first", "second" and the like in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or order. It is to be understood that the data so used may be interchanged where appropriate, so that the embodiments of the present application described herein can be implemented in a sequence other than those illustrated or described herein. In addition, the terms "comprises" and "comprises" and "the" and "the" are intended to cover a non-exclusive inclusion, for example, a process, method, system, product, or device that comprises a series of steps or units is not necessarily limited to Those steps or units may include other steps or units not explicitly listed or inherent to such processes, methods, products or devices.

According to an embodiment of the present application, a method embodiment of a data storage method is provided. It should be noted that the steps illustrated in the flowchart of the accompanying drawings may be performed in a computer system such as a set of computer executable instructions, and Although a logical order is shown in the flowcharts, in some cases the steps shown or described may be performed in a different order than the ones described herein.

FIG. 1 is a flowchart of a data storage method according to an embodiment of the present application. As shown in FIG. 1, the method includes the following steps:

In step S102, an indicator definition of the indicator data is added in the metadata table.

The metadata table is a data table for recording indicator metadata, and the identifier of the indicator may be recorded on the metadata table. Metadata such as name, data type, etc. In this embodiment, when the indicator needs to be imported into the data analysis system, the indicator definition of the indicator data is added to the metadata table, which may include adding the identifier, name, data type, and the like of the indicator data for querying and storing. Data (for example: data type for data storage format verification).

Step S104, in the indicator data storage table, the data storage location of the unstored data is retrieved, wherein the data storage location includes the column in the indicator data storage table being empty.

Step S106, establishing a mapping relationship between the indicator definition and the retrieved data storage location to obtain an associated storage location.

The indicator data storage table is a data table in which statistical data of various indicators are recorded. In the embodiment of the present application, the indicator data storage table may be set to be column storage, or may be set to row storage, that is, the indicator data is stored in a data column or stored in a row, and each column represents statistical data of an indicator in different dimensions, and is in the indicator. The data storage table is preset with a data storage location where the indicator data is not stored, such as a blank line or an empty column, so that after the indicator data is imported, the indicator data is imported into a data storage location of the preset unstored indicator data.

In step S108, the indicator data is stored in the associated storage location.

After the mapping relationship between the indicator definition and the retrieved data storage location is established, the import location of the indicator data is determined as the associated storage location. Therefore, the acquired indicator data can be imported into the associated storage location mapped by the above established mapping relationship. . In the embodiment of the present application, the data storage location in which the indicator data is not stored is preset in the indicator data storage table for importing the indicator data, so that the imported indicator data and the original indicator data in the data analysis system are in the same indicator data storage table. When the indicator data is queried, the row storage metrics need not be converted into column storage, which reduces the IO performance overhead of the row storage metrics into column storage, and improves the query efficiency.

According to the embodiment of the present application, in the metadata table, the indicator definition of the indicator data is added; in the indicator data storage table, the data storage location of the unstored data is retrieved, wherein the data storage location includes the column in the indicator data storage table is empty Establishing a mapping relationship between the indicator definition and the retrieved data storage location to obtain an associated storage location; storing the indicator data in the associated storage location, and eliminating the need to convert the row storage indicator into column storage when performing the indicator data query, reducing The row storage index is converted into the IO performance overhead of the column storage, which improves the query efficiency and solves the technical problem of low efficiency of index data query in the prior art.

As an optional implementation manner, before querying the empty column preset in the indicator data storage table stored in the column, the method further includes: setting an N column empty column in the indicator data storage table, and using the empty column as the data The storage location, where 0 < N ≤ Max, Max is the maximum value supported by the database storing the indicator data; the indicator data storage table is set in the database as the column storage.

In the embodiment of the present application, N columns of empty columns are set in the indicator data storage table stored in advance in the data analysis system, wherein N can be arbitrarily selected from 0 to Max. Each empty column can be added with a corresponding identifier for indicating Corresponding empty or empty lines. If the indicator data storage table is set to column storage, each column represents statistics of an indicator in different dimensions, as shown in Table 4; if the indicator data storage table is set to row storage, each row represents one item The statistics of the indicators in different dimensions.

Table 4

维度IDDimension ID	曝光exposure	点击Click	点击率Click rate	预置1Preset 1	…...	预置NPreset N

As an optional implementation manner, establishing a mapping relationship between the indicator definition and the retrieved data storage location includes: obtaining an identifier of the retrieved data storage location; and querying the data table of the mapping relationship column corresponding to the indicator definition from the metadata table The identifier of the retrieved data storage location is stored in the data table to establish a mapping relationship between the data storage location and the indicator definition, and the data storage location is used as the associated storage location.

In the embodiment of the present application, each data storage location in the preset indicator data storage table is provided with a corresponding identifier, such as “preset 1”... “preset N” shown in Table 4, and the indicator data is imported. During the process, if an empty column of the imported indicator data is determined, the identifier is obtained, and then the identifier is written into the data table of the mapping relationship column corresponding to the imported indicator in the metadata table to establish an empty column and an imported The mapping relationship between indicators. The principle of using blank lines as the data storage location is the same as that of the empty column, and will not be described here.

table 5

As shown in Table 4 and Table 5, the indicators whose names are “Order” and “Cost” are imported indicators, and the identifiers of the empty columns corresponding to the above indicators in the mapping relationship column are “Preset 1” and “ Preset 2", when the indicator data is imported into Table 4, there is a mapping relationship between the above indicators in Table 5 and their indicator data.

As an optional implementation manner, the method further includes: deleting a mapping relationship between the indicator definition indicated by the deletion instruction in the metadata table and the indicator data in the indicator data storage table when receiving the deletion instruction for deleting the indicator data The metadata defined by the indicator indicated by the record deletion instruction in the metadata table is marked as redundant.

In the embodiment of the present application, when a certain indicator data needs to be deleted, the mapping relationship between the indicator definition indicated by the deletion instruction and the indicator data is deleted, and the metadata defined by the indicator recorded in the metadata table is marked as redundant. In this way, the data analysis system will delete it when it is idle.

It should be noted that, in the embodiment of the present application, the data in each example is only used as an example of the advertisement monitoring data. After reading the specification of the present application, those skilled in the art may know that the technical solutions of the embodiments of the present application may be used for each The data storage and query of multiple indicators are not unduly limited in the embodiment of the present application.

As an optional implementation manner, before the storing the indicator data in the associated storage location, the method further includes: acquiring a data type of the indicator data; acquiring a data storage type supported by the associated storage location; and a data type according to the indicator data. And the data storage type supported by the associated storage location, determining an associated storage location that matches the data type of the indicator data; storing the indicator data to an associated storage location that matches the data type of the indicator data. Thus, with embodiments of the present invention, data can be stored to a storage location that matches its data type.

According to an embodiment of the present application, there is also provided a method embodiment of a data query method, and it should be noted that the steps shown in the flowchart of the drawing may be executed in a computer system such as a set of computer executable instructions, and Although the logical order is shown in the flowcharts, in some cases the steps shown or described may be performed in a different order than the ones described herein. The data query method in the embodiment of the present application may be queried based on the indicator data stored and imported by the data storage method in the embodiment of the present application, that is, the data query method in the embodiment of the present application may be used to query the data in the embodiment of the present application. The storage method stores and imports the indicator data.

As shown in FIG. 2, the data query method in this embodiment of the present application includes:

Step S202, receiving a query instruction for querying indicator data.

Step S204: Determine an indicator definition indicated by the query instruction from the metadata table, and determine a mapping relationship between the indicator definition indicated by the query instruction and the indicator data in the indicator data storage table.

Step S206, querying, by using the mapping relationship, the indicator data indicated by the query instruction from the indicator data storage table.

After the indicator data is imported by using the data storage method of the embodiment of the present application (refer to the description of the data storage method in the embodiment of the present application), the imported indicator data and the original indicator data are stored in the indicator data storage table.

After receiving the query instruction for querying the indicator data, combining the metadata table and the indicator data storage table, the reference finger The corresponding indicator data is directly queried in the standard data storage table. In the embodiment of the present application, the data storage location is preset in the indicator data storage table for importing the indicator data, so that the imported indicator data and the original indicator data in the data analysis system are in the same indicator data storage table, and the indicator data is performed. When querying, there is no need to convert row storage metrics into column storage, which reduces the IO performance overhead of row storage metrics converted into column storage and improves query efficiency.

For example, taking Table 4 and Table 5 above as examples, when querying indicator data, the query statement is as follows:

Therefore, in the index data query process of the embodiment of the present application, only the column in which the index is queried in the metadata table is needed, and the group query is directly performed, and the performance is greatly improved.

The embodiment of the present application further provides a data storage device, which can be used to execute the data storage method of the embodiment of the present application. As shown in FIG. 3, the device includes: an adding unit 301, a retrieving unit 303, an establishing unit 305, and Import unit 307.

The adding unit 301 is configured to add an indicator definition of the indicator data in the metadata table.

The metadata table is a data table for recording indicator metadata, and metadata such as an identifier, a name, and a data type of the indicator may be recorded on the metadata table. In this embodiment, when the indicator needs to be imported into the data analysis system, the indicator definition of the indicator data is added to the metadata table, which may include adding the identifier, name, data type, and the like of the indicator data for querying and storing. Data (for example: data type for data storage format verification).

The retrieval unit 303 is configured to retrieve, in the indicator data storage table, a data storage location of the unstored data, wherein the data storage location includes a column in the indicator data storage table that is empty.

The establishing unit 305 is configured to establish a mapping relationship between the indicator definition and the data storage location to obtain an associated storage location.

The indicator data storage table is a data table in which statistical data of various indicators are recorded. In the embodiment of the present application, the indicator The data storage table can be set to column storage or set to row storage, that is, the indicator data is stored in a data column or stored in a row, and each column represents statistical data of an indicator in different dimensions, and is preset in the indicator data storage table. The data storage location of the indicator data, such as a blank line, is stored, so that after the indicator data is imported, the indicator data is imported into a data storage location of the preset unstored indicator data.

The import unit 307 is configured to store the indicator data in an associated storage location.

As an optional implementation manner, the apparatus further includes: a first setting unit, configured to set an N column empty column in the indicator data storage table, and use an empty column or a blank line as a data storage location for retrieving data that is not stored. The data storage location, where 0<N≤Max, Max is the maximum value supported by the database storing the indicator data; and the second setting unit is configured to set the indicator data storage table in the database as the column storage.

In the embodiment of the present application, N columns of empty columns are set in the indicator data storage table stored in advance in the data analysis system, wherein N can be arbitrarily selected from 0 to Max. Each empty column can be added with a corresponding identifier to indicate the corresponding empty column. If the indicator data storage table is set to column storage, each column represents statistics of an indicator in different dimensions, as shown in Table 4; if the indicator data storage table is set to row storage, each row represents one item The statistics of the indicators in different dimensions.

As an optional implementation manner, the establishing unit includes: an obtaining module, configured to obtain an identifier of the retrieved data storage location; and a query module, configured to query, from the metadata table, a data table of the mapping relationship column corresponding to the index definition; The writing module is configured to store the identifier of the retrieved data storage location into the data table to establish a mapping relationship between the data storage location and the indicator definition, and use the data storage location as the associated storage location.

In the embodiment of the present application, each data storage location in the preset indicator data storage table is set corresponding thereto The identifier, as shown in Table 4, "Preset 1" ... "Preset N", in the process of importing the indicator data, if the empty column of the index data is determined, the identifier is obtained, and then the identifier is written. In the data table of the mapping relationship column corresponding to the imported indicator in the metadata table, a mapping relationship between the empty column and the imported indicator is established. The principle of using blank lines as the data storage location is the same as that of the empty column, and will not be described here.

As an optional implementation manner, the device further includes: a deleting unit, configured to delete the indicator definition and the indicator data storage table indicated by the deletion instruction in the metadata table when receiving the deletion instruction for deleting the indicator data A mapping relationship of the indicator data; the marking unit is configured to mark the metadata defined by the indicator indicated by the record deletion instruction in the metadata table as redundant.

As an optional implementation manner, the foregoing apparatus further includes: a first acquiring unit, configured to acquire a data type of the indicator data; and a second acquiring unit, configured to acquire a data storage type supported by the associated storage location; And determining, according to the data type of the indicator data and the data storage type supported by the associated storage location, an associated storage location that matches the data type of the indicator data; and a storage unit configured to store the indicator data to the data type of the indicator data Match the associated storage location.

It should be noted that the data storage device of the embodiment of the present application may further include: a metadata storage unit, configured to add a definition of the indicator, establish a mapping relationship between the indicator and the preset table column, and store other metadata information, and use Query and storage (for example: data type for data storage format check); and data unit for updating a column of data or a cell data (including new data or updated data) in the indicator data storage table, and deleting the indicator data Stores a column of data or a cell of data in a table and supports batch operations to improve operational performance and transaction support. The metadata storage unit is equivalent to the adding unit and the establishing unit in the embodiment of the present application, and the data unit is equivalent to the searching unit, the import unit, the deleting unit, the marking unit, and the like.

The data storage device includes a processor and a memory, and the adding unit 301, the retrieving unit 303, the establishing unit 305, the importing unit 307, and the like are each stored as a program unit in a memory, and the program unit stored in the memory is executed by the processor.

The processor contains a kernel, and the kernel removes the corresponding program unit from the memory. The kernel can be set to one or more, and the indicator data can be imported by adjusting the kernel parameters.

The memory may include non-persistent memory, random access memory (RAM), and/or non-volatile memory in a computer readable medium, such as read only memory (ROM) or flash memory (flash RAM), the memory including at least one Memory chip.

The present application also provides an embodiment of a computer program product, when executed on a data processing device, adapted to perform a program code that initializes a method step of: adding an indicator definition of the indicator data in the metadata table; In the data storage table, the data storage location of the unstored data is retrieved, wherein the data storage location includes a column in the indicator data storage table is empty; and a mapping relationship between the indicator definition and the retrieved data storage location is established to obtain an associated storage location; Store metric data in an associated storage location.

The embodiment of the present application further provides a data query device, which can be used to perform the data query method of the embodiment of the present application. As shown in FIG. 4, the device includes: a receiving unit 401, a second determining unit 403, and a query unit. 405.

The receiving unit 401 is configured to receive a query instruction for querying the indicator data.

The second determining unit 403 is configured to determine, from the metadata table, the indicator definition indicated by the query instruction, and determine a mapping relationship between the indicator definition indicated by the query instruction and the indicator data in the indicator data storage table.

The query unit 405 is configured to query the indicator data indicated by the query instruction from the indicator data storage table by using the mapping relationship.

After receiving the query instruction for querying the indicator data, combining the metadata table and the indicator data storage table, directly querying the corresponding indicator data from the indicator data storage table. In the embodiment of the present application, the data storage location is preset in the indicator data storage table for importing the indicator data, so that the imported indicator data and the original indicator data in the data analysis system are in the same indicator data storage table, and the indicator data is performed. When querying, there is no need to convert row storage metrics into column storage, which reduces the IO performance overhead of row storage metrics converted into column storage and improves query efficiency.

The data querying device includes a processor and a memory, and the receiving unit 401, the second determining unit 403, the query unit 405, and the like are all stored as a program unit in a memory, and the program unit stored in the memory is executed by the processor.

The processor contains a kernel, and the kernel removes the corresponding program unit from the memory. The kernel can set one or more and query the indicator data by adjusting the kernel parameters.

The memory may include non-persistent memory, random access memory (RAM) and/or in a computer readable medium. Or a form of non-volatile memory, such as a read only memory (ROM) or a flash memory (flash RAM), the memory including at least one memory chip.

The present application also provides an embodiment of a computer program product, when executed on a data processing device, adapted to perform program code initialization having the following method steps: receiving a query instruction for querying indicator data, from a metadata table Determining the indicator definition indicated by the query instruction, determining a mapping relationship between the indicator definition indicated by the query instruction and the indicator data in the indicator data storage table, and using the mapping relationship to query the indicator data indicated by the query instruction from the indicator data storage table.

The serial numbers of the embodiments of the present application are merely for the description, and do not represent the advantages and disadvantages of the embodiments.

In the above-mentioned embodiments of the present application, the descriptions of the various embodiments are different, and the parts that are not detailed in a certain embodiment can be referred to the related descriptions of other embodiments.

In the several embodiments provided by the present application, it should be understood that the disclosed technical contents may be implemented in other manners. The device embodiments described above are only schematic. For example, the division of the unit may be a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be combined or may be Integrate into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, unit or module, and may be electrical or otherwise.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application, in essence or the contribution to the prior art, or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium. A number of instructions are included to cause a computer device (which may be a personal computer, server or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present application. The foregoing storage medium includes: a U disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic disk, or an optical disk, and the like. .

The above description is only a preferred embodiment of the present application, and it should be noted that those skilled in the art can also make several improvements and retouchings without departing from the principles of the present application. It should be considered as the scope of protection of this application.

Claims

A data storage method, comprising:

In the metadata table, add the indicator definition of the indicator data;

Retrieving, in the indicator data storage table, a data storage location of the unstored data, wherein the data storage location includes a column in the indicator data storage table that is empty;

Establishing a mapping relationship between the indicator definition and the retrieved data storage location to obtain an associated storage location;

The indicator data is stored in the associated storage location.
The method of claim 1, wherein establishing a mapping relationship between the indicator definition and the retrieved data storage location comprises:

Obtaining an identifier of the retrieved data storage location;

Querying, from the metadata table, a data table of a mapping relationship column corresponding to the indicator definition;

And storing an identifier of the retrieved data storage location into the data table to establish a mapping relationship between the data storage location and the indicator definition, and using the data storage location as the associated storage location.
The method of claim 1 wherein prior to retrieving the data storage location where the data is not stored, the method further comprises:

Setting N columns of empty columns in the indicator data storage table, and using the empty columns as the data storage location, where 0<N≤Max, the Max is a maximum value supported by a database storing index data;

The indicator data storage table is set in the database as a column storage.
The method of claim 1 wherein the method further comprises:

And when the deletion instruction for deleting the indicator data is received, deleting a mapping relationship between the indicator definition indicated by the deletion instruction in the metadata table and the indicator data in the indicator data storage table;

The metadata in the metadata table in which the indicator definition indicated by the deletion instruction is recorded is marked as redundant.
The method of claim 1 wherein before the storing the indicator data in the associated storage location, the method further comprises:

Obtaining a data type of the indicator data;

Obtaining a data storage type supported by the associated storage location;

Determining an associated storage location that matches a data type of the indicator data according to a data type of the indicator data and a data storage type supported by the associated storage location;

The indicator data is stored in an associated storage location that matches the data type of the indicator data.
A data query method, including:

Receiving a query instruction for querying indicator data;

Determining, from the metadata table, the indicator definition indicated by the query instruction, determining a mapping relationship between the indicator definition indicated by the query instruction and the indicator data in the indicator data storage table;

The indicator data indicated by the query instruction is queried from the indicator data storage table by using the mapping relationship.
A data storage device, comprising:

Add a unit for adding a metric definition of the indicator data in the metadata table;

a retrieval unit, configured to retrieve, in the indicator data storage table, a data storage location of the unstored data, wherein the data storage location includes a column in the indicator data storage table that is empty;

Establishing a unit, configured to establish a mapping relationship between the indicator definition and the data storage location to obtain an associated storage location;

And an importing unit, configured to store the indicator data into the associated storage location.
The apparatus of claim 7, wherein the establishing unit comprises:

An obtaining module, configured to obtain an identifier of the retrieved data storage location;

a query module, configured to query, from the metadata table, a data table of a mapping relationship column corresponding to the indicator definition;

a writing module, configured to store an identifier of the retrieved data storage location into the data table to establish a mapping relationship between the data storage location and the indicator definition, and use the data storage location as the associated storage location .
The apparatus of claim 7 wherein said apparatus further comprises:

a first setting unit, configured to set an N column of empty columns in the indicator data storage table before using the data storage location of the unstored data, and use the empty column as the data storage location, where 0<N≤ Max, The Max is a maximum value supported by a database storing indicator data;

And a second setting unit, configured to set the indicator data storage table in the database as a column storage.
The apparatus of claim 7 wherein said apparatus further comprises:

a deleting unit, configured to delete a mapping relationship between the indicator definition indicated by the deletion instruction in the metadata table and the indicator data in the indicator data storage table when receiving the deletion instruction for deleting the indicator data;

a marking unit, configured to mark metadata in the metadata table that records the indicator definition indicated by the deletion instruction as redundant.
The apparatus of claim 7 wherein said apparatus further comprises:

a first acquiring unit, configured to acquire a data type of the indicator data before storing the indicator data in the associated storage location;

a second acquiring unit, configured to acquire a data storage type supported by the associated storage location;

a first determining unit, configured to determine, according to a data type of the indicator data and a data storage type supported by the associated storage location, an associated storage location that matches a data type of the indicator data;

And a storage unit, configured to store the indicator data to an associated storage location that matches a data type of the indicator data.
A data query device, comprising:

a receiving unit, configured to receive a query instruction for querying indicator data;

a second determining unit, configured to determine, from the metadata table, the indicator definition indicated by the query instruction, and determine a mapping relationship between the indicator definition indicated by the query instruction and the indicator data in the indicator data storage table;

And a query unit, configured to query, from the indicator data storage table, the indicator data indicated by the query instruction by using the mapping relationship.