CN103744952A - Method and system for implementing multi-table property of NoSQL database - Google Patents
Method and system for implementing multi-table property of NoSQL database Download PDFInfo
- Publication number
- CN103744952A CN103744952A CN201410001133.0A CN201410001133A CN103744952A CN 103744952 A CN103744952 A CN 103744952A CN 201410001133 A CN201410001133 A CN 201410001133A CN 103744952 A CN103744952 A CN 103744952A
- Authority
- CN
- China
- Prior art keywords
- database
- module
- name
- data
- asynchronous
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Abstract
The invention relates to the technical field of databases, and discloses a method and a system for implementing a multi-table property of NoSQL database. Encapsulation optimization is performed on the interface of a database on the basis of the NoSQL database in order to provide a table-including database interface for a user. Synchronization, asynchronization and traversing operation is performed. The multi-table property is added on the original basis, thereby solving the use problem of an internal storage, saving the space of the internal storage, eliminating internal storage operation and synchronization operation between the internal storage and the database, and lowering the complexity of data operation.
Description
Technical field
The present invention relates to the technical field of non-relational data manipulation, the technical field that particularly NoSQL database multi-list characteristic realizes.
Background technology
Current non-relational database does not have the concept of table, table can not realized and searches efficiently and write, and the demand that adapts to the very large and high concurrent read-write of present data volume, the processing mode of multilist can be divided into a plurality of tables by information in database by the mode being initialised in internal memory at present.
A. the information in each table is read in internal memory;
B. read the information in master meter, and in internal memory, generate master meter record set;
C. according to the incidence relation between the unknown message in the master meter record set of setting up in advance and time table information, the unknown message of take in described master meter record set is index, by described incidence relation, retrieve the inferior table information being associated with this unknown message in internal memory, and the Given information in described master meter record set and the relevant time table information retrieving are assembled into the complete documentation of database multi-list information.
There is following defect in prior art: the memory space of internal memory has limited the size of quantity of information in database, and the stationary problem of database and data in EMS memory has increased operational ton.
Summary of the invention
In view of this, the invention provides a kind of implementation method and system of NoSQL database multi-list characteristic, to reduce the database of carrying out in database multi-list information initializing process, read number of times, shorten initialization time, improve the execution efficiency of database manipulation.
On the one hand, the invention provides a kind of implementation method of NoSQL database multi-list characteristic, it comprises the following steps:
S1: initialization data storehouse table;
S2: the interface providing by system carries out synchronous operation, asynchronous operation and traversing operation
S3: judge whether to exit, if directly exit; If not, go to step S2.
Further, above-mentioned synchronous operation and asynchronous operation all comprise reading and writing, deletion action, and carry the parameter that table name claims.
Further, described traversing operation comprises two kinds of traversal modes: travel through the data in whole database and travel through the data in an independent table.
The name of the table carrying according to traversing operation further, is distinguished described traversal mode.
Further, to the operation of database, can not add the name of table, now with the mode of operation operating database of NoSQL database.
Meanwhile, the present invention also provides a kind of system that realizes of NoSQL database multi-list characteristic, and it comprises following ingredient:
Initialization module: show for initialization data storehouse;
Interface module: comprise synchronization module, asynchronous module and spider module, wherein synchronization module is used for providing synchronous operation, and asynchronous module is used for providing asynchronous operation, and spider module is used for providing traversing operation;
Judge module: exit for judging whether, if directly exit; If not, converting interface module is carried out corresponding operating.
Further, above-mentioned synchronization module and asynchronous module all comprise reading and writing, deletion action, and carry the parameter that table name claims.
Further, described spider module comprises two kinds of traversal modes: travel through the data in whole database and travel through the data in an independent table.
The name of the table carrying when operating according to spider module further, is distinguished described traversal mode.
Further, to the operation of database, can not add the name of table, now with the mode of operation operating database of NoSQL database.
The present invention is by encapsulating optimization by the interface of database on the basis at NoSQL database, offer database interface that comprises table of user, add on the original basis multilist characteristic, thereby avoided the problem of the use of internal memory, saved memory headroom, save the operation of synchronizeing between internal memory operation and internal memory and database, reduced the complexity of data manipulation.Increase the concept of information classification in database simultaneously, expanded the range of application of database.
Accompanying drawing explanation
Fig. 1 is the system construction drawing of realizing NoSQL database multi-list characteristic of the embodiment of the present invention;
Fig. 2 is the method flow diagram of realizing NoSQL database multi-list characteristic of the embodiment of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is clearly and completely described.Obviously, described embodiment is for implementing better embodiment of the present invention, and described description is to illustrate that rule of the present invention is object, not in order to limit scope of the present invention.Protection scope of the present invention should with claim the person of being defined be as the criterion, the embodiment based in the present invention, the every other embodiment that those of ordinary skills obtain under the prerequisite of not making creative work, belongs to the scope of protection of the invention.
The present invention, by the interface of database being encapsulated to optimization on the basis at NoSQL database, offers the database interface project that one of user comprises table, adds on the original basis multilist characteristic.
With reference to Fig. 1, wherein show the system construction drawing of realizing NoSQL database multi-list characteristic according to the embodiment of the present invention, be described as follows.
System comprises NoSQL database, database interface module and user.Database interface module is used to user that a database interface that comprises table is provided, so that NoSQL database is operated.This interface module is mainly divided into three submodules: synchronization module, asynchronous module and spider module.Synchronization module and asynchronous module all comprise reading and writing and delete three operations, and these three parameters that operation all claims with table name.The value that key-value pair in the table of the appointment to be checked such as synchronization module is answered, until carry out next step returned to a result from database after again; Asynchronous module can be without waiting for service data, and the function passes that only need to will operate is just passable to database interface.Spider module is divided into the data in the whole database of traversal and travels through the data in an independent table, mainly according to the name of table, distinguishes.Meanwhile, in order not make the concept of table too strengthen, still can be with the conceptual operation database of NoSQL, only just passable otherwise add the name of table.
With reference to Fig. 2, wherein show the method flow diagram of realizing NoSQL database multi-list characteristic according to the embodiment of the present invention, be described as follows.
When user starts to operate NoSQL database,
S1: initialization data storehouse table;
S2: the interface providing by system carries out synchronous operation, asynchronous operation and traversing operation
S3: judge whether to exit, if directly exit; If not, go to step S2.
Take respectively below and increase database data and change the embodiment that database data is example further description this programme.
When needs divide a plurality of table save data, carry out according to the following steps:
S11: for each table creates a table name;
S21: add that before the key of different pieces of information table name is stored in database.
Above-mentioned database manipulation mode is equally applicable to delete and search operation.
When needs are more during new data, carry out according to the following steps:
S22: by adding that before the data key of needs changes table name searches the data that need change;
S23: revise the data that find;
S24: the mode by amended data with above-mentioned save data is written in database, thus with new data, cover original data.
The present invention is by encapsulating optimization by the interface of database on the basis at NoSQL database, offer database interface that comprises table of user, add on the original basis multilist characteristic, thereby avoided the problem of the use of internal memory, saved memory headroom, save the operation of synchronizeing between internal memory operation and internal memory and database, reduced the complexity of data manipulation.Increase the concept of information classification in database simultaneously, expanded the range of application of database.
Although the present invention discloses as above in the mode of most preferred embodiment, yet not with it, limit the present invention, those skilled in the art without departing from the spirit and scope of the present invention, change arbitrarily and change can do.The scope that protection scope of the present invention is only limited by appended claims is as the criterion.
Claims (10)
1. an implementation method for NoSQL database multi-list characteristic, is characterized in that, comprises the following steps:
S1: initialization data storehouse table;
S2: the interface providing by system carries out synchronous operation, asynchronous operation and traversing operation
S3: judge whether to exit, if directly exit; If not, go to step S2.
2. the method for claim 1, is characterized in that: above-mentioned synchronous operation and asynchronous operation all comprise reading and writing, deletion action, and carries the parameter that table name claims.
3. the method as described in as arbitrary in claim 1 to 2, is characterized in that: described traversing operation comprises two kinds of traversal modes: travel through data in whole database and the data in the independent table of traversal.
4. method as claimed in claim 3, is characterized in that: the name of the table carrying according to traversing operation is distinguished described traversal mode.
5. the method for claim 1, is characterized in that: the operation of database is not added to the name of table, now with the mode of operation operating database of NoSQL database.
6. the system that realizes of NoSQL database multi-list characteristic, is characterized in that, comprises following ingredient:
Initialization module: show for initialization data storehouse;
Interface module: comprise synchronization module, asynchronous module and spider module, wherein synchronization module is used for providing synchronous operation, and asynchronous module is used for providing asynchronous operation, and spider module is used for providing traversing operation;
Judge module: exit for judging whether, if directly exit; If not, converting interface module is carried out corresponding operating.
7. system as claimed in claim 6, is characterized in that: above-mentioned synchronization module and asynchronous module all comprise reading and writing, deletion action, and carries the parameter that table name claims.
8. the system as described in as arbitrary in claim 6 to 7, is characterized in that: described spider module comprises two kinds of traversal modes: travel through data in whole database and the data in the independent table of traversal.
9. system as claimed in claim 8, is characterized in that: the name of the table carrying when operating according to spider module is distinguished described traversal mode.
10. system as claimed in claim 6, is characterized in that: the operation of database is not added to the name of table, now with the mode of operation operating database of NoSQL database.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410001133.0A CN103744952A (en) | 2014-01-02 | 2014-01-02 | Method and system for implementing multi-table property of NoSQL database |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410001133.0A CN103744952A (en) | 2014-01-02 | 2014-01-02 | Method and system for implementing multi-table property of NoSQL database |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103744952A true CN103744952A (en) | 2014-04-23 |
Family
ID=50501970
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410001133.0A Pending CN103744952A (en) | 2014-01-02 | 2014-01-02 | Method and system for implementing multi-table property of NoSQL database |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103744952A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104267932A (en) * | 2014-08-12 | 2015-01-07 | 广州华多网络科技有限公司 | Method, device and server for operating databases |
| CN105069059A (en) * | 2015-07-28 | 2015-11-18 | 小米科技有限责任公司 | Database synchronization method and apparatus |
| CN107622128A (en) * | 2017-09-29 | 2018-01-23 | 北京酷我科技有限公司 | A kind of database deletes data-optimized algorithm |
| CN110909029A (en) * | 2019-11-08 | 2020-03-24 | 苏宁云计算有限公司 | Method and medium for realizing cache based on Nosql |
| TWI710919B (en) * | 2019-02-02 | 2020-11-21 | 開曼群島商創新先進技術有限公司 | Data storage device, translation device and data inventory acquisition method |
| CN112785247A (en) * | 2020-12-30 | 2021-05-11 | 南京博尔英科技有限公司 | Digital intelligent recruitment management system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7467390B2 (en) * | 2003-04-01 | 2008-12-16 | International Business Machines Corporation | Enhanced staged event-driven architecture |
| CN101398857A (en) * | 2008-11-12 | 2009-04-01 | 北京星网锐捷网络技术有限公司 | Data synchronization method in embedded distribution system and embedded distribution system |
| CN102129469A (en) * | 2011-03-23 | 2011-07-20 | 华中科技大学 | Virtual experiment-oriented unstructured data accessing method |
| CN102332030A (en) * | 2011-10-17 | 2012-01-25 | 中国科学院计算技术研究所 | Data storing, managing and inquiring method and system for distributed key-value storage system |
| CN102495853A (en) * | 2011-11-17 | 2012-06-13 | 成都康赛电子科大信息技术有限责任公司 | Aspect-oriented cloud storage engine construction method |
| CN102880475A (en) * | 2012-10-23 | 2013-01-16 | 上海普元信息技术股份有限公司 | Real-time event handling system and method based on cloud computing in computer software system |
-
2014
- 2014-01-02 CN CN201410001133.0A patent/CN103744952A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7467390B2 (en) * | 2003-04-01 | 2008-12-16 | International Business Machines Corporation | Enhanced staged event-driven architecture |
| CN101398857A (en) * | 2008-11-12 | 2009-04-01 | 北京星网锐捷网络技术有限公司 | Data synchronization method in embedded distribution system and embedded distribution system |
| CN102129469A (en) * | 2011-03-23 | 2011-07-20 | 华中科技大学 | Virtual experiment-oriented unstructured data accessing method |
| CN102332030A (en) * | 2011-10-17 | 2012-01-25 | 中国科学院计算技术研究所 | Data storing, managing and inquiring method and system for distributed key-value storage system |
| CN102495853A (en) * | 2011-11-17 | 2012-06-13 | 成都康赛电子科大信息技术有限责任公司 | Aspect-oriented cloud storage engine construction method |
| CN102880475A (en) * | 2012-10-23 | 2013-01-16 | 上海普元信息技术股份有限公司 | Real-time event handling system and method based on cloud computing in computer software system |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104267932A (en) * | 2014-08-12 | 2015-01-07 | 广州华多网络科技有限公司 | Method, device and server for operating databases |
| CN104267932B (en) * | 2014-08-12 | 2017-11-07 | 广州华多网络科技有限公司 | database operation method, device and server |
| CN105069059A (en) * | 2015-07-28 | 2015-11-18 | 小米科技有限责任公司 | Database synchronization method and apparatus |
| CN107622128A (en) * | 2017-09-29 | 2018-01-23 | 北京酷我科技有限公司 | A kind of database deletes data-optimized algorithm |
| TWI710919B (en) * | 2019-02-02 | 2020-11-21 | 開曼群島商創新先進技術有限公司 | Data storage device, translation device and data inventory acquisition method |
| US10853363B2 (en) | 2019-02-02 | 2020-12-01 | Alibaba Group Holding Limited | Data storage apparatus, translation apparatus, and database access method |
| US11226961B2 (en) | 2019-02-02 | 2022-01-18 | Beijing Oceanbase Technology Co., Ltd. | Data storage apparatus, translation apparatus, and database access method |
| US11797533B2 (en) | 2019-02-02 | 2023-10-24 | Beijing Oceanbase Technology Co., Ltd. | Data storage apparatus, translation apparatus, and database access method |
| CN110909029A (en) * | 2019-11-08 | 2020-03-24 | 苏宁云计算有限公司 | Method and medium for realizing cache based on Nosql |
| CN112785247A (en) * | 2020-12-30 | 2021-05-11 | 南京博尔英科技有限公司 | Digital intelligent recruitment management system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105701098B (en) | The method and apparatus for generating index for the table in database | |
| CN103744952A (en) | Method and system for implementing multi-table property of NoSQL database | |
| CN100468402C (en) | Sort data storage and split catalog inquiry method based on catalog tree | |
| US9460188B2 (en) | Data warehouse compatibility | |
| US9256665B2 (en) | Creation of inverted index system, and data processing method and apparatus | |
| US8924373B2 (en) | Query plans with parameter markers in place of object identifiers | |
| CN107391502B (en) | Time interval data query method and device and index construction method and device | |
| CN109241159B (en) | Partition query method and system for data cube and terminal equipment | |
| CN112036736A (en) | Workflow creating method and device | |
| CN105117417A (en) | Read-optimized memory database Trie tree index method | |
| US8812489B2 (en) | Swapping expected and candidate affinities in a query plan cache | |
| CN107870728A (en) | Method and apparatus for mobile data | |
| CN107301214A (en) | Data migration method, device and terminal device in HIVE | |
| CN106970929B (en) | Data import method and device | |
| CN104360865A (en) | Serialization method, deserialization method and related equipment | |
| CN106777027B (en) | Large-scale parallel processing row-column mixed data storage device and storage and query method | |
| CN103729429A (en) | Hbase based compression method | |
| CN103914483A (en) | File storage method and device and file reading method and device | |
| CN102622434A (en) | Data storage method, data searching method and device | |
| CN104216961A (en) | Method and device for data processing | |
| CN106095698A (en) | OO caching write, read method and device | |
| CN103440246A (en) | Intermediate result data sequencing method and system for MapReduce | |
| CN104217011A (en) | Method and device for inquiring HBase secondary index table | |
| CN101826109A (en) | Large-capacity file splitting method, device and system | |
| CN107451204B (en) | Data query method, device and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C53 | Correction of patent of invention or patent application | ||
| CB03 | Change of inventor or designer information |
Inventor after: Cui Jingjing Inventor after: Lin Jiajie Inventor after: Zhang Peng Inventor before: Cui Jingjing Inventor before: Lin Jiajie Inventor before: Liu Lina Inventor before: Zhang Peng |
|
| COR | Change of bibliographic data |
Free format text: CORRECT: INVENTOR; FROM: CUI JINGJING LIN JIAJIE LIU LINA ZHANG PENG TO: CUI JINGJING LIN JIAJIE ZHANG PENG |
|
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20140423 |
|
| RJ01 | Rejection of invention patent application after publication |