WO2015131731A1

WO2015131731A1 - Notes managing method and device

Info

Publication number: WO2015131731A1
Application number: PCT/CN2015/071984
Authority: WO
Inventors: 章苹
Original assignee: 中兴通讯股份有限公司
Priority date: 2014-10-17
Filing date: 2015-01-30
Publication date: 2015-09-11
Also published as: CN105573735B; CN105573735A

Abstract

A notes managing method and device, for solving the problem of the inconvenient way of existing note taking; the method comprising: acquiring a content picture and at least one notes picture; establishing a first level of association between the content picture and the notes picture, and establishing a second level of association between reference symbols in the content picture and the notes picture. The method is suitable for a mobile terminal, and can manage a large number of high quality notes with pictures.

Description

Note management method and device

Technical field

The present invention relates to the field of mobile communications, and in particular, to a note management method and apparatus on a mobile terminal.

Background technique

With the development of mobile communication networks and mobile terminal technologies, people are increasingly demanding mobile phones. In the past, people only used mobile phones to make calls and send short messages. Nowadays, with the continuous development of mobile phone camera technology, people can go anywhere, anytime. Record daily life with your mobile phone.

At this stage, just using a mobile phone camera for taking photos and taking pictures does not realize more functions.

Summary of the invention

When encountering a new technology in the process of reading, you need to take notes. The usual way is to mark the corresponding position on the book, but you may encounter the following problems:

1. The book space is limited and it is not convenient to record;

2, forget to carry the book, the record will not be able to find, reduce work efficiency;

3. It is not convenient to find and use in work and study.

The embodiment of the invention provides a note management method and device to solve the problem that the related note mode is poor in convenience.

To solve the above problem, an embodiment of the present invention provides a note management method, including:

Collecting a content image and at least one note image;

A first layer association is established between the content picture and the at least one note picture.

Optionally, after the step of establishing an association between the content picture and the at least one note picture, the method further includes:

Determining one or more annotation symbols from the content image;

Position of the one or more annotation symbols in the note picture and the content picture Establish a second layer of association.

Optionally, the method further includes:

Receiving a note extraction instruction for extracting a note picture, wherein the note extraction instruction carries an identifier of the content picture;

Extracting at least one note picture associated with the first layer of the content picture.

Optionally, the note extraction instruction further carries information of a location of the symbol in the content image, and after extracting the at least one note image associated with the first layer of the content image, the method further includes:

And extracting, from the note picture associated with the first layer of the content picture, a note picture associated with the second layer at the location of the annotation symbol according to the location of the annotation symbol.

Optionally, the identifier of the content picture is a number, and establishing a first layer association between the content picture and the at least one note picture includes:

A corresponding number is assigned to the content picture and the at least one note picture.

The embodiment of the invention further provides a note management device, comprising:

The acquisition module is configured to collect a content picture and at least one note picture;

The first layer association establishing module is configured to establish a first layer association between the content picture and the at least one note picture.

Optionally, the device further includes:

An annotation extraction module configured to determine one or more annotation symbols from the content image;

A second layer association establishing module is configured to establish a second layer association between the note picture and the location of the one or more tag symbols in the content picture.

Optionally, the device further includes:

An instruction receiving module, configured to receive a note extraction instruction for extracting a note picture, where the note extraction instruction carries an identifier of the content picture;

The note extraction module is configured to extract at least one note picture associated with the first layer of the content picture.

Optionally, the note extraction instruction further carries information about a location of one or more annotation symbols in the content picture,

The note extraction module is further configured to extract, from the note picture associated with the first layer of the content picture, according to the location of the one or more annotation symbols, the one or more annotation symbols There is a note picture associated with the second layer in the location.

Optionally, the identifier of the content picture is a number.

The first layer association establishing module is configured to be a number corresponding to the content picture and the at least one note picture allocation.

The embodiment of the invention further provides a computer program and a storage medium thereof, the computer program comprising program instructions, when the program instruction is executed by the mobile terminal device, the device can implement the method for managing the note, the storage medium storage device Computer program.

The embodiment of the invention provides a note management method and device, which firstly collects a content picture and at least one note picture, and then establishes a first layer association between the content picture and the note picture. A large number of high-quality picture notes have been implemented, which solves the problem of poor convenience of related notes.

BRIEF abstract

1 is a schematic diagram of an acquisition process of an annotated symbol in Embodiment 1 of the present invention;

Figure 2 is a schematic diagram of the symbolic form;

Figure 3 is a schematic diagram of the linking process;

4 is a flowchart of a note management method according to Embodiment 2 of the present invention;

FIG. 5 is a schematic structural diagram of a note management apparatus according to Embodiment 3 of the present invention.

Preferred embodiment of the invention

Embodiments of the present invention will be described in detail below with reference to the accompanying drawings. It should be noted that, in the case of no conflict, the features in the embodiments and the embodiments in the present application may be arbitrarily combined with each other.

First, the first embodiment of the present invention will be described with reference to the accompanying drawings.

Embodiment 1 of the present invention provides a note management method for overcoming a classic reading note record. The inconvenience caused by the method and the search makes full use of the image acquisition module provided by the mobile terminal, and the note management based on the camera, the user only needs to use the mobile phone to take a photo of the module to be taken, and then take a note to himself. Take a second photo and link the two photos by labeling. Just click the link in the picture to find the next time you need to find the relevant notes. The two linked photos can be saved to any convenient location.

The embodiments of the present invention specifically relate to the following devices and modules:

1. Mobile terminal that can be clearly photographed:

The mobile terminal can clearly take photos of books and other text materials that need to be taken, such as smartphones, digital cameras, and the like that can be photographed.

2. Graphic recognition module:

In the embodiment of the present invention, the graphic recognition algorithm relates to comparison of key points in the image and comparison of visual symbols, and the image recognition technology mainly includes the following processes.

1) Image acquisition: mainly to extract image data, including content pictures and note pictures.

2) Image enhancement: The image is degraded during imaging, acquisition and transmission, resulting in image distortion after digitization, and the image needs to be enhanced to reduce noise in the image, enhance image brightness, etc., for later image processing. Lay the foundation.

3) Image restoration: When the image is acquired, the image is blurred due to the influence of ambient noise or light. In order to make the image more clear, the image is restored. In general, the method of filtering and denoising is mainly used to restore the original as much as possible. Figure.

4) Image coding and compression: Due to the large amount of digital image data, it is inconvenient for transmission and processing. At this time, it is necessary to encode and compress the image.

5) Image segmentation technology: The image is segmented into sub-regions that do not overlap each other and have their own features. Each region is a contiguous set of pixels, and the characteristics here may be the color, shape, grayscale and texture of the image. Image segmentation represents an image as a collection of physically meaningful connected regions based on a priori knowledge of the target and background. That is, mark and locate the target and background in the image, and then separate the target from the background.

In the above process, the last step uses image segmentation technology to separate the target from the background of the image, that is, the key points in the image and the visual coincidence can be identified to achieve the purpose of extracting features.

In the embodiment of the present invention, the image recognition technology is fully utilized to identify the special symbol in the photo, and the label may be a special symbol as shown in FIG. 2, such as “

△, ○", etc., wherein the annotation symbol acquisition method can be labeled and then photographed, or can be photographed and labeled first. The acquisition process of the annotation symbol is as shown in FIG.

3, button and response management module

In order to make a one-to-one correspondence between the content picture and the note picture, the photo number needs to be given, and at the same time, the corresponding monitor button and response management need to be formed in the content picture and the note picture by the recognized tag symbol, and the specific implementation method as follows:

1) For the photo number taken by the terminal, the numbering method is: the content picture and the note picture are uniformly numbered, and can be arbitrarily set without any ambiguity, and can be completed after the photo is taken.

2) According to the annotation symbol recognized by the image processing technology, a monitor button is automatically set in the note picture and the content picture, and the button is used to cover the mark conformance. The main purpose is to press the button when looking for a note from the content picture. The content of the note can appear; when the button is pressed from the note picture, the corresponding content in the content picture can appear, and the shape of the monitor button can be the same as or different from the note symbol.

3) forming a corresponding monitor response action in the corresponding position marked in the content picture and the note picture, the main purpose is to form a response with the monitor button, that is, each time the button action is pressed, the response action is further processed, for example, Display the content of the corresponding mark symbol in the note picture to the content picture.

The specific process is shown in FIG. 2. The photo number in FIG. 2 may not be displayed, as long as a logical one-to-one correspondence is formed, which is shown here for the image, and is shown in the figure.

4, link management module

After setting up the monitor button and the corresponding response management event for the content picture and the note picture respectively, it is necessary to establish link management for the two photos, as follows:

1) Firstly, the content picture and the note picture are linked according to the number, and the implementation method can be established by establishing a hyperlink, and then the one-to-one correspondence between the content picture and the note picture is established, and then according to the one-to-one correspondence Create a link to the callout symbol.

2) Establish processing on the monitor button separately.

3) Establish response processing events separately.

4) Establish a link between the two through technical methods.

That is: each time the button is pressed, the corresponding note content is displayed. The link process diagram is shown in Figure 3.

For the link method is not limited to the link of two photos, you can also link multiple photos or a many-to-one picture;

The content of the notes after taking a photo with a mobile phone can be stored and stored on the mobile phone, and can be used on other terminal devices or the cloud;

The present invention is not limited to the labeling, as long as it meets the requirements for easy identification.

After clicking the monitor button, the position of the note display is not specified, and can be any position in the interface, and the size of the content box of the note can be arbitrarily adjusted.

Embodiment 2 of the present invention will be described below with reference to the accompanying drawings.

The embodiment of the present invention provides a note management method, which provides a solution for recording and managing notes through a mobile terminal, as shown in FIG. 4, which includes:

Step 401: Collect a content picture and at least one note picture;

In this step, the content picture and the note picture are collected by the picture collection module of the mobile terminal, and the picture may be collected by taking a picture as described in the first embodiment of the present invention; the picture may also be obtained through other means, such as receiving other device transmission. The picture is downloaded or downloaded from the network, which is not limited by the present invention.

Step 402: Establish a first layer association between the content picture and the note picture.

In this step, a first layer association is established between the content picture and the note picture, and the association relationship does not necessarily correspond to one-to-one correspondence, that is, the same content picture can correspond to multiple note pictures, and the same note picture can also correspond to multiple Content images.

In this way, the content picture and the note picture are linked, and the corresponding note picture can be determined according to the association when determining the content picture; similarly, when the note picture is determined, the corresponding content picture may also be determined according to the association relationship.

Establishing an association can be achieved by adding a corresponding number to the content picture and the note picture. For example, a content picture A can correspond to multiple note pictures A1, A2, A3, etc.; one note picture B can also correspond to different content pictures B1, B2, B3, and the like.

Step 403: Determine at least one label symbol from the content picture.

Optionally, the content corresponding to the note picture may be further refined. Specifically, the mark content in the picture may be extracted as a mark symbol by using the picture segmentation technology described in the first embodiment of the present invention, or may be manually added ( For example, select an area in the content image and use the area as the location of the label symbol).

Step 404: Establish a second layer association between the note picture and the location of one or more call symbols in the content picture.

In this step, through the second layer association, the correspondence between the note picture and the content picture is further refined, that is, while the note picture is corresponding to the content picture, the note picture can be further corresponding to the part of the content picture. The location makes the notes more targeted.

Step 405: Receive a note extraction instruction for extracting a note picture, and extract a note picture associated with the first layer of the content picture.

The identifier of the content picture is carried in the note extraction instruction.

After storing the note picture and the content picture, the note picture and the content picture can be extracted as needed at any time. Specifically, the content picture can be read first, and the content picture can be determined according to the relationship between the content picture and the note picture. , get the corresponding note picture.

Optionally, the note extraction instruction may further carry information of a location of the symbol in the content picture, and extract a note picture associated with the first layer of the content picture, and then according to the position of the marked symbol Extracting, from a note picture associated with the first layer of the content picture, a note picture associated with the second layer of the position of the call symbol.

Embodiment 3 of the present invention will be described below with reference to the accompanying drawings.

The embodiment of the invention provides a note management device. The structure of the device is as shown in FIG. 5, and includes:

The collecting module 501 is adapted to collect a content picture and at least one note picture;

The first layer association establishing module 502 is adapted to establish a first layer association between the content picture and the note picture.

Optionally, the device further includes:

An annotation extraction module 503, configured to determine at least one annotation symbol from the content image;

The second layer association establishing module 504 is adapted to establish a second layer association between the note picture and the location of one or more tag symbols in the content picture.

Optionally, the device further includes:

The instruction receiving module 505 is adapted to receive a note extraction instruction for extracting a note picture, where the note extraction instruction carries an identifier of the content picture;

The note extraction module 506 is adapted to extract a note picture associated with the first layer of the content picture.

Optionally, the note extraction instruction further carries information about a location of the symbol in the content picture.

The note extraction module 506 is further adapted to extract, according to the location of the annotation symbol, a note picture associated with the second layer of the position of the annotation symbol from a note picture associated with the first layer of the content picture. .

Optionally, the identifier of the content picture is a number.

The first layer association establishing module 502 is specifically adapted to allocate a corresponding number for the content picture and the note picture.

The above note management device can be integrated in the mobile terminal, and the corresponding function is completed by the mobile terminal, and the mobile terminal includes a processor, a program memory and a data memory.

The embodiment of the invention provides a note management method and device, which firstly collects a content picture and at least one note picture, and then establishes a first layer association between the content picture and the note picture. A large number of high-quality picture notes have been implemented, which solves the problem of poor convenience of existing notes. The technical solution provided by the embodiment of the present invention can effectively and quickly call the content that needs to be recorded to facilitate searching, thereby improving work and learning efficiency.

One of ordinary skill in the art will appreciate that all or a portion of the steps of the above-described embodiments can be implemented using a computer program flow, which can be stored in a computer readable storage medium, such as on a corresponding hardware platform (eg, The system, device, device, device, etc. are executed, and when executed, include one or a combination of the steps of the method embodiments.

Alternatively, all or part of the steps of the above embodiments may also be implemented by using an integrated circuit. These steps may be separately fabricated into individual integrated circuit modules, or multiple modules or steps may be fabricated into a single integrated circuit module. achieve. Thus, the invention is not limited to any specific combination of hardware and software.

The devices/function modules/functional units in the above embodiments may be implemented by a general-purpose computing device, which may be centralized on a single computing device or distributed over a network of multiple computing devices.

When each device/function module/functional unit in the above embodiment is implemented in the form of a software function module and sold or used as a stand-alone product, it can be stored in a computer readable storage medium. The above mentioned computer readable storage medium may be a read only memory, a magnetic disk or an optical disk or the like.

Variations or substitutions are readily conceivable within the scope of the present invention by those skilled in the art and are within the scope of the present invention. Therefore, the scope of the invention should be determined by the scope of the claims.

Industrial applicability

The note management method and apparatus provided by the embodiments of the present invention are applicable to a mobile terminal. By collecting a content picture and at least one note picture, establishing a first layer association between the content picture and the note picture, and establishing a second layer association between the annotation symbol in the content picture and the note picture, which can be managed A large number of high quality photo notes.

Claims

A note management method, including:

Collecting a content image and at least one note image;

A first layer association is established between the content picture and the at least one note picture.
The method of claim 1, after the step of establishing an association between the content picture and the at least one note picture, further comprising:

Determining one or more annotation symbols from the content image;

A second layer association is established between the note picture and the location of the one or more tag symbols in the content picture.
The method of claim 2 further comprising:

Receiving a note extraction instruction for extracting a note picture, wherein the note extraction instruction carries an identifier of the content picture;

Extracting at least one note picture associated with the first layer of the content picture.
The method according to claim 3, wherein the note extraction instruction further carries information of a location of the marked symbol in the content picture, and extracts at least one note picture associated with the first layer of the content picture. After the step, it also includes:

And extracting, from the note picture associated with the first layer of the content picture, a note picture associated with the second layer at the location of the annotation symbol according to the location of the annotation symbol.
The method according to claim 3, wherein the identifier of the content picture is a number, and establishing a first layer association between the content picture and the at least one note picture comprises:

A corresponding number is assigned to the content picture and the at least one note picture.
A note management device comprising:

The acquisition module is configured to collect a content picture and at least one note picture;

The first layer association establishing module is configured to establish a first layer association between the content picture and the at least one note picture.
The note management device according to claim 6, further comprising:

An annotation extraction module configured to determine one or more annotation symbols from the content image;

A second layer association establishing module is configured to establish a second layer association between the note picture and the location of the one or more tag symbols in the content picture.
The note management device according to claim 7, further comprising:

An instruction receiving module, configured to receive a note extraction instruction for extracting a note picture, where the note extraction instruction carries an identifier of the content picture;

The note extraction module is configured to extract at least one note picture associated with the first layer of the content picture.
The note management device according to claim 8, wherein the note extraction instruction further carries information of a position of one or more of the content symbols in the content picture,

The note extraction module is further configured to extract, from the note picture associated with the first layer of the content picture, according to the location of the one or more annotation symbols, the one or more annotation symbols There is a note picture associated with the second layer in the location.
The note management device according to claim 8, wherein the identifier of the content picture is a number.

The first layer association establishing module is configured to be a number corresponding to the content picture and the at least one note picture allocation.
A computer program comprising program instructions that, when executed by a mobile terminal device, cause the device to perform the method of any of claims 1-5.
A carrier carrying the computer program of claim 11.