EP0472313A2 - Image processing method and apparatus therefor - Google Patents

Image processing method and apparatus therefor Download PDF

Info

Publication number
EP0472313A2
EP0472313A2 EP91307105A EP91307105A EP0472313A2 EP 0472313 A2 EP0472313 A2 EP 0472313A2 EP 91307105 A EP91307105 A EP 91307105A EP 91307105 A EP91307105 A EP 91307105A EP 0472313 A2 EP0472313 A2 EP 0472313A2
Authority
EP
European Patent Office
Prior art keywords
horizontal
counting
image information
characters
vertical
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP91307105A
Other languages
German (de)
French (fr)
Other versions
EP0472313A3 (en
EP0472313B1 (en
Inventor
Tadanori C/O Canon Kabushiki Kaisha Nakatsuka
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP2205229A external-priority patent/JPH0490083A/en
Priority claimed from JP03190238A external-priority patent/JP3135290B2/en
Application filed by Canon Inc filed Critical Canon Inc
Publication of EP0472313A2 publication Critical patent/EP0472313A2/en
Publication of EP0472313A3 publication Critical patent/EP0472313A3/en
Application granted granted Critical
Publication of EP0472313B1 publication Critical patent/EP0472313B1/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10Character recognition
    • G06V30/14Image acquisition
    • G06V30/146Aligning or centring of the image pick-up or image-field
    • G06V30/1463Orientation detection or correction, e.g. rotation of multiples of 90 degrees
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10Character recognition

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Character Input (AREA)

Abstract

A character recognition method capable of determining the direction of row of characters, applicable to a language which can be written in horizontal or vertical direction, such as Japanese language, is disclosed. The method takes projection in both directions, by counting black pixels, and compares the obtained counts with a threshold value. The text is identified as horizontally or vertically written, respectively if the count exceed the threshold value more in the horizontal or vertical direction. Projection is taken again in the perpendicular direction, after the writing direction is determined, to extract each character, which is subjected to character recognition in known manner. Thus the method can achieve automatic recognition, without instruction of the direction of writing, by the operator.

Description

    BACKGROUND OF THE INVENTION Field of the Invention
  • The present invention relates to an image processing method for receiving text image information in which horizontal or vertical writing is not identified, and recognizing characters etc. in said text image information, and an apparatus therefor.
  • Related Background Art
  • Conventional character recognition apparatus is composed of an input unit for reading a text image, a pre-treatment unit for extracting a character from the input image and applying various normalizations to the extracted image, and a recognition unit for extracting geometrical features from the normalized pattern and comparing said features with standard patterns stored in advance in a dictionary, thereby recognizing the character portion of said text image. Since the Japanese text may be present in vertical writing, in addition to the ordinary horizontal writing, the pre-treatment unit for extracting the character pattern in the character recognition apparatus for Japanese characters has been designed, for a horizontally written text image, to extract a row of characters by taking a horizontal image projection, and to extract a character by taking a vertical image projection of thus extracted row or rows. Also for a vertically written text image, a row of characters is extracted by taking a vertical image projection, and a character is extracted by taking a horizontal image projection on thus extracted row or rows.
  • Also for designated a vertically or horizontally written area in text image information, there is already known an apparatus allowing, on a display of the image information entered by the user, to designate an area therein and whether said area is vertically or horizontally written.
  • For this reason, the character recognition apparatus for Japanese characters employs different process for the horizontal writing and for the vertical writing. It has therefore been necessary to prepare a character recognition apparatus exclusive for horizontal or vertical writing, or to designate the horizontal or vertical writing by the user prior to the character recognition.
  • In consideration of the drawbacks of the prior technology explained above, the object of the present invention is to provide a character recognition apparatus capable of character recognition, by detecting whether the text image is vertically or horizontally written, based on said text image.
  • Also in the above-explained prior technology, if vertically and horizontally written texts are mixedly present in the image information, as in the case of magazines, the use is required to execute a cumbersome operation of designating each vertically or horizontally written area and classifying each area as vertically or horizontally written.
  • SUMMARY OF THE INVENTION
  • The object of the present invention is to resolve the drawbacks in the above-explained prior technology, and to discriminate whether the text of input image information is vertically or horizontally written, by taking histograms in the vertical and horizontal directions on the entered text image information, and comparing thus prepared histograms with suitable reference values or investigating the relationships of said histograms in the vertical and horizontal directions.
  • Also in image information containing a vertically written text and a horizontally written text in mixed manner, the detection of areas and of mode of writing in each area can be achieved without the toil of operator, by partially analyzing the histograms in each of horizontal and vertical directions.
  • BRIEF DESCRIPTION OF THE DRAWINGS
    • Fig. 1 is a block diagram of an image processing apparatus embodying the present invention;
    • Fig. 2 is a view showing an example of projections of input text image information in said embodiment;
    • Fig. 3 is a first flow chart of the recognition process of said embodiment;
    • Fig. 4 is a first flow chart of a process for detecting the direction of row of characters;
    • Fig. 5 is a second flow chart of the process for detecting the direction of row of characters;
    • Fig. 6 is a third flow chart of the process for detecting the direction of row of characters;
    • Fig. 7 is a fourth flow chart of the process for detecting the direction of row of characters;
    • Fig. 8 is a fifth flow chart of the process for detecting the direction of row of characters;
    • Fig. 9 is a view showing a second example of projections of the input text image information;
    • Fig. 10 is a second flow chart of the character recognition process;
    • Fig. 11 is a sixth flow chart of the process for detecting the direction of row of characters;
    • Fig. 12 is a seventh flow chart of the process for detecting the direction of row of characters;
    • Fig. 13 is a first view for explaining an embodiment 3.1;
    • Fig. 14 is a second view for explaining the embodiment 3.1;
    • Fig. 15 is a third view for explaining the embodiment 3.1;
    • Fig. 16 is a fourth view for explaining the embodiment 3.1;
    • Fig. 17 is an eighth flow chart of the process for detecting the direction of row of characters;
    • Fig. 18 is a view showing a third example of projections of the input text image information;
    • Fig. 19 is a third flow chart of the character recognition process;
    • Fig. 20 is a ninth flow chart of the process for detecting the direction of row of characters;
    • Fig. 21 is a view showing area separation by comparison of histograms with reference values; and
    • Fig. 22 is a tenth flow chart of the process for detecting the direction of row of characters.
    DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • Now the present invention will be clarified in detail by preferred embodiments thereof shown in the attached drawings.
  • [Description of character recognition apparatus (Fig. 1)]
  • Fig. 1 is a schematic block diagram of a character recognition apparatus embodying the present invention, common to all the embodiments.
  • In Fig. 1 there are shown the entire character recognition apparatus 1 of the present embodiment; an input unit 2, composed for example of a scanner, for reading a text image and generating digital original image data; a central processing unit (CPU) 3 for controlling the entire apparatus; a ROM 4 storing a control program for the CPU 3 corresponding to flow charts to be explained later and other various data; and a memory (RAM) 5 used as a work area of the CPU 3 and also having an area for storing the text image data entered from the input unit 2.
  • There are further shown a character row determination unit 6 for determining the direction of row of characters in the text image stored in the memory 5, namely whether said text is vertically or horizontally written, and extracting respective areas if vertical and horizontal writings are mixedly present as shown in Fig. 18; a pre-processing unit 7 for extracting the pattern of a character from the text image stored in the memory 5 and effecting variousnormalizations; a recognition unit 8 for extracting geometrical features from the pattern pre-processed by the pre-processing unit 7 and comparing said features with standard patterns stored in advance in a dictionary 9 for recognition; a display unit 10 for displaying, for example, the result of recognition on the input text image; a system bus 11 including a data bus, an address bus, a control signal bus etc. from the CPU 3; and an interface unit 12 for interface control with an external output unit such as a printer 13.
  • [Description of text image (Fig. 2)]
  • Fig. 2 shows an example of text image entered into the character recognition apparatus of the present embodiment.
  • In Fig. 2 there are shown a text image 21 read by the input unit 2; a projection 22 of the text image 21 (count of black pixels) when it is scanned in the horizontal direction; a similar projection 23 of said text image 21 obtained by vertical scanning; and lines 24, 25 indicating a reference value α.
  • In the example shown in Fig. 2, the entered text image 21 is horizontally written, and it will be understood that the number of lines in which the count of black pixels exceeds the reference value α is larger in the horizontal direction than in the vertical direction.
  • [1.1 Embodiment of counting black pixels in each row, utilizing the reference value α]
  • Fig. 3 is a flow chart of the control sequence of the CPU 3 in the present embodiment, and a corresponding control program is stored in the ROM 4.
  • At first a step S0 reads a text image, set by the operator, by the input unit 2 (scanner), and stores it in the memory 5. In a next step S2, the character line determination unit 6 discriminates whether the text image stored in the memory 5 is horizontally or vertically written, by calculating the projections (counts of black pixels) of said text image in the horizontal and vertical directions, then determining the ratio of number of lines in which said pixel count exceeds the reference value α to the total number of lines, and comparing said ratio for the horizontal direction with that for the vertical direction.
  • Fig. 4 shows the details of said step S2 executed by the determination unit 6. At first a step S11 counts the number of black pixels for each horizontal line, and a step S12 determines the number of lines in which the obtained count is equal to or larger than the reference value α. This operation is conducted for all the horizontal lines (number TH) of the text image, and the number UH of lines in which the count is equal to or larger than the reference value a is determined. Then the ratio RH of the number UH of lines in which the pixel count is equal to or larger than the reference value α to the total line number TH is calculated by: RH = UH/TH.
    Figure imgb0001
  • Then a step S13 counts the number of black pixels in each vertical line, and a step S14 discriminates whether the count is at least equal to the reference value α. This operation is conducted for all the vertical lines (numbber TV), and the number UV of lines in which the count is equal to or larger than the reference value α is determined. Then the ratio RV of said line number UV to the total line number TV is calculated by: RV = UV/TV.
    Figure imgb0002
  • Then a step S15 compares the obtained ratio RH for the horizontal direction with that RV for the vertical direction. If a condition RH ≧ RV is satisfied, the text image is identified as horizontally written.
  • Referring again to Fig. 3, and if the text image is horizontally written, the sequence proceeds to a step S3 to effect pre-processing for horizontal writing in the pre-processing unit 7. Said preprocessing for horizontal writing consists of character extraction by extracting a row of characters by taking a projection in the horizontal direction and extracting a character by taking a projection in the vertical direction on the extracted row(s) of characters, normalization of position, inclination, line width and density of the character, and noise elimination.
  • On the other hand, if the condition RH ≧ RV is not satisfied in the step S2, the text image stored in the memory 5 is identified as vertically written, and a step S4 executes pre-processing for vertical writing in the pre-processing unit 7. Said pre-processing consists of character extraction by extracting a row of characters by taking a projection in the vertical direction and extracting a character by taking a projection in the horizontal direction on the extracted row(s) of characters, normalization of position, inclination, line width and density of the character, and noise elimination.
  • Then, in step S5, the recognition unit 8 effects extraction of features such as contour line on each unknown character pattern pre-processed in the pre-processing unit 7. The dictionary 9 stores the features of standard patterns of all the characters to be identified. The feature of the unknown character pattern is matched with all the features of the standard patterns stored in the dictionary 9, and a character pattern of the highest probability is stored as the result of recognition in the memory 5. All the characters of the input text image are similarly recognized and stored in the memory 5. A next step S6 displays the results of recognition, stored in the memory 5, on the display unit 10. An output process of characters by the printer 13 is omitted for the purpose of simplicity.
  • As explained in the foregoing, this embodiment provides a character recognition apparatus which can adapt texts of horizontal and vertical writings and is therefore easily usable for the users.
  • [1.2 Variation of 1.1: embodiment with counting from vertical direction]
  • Fig. 5 shows the details of the step S2, in Fig. 3, for discriminating whether the text image is horizontally or vertically written. In this embodiment, the order of sequence of the steps S11, S12 and the steps S13, S14 is inverted in comparison with the foregoing embodiment 1.1. More specifically, the embodiment 1.1 counts the black pixels at first in the horizontal direction and then in the vertical direction, whereas the present embodiment effects said counting at first in the vertical direction and then in the horizontal direction. The structure of the apparatus in the present embodiment is same as shown in Fig. 1.
  • The present embodiment can provide same effects and advantages as in the foregoing embodiment 1.1.
  • [1.3 Variation of 1.1: Embodiment for counting white pixels]
  • Fig. 6 is a flow chart of the present embodiment in which the counting of black pixels in the step S2 in the embodiment 1.1 is replaced by counting of white pixels. In this embodiment, the structure of the character recognition apparatus and the control sequence other than said step S2 are identical to those of the embodiment 1.1, shown in Figs. 1 and 3.
  • At first a step S31 counts the white pixels in each horizontal line, and a step S32 discriminates whether the obtained count is at least equal to the reference value α, then determines the number of lines in which the obtained count is at least equal to the reference value α over the entire input image, and calculates the ratio RH of the number of such lines to the entire number of lines.
  • Then a step S33 counts the white pixels in each vertical line, and a step S34 discriminates whether the obtained count is at least equal to the reference value α, then determines the number of lines in which the obtained count is at least equal to the reference value α over the entire input image, and calculates the ratio RV of the number of such lines to the entire number of lines.
  • A next step S35 compares RH and RV, and the text image is identified as horizontally written or vertically written, respectively if a condition RH ≦ RV is satisfied or not.
  • Also the present embodiment explained above can provide similar effects and advantages as those in the foregoing embodiment.
  • [1.4 Variation of 1.1: Embodiment for counting plural lines]
  • Fig. 7 is a flow chart of the present embodiment, in which the counting of black pixels in the step 2 of the embodiment 1.1 is replaced by counting of black pixels in plural lines. Also in this embodiment, the structure of the character recognition apparatus and the control sequence except for said step S2 are identical to those of the embodiment 1.1, shown in Figs. 1 and 3.
  • At first a step S41 counts the black pixels in every plural lines, and a step S42 discriminates whether the obtained count is at least equal to a reference value α, then determines, in the entire input image, the number of lines in which the obtained count is at least equal to said reference value α, and calculates the ratio RH of the number of such line to the entire number of lines.
  • A step S43 similarly effects counting of black pixels in the vertical direction and a step S44 determines the ratio RV of the number of lines in which the count is at least equal to the reference value α to the entire number of lines.
  • A next step S45 compares thus determined RH and RV, and the text image is identified as horizontally written or vertically written, respectively if a condition RH ≧ RV is satisfied or not.
  • The present embodiment explained above can also provide similar effects and advantages as those in the foregoing embodiments.
  • [1.5 Variation of 1.3: Embodiment with counting from vertical direction]
  • The above-explained embodiment 1.3 can provide similar effects and advantages as those in the embodiment 1.1 even when the sequence of horizontal counting and vertical counting is interchanged as in the embodiment 1.2. The configuration of the character recognition apparatus and the control sequence remain same as those of the embodiment 1.1, shown in Figs. 1 and 3, and the only difference lies in the step S2 shown in Fig. 6, in which the steps are executed in the order of S33, S34, S31 and S32.
  • [1.6 Variation of 1.3: Embodiment for counting plural lines]
  • The above-explained embodiment 1.3 can provide similar effects and advantages as those in the embodiment 1.1, even when the counting for each line is replaced by counting of plural lines as the foregoing embodiment 1.4. In this embodiment, the configuration of the character recognition apparatus and the control sequence remain same as those of the embodiment 1.1 shown in Figs. 1 and 3, and the only difference lies in the step S2 in Fig. 6, in which the steps S31 and S33 execute counting on plural lines at a time instead of a line.
  • [1.7 Variation of 1.4: Embodiment with counting from vertical direction]
  • The above-explained embodiment 1.4 can also provide similar effects and advantages to those of the embodiment 1.1, even when the sequence of horizontal counting and vertical counting is interchanged as in the embodiment 1.2. In this embodiment, the configuration of the character recognition apparatus and the control sequence remain same as those of the embodiment 1.1 shown in Figs. 1 and 3, and the only difference lies in the step S2 shown in Fig. 7, in which the steps are executed in the order of S43, S44, S41 and S42.
  • [1.8 Variation of 1.1: Embodiment of taking lines in which the count is equal to or less than the reference value α]
  • In the step S2 of the embodiment 1.1, shown in Fig. 4, the condition "the count of black pixels equal to or larger than the reference value α" may be replaced by "the count of black pixels equal to or less than the reference value α". In this embodiment, the configuration of the character recognition apparatus and the control sequence except for the step S2 are same as those of the embodiment 1.1 shown in Figs. 1 and 3.
  • Fig. 8 shows the details of the step S2 of the control sequence in the present embodiment.
  • At first a step S51 counts the black pixeLs in each horizontal line, and discriminates whether the obtained count is not in excess of a reference value α. Then a step S52 counts, in the entire input image, the number of lines in which the count is not in excess of the reference value α, and calculates the ratio RH of the number of such lines to the entire number of horizontal lines.
  • Then a step S53 counts the black pixels in each vertical lines, and step S54 discriminates whether the obtained count is not in excess of the reference value α, counts the number of lines in which the count is not in excess of the reference value α, and calculates the ratio RV of such lines. A next step S55 compares RH with RV, and identifies the text image as horizontally or vertically written, respectively if a condition RH ≦ RV is satisfied or not.
  • The above-explained embodiment 1.8 can provide similar effects and advantages to those in the aforementioned embodiment 1.1.
  • As explained in the foregoing, these embodiments are capable of automatically identifying the direction of row of characters in a text, thereby determining whether the text image is written horizontally or vertically. Consequently, in the character recognition by reading a text image, the operator is no longer required to enter whether the text is horizontally or vertically written, and the operation of character recognition is therefore improved.
  • [2.1 Embodiment of using different reference values for the horizontal and vertical directions]
  • In this embodiment, reference values α, β are employed respectively in the horizontal and vertical directions as shown in Fig. 9, instead of the single reference value a in the embodiment 1.1 shown in Fig. 2.
  • Said reference values α, β are determined after the input of the image information as shown in a flow chart in Fig. 10. In the following, the step S1 alone will be explained since said flow chart differs only in said step S1 from that shown in Fig. 3.
  • The reference values α, β are determined in the step S1 in the following manner.
  • The reference values α, β respectively in the horizontal direction and in the vertical direction are given by: α = B·TV S H + t H ,
    Figure imgb0003
    β = B·TH S V + t V
    Figure imgb0004
    where B is an initial reference value, TH and TV are total line numbers respectively in the horizontal and vertical directions in a designated area of the text image, and SH, SV, tH, tV are correction factor a α, β (SH ≠ 0, SV ≠ 0).
  • The use of the height and width of the designated area of the text image enables exact identification of vertical or horizontal wiring, without being influenced by the vertical-to-horizontal ratio of the designated area.
  • Fig. 9 shows an example of identifying the horizontal or vertical writing in the entire area of the text image.
  • The reference values α, β determined in said step S1 may be employed similarly in the embodiments 1.1 to 1.8 shown in Figs. 4 to 8.
  • [2.2 Embodiment employing maximum black pixel count]
  • Fig. 11 shows the details of the step S2 shown in Fig. 3, for identifying whether the text image is horizontally or vertically written. A step S61 determines the maximum values MH, MV of black pixels respectively in the horizontal and vertical directions, and corrects said maximum values with the horizontal line number TH, vertical line number VH and correction coefficients as indicated in Fig. 11. A next step S63 compares thus corrected maximum values of the black pixels in the horizontal and vertical directions, and the text image is identified as horizontally or vertically written respectively if the maximum value in the horizontal direction is larger or smaller than that in the vertical direction.
  • The configuration of the image processing, apparatus in the present embodiment is same as that shown in Fig. 1.
  • [3.1 Embodiment of assuming both horizontal and vertical writings and determining the direction from the similarity of the results of recognition]
  • Fig. 12 shows the details of the step S2, shown in Fig. 3, for discriminating whether the text image is horizontally or vertically written.
  • A step S71 extracts a rectangular area according to a histogram in the horizontal direction (Fig. 13), then prepares a histogram in the vertical direction in said extracted area, and extracts one or plural rectangular areas (Fig. 14). Fig. 14 shows only the rectangular areas extracted from the first row. Then a step S72 extracts a rectangular area according to a histogram in the vertical direction (Fig. 15), prepares a histogram in the horizontal direction in said extracted area, and extracts one or plural rectangular areas (Fig. 16). A next step S73 recognizes the rectangles extracted in the steps S71, S72, and a step S74 determines whether the text image is horizontally or vertically written, according to the level or similarity of said extracted rectangles.
  • [3.2 Embodiment of assuming both horizontal and vertical writings and determining the writing direction from the vertical-to-horizontal ratio of extracted rectangle]
  • Fig. 17 shows the details of the step S2, shown in Fig. 3, for determining whether the text image is horizontally or vertically written.
  • A step S81 extracts a rectangle according to the histogram in the horizontal direction (Fig. 13), then prepares a histogram in the vertical direction, in said rectangle, and extracts one or plural rectangles (Fig. 14). Fig. 14 only shows the rectangles extracted from the first row. Then a step S82 extracts a rectangle according to the histogram in the vertical direction (Fig. 15), then prepares a histogram in the horizontal direction, and extracts one or plural rectangles (Fig. 16). A next step S83 calculates the vertical-to-horizontal (V-H) ratio of the rectangles extracted in the steps S81 and S82.
  • In the example illustrated in Figs. 14 and 16, the V-H ratio is apparently closer to 1:1 in the rectangle extracted in the step S81.
  • A next step S84 identifies the text image as horizontally or vertically written respectively if the V-H ratio closer to 1:1 is obtained in the step S81 or not.
  • [4.1 Embodiment for a text including both horizontally and vertically written areas]
  • Fig. 18 shows an example of the input text image, to the character recognition apparatus, including vertically and horizontally written areas in mixed manner.
  • In Fig. 18 there are shown a text image 31 read by the input unit 2; a projection 32 of said text image (counts of black pixels) obtained by scanning said text image in the horizontal direction; a projection 33 of said text image obtained by scanning in the vertical direction; lines 34, 35 respectively corresponding to reference values α, β; horizontally written areas 36, 42 identified by the character row/area determination unit; a vertically written area 37; characters 38 - 40 in said areas; and an area 41 identified as free of characters.
  • In the example shown in Fig. 18, the input text image 31 contains both the horizontally and vertically written texts.
  • Fig. 19 is a flow chart of the control sequence executed by the CPU 3 in the present embodiment, and a corresponding control program is stored in the ROM 4.
  • At first a step S100 enters a text image, set by the operator, through the input unit (scanner) 2 and stores said image in the memory 5. In a next step 101, the character determination unit 6 extracts horizontally written areas and vertically written areas from the text image stored in the memory 5, by determining projections (counts of black pixels) in the horizontal and vertical directions on the text image stored in the memory 5 and comparing the numbers of lines in which said count is at least equal to the reference value α or β.
  • Fig. 20 shows the details of said step S101 executed by the character row determination unit 6. At first a step S111 counts the black pixels in each line, and determines an area or areas in which the obtained count is at least equal to the reference value α. In the example shown in Fig. 18, such an area is indicated by 36.
  • A next step S112 similarly determines an area or areas in the vertical direction. In Fig. 18, such areas are indicated by 36, 37.
  • A step S113 then determines the horizontally written areas and vertically written areas in the text image.
  • The steps S111 and S112 classify the text image into areas of following four categories shown in Fig. 21:
  • Area A:
    where the count is at least equal to the reference value both in the horizontal and vertical directions;
  • In such area A, histograms are prepared again in said area, and the area is identified as horizontally or vertically written respectively if the maximum value of the histogram minus the reference value is larger in the horizontal direction or in the vertical direction.
  • Area B:
    where the count is at least equal to the reference value only in the horizontal direction;
  • Such area is identified as horizontally written. Thus the area 36 in Fig. 18 is identified as horizontally written. Since the areas 36 and 42 are mutually adjacent and have the same writing direction, the two areas are combined as an area.
  • Area C: where the count is at lease equal to the reference value only in the vertical direction;
  • Such area is identified as vertically written. Thus the area 37 in Fig. 18 is identified as vertically written.
  • Area D:
    where the count is less than the reference value both in the horizontal and vertical directions;
  • Histograms are again prepared in such area in the horizontal and vertical directions, and the area is identified as horizontally or vertically written respectively if the maximum value of the histogram minus the reference value is larger in the horizontal or vertical direction. A zero histogram indicates absence of characters in the area, as in case of the area 41 in Fig. 18.
  • The above-mentioned reference value are corrected by the width and height of the text image.
  • After the identification of horizontally and vertically written areas, a step S114 determines the order of sequence of recognition of such areas, for example from above to bottom according to the magnitude of coordinate value.
  • Again referring to the flow chart shown in Fig. 19, in case of a horizontally written area, the sequence proceeds to a step S103 in which the pre-processing unit 7 effects pre-processing for horizontal writing, including character extraction by taking horizontal projection to extract a character row and then taking vertical projection on the extracted row or rows; normalizations on the position, inclination and density of character; and noise elimination.
  • On the other hand, if the step S102 identifies a vertically written area, the sequence proceeds to a step S104 in which the pre-processing unit 7 executes pre-processing for vertical writing, including character extraction by taking vertical projection to extract a character row and then taking horizontal projection on thus extracted row or rows; normalizations on the position, inclination and density of character; and noise elimination.
  • In a next step S105, the recognition unit 8 extracts features, such as contours, from the unknown character pattern pre-processed in the pre-processing unit 7. The dictionary 9 store features of the standard patterns of all the characters to be recognized. The feature of said unknown character pattern is matched with the features of the standard patterns stored in the dictionary 9, and the most probable character is stored as the result of recognition in the memory 5, and all the characters in the input text image are similarly recognized and stored in the memory 5.
  • Then the sequence proceeds to a step S106, and returns to the step S102 if any unrecognized area still exists, or proceeds to a step S107 if all the areas have been recognized. The step S107 displays the results of recognition, stored in the memory 5, on the display unit 10. The process of output of characters by the printer 13 will be omitted from the description.
  • As explained in the foregoing, the present embodiment provides a character recognition apparatus adaptable to any text that is horizontally or vertically written or contains both writings.
  • [4.2 Embodiment of requesting confirmation by operator on the identification of horizontal or vertical writing and on the order of recognition]
  • Fig. 22 shows the details of the step S101 in the present embodiment.
  • Steps S111 ∼ S114 determine the horizontally and vertically written areas in the same manner as in the embodiment 4.1. Then a step S115 determines the property (vertical or horizontal writing) of the extracted areas and the order of recognition thereof, through request to and confirmation by the operator.

Claims (20)

  1. An image processing method comprising steps of:
       counting image data, on the input image
    information, in the horizontal and vertical directions;
       comparing the results of said counting with a threshold value; and
       determining the direction of row of characters in said input image information, according to the results of said comparison.
  2. A method according to claim 1, wherein said threshold value includes a first threshold value for the horizontal direction and a second threshold value for the vertical direction.
  3. A method according to claim 1, wherein said threshold value corresponds to the size of area of said image information.
  4. An image processing method comprising steps of:
       counting image data, on the input image information, in the horizontal and vertical directions;
       comparing maximum values in the horizontal and vertical directions in said counting of image data, and
       determining the direction of row of characters in said input image information according to the result of said comparison.
  5. A method according to claim 4, wherein the results of said counting of image data are corrected according to the size of area of said image information.
  6. An image processing method comprising steps of:
       counting image data, on the input image information, in the horizontal and vertical direction;
       deriving a vertical-to-horizontal ratio of a rectangular area of character information extracted according to the results of said counting; and
       determining the direction of row of characters in said image information according to thus derived vertical-to-horizontal ratio.
  7. An image processing method comprising steps of;
       counting image data, on the input image information, in the horizontal and vertical directions; and
       deriving the direction of row of characters in a partical area in said image information, according to the results of said counting.
  8. An image processing apparatus compressing:
       counter means for counting image data, on the input image information, in the horizontal and vertical directions;
       comparator means for comparing the results of counting of image data by said counter means with a threshold value; and
       direction determining means for determining the direction of row of characters in said input image information, according to the result of comparison by said comparator means.
  9. An apparatus according to claim 8, wherein said threshold value includes a first threshold value for the horizontal direction and a second threshold value for the vertical direction.
  10. An apparatus according to claim 8, wherein said threshold value corresponds to the size of area of said image information.
  11. An image processing apparatus compressing:
       counter means for counting image data, on the input image information, in the horizontal and vertical directions;
       comparator means for comparing the maximum values in the horizontal and vertical directions in the image data counted by said counter means; and
       determination means for determining the direction of row of characters in said input image information, according to the result of comparison by said comparator means.
  12. An apparatus according to claim 11, further comprising correction means for correcting the results of counting by said counter means, according to the size of area of said image information.
  13. An image processing apparatus comprising:
       counter means for counting image data, on the input image information, in the horizontal and vertical directions;
       derivation means for deriving a vertical-to-horizontal ratio of a rectangular area of character information extracted according to the results of counting by said counter means; and
       determination means for determining the direction of row of characters in said image information, according to thus derived vertical-to-horizontal ratio by said derivation means.
  14. An image processing apparatus comprising:
       counter means for counting image data, on the input image information, in the horizontal and vertical directions; and
       derivation means for deriving the direction of a row of characters in a partial area in said image information, according to the results of counting by said counter means.
  15. Text processing apparatus comprising means for inputting text information and means for determining whether said text information comprises text written parallel or perpendicular to the axis of the characters of said text.
  16. Apparatus according to claim 15, comprising means for scanning in an image including said text, and for recognising characters therefrom.
  17. Apparatus according to claim 16, comprising means for recognising separate areas of said images corresponding to separately oriented text areas.
  18. Apparatus for determining the orientation of text comprising means for statistically analysing the orientation thereof.
  19. Apparatus for recognising text orientation comprising means for recognising the orientation of the ragged edge of text.
  20. A document scanner comprising means for performing print density histogram derivation in two orthogonal directions.
EP91307105A 1990-08-03 1991-08-02 Image processing method and apparatus therefor Expired - Lifetime EP0472313B1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2205229A JPH0490083A (en) 1990-08-03 1990-08-03 Character recognizing device
JP205229/90 1990-08-03
JP03190238A JP3135290B2 (en) 1991-07-30 1991-07-30 Image processing method and apparatus
JP190238/91 1991-07-30

Publications (3)

Publication Number Publication Date
EP0472313A2 true EP0472313A2 (en) 1992-02-26
EP0472313A3 EP0472313A3 (en) 1993-08-11
EP0472313B1 EP0472313B1 (en) 1998-11-11

Family

ID=26505955

Family Applications (1)

Application Number Title Priority Date Filing Date
EP91307105A Expired - Lifetime EP0472313B1 (en) 1990-08-03 1991-08-02 Image processing method and apparatus therefor

Country Status (3)

Country Link
US (1) US5696841A (en)
EP (1) EP0472313B1 (en)
DE (1) DE69130469T2 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5588072A (en) * 1993-12-22 1996-12-24 Canon Kabushiki Kaisha Method and apparatus for selecting blocks of image data from image data having both horizontally- and vertically-oriented blocks
EP0843275A2 (en) * 1996-11-13 1998-05-20 Nec Corporation Pattern extraction apparatus and method for extracting patterns
EP1439484A1 (en) * 2002-11-22 2004-07-21 Océ-Technologies B.V. Segmenting an image via shortest cycles
EP1439486A1 (en) * 2002-11-22 2004-07-21 Océ-Technologies B.V. Segmenting an image via a graph
US7529407B2 (en) 2002-11-22 2009-05-05 Oce-Technologies B.V. Segmenting an image via shortest cycles

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0951422A (en) * 1995-08-09 1997-02-18 Minolta Co Ltd Image edit device
JP3720502B2 (en) * 1996-12-26 2005-11-30 キヤノン株式会社 Image processing apparatus, image processing method in the apparatus, and computer-readable storage medium
US6023534A (en) * 1997-08-04 2000-02-08 Xerox Corporation Method of extracting image data from an area generated with a halftone pattern
JP3472094B2 (en) * 1997-08-21 2003-12-02 シャープ株式会社 Area judgment device
JP4170441B2 (en) * 1997-11-28 2008-10-22 富士通株式会社 Document image inclination detection apparatus and storage medium for document image inclination detection program
US6151423A (en) * 1998-03-04 2000-11-21 Canon Kabushiki Kaisha Character recognition with document orientation determination
JP3795238B2 (en) * 1998-10-01 2006-07-12 シャープ株式会社 Document image processing apparatus and document image processing method
US6970894B2 (en) * 1998-12-30 2005-11-29 Intel Corporation Method for extracting information from a file using a printer driver
JP4323606B2 (en) * 1999-03-01 2009-09-02 理想科学工業株式会社 Document image tilt detection device
US8311946B1 (en) 1999-10-15 2012-11-13 Ebrary Method and apparatus for improved information transactions
US7536561B2 (en) * 1999-10-15 2009-05-19 Ebrary, Inc. Method and apparatus for improved information transactions
US20040148274A1 (en) * 1999-10-15 2004-07-29 Warnock Christopher M. Method and apparatus for improved information transactions
KR100315428B1 (en) * 1999-12-24 2001-11-26 오길록 Character Feature Extraction Apparatus And Method For Recognition Of Multi-Language Printed Document
US7034849B1 (en) * 2001-12-31 2006-04-25 Apple Computer, Inc. Method and apparatus for image blending
US7840564B2 (en) * 2005-02-16 2010-11-23 Ebrary System and method for automatic anthology creation using document aspects
US20060239555A1 (en) * 2005-04-25 2006-10-26 Destiny Technology Corporation System and method for differentiating pictures and texts
US7433869B2 (en) * 2005-07-01 2008-10-07 Ebrary, Inc. Method and apparatus for document clustering and document sketching
US9002096B2 (en) * 2009-01-06 2015-04-07 Siemens Healthcare Diagnostics Inc. Method and apparatus for determining a liquid level in a container using imaging
KR101035739B1 (en) * 2009-02-13 2011-05-20 전남대학교산학협력단 Method for compensating for distortion in text recognition
US9569679B1 (en) * 2012-12-04 2017-02-14 A9.Com, Inc. Adaptive image sampling for text detection
US10607381B2 (en) 2014-07-07 2020-03-31 Canon Kabushiki Kaisha Information processing apparatus
JP6938318B2 (en) 2017-10-03 2021-09-22 キヤノン株式会社 Information processing equipment, information processing methods and programs
US11042735B2 (en) * 2018-09-25 2021-06-22 Drägerwerk AG & Co. KGaA System and method for verifying whether text will be properly rendered in a target area of a user interface and/or a graphics file
CN113505745B (en) * 2021-07-27 2024-04-05 京东科技控股股份有限公司 Character recognition method and device, electronic equipment and storage medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS5631174A (en) * 1979-08-24 1981-03-28 Toshiba Corp Optical character reader
JPS63173188A (en) * 1987-01-13 1988-07-16 Fujitsu Ltd Character processing system

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE3065583D1 (en) * 1979-06-26 1983-12-22 Ibm Device for determining the optimum scanning angle of printed matter
JPS62200486A (en) * 1986-02-28 1987-09-04 Toshiba Corp Character reader
US4817169A (en) * 1987-04-14 1989-03-28 Nippon Sheet Glass Co., Ltd. Page segmentor
US4827529A (en) * 1987-04-14 1989-05-02 Nippon Sheet Glass Co., Ltd. Lines and characters separation apparatus
US5001766A (en) * 1988-05-16 1991-03-19 At&T Bell Laboratories Apparatus and method for skew control of document images
US5073949A (en) * 1989-03-16 1991-12-17 Kabushiki Kaisha Toshiba Personal verification apparatus
US5191438A (en) * 1989-12-12 1993-03-02 Sharp Kabushiki Kaisha Facsimile device with skew correction and text line direction detection
JPH03290774A (en) * 1990-04-06 1991-12-20 Fuji Facom Corp Sentence area extracting device for document picture

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS5631174A (en) * 1979-08-24 1981-03-28 Toshiba Corp Optical character reader
JPS63173188A (en) * 1987-01-13 1988-07-16 Fujitsu Ltd Character processing system

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
2.3 *
9TH INT. CONF. ON PATTERN RECOGNITION vol. 2, 14 November 1988, ROME pages 927 - 9 D. YING ET AL 'automatic recognition of province name on the license plate of moving vehicle' *
PATENT ABSTRACTS OF JAPAN vol. 005, no. 084 (P-064)2 June 1981 & JP-A-56 031 174 ( TOSHIBA ) 28 March 1981 *
PATENT ABSTRACTS OF JAPAN vol. 012, no. 451 (P-791)28 November 1988 & JP-A-63 173 188 ( FUJITSU ) 16 July 1988 *
PROC. OF THE 1987 IEEE INT. CONF. ON SYSTEMS, MAN AND CYBERNETICS vol. 2, 20 October 1987, ALEXANDRIA, VA pages 759 - 763 O. IKAWI ET AL 'A segmentation method based on office document hierarchical structure' section 3.1 *

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5588072A (en) * 1993-12-22 1996-12-24 Canon Kabushiki Kaisha Method and apparatus for selecting blocks of image data from image data having both horizontally- and vertically-oriented blocks
US5854853A (en) * 1993-12-22 1998-12-29 Canon Kabushika Kaisha Method and apparatus for selecting blocks of image data from image data having both horizontally- and vertically-oriented blocks
EP0843275A2 (en) * 1996-11-13 1998-05-20 Nec Corporation Pattern extraction apparatus and method for extracting patterns
EP0843275A3 (en) * 1996-11-13 1999-08-11 Nec Corporation Pattern extraction apparatus and method for extracting patterns
US6327384B1 (en) 1996-11-13 2001-12-04 Nec Corporation Character recognition apparatus and method for recognizing characters
EP1439484A1 (en) * 2002-11-22 2004-07-21 Océ-Technologies B.V. Segmenting an image via shortest cycles
EP1439486A1 (en) * 2002-11-22 2004-07-21 Océ-Technologies B.V. Segmenting an image via a graph
US7529407B2 (en) 2002-11-22 2009-05-05 Oce-Technologies B.V. Segmenting an image via shortest cycles
US7570811B2 (en) 2002-11-22 2009-08-04 Oce Technologies B.V. Segmenting an image via a graph

Also Published As

Publication number Publication date
DE69130469T2 (en) 1999-05-06
DE69130469D1 (en) 1998-12-17
EP0472313A3 (en) 1993-08-11
US5696841A (en) 1997-12-09
EP0472313B1 (en) 1998-11-11

Similar Documents

Publication Publication Date Title
EP0472313A2 (en) Image processing method and apparatus therefor
US5764799A (en) OCR method and apparatus using image equivalents
US5761344A (en) Image pre-processor for character recognition system
US6151423A (en) Character recognition with document orientation determination
US5889897A (en) Methodology for OCR error checking through text image regeneration
EP0677817B1 (en) Page segmentation and character recognition system
US5867277A (en) Reduced resolution document storage and retrieval system
KR100247970B1 (en) Direction correction method of document image
US5650799A (en) Programmable function keys for a networked imaging computer system
EP0266140A2 (en) Optical character recognition by forming and detecting matrices of geographical features
GB2301470A (en) Hand-written character recognition in facsimile apparatus
EP0482187A1 (en) Row-by-row segmentation and thresholding for optical character recognition (system and method)
US7149352B2 (en) Image processing device, program product and system
EP0809205A2 (en) Character line detecting apparatus using simplified projection information and method thereof and character recognition apparatus thereof and method thereof
US20010043742A1 (en) Communication document detector
JP2644041B2 (en) Character recognition device
JP3086653B2 (en) Character recognition method and character recognition device
JP3135290B2 (en) Image processing method and apparatus
JPH0490083A (en) Character recognizing device
JP3090928B2 (en) Character recognition device
JPH09259222A (en) Format recognition device and character reader
JP3384634B2 (en) Character type identification method
JP2902097B2 (en) Information processing device and character recognition device
JP3276554B2 (en) Format recognition device and character reader
JP2747136B2 (en) Character recognition device

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): DE FR GB

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): DE FR GB

17P Request for examination filed

Effective date: 19931223

17Q First examination report despatched

Effective date: 19950404

GRAG Despatch of communication of intention to grant

Free format text: ORIGINAL CODE: EPIDOS AGRA

GRAG Despatch of communication of intention to grant

Free format text: ORIGINAL CODE: EPIDOS AGRA

GRAH Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOS IGRA

GRAH Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOS IGRA

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): DE FR GB

REF Corresponds to:

Ref document number: 69130469

Country of ref document: DE

Date of ref document: 19981217

ET Fr: translation filed
PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed
REG Reference to a national code

Ref country code: GB

Ref legal event code: IF02

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20090821

Year of fee payment: 19

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20090831

Year of fee payment: 19

Ref country code: GB

Payment date: 20090827

Year of fee payment: 19

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20100802

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20110502

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 69130469

Country of ref document: DE

Effective date: 20110301

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20100831

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20110301

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20100802