WO2008081234A1

WO2008081234A1 - Improved indicator device

Info

Publication number: WO2008081234A1
Application number: PCT/IB2007/003679
Authority: WO
Inventors: Marco Gregnanin
Original assignee: Itex Di Marco Gregnanin
Priority date: 2006-11-29
Filing date: 2007-11-29
Publication date: 2008-07-10
Also published as: ITMI20062299A1

Abstract

The present invention relates to an indicator device (1) conceived for visually impaired and/or blind users which, in combination with a software program, allows determination of the graphical properties of a target area of an object (100), an automated color recognition system which comprises the indicator device (1) and a method for automatic recognition of the color of the object (100).

Description

Improved indicator device

The present invention relates to an indicator device for automatic detection of the color, graphics and/or text on a region of an object, particularly designed for use by visually impaired, blind and/or non-reading (e.g. dyslexic) users.

Automatic color detection is now a simple process, also available to visually impaired and/or blind users, who can utilize reflected light-measuring colorimeters connected to a voice synthesizer to "read" the color of any object directly therefrom.

However, the detection of graphics within an object requires different and often heavy devices, such as a scanner or a dedicated camera. Thus, there is the need of carrying a plurality of devices to achieve a valid aid, which leads to apparent drawbacks in terms of costs and comfort of use.

On the other hand, currently available software can determine the color of each pixel of a digital image, by comparing its color parameters with those stored in commercial collections of color samples.

The patent entitled "Metodo e apparato per riconoscere testo in una imagine digitale"

(Method and apparatus for recognizing text within a digital image), filed for the Applicant hereof on 30 November 2006, which is entirely incorporated herein, further discloses an improved software program for character, glyph and/or barcode recognition, designed for use by visually impaired and/or blind users.

Such software program can read labels on containers having a three-dimensional shape, such as bottles or cans, in view of discriminating their contents, but cannot determine whether or not they have their original contents.

Consider, for instance, wine bottles, that are often reused for water or oil: by only reading the label, one cannot ascertain whether the bottle has its original content or, for example, a wine bottle has been filled with water.

This requires a crosscheck to be performed on the color of such contents to check whether it is the expected content, corresponding to the label text; for instance, in an oil bottle, the contents shall have a yellow color. This system might also be useful during the purchase, whereby visually impaired or blind user will prefer transparent containers, which always allow such crosscheck.

Since currently available colorimeters have a high cost and are difficult to use, it would desirable to provide a device that can both be lighter, easier to use and less expensive than those of the prior art, and be integrated with the devices the above mentioned users are always equipped with.

In view of the prior art described above, the object of the present invention is to provide a device, a system and a method that allow particularly visually impaired, blind and/or non-reading (e.g. dyslexic) users to detect color, graphics and/or text (in short: the graphical properties) of a given object, at a substantially lower cost than with prior art devices. According to the present invention, this object is fulfilled by an indicator device as defined in claim 1 a method as defined in claim 25 and a system as defined in claim 31.

The present invention provides a cost-effective and practical device, that can be combined with the above mentioned software program to achieve fast, accurate and reliable recognition of the graphical properties (such as color, but also specific letters, words or phrases), and thus constitute a quick aid for the above mentioned users.

The features and advantages of the present invention will appear from the following detailed description of one practical embodiment, which is illustrated without limitation in the annexed drawings, in which:

- Figure 1 shows a first embodiment of an indicator device of the present invention; - Figure 2 shows a second embodiment of an indicator device of the present invention; - Figure 3 schematically shows the image acquired by the device of Fig. 4;

- Figure 4 shows a system according to a first embodiment of the present invention;

- Figure 5 shows a variant of the embodiment of Figure 1;

- Figure 6 shows a variant of the embodiment of Figure 2. Referring to Figures 1, 2, 5 and 6, numeral 1 generally designates an indicator device for automatic reading of a target area of an object 100, which device comprises a marker 2 and advantageously a handle 3 adapted to be held by a user, such as a visually impaired and/or blind user, wherein the marker 2 is automatically recognizable and allows unique definition of a detection area 4 so that, when the device 1 is correctly held using the handle 3, the characteristics of the target area can be seen by an image acquisition device 101 through the detection area 4.

The term "handle" as used herein shall be intended to designate any portion of the device 1 that allows a user, such as a visually impaired and/or blind user to correctly grasp, position and/or hold the device 1.

The marker 2 is so designed as to define a Cartesian or polar coordinate system, when shown on a two-dimensional image. With the design of Figure 5, cross combination of the position data of the marker 2 and the characteristics (such as focal length) of the acquisition device, allows determination of a point or direction in space.

The marker 2 may be a graphical marker, i.e. including alphanumeric characters and/or glyphs of any nature; advantageously, it only includes alphanumeric characters. It was surprisingly found that the marker 2 is be recognized by the OCR device developed by the owner hereof in a particularly short time when the marker has a very short text on it, e.g. containing any of the letters "I", "T", "E" and/or "X" or, preferably, all of them.

Nevertheless, a marker 2 including alphanumeric characters is more difficult to recognize within a text-containing image. For quicker operation, the marker 2 may include or advantageously consist of one or more barcodes, preferably only one, predetermined by and known to the recognition system, for the marker 2 to be recognized by a single character recognition "pass".

Advantageously, the barcode/s may extend circumferentially and/or symmetrically over the indicator device 1, so that they are always visible, regardless of the orientation of the indicator device.

The indicator device 1 may include two or more markers 2, so that the detection area 4 can be also determined based on the relative position of the markers 2; in Figure 2, the detection area 4 is located in a middle region between the two markers 2, to reduce required calculation times. Figure 4 shows a system for determining the graphical properties of a target area of an object 100. This system comprises a digital image processing program, installed in a processing device 102, and a device 101 for acquiring digital images.

According to the present invention, the method for automatic reading of a target area of an object 100 comprises the step of acquiring an image that shows both the target area and the indicator device 1, so that both the target area and the marker 2 are visible within the acquired image.

Then, the position of the marker 2 in the image is automatically recognized and the position of the target area 4 is determined based on the position of the- marker 2; preferably, the latter determination is only based on data that can be deduced by the image of the marker 2 or markers 2.

Advantageously, the detection area 3 in the acquired image coincides with the target area.

For color determination, the image corresponding to the detection area 4 can be sampled at one or more points close to each other, to preferably obtain a single color value; then, such color value is compared with those contained in a suitable database which allows automatic association, through the same or a different database, with the name of the recognized color or with a characteristic set of properties thereof.

Then, the name of the color (or the characteristic set of properties thereof), can be emitted in any suitable manner, and for instance converted into sound.

It two or more dominant colors are recognized, then the process may include the step of informing the user of the names of all recognized colors.

The indicator device 1 is advantageously placed in such position that the detection area 4 overlaps the area of the object 100 to be subjected to color recognition.

Figure 5 shows a variant of the indicator device 1 of Figure 1, in which a plurality of markers 2 are placed in such positions as to also provide an indication of the three-dimensional position of the indicator device 1.

However, the variant of Figure 6 allows direct selection of a text area as a detection area 4.

The indicator device 1 may include two elements 11, 12 advantageously having an L shape, which are arranged in such relationship as to define a rectangle and are slideable towards and away from each other, each preferably having a marker 2, so that the desired detection area 4 can be defined by the relative position of the markers.

The device 101 captures the image of the object 100 and the indicator device 1 and transmits it to the processor 102. For instance, with the system of Figure 4, the acquired image might be the one of Figure 3. The image processing program recognizes the position of the marker 2 within the digital image using suitable recognition means and determines then the position of the detection area 4 by suitable processing means. The relationship between the relative positions of the marker 2 and the detection area 4 is predetermined and advantageously stored in the image processing program. Particularly, the process for recognizing the marker 2 may be as described in the above mentioned patent entitled "Metodo e apparato per riconoscere testo in una immagine digitale"

(Method and apparatus for recognizing text within a digital image), by the owner hereof.

Thus, the processor 102 may easily determine the position of the detection area 4 relative to the position of the marker 2. In the case as shown in Figure 1 or 5, the position of the detection area 4 is defined, for instance, as the position directly facing one end 5 of the device 1 ; in the case of Figure 2, the detection area 4 is at the center of the line that joins the two markers 2; in the case of Figure 6, the detection area 4 may coincide with the inner portion of the device 1.

Advantageously, the indicator device 1 may include a first portion 6 designed for white balance and/or a second portion 7 designed for contrast balance in an image acquisition device 101.

These portions may advantageously consist of a first darker area 8, such as a black or a standard 70% gray, and a second brighter area 9, such as a white or standard 30% gray area. Preferably, the two portions 6, 7 are coincident; in a preferred embodiment, the areas 8 and 9 are black and white respectively.

Advantageously, the handle 3 is sufficiently separated by the first portion 6 and the second portion 7 to allow a visually impaired and/or blind user to grasp and/or hold the indicator device 1 while ensuring that the first portion 6, the second portion 7, the marker 2 and the detection area 4 are not accidentally concealed. Advantageously, the marker 2 and the areas 8 and 9 have different tactile properties from each other and/or from the rest of the indicator device 1.

In the embodiment of Figure 2, the handle is shown to be formed of a rod; nevertheless, other designs may be provided, as long as they allow the user to handle and/or position the device 1. Advantageously, the device 1 generally has such a shape as to allow visually impaired and/or blind users to immediately find how it has to be held for the marker 2 to be always directed towards the image acquisition device 101.

For example, in the device of Figure 6 the four sides have different thicknesses, with all four differing from one another or with opposite or contiguous sides having equal thicknesses. Advantageously, the device may be substantially symmetrical in shape with respect to a plane or an axis and comprise a marker 2 and/or a white balance portion 6 and/or a contrast balance portion 7 on each side of the plane of symmetry or along the circumference thereof, so that the marker 2 extends circularly.

Thus, the color determination method is not dependent on how the user positions the indicator device 1.

The device 1 as shown in Figure 1 has a substantially elongate shape extending along a longitudinal axis and has a tip 10 at its end 5; such tip 10 provides a tactile indication of the position of the detection area 4, the latter being placed directly in front of the tip 10.

The device 1 as shown in Figures 2 and 6 has a substantially planar portion 12 including a transparent area 13, preferably at the center of the portion 12, and containing the detection area 4; the area 13 may either be formed of a transparent material or be empty.

The device 1 of the present invention may further include suitable control and monitoring means, which are adapted to communicate with the image acquisition device 101 and/or with the processor 102 to start image acquisition, for instance as soon as the user has correctly positioned the device 1.

Furthermore, the control and monitoring means may be designed to allow selection of the recognition mode: for instance, recognition of colors, letters, words or phrases within the target area and/or the object.

Those skilled in the art will obviously appreciate that a number of changes and variants may be made to the arrangements as described hereinbefore to meet incidental and specific needs, without departure from the scope of the invention, as defined in the following claims.

Claims

1. An indicator device (1) for automatic detection of the graphical properties of a target area of an object (100), said device comprising a marker (2) and preferably a handle (3) adapted

5 to be held by a visually impaired and/or blind user; characterized in that

- said marker (2) is automatically recognizable and allows unique definition of a detection area (4) relative to it;

- said indicator device (1) is so designed that, when it is correctly held using said handle 10 (3), said target area can be seen, through said detection area (4), by an image acquisition device

(101).

2. An indicator device (1) as claimed in the preceding claim, wherein said marker (2) is so designed as to define a coordinate system, when shown on a two-dimensional image.

3. An indicator device (1) as claimed in any one of preceding claims, wherein said marker 3.5 (2) is of the graphical type.

4. An indicator device (1) as claimed in any one of preceding claims, wherein said marker (2) includes alphanumeric characters.

5. An indicator device (1) as claimed in the preceding claim, wherein said marker (2) only includes alphanumeric characters.

20 6. An indicator device (1) as claimed in the preceding claim, wherein said characters include the letters "I", "T", "E" and/or "X".

7. An indicator device (1) as claimed in any one of claims 1 to 3, wherein said marker (2) includes a barcode.

8. An indicator device (1) as claimed in any one of the preceding claims, wherein said 5 marker extends circumferentially and/or symmetrically along said indicator device (1) so that they are always visible, regardless of the orientation of said indicator device (1).

9. An indicator device (1) as claimed in any one of the preceding claims, comprising two or more of said markers (2), said detection area (4) being allowed to be also determined based on the relative position of said markers (2). 10. An indicator device (1) as claimed in the preceding claim, wherein said detection area

(4) is located within the area defined by the positions of said markers (2).

11. An indicator device (1) as claimed in the preceding claim, wherein said detection area (4) is at the center between the positions of said markers (2).

12. An indicator device (1) as claimed in any one of the preceding claims, comprising a first portion (6) for white balance of an image acquisition device (101).

13. An indicator device (1) as claimed in any one of the preceding claims, comprising a second portion (7) for contrast balance of an image acquisition device (101).

14. An indicator device (1) as claimed in claims 12 and 13, wherein said first portion (6) coincides with said second portion (7). 15. An indicator device (1) as claimed in any one of the preceding claims, wherein said handle (3) is sufficiently distinct from said first portion (6), said second portion (7), said marker (2) and said detection area (4) as to allow said indicator device (1) to be held by a visually impaired and/or blind user, while ensuring that said user does not accidentally conceal said first portion (6), said second portion (7), said marker (2) or said detection area (4). 16. An indicator device (1) as claimed in any one of the preceding claims, having a substantially elongate shape along a longitudinal axis, with an end (5) defining a tip (10).

17. An indicator device (1) as claimed in the preceding claim, wherein said marker (2) is located in the proximity of said tip (10) and said detection area (4) is located beyond said tip (10) in the direction of said longitudinal axis. 18. An indicator device (1) as claimed in any one of claims 16 an 17, comprising a second end (11) away from said first end (5), said handle (3) being formed on said second end (11).

19. An indicator device (1) as claimed in any one of the preceding claims, having a substantially planar portion (12) with a transparent central area (13). 20. An indicator device (1) as claimed in the preceding claim, wherein said detection area

(4) is located within said transparent central area (13).

21. An indicator device (1) as claimed in any one of claims 19 to 20, wherein said central area (13) is formed of a transparent material.

22. An indicator device (1) as claimed in any one of claims 19 and 20, wherein said central area (13) is empty.

23. An indicator device (1) as claimed in any one of the preceding claims, comprising control and monitoring means, adapted to communicate with the image acquisition device (101) and/or with the processor (102) to start remote image acquisition.

24. An indicator device (1) as claimed in the preceding claim, wherein said control and monitoring means allow selection of color and/or text recognition modes.

25. A method for automatic determination of the graphical properties of a target area of an object, comprising the steps of:

- acquiring an image that shows both said target area and an indicator device (1) as claimed in any one of the preceding claims; characterized in that

- said image is acquired in such a manner as to represent both said marker (2) and said target area.

26. A method as claimed in the preceding claim, further comprising the step of automatically recognizing the position of said marker (2) in said image. 21, A method as claimed in the preceding claim, further comprising the step of determining the position of said detection area (4) from the position of said marker (2).

28. A method as claimed in the preceding claim, wherein said detection area (4) is only determined based on the position of said marker (2).

29. A method as claimed in any one of claims 27 to 28, wherein said detection area (4) in the acquired image coincides with said target area.

30. A method as claimed in any one of claims 25 to 29, comprising the step of placing said indicator device (1) so that said detection area (4) overlaps said target area.

31. A system comprising:

- digital image acquisition means (101), - a digital image processing program loaded in a processing device (102);

- an indicator device (1) as claimed in any one of claims 1 to 24; characterized in that said system comprises recognition means for recognizing the image of said marker (2) within said digital image and processing means for determining said detection area (4) in said digital image, relative to the image of said marker (2).

32. A system as claimed in the preceding claim, wherein said program comprises storage means, containing the relationship between the position of said marker (2) and said detection area (4).