EP0685092B1

EP0685092B1 - Method and apparatus for illumination and imaging of a surface

Info

Publication number: EP0685092B1
Application number: EP94910141A
Authority: EP
Inventors: Joe Zheng; John Sussmeier
Original assignee: United Parcel Service of America Inc; United Parcel Service Inc
Current assignee: United Parcel Service of America Inc; United Parcel Service Inc
Priority date: 1993-02-19
Filing date: 1994-02-18
Publication date: 1999-05-19
Anticipated expiration: 2014-02-18
Also published as: US5567934A; US5517018A; DE69418598T2; US5399852A; CA2156153C; EP0685092A1; AU6269794A; ATE180341T1; DK0685092T3; WO1994019766A2; GR3030935T3; DE69418598D1; ES2134933T3; WO1994019766A3; JP2895236B2; JPH08506678A; CA2156153A1

Abstract

An apparatus for illumination and imaging of a surface includes an apparatus for illuminating the surface, an apparatus for obtaining an image of the illuminated surface and providing an output signal representative of the obtained image, and an apparatus for limiting the exposure time of the image-obtaining apparatus to a selected fast exposure time less than the video frame rate of the image-obtaining apparatus. The image-obtaining apparatus may be a CCD-based camera. The CCD-based camera and the illumination apparatus may be mounted in a shroud having an opaque side wall. A first polarizing film may be provided intermediate the illumination apparatus and the surface, and a second polarizing film, having a polarization orientation orthogonal to that of the first polarizing film, may be provided intermediate the surface and the image-obtaining apparatus. Tip switches may be provided to prevent activation of the illumination apparatus and the image obtaining apparatus except when a lower edge of the shroud side wall is in contact with the surface.

Description

Background of the Invention.

This invention relates to methods and devices for illuminating a surface and obtaining an image of the surface, and particularly to hand-held illumination and imaging devices for the purpose of reading labels having information in a code, such as a bar code, or an alphanumeric format.
Devices for imaging of surfaces provide an electronic representation of an image of the surface of an object. The representation in electronic form is then stored or transmitted to an appropriate data processing apparatus. If information is stored in the label in alphanumeric format, the image would be transmitted to a data processing apparatus having character recognition capacity. Typically, however, routine information is printed in a code format. A common example is a bar code label affixed to the surface of a package. The bar code label contains information about the package's origin, destination, order number, and the like. To retrieve the information from the bar code label, an appropriate imaging device electronically creates a digitized image of the bar code label. That image is then transferred to a processing computer. The processing computer deciphers the desired information from the digitized image.
An imaging device can be either machine-mounted or hand-held. Portable hand-held devices are especially useful when processing is required at remote locations. Such devices are also useful when the objects to which labels have been applied may be in a variety of sizes or positions.
The ability to retrieve data from the surface of an object depends largely on the quality of the digital image obtained by the imaging device. Glares, shadows and nonuniformity in illumination on the surface during the imaging process result in degradation of the digital image. More specifically, image processing software may be unable to reliably identify the optical characteristics (such as color) of every portion of the label. As a result, data will be lost. Uniform illumination over a surface is especially important when reading information on an alphanumeric label or in a two-dimensional encoded format where there is a minimum of redundancy.
Non-uniform ambient light is one source of nonuniformity in illumination. A second problem, which is particularly common in shipping of packages and letters, results from the practice of placing a shiny protective layer, such as transparent tape, over the label. Such tape will cause specular reflection from the surface, which will obscure the image of the underlying label.
A desirable goal in obtaining images of labels is to obtain the image as quickly as possible. This goal makes it desirable to be able to capture the entire image of a two-dimensional label substantially instantaneously.
The use of charge-coupled device based cameras has been proposed for obtaining images of labels. However, CCD-based cameras are subject to the drawback that the photo-charges in the potential wells in the CCD array can exceed the capacity of the potential wells in the presence of intense illumination. Charges spill over into adjacent potential wells, which phenomenon is known as blooming. Blooming, of course, results in loss of information.
Furthermore, relative motion of the camera and the substrate can cause blurring of the obtained image. For example, a normal video exposure time is 0.033 seconds. In that time, an object moving at 5 inches per second moves 0.165 inches (1 inch ≃ 2.54 cm), which, in 100 dpi image resolution, is 16.5 pixels. Such a pixel shift will provide a very blurred image, with resulting loss of data.
Document FR-A-2 578 339 discloses an imaging apparatus for the detection of moving identification marks. The apparatus comprises illumination and image obtaining means positioned in a shroud which is directed to the mark to be detected. A bar code reader representing an optoelectronic unit with a video camera is described in DE-OS-37 37 792. A light source for illuminating the bar code to be read is connected via a separating means with the video camera. EP-A-0 385 478 described another bar code reader, wherein a field of view which includes a symbol to be read is imaged upon a light-responsive array such as a CCD imager device. The imager device detects a complete image of the symbol which is scanned in a memory instead of a mechanical scanning.
In WO-A-94/19764 (document according to Art. 54(3) EPC), an apparatus for illuminating and imaging a surface is described which includes a two-dimensional array of LED's for providing a uniform illumination of the surface. The LED's are mounted on a planar surface and positioned with a CCD-based camera within a shroud to be set on an image to be investigated.
It is an object of the invention, to provide an improved apparatus and method for illumination and imaging of a surface which obtains accurate images in a short amount of time.
The object of the invention is solved with an apparatus and a method comprising the features of claims 1 or 5, respectively. Advantages embodiments of the invention are defined in the dependent claims.
Additional objects and advantages of the invention will become apparent from the detailed description of a preferred embodiment which follows.

Brief Description of the Figures.

Figure 1 is a perspective view with partial cutaway of an apparatus of the invention in use.
Figure 2 is an exploded perspective view of an apparatus according to the invention.
Figure 3 is a flow chart illustrating operation of a shutter circuit in an apparatus.
Figure 4 is a block diagram showing a controller, and signal processor as used with an apparatus.

Detailed Description of a Preferred Embodiment.

Referring now to Figure 1, there is depicted an illuminating and imaging apparatus 10 according to the invention in use illuminating and imaging a label 14 applied to a planar upper surface of a package 12. Referring to Figure 2, apparatus 10 includes shroud 20, camera 40, handle 60, and illumination apparatus 80. Shroud 20 has an opaque, vertical sidewall 22. Vertical sidewall 22 has a lower edge which defines a bottom opening 24, and has a top opening 26. In the embodiment illustrated in the figures, sidewall 22 includes four planar panels, so as to provide a square cross-section. It will be understood that the form of vertical sidewall 22 may be selected as desired. For example, the vertical sidewall 22 may be rectangular, or cylindrical in plan. Ordinarily, vertical sidewall 22 will be selected so that the shape of bottom opening 24 is the same as the shape of a surface to be illuminated. The shape of the bottom opening 24 may also be selected so as to be the same as the shape of the array of an imaging device. It will also be appreciated that vertical sidewall 22 need not be precisely vertical.
Camera 40, which in the illustrated embodiment has a substantially cylindrical housing, is disposed through top opening 26 in shroud 20. Camera 40 is mounted in an upper portion of shroud 20 by bracket 42 on the side of the housing of camera 40. Camera 40 is secured to shroud 20 by a fastener 44 disposed through hole 28 through sidewall 22. Camera 40 is an apparatus that obtains an image of a surface, such as the surface of package 12 illustrated in Figure 1, and produces a signal representative of the obtained image of the surface. Camera 40 may be, for example, a CCD-based camera. An example of a suitable CCD-based camera is a Pulnix TM-7X, with a Tamron 6.5 mm. lens. Appropriate power and signal lines are provided through cable 70 to an external power supply (not shown), controller 110 and signal processor 120 (shown schematically in Figure 4). The power supply provides electrical power for operation of camera 40 and illumination apparatus 80. The signal lines in cable 70 transmit control signals from controller 110 to camera 40 and trigger 85, and transmit from camera 40 to signal processor 120 an output signal representative of the image obtained by camera 40.
Referring again to Figures 1 and 2, handle 60 is mounted on the upper face of the housing of camera 40. Handle 60 is generally cylindrical, and provides a convenient hand grip for an operator. Preferably, there is provided a hand switch 62, which an operator can use for providing a signal to controller to begin the sequence of illuminating the surface and obtaining the image. Hand switch 62 may be an omnidirectional switch.
Illumination apparatus device 80 is mounted in an upper portion of shroud 20, mounted on horizontal plate 72, which is preferably mounted within an upper portion of shroud 20 about a lens of camera 40. In the illustrated embodiment, lighting apparatus 80 is a linear xenon flash lamp or strobe light. Illumination apparatus 80 includes a flash lamp tube 82, which is mounted in a reflector 84. Reflector 84 may have a surface of bubble alzac, or reflective aluminum. Suitable electrical connections (not shown) provide current to cause the flash lamp tube 82 to flash. Horizonal planar support plate 72 is provided with an aperture 74 therethrough for permitting light from the surface to pass through to camera 40. Suitable conventional fixtures may be provided for mounting flash tube 82 in reflector 84.
There are further provided first polarizing film, or polarizer, 100 and second polarizing film, or analyzer, 102. First polarizing film 100 is provided beneath illumination apparatus 80. First polarizing film 100 is so positioned that all light emitted by illumination apparatus 80 is transmitted through first polarizing film 100 before reaching an illuminated surface through bottom opening 24 of shroud 20. Second polarizing film 102 is mounted on the aperture of camera 40. Second polarizing film 102 is thus so mounted that light reflected from a surface will pass through second polarizing film 102 before entering camera 40. First polarizing film 100 has a first selected polarization orientation, and second polarizing film 102 has a second selected polarization orientation, 90° from the polarization orientation of first polarizing film 100. The use of the combination of first polarizing film 100 in the path of light from illumination apparatus 80 to the surface, and second polarizing film 102, having a polarization orientation at a 90° angle from the polarization orientation of first polarizing film 100, in the path of light reflected from the illuminated surface to the camera 40, eliminates the effect of specular reflection of light from the surface. The use of first polarizing film 100 and second polarizing film 102 is particularly advantageous where apparatus 10 is used to read labels that may be covered with a shiny coating such as a transparent tape.
Tip switches 130, 132 are provided at two opposite points on the lower edge of shroud 20. Tip switches 130, 132 are closed when the respective points on the lower edge of shroud 20 engage a surface. As shown in Figure 4, tip switches 130, 132 are connected in series with hand switch 62. The signal from hand switch 62 will only be transmitted when both lower edges of shroud 20 are in contact with a surface, such as the surface of package 12 of Figure 1. As a result, tip switches 130, 132 serve to prevent activation of illumination device 80 and of camera 40, except when the lower edge of shroud 20 is in contact with the surface.
This configuration of tip switches 130, 132 serves both safety and image quality goals. First, illumination apparatus 80 cannot be inadvertently activated while directed at someone's eyes. Because the flash lamp intensity is high, eye discomfort could be caused if the device were activated while directed at someone's eyes. Second, the configuration of tip switches 130, 132 assumes that the camera cannot be activated while a gap exists between the points on the lower edge of shroud 20 where tip switches 130, 132 are located, and a surface. As a result, the quantity of ambient light reaching the surface will be minimized. If, as shown, the lower edge of shroud 20 lies in a plane, this configuration of tip switches 130, 132 assures that substantially no ambient light will reach a planar surface within the shroud.
An electronic shutter is preferably provided for control of the CCD-based camera. A CCD-based camera conventionally allows charge to accumulate in the potential wells for a period of time equal to the video frame rate. At the end of this period of time, the charge is read out in accordance with conventional techniques. The video frame rate (or video frame length or video exposure time) is conventionally 1/30 seconds. However, it has been found by the inventors, in using device 10, that the illumination produced by illumination apparatus 80 is so great that the photo-charges in many of the potential wells of a CCD array will exceed the capacity of the potential wells, if charges are permitted to accumulate for a time equal to the video frame rate. In addition, it is desirable to reduce the exposure time as much as possible to prevent loss of clarity caused by relative movement of the camera and the label.
Referring now to Figure 3, there is shown a flow chart illustrating the sequence of operation of an electronic shutter. The electronic shutter is preferably provided in controller 110, either in software or hardware. At box 305, labeled "START VIDEO FRAME (T=0)," a new video frame has started. At the start of the video frame, at time T = 0, there is no charge stored in any of the elements of the CCD array.
Immediately after time T = 0, each element in the CCD array is maintained in a shorted condition, so that no charge can accumulate in any of the elements of the CCD array. In other words, the electronic shutter is closed. This step is illustrated by box 310, labeled MAINTAIN CCD SHORTED.
The time T from the beginning of the video frame is then continuously compared to a time equal to the length of a video frame less a selected fast exposure time. This is illustrated by box 315, labeled T = VIDEO FRAME LENGTH - SELECTED FAST EXPOSURE TIME? If the time T is less than the video frame rate less the selected fast exposure time, the controller continues to maintain the elements in the CCD array shorted, as indicated by the arrow marked "NO" leading from box 315.
If the time T is equal to the video frame length less the selected fast exposure time, then, as indicated by box 320, labeled "ACTIVATE CCD ARRAY AND ILLUMINATION APPARATUS," the controller provides a signal so that the elements of the CCD array are no longer shorted, and the elements begin to accumulate charge. Simultaneously, illumination apparatus 80 is activated by a signal provided from the controller to trigger 85. As a result, the elements in the CCD array will be exposed to light reflected during illumination of the surface and will accumulate charge.
Time T is compared to the length of the video frame, as shown by box 325, labeled T = VIDEO FRAME LENGTH?. As long as the time T is less than the video frame length, the CCD array remains activated, and individual elements accumulate charge as light impinges on them. This is indicated by the arrow marked NO from box 325 to box 320. As shown by the arrow marked YES from box 325 to box 330, when the time is equal to the video frame length, the CCD array is read out, as indicated by box 330, labeled READ OUT CCD ARRAY. The process is then at an end, as indicated by box 335.
It will be understood that by the foregoing process, the time that the elements in the CCD array are accumulating charge is maintained as short as possible. This will prevent blurring, due to relative movement of apparatus 10 and the surface, and will also prevent blooming due to excessive exposure time. The use of an electronic shutter provides precise control over the selected fast exposure time. In addition, the use of the electronic shutter, combined with activation of the illumination apparatus simultaneously with the opening of the electronic shutter, assures that the light reflected from the surface is primarily light generated by the illumination apparatus. The use of an electronic shutter thereby minimizes the influence of ambient light. This in particular assures that, with the use of first and second polarizing films 100, 102, oriented at a ninety degree angle to one another, as explained above, the glare from the surface will be eliminated or minimized.
It is preferred that the selected fast exposure time be substantially shorter than the video frame rate, and preferably as fast as possible, provided that the illumination intensity is great enough. In a tested embodiment, a selected fast exposure time of one millisecond provided good results. This selected fast exposure time is thus 1/33 the video frame rate. The selected fast exposure time may be set, on an empirical basis, by those of skill in the art. If, after using a selected fast exposure time, blooming or blurring are observed, then the selected fast exposure time should be shortened. If after using a selected fast exposure time, obtained intensity levels were too low to distinguish different optical properties, the selected fast exposure time should be increased.
Referring now to Figure 4, there is illustrated a block diagram of an apparatus with its controller and signal processor. Controller 110 provides control signals to camera 40 and illumination apparatus trigger circuit 85. Tip switches 130, 132, are disposed in the circuit intermediate switch 62 and controller 110. As explained above, the control signals from controller 110 provide for an electronic shutter to time operation of camera 40,, as well as for timing of the triggering of illumination apparatus 80. Trigger circuit 85 customarily includes an electrical energy storage device, such as one or more capacitors. Upon receipt of a signal from controller 110, trigger circuit 85 allows current to flow from such capacitors to illumination apparatus 80. Camera 40 provides a signal, representative of the light reflected from the surface, to signal processor 120.
Many variations are possible within the scope of the invention. For example, the light source illumination apparatus 80 need not be a flash lamp. Illumination apparatus 80 may include, for example, an array of light-emitting diodes, a diffuse light source, or any other type of light source. An intense light source, such as a flash lamp, is advantageous in that it will tend to minimize the influence of ambient light on the total illumination of the surface. As a result, non-uniformities in ambient illumination will contribute relatively little to total illumination. Intense illumination, such as that from a flash lamp, also permits the aperture of the camera lens to be adjusted to a minimum, to provide the greatest depth of field. Depth of field is particularly useful when a label is applied to a curved surface, such as a tube.
Shroud 20, in combination with illumination apparatus 80 and camera 40, is highly advantageous. Shroud 20, is opaque, and in operation has only bottom opening 24. As a result shroud 20 substantially eliminates the illumination of the surface by ambient light. As a result, illumination of the surface will be substantially entirely as a result of lighting apparatus 80. Thus, uniformity of illumination may be controlled. In addition, polarization of light illuminating the surface may be controlled, to reduce specular reflection. Control of the intensity of illumination is also achieved. This assures that the apparatus may successfully be used even where ambient illumination is very intense, such as in direct sunlight. The distance between the lens of camera 40 and the surface is maintained constant, thereby eliminating the need to refocus the camera. The device according to the invention can be implemented in a hand-held configuration.
In a particularly preferred embodiment, given only by way of example, camera 40 is mounted three inches above the bottom edge of the shroud, and has a field of view 2.5 inches across. The shroud has dimensions of 3.75 inches in height. The reflector 84 has an inner diameter of 0.8 inches, and extends in an arc of 225°. The axis of the lamp is mounted 1.45 inches away from the camera optical center, and 0.234 inches radially from the axis of the reflector 80. The selected short exposure time may be about 1 millisecond.
It will be appreciated that there are considerable variations that can be accomplished in a method and apparatus of the invention without departing from its scope. As a result, although a preferred embodiment of the method and apparatus of the invention has been described above, it is emphasized that the invention is not limited to a preferred embodiment and there exist other alternative embodiments that are fully encompassed within the invention's scope, which is intended to be limited only by the scope of the appended claims.

Claims

Apparatus (10) for illumination and imaging of a surface, comprising:

(a) a shroud (20) having an opaque side wall (22), a lower edge of said side wall defining a bottom opening (24);

(b) means (80), mounted in said shroud (20), for illuminating the surface through said bottom opening (24); and

(c) means (40), mounted in said shroud (20), comprising a CCD-based camera, for obtaining an image of the illuminated surface and providing an output signal representative of said obtained image,

characterized by
means (130, 132) for preventing activation of said illumination means (80) and said image obtaining means (40) except when said lower edge of said shroud side wall (22) is in contact with the surface.
Apparatus of claim 1, wherein said activation preventing means (130, 132) is adapted to prevent activation of said illumination means (80) and said image obtaining means (40) except when two substantially opposite points on said lower edge of said shroud side wall (22) are in contact with the surface.
Apparatus of claim 1 or 2, wherein said lower edge of said side wall (22) lies in a plane.
Apparatus of one of the foregoing claims, further comprising an activation switch (62) mounted thereon for activation of said illumination means (80) and said image obtaining means (40), and a circuit (110) defined intermediate said activation switch (62) and said illumination means (80) and said image obtaining means (40), wherein said activation preventing means (130, 132) comprises two tip switches mounted on said shroud side wall (22) at said two substantially opposite points, said tip switches being connected in series in said circuit (110), whereby said circuit (110) can only be closed when both of said tip switches are closed.
Method for illumination and imaging of a surface,
comprising the steps of:

(a) providing a shroud (20) having an opaque side wall (22), a lower edge of said side wall defining a bottom opening (24);

(b) illuminating the surface through said bottom opening (24) by employing a light source (80) mounted in said shroud (20); and

(c) obtaining an image of the illuminated surface, employing a CCD-based camera mounted in said shroud (20), and providing an output signal representative of the obtained image,

characterized by
the steps of providing means (130, 132) for preventing carrying out of said steps (b) and (c) except when the lower edge of said side wall (22) is in contact with the surface, and before said steps of illuminating the surface and obtaining an image, engaging the surface with said lower edge of said shroud side wall (22).
Method of claim 5, wherein said preventing means (130, 132) is adapted to prevent carrying out of said steps (b) and (c) except when two substantially opposite points on said lower edge of said shroud side wall (22) are in contact with the surface, and wherein said step of engaging the surface comprises contacting the surface with said lower edge of said shroud side wall (22) at said two substantially opposite points.
Method of claim 5 or 6, wherein said lower edge of said side wall (22) lies in a plane.
Method of one of the claims 5 to 7, further comprising the steps of providing an activation switch (62) and a circuit (110), said activation switch (62) being adapted to close said circuit (110) to cause said steps (b) and (c) to take place, wherein said preventing means (130, 132) comprises two tip switches mounted on said shroud side wall (22) at said two substantially opposite points, said tip switches being connected in series in said circuit (110), whereby said circuit (110) can only be closed when both of said tip switches are closed.