US4980759A - Calibration system and method for color image scanning - Google Patents

Calibration system and method for color image scanning Download PDF

Info

Publication number
US4980759A
US4980759A US07/398,897 US39889789A US4980759A US 4980759 A US4980759 A US 4980759A US 39889789 A US39889789 A US 39889789A US 4980759 A US4980759 A US 4980759A
Authority
US
United States
Prior art keywords
light
cells
photodetector
signals
subject
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
US07/398,897
Inventor
William K. Smyth
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Intellectual Ventures I LLC
Original Assignee
Polaroid Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Polaroid Corp filed Critical Polaroid Corp
Assigned to POLAROID CORPORATION, A CORP OF DE reassignment POLAROID CORPORATION, A CORP OF DE ASSIGNMENT OF ASSIGNORS INTEREST. Assignors: SMYTH, WILLIAM K.
Priority to US07/398,897 priority Critical patent/US4980759A/en
Priority to CA002019725A priority patent/CA2019725C/en
Priority to ES90114601T priority patent/ES2056314T3/en
Priority to DK90114601.9T priority patent/DK0415100T3/en
Priority to DE69008973T priority patent/DE69008973T2/en
Priority to EP90114601A priority patent/EP0415100B1/en
Priority to DE199090114601T priority patent/DE415100T1/en
Priority to AT90114601T priority patent/ATE105948T1/en
Priority to JP2224168A priority patent/JP2501656B2/en
Publication of US4980759A publication Critical patent/US4980759A/en
Application granted granted Critical
Assigned to MORGAN GUARANTY TRUST COMPANY OF NEW YORK reassignment MORGAN GUARANTY TRUST COMPANY OF NEW YORK SECURITY AGREEMENT Assignors: POLAROID CORPORATION
Assigned to POLAROID CORPORATION reassignment POLAROID CORPORATION CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: OEP IMAGING OPERATING CORPORATION
Assigned to OEP IMAGINIG OPERATING CORPORATION reassignment OEP IMAGINIG OPERATING CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: POLAROID CORPORATION
Assigned to JPMORGAN CHASE BANK,N.A,AS ADMINISTRATIVE AGENT reassignment JPMORGAN CHASE BANK,N.A,AS ADMINISTRATIVE AGENT SECURITY INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: PETTERS CONSUMER BRANDS INTERNATIONAL, LLC, PETTERS CONSUMER BRANDS, LLC, POLAROID ASIA PACIFIC LLC, POLAROID CAPITAL LLC, POLAROID CORPORATION, POLAROID EYEWEAR ILLC, POLAROID HOLDING COMPANY, POLAROID INTERNATIONAL HOLDING LLC, POLAROID INVESTMENT LLC, POLAROID LATIN AMERICA I CORPORATION, POLAROID NEW BEDFORD REAL ESTATE LLC, POLAROID NORWOOD REAL ESTATE LLC, POLAROID WALTHAM REAL ESTATE LLC, ZINK INCORPORATED
Assigned to WILMINGTON TRUST COMPANY, AS COLLATERAL AGENT reassignment WILMINGTON TRUST COMPANY, AS COLLATERAL AGENT SECURITY AGREEMENT Assignors: PETTERS CONSUMER BRANDS INTERNATIONAL, LLC, PETTERS CONSUMER BRANDS, LLC, POLAROID ASIA PACIFIC LLC, POLAROID CAPITAL LLC, POLAROID CORPORATION, POLAROID EYEWEAR I LLC, POLAROID INTERNATIONAL HOLDING LLC, POLAROID INVESTMENT LLC, POLAROID LATIN AMERICA I CORPORATION, POLAROID NEW BEDFORD REAL ESTATE LLC, POLAROID NORWOOD REAL ESTATE LLC, POLAROID WALTHAM REAL ESTATE LLC, POLAROLD HOLDING COMPANY, ZINK INCORPORATED
Assigned to POLAROID CORPORATION (F/K/A OEP IMAGING OPERATING COMPANY) reassignment POLAROID CORPORATION (F/K/A OEP IMAGING OPERATING COMPANY) U.S. BANKRUPTCY COURT DISTRICT OF DELAWARE ORDER AUTHORIZING RELEASE OF ALL LIENS Assignors: JPMORGAN CHASE BANK, N.A. (F/K/A MORGAN GUARANTY TRUST COMPANY OF NEW YORK)
Assigned to OEP IMAGING OPERATING CORPORATION reassignment OEP IMAGING OPERATING CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: POLAROID CORPORATION
Assigned to POLAROID CORPORATION (FMR OEP IMAGING OPERATING CORP.) reassignment POLAROID CORPORATION (FMR OEP IMAGING OPERATING CORP.) SUPPLEMENTAL ASSIGNMENT OF PATENTS Assignors: PRIMARY PDC, INC. (FMR POLAROID CORPORATION)
Assigned to POLAROID NORWOOD REAL ESTATE LLC, POLAROID HOLDING COMPANY, ZINK INCORPORATED, POLAROID CORPORATION, POLAROID LATIN AMERICA I CORPORATION, POLOROID INTERNATIONAL HOLDING LLC, POLAROID NEW BEDFORD REAL ESTATE LLC, POLAROID INVESTMENT LLC, PETTERS CONSUMER BRANDS INTERNATIONAL, LLC, POLAROID EYEWEAR LLC, POLAROID CAPITAL LLC, PETTERS CONSUMER BRANDS, LLC, POLAROID WALTHAM REAL ESTATE LLC, POLAROID ASIA PACIFIC LLC reassignment POLAROID NORWOOD REAL ESTATE LLC RELEASE OF SECURITY INTEREST IN PATENTS Assignors: WILMINGTON TRUST COMPANY
Assigned to POLAROID LATIN AMERICA I CORPORATION, POLAROID CORPORATION, POLAROID CAPITAL LLC, POLAROID CONSUMER ELECTRONICS INTERNATIONAL, LLC, (FORMERLY KNOWN AS PETTERS CONSUMER ELECTRONICS INTERNATIONAL, LLC), ZINK INCORPORATED, POLAROID INTERNATIONAL HOLDING LLC, POLAROID NORWOOD REAL ESTATE LLC, POLAROID WALTHAM REAL ESTATE LLC, PLLAROID EYEWEAR I LLC, POLAROID CONSUMER ELECTRONICS, LLC, (FORMERLY KNOWN AS PETTERS CONSUMER ELECTRONICS, LLC), POLAROID ASIA PACIFIC LLC, POLAROID NEW BEDFORD REAL ESTATE LLC, POLAROID INVESTMENT LLC, POLAROID HOLDING COMPANY reassignment POLAROID LATIN AMERICA I CORPORATION RELEASE OF SECURITY INTEREST IN PATENTS Assignors: JPMORGAN CHASE BANK, N.A.
Assigned to SENSHIN CAPITAL, LLC reassignment SENSHIN CAPITAL, LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: POLAROID CORPORATION
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/40Picture signal circuits
    • H04N1/40056Circuits for driving or energising particular reading heads or original illumination means
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof
    • H04N23/84Camera processing pipelines; Components thereof for processing colour signals
    • H04N23/88Camera processing pipelines; Components thereof for processing colour signals for colour balance, e.g. white-balance circuits or colour temperature control
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/46Colour picture communication systems
    • H04N1/48Picture signal generators
    • H04N1/486Picture signal generators with separate detectors, each detector being used for one specific colour component

Definitions

  • This invention relates to electronic image scanning and processing and, more particularly, to the calibration of photodetector output to compensate for intensity and color temperature variation in subject illumination by a low-cost source of illumination.
  • each set of the photodetectors in each set are arranged in adjacent rows transverse to the scanning path and in columns parallel to that path.
  • each set of the photodetectors is exposed through a filter which could represent one of the primary colors, that is, red (R), green (G), or blue (B).
  • the filters could represent the complimentary colors.
  • Color balance in the system of the aforementioned co-pending application is achieved by a combination of selecting the number of photodetector rows in each set to correspond with the sensitivity of the photodetectors to the light in the R, G and B spectral regions and by accumulating the charge developed by photodetectors in each column of each set so that the output signal for each subject image pixel is the composite output of the photodetector rows.
  • the photodetectors are most sensitive to red light and least sensitive to blue light.
  • the photodetector set exposed through the red filter will have as few as six active rows of photodetectors where as the blue set will have as many as sixteen photodetector rows.
  • each image pixel As light reflected from each image pixel scans or traverses the photodetectors in a column common to all three sets, the R, G or B spectral components in the pixel develop a charge in each photodetector underlying a filter which passes a spectral component in the pixel.
  • the photodetector charges are accumulated in each photodetector set in a manner such that each successive photodetector in a column receives the charge of a photodetector immediately preceding it in the context of scanning direction and also adds its own charge to the accumulating charge.
  • each image pixel is represented by a well developed photodetector signal capable of being processed electronically to develop a digital emulation of the subject image.
  • an exceedingly high measure of color balance is achieved simply by variation in the number of photodetectors exposed to the respective R, G and B spectral components of each subject image pixel.
  • the overall quality of data obtained by image scanning is dependent also on uniform intensity and color temperature of the source of the illumination reflected from the subject image to the photodetector sets.
  • a low-cost tungsten halogen bulb powered by line voltage for example, is used as the source of image scanning illumination
  • the intensity of light reflected from the subject image to the photodetectors will vary with normally incurred line voltage variations including the sixty cycle ripple associated with line voltage.
  • the color temperature of such a light source is unstable particularly during the period immediately after the lamp is turned on. Quite obviously, the signals generated by the photodetectors exposed to such a light source will vary with the voltage variation induced intensity of the light, and with color temperature variation where photodetector signal strength is predicated on response to a limited spectrum of the reflected light.
  • a linear detector array provided for reading the document or subject image includes a detector in the path of light reflected from reference indicia and associated with an exposure meter circuit.
  • the photodetector array When light reflected from a given line of image pixels is read by the photodetector array, the quantity of light read by the exposure meter associated detector is integrated and stored in a manner to control the exposure of the image sensing photodetectors in the next line of pixels.
  • This system operates in the manner of an electronic shutter by which the time during which the detectors are exposed to light reflected from the subject image is controlled by the exposure meter circuit.
  • the resolution requirements for reproducing a subject image represented by a color photograph require a photodetector cell density of a magnitude making it extremely difficult to accommodate circuity associated with electronic shutter operation.
  • the attainment of digital data capable of reproducing a high resolution subject image, such as a color photograph requires that photodetector cell calibration be accomplished on a real time basis, that is, so that the photodetector cells in each row scanned by the subject image are calibrated on the basis of light to which they are actually exposed.
  • a system for calibrating the output of image scanning photodetector cells to compensate for variations in light emanating from a low-cost light source, on a real time basis, and in a manner enabling the use of a sufficiently dense pattern of cells to obtain a high resolution digital replica of an image exemplified by a color photograph.
  • the image scanner employs an accumulating charge transfer arrangement of photodetector rows, the first few cells in each photodetector row are exposed to illumination reflected from a white reference patch in a manner so that any variation of charge produced by those cells from an arbitrary normal value is used as a calibration factor for the image light scanned cells in the same row.
  • the invention is practiced by serially transferring the charge signals of each photodetector row to a multiplying processor.
  • the signals resulting from exposure of the first few photodetector cells in a row to the white reference sample are multiplied by 1 and the value compared with a constant reference value.
  • the constant reference value is divided by the incoming white reference signal value to achieve a calibration factor.
  • the signals developed by photodetector cells in the same row but scanned by subject image pixels are fed to the processor, they are multiplied by the calibration factor to correct for exposure light intensity variations from that represented by the constant reference value.
  • a photodetector array which includes sets of photodetector rows and transfer circuitry for accumulating the cell charges developed by the image illumination scan the provision of white reference patch reading cells in each row of a set results in an accumulation of white reference charges corresponding directly to the accumulated charges of image pixel reading cells.
  • a filter passing light of a limited spectral region such as red, green or blue light
  • variations in illumination color temperature will be accounted for as variations in intensity at each row of photodetector cells.
  • a principal object of the present invention is, therefore, the provision of an improved calibration system and method by which the output of a photodetector array scanned by imaging illumination originating in a low-cost and variable light source may be corrected in real time to obtain data quality commensurate with precisely uniform illumination sources.
  • Another object of the present invention is to provide such a calibration system and method which enables the use of a dense pattern of photodetectors consistent with providing digital data replicas of high resolution color photographs.
  • Still another object of the present invention is to provide a photodetector calibration system and method suitable for use with color balanced image scanning photodetector sets in which each of multiple sets includes a variable number of photodetectors depending on photodetector sensitivity to differing spectral regions of light.
  • FIG. 1 is a schematic side elevation of components used in an image scanner with which the present invention is particularly suited for use;
  • FIG. 2 is a schematic plan view of the optical system employed in the apparatus of FIG. 1;
  • FIG. 3 is a front elevation depicting the physical arrangement of photodetector sets used in the image scanning device of FIG. 1;
  • FIG. 4 is a fragmentary schematic view depicting operation of the photodetector array employed by the present invention.
  • FIGS. 5A and 5B are block diagrams representing identical components but in different states of operation.
  • an image scanning apparatus is generally designated by the reference numeral 10 and shown to include components substantially identical to those disclosed in the afore-mentioned co-pending U.S. patent application Ser. No. 328,314. While the system 10 is substantially fully disclosed in the afore-mentioned co-pending application, the general organization and operation of the system is worth repeating here in the interest of a full understanding of the calibration system of the present invention.
  • the scanning system 10 is shown to include a bed 12 on which a subject 14 is placed for engagement by a rotatable drum 16 driven by a stepping motor 18.
  • the subject 14 passes between the periphery of the drum 16 and a pair of pressure rollers 20 in a manner to attain a secure frictional engagement of the subject 14 between the drum 16 and the rollers 20.
  • a source of illumination represented by a tungsten halogen tube 22 positioned within a focusing reflector 24, develops a path of illumination from the bulb 22 to the section of the drum periphery located between the pressure rollers 20 with the aid of a mirror 26 and a polarizer 28.
  • Illumination reflected from the same peripheral region of the drum 16 is folded by mirrors 30 and 32 and passed to a focusing lens 34 through a second polarizer 36. Illumination focused by the lens 34 is passed to a photo detector array 38 to be described in more detail below.
  • the system includes an electronic timing device 40 such as a clock generator which outputs to the stepper motor 18 and to a driver 42 for the photodetector array 38 to synchronize operation of the motor and the photodetector array 38 in a manner to be described in more detail below.
  • Output from the photodetector array 38 is digitized by way of an analog to digital (A/D) converter 43 and then fed to a processor 44 and ultimately to a display 46, again in a manner to be described in more detail below.
  • A/D analog to digital
  • the folded path of illumination from the bulb 22 to the photodetector array 38 is generally depicted in the plan view of FIG. 2 of the drawings.
  • the illustrated illumination path represents a departure from the illumination path of the image scanning system disclosed in the afore-mentioned co-pending application in that, in addition to light reflected from the image on the subject 14 as it passes over the drum 16, illumination is also reflected from a white reference patch 48 which may be represented in practice by a stationary white patch of dimensions corresponding to the width of the illumination scan at the periphery of the drum 16 but located on the housing (not shown) which supports the drum 16 for rotation.
  • the white reference patch 48 may take other physical forms such as a white band on the edge of the drum 16 adjacent to the position of the drum occupied by the subject 14 or it may be represented by a white border along one longitudinal edge of the subject 14. Regardless of the specific physical form taken by the white reference patch 14, it represents a reference patch of white light by which illumination originating with the bulb 22 is reflected through the lens 34 and focused along one edge of the photodetector array 38 simultaneously with light reflected from the image on the subject 14.
  • FIG. 3 of the drawings the physical organization of the photodetector array 38 is depicted in relation to a single row of pixels reflected from the subject 14 and the white patch 48. It should be noted with respect to FIG. 3 that while the pixels are shown as arranged on a single line, the image elements or pixels on the subject, as well as in the reflected light image of the subject forwarded by the lens 34, are randomly distributed in accordance with the image information they represent. On the other hand, because of the geometry of the photodetector cells in the array 38, the pixels are resolved into a series of adjacent linear rows not unlike the single row illustrated in FIG. 3.
  • the photodetector array 38 is similar to that disclosed in the afore-mentioned co-pending application in that it is comprised of three photodetector sets or circuit modules 50, 52 and 54. Each module contains sixteen rows 56 of photodetector cells, the rows being oriented transverse to the direction of image scan as represented by the arrow 58. The individual cells in the rows 56 are also arranged to be aligned as columns which extend parallel to the direction of image scan. Although not illustrated in FIG. 3 of the drawings, each of the modules 50, 52 and 54 is covered by a filter (not shown) corresponding to the basic red, green and blue spectral regions of visible light.
  • the module 50 includes a red filter which covers all of the active cells thereof whereas the module 52 is exposed through a green filter and the module 54 through a blue filter. Because the photodetector cells are most sensitive to red light and least sensitive to blue light, the red module 50 is covered with a mask 60 leaving only six active rows 56 of photodetector cells. In the blue module 54, all sixteen rows 56 are active whereas in the green module 52, a mask 61 is again incorporated to expose only twelve active rows 56 of photodetector cells.
  • the first two columns of photodetector cells in each module 50, 52 and 54 are stippled to delineate them from the other columns of photodetector cells. While the stippled cells are identical in all respects to the other cells, they are delineated because they are exposed to light reflected from the white reference patch 48 whereas the other cells are exposed to light reflected from the subject 14. While the first two cells are shown as reserved for exposure by light reflected from the white patch 48, it is contemplated that as many as 20 columns of pixels may be used for this purpose. Also in FIG. 3, the final row 57 in each module 50, 52 and 54 is delineated by cross-hatching and while comprising the same cells as the rows 56, is provided with circuitry to be described and by which it functions as a shift register.
  • each of the modules 50, 52 and 54 is identically constructed.
  • the subject 14 is shown as having an arbitrary shape extending from one linear edge 14e and further includes two rows of two pixels each.
  • the pixels are presented as little circles identified by the legends A1,A2 in the first row, and B1,B2 in the second row.
  • a single reference pixel (REF) is shown as aligned with the row A1,A2 of image pixels and is presented in the light image to which the modules 50, 52 and 54 are exposed by the same linear increment of light as the image pixels in that row.
  • the white reference patch 48 from which the reference pixel emanates may remain stationary while the subject 14 is moved in the scanning path represented by the arrow 58, the linear increment of light reflecting a specific individual row of image pixels will also reflect the reference pixel.
  • the rows 56 of the photodetector cells in each module 50, 52 and 54 are embodied as registers.
  • sixteen of the registers are employed in each module with each register having two thousand forty-eight cells capable of light detection.
  • a shift register 57 is employed at the trailing end of each module for extracting signal samples obtained from the detection of light by cells of the respective modules. The signal samples are obtained from a plurality of the other sixteen registers 56.
  • the illustration of the circuit module in FIG. 4 contains a total of only three registers 56, each of which has only three cells.
  • the cells are identified by the legends J1, J2 and JR; in the next register 56 the cells are identified by the legends K1, K2 and KR; and in the following register the cells are identified by the legends L1, L2 and LR.
  • These three registers are employed for the detection of light.
  • the last of the registers 57 at the bottom of the array of FIG. 4 has cells identified by the legends S1-S3 and is employed for extracting signal samples from the module.
  • Also included within the circuit module is a set of gates 62, 64, 66 and 68 which are driven by the gate driver 42.
  • An amplifier 70 is connected to the output terminal of the shift register 57 for applying signals put out by the shift register 57 to the signal processor 44.
  • the gate 62 applies a signal via a line 74 to activate an electrode assembly (not shown) in each of the cells J1, J2, JR to render these cells responsive to incident light for detecting the light during a sampling interval of time designed by an electric pulse signal on the line 74.
  • the gate 64 applies a sample pulse signal via a line 76 to activate the corresponding electrode structures (not shown) of the cells K1, K2 and KR, and the gate 66 similarly applies, via a line 78, an electric pulse signal to the electrode structures of the cells L1, L2 and LR to initiate sampling of the incident light by the cells.
  • Circuitry of the gate 62 also extends between the first two registers 56 for transferring charge between a first cell in each column to a second cell in each column.
  • circuitry of the gate 64 and of the gate 66 provides for further transfer of the charges among the cells of the individual columns, namely, successive transfers of charge among the cells K1-L1-SI, K2-L2-S2, and KR-LR-S3. Circuits of the gates 62, 64, 66 and 68 are activated by the driver 42 in response to signals of the timing unit 40.
  • the array of charge-coupled devices or cells of the four registers 56, in conjunction with the circuits of the gates 62, 64, 66 and 68 operate in accordance with a gating procedure known as a three-phase gating operation.
  • the pixel Al reflects light of the lamp 22 to be detected by the cell J1 of the charge-coupled device of the register 56.
  • the cell J1 produces an electric charge proportional to the reflectivity of light from the pixel Al.
  • the resulting charge produced in the cell J1 is transferred by the gate 62 to the cell K1.
  • the driver 70 activates circuitry of the gate 64 to energize the electrodes structure of all of the cells of the second register 56, thus enabling the cell K1 to sample the light from the pixel A1.
  • the cell J1 is being activated to sample light of the pixel B1. Therefore, the sum of charges appearing in cell L1 at the conclusion of three sampling intervals of the pixel A1 is succeeded in next sampling interval with a sum of the charges from the sampling of the pixel B1. Similar comments apply to the summation of pixel signals via the columns J2-K2-L2 and JR-KR-LR.
  • the resultant accumulated charges are transferred by the gate 66 to the corresponding cells S1-S3 of the shift register 57.
  • the gate 68 is activated by the driver 42 in response to timing signals from the timing unit 40 to strobe the cells S1-S3 to shift the charges through the register 57 and via the amplifier 70 to the signal processor 44.
  • the accumulated charge in cell S3 is transferred out by the amplifier 70, the accumulated charge in the cell S2 is transferred into the cell S3, and the accumulated charge of the cell S1 is transferred into the cell S2.
  • Subsequent transfers allow the various quantities of charge to move sequentially through the cells of the shift register 57 to the converter 43 and processor 44 for subsequent use in forming the image at the display 46.
  • the charges of the shift register 57 are cleared out completely prior to the next sampling interval, so as to be ready to receive charges from the next row of pixels.
  • FIGS. 5A and 5B of the drawings illustrate in block diagram form, the processor 44, an output lookup table 80, a calibration lookup table 82 and a calibration factor storage unit 84.
  • FIGS. 5a and 5b respectfully, are identical with the exception of the arrow lines 86 and 88 which, when present, indicate the passage of information between the components which they connect during different states of processor operation.
  • the processor 44 may be considered simply as a multiplier by which data input to a port A is multiplied by a value at the port B so that the output of the processor is the product of the two input factors or A ⁇ B.
  • the processor is conditioned to receive the signals originating with each set of photodetector cells exposed to light reflected from the white reference sample 48.
  • port B is fixed at a default setting of unity or one.
  • the signal strength of the white reference data is processed and assigned a calibration value (X) corresponding to the signal strength input to the port A but selected to lie in a range from a numerical value of less than one and greater than zero.
  • the product of white reference raw data signals thus derived are output from the processor and sent to the lookup table 82 at which the reciprocal of the numerical value X of the white reference signal strength value is derived and sent to the calibration storage unit 84.
  • the operational state of the circuitry is then shifted to the condition depicted in FIG. 5B of the drawings as the signals input to the port A of the processor 44 shift to the signals developed by photodetector cells in the same set but exposed to image pixels.
  • the calibration factors previously computed and stored in the unit 84 are input to port B.
  • the processor 44 now multiplies the signals sequenced into the port A by the calibration factor 1/X and outputs the corrected signal values for presentation of a replica of the subject image 14 at the display 46. This cycle is repeated for each sequence of signals generated by the exposure of each set of photodetector cell rows or registers as they are scanned by a line of pixels reflected from the respective white reference patch 48 and the subject image 14.

Abstract

A system and method for calibrating signals provided by individual cells in a photodetector array scanned by light originating at a low-cost variable light source and reflected from a subject to be replicated in digital form by processing photodetector cell signals in a manner so that individual cell signals are corrected to compensate for fluctuations in source light. The system and method is particularly applicable to a color balanced photodetector array in which individual photodetectors are arranged in sets with each set having a variable number of rows oriented in a direction transverse to the direction of scan and columns parallel to the direction of scan. The invention is practiced by exposing the first few photodetectors in each row to the full spectrum of visible light reflected from a white reference patch. During processing, as the photodetector signals are sequentially transferred, to a processor, the signals provided by the cells exposed to the white reference are compared with a fixed value to obtain a calibration factor. As the signals develop by cells in the same set but as a result of exposure to light reflected from the subject image, those signals are multiplied by the calibration factor so that the process signals are corrected for variations in source light on a real time basis.

Description

BACKGROUND OF THE INVENTION
This invention relates to electronic image scanning and processing and, more particularly, to the calibration of photodetector output to compensate for intensity and color temperature variation in subject illumination by a low-cost source of illumination.
In a commonly assigned, co-pending U.S. patent application entitled "COLOR BALANCED IMAGE DETECTOR SYSTEM", Ser. No. 328,314, filed Mar. 13, 1989, there is disclosed a color balanced imaging system in which plural (e.g. 3) sets of photodetectors are exposed to a light image reflected from a subject, which may be represented by a color photograph, for example, in a manner to achieve a high resolution, accurate color rendition of the image in digital form. The photodetector sets are exposed by scanning the subject image with white light so that light reflected from a given picture element or "pixel" in the subject image will impinge each individual photodetector located in the scanning path. To this end, the photodetectors in each set are arranged in adjacent rows transverse to the scanning path and in columns parallel to that path. Where the subject reflects only light in the visible spectrum, each set of the photodetectors is exposed through a filter which could represent one of the primary colors, that is, red (R), green (G), or blue (B). Alternatively, the filters could represent the complimentary colors.
Color balance in the system of the aforementioned co-pending application is achieved by a combination of selecting the number of photodetector rows in each set to correspond with the sensitivity of the photodetectors to the light in the R, G and B spectral regions and by accumulating the charge developed by photodetectors in each column of each set so that the output signal for each subject image pixel is the composite output of the photodetector rows. For example, the photodetectors are most sensitive to red light and least sensitive to blue light. Thus, the photodetector set exposed through the red filter will have as few as six active rows of photodetectors where as the blue set will have as many as sixteen photodetector rows. As light reflected from each image pixel scans or traverses the photodetectors in a column common to all three sets, the R, G or B spectral components in the pixel develop a charge in each photodetector underlying a filter which passes a spectral component in the pixel. The photodetector charges are accumulated in each photodetector set in a manner such that each successive photodetector in a column receives the charge of a photodetector immediately preceding it in the context of scanning direction and also adds its own charge to the accumulating charge. As a result of the accumulation of charges, each image pixel is represented by a well developed photodetector signal capable of being processed electronically to develop a digital emulation of the subject image. Moreover, an exceedingly high measure of color balance is achieved simply by variation in the number of photodetectors exposed to the respective R, G and B spectral components of each subject image pixel.
While the afore-mentioned scanning system represents a major advance in the attainment of data accurate with respect to color balance, the overall quality of data obtained by image scanning is dependent also on uniform intensity and color temperature of the source of the illumination reflected from the subject image to the photodetector sets. If a low-cost tungsten halogen bulb powered by line voltage, for example, is used as the source of image scanning illumination, the intensity of light reflected from the subject image to the photodetectors will vary with normally incurred line voltage variations including the sixty cycle ripple associated with line voltage. Also, the color temperature of such a light source is unstable particularly during the period immediately after the lamp is turned on. Quite obviously, the signals generated by the photodetectors exposed to such a light source will vary with the voltage variation induced intensity of the light, and with color temperature variation where photodetector signal strength is predicated on response to a limited spectrum of the reflected light.
The problems associated with intensity and color temperature variation in low-cost light sources for image scanning applications have been addressed in the prior art. For example, U.S. Pat. No. 4,174,528 and the prior art cited therein as background art teach the use of a white reference image or patch in the light path between the light source and a photodetector array for the purpose of calibrating the output of the array to compensate for variations in exposure light intensity and color temperature. In many of the prior art disclosures, the white reference patch is exposed to the photodetectors only at the beginning of an image scan. It is obvious that this approach to photodetector calibration is effective only in a very general way and would not account for cyclical variations in light intensity variations which occur during the scan of a single subject image. The disclosure of U.S. Pat. No. 4,174,528, on the other hand, approaches a scanner calibration procedure by which photodetector calibration is accomplished on a line-by-line basis. Specifically, a linear detector array provided for reading the document or subject image includes a detector in the path of light reflected from reference indicia and associated with an exposure meter circuit. When light reflected from a given line of image pixels is read by the photodetector array, the quantity of light read by the exposure meter associated detector is integrated and stored in a manner to control the exposure of the image sensing photodetectors in the next line of pixels. This system operates in the manner of an electronic shutter by which the time during which the detectors are exposed to light reflected from the subject image is controlled by the exposure meter circuit.
From the standpoint of adapting the exposure control arrangement of the afore-mentioned U.S. Pat. No. 4,174,528 to the system described with reference to the afore-mentioned co-pending patent application in which the charges developed by individual rows of photodetector cells are accumulated to achieve color balance, several problems arise. For example, where the photodetector cell charges are accumulated in successive rows, it is essential that the rate of photodetector charge transfer is identical to the rate of image pixel scan. Although it might be possible to vary the rate of scan to accommodate a variable exposure time interval for each row of photodetectors, the costs of doing so are likely to be greater than the costs of a non-variable light source. Also the resolution requirements for reproducing a subject image represented by a color photograph, for example, require a photodetector cell density of a magnitude making it extremely difficult to accommodate circuity associated with electronic shutter operation. Finally, the attainment of digital data capable of reproducing a high resolution subject image, such as a color photograph, requires that photodetector cell calibration be accomplished on a real time basis, that is, so that the photodetector cells in each row scanned by the subject image are calibrated on the basis of light to which they are actually exposed.
In light of the foregoing, it will be seen that there is a need for an effective photodetector calibration system for the color balanced scanning technique of the type in which photodetector output is the result of the transfer and accumulation of successive cell charges.
SUMMARY OF THE INVENTION
In accordance with the present invention, a system is provided for calibrating the output of image scanning photodetector cells to compensate for variations in light emanating from a low-cost light source, on a real time basis, and in a manner enabling the use of a sufficiently dense pattern of cells to obtain a high resolution digital replica of an image exemplified by a color photograph. Where the image scanner employs an accumulating charge transfer arrangement of photodetector rows, the first few cells in each photodetector row are exposed to illumination reflected from a white reference patch in a manner so that any variation of charge produced by those cells from an arbitrary normal value is used as a calibration factor for the image light scanned cells in the same row.
The invention is practiced by serially transferring the charge signals of each photodetector row to a multiplying processor. The signals resulting from exposure of the first few photodetector cells in a row to the white reference sample are multiplied by 1 and the value compared with a constant reference value. The constant reference value is divided by the incoming white reference signal value to achieve a calibration factor. As the signals developed by photodetector cells in the same row but scanned by subject image pixels are fed to the processor, they are multiplied by the calibration factor to correct for exposure light intensity variations from that represented by the constant reference value.
In a photodetector array which includes sets of photodetector rows and transfer circuitry for accumulating the cell charges developed by the image illumination scan the provision of white reference patch reading cells in each row of a set results in an accumulation of white reference charges corresponding directly to the accumulated charges of image pixel reading cells. When the set is exposed through a filter passing light of a limited spectral region, such as red, green or blue light, variations in illumination color temperature will be accounted for as variations in intensity at each row of photodetector cells. Because the calibration for light intensity variation is performed on the raw signal data transferred from the photodetectors and because all photodetector cells in each row, including cells reading image pixels and cells reading the white reference patch, are exposed by the same line increment of illumination, variations in that line increment of illumination caused by fluctuations at the light source may be measured and corrected in real time for each line of photodetectors scanned.
A principal object of the present invention is, therefore, the provision of an improved calibration system and method by which the output of a photodetector array scanned by imaging illumination originating in a low-cost and variable light source may be corrected in real time to obtain data quality commensurate with precisely uniform illumination sources. Another object of the present invention is to provide such a calibration system and method which enables the use of a dense pattern of photodetectors consistent with providing digital data replicas of high resolution color photographs. Still another object of the present invention is to provide a photodetector calibration system and method suitable for use with color balanced image scanning photodetector sets in which each of multiple sets includes a variable number of photodetectors depending on photodetector sensitivity to differing spectral regions of light. Other objects and further scope of applicability of the present invention will become apparent from the detailed description to follow taken in conjunction with the accompanying drawings in which like parts are designated by like reference numerals.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a schematic side elevation of components used in an image scanner with which the present invention is particularly suited for use;
FIG. 2 is a schematic plan view of the optical system employed in the apparatus of FIG. 1;
FIG. 3 is a front elevation depicting the physical arrangement of photodetector sets used in the image scanning device of FIG. 1;
FIG. 4 is a fragmentary schematic view depicting operation of the photodetector array employed by the present invention;
FIGS. 5A and 5B are block diagrams representing identical components but in different states of operation.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT
In FIGS. 1 and 2 of the drawings, an image scanning apparatus is generally designated by the reference numeral 10 and shown to include components substantially identical to those disclosed in the afore-mentioned co-pending U.S. patent application Ser. No. 328,314. While the system 10 is substantially fully disclosed in the afore-mentioned co-pending application, the general organization and operation of the system is worth repeating here in the interest of a full understanding of the calibration system of the present invention.
Thus, in FIG. 1, the scanning system 10 is shown to include a bed 12 on which a subject 14 is placed for engagement by a rotatable drum 16 driven by a stepping motor 18. The subject 14 passes between the periphery of the drum 16 and a pair of pressure rollers 20 in a manner to attain a secure frictional engagement of the subject 14 between the drum 16 and the rollers 20. A source of illumination, represented by a tungsten halogen tube 22 positioned within a focusing reflector 24, develops a path of illumination from the bulb 22 to the section of the drum periphery located between the pressure rollers 20 with the aid of a mirror 26 and a polarizer 28. Illumination reflected from the same peripheral region of the drum 16 is folded by mirrors 30 and 32 and passed to a focusing lens 34 through a second polarizer 36. Illumination focused by the lens 34 is passed to a photo detector array 38 to be described in more detail below. As depicted in block diagram form in FIG. 1, the system includes an electronic timing device 40 such as a clock generator which outputs to the stepper motor 18 and to a driver 42 for the photodetector array 38 to synchronize operation of the motor and the photodetector array 38 in a manner to be described in more detail below. Output from the photodetector array 38 is digitized by way of an analog to digital (A/D) converter 43 and then fed to a processor 44 and ultimately to a display 46, again in a manner to be described in more detail below.
The folded path of illumination from the bulb 22 to the photodetector array 38 is generally depicted in the plan view of FIG. 2 of the drawings. The illustrated illumination path represents a departure from the illumination path of the image scanning system disclosed in the afore-mentioned co-pending application in that, in addition to light reflected from the image on the subject 14 as it passes over the drum 16, illumination is also reflected from a white reference patch 48 which may be represented in practice by a stationary white patch of dimensions corresponding to the width of the illumination scan at the periphery of the drum 16 but located on the housing (not shown) which supports the drum 16 for rotation. The white reference patch 48 may take other physical forms such as a white band on the edge of the drum 16 adjacent to the position of the drum occupied by the subject 14 or it may be represented by a white border along one longitudinal edge of the subject 14. Regardless of the specific physical form taken by the white reference patch 14, it represents a reference patch of white light by which illumination originating with the bulb 22 is reflected through the lens 34 and focused along one edge of the photodetector array 38 simultaneously with light reflected from the image on the subject 14.
In FIG. 3 of the drawings, the physical organization of the photodetector array 38 is depicted in relation to a single row of pixels reflected from the subject 14 and the white patch 48. It should be noted with respect to FIG. 3 that while the pixels are shown as arranged on a single line, the image elements or pixels on the subject, as well as in the reflected light image of the subject forwarded by the lens 34, are randomly distributed in accordance with the image information they represent. On the other hand, because of the geometry of the photodetector cells in the array 38, the pixels are resolved into a series of adjacent linear rows not unlike the single row illustrated in FIG. 3.
The photodetector array 38 is similar to that disclosed in the afore-mentioned co-pending application in that it is comprised of three photodetector sets or circuit modules 50, 52 and 54. Each module contains sixteen rows 56 of photodetector cells, the rows being oriented transverse to the direction of image scan as represented by the arrow 58. The individual cells in the rows 56 are also arranged to be aligned as columns which extend parallel to the direction of image scan. Although not illustrated in FIG. 3 of the drawings, each of the modules 50, 52 and 54 is covered by a filter (not shown) corresponding to the basic red, green and blue spectral regions of visible light. Specifically, the module 50 includes a red filter which covers all of the active cells thereof whereas the module 52 is exposed through a green filter and the module 54 through a blue filter. Because the photodetector cells are most sensitive to red light and least sensitive to blue light, the red module 50 is covered with a mask 60 leaving only six active rows 56 of photodetector cells. In the blue module 54, all sixteen rows 56 are active whereas in the green module 52, a mask 61 is again incorporated to expose only twelve active rows 56 of photodetector cells.
In the illustration of FIG. 3, the first two columns of photodetector cells in each module 50, 52 and 54 are stippled to delineate them from the other columns of photodetector cells. While the stippled cells are identical in all respects to the other cells, they are delineated because they are exposed to light reflected from the white reference patch 48 whereas the other cells are exposed to light reflected from the subject 14. While the first two cells are shown as reserved for exposure by light reflected from the white patch 48, it is contemplated that as many as 20 columns of pixels may be used for this purpose. Also in FIG. 3, the final row 57 in each module 50, 52 and 54 is delineated by cross-hatching and while comprising the same cells as the rows 56, is provided with circuitry to be described and by which it functions as a shift register.
The basic operation and circuity of the photodetector sets or modules 50, 52 and 54 may be appreciated by reference to FIG. 4 in which a vastly enlarged fragment of three detector rows 56 and a shift register 57 are shown. With the exception of the color filter associated with each module and the masks 60 and 61 of the modules 50 and 52, each of the modules 50, 52 and 54 is identically constructed.
In FIG. 4, the subject 14 is shown as having an arbitrary shape extending from one linear edge 14e and further includes two rows of two pixels each. The pixels are presented as little circles identified by the legends A1,A2 in the first row, and B1,B2 in the second row. A single reference pixel (REF) is shown as aligned with the row A1,A2 of image pixels and is presented in the light image to which the modules 50, 52 and 54 are exposed by the same linear increment of light as the image pixels in that row. In this respect, while the white reference patch 48 from which the reference pixel emanates may remain stationary while the subject 14 is moved in the scanning path represented by the arrow 58, the linear increment of light reflecting a specific individual row of image pixels will also reflect the reference pixel.
In an electronic circuit context, the rows 56 of the photodetector cells in each module 50, 52 and 54 are embodied as registers. In a preferred embodiment, sixteen of the registers are employed in each module with each register having two thousand forty-eight cells capable of light detection. As indicated, a shift register 57 is employed at the trailing end of each module for extracting signal samples obtained from the detection of light by cells of the respective modules. The signal samples are obtained from a plurality of the other sixteen registers 56.
By way of example and in the interest of simplicity, the illustration of the circuit module in FIG. 4 contains a total of only three registers 56, each of which has only three cells. In the uppermost register 56, the cells are identified by the legends J1, J2 and JR; in the next register 56 the cells are identified by the legends K1, K2 and KR; and in the following register the cells are identified by the legends L1, L2 and LR. These three registers are employed for the detection of light. The last of the registers 57 at the bottom of the array of FIG. 4, has cells identified by the legends S1-S3 and is employed for extracting signal samples from the module. Also included within the circuit module is a set of gates 62, 64, 66 and 68 which are driven by the gate driver 42. An amplifier 70 is connected to the output terminal of the shift register 57 for applying signals put out by the shift register 57 to the signal processor 44.
In operation, the gate 62 applies a signal via a line 74 to activate an electrode assembly (not shown) in each of the cells J1, J2, JR to render these cells responsive to incident light for detecting the light during a sampling interval of time designed by an electric pulse signal on the line 74. Similarly, the gate 64 applies a sample pulse signal via a line 76 to activate the corresponding electrode structures (not shown) of the cells K1, K2 and KR, and the gate 66 similarly applies, via a line 78, an electric pulse signal to the electrode structures of the cells L1, L2 and LR to initiate sampling of the incident light by the cells. Circuitry of the gate 62 also extends between the first two registers 56 for transferring charge between a first cell in each column to a second cell in each column. Thus upon activation of circuitry within the gate 62, a charge in the cell J1 is transferred into the cell K1, a charge in the cell J2 is transferred to the cell K2 and a charge in the cell JR is transferred to the cell KR. In a similar fashion, circuitry of the gate 64 and of the gate 66 provides for further transfer of the charges among the cells of the individual columns, namely, successive transfers of charge among the cells K1-L1-SI, K2-L2-S2, and KR-LR-S3. Circuits of the gates 62, 64, 66 and 68 are activated by the driver 42 in response to signals of the timing unit 40. The array of charge-coupled devices or cells of the four registers 56, in conjunction with the circuits of the gates 62, 64, 66 and 68 operate in accordance with a gating procedure known as a three-phase gating operation.
The aspect of summation for integration of the signals obtained from each pixel of the subject for forming the corresponding pixel of the image may be explained with reference to FIG. 4. Consider the pixel A1 in the subject 14. During an early part of the scan, the pixel Al reflects light of the lamp 22 to be detected by the cell J1 of the charge-coupled device of the register 56. The cell J1 produces an electric charge proportional to the reflectivity of light from the pixel Al. The resulting charge produced in the cell J1 is transferred by the gate 62 to the cell K1. Subsequently, as the scanning motion of the rays of light continue, rays of light from the pixel Al impinge upon the cell K1. At this point in time, the driver 70 activates circuitry of the gate 64 to energize the electrodes structure of all of the cells of the second register 56, thus enabling the cell K1 to sample the light from the pixel A1.
Upon a sampling of light of pixel A1 by cell K1, additional charge is produced by the cell K1. The total charge now present in the cell K1 is equal to the sum of the charges produced by the detection operations of cells J1 and K1. Thereafter, the gate 64 transfers the charge from K1 to the cell L1, this being followed by a further sampling of light of the pixel A1 with the further production of charge to produce a total charge accumulation in the cell L1 equal to the sum of the charges produced by the detection of light from the pixel A1 by the cells J1, K1 and L1.
At the time when the cell K1 is being activated to sample light of the pixel A1, the cell J1 is being activated to sample light of the pixel B1. Therefore, the sum of charges appearing in cell L1 at the conclusion of three sampling intervals of the pixel A1 is succeeded in next sampling interval with a sum of the charges from the sampling of the pixel B1. Similar comments apply to the summation of pixel signals via the columns J2-K2-L2 and JR-KR-LR. At the conclusion of the sampling of the respective rows of pixels by the third register 56, the resultant accumulated charges are transferred by the gate 66 to the corresponding cells S1-S3 of the shift register 57. Thereupon, the gate 68 is activated by the driver 42 in response to timing signals from the timing unit 40 to strobe the cells S1-S3 to shift the charges through the register 57 and via the amplifier 70 to the signal processor 44. Thus, the accumulated charge in cell S3 is transferred out by the amplifier 70, the accumulated charge in the cell S2 is transferred into the cell S3, and the accumulated charge of the cell S1 is transferred into the cell S2. Subsequent transfers allow the various quantities of charge to move sequentially through the cells of the shift register 57 to the converter 43 and processor 44 for subsequent use in forming the image at the display 46. The charges of the shift register 57 are cleared out completely prior to the next sampling interval, so as to be ready to receive charges from the next row of pixels.
From the foregoing description of the photodetector sets or module 50, 52 and 54 in the array 38 and associated circuitry, it will be appreciated that as each set of rows or registers 56 of photodetector cells is scanned by light reflected from the subject 14 and the white reference patch 48, digital signals corresponding to the pixels in each row will be sent to the processor 44 sequentially. Moreover, because the first two or more cells in each row 56 represent signals developed by light reflected from the white reference patch 48, the individual signals developed in the cells exposed to the white reference patch will precede the signals developed by cells exposed to the image of the subject 14. The manner in which this sequence of signal transfer from the photodetector array 38 to the processor 44 is used to correct for variations in illumination originating with the lamp 22 from a preestablished normal or reference value may be understood by reference to FIGS. 5A and 5B of the drawings. These figures illustrate in block diagram form, the processor 44, an output lookup table 80, a calibration lookup table 82 and a calibration factor storage unit 84. The block diagram illustrations in FIGS. 5a and 5b, respectfully, are identical with the exception of the arrow lines 86 and 88 which, when present, indicate the passage of information between the components which they connect during different states of processor operation. Also for purposes of facilitating an understanding of the present invention, the processor 44 may be considered simply as a multiplier by which data input to a port A is multiplied by a value at the port B so that the output of the processor is the product of the two input factors or A×B.
In FIG. 5A, the processor is conditioned to receive the signals originating with each set of photodetector cells exposed to light reflected from the white reference sample 48. At the time these signals are input to the port A of the processor 44, port B is fixed at a default setting of unity or one. The signal strength of the white reference data is processed and assigned a calibration value (X) corresponding to the signal strength input to the port A but selected to lie in a range from a numerical value of less than one and greater than zero. The product of white reference raw data signals thus derived are output from the processor and sent to the lookup table 82 at which the reciprocal of the numerical value X of the white reference signal strength value is derived and sent to the calibration storage unit 84. The operational state of the circuitry is then shifted to the condition depicted in FIG. 5B of the drawings as the signals input to the port A of the processor 44 shift to the signals developed by photodetector cells in the same set but exposed to image pixels. At the same time, the calibration factors previously computed and stored in the unit 84 are input to port B. The processor 44 now multiplies the signals sequenced into the port A by the calibration factor 1/X and outputs the corrected signal values for presentation of a replica of the subject image 14 at the display 46. This cycle is repeated for each sequence of signals generated by the exposure of each set of photodetector cell rows or registers as they are scanned by a line of pixels reflected from the respective white reference patch 48 and the subject image 14.
It will be apparent from the described operation of components represented in FIGS. 5A and 5B that any variation in the intensity of light emanating from the source 22 and to which any one of the photodetector cell registers 56 is exposed, will be accounted for by the contribution to processing calibration of signals developed by that row. Moreover, because the cells exposed by reflection of light from the white reference patch are exposed through the same R, G or B filter through which the image reading cells in the same row are exposed, any fluctuation in color temperature at the light source 22 will be detected and corrected for as a variation in intensity of light at the respective R, G and B wavelengths.
Thus it will be appreciated that as a result of the present invention, the highly effective calibration system and method is provided for color image scanning systems and by which the stated objectives, among others, are fully realized. Also, it will be apparent to those skilled in the art from the preceding description and accompanying drawings that modifications and/or changes may be made in the described embodiment without departure from the invention. Accordingly, it is expressly intended that the foregoing description and accompanying drawing illustrations are illustrative of a preferred embodiment only, not limiting, and that the true spirit and scope of the present invention be determined b reference to the appended claims.

Claims (10)

I claim:
1. In an image scanning system having a light source and a plurality of photodetector cells arranged in at least one set comprising an othogonal pattern of plural rows and columns, means for scanning said photodetector cells with image light originating at said light source and reflected from a subject in a direction transverse to said rows, and means for operating said cells so that each row is exposed to a linear increment of said image light the improvement comprising:
means for exposing at least the first cell in each row to the full spectrum of light emanating from said light source;
means for summing signals provided by said photodetector cells in each column of each set to provide column signals in an ordered sequence from a first of said columns to a last of said columns;
means for processing at least said first column signal to obtain a calibration factor representing variation of light value emanating from said light source from a fixed value for said one set of photodetector cells; and
means for multiplying each column signal provided for each column of said one set of photodetector cells succeeding said at least first column signal by said calibration factor.
2. The image scanning system of claim 1, wherein the number of photodetector cells in each row is on the order of 2,000 and wherein the number of cells in each row exposed to the full spectrum of light emanating from said light source is in the range of between 1 and 20.
3. The image scanning system of claim 1, wherein said means for exposing the first cell in each row to the full spectrum of light emanating from said source includes a white reference patch aligned with a portion of the subject from which light is reflected.
4. The image scanning system of claim 1, wherein said rows of photodetector cells are arranged in plural sets so that the cells of each set detect a spectral portion of light different from the spectral portion of light detected by another of said sets, whereby said calibration factor represents light value variation in the respective spectral portions of light to which each row is exposed.
5. The image scanning system of claim 1, wherein said calibration factor is of a numerical value greater than one.
6. In an image scanning system having a light source and a color balanced detector array including plural sets of detectors, each of said detectors detecting light from a subject, the detectors of each of said detector sets detecting a spectral portion of the light different from the spectral portion of the light detected by the detectors of another of said detector sets; means for scanning light from successive portions of the subject to said detector sets along a predetermined scanning path; and wherein each of said detector sets comprises a plurality of detectors arranged in rows and columns, the columns being parallel to said scanning path and the rows being transverse to said scanning path, each of said detectors providing a signal in response to a detection of light; and means synchronized with said scanning means for triggering said detectors to provide their respective signals in synchronism with the scanning along said scanning path; and means for retrieving column signals of the respective detector sets to provide imaging data of said subject, the improvement comprising:
means for exposing at least the first detector in each row of a set of detectors to the full spectrum of light emanating from said light source;
means for summing signals provided by said detectors in each column of each set to provide column signals in an ordered sequence from a first one of the columns to a last one of the columns;
means for processing at least said first column signal of each said set to obtain a calibration factor representing variation of light value emanating from said light source from a fixed value for that set; and
means for multiplying each said column signal succeeding said at least first column signal for that set by said calibration factor.
7. The image scanning system of claim 6, wherein said means for exposing at least the first detector in each row to the full spectrum of light emanating from said light source comprises a white reference patch adjacent to the subject from which light is reflected to the remaining detectors in each row.
8. The image scanning system of claim 7, in which the subject is advanced linearly relative to a fixed band of light emanating from said light source and wherein said a white reference patch is positioned along one side of the subject.
9. The image scanning system of claim 8, wherein said white reference patch is fixed in said band of illumination.
10. The method of calibrating the output of an image scanning photodetector array in which photodetector cells are arranged in at least one set comprising rows and columns with the rows oriented in a direction transverse to the direction of scan and in which signals are provided by the individual cells in response to exposure by light image pixels in turn developed by reflection of source light from a subject, said method comprising the steps of:
exposing at least the first cell in each row to the full spectrum of light emanating from said source light;
summing signals provided by the cells in each column of each set of photodetector cells to provide column signals in an ordered sequence from a first one of the columns to a last one of the columns;
processing at least the first column signal to obtain a calibration factor representing variation of said source light from a predetermined value; and
multiplying each column signal provided for each column succeeding said at least first column signal by said calibration factor to compensate for variations in light originating with said source light.
US07/398,897 1989-08-28 1989-08-28 Calibration system and method for color image scanning Expired - Lifetime US4980759A (en)

Priority Applications (9)

Application Number Priority Date Filing Date Title
US07/398,897 US4980759A (en) 1989-08-28 1989-08-28 Calibration system and method for color image scanning
CA002019725A CA2019725C (en) 1989-08-28 1990-06-25 Calibration system and method for color image scanning
ES90114601T ES2056314T3 (en) 1989-08-28 1990-07-30 CALIBRATION SYSTEM AND METHOD FOR EXPLORATION OF COLOR IMAGES.
DK90114601.9T DK0415100T3 (en) 1989-08-28 1990-07-30 Calibration system and color image scanning method
DE69008973T DE69008973T2 (en) 1989-08-28 1990-07-30 Calibration system and method for color image scanning methods.
EP90114601A EP0415100B1 (en) 1989-08-28 1990-07-30 Calibration system and method for color image scanning
DE199090114601T DE415100T1 (en) 1989-08-28 1990-07-30 CALIBRATION SYSTEM AND METHOD FOR COLOR IMAGE SCANING METHODS.
AT90114601T ATE105948T1 (en) 1989-08-28 1990-07-30 CALIBRATION SYSTEM AND METHODS FOR COLOR IMAGE SCANNING.
JP2224168A JP2501656B2 (en) 1989-08-28 1990-08-24 Image scanning device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US07/398,897 US4980759A (en) 1989-08-28 1989-08-28 Calibration system and method for color image scanning

Publications (1)

Publication Number Publication Date
US4980759A true US4980759A (en) 1990-12-25

Family

ID=23577249

Family Applications (1)

Application Number Title Priority Date Filing Date
US07/398,897 Expired - Lifetime US4980759A (en) 1989-08-28 1989-08-28 Calibration system and method for color image scanning

Country Status (8)

Country Link
US (1) US4980759A (en)
EP (1) EP0415100B1 (en)
JP (1) JP2501656B2 (en)
AT (1) ATE105948T1 (en)
CA (1) CA2019725C (en)
DE (2) DE69008973T2 (en)
DK (1) DK0415100T3 (en)
ES (1) ES2056314T3 (en)

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5075770A (en) * 1989-03-24 1991-12-24 Polaroid Corporation Color balanced image detector system
US5475769A (en) * 1992-07-13 1995-12-12 Polaroid Corporation Method and apparatus for recovering image data through the use of a color test pattern
US5652663A (en) * 1994-07-29 1997-07-29 Polaroid Corporation Preview buffer for electronic scanner
US5757425A (en) * 1995-12-19 1998-05-26 Eastman Kodak Company Method and apparatus for independently calibrating light source and photosensor arrays
US6466337B1 (en) * 1996-12-02 2002-10-15 Heidelberger Druckmaschinen Ag Process for calibrating a scanner
US6516101B1 (en) * 1997-10-09 2003-02-04 Mustek System, Inc. Image scanning device having image data correction function
US6900448B1 (en) * 2000-07-31 2005-05-31 Hewlett-Packard Development Company L.P. Method and system for dynamic scanner calibration
US20070002398A1 (en) * 2005-06-30 2007-01-04 Brother Kogyo Kabushiki Kaisha Image reader and method of producing thereof
US8279236B2 (en) 2000-04-11 2012-10-02 Rah Color Technologies Llc Methods and apparatus for calibrating a color display
US8339689B1 (en) * 2006-06-30 2012-12-25 Marvell International Ltd. Exposure correction for scanners
US8416444B2 (en) 1996-02-26 2013-04-09 Rah Color Technologies, Llc System for distributing and controlling color reproduction at multiple sites
US8537357B2 (en) 1997-08-25 2013-09-17 Rah Color Technologies Llc System for distributing and controlling color reproduction at multiple sites
US8638340B2 (en) 1996-02-26 2014-01-28 Rah Color Technologies Llc Color calibration of color image rendering devices
US20150241274A1 (en) * 2014-02-26 2015-08-27 Sensity Systems, Inc. Method and Apparatus for Luminaire Characterization
US20180167534A1 (en) * 2011-11-30 2018-06-14 Nobuyuki Satoh Image capturing unit, color measuring device, image forming apparatus, color measuring system and color measurement method

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5821993A (en) * 1996-01-25 1998-10-13 Medar, Inc. Method and system for automatically calibrating a color camera in a machine vision system
US20020100863A1 (en) * 2001-01-30 2002-08-01 Spears Kurt E. Optical image scanner with color and intensity compensation during lamp warmup
JP5962293B2 (en) * 2012-07-23 2016-08-03 富士ゼロックス株式会社 Image reading apparatus and image forming apparatus

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4136360A (en) * 1975-10-14 1979-01-23 Dr. Ing. Rudolf Hell Gmbh Apparatus including a circuit arrangement for adjusting the color signal levels of a white dot
US4174528A (en) * 1978-06-30 1979-11-13 International Business Machines Corporation Exposure control for document scanner arrays
US4661843A (en) * 1984-07-16 1987-04-28 Kabushiki Kaisha Toshiba Color image copying apparatus
US4677287A (en) * 1982-07-14 1987-06-30 Canon Kabushiki Kaisha Document reader with light source control
US4687919A (en) * 1984-02-01 1987-08-18 Sharp Kabushiki Kaisha A lighting control device in manuscript reproduction equipment
US4707615A (en) * 1982-04-13 1987-11-17 Tokyo Shibaura Denki Kabushiki Kaisha Solid state image sensor
US4710779A (en) * 1980-11-14 1987-12-01 Konishiroku Photo Industry Co., Ltd. Optical recording apparatus
US4712000A (en) * 1983-10-21 1987-12-08 Canon Kabushiki Kaisha Rotary encoder with source-adjacent light sampling and control
US4731661A (en) * 1984-11-16 1988-03-15 Sharp Kabushiki Kaisha Color document reader with white balance adjuster for determining light emission periods for a plurality of different-colored light sources and corresponding integration times for a light sensor by reading a white reference area
US4734762A (en) * 1982-10-20 1988-03-29 Canon Kabushiki Kaisha Color image reading apparatus with a plurality of line sensors in which a white balance operation is performed by determining amplifier gains while reading a white reference plate
US4745467A (en) * 1985-10-28 1988-05-17 Kabushiki Kaisha Toshiba Color image-processing apparatus
US4812900A (en) * 1985-10-17 1989-03-14 Canon Kabushiki Kaisha Original reading apparatus with light source switching without a switching circuit
US4862286A (en) * 1986-11-14 1989-08-29 Canon Kabushiki Kaisha Image reading apparatus which adjusts image signals to improve signal balance
US4866512A (en) * 1987-07-15 1989-09-12 Dainippon Screen Mfg. Co., Ltd. Method of and apparatus for reading image in corrected read timing

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
SU832773A1 (en) * 1978-08-18 1981-05-23 Всесоюзный Научно-Исследовательскийинститут Телевидения И Радиовещания Device for equalizing color-divided signals
DD140092A1 (en) * 1978-11-07 1980-02-06 Wolfgang Baer ARRANGEMENT FOR CHARACTERING COLOR GRAPHIC TEMPLATES
DE3364212D1 (en) * 1982-11-30 1986-07-24 Toshiba Kk Picture signal processing system suitable for displaying continuous tone pictures
IT1172646B (en) * 1983-09-21 1987-06-18 M S Sistemi Automatici Srl APPARATUS TO DETECT THE COLORING OF FLAT BODIES IN MOVEMENT AND SUITABLE FOR PROCESSING ELECTRIC SIGNALS THAT VARY ACCORDING TO THE COLOR QUALITY OF THE SAID BODIES APPARATUS PARTICULARLY SUITABLE FOR AUTOMATING THE CHOICE OF CERAMIC TILES AT THE PRODUCTION
JPS60236581A (en) * 1984-05-10 1985-11-25 Fuji Xerox Co Ltd Color picture reader
JPH0813078B2 (en) * 1984-07-23 1996-02-07 株式会社リコー Color original reading device
JPS63316567A (en) * 1987-06-19 1988-12-23 Mitsubishi Electric Corp Color image reader
JPH01307360A (en) * 1988-06-06 1989-12-12 Mitsubishi Electric Corp Color picture reader

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4136360A (en) * 1975-10-14 1979-01-23 Dr. Ing. Rudolf Hell Gmbh Apparatus including a circuit arrangement for adjusting the color signal levels of a white dot
US4174528A (en) * 1978-06-30 1979-11-13 International Business Machines Corporation Exposure control for document scanner arrays
US4710779A (en) * 1980-11-14 1987-12-01 Konishiroku Photo Industry Co., Ltd. Optical recording apparatus
US4707615A (en) * 1982-04-13 1987-11-17 Tokyo Shibaura Denki Kabushiki Kaisha Solid state image sensor
US4677287A (en) * 1982-07-14 1987-06-30 Canon Kabushiki Kaisha Document reader with light source control
US4734762A (en) * 1982-10-20 1988-03-29 Canon Kabushiki Kaisha Color image reading apparatus with a plurality of line sensors in which a white balance operation is performed by determining amplifier gains while reading a white reference plate
US4712000A (en) * 1983-10-21 1987-12-08 Canon Kabushiki Kaisha Rotary encoder with source-adjacent light sampling and control
US4687919A (en) * 1984-02-01 1987-08-18 Sharp Kabushiki Kaisha A lighting control device in manuscript reproduction equipment
US4661843A (en) * 1984-07-16 1987-04-28 Kabushiki Kaisha Toshiba Color image copying apparatus
US4731661A (en) * 1984-11-16 1988-03-15 Sharp Kabushiki Kaisha Color document reader with white balance adjuster for determining light emission periods for a plurality of different-colored light sources and corresponding integration times for a light sensor by reading a white reference area
US4812900A (en) * 1985-10-17 1989-03-14 Canon Kabushiki Kaisha Original reading apparatus with light source switching without a switching circuit
US4745467A (en) * 1985-10-28 1988-05-17 Kabushiki Kaisha Toshiba Color image-processing apparatus
US4862286A (en) * 1986-11-14 1989-08-29 Canon Kabushiki Kaisha Image reading apparatus which adjusts image signals to improve signal balance
US4866512A (en) * 1987-07-15 1989-09-12 Dainippon Screen Mfg. Co., Ltd. Method of and apparatus for reading image in corrected read timing

Cited By (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5075770A (en) * 1989-03-24 1991-12-24 Polaroid Corporation Color balanced image detector system
US5475769A (en) * 1992-07-13 1995-12-12 Polaroid Corporation Method and apparatus for recovering image data through the use of a color test pattern
US5652663A (en) * 1994-07-29 1997-07-29 Polaroid Corporation Preview buffer for electronic scanner
US5757425A (en) * 1995-12-19 1998-05-26 Eastman Kodak Company Method and apparatus for independently calibrating light source and photosensor arrays
US9036209B2 (en) 1996-02-26 2015-05-19 Rah Color Technologies Llc System for distributing and controlling color reproduction at multiple sites
US8638340B2 (en) 1996-02-26 2014-01-28 Rah Color Technologies Llc Color calibration of color image rendering devices
US8760704B2 (en) 1996-02-26 2014-06-24 Rah Color Technologies Llc System for distributing and controlling color reproduction at multiple sites
US8416444B2 (en) 1996-02-26 2013-04-09 Rah Color Technologies, Llc System for distributing and controlling color reproduction at multiple sites
US8817314B2 (en) 1996-02-26 2014-08-26 Rah Color Technologies Llc System for distributing and controlling color reproduction at multiple sites
US6466337B1 (en) * 1996-12-02 2002-10-15 Heidelberger Druckmaschinen Ag Process for calibrating a scanner
US9057645B2 (en) 1997-08-25 2015-06-16 Rah Color Technologies Llc System for distributing and controlling color reproduction at multiple sites
US8917394B2 (en) 1997-08-25 2014-12-23 Rah Color Technologies Llc System for distributing and controlling color reproduction at multiple sites
US9404802B2 (en) 1997-08-25 2016-08-02 Rah Color Technologies Llc System for distributing and controlling color reproduction at multiple sites
US9894338B2 (en) 1997-08-25 2018-02-13 Rah Color Technologies Llc System for distributing and controlling color reproduction at multiple sites
US8537357B2 (en) 1997-08-25 2013-09-17 Rah Color Technologies Llc System for distributing and controlling color reproduction at multiple sites
US6516101B1 (en) * 1997-10-09 2003-02-04 Mustek System, Inc. Image scanning device having image data correction function
US9767763B2 (en) 2000-04-11 2017-09-19 Rah Color Technologies Llc Methods and apparatus for calibrating a color display
US9500527B2 (en) 2000-04-11 2016-11-22 Rah Color Technologies Llc Methods and apparatus for calibrating a color display
US10008180B2 (en) 2000-04-11 2018-06-26 Rah Color Technologies Llc Methods and apparatus for calibrating a color display
US8279236B2 (en) 2000-04-11 2012-10-02 Rah Color Technologies Llc Methods and apparatus for calibrating a color display
US8665289B2 (en) 2000-04-11 2014-03-04 RAH Color Technology LLC Methods and apparatus for calibrating a color display
US6900448B1 (en) * 2000-07-31 2005-05-31 Hewlett-Packard Development Company L.P. Method and system for dynamic scanner calibration
US20050185227A1 (en) * 2000-07-31 2005-08-25 Thompson Robert D. Method and system for dynamic scanner calibration
US7856331B2 (en) * 2000-07-31 2010-12-21 Thompson Robert D Scanner calibration
US7978380B2 (en) * 2005-06-30 2011-07-12 Brother Kogyo Kabushiki Kaisha Image reader and method of producing thereof
US20070002398A1 (en) * 2005-06-30 2007-01-04 Brother Kogyo Kabushiki Kaisha Image reader and method of producing thereof
US9516288B2 (en) 2005-08-31 2016-12-06 Rah Color Technologies Llc Color calibration of color image rendering devices
US10038884B2 (en) 2005-08-31 2018-07-31 Rah Color Technologies Llc Color calibration of color image rendering devices
US10560676B2 (en) 2005-08-31 2020-02-11 Rah Color Technologies Llc Color calibration of color image rendering devices
US9894340B2 (en) 2005-08-31 2018-02-13 Rah Color Technologies Llc Color calibration of color image rendering devices
US9041988B1 (en) * 2006-06-30 2015-05-26 Marvell International Ltd. Exposure correction for scanners
US8339689B1 (en) * 2006-06-30 2012-12-25 Marvell International Ltd. Exposure correction for scanners
US8599453B1 (en) 2006-06-30 2013-12-03 Marvell International Ltd. Exposure correction for scanners
US20180167534A1 (en) * 2011-11-30 2018-06-14 Nobuyuki Satoh Image capturing unit, color measuring device, image forming apparatus, color measuring system and color measurement method
US10244147B2 (en) * 2011-11-30 2019-03-26 Ricoh Company, Ltd. Image capturing device and color measurement method for capturing a reference chart and a subject
US10674041B2 (en) 2011-11-30 2020-06-02 Ricoh Company, Ltd. Image capturing unit, color measuring device, image forming apparatus, color measuring system and color measurement method for capturing a reference chart and a subject
CN106233104B (en) * 2014-02-26 2018-01-09 赛西蒂系统股份有限公司 The method and apparatus characterized for luminaire
US9746370B2 (en) * 2014-02-26 2017-08-29 Sensity Systems Inc. Method and apparatus for measuring illumination characteristics of a luminaire
US20150241274A1 (en) * 2014-02-26 2015-08-27 Sensity Systems, Inc. Method and Apparatus for Luminaire Characterization
CN106233104A (en) * 2014-02-26 2016-12-14 赛西蒂系统股份有限公司 The method and apparatus characterized for illumination apparatus

Also Published As

Publication number Publication date
CA2019725C (en) 2000-08-29
EP0415100A3 (en) 1991-04-10
ATE105948T1 (en) 1994-06-15
DE69008973T2 (en) 1994-09-01
DE415100T1 (en) 1991-07-04
ES2056314T3 (en) 1994-10-01
CA2019725A1 (en) 1991-02-28
DE69008973D1 (en) 1994-06-23
JP2501656B2 (en) 1996-05-29
DK0415100T3 (en) 1994-06-20
EP0415100B1 (en) 1994-05-18
EP0415100A2 (en) 1991-03-06
JPH03132254A (en) 1991-06-05

Similar Documents

Publication Publication Date Title
US4980759A (en) Calibration system and method for color image scanning
EP0388658B1 (en) Color balanced image detector system
US6008905A (en) Method and apparatus for determining the appearance of an object
CA1045252A (en) Inspection of masks and wafers by image dissection
US4538353A (en) Electronic foot measuring apparatus and method
EP0080699B1 (en) Densitometer
US4282510A (en) Apparatus for discerning the noticeable presence of spatial fluctuations of intensity within a two-dimensional visual field
EP0490045B1 (en) Single-scan time delay and integration color imaging system
WO2007087372A2 (en) Spatial image modulation to improve performance of computed tomography imaging spectrometer
JPH02120847A (en) Exposure control and photographic color copying machine
JPH0758908A (en) Method and equipment for correction of color overlap error
US7876434B2 (en) Color camera computed tomography imaging spectrometer for improved spatial-spectral image accuracy
US5208674A (en) Micro-dispersion electronic camera
JPS62188473A (en) Method of creating electronic display of original image
US4698515A (en) Method of operating radiation sensors
US3778166A (en) Bipolar area correlator
US6215962B1 (en) Illumination detecting camera
EP0137777B1 (en) Reconstitution of images
EP4264941A1 (en) An image sensing system
JPS60177337A (en) Method for determining exposure in photographic printing
JPS5992667A (en) Multicolor reader
JPH09186823A (en) Image reader
JPS5875043A (en) Signal processing system of mtf measuring machine

Legal Events

Date Code Title Description
AS Assignment

Owner name: POLAROID CORPORATION, A CORP OF DE, MASSACHUSETTS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST.;ASSIGNOR:SMYTH, WILLIAM K.;REEL/FRAME:005131/0084

Effective date: 19890816

STCF Information on status: patent grant

Free format text: PATENTED CASE

FPAY Fee payment

Year of fee payment: 4

FPAY Fee payment

Year of fee payment: 8

AS Assignment

Owner name: MORGAN GUARANTY TRUST COMPANY OF NEW YORK, NEW YOR

Free format text: SECURITY AGREEMENT;ASSIGNOR:POLAROID CORPORATION;REEL/FRAME:011658/0699

Effective date: 20010321

FPAY Fee payment

Year of fee payment: 12

AS Assignment

Owner name: OEP IMAGINIG OPERATING CORPORATION, NEW YORK

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:POLAROID CORPORATION;REEL/FRAME:016427/0144

Effective date: 20020731

Owner name: POLAROID CORPORATION, NEW YORK

Free format text: CHANGE OF NAME;ASSIGNOR:OEP IMAGING OPERATING CORPORATION;REEL/FRAME:016470/0006

Effective date: 20020801

Owner name: OEP IMAGINIG OPERATING CORPORATION,NEW YORK

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:POLAROID CORPORATION;REEL/FRAME:016427/0144

Effective date: 20020731

Owner name: POLAROID CORPORATION,NEW YORK

Free format text: CHANGE OF NAME;ASSIGNOR:OEP IMAGING OPERATING CORPORATION;REEL/FRAME:016470/0006

Effective date: 20020801

AS Assignment

Owner name: WILMINGTON TRUST COMPANY, AS COLLATERAL AGENT, DEL

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:POLAROLD HOLDING COMPANY;POLAROID CORPORATION;POLAROID ASIA PACIFIC LLC;AND OTHERS;REEL/FRAME:016602/0332

Effective date: 20050428

Owner name: JPMORGAN CHASE BANK,N.A,AS ADMINISTRATIVE AGENT, W

Free format text: SECURITY INTEREST;ASSIGNORS:POLAROID HOLDING COMPANY;POLAROID CORPORATION;POLAROID ASIA PACIFIC LLC;AND OTHERS;REEL/FRAME:016602/0603

Effective date: 20050428

Owner name: WILMINGTON TRUST COMPANY, AS COLLATERAL AGENT,DELA

Free format text: SECURITY AGREEMENT;ASSIGNORS:POLAROLD HOLDING COMPANY;POLAROID CORPORATION;POLAROID ASIA PACIFIC LLC;AND OTHERS;REEL/FRAME:016602/0332

Effective date: 20050428

Owner name: JPMORGAN CHASE BANK,N.A,AS ADMINISTRATIVE AGENT,WI

Free format text: SECURITY INTEREST;ASSIGNORS:POLAROID HOLDING COMPANY;POLAROID CORPORATION;POLAROID ASIA PACIFIC LLC;AND OTHERS;REEL/FRAME:016602/0603

Effective date: 20050428

Owner name: WILMINGTON TRUST COMPANY, AS COLLATERAL AGENT, DEL

Free format text: SECURITY AGREEMENT;ASSIGNORS:POLAROLD HOLDING COMPANY;POLAROID CORPORATION;POLAROID ASIA PACIFIC LLC;AND OTHERS;REEL/FRAME:016602/0332

Effective date: 20050428

AS Assignment

Owner name: POLAROID CORPORATION (F/K/A OEP IMAGING OPERATING

Free format text: U.S. BANKRUPTCY COURT DISTRICT OF DELAWARE ORDER AUTHORIZING RELEASE OF ALL LIENS;ASSIGNOR:JPMORGAN CHASE BANK, N.A. (F/K/A MORGAN GUARANTY TRUST COMPANY OF NEW YORK);REEL/FRAME:016621/0377

Effective date: 20020418

AS Assignment

Owner name: OEP IMAGING OPERATING CORPORATION,NEW YORK

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:POLAROID CORPORATION;REEL/FRAME:018584/0600

Effective date: 20020731

Owner name: OEP IMAGING OPERATING CORPORATION, NEW YORK

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:POLAROID CORPORATION;REEL/FRAME:018584/0600

Effective date: 20020731

AS Assignment

Owner name: POLAROID CORPORATION (FMR OEP IMAGING OPERATING CO

Free format text: SUPPLEMENTAL ASSIGNMENT OF PATENTS;ASSIGNOR:PRIMARY PDC, INC. (FMR POLAROID CORPORATION);REEL/FRAME:019077/0001

Effective date: 20070122

AS Assignment

Owner name: POLAROID HOLDING COMPANY, MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WILMINGTON TRUST COMPANY;REEL/FRAME:019699/0512

Effective date: 20070425

Owner name: POLAROID CORPORATION, MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WILMINGTON TRUST COMPANY;REEL/FRAME:019699/0512

Effective date: 20070425

Owner name: POLAROID CAPITAL LLC, MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WILMINGTON TRUST COMPANY;REEL/FRAME:019699/0512

Effective date: 20070425

Owner name: POLAROID ASIA PACIFIC LLC, MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WILMINGTON TRUST COMPANY;REEL/FRAME:019699/0512

Effective date: 20070425

Owner name: POLAROID EYEWEAR LLC, MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WILMINGTON TRUST COMPANY;REEL/FRAME:019699/0512

Effective date: 20070425

Owner name: POLOROID INTERNATIONAL HOLDING LLC, MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WILMINGTON TRUST COMPANY;REEL/FRAME:019699/0512

Effective date: 20070425

Owner name: POLAROID INVESTMENT LLC, MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WILMINGTON TRUST COMPANY;REEL/FRAME:019699/0512

Effective date: 20070425

Owner name: POLAROID LATIN AMERICA I CORPORATION, MASSACHUSETT

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WILMINGTON TRUST COMPANY;REEL/FRAME:019699/0512

Effective date: 20070425

Owner name: POLAROID NEW BEDFORD REAL ESTATE LLC, MASSACHUSETT

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WILMINGTON TRUST COMPANY;REEL/FRAME:019699/0512

Effective date: 20070425

Owner name: POLAROID NORWOOD REAL ESTATE LLC, MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WILMINGTON TRUST COMPANY;REEL/FRAME:019699/0512

Effective date: 20070425

Owner name: POLAROID WALTHAM REAL ESTATE LLC, MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WILMINGTON TRUST COMPANY;REEL/FRAME:019699/0512

Effective date: 20070425

Owner name: PETTERS CONSUMER BRANDS, LLC, MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WILMINGTON TRUST COMPANY;REEL/FRAME:019699/0512

Effective date: 20070425

Owner name: PETTERS CONSUMER BRANDS INTERNATIONAL, LLC, MASSAC

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WILMINGTON TRUST COMPANY;REEL/FRAME:019699/0512

Effective date: 20070425

Owner name: ZINK INCORPORATED, MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WILMINGTON TRUST COMPANY;REEL/FRAME:019699/0512

Effective date: 20070425

Owner name: POLAROID HOLDING COMPANY,MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WILMINGTON TRUST COMPANY;REEL/FRAME:019699/0512

Effective date: 20070425

Owner name: POLAROID CORPORATION,MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WILMINGTON TRUST COMPANY;REEL/FRAME:019699/0512

Effective date: 20070425

Owner name: POLAROID CAPITAL LLC,MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WILMINGTON TRUST COMPANY;REEL/FRAME:019699/0512

Effective date: 20070425

Owner name: POLAROID ASIA PACIFIC LLC,MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WILMINGTON TRUST COMPANY;REEL/FRAME:019699/0512

Effective date: 20070425

Owner name: POLAROID EYEWEAR LLC,MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WILMINGTON TRUST COMPANY;REEL/FRAME:019699/0512

Effective date: 20070425

Owner name: POLOROID INTERNATIONAL HOLDING LLC,MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WILMINGTON TRUST COMPANY;REEL/FRAME:019699/0512

Effective date: 20070425

Owner name: POLAROID INVESTMENT LLC,MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WILMINGTON TRUST COMPANY;REEL/FRAME:019699/0512

Effective date: 20070425

Owner name: POLAROID LATIN AMERICA I CORPORATION,MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WILMINGTON TRUST COMPANY;REEL/FRAME:019699/0512

Effective date: 20070425

Owner name: POLAROID NEW BEDFORD REAL ESTATE LLC,MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WILMINGTON TRUST COMPANY;REEL/FRAME:019699/0512

Effective date: 20070425

Owner name: POLAROID NORWOOD REAL ESTATE LLC,MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WILMINGTON TRUST COMPANY;REEL/FRAME:019699/0512

Effective date: 20070425

Owner name: POLAROID WALTHAM REAL ESTATE LLC,MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WILMINGTON TRUST COMPANY;REEL/FRAME:019699/0512

Effective date: 20070425

Owner name: PETTERS CONSUMER BRANDS, LLC,MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WILMINGTON TRUST COMPANY;REEL/FRAME:019699/0512

Effective date: 20070425

Owner name: PETTERS CONSUMER BRANDS INTERNATIONAL, LLC,MASSACH

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WILMINGTON TRUST COMPANY;REEL/FRAME:019699/0512

Effective date: 20070425

Owner name: ZINK INCORPORATED,MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:WILMINGTON TRUST COMPANY;REEL/FRAME:019699/0512

Effective date: 20070425

AS Assignment

Owner name: POLAROID HOLDING COMPANY, MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:JPMORGAN CHASE BANK, N.A.;REEL/FRAME:020733/0001

Effective date: 20080225

Owner name: POLAROID INTERNATIONAL HOLDING LLC, MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:JPMORGAN CHASE BANK, N.A.;REEL/FRAME:020733/0001

Effective date: 20080225

Owner name: POLAROID INVESTMENT LLC, MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:JPMORGAN CHASE BANK, N.A.;REEL/FRAME:020733/0001

Effective date: 20080225

Owner name: POLAROID LATIN AMERICA I CORPORATION, MASSACHUSETT

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:JPMORGAN CHASE BANK, N.A.;REEL/FRAME:020733/0001

Effective date: 20080225

Owner name: POLAROID NEW BEDFORD REAL ESTATE LLC, MASSACHUSETT

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:JPMORGAN CHASE BANK, N.A.;REEL/FRAME:020733/0001

Effective date: 20080225

Owner name: POLAROID NORWOOD REAL ESTATE LLC, MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:JPMORGAN CHASE BANK, N.A.;REEL/FRAME:020733/0001

Effective date: 20080225

Owner name: POLAROID WALTHAM REAL ESTATE LLC, MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:JPMORGAN CHASE BANK, N.A.;REEL/FRAME:020733/0001

Effective date: 20080225

Owner name: POLAROID CONSUMER ELECTRONICS, LLC, (FORMERLY KNOW

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:JPMORGAN CHASE BANK, N.A.;REEL/FRAME:020733/0001

Effective date: 20080225

Owner name: POLAROID CONSUMER ELECTRONICS INTERNATIONAL, LLC,

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:JPMORGAN CHASE BANK, N.A.;REEL/FRAME:020733/0001

Effective date: 20080225

Owner name: ZINK INCORPORATED, MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:JPMORGAN CHASE BANK, N.A.;REEL/FRAME:020733/0001

Effective date: 20080225

Owner name: POLAROID CORPORATION, MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:JPMORGAN CHASE BANK, N.A.;REEL/FRAME:020733/0001

Effective date: 20080225

Owner name: POLAROID ASIA PACIFIC LLC, MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:JPMORGAN CHASE BANK, N.A.;REEL/FRAME:020733/0001

Effective date: 20080225

Owner name: POLAROID CAPITAL LLC, MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:JPMORGAN CHASE BANK, N.A.;REEL/FRAME:020733/0001

Effective date: 20080225

Owner name: PLLAROID EYEWEAR I LLC, MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:JPMORGAN CHASE BANK, N.A.;REEL/FRAME:020733/0001

Effective date: 20080225

Owner name: POLAROID HOLDING COMPANY,MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:JPMORGAN CHASE BANK, N.A.;REEL/FRAME:020733/0001

Effective date: 20080225

Owner name: POLAROID INTERNATIONAL HOLDING LLC,MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:JPMORGAN CHASE BANK, N.A.;REEL/FRAME:020733/0001

Effective date: 20080225

Owner name: POLAROID INVESTMENT LLC,MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:JPMORGAN CHASE BANK, N.A.;REEL/FRAME:020733/0001

Effective date: 20080225

Owner name: POLAROID LATIN AMERICA I CORPORATION,MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:JPMORGAN CHASE BANK, N.A.;REEL/FRAME:020733/0001

Effective date: 20080225

Owner name: POLAROID NEW BEDFORD REAL ESTATE LLC,MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:JPMORGAN CHASE BANK, N.A.;REEL/FRAME:020733/0001

Effective date: 20080225

Owner name: POLAROID NORWOOD REAL ESTATE LLC,MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:JPMORGAN CHASE BANK, N.A.;REEL/FRAME:020733/0001

Effective date: 20080225

Owner name: POLAROID WALTHAM REAL ESTATE LLC,MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:JPMORGAN CHASE BANK, N.A.;REEL/FRAME:020733/0001

Effective date: 20080225

Owner name: ZINK INCORPORATED,MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:JPMORGAN CHASE BANK, N.A.;REEL/FRAME:020733/0001

Effective date: 20080225

Owner name: POLAROID CORPORATION,MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:JPMORGAN CHASE BANK, N.A.;REEL/FRAME:020733/0001

Effective date: 20080225

Owner name: POLAROID ASIA PACIFIC LLC,MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:JPMORGAN CHASE BANK, N.A.;REEL/FRAME:020733/0001

Effective date: 20080225

Owner name: POLAROID CAPITAL LLC,MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:JPMORGAN CHASE BANK, N.A.;REEL/FRAME:020733/0001

Effective date: 20080225

Owner name: PLLAROID EYEWEAR I LLC,MASSACHUSETTS

Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:JPMORGAN CHASE BANK, N.A.;REEL/FRAME:020733/0001

Effective date: 20080225

AS Assignment

Owner name: SENSHIN CAPITAL, LLC, DELAWARE

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:POLAROID CORPORATION;REEL/FRAME:021040/0001

Effective date: 20080415

Owner name: SENSHIN CAPITAL, LLC,DELAWARE

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:POLAROID CORPORATION;REEL/FRAME:021040/0001

Effective date: 20080415

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Free format text: PAYER NUMBER DE-ASSIGNED (ORIGINAL EVENT CODE: RMPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY